00:00:00.001 Started by upstream project "autotest-per-patch" build number 130870 00:00:00.001 originally caused by: 00:00:00.001 Started by user sys_sgci 00:00:00.032 Checking out git https://review.spdk.io/gerrit/a/build_pool/jenkins_build_pool into /var/jenkins_home/workspace/nvmf-tcp-vg-autotest_script/33b20b30f0a51e6b52980845e0f6aa336787973ad45e341fbbf98d1b65b265d4 to read jbp/jenkins/jjb-config/jobs/autotest-downstream/autotest-vg.groovy 00:00:04.301 The recommended git tool is: git 00:00:04.301 using credential 00000000-0000-0000-0000-000000000002 00:00:04.303 > git rev-parse --resolve-git-dir /var/jenkins_home/workspace/nvmf-tcp-vg-autotest_script/33b20b30f0a51e6b52980845e0f6aa336787973ad45e341fbbf98d1b65b265d4/jbp/.git # timeout=10 00:00:04.315 Fetching changes from the remote Git repository 00:00:04.317 > git config remote.origin.url https://review.spdk.io/gerrit/a/build_pool/jenkins_build_pool # timeout=10 00:00:04.329 Using shallow fetch with depth 1 00:00:04.329 Fetching upstream changes from https://review.spdk.io/gerrit/a/build_pool/jenkins_build_pool 00:00:04.329 > git --version # timeout=10 00:00:04.340 > git --version # 'git version 2.39.2' 00:00:04.340 using GIT_ASKPASS to set credentials SPDKCI HTTPS Credentials 00:00:04.353 Setting http proxy: proxy-dmz.intel.com:911 00:00:04.353 > git fetch --tags --force --progress --depth=1 -- https://review.spdk.io/gerrit/a/build_pool/jenkins_build_pool refs/heads/master # timeout=5 00:00:08.488 > git rev-parse origin/FETCH_HEAD^{commit} # timeout=10 00:00:08.500 > git rev-parse FETCH_HEAD^{commit} # timeout=10 00:00:08.513 Checking out Revision f95f9907808933a1db7196e15e13478e0f322ee7 (FETCH_HEAD) 00:00:08.513 > git config core.sparsecheckout # timeout=10 00:00:08.526 > git read-tree -mu HEAD # timeout=10 00:00:08.542 > git checkout -f f95f9907808933a1db7196e15e13478e0f322ee7 # timeout=5 00:00:08.561 Commit message: "Revert "autotest-phy: replace deprecated label for nvmf-cvl"" 00:00:08.561 > git rev-list --no-walk f95f9907808933a1db7196e15e13478e0f322ee7 # timeout=10 00:00:08.700 [Pipeline] Start of Pipeline 00:00:08.712 [Pipeline] library 00:00:08.713 Loading library shm_lib@master 00:00:08.713 Library shm_lib@master is cached. Copying from home. 00:00:08.727 [Pipeline] node 00:00:08.733 Running on VM-host-SM0 in /var/jenkins/workspace/nvmf-tcp-vg-autotest_4 00:00:08.735 [Pipeline] { 00:00:08.742 [Pipeline] catchError 00:00:08.743 [Pipeline] { 00:00:08.753 [Pipeline] wrap 00:00:08.758 [Pipeline] { 00:00:08.764 [Pipeline] stage 00:00:08.765 [Pipeline] { (Prologue) 00:00:08.782 [Pipeline] echo 00:00:08.783 Node: VM-host-SM0 00:00:08.789 [Pipeline] cleanWs 00:00:08.798 [WS-CLEANUP] Deleting project workspace... 00:00:08.798 [WS-CLEANUP] Deferred wipeout is used... 00:00:08.803 [WS-CLEANUP] done 00:00:09.156 [Pipeline] setCustomBuildProperty 00:00:09.230 [Pipeline] httpRequest 00:00:09.865 [Pipeline] echo 00:00:09.866 Sorcerer 10.211.164.101 is alive 00:00:09.872 [Pipeline] retry 00:00:09.873 [Pipeline] { 00:00:09.881 [Pipeline] httpRequest 00:00:09.886 HttpMethod: GET 00:00:09.886 URL: http://10.211.164.101/packages/jbp_f95f9907808933a1db7196e15e13478e0f322ee7.tar.gz 00:00:09.887 Sending request to url: http://10.211.164.101/packages/jbp_f95f9907808933a1db7196e15e13478e0f322ee7.tar.gz 00:00:09.899 Response Code: HTTP/1.1 200 OK 00:00:09.900 Success: Status code 200 is in the accepted range: 200,404 00:00:09.900 Saving response body to /var/jenkins/workspace/nvmf-tcp-vg-autotest_4/jbp_f95f9907808933a1db7196e15e13478e0f322ee7.tar.gz 00:00:22.265 [Pipeline] } 00:00:22.282 [Pipeline] // retry 00:00:22.289 [Pipeline] sh 00:00:22.572 + tar --no-same-owner -xf jbp_f95f9907808933a1db7196e15e13478e0f322ee7.tar.gz 00:00:22.620 [Pipeline] httpRequest 00:00:23.013 [Pipeline] echo 00:00:23.014 Sorcerer 10.211.164.101 is alive 00:00:23.020 [Pipeline] retry 00:00:23.021 [Pipeline] { 00:00:23.031 [Pipeline] httpRequest 00:00:23.034 HttpMethod: GET 00:00:23.035 URL: http://10.211.164.101/packages/spdk_2a4f56c54d9adf89f0a3da3351edcad2c0a1ed33.tar.gz 00:00:23.035 Sending request to url: http://10.211.164.101/packages/spdk_2a4f56c54d9adf89f0a3da3351edcad2c0a1ed33.tar.gz 00:00:23.042 Response Code: HTTP/1.1 200 OK 00:00:23.042 Success: Status code 200 is in the accepted range: 200,404 00:00:23.043 Saving response body to /var/jenkins/workspace/nvmf-tcp-vg-autotest_4/spdk_2a4f56c54d9adf89f0a3da3351edcad2c0a1ed33.tar.gz 00:04:37.651 [Pipeline] } 00:04:37.667 [Pipeline] // retry 00:04:37.672 [Pipeline] sh 00:04:37.943 + tar --no-same-owner -xf spdk_2a4f56c54d9adf89f0a3da3351edcad2c0a1ed33.tar.gz 00:04:41.232 [Pipeline] sh 00:04:41.510 + git -C spdk log --oneline -n5 00:04:41.510 2a4f56c54 bdev/nvme: controller failover/multipath doc change 00:04:41.510 d16db39ee bdev/nvme: removed 'multipath' param from spdk_bdev_nvme_create() 00:04:41.510 32fb30b70 bdev/nvme: changed default config to multipath 00:04:41.510 397c5fc31 bdev/nvme: ctrl config consistency check 00:04:41.510 3950cd1bb bdev/nvme: Change spdk_bdev_reset() to succeed if at least one nvme_ctrlr is reconnected 00:04:41.527 [Pipeline] writeFile 00:04:41.542 [Pipeline] sh 00:04:41.881 + jbp/jenkins/jjb-config/jobs/scripts/autorun_quirks.sh 00:04:41.892 [Pipeline] sh 00:04:42.169 + cat autorun-spdk.conf 00:04:42.170 SPDK_RUN_FUNCTIONAL_TEST=1 00:04:42.170 SPDK_TEST_NVMF=1 00:04:42.170 SPDK_TEST_NVMF_TRANSPORT=tcp 00:04:42.170 SPDK_TEST_USDT=1 00:04:42.170 SPDK_TEST_NVMF_MDNS=1 00:04:42.170 SPDK_RUN_UBSAN=1 00:04:42.170 NET_TYPE=virt 00:04:42.170 SPDK_JSONRPC_GO_CLIENT=1 00:04:42.170 SPDK_ABI_DIR=/home/vagrant/spdk_repo/spdk-abi 00:04:42.176 RUN_NIGHTLY=0 00:04:42.178 [Pipeline] } 00:04:42.190 [Pipeline] // stage 00:04:42.203 [Pipeline] stage 00:04:42.205 [Pipeline] { (Run VM) 00:04:42.217 [Pipeline] sh 00:04:42.497 + jbp/jenkins/jjb-config/jobs/scripts/prepare_nvme.sh 00:04:42.497 + echo 'Start stage prepare_nvme.sh' 00:04:42.497 Start stage prepare_nvme.sh 00:04:42.497 + [[ -n 6 ]] 00:04:42.497 + disk_prefix=ex6 00:04:42.497 + [[ -n /var/jenkins/workspace/nvmf-tcp-vg-autotest_4 ]] 00:04:42.497 + [[ -e /var/jenkins/workspace/nvmf-tcp-vg-autotest_4/autorun-spdk.conf ]] 00:04:42.497 + source /var/jenkins/workspace/nvmf-tcp-vg-autotest_4/autorun-spdk.conf 00:04:42.497 ++ SPDK_RUN_FUNCTIONAL_TEST=1 00:04:42.497 ++ SPDK_TEST_NVMF=1 00:04:42.497 ++ SPDK_TEST_NVMF_TRANSPORT=tcp 00:04:42.497 ++ SPDK_TEST_USDT=1 00:04:42.497 ++ SPDK_TEST_NVMF_MDNS=1 00:04:42.497 ++ SPDK_RUN_UBSAN=1 00:04:42.497 ++ NET_TYPE=virt 00:04:42.497 ++ SPDK_JSONRPC_GO_CLIENT=1 00:04:42.497 ++ SPDK_ABI_DIR=/home/vagrant/spdk_repo/spdk-abi 00:04:42.497 ++ RUN_NIGHTLY=0 00:04:42.497 + cd /var/jenkins/workspace/nvmf-tcp-vg-autotest_4 00:04:42.497 + nvme_files=() 00:04:42.497 + declare -A nvme_files 00:04:42.497 + backend_dir=/var/lib/libvirt/images/backends 00:04:42.497 + nvme_files['nvme.img']=5G 00:04:42.497 + nvme_files['nvme-cmb.img']=5G 00:04:42.497 + nvme_files['nvme-multi0.img']=4G 00:04:42.498 + nvme_files['nvme-multi1.img']=4G 00:04:42.498 + nvme_files['nvme-multi2.img']=4G 00:04:42.498 + nvme_files['nvme-openstack.img']=8G 00:04:42.498 + nvme_files['nvme-zns.img']=5G 00:04:42.498 + (( SPDK_TEST_NVME_PMR == 1 )) 00:04:42.498 + (( SPDK_TEST_FTL == 1 )) 00:04:42.498 + (( SPDK_TEST_NVME_FDP == 1 )) 00:04:42.498 + [[ ! -d /var/lib/libvirt/images/backends ]] 00:04:42.498 + for nvme in "${!nvme_files[@]}" 00:04:42.498 + sudo -E spdk/scripts/vagrant/create_nvme_img.sh -n /var/lib/libvirt/images/backends/ex6-nvme-multi2.img -s 4G 00:04:42.498 Formatting '/var/lib/libvirt/images/backends/ex6-nvme-multi2.img', fmt=raw size=4294967296 preallocation=falloc 00:04:42.498 + for nvme in "${!nvme_files[@]}" 00:04:42.498 + sudo -E spdk/scripts/vagrant/create_nvme_img.sh -n /var/lib/libvirt/images/backends/ex6-nvme-cmb.img -s 5G 00:04:42.498 Formatting '/var/lib/libvirt/images/backends/ex6-nvme-cmb.img', fmt=raw size=5368709120 preallocation=falloc 00:04:42.498 + for nvme in "${!nvme_files[@]}" 00:04:42.498 + sudo -E spdk/scripts/vagrant/create_nvme_img.sh -n /var/lib/libvirt/images/backends/ex6-nvme-openstack.img -s 8G 00:04:42.498 Formatting '/var/lib/libvirt/images/backends/ex6-nvme-openstack.img', fmt=raw size=8589934592 preallocation=falloc 00:04:42.498 + for nvme in "${!nvme_files[@]}" 00:04:42.498 + sudo -E spdk/scripts/vagrant/create_nvme_img.sh -n /var/lib/libvirt/images/backends/ex6-nvme-zns.img -s 5G 00:04:42.498 Formatting '/var/lib/libvirt/images/backends/ex6-nvme-zns.img', fmt=raw size=5368709120 preallocation=falloc 00:04:42.498 + for nvme in "${!nvme_files[@]}" 00:04:42.498 + sudo -E spdk/scripts/vagrant/create_nvme_img.sh -n /var/lib/libvirt/images/backends/ex6-nvme-multi1.img -s 4G 00:04:42.498 Formatting '/var/lib/libvirt/images/backends/ex6-nvme-multi1.img', fmt=raw size=4294967296 preallocation=falloc 00:04:42.498 + for nvme in "${!nvme_files[@]}" 00:04:42.498 + sudo -E spdk/scripts/vagrant/create_nvme_img.sh -n /var/lib/libvirt/images/backends/ex6-nvme-multi0.img -s 4G 00:04:42.498 Formatting '/var/lib/libvirt/images/backends/ex6-nvme-multi0.img', fmt=raw size=4294967296 preallocation=falloc 00:04:42.498 + for nvme in "${!nvme_files[@]}" 00:04:42.498 + sudo -E spdk/scripts/vagrant/create_nvme_img.sh -n /var/lib/libvirt/images/backends/ex6-nvme.img -s 5G 00:04:42.754 Formatting '/var/lib/libvirt/images/backends/ex6-nvme.img', fmt=raw size=5368709120 preallocation=falloc 00:04:42.754 ++ sudo grep -rl ex6-nvme.img /etc/libvirt/qemu 00:04:42.754 + echo 'End stage prepare_nvme.sh' 00:04:42.754 End stage prepare_nvme.sh 00:04:42.763 [Pipeline] sh 00:04:43.057 + DISTRO=fedora39 CPUS=10 RAM=12288 jbp/jenkins/jjb-config/jobs/scripts/vagrant_create_vm.sh 00:04:43.057 Setup: -n 10 -s 12288 -x http://proxy-dmz.intel.com:911 -p libvirt --qemu-emulator=/usr/local/qemu/vanilla-v8.0.0/bin/qemu-system-x86_64 --nic-model=e1000 -b /var/lib/libvirt/images/backends/ex6-nvme.img -b /var/lib/libvirt/images/backends/ex6-nvme-multi0.img,nvme,/var/lib/libvirt/images/backends/ex6-nvme-multi1.img:/var/lib/libvirt/images/backends/ex6-nvme-multi2.img -H -a -v -f fedora39 00:04:43.057 00:04:43.057 DIR=/var/jenkins/workspace/nvmf-tcp-vg-autotest_4/spdk/scripts/vagrant 00:04:43.057 SPDK_DIR=/var/jenkins/workspace/nvmf-tcp-vg-autotest_4/spdk 00:04:43.057 VAGRANT_TARGET=/var/jenkins/workspace/nvmf-tcp-vg-autotest_4 00:04:43.057 HELP=0 00:04:43.057 DRY_RUN=0 00:04:43.057 NVME_FILE=/var/lib/libvirt/images/backends/ex6-nvme.img,/var/lib/libvirt/images/backends/ex6-nvme-multi0.img, 00:04:43.057 NVME_DISKS_TYPE=nvme,nvme, 00:04:43.057 NVME_AUTO_CREATE=0 00:04:43.057 NVME_DISKS_NAMESPACES=,/var/lib/libvirt/images/backends/ex6-nvme-multi1.img:/var/lib/libvirt/images/backends/ex6-nvme-multi2.img, 00:04:43.057 NVME_CMB=,, 00:04:43.057 NVME_PMR=,, 00:04:43.057 NVME_ZNS=,, 00:04:43.057 NVME_MS=,, 00:04:43.057 NVME_FDP=,, 00:04:43.057 SPDK_VAGRANT_DISTRO=fedora39 00:04:43.057 SPDK_VAGRANT_VMCPU=10 00:04:43.057 SPDK_VAGRANT_VMRAM=12288 00:04:43.057 SPDK_VAGRANT_PROVIDER=libvirt 00:04:43.058 SPDK_VAGRANT_HTTP_PROXY=http://proxy-dmz.intel.com:911 00:04:43.058 SPDK_QEMU_EMULATOR=/usr/local/qemu/vanilla-v8.0.0/bin/qemu-system-x86_64 00:04:43.058 SPDK_OPENSTACK_NETWORK=0 00:04:43.058 VAGRANT_PACKAGE_BOX=0 00:04:43.058 VAGRANTFILE=/var/jenkins/workspace/nvmf-tcp-vg-autotest_4/spdk/scripts/vagrant/Vagrantfile 00:04:43.058 FORCE_DISTRO=true 00:04:43.058 VAGRANT_BOX_VERSION= 00:04:43.058 EXTRA_VAGRANTFILES= 00:04:43.058 NIC_MODEL=e1000 00:04:43.058 00:04:43.058 mkdir: created directory '/var/jenkins/workspace/nvmf-tcp-vg-autotest_4/fedora39-libvirt' 00:04:43.058 /var/jenkins/workspace/nvmf-tcp-vg-autotest_4/fedora39-libvirt /var/jenkins/workspace/nvmf-tcp-vg-autotest_4 00:04:46.340 Bringing machine 'default' up with 'libvirt' provider... 00:04:46.907 ==> default: Creating image (snapshot of base box volume). 00:04:47.172 ==> default: Creating domain with the following settings... 00:04:47.172 ==> default: -- Name: fedora39-39-1.5-1721788873-2326_default_1728299742_7e60aadc8830418c78e0 00:04:47.172 ==> default: -- Domain type: kvm 00:04:47.172 ==> default: -- Cpus: 10 00:04:47.172 ==> default: -- Feature: acpi 00:04:47.172 ==> default: -- Feature: apic 00:04:47.172 ==> default: -- Feature: pae 00:04:47.172 ==> default: -- Memory: 12288M 00:04:47.172 ==> default: -- Memory Backing: hugepages: 00:04:47.172 ==> default: -- Management MAC: 00:04:47.172 ==> default: -- Loader: 00:04:47.172 ==> default: -- Nvram: 00:04:47.172 ==> default: -- Base box: spdk/fedora39 00:04:47.172 ==> default: -- Storage pool: default 00:04:47.172 ==> default: -- Image: /var/lib/libvirt/images/fedora39-39-1.5-1721788873-2326_default_1728299742_7e60aadc8830418c78e0.img (20G) 00:04:47.172 ==> default: -- Volume Cache: default 00:04:47.172 ==> default: -- Kernel: 00:04:47.172 ==> default: -- Initrd: 00:04:47.172 ==> default: -- Graphics Type: vnc 00:04:47.172 ==> default: -- Graphics Port: -1 00:04:47.172 ==> default: -- Graphics IP: 127.0.0.1 00:04:47.172 ==> default: -- Graphics Password: Not defined 00:04:47.172 ==> default: -- Video Type: cirrus 00:04:47.172 ==> default: -- Video VRAM: 9216 00:04:47.172 ==> default: -- Sound Type: 00:04:47.172 ==> default: -- Keymap: en-us 00:04:47.172 ==> default: -- TPM Path: 00:04:47.172 ==> default: -- INPUT: type=mouse, bus=ps2 00:04:47.172 ==> default: -- Command line args: 00:04:47.172 ==> default: -> value=-device, 00:04:47.172 ==> default: -> value=nvme,id=nvme-0,serial=12340,addr=0x10, 00:04:47.172 ==> default: -> value=-drive, 00:04:47.172 ==> default: -> value=format=raw,file=/var/lib/libvirt/images/backends/ex6-nvme.img,if=none,id=nvme-0-drive0, 00:04:47.172 ==> default: -> value=-device, 00:04:47.172 ==> default: -> value=nvme-ns,drive=nvme-0-drive0,bus=nvme-0,nsid=1,zoned=false,logical_block_size=4096,physical_block_size=4096, 00:04:47.172 ==> default: -> value=-device, 00:04:47.172 ==> default: -> value=nvme,id=nvme-1,serial=12341,addr=0x11, 00:04:47.172 ==> default: -> value=-drive, 00:04:47.172 ==> default: -> value=format=raw,file=/var/lib/libvirt/images/backends/ex6-nvme-multi0.img,if=none,id=nvme-1-drive0, 00:04:47.172 ==> default: -> value=-device, 00:04:47.172 ==> default: -> value=nvme-ns,drive=nvme-1-drive0,bus=nvme-1,nsid=1,zoned=false,logical_block_size=4096,physical_block_size=4096, 00:04:47.172 ==> default: -> value=-drive, 00:04:47.172 ==> default: -> value=format=raw,file=/var/lib/libvirt/images/backends/ex6-nvme-multi1.img,if=none,id=nvme-1-drive1, 00:04:47.172 ==> default: -> value=-device, 00:04:47.172 ==> default: -> value=nvme-ns,drive=nvme-1-drive1,bus=nvme-1,nsid=2,zoned=false,logical_block_size=4096,physical_block_size=4096, 00:04:47.172 ==> default: -> value=-drive, 00:04:47.172 ==> default: -> value=format=raw,file=/var/lib/libvirt/images/backends/ex6-nvme-multi2.img,if=none,id=nvme-1-drive2, 00:04:47.172 ==> default: -> value=-device, 00:04:47.172 ==> default: -> value=nvme-ns,drive=nvme-1-drive2,bus=nvme-1,nsid=3,zoned=false,logical_block_size=4096,physical_block_size=4096, 00:04:47.429 ==> default: Creating shared folders metadata... 00:04:47.429 ==> default: Starting domain. 00:04:49.330 ==> default: Waiting for domain to get an IP address... 00:05:07.512 ==> default: Waiting for SSH to become available... 00:05:07.512 ==> default: Configuring and enabling network interfaces... 00:05:10.795 default: SSH address: 192.168.121.168:22 00:05:10.795 default: SSH username: vagrant 00:05:10.795 default: SSH auth method: private key 00:05:13.327 ==> default: Rsyncing folder: /mnt/jenkins_nvme/jenkins/workspace/nvmf-tcp-vg-autotest_4/spdk/ => /home/vagrant/spdk_repo/spdk 00:05:21.440 ==> default: Mounting SSHFS shared folder... 00:05:22.374 ==> default: Mounting folder via SSHFS: /mnt/jenkins_nvme/jenkins/workspace/nvmf-tcp-vg-autotest_4/fedora39-libvirt/output => /home/vagrant/spdk_repo/output 00:05:22.374 ==> default: Checking Mount.. 00:05:23.749 ==> default: Folder Successfully Mounted! 00:05:23.749 ==> default: Running provisioner: file... 00:05:24.703 default: ~/.gitconfig => .gitconfig 00:05:24.962 00:05:24.962 SUCCESS! 00:05:24.962 00:05:24.962 cd to /var/jenkins/workspace/nvmf-tcp-vg-autotest_4/fedora39-libvirt and type "vagrant ssh" to use. 00:05:24.962 Use vagrant "suspend" and vagrant "resume" to stop and start. 00:05:24.962 Use vagrant "destroy" followed by "rm -rf /var/jenkins/workspace/nvmf-tcp-vg-autotest_4/fedora39-libvirt" to destroy all trace of vm. 00:05:24.962 00:05:24.970 [Pipeline] } 00:05:24.985 [Pipeline] // stage 00:05:24.994 [Pipeline] dir 00:05:24.995 Running in /var/jenkins/workspace/nvmf-tcp-vg-autotest_4/fedora39-libvirt 00:05:24.996 [Pipeline] { 00:05:25.023 [Pipeline] catchError 00:05:25.026 [Pipeline] { 00:05:25.049 [Pipeline] sh 00:05:25.332 + vagrant ssh-config --host vagrant 00:05:25.332 + sed -ne /^Host/,$p 00:05:25.332 + tee ssh_conf 00:05:29.516 Host vagrant 00:05:29.516 HostName 192.168.121.168 00:05:29.516 User vagrant 00:05:29.516 Port 22 00:05:29.516 UserKnownHostsFile /dev/null 00:05:29.516 StrictHostKeyChecking no 00:05:29.516 PasswordAuthentication no 00:05:29.516 IdentityFile /var/lib/libvirt/images/.vagrant.d/boxes/spdk-VAGRANTSLASH-fedora39/39-1.5-1721788873-2326/libvirt/fedora39 00:05:29.516 IdentitiesOnly yes 00:05:29.516 LogLevel FATAL 00:05:29.517 ForwardAgent yes 00:05:29.517 ForwardX11 yes 00:05:29.517 00:05:29.529 [Pipeline] withEnv 00:05:29.531 [Pipeline] { 00:05:29.543 [Pipeline] sh 00:05:29.889 + /usr/local/bin/ssh -t -F ssh_conf vagrant@vagrant #!/bin/bash 00:05:29.889 source /etc/os-release 00:05:29.889 [[ -e /image.version ]] && img=$(< /image.version) 00:05:29.889 # Minimal, systemd-like check. 00:05:29.889 if [[ -e /.dockerenv ]]; then 00:05:29.889 # Clear garbage from the node's name: 00:05:29.889 # agt-er_autotest_547-896 -> autotest_547-896 00:05:29.889 # $HOSTNAME is the actual container id 00:05:29.889 agent=$HOSTNAME@${DOCKER_SWARM_PLUGIN_JENKINS_AGENT_NAME#*_} 00:05:29.889 if grep -q "/etc/hostname" /proc/self/mountinfo; then 00:05:29.889 # We can assume this is a mount from a host where container is running, 00:05:29.889 # so fetch its hostname to easily identify the target swarm worker. 00:05:29.889 container="$(< /etc/hostname) ($agent)" 00:05:29.889 else 00:05:29.889 # Fallback 00:05:29.889 container=$agent 00:05:29.889 fi 00:05:29.889 fi 00:05:29.889 echo "${NAME} ${VERSION_ID}|$(uname -r)|${img:-N/A}|${container:-N/A}" 00:05:29.889 00:05:29.900 [Pipeline] } 00:05:29.915 [Pipeline] // withEnv 00:05:29.924 [Pipeline] setCustomBuildProperty 00:05:29.937 [Pipeline] stage 00:05:29.940 [Pipeline] { (Tests) 00:05:29.955 [Pipeline] sh 00:05:30.233 + scp -F ssh_conf -r /var/jenkins/workspace/nvmf-tcp-vg-autotest_4/jbp/jenkins/jjb-config/jobs/scripts/autoruner.sh vagrant@vagrant:./ 00:05:30.505 [Pipeline] sh 00:05:30.784 + scp -F ssh_conf -r /var/jenkins/workspace/nvmf-tcp-vg-autotest_4/jbp/jenkins/jjb-config/jobs/scripts/pkgdep-autoruner.sh vagrant@vagrant:./ 00:05:31.056 [Pipeline] timeout 00:05:31.056 Timeout set to expire in 1 hr 0 min 00:05:31.058 [Pipeline] { 00:05:31.072 [Pipeline] sh 00:05:31.352 + /usr/local/bin/ssh -t -F ssh_conf vagrant@vagrant git -C spdk_repo/spdk reset --hard 00:05:31.919 HEAD is now at 2a4f56c54 bdev/nvme: controller failover/multipath doc change 00:05:31.931 [Pipeline] sh 00:05:32.238 + /usr/local/bin/ssh -t -F ssh_conf vagrant@vagrant sudo chown vagrant:vagrant spdk_repo 00:05:32.510 [Pipeline] sh 00:05:32.789 + scp -F ssh_conf -r /var/jenkins/workspace/nvmf-tcp-vg-autotest_4/autorun-spdk.conf vagrant@vagrant:spdk_repo 00:05:33.062 [Pipeline] sh 00:05:33.342 + /usr/local/bin/ssh -t -F ssh_conf vagrant@vagrant JOB_BASE_NAME=nvmf-tcp-vg-autotest ./autoruner.sh spdk_repo 00:05:33.601 ++ readlink -f spdk_repo 00:05:33.601 + DIR_ROOT=/home/vagrant/spdk_repo 00:05:33.601 + [[ -n /home/vagrant/spdk_repo ]] 00:05:33.601 + DIR_SPDK=/home/vagrant/spdk_repo/spdk 00:05:33.601 + DIR_OUTPUT=/home/vagrant/spdk_repo/output 00:05:33.601 + [[ -d /home/vagrant/spdk_repo/spdk ]] 00:05:33.601 + [[ ! -d /home/vagrant/spdk_repo/output ]] 00:05:33.601 + [[ -d /home/vagrant/spdk_repo/output ]] 00:05:33.601 + [[ nvmf-tcp-vg-autotest == pkgdep-* ]] 00:05:33.601 + cd /home/vagrant/spdk_repo 00:05:33.601 + source /etc/os-release 00:05:33.601 ++ NAME='Fedora Linux' 00:05:33.601 ++ VERSION='39 (Cloud Edition)' 00:05:33.601 ++ ID=fedora 00:05:33.601 ++ VERSION_ID=39 00:05:33.601 ++ VERSION_CODENAME= 00:05:33.601 ++ PLATFORM_ID=platform:f39 00:05:33.601 ++ PRETTY_NAME='Fedora Linux 39 (Cloud Edition)' 00:05:33.601 ++ ANSI_COLOR='0;38;2;60;110;180' 00:05:33.601 ++ LOGO=fedora-logo-icon 00:05:33.601 ++ CPE_NAME=cpe:/o:fedoraproject:fedora:39 00:05:33.601 ++ HOME_URL=https://fedoraproject.org/ 00:05:33.601 ++ DOCUMENTATION_URL=https://docs.fedoraproject.org/en-US/fedora/f39/system-administrators-guide/ 00:05:33.601 ++ SUPPORT_URL=https://ask.fedoraproject.org/ 00:05:33.601 ++ BUG_REPORT_URL=https://bugzilla.redhat.com/ 00:05:33.601 ++ REDHAT_BUGZILLA_PRODUCT=Fedora 00:05:33.601 ++ REDHAT_BUGZILLA_PRODUCT_VERSION=39 00:05:33.601 ++ REDHAT_SUPPORT_PRODUCT=Fedora 00:05:33.601 ++ REDHAT_SUPPORT_PRODUCT_VERSION=39 00:05:33.601 ++ SUPPORT_END=2024-11-12 00:05:33.601 ++ VARIANT='Cloud Edition' 00:05:33.601 ++ VARIANT_ID=cloud 00:05:33.601 + uname -a 00:05:33.601 Linux fedora39-cloud-1721788873-2326 6.8.9-200.fc39.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Jul 24 03:04:40 UTC 2024 x86_64 GNU/Linux 00:05:33.601 + sudo /home/vagrant/spdk_repo/spdk/scripts/setup.sh status 00:05:34.168 0000:00:03.0 (1af4 1001): Active devices: mount@vda:vda2,mount@vda:vda3,mount@vda:vda5, so not binding PCI dev 00:05:34.168 Hugepages 00:05:34.168 node hugesize free / total 00:05:34.168 node0 1048576kB 0 / 0 00:05:34.168 node0 2048kB 0 / 0 00:05:34.168 00:05:34.168 Type BDF Vendor Device NUMA Driver Device Block devices 00:05:34.168 virtio 0000:00:03.0 1af4 1001 unknown virtio-pci - vda 00:05:34.168 NVMe 0000:00:10.0 1b36 0010 unknown nvme nvme1 nvme1n1 00:05:34.168 NVMe 0000:00:11.0 1b36 0010 unknown nvme nvme0 nvme0n1 nvme0n2 nvme0n3 00:05:34.168 + rm -f /tmp/spdk-ld-path 00:05:34.168 + source autorun-spdk.conf 00:05:34.168 ++ SPDK_RUN_FUNCTIONAL_TEST=1 00:05:34.168 ++ SPDK_TEST_NVMF=1 00:05:34.168 ++ SPDK_TEST_NVMF_TRANSPORT=tcp 00:05:34.168 ++ SPDK_TEST_USDT=1 00:05:34.168 ++ SPDK_TEST_NVMF_MDNS=1 00:05:34.168 ++ SPDK_RUN_UBSAN=1 00:05:34.168 ++ NET_TYPE=virt 00:05:34.168 ++ SPDK_JSONRPC_GO_CLIENT=1 00:05:34.168 ++ SPDK_ABI_DIR=/home/vagrant/spdk_repo/spdk-abi 00:05:34.168 ++ RUN_NIGHTLY=0 00:05:34.168 + (( SPDK_TEST_NVME_CMB == 1 || SPDK_TEST_NVME_PMR == 1 )) 00:05:34.168 + [[ -n '' ]] 00:05:34.168 + sudo git config --global --add safe.directory /home/vagrant/spdk_repo/spdk 00:05:34.168 + for M in /var/spdk/build-*-manifest.txt 00:05:34.168 + [[ -f /var/spdk/build-kernel-manifest.txt ]] 00:05:34.168 + cp /var/spdk/build-kernel-manifest.txt /home/vagrant/spdk_repo/output/ 00:05:34.168 + for M in /var/spdk/build-*-manifest.txt 00:05:34.168 + [[ -f /var/spdk/build-pkg-manifest.txt ]] 00:05:34.168 + cp /var/spdk/build-pkg-manifest.txt /home/vagrant/spdk_repo/output/ 00:05:34.168 + for M in /var/spdk/build-*-manifest.txt 00:05:34.168 + [[ -f /var/spdk/build-repo-manifest.txt ]] 00:05:34.169 + cp /var/spdk/build-repo-manifest.txt /home/vagrant/spdk_repo/output/ 00:05:34.169 ++ uname 00:05:34.169 + [[ Linux == \L\i\n\u\x ]] 00:05:34.169 + sudo dmesg -T 00:05:34.169 + sudo dmesg --clear 00:05:34.169 + dmesg_pid=5263 00:05:34.169 + [[ Fedora Linux == FreeBSD ]] 00:05:34.169 + export UNBIND_ENTIRE_IOMMU_GROUP=yes 00:05:34.169 + UNBIND_ENTIRE_IOMMU_GROUP=yes 00:05:34.169 + sudo dmesg -Tw 00:05:34.169 + [[ -e /var/spdk/dependencies/vhost/spdk_test_image.qcow2 ]] 00:05:34.169 + [[ -x /usr/src/fio-static/fio ]] 00:05:34.169 + export FIO_BIN=/usr/src/fio-static/fio 00:05:34.169 + FIO_BIN=/usr/src/fio-static/fio 00:05:34.169 + [[ '' == \/\q\e\m\u\_\v\f\i\o\/* ]] 00:05:34.169 + [[ ! -v VFIO_QEMU_BIN ]] 00:05:34.169 + [[ -e /usr/local/qemu/vfio-user-latest ]] 00:05:34.169 + export VFIO_QEMU_BIN=/usr/local/qemu/vfio-user-latest/bin/qemu-system-x86_64 00:05:34.169 + VFIO_QEMU_BIN=/usr/local/qemu/vfio-user-latest/bin/qemu-system-x86_64 00:05:34.169 + [[ -e /usr/local/qemu/vanilla-latest ]] 00:05:34.169 + export QEMU_BIN=/usr/local/qemu/vanilla-latest/bin/qemu-system-x86_64 00:05:34.169 + QEMU_BIN=/usr/local/qemu/vanilla-latest/bin/qemu-system-x86_64 00:05:34.169 + spdk/autorun.sh /home/vagrant/spdk_repo/autorun-spdk.conf 00:05:34.169 Test configuration: 00:05:34.169 SPDK_RUN_FUNCTIONAL_TEST=1 00:05:34.169 SPDK_TEST_NVMF=1 00:05:34.169 SPDK_TEST_NVMF_TRANSPORT=tcp 00:05:34.169 SPDK_TEST_USDT=1 00:05:34.169 SPDK_TEST_NVMF_MDNS=1 00:05:34.169 SPDK_RUN_UBSAN=1 00:05:34.169 NET_TYPE=virt 00:05:34.169 SPDK_JSONRPC_GO_CLIENT=1 00:05:34.169 SPDK_ABI_DIR=/home/vagrant/spdk_repo/spdk-abi 00:05:34.169 RUN_NIGHTLY=0 11:16:29 -- common/autotest_common.sh@1680 -- $ [[ n == y ]] 00:05:34.169 11:16:29 -- common/autobuild_common.sh@15 -- $ source /home/vagrant/spdk_repo/spdk/scripts/common.sh 00:05:34.169 11:16:29 -- scripts/common.sh@15 -- $ shopt -s extglob 00:05:34.169 11:16:29 -- scripts/common.sh@544 -- $ [[ -e /bin/wpdk_common.sh ]] 00:05:34.169 11:16:29 -- scripts/common.sh@552 -- $ [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:05:34.169 11:16:29 -- scripts/common.sh@553 -- $ source /etc/opt/spdk-pkgdep/paths/export.sh 00:05:34.169 11:16:29 -- paths/export.sh@2 -- $ PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/home/vagrant/.local/bin:/home/vagrant/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:05:34.169 11:16:29 -- paths/export.sh@3 -- $ PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/home/vagrant/.local/bin:/home/vagrant/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:05:34.169 11:16:29 -- paths/export.sh@4 -- $ PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/home/vagrant/.local/bin:/home/vagrant/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:05:34.169 11:16:29 -- paths/export.sh@5 -- $ export PATH 00:05:34.169 11:16:29 -- paths/export.sh@6 -- $ echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/home/vagrant/.local/bin:/home/vagrant/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:05:34.428 11:16:29 -- common/autobuild_common.sh@485 -- $ out=/home/vagrant/spdk_repo/spdk/../output 00:05:34.428 11:16:29 -- common/autobuild_common.sh@486 -- $ date +%s 00:05:34.428 11:16:29 -- common/autobuild_common.sh@486 -- $ mktemp -dt spdk_1728299789.XXXXXX 00:05:34.428 11:16:29 -- common/autobuild_common.sh@486 -- $ SPDK_WORKSPACE=/tmp/spdk_1728299789.KV835y 00:05:34.428 11:16:29 -- common/autobuild_common.sh@488 -- $ [[ -n '' ]] 00:05:34.428 11:16:29 -- common/autobuild_common.sh@492 -- $ '[' -n '' ']' 00:05:34.428 11:16:29 -- common/autobuild_common.sh@495 -- $ scanbuild_exclude='--exclude /home/vagrant/spdk_repo/spdk/dpdk/' 00:05:34.428 11:16:29 -- common/autobuild_common.sh@499 -- $ scanbuild_exclude+=' --exclude /home/vagrant/spdk_repo/spdk/xnvme --exclude /tmp' 00:05:34.428 11:16:29 -- common/autobuild_common.sh@501 -- $ scanbuild='scan-build -o /home/vagrant/spdk_repo/spdk/../output/scan-build-tmp --exclude /home/vagrant/spdk_repo/spdk/dpdk/ --exclude /home/vagrant/spdk_repo/spdk/xnvme --exclude /tmp --status-bugs' 00:05:34.428 11:16:29 -- common/autobuild_common.sh@502 -- $ get_config_params 00:05:34.428 11:16:29 -- common/autotest_common.sh@407 -- $ xtrace_disable 00:05:34.428 11:16:29 -- common/autotest_common.sh@10 -- $ set +x 00:05:34.428 11:16:29 -- common/autobuild_common.sh@502 -- $ config_params='--enable-debug --enable-werror --with-rdma --with-usdt --with-idxd --with-fio=/usr/src/fio --with-iscsi-initiator --disable-unit-tests --enable-ubsan --enable-coverage --with-ublk --with-avahi --with-golang' 00:05:34.428 11:16:29 -- common/autobuild_common.sh@504 -- $ start_monitor_resources 00:05:34.428 11:16:29 -- pm/common@17 -- $ local monitor 00:05:34.428 11:16:29 -- pm/common@19 -- $ for monitor in "${MONITOR_RESOURCES[@]}" 00:05:34.428 11:16:29 -- pm/common@19 -- $ for monitor in "${MONITOR_RESOURCES[@]}" 00:05:34.428 11:16:29 -- pm/common@25 -- $ sleep 1 00:05:34.428 11:16:29 -- pm/common@21 -- $ date +%s 00:05:34.428 11:16:29 -- pm/common@21 -- $ date +%s 00:05:34.428 11:16:29 -- pm/common@21 -- $ /home/vagrant/spdk_repo/spdk/scripts/perf/pm/collect-cpu-load -d /home/vagrant/spdk_repo/spdk/../output/power -l -p monitor.autobuild.sh.1728299789 00:05:34.428 11:16:29 -- pm/common@21 -- $ /home/vagrant/spdk_repo/spdk/scripts/perf/pm/collect-vmstat -d /home/vagrant/spdk_repo/spdk/../output/power -l -p monitor.autobuild.sh.1728299789 00:05:34.428 Redirecting to /home/vagrant/spdk_repo/spdk/../output/power/monitor.autobuild.sh.1728299789_collect-cpu-load.pm.log 00:05:34.428 Redirecting to /home/vagrant/spdk_repo/spdk/../output/power/monitor.autobuild.sh.1728299789_collect-vmstat.pm.log 00:05:35.371 11:16:30 -- common/autobuild_common.sh@505 -- $ trap stop_monitor_resources EXIT 00:05:35.371 11:16:30 -- spdk/autobuild.sh@11 -- $ SPDK_TEST_AUTOBUILD= 00:05:35.371 11:16:30 -- spdk/autobuild.sh@12 -- $ umask 022 00:05:35.371 11:16:30 -- spdk/autobuild.sh@13 -- $ cd /home/vagrant/spdk_repo/spdk 00:05:35.371 11:16:30 -- spdk/autobuild.sh@16 -- $ date -u 00:05:35.371 Mon Oct 7 11:16:30 AM UTC 2024 00:05:35.371 11:16:30 -- spdk/autobuild.sh@17 -- $ git describe --tags 00:05:35.371 v25.01-pre-39-g2a4f56c54 00:05:35.371 11:16:30 -- spdk/autobuild.sh@19 -- $ '[' 0 -eq 1 ']' 00:05:35.371 11:16:30 -- spdk/autobuild.sh@23 -- $ '[' 1 -eq 1 ']' 00:05:35.371 11:16:30 -- spdk/autobuild.sh@24 -- $ run_test ubsan echo 'using ubsan' 00:05:35.371 11:16:30 -- common/autotest_common.sh@1101 -- $ '[' 3 -le 1 ']' 00:05:35.371 11:16:30 -- common/autotest_common.sh@1107 -- $ xtrace_disable 00:05:35.371 11:16:30 -- common/autotest_common.sh@10 -- $ set +x 00:05:35.371 ************************************ 00:05:35.371 START TEST ubsan 00:05:35.371 ************************************ 00:05:35.371 using ubsan 00:05:35.371 11:16:30 ubsan -- common/autotest_common.sh@1125 -- $ echo 'using ubsan' 00:05:35.371 00:05:35.371 real 0m0.000s 00:05:35.371 user 0m0.000s 00:05:35.371 sys 0m0.000s 00:05:35.371 11:16:30 ubsan -- common/autotest_common.sh@1126 -- $ xtrace_disable 00:05:35.371 11:16:30 ubsan -- common/autotest_common.sh@10 -- $ set +x 00:05:35.371 ************************************ 00:05:35.371 END TEST ubsan 00:05:35.371 ************************************ 00:05:35.371 11:16:30 -- spdk/autobuild.sh@27 -- $ '[' -n '' ']' 00:05:35.371 11:16:30 -- spdk/autobuild.sh@31 -- $ case "$SPDK_TEST_AUTOBUILD" in 00:05:35.371 11:16:30 -- spdk/autobuild.sh@47 -- $ [[ 0 -eq 1 ]] 00:05:35.371 11:16:30 -- spdk/autobuild.sh@51 -- $ [[ 0 -eq 1 ]] 00:05:35.371 11:16:30 -- spdk/autobuild.sh@55 -- $ [[ -n '' ]] 00:05:35.371 11:16:30 -- spdk/autobuild.sh@57 -- $ [[ 0 -eq 1 ]] 00:05:35.371 11:16:30 -- spdk/autobuild.sh@59 -- $ [[ 0 -eq 1 ]] 00:05:35.371 11:16:30 -- spdk/autobuild.sh@62 -- $ [[ 0 -eq 1 ]] 00:05:35.371 11:16:30 -- spdk/autobuild.sh@67 -- $ /home/vagrant/spdk_repo/spdk/configure --enable-debug --enable-werror --with-rdma --with-usdt --with-idxd --with-fio=/usr/src/fio --with-iscsi-initiator --disable-unit-tests --enable-ubsan --enable-coverage --with-ublk --with-avahi --with-golang --with-shared 00:05:35.371 Using default SPDK env in /home/vagrant/spdk_repo/spdk/lib/env_dpdk 00:05:35.371 Using default DPDK in /home/vagrant/spdk_repo/spdk/dpdk/build 00:05:35.939 Using 'verbs' RDMA provider 00:05:49.100 Configuring ISA-L (logfile: /home/vagrant/spdk_repo/spdk/.spdk-isal.log)...done. 00:06:01.363 Configuring ISA-L-crypto (logfile: /home/vagrant/spdk_repo/spdk/.spdk-isal-crypto.log)...done. 00:06:01.363 go version go1.21.1 linux/amd64 00:06:01.878 Creating mk/config.mk...done. 00:06:01.879 Creating mk/cc.flags.mk...done. 00:06:01.879 Type 'make' to build. 00:06:01.879 11:16:57 -- spdk/autobuild.sh@70 -- $ run_test make make -j10 00:06:01.879 11:16:57 -- common/autotest_common.sh@1101 -- $ '[' 3 -le 1 ']' 00:06:01.879 11:16:57 -- common/autotest_common.sh@1107 -- $ xtrace_disable 00:06:01.879 11:16:57 -- common/autotest_common.sh@10 -- $ set +x 00:06:01.879 ************************************ 00:06:01.879 START TEST make 00:06:01.879 ************************************ 00:06:01.879 11:16:57 make -- common/autotest_common.sh@1125 -- $ make -j10 00:06:02.136 make[1]: Nothing to be done for 'all'. 00:06:20.204 The Meson build system 00:06:20.204 Version: 1.5.0 00:06:20.204 Source dir: /home/vagrant/spdk_repo/spdk/dpdk 00:06:20.204 Build dir: /home/vagrant/spdk_repo/spdk/dpdk/build-tmp 00:06:20.204 Build type: native build 00:06:20.204 Program cat found: YES (/usr/bin/cat) 00:06:20.204 Project name: DPDK 00:06:20.204 Project version: 24.03.0 00:06:20.204 C compiler for the host machine: cc (gcc 13.3.1 "cc (GCC) 13.3.1 20240522 (Red Hat 13.3.1-1)") 00:06:20.204 C linker for the host machine: cc ld.bfd 2.40-14 00:06:20.204 Host machine cpu family: x86_64 00:06:20.204 Host machine cpu: x86_64 00:06:20.204 Message: ## Building in Developer Mode ## 00:06:20.204 Program pkg-config found: YES (/usr/bin/pkg-config) 00:06:20.204 Program check-symbols.sh found: YES (/home/vagrant/spdk_repo/spdk/dpdk/buildtools/check-symbols.sh) 00:06:20.204 Program options-ibverbs-static.sh found: YES (/home/vagrant/spdk_repo/spdk/dpdk/buildtools/options-ibverbs-static.sh) 00:06:20.204 Program python3 found: YES (/usr/bin/python3) 00:06:20.204 Program cat found: YES (/usr/bin/cat) 00:06:20.204 Compiler for C supports arguments -march=native: YES 00:06:20.204 Checking for size of "void *" : 8 00:06:20.204 Checking for size of "void *" : 8 (cached) 00:06:20.204 Compiler for C supports link arguments -Wl,--undefined-version: YES 00:06:20.204 Library m found: YES 00:06:20.204 Library numa found: YES 00:06:20.204 Has header "numaif.h" : YES 00:06:20.204 Library fdt found: NO 00:06:20.204 Library execinfo found: NO 00:06:20.204 Has header "execinfo.h" : YES 00:06:20.204 Found pkg-config: YES (/usr/bin/pkg-config) 1.9.5 00:06:20.204 Run-time dependency libarchive found: NO (tried pkgconfig) 00:06:20.204 Run-time dependency libbsd found: NO (tried pkgconfig) 00:06:20.204 Run-time dependency jansson found: NO (tried pkgconfig) 00:06:20.204 Run-time dependency openssl found: YES 3.1.1 00:06:20.204 Run-time dependency libpcap found: YES 1.10.4 00:06:20.204 Has header "pcap.h" with dependency libpcap: YES 00:06:20.204 Compiler for C supports arguments -Wcast-qual: YES 00:06:20.204 Compiler for C supports arguments -Wdeprecated: YES 00:06:20.204 Compiler for C supports arguments -Wformat: YES 00:06:20.204 Compiler for C supports arguments -Wformat-nonliteral: NO 00:06:20.204 Compiler for C supports arguments -Wformat-security: NO 00:06:20.204 Compiler for C supports arguments -Wmissing-declarations: YES 00:06:20.204 Compiler for C supports arguments -Wmissing-prototypes: YES 00:06:20.204 Compiler for C supports arguments -Wnested-externs: YES 00:06:20.204 Compiler for C supports arguments -Wold-style-definition: YES 00:06:20.204 Compiler for C supports arguments -Wpointer-arith: YES 00:06:20.204 Compiler for C supports arguments -Wsign-compare: YES 00:06:20.204 Compiler for C supports arguments -Wstrict-prototypes: YES 00:06:20.204 Compiler for C supports arguments -Wundef: YES 00:06:20.204 Compiler for C supports arguments -Wwrite-strings: YES 00:06:20.204 Compiler for C supports arguments -Wno-address-of-packed-member: YES 00:06:20.204 Compiler for C supports arguments -Wno-packed-not-aligned: YES 00:06:20.204 Compiler for C supports arguments -Wno-missing-field-initializers: YES 00:06:20.204 Compiler for C supports arguments -Wno-zero-length-bounds: YES 00:06:20.204 Program objdump found: YES (/usr/bin/objdump) 00:06:20.204 Compiler for C supports arguments -mavx512f: YES 00:06:20.204 Checking if "AVX512 checking" compiles: YES 00:06:20.204 Fetching value of define "__SSE4_2__" : 1 00:06:20.204 Fetching value of define "__AES__" : 1 00:06:20.204 Fetching value of define "__AVX__" : 1 00:06:20.204 Fetching value of define "__AVX2__" : 1 00:06:20.204 Fetching value of define "__AVX512BW__" : (undefined) 00:06:20.204 Fetching value of define "__AVX512CD__" : (undefined) 00:06:20.204 Fetching value of define "__AVX512DQ__" : (undefined) 00:06:20.204 Fetching value of define "__AVX512F__" : (undefined) 00:06:20.204 Fetching value of define "__AVX512VL__" : (undefined) 00:06:20.204 Fetching value of define "__PCLMUL__" : 1 00:06:20.204 Fetching value of define "__RDRND__" : 1 00:06:20.204 Fetching value of define "__RDSEED__" : 1 00:06:20.204 Fetching value of define "__VPCLMULQDQ__" : (undefined) 00:06:20.204 Fetching value of define "__znver1__" : (undefined) 00:06:20.204 Fetching value of define "__znver2__" : (undefined) 00:06:20.204 Fetching value of define "__znver3__" : (undefined) 00:06:20.204 Fetching value of define "__znver4__" : (undefined) 00:06:20.204 Compiler for C supports arguments -Wno-format-truncation: YES 00:06:20.204 Message: lib/log: Defining dependency "log" 00:06:20.204 Message: lib/kvargs: Defining dependency "kvargs" 00:06:20.204 Message: lib/telemetry: Defining dependency "telemetry" 00:06:20.204 Checking for function "getentropy" : NO 00:06:20.204 Message: lib/eal: Defining dependency "eal" 00:06:20.204 Message: lib/ring: Defining dependency "ring" 00:06:20.204 Message: lib/rcu: Defining dependency "rcu" 00:06:20.204 Message: lib/mempool: Defining dependency "mempool" 00:06:20.204 Message: lib/mbuf: Defining dependency "mbuf" 00:06:20.204 Fetching value of define "__PCLMUL__" : 1 (cached) 00:06:20.204 Fetching value of define "__AVX512F__" : (undefined) (cached) 00:06:20.204 Compiler for C supports arguments -mpclmul: YES 00:06:20.204 Compiler for C supports arguments -maes: YES 00:06:20.204 Compiler for C supports arguments -mavx512f: YES (cached) 00:06:20.204 Compiler for C supports arguments -mavx512bw: YES 00:06:20.204 Compiler for C supports arguments -mavx512dq: YES 00:06:20.204 Compiler for C supports arguments -mavx512vl: YES 00:06:20.204 Compiler for C supports arguments -mvpclmulqdq: YES 00:06:20.204 Compiler for C supports arguments -mavx2: YES 00:06:20.204 Compiler for C supports arguments -mavx: YES 00:06:20.204 Message: lib/net: Defining dependency "net" 00:06:20.204 Message: lib/meter: Defining dependency "meter" 00:06:20.204 Message: lib/ethdev: Defining dependency "ethdev" 00:06:20.204 Message: lib/pci: Defining dependency "pci" 00:06:20.204 Message: lib/cmdline: Defining dependency "cmdline" 00:06:20.204 Message: lib/hash: Defining dependency "hash" 00:06:20.204 Message: lib/timer: Defining dependency "timer" 00:06:20.204 Message: lib/compressdev: Defining dependency "compressdev" 00:06:20.204 Message: lib/cryptodev: Defining dependency "cryptodev" 00:06:20.204 Message: lib/dmadev: Defining dependency "dmadev" 00:06:20.204 Compiler for C supports arguments -Wno-cast-qual: YES 00:06:20.204 Message: lib/power: Defining dependency "power" 00:06:20.204 Message: lib/reorder: Defining dependency "reorder" 00:06:20.204 Message: lib/security: Defining dependency "security" 00:06:20.204 Has header "linux/userfaultfd.h" : YES 00:06:20.204 Has header "linux/vduse.h" : YES 00:06:20.204 Message: lib/vhost: Defining dependency "vhost" 00:06:20.204 Compiler for C supports arguments -Wno-format-truncation: YES (cached) 00:06:20.204 Message: drivers/bus/pci: Defining dependency "bus_pci" 00:06:20.204 Message: drivers/bus/vdev: Defining dependency "bus_vdev" 00:06:20.204 Message: drivers/mempool/ring: Defining dependency "mempool_ring" 00:06:20.204 Message: Disabling raw/* drivers: missing internal dependency "rawdev" 00:06:20.204 Message: Disabling regex/* drivers: missing internal dependency "regexdev" 00:06:20.204 Message: Disabling ml/* drivers: missing internal dependency "mldev" 00:06:20.204 Message: Disabling event/* drivers: missing internal dependency "eventdev" 00:06:20.204 Message: Disabling baseband/* drivers: missing internal dependency "bbdev" 00:06:20.204 Message: Disabling gpu/* drivers: missing internal dependency "gpudev" 00:06:20.204 Program doxygen found: YES (/usr/local/bin/doxygen) 00:06:20.204 Configuring doxy-api-html.conf using configuration 00:06:20.204 Configuring doxy-api-man.conf using configuration 00:06:20.204 Program mandb found: YES (/usr/bin/mandb) 00:06:20.204 Program sphinx-build found: NO 00:06:20.204 Configuring rte_build_config.h using configuration 00:06:20.204 Message: 00:06:20.204 ================= 00:06:20.204 Applications Enabled 00:06:20.204 ================= 00:06:20.204 00:06:20.204 apps: 00:06:20.204 00:06:20.204 00:06:20.204 Message: 00:06:20.204 ================= 00:06:20.204 Libraries Enabled 00:06:20.204 ================= 00:06:20.204 00:06:20.204 libs: 00:06:20.204 log, kvargs, telemetry, eal, ring, rcu, mempool, mbuf, 00:06:20.204 net, meter, ethdev, pci, cmdline, hash, timer, compressdev, 00:06:20.204 cryptodev, dmadev, power, reorder, security, vhost, 00:06:20.204 00:06:20.204 Message: 00:06:20.204 =============== 00:06:20.204 Drivers Enabled 00:06:20.204 =============== 00:06:20.204 00:06:20.204 common: 00:06:20.204 00:06:20.204 bus: 00:06:20.204 pci, vdev, 00:06:20.204 mempool: 00:06:20.204 ring, 00:06:20.204 dma: 00:06:20.204 00:06:20.204 net: 00:06:20.204 00:06:20.204 crypto: 00:06:20.204 00:06:20.204 compress: 00:06:20.204 00:06:20.204 vdpa: 00:06:20.204 00:06:20.204 00:06:20.204 Message: 00:06:20.204 ================= 00:06:20.204 Content Skipped 00:06:20.204 ================= 00:06:20.204 00:06:20.204 apps: 00:06:20.204 dumpcap: explicitly disabled via build config 00:06:20.204 graph: explicitly disabled via build config 00:06:20.204 pdump: explicitly disabled via build config 00:06:20.204 proc-info: explicitly disabled via build config 00:06:20.204 test-acl: explicitly disabled via build config 00:06:20.204 test-bbdev: explicitly disabled via build config 00:06:20.204 test-cmdline: explicitly disabled via build config 00:06:20.204 test-compress-perf: explicitly disabled via build config 00:06:20.204 test-crypto-perf: explicitly disabled via build config 00:06:20.204 test-dma-perf: explicitly disabled via build config 00:06:20.204 test-eventdev: explicitly disabled via build config 00:06:20.204 test-fib: explicitly disabled via build config 00:06:20.204 test-flow-perf: explicitly disabled via build config 00:06:20.204 test-gpudev: explicitly disabled via build config 00:06:20.204 test-mldev: explicitly disabled via build config 00:06:20.204 test-pipeline: explicitly disabled via build config 00:06:20.204 test-pmd: explicitly disabled via build config 00:06:20.204 test-regex: explicitly disabled via build config 00:06:20.204 test-sad: explicitly disabled via build config 00:06:20.204 test-security-perf: explicitly disabled via build config 00:06:20.204 00:06:20.204 libs: 00:06:20.204 argparse: explicitly disabled via build config 00:06:20.205 metrics: explicitly disabled via build config 00:06:20.205 acl: explicitly disabled via build config 00:06:20.205 bbdev: explicitly disabled via build config 00:06:20.205 bitratestats: explicitly disabled via build config 00:06:20.205 bpf: explicitly disabled via build config 00:06:20.205 cfgfile: explicitly disabled via build config 00:06:20.205 distributor: explicitly disabled via build config 00:06:20.205 efd: explicitly disabled via build config 00:06:20.205 eventdev: explicitly disabled via build config 00:06:20.205 dispatcher: explicitly disabled via build config 00:06:20.205 gpudev: explicitly disabled via build config 00:06:20.205 gro: explicitly disabled via build config 00:06:20.205 gso: explicitly disabled via build config 00:06:20.205 ip_frag: explicitly disabled via build config 00:06:20.205 jobstats: explicitly disabled via build config 00:06:20.205 latencystats: explicitly disabled via build config 00:06:20.205 lpm: explicitly disabled via build config 00:06:20.205 member: explicitly disabled via build config 00:06:20.205 pcapng: explicitly disabled via build config 00:06:20.205 rawdev: explicitly disabled via build config 00:06:20.205 regexdev: explicitly disabled via build config 00:06:20.205 mldev: explicitly disabled via build config 00:06:20.205 rib: explicitly disabled via build config 00:06:20.205 sched: explicitly disabled via build config 00:06:20.205 stack: explicitly disabled via build config 00:06:20.205 ipsec: explicitly disabled via build config 00:06:20.205 pdcp: explicitly disabled via build config 00:06:20.205 fib: explicitly disabled via build config 00:06:20.205 port: explicitly disabled via build config 00:06:20.205 pdump: explicitly disabled via build config 00:06:20.205 table: explicitly disabled via build config 00:06:20.205 pipeline: explicitly disabled via build config 00:06:20.205 graph: explicitly disabled via build config 00:06:20.205 node: explicitly disabled via build config 00:06:20.205 00:06:20.205 drivers: 00:06:20.205 common/cpt: not in enabled drivers build config 00:06:20.205 common/dpaax: not in enabled drivers build config 00:06:20.205 common/iavf: not in enabled drivers build config 00:06:20.205 common/idpf: not in enabled drivers build config 00:06:20.205 common/ionic: not in enabled drivers build config 00:06:20.205 common/mvep: not in enabled drivers build config 00:06:20.205 common/octeontx: not in enabled drivers build config 00:06:20.205 bus/auxiliary: not in enabled drivers build config 00:06:20.205 bus/cdx: not in enabled drivers build config 00:06:20.205 bus/dpaa: not in enabled drivers build config 00:06:20.205 bus/fslmc: not in enabled drivers build config 00:06:20.205 bus/ifpga: not in enabled drivers build config 00:06:20.205 bus/platform: not in enabled drivers build config 00:06:20.205 bus/uacce: not in enabled drivers build config 00:06:20.205 bus/vmbus: not in enabled drivers build config 00:06:20.205 common/cnxk: not in enabled drivers build config 00:06:20.205 common/mlx5: not in enabled drivers build config 00:06:20.205 common/nfp: not in enabled drivers build config 00:06:20.205 common/nitrox: not in enabled drivers build config 00:06:20.205 common/qat: not in enabled drivers build config 00:06:20.205 common/sfc_efx: not in enabled drivers build config 00:06:20.205 mempool/bucket: not in enabled drivers build config 00:06:20.205 mempool/cnxk: not in enabled drivers build config 00:06:20.205 mempool/dpaa: not in enabled drivers build config 00:06:20.205 mempool/dpaa2: not in enabled drivers build config 00:06:20.205 mempool/octeontx: not in enabled drivers build config 00:06:20.205 mempool/stack: not in enabled drivers build config 00:06:20.205 dma/cnxk: not in enabled drivers build config 00:06:20.205 dma/dpaa: not in enabled drivers build config 00:06:20.205 dma/dpaa2: not in enabled drivers build config 00:06:20.205 dma/hisilicon: not in enabled drivers build config 00:06:20.205 dma/idxd: not in enabled drivers build config 00:06:20.205 dma/ioat: not in enabled drivers build config 00:06:20.205 dma/skeleton: not in enabled drivers build config 00:06:20.205 net/af_packet: not in enabled drivers build config 00:06:20.205 net/af_xdp: not in enabled drivers build config 00:06:20.205 net/ark: not in enabled drivers build config 00:06:20.205 net/atlantic: not in enabled drivers build config 00:06:20.205 net/avp: not in enabled drivers build config 00:06:20.205 net/axgbe: not in enabled drivers build config 00:06:20.205 net/bnx2x: not in enabled drivers build config 00:06:20.205 net/bnxt: not in enabled drivers build config 00:06:20.205 net/bonding: not in enabled drivers build config 00:06:20.205 net/cnxk: not in enabled drivers build config 00:06:20.205 net/cpfl: not in enabled drivers build config 00:06:20.205 net/cxgbe: not in enabled drivers build config 00:06:20.205 net/dpaa: not in enabled drivers build config 00:06:20.205 net/dpaa2: not in enabled drivers build config 00:06:20.205 net/e1000: not in enabled drivers build config 00:06:20.205 net/ena: not in enabled drivers build config 00:06:20.205 net/enetc: not in enabled drivers build config 00:06:20.205 net/enetfec: not in enabled drivers build config 00:06:20.205 net/enic: not in enabled drivers build config 00:06:20.205 net/failsafe: not in enabled drivers build config 00:06:20.205 net/fm10k: not in enabled drivers build config 00:06:20.205 net/gve: not in enabled drivers build config 00:06:20.205 net/hinic: not in enabled drivers build config 00:06:20.205 net/hns3: not in enabled drivers build config 00:06:20.205 net/i40e: not in enabled drivers build config 00:06:20.205 net/iavf: not in enabled drivers build config 00:06:20.205 net/ice: not in enabled drivers build config 00:06:20.205 net/idpf: not in enabled drivers build config 00:06:20.205 net/igc: not in enabled drivers build config 00:06:20.205 net/ionic: not in enabled drivers build config 00:06:20.205 net/ipn3ke: not in enabled drivers build config 00:06:20.205 net/ixgbe: not in enabled drivers build config 00:06:20.205 net/mana: not in enabled drivers build config 00:06:20.205 net/memif: not in enabled drivers build config 00:06:20.205 net/mlx4: not in enabled drivers build config 00:06:20.205 net/mlx5: not in enabled drivers build config 00:06:20.205 net/mvneta: not in enabled drivers build config 00:06:20.205 net/mvpp2: not in enabled drivers build config 00:06:20.205 net/netvsc: not in enabled drivers build config 00:06:20.205 net/nfb: not in enabled drivers build config 00:06:20.205 net/nfp: not in enabled drivers build config 00:06:20.205 net/ngbe: not in enabled drivers build config 00:06:20.205 net/null: not in enabled drivers build config 00:06:20.205 net/octeontx: not in enabled drivers build config 00:06:20.205 net/octeon_ep: not in enabled drivers build config 00:06:20.205 net/pcap: not in enabled drivers build config 00:06:20.205 net/pfe: not in enabled drivers build config 00:06:20.205 net/qede: not in enabled drivers build config 00:06:20.205 net/ring: not in enabled drivers build config 00:06:20.205 net/sfc: not in enabled drivers build config 00:06:20.205 net/softnic: not in enabled drivers build config 00:06:20.205 net/tap: not in enabled drivers build config 00:06:20.205 net/thunderx: not in enabled drivers build config 00:06:20.205 net/txgbe: not in enabled drivers build config 00:06:20.205 net/vdev_netvsc: not in enabled drivers build config 00:06:20.205 net/vhost: not in enabled drivers build config 00:06:20.205 net/virtio: not in enabled drivers build config 00:06:20.205 net/vmxnet3: not in enabled drivers build config 00:06:20.205 raw/*: missing internal dependency, "rawdev" 00:06:20.205 crypto/armv8: not in enabled drivers build config 00:06:20.205 crypto/bcmfs: not in enabled drivers build config 00:06:20.205 crypto/caam_jr: not in enabled drivers build config 00:06:20.205 crypto/ccp: not in enabled drivers build config 00:06:20.205 crypto/cnxk: not in enabled drivers build config 00:06:20.205 crypto/dpaa_sec: not in enabled drivers build config 00:06:20.205 crypto/dpaa2_sec: not in enabled drivers build config 00:06:20.205 crypto/ipsec_mb: not in enabled drivers build config 00:06:20.205 crypto/mlx5: not in enabled drivers build config 00:06:20.205 crypto/mvsam: not in enabled drivers build config 00:06:20.205 crypto/nitrox: not in enabled drivers build config 00:06:20.205 crypto/null: not in enabled drivers build config 00:06:20.205 crypto/octeontx: not in enabled drivers build config 00:06:20.205 crypto/openssl: not in enabled drivers build config 00:06:20.205 crypto/scheduler: not in enabled drivers build config 00:06:20.205 crypto/uadk: not in enabled drivers build config 00:06:20.205 crypto/virtio: not in enabled drivers build config 00:06:20.205 compress/isal: not in enabled drivers build config 00:06:20.205 compress/mlx5: not in enabled drivers build config 00:06:20.205 compress/nitrox: not in enabled drivers build config 00:06:20.205 compress/octeontx: not in enabled drivers build config 00:06:20.205 compress/zlib: not in enabled drivers build config 00:06:20.205 regex/*: missing internal dependency, "regexdev" 00:06:20.205 ml/*: missing internal dependency, "mldev" 00:06:20.205 vdpa/ifc: not in enabled drivers build config 00:06:20.205 vdpa/mlx5: not in enabled drivers build config 00:06:20.205 vdpa/nfp: not in enabled drivers build config 00:06:20.205 vdpa/sfc: not in enabled drivers build config 00:06:20.205 event/*: missing internal dependency, "eventdev" 00:06:20.205 baseband/*: missing internal dependency, "bbdev" 00:06:20.205 gpu/*: missing internal dependency, "gpudev" 00:06:20.205 00:06:20.205 00:06:20.205 Build targets in project: 85 00:06:20.205 00:06:20.205 DPDK 24.03.0 00:06:20.205 00:06:20.205 User defined options 00:06:20.205 buildtype : debug 00:06:20.205 default_library : shared 00:06:20.205 libdir : lib 00:06:20.205 prefix : /home/vagrant/spdk_repo/spdk/dpdk/build 00:06:20.205 c_args : -Wno-stringop-overflow -fcommon -Wno-stringop-overread -Wno-array-bounds -fPIC -Werror 00:06:20.205 c_link_args : 00:06:20.205 cpu_instruction_set: native 00:06:20.205 disable_apps : dumpcap,graph,pdump,proc-info,test-acl,test-bbdev,test-cmdline,test-compress-perf,test-crypto-perf,test-dma-perf,test-eventdev,test-fib,test-flow-perf,test-gpudev,test-mldev,test-pipeline,test-pmd,test-regex,test-sad,test-security-perf,test 00:06:20.205 disable_libs : acl,argparse,bbdev,bitratestats,bpf,cfgfile,dispatcher,distributor,efd,eventdev,fib,gpudev,graph,gro,gso,ip_frag,ipsec,jobstats,latencystats,lpm,member,metrics,mldev,node,pcapng,pdcp,pdump,pipeline,port,rawdev,regexdev,rib,sched,stack,table 00:06:20.205 enable_docs : false 00:06:20.205 enable_drivers : bus,bus/pci,bus/vdev,mempool/ring 00:06:20.205 enable_kmods : false 00:06:20.205 max_lcores : 128 00:06:20.205 tests : false 00:06:20.205 00:06:20.205 Found ninja-1.11.1.git.kitware.jobserver-1 at /usr/local/bin/ninja 00:06:20.205 ninja: Entering directory `/home/vagrant/spdk_repo/spdk/dpdk/build-tmp' 00:06:20.463 [1/268] Compiling C object lib/librte_kvargs.a.p/kvargs_rte_kvargs.c.o 00:06:20.463 [2/268] Compiling C object lib/librte_log.a.p/log_log_linux.c.o 00:06:20.463 [3/268] Linking static target lib/librte_kvargs.a 00:06:20.463 [4/268] Compiling C object lib/librte_telemetry.a.p/telemetry_telemetry_data.c.o 00:06:20.463 [5/268] Compiling C object lib/librte_log.a.p/log_log.c.o 00:06:20.463 [6/268] Linking static target lib/librte_log.a 00:06:21.395 [7/268] Generating lib/kvargs.sym_chk with a custom command (wrapped by meson to capture output) 00:06:21.395 [8/268] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_config.c.o 00:06:21.395 [9/268] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_errno.c.o 00:06:21.395 [10/268] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_hexdump.c.o 00:06:21.395 [11/268] Compiling C object lib/librte_telemetry.a.p/telemetry_telemetry.c.o 00:06:21.652 [12/268] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_debug.c.o 00:06:21.652 [13/268] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_bus.c.o 00:06:21.652 [14/268] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_devargs.c.o 00:06:21.909 [15/268] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_class.c.o 00:06:21.909 [16/268] Generating lib/log.sym_chk with a custom command (wrapped by meson to capture output) 00:06:21.909 [17/268] Linking target lib/librte_log.so.24.1 00:06:21.909 [18/268] Compiling C object lib/librte_telemetry.a.p/telemetry_telemetry_legacy.c.o 00:06:21.909 [19/268] Linking static target lib/librte_telemetry.a 00:06:22.168 [20/268] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_dev.c.o 00:06:22.168 [21/268] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_fbarray.c.o 00:06:22.168 [22/268] Generating symbol file lib/librte_log.so.24.1.p/librte_log.so.24.1.symbols 00:06:22.168 [23/268] Linking target lib/librte_kvargs.so.24.1 00:06:22.426 [24/268] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_lcore.c.o 00:06:22.426 [25/268] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_interrupts.c.o 00:06:22.684 [26/268] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_string_fns.c.o 00:06:22.684 [27/268] Generating symbol file lib/librte_kvargs.so.24.1.p/librte_kvargs.so.24.1.symbols 00:06:22.942 [28/268] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_launch.c.o 00:06:22.942 [29/268] Generating lib/telemetry.sym_chk with a custom command (wrapped by meson to capture output) 00:06:22.942 [30/268] Linking target lib/librte_telemetry.so.24.1 00:06:23.201 [31/268] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_memalloc.c.o 00:06:23.458 [32/268] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_mcfg.c.o 00:06:23.458 [33/268] Generating symbol file lib/librte_telemetry.so.24.1.p/librte_telemetry.so.24.1.symbols 00:06:23.458 [34/268] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_uuid.c.o 00:06:23.458 [35/268] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_memory.c.o 00:06:23.717 [36/268] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_thread.c.o 00:06:23.975 [37/268] Compiling C object lib/librte_eal.a.p/eal_common_rte_reciprocal.c.o 00:06:23.975 [38/268] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_memzone.c.o 00:06:24.233 [39/268] Compiling C object lib/librte_eal.a.p/eal_common_rte_version.c.o 00:06:24.233 [40/268] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_tailqs.c.o 00:06:24.233 [41/268] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_cpuflags.c.o 00:06:24.233 [42/268] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_options.c.o 00:06:24.233 [43/268] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_hypervisor.c.o 00:06:24.490 [44/268] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_timer.c.o 00:06:24.490 [45/268] Compiling C object lib/librte_eal.a.p/eal_common_rte_random.c.o 00:06:24.748 [46/268] Compiling C object lib/librte_eal.a.p/eal_common_rte_malloc.c.o 00:06:24.748 [47/268] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_trace_points.c.o 00:06:25.313 [48/268] Compiling C object lib/librte_eal.a.p/eal_common_malloc_elem.c.o 00:06:25.313 [49/268] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_dynmem.c.o 00:06:25.313 [50/268] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_trace_utils.c.o 00:06:25.313 [51/268] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_trace.c.o 00:06:25.313 [52/268] Compiling C object lib/librte_eal.a.p/eal_common_malloc_heap.c.o 00:06:25.313 [53/268] Compiling C object lib/librte_eal.a.p/eal_unix_eal_debug.c.o 00:06:25.571 [54/268] Compiling C object lib/librte_eal.a.p/eal_common_rte_service.c.o 00:06:25.828 [55/268] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_trace_ctf.c.o 00:06:25.828 [56/268] Compiling C object lib/librte_eal.a.p/eal_common_malloc_mp.c.o 00:06:26.085 [57/268] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_proc.c.o 00:06:26.085 [58/268] Compiling C object lib/librte_eal.a.p/eal_unix_eal_file.c.o 00:06:26.085 [59/268] Compiling C object lib/librte_eal.a.p/eal_unix_eal_firmware.c.o 00:06:26.085 [60/268] Compiling C object lib/librte_eal.a.p/eal_common_rte_keepalive.c.o 00:06:26.342 [61/268] Compiling C object lib/librte_eal.a.p/eal_common_hotplug_mp.c.o 00:06:26.342 [62/268] Compiling C object lib/librte_eal.a.p/eal_linux_eal_cpuflags.c.o 00:06:26.342 [63/268] Compiling C object lib/librte_eal.a.p/eal_unix_rte_thread.c.o 00:06:26.342 [64/268] Compiling C object lib/librte_eal.a.p/eal_unix_eal_unix_thread.c.o 00:06:26.600 [65/268] Compiling C object lib/librte_eal.a.p/eal_unix_eal_unix_memory.c.o 00:06:26.600 [66/268] Compiling C object lib/librte_eal.a.p/eal_linux_eal_alarm.c.o 00:06:26.600 [67/268] Compiling C object lib/librte_eal.a.p/eal_unix_eal_unix_timer.c.o 00:06:26.858 [68/268] Compiling C object lib/librte_eal.a.p/eal_unix_eal_filesystem.c.o 00:06:27.116 [69/268] Compiling C object lib/librte_eal.a.p/eal_linux_eal_dev.c.o 00:06:27.116 [70/268] Compiling C object lib/librte_eal.a.p/eal_linux_eal.c.o 00:06:27.116 [71/268] Compiling C object lib/librte_eal.a.p/eal_x86_rte_cpuflags.c.o 00:06:27.116 [72/268] Compiling C object lib/librte_eal.a.p/eal_linux_eal_memalloc.c.o 00:06:27.116 [73/268] Compiling C object lib/librte_eal.a.p/eal_linux_eal_lcore.c.o 00:06:27.116 [74/268] Compiling C object lib/librte_eal.a.p/eal_x86_rte_spinlock.c.o 00:06:27.116 [75/268] Compiling C object lib/librte_eal.a.p/eal_linux_eal_hugepage_info.c.o 00:06:27.394 [76/268] Compiling C object lib/librte_eal.a.p/eal_x86_rte_hypervisor.c.o 00:06:27.394 [77/268] Compiling C object lib/librte_eal.a.p/eal_linux_eal_timer.c.o 00:06:27.658 [78/268] Compiling C object lib/librte_eal.a.p/eal_x86_rte_power_intrinsics.c.o 00:06:27.915 [79/268] Compiling C object lib/librte_eal.a.p/eal_linux_eal_memory.c.o 00:06:27.915 [80/268] Compiling C object lib/librte_eal.a.p/eal_x86_rte_cycles.c.o 00:06:27.915 [81/268] Compiling C object lib/librte_eal.a.p/eal_linux_eal_vfio_mp_sync.c.o 00:06:27.915 [82/268] Compiling C object lib/librte_ring.a.p/ring_rte_ring.c.o 00:06:27.915 [83/268] Linking static target lib/librte_ring.a 00:06:28.174 [84/268] Compiling C object lib/librte_eal.a.p/eal_linux_eal_vfio.c.o 00:06:28.174 [85/268] Compiling C object lib/librte_eal.a.p/eal_linux_eal_interrupts.c.o 00:06:28.174 [86/268] Compiling C object lib/librte_rcu.a.p/rcu_rte_rcu_qsbr.c.o 00:06:28.174 [87/268] Linking static target lib/librte_rcu.a 00:06:28.174 [88/268] Compiling C object lib/librte_eal.a.p/eal_linux_eal_thread.c.o 00:06:28.431 [89/268] Linking static target lib/librte_eal.a 00:06:28.431 [90/268] Compiling C object lib/librte_mempool.a.p/mempool_rte_mempool_ops.c.o 00:06:28.431 [91/268] Compiling C object lib/librte_mempool.a.p/mempool_rte_mempool.c.o 00:06:28.689 [92/268] Generating lib/ring.sym_chk with a custom command (wrapped by meson to capture output) 00:06:28.689 [93/268] Compiling C object lib/librte_mempool.a.p/mempool_mempool_trace_points.c.o 00:06:28.947 [94/268] Compiling C object lib/net/libnet_crc_avx512_lib.a.p/net_crc_avx512.c.o 00:06:28.947 [95/268] Linking static target lib/net/libnet_crc_avx512_lib.a 00:06:28.947 [96/268] Generating lib/rcu.sym_chk with a custom command (wrapped by meson to capture output) 00:06:28.947 [97/268] Compiling C object lib/librte_mempool.a.p/mempool_rte_mempool_ops_default.c.o 00:06:28.947 [98/268] Linking static target lib/librte_mempool.a 00:06:28.947 [99/268] Compiling C object lib/librte_mbuf.a.p/mbuf_rte_mbuf_ptype.c.o 00:06:29.205 [100/268] Compiling C object lib/librte_mbuf.a.p/mbuf_rte_mbuf_dyn.c.o 00:06:29.205 [101/268] Compiling C object lib/librte_mbuf.a.p/mbuf_rte_mbuf_pool_ops.c.o 00:06:29.463 [102/268] Compiling C object lib/librte_net.a.p/net_net_crc_sse.c.o 00:06:29.721 [103/268] Compiling C object lib/librte_net.a.p/net_rte_net.c.o 00:06:29.721 [104/268] Compiling C object lib/librte_mbuf.a.p/mbuf_rte_mbuf.c.o 00:06:29.721 [105/268] Linking static target lib/librte_mbuf.a 00:06:29.721 [106/268] Compiling C object lib/librte_net.a.p/net_rte_ether.c.o 00:06:29.721 [107/268] Compiling C object lib/librte_net.a.p/net_rte_net_crc.c.o 00:06:29.979 [108/268] Compiling C object lib/librte_net.a.p/net_rte_arp.c.o 00:06:29.979 [109/268] Linking static target lib/librte_net.a 00:06:30.282 [110/268] Compiling C object lib/librte_meter.a.p/meter_rte_meter.c.o 00:06:30.282 [111/268] Linking static target lib/librte_meter.a 00:06:30.282 [112/268] Compiling C object lib/librte_ethdev.a.p/ethdev_ethdev_driver.c.o 00:06:30.543 [113/268] Generating lib/mempool.sym_chk with a custom command (wrapped by meson to capture output) 00:06:30.543 [114/268] Compiling C object lib/librte_ethdev.a.p/ethdev_ethdev_private.c.o 00:06:30.543 [115/268] Compiling C object lib/librte_ethdev.a.p/ethdev_ethdev_profile.c.o 00:06:30.543 [116/268] Generating lib/net.sym_chk with a custom command (wrapped by meson to capture output) 00:06:30.543 [117/268] Compiling C object lib/librte_ethdev.a.p/ethdev_rte_class_eth.c.o 00:06:30.801 [118/268] Generating lib/meter.sym_chk with a custom command (wrapped by meson to capture output) 00:06:30.801 [119/268] Generating lib/mbuf.sym_chk with a custom command (wrapped by meson to capture output) 00:06:31.365 [120/268] Compiling C object lib/librte_ethdev.a.p/ethdev_rte_ethdev_telemetry.c.o 00:06:31.365 [121/268] Compiling C object lib/librte_ethdev.a.p/ethdev_rte_mtr.c.o 00:06:31.623 [122/268] Compiling C object lib/librte_ethdev.a.p/ethdev_ethdev_trace_points.c.o 00:06:31.623 [123/268] Compiling C object lib/librte_ethdev.a.p/ethdev_rte_ethdev_cman.c.o 00:06:31.623 [124/268] Compiling C object lib/librte_ethdev.a.p/ethdev_sff_common.c.o 00:06:31.882 [125/268] Compiling C object lib/librte_pci.a.p/pci_rte_pci.c.o 00:06:31.882 [126/268] Linking static target lib/librte_pci.a 00:06:31.882 [127/268] Compiling C object lib/librte_ethdev.a.p/ethdev_sff_telemetry.c.o 00:06:31.882 [128/268] Compiling C object lib/librte_ethdev.a.p/ethdev_sff_8079.c.o 00:06:31.882 [129/268] Compiling C object lib/librte_ethdev.a.p/ethdev_rte_tm.c.o 00:06:31.882 [130/268] Compiling C object lib/librte_ethdev.a.p/ethdev_rte_flow.c.o 00:06:32.141 [131/268] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline.c.o 00:06:32.141 [132/268] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_cirbuf.c.o 00:06:32.141 [133/268] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_parse.c.o 00:06:32.141 [134/268] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_parse_num.c.o 00:06:32.141 [135/268] Compiling C object lib/librte_ethdev.a.p/ethdev_sff_8472.c.o 00:06:32.141 [136/268] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_parse_portlist.c.o 00:06:32.141 [137/268] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_parse_string.c.o 00:06:32.398 [138/268] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_socket.c.o 00:06:32.398 [139/268] Compiling C object lib/librte_ethdev.a.p/ethdev_ethdev_linux_ethtool.c.o 00:06:32.398 [140/268] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_rdline.c.o 00:06:32.398 [141/268] Generating lib/pci.sym_chk with a custom command (wrapped by meson to capture output) 00:06:32.398 [142/268] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_vt100.c.o 00:06:32.398 [143/268] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_os_unix.c.o 00:06:32.398 [144/268] Compiling C object lib/librte_hash.a.p/hash_rte_hash_crc.c.o 00:06:32.398 [145/268] Compiling C object lib/librte_ethdev.a.p/ethdev_sff_8636.c.o 00:06:32.398 [146/268] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_parse_etheraddr.c.o 00:06:32.660 [147/268] Compiling C object lib/librte_ethdev.a.p/ethdev_rte_ethdev.c.o 00:06:32.660 [148/268] Linking static target lib/librte_ethdev.a 00:06:32.917 [149/268] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_parse_ipaddr.c.o 00:06:32.917 [150/268] Linking static target lib/librte_cmdline.a 00:06:32.917 [151/268] Compiling C object lib/librte_hash.a.p/hash_rte_thash_gfni.c.o 00:06:32.917 [152/268] Compiling C object lib/librte_hash.a.p/hash_rte_fbk_hash.c.o 00:06:32.917 [153/268] Compiling C object lib/librte_timer.a.p/timer_rte_timer.c.o 00:06:32.917 [154/268] Linking static target lib/librte_timer.a 00:06:33.174 [155/268] Compiling C object lib/librte_hash.a.p/hash_rte_thash.c.o 00:06:33.174 [156/268] Compiling C object lib/librte_compressdev.a.p/compressdev_rte_compressdev.c.o 00:06:33.174 [157/268] Compiling C object lib/librte_compressdev.a.p/compressdev_rte_compressdev_pmd.c.o 00:06:33.433 [158/268] Compiling C object lib/librte_hash.a.p/hash_rte_cuckoo_hash.c.o 00:06:33.433 [159/268] Linking static target lib/librte_hash.a 00:06:33.693 [160/268] Compiling C object lib/librte_compressdev.a.p/compressdev_rte_comp.c.o 00:06:33.693 [161/268] Linking static target lib/librte_compressdev.a 00:06:33.693 [162/268] Generating lib/timer.sym_chk with a custom command (wrapped by meson to capture output) 00:06:33.693 [163/268] Compiling C object lib/librte_cryptodev.a.p/cryptodev_cryptodev_pmd.c.o 00:06:33.955 [164/268] Compiling C object lib/librte_cryptodev.a.p/cryptodev_cryptodev_trace_points.c.o 00:06:33.955 [165/268] Compiling C object lib/librte_dmadev.a.p/dmadev_rte_dmadev.c.o 00:06:33.955 [166/268] Compiling C object lib/librte_power.a.p/power_guest_channel.c.o 00:06:33.955 [167/268] Compiling C object lib/librte_power.a.p/power_power_common.c.o 00:06:34.213 [168/268] Compiling C object lib/librte_dmadev.a.p/dmadev_rte_dmadev_trace_points.c.o 00:06:34.213 [169/268] Linking static target lib/librte_dmadev.a 00:06:34.471 [170/268] Compiling C object lib/librte_cryptodev.a.p/cryptodev_rte_cryptodev.c.o 00:06:34.471 [171/268] Compiling C object lib/librte_power.a.p/power_power_acpi_cpufreq.c.o 00:06:34.471 [172/268] Linking static target lib/librte_cryptodev.a 00:06:34.471 [173/268] Compiling C object lib/librte_power.a.p/power_power_amd_pstate_cpufreq.c.o 00:06:34.471 [174/268] Compiling C object lib/librte_power.a.p/power_power_kvm_vm.c.o 00:06:34.729 [175/268] Compiling C object lib/librte_power.a.p/power_power_cppc_cpufreq.c.o 00:06:34.729 [176/268] Generating lib/cmdline.sym_chk with a custom command (wrapped by meson to capture output) 00:06:34.729 [177/268] Generating lib/compressdev.sym_chk with a custom command (wrapped by meson to capture output) 00:06:34.729 [178/268] Generating lib/hash.sym_chk with a custom command (wrapped by meson to capture output) 00:06:34.986 [179/268] Compiling C object lib/librte_power.a.p/power_power_intel_uncore.c.o 00:06:35.244 [180/268] Compiling C object lib/librte_power.a.p/power_power_pstate_cpufreq.c.o 00:06:35.244 [181/268] Compiling C object lib/librte_power.a.p/power_rte_power.c.o 00:06:35.244 [182/268] Generating lib/dmadev.sym_chk with a custom command (wrapped by meson to capture output) 00:06:35.244 [183/268] Compiling C object lib/librte_vhost.a.p/vhost_fd_man.c.o 00:06:35.504 [184/268] Compiling C object lib/librte_power.a.p/power_rte_power_uncore.c.o 00:06:35.504 [185/268] Compiling C object lib/librte_power.a.p/power_rte_power_pmd_mgmt.c.o 00:06:35.504 [186/268] Compiling C object lib/librte_reorder.a.p/reorder_rte_reorder.c.o 00:06:35.504 [187/268] Linking static target lib/librte_power.a 00:06:35.504 [188/268] Linking static target lib/librte_reorder.a 00:06:36.070 [189/268] Compiling C object lib/librte_security.a.p/security_rte_security.c.o 00:06:36.070 [190/268] Linking static target lib/librte_security.a 00:06:36.070 [191/268] Compiling C object lib/librte_vhost.a.p/vhost_vdpa.c.o 00:06:36.070 [192/268] Compiling C object lib/librte_vhost.a.p/vhost_socket.c.o 00:06:36.070 [193/268] Compiling C object lib/librte_vhost.a.p/vhost_iotlb.c.o 00:06:36.070 [194/268] Generating lib/reorder.sym_chk with a custom command (wrapped by meson to capture output) 00:06:36.637 [195/268] Compiling C object lib/librte_vhost.a.p/vhost_vhost.c.o 00:06:36.637 [196/268] Generating lib/power.sym_chk with a custom command (wrapped by meson to capture output) 00:06:36.637 [197/268] Generating lib/security.sym_chk with a custom command (wrapped by meson to capture output) 00:06:36.895 [198/268] Compiling C object drivers/libtmp_rte_bus_pci.a.p/bus_pci_pci_params.c.o 00:06:36.895 [199/268] Compiling C object lib/librte_vhost.a.p/vhost_virtio_net_ctrl.c.o 00:06:36.895 [200/268] Generating lib/cryptodev.sym_chk with a custom command (wrapped by meson to capture output) 00:06:37.152 [201/268] Compiling C object lib/librte_vhost.a.p/vhost_vhost_user.c.o 00:06:37.152 [202/268] Compiling C object lib/librte_vhost.a.p/vhost_vduse.c.o 00:06:37.410 [203/268] Compiling C object drivers/libtmp_rte_bus_pci.a.p/bus_pci_pci_common.c.o 00:06:37.410 [204/268] Compiling C object drivers/libtmp_rte_bus_vdev.a.p/bus_vdev_vdev_params.c.o 00:06:37.410 [205/268] Compiling C object drivers/libtmp_rte_bus_pci.a.p/bus_pci_pci_common_uio.c.o 00:06:37.669 [206/268] Compiling C object drivers/libtmp_rte_bus_pci.a.p/bus_pci_linux_pci.c.o 00:06:37.669 [207/268] Compiling C object drivers/libtmp_rte_bus_pci.a.p/bus_pci_linux_pci_uio.c.o 00:06:37.927 [208/268] Compiling C object drivers/libtmp_rte_bus_vdev.a.p/bus_vdev_vdev.c.o 00:06:37.927 [209/268] Linking static target drivers/libtmp_rte_bus_vdev.a 00:06:37.927 [210/268] Compiling C object lib/librte_vhost.a.p/vhost_vhost_crypto.c.o 00:06:37.927 [211/268] Compiling C object drivers/libtmp_rte_bus_pci.a.p/bus_pci_linux_pci_vfio.c.o 00:06:37.927 [212/268] Linking static target drivers/libtmp_rte_bus_pci.a 00:06:38.185 [213/268] Compiling C object drivers/libtmp_rte_mempool_ring.a.p/mempool_ring_rte_mempool_ring.c.o 00:06:38.185 [214/268] Linking static target drivers/libtmp_rte_mempool_ring.a 00:06:38.185 [215/268] Generating drivers/rte_bus_vdev.pmd.c with a custom command 00:06:38.185 [216/268] Compiling C object drivers/librte_bus_vdev.a.p/meson-generated_.._rte_bus_vdev.pmd.c.o 00:06:38.185 [217/268] Compiling C object drivers/librte_bus_vdev.so.24.1.p/meson-generated_.._rte_bus_vdev.pmd.c.o 00:06:38.185 [218/268] Linking static target drivers/librte_bus_vdev.a 00:06:38.185 [219/268] Generating drivers/rte_bus_pci.pmd.c with a custom command 00:06:38.185 [220/268] Compiling C object drivers/librte_bus_pci.a.p/meson-generated_.._rte_bus_pci.pmd.c.o 00:06:38.185 [221/268] Compiling C object drivers/librte_bus_pci.so.24.1.p/meson-generated_.._rte_bus_pci.pmd.c.o 00:06:38.185 [222/268] Linking static target drivers/librte_bus_pci.a 00:06:38.185 [223/268] Generating drivers/rte_mempool_ring.pmd.c with a custom command 00:06:38.185 [224/268] Compiling C object drivers/librte_mempool_ring.so.24.1.p/meson-generated_.._rte_mempool_ring.pmd.c.o 00:06:38.185 [225/268] Compiling C object drivers/librte_mempool_ring.a.p/meson-generated_.._rte_mempool_ring.pmd.c.o 00:06:38.443 [226/268] Linking static target drivers/librte_mempool_ring.a 00:06:38.443 [227/268] Generating drivers/rte_bus_vdev.sym_chk with a custom command (wrapped by meson to capture output) 00:06:39.009 [228/268] Generating drivers/rte_bus_pci.sym_chk with a custom command (wrapped by meson to capture output) 00:06:39.587 [229/268] Compiling C object lib/librte_vhost.a.p/vhost_virtio_net.c.o 00:06:39.587 [230/268] Linking static target lib/librte_vhost.a 00:06:40.152 [231/268] Generating lib/eal.sym_chk with a custom command (wrapped by meson to capture output) 00:06:40.409 [232/268] Linking target lib/librte_eal.so.24.1 00:06:40.409 [233/268] Generating symbol file lib/librte_eal.so.24.1.p/librte_eal.so.24.1.symbols 00:06:40.409 [234/268] Linking target lib/librte_pci.so.24.1 00:06:40.409 [235/268] Linking target lib/librte_meter.so.24.1 00:06:40.667 [236/268] Linking target lib/librte_timer.so.24.1 00:06:40.667 [237/268] Linking target lib/librte_ring.so.24.1 00:06:40.667 [238/268] Linking target lib/librte_dmadev.so.24.1 00:06:40.667 [239/268] Linking target drivers/librte_bus_vdev.so.24.1 00:06:40.667 [240/268] Generating symbol file lib/librte_pci.so.24.1.p/librte_pci.so.24.1.symbols 00:06:40.667 [241/268] Generating symbol file lib/librte_meter.so.24.1.p/librte_meter.so.24.1.symbols 00:06:40.667 [242/268] Generating symbol file lib/librte_ring.so.24.1.p/librte_ring.so.24.1.symbols 00:06:40.667 [243/268] Generating symbol file lib/librte_timer.so.24.1.p/librte_timer.so.24.1.symbols 00:06:40.667 [244/268] Generating symbol file lib/librte_dmadev.so.24.1.p/librte_dmadev.so.24.1.symbols 00:06:40.667 [245/268] Linking target drivers/librte_bus_pci.so.24.1 00:06:40.667 [246/268] Linking target lib/librte_rcu.so.24.1 00:06:40.667 [247/268] Linking target lib/librte_mempool.so.24.1 00:06:40.924 [248/268] Generating lib/ethdev.sym_chk with a custom command (wrapped by meson to capture output) 00:06:40.924 [249/268] Generating symbol file lib/librte_rcu.so.24.1.p/librte_rcu.so.24.1.symbols 00:06:40.924 [250/268] Generating symbol file lib/librte_mempool.so.24.1.p/librte_mempool.so.24.1.symbols 00:06:40.924 [251/268] Linking target lib/librte_mbuf.so.24.1 00:06:40.924 [252/268] Linking target drivers/librte_mempool_ring.so.24.1 00:06:40.924 [253/268] Generating lib/vhost.sym_chk with a custom command (wrapped by meson to capture output) 00:06:41.182 [254/268] Generating symbol file lib/librte_mbuf.so.24.1.p/librte_mbuf.so.24.1.symbols 00:06:41.182 [255/268] Linking target lib/librte_net.so.24.1 00:06:41.182 [256/268] Linking target lib/librte_compressdev.so.24.1 00:06:41.182 [257/268] Linking target lib/librte_cryptodev.so.24.1 00:06:41.182 [258/268] Linking target lib/librte_reorder.so.24.1 00:06:41.183 [259/268] Generating symbol file lib/librte_net.so.24.1.p/librte_net.so.24.1.symbols 00:06:41.183 [260/268] Generating symbol file lib/librte_cryptodev.so.24.1.p/librte_cryptodev.so.24.1.symbols 00:06:41.183 [261/268] Linking target lib/librte_cmdline.so.24.1 00:06:41.183 [262/268] Linking target lib/librte_security.so.24.1 00:06:41.440 [263/268] Linking target lib/librte_ethdev.so.24.1 00:06:41.440 [264/268] Linking target lib/librte_hash.so.24.1 00:06:41.440 [265/268] Generating symbol file lib/librte_ethdev.so.24.1.p/librte_ethdev.so.24.1.symbols 00:06:41.440 [266/268] Generating symbol file lib/librte_hash.so.24.1.p/librte_hash.so.24.1.symbols 00:06:41.440 [267/268] Linking target lib/librte_power.so.24.1 00:06:41.440 [268/268] Linking target lib/librte_vhost.so.24.1 00:06:41.698 INFO: autodetecting backend as ninja 00:06:41.698 INFO: calculating backend command to run: /usr/local/bin/ninja -C /home/vagrant/spdk_repo/spdk/dpdk/build-tmp -j 10 00:07:13.778 CC lib/log/log.o 00:07:13.778 CC lib/log/log_flags.o 00:07:13.778 CC lib/log/log_deprecated.o 00:07:13.778 CC lib/ut/ut.o 00:07:13.778 CC lib/ut_mock/mock.o 00:07:13.778 LIB libspdk_log.a 00:07:13.778 LIB libspdk_ut.a 00:07:13.778 LIB libspdk_ut_mock.a 00:07:13.778 SO libspdk_ut.so.2.0 00:07:13.778 SO libspdk_log.so.7.0 00:07:13.778 SO libspdk_ut_mock.so.6.0 00:07:13.778 SYMLINK libspdk_log.so 00:07:13.778 SYMLINK libspdk_ut_mock.so 00:07:13.778 SYMLINK libspdk_ut.so 00:07:13.778 CC lib/util/base64.o 00:07:13.778 CC lib/util/bit_array.o 00:07:13.778 CC lib/util/cpuset.o 00:07:13.778 CC lib/util/crc16.o 00:07:13.778 CC lib/util/crc32.o 00:07:13.778 CC lib/util/crc32c.o 00:07:13.778 CC lib/ioat/ioat.o 00:07:13.778 CC lib/dma/dma.o 00:07:13.778 CXX lib/trace_parser/trace.o 00:07:13.778 CC lib/vfio_user/host/vfio_user_pci.o 00:07:13.778 CC lib/util/crc32_ieee.o 00:07:13.778 CC lib/vfio_user/host/vfio_user.o 00:07:13.778 CC lib/util/crc64.o 00:07:13.778 LIB libspdk_dma.a 00:07:13.778 CC lib/util/dif.o 00:07:13.778 CC lib/util/fd.o 00:07:13.778 CC lib/util/fd_group.o 00:07:13.778 SO libspdk_dma.so.5.0 00:07:13.778 LIB libspdk_ioat.a 00:07:13.778 SYMLINK libspdk_dma.so 00:07:13.778 CC lib/util/file.o 00:07:13.778 SO libspdk_ioat.so.7.0 00:07:13.778 CC lib/util/hexlify.o 00:07:13.778 CC lib/util/iov.o 00:07:13.778 SYMLINK libspdk_ioat.so 00:07:13.778 CC lib/util/math.o 00:07:13.778 CC lib/util/net.o 00:07:13.778 LIB libspdk_vfio_user.a 00:07:13.778 CC lib/util/pipe.o 00:07:13.778 SO libspdk_vfio_user.so.5.0 00:07:13.778 CC lib/util/strerror_tls.o 00:07:13.778 CC lib/util/string.o 00:07:13.778 CC lib/util/uuid.o 00:07:13.778 SYMLINK libspdk_vfio_user.so 00:07:13.778 CC lib/util/xor.o 00:07:13.778 CC lib/util/zipf.o 00:07:13.778 CC lib/util/md5.o 00:07:13.778 LIB libspdk_util.a 00:07:13.778 SO libspdk_util.so.10.0 00:07:13.778 LIB libspdk_trace_parser.a 00:07:13.778 SO libspdk_trace_parser.so.6.0 00:07:13.778 SYMLINK libspdk_util.so 00:07:13.778 SYMLINK libspdk_trace_parser.so 00:07:13.778 CC lib/conf/conf.o 00:07:13.778 CC lib/idxd/idxd.o 00:07:13.778 CC lib/idxd/idxd_user.o 00:07:13.778 CC lib/idxd/idxd_kernel.o 00:07:13.778 CC lib/rdma_utils/rdma_utils.o 00:07:13.778 CC lib/env_dpdk/env.o 00:07:13.778 CC lib/env_dpdk/memory.o 00:07:13.778 CC lib/json/json_parse.o 00:07:13.778 CC lib/rdma_provider/common.o 00:07:13.778 CC lib/vmd/vmd.o 00:07:13.778 LIB libspdk_conf.a 00:07:13.778 SO libspdk_conf.so.6.0 00:07:13.778 LIB libspdk_rdma_utils.a 00:07:13.778 CC lib/env_dpdk/pci.o 00:07:13.778 SYMLINK libspdk_conf.so 00:07:13.778 CC lib/json/json_util.o 00:07:13.778 SO libspdk_rdma_utils.so.1.0 00:07:13.778 CC lib/rdma_provider/rdma_provider_verbs.o 00:07:13.778 CC lib/json/json_write.o 00:07:13.778 SYMLINK libspdk_rdma_utils.so 00:07:13.778 CC lib/vmd/led.o 00:07:13.778 CC lib/env_dpdk/init.o 00:07:13.778 CC lib/env_dpdk/threads.o 00:07:13.778 CC lib/env_dpdk/pci_ioat.o 00:07:13.779 LIB libspdk_json.a 00:07:13.779 LIB libspdk_rdma_provider.a 00:07:13.779 SO libspdk_rdma_provider.so.6.0 00:07:13.779 SO libspdk_json.so.6.0 00:07:13.779 LIB libspdk_idxd.a 00:07:13.779 SYMLINK libspdk_rdma_provider.so 00:07:13.779 SYMLINK libspdk_json.so 00:07:13.779 CC lib/env_dpdk/pci_virtio.o 00:07:13.779 CC lib/env_dpdk/pci_vmd.o 00:07:13.779 SO libspdk_idxd.so.12.1 00:07:13.779 CC lib/env_dpdk/pci_idxd.o 00:07:13.779 SYMLINK libspdk_idxd.so 00:07:13.779 CC lib/env_dpdk/pci_event.o 00:07:13.779 CC lib/env_dpdk/sigbus_handler.o 00:07:13.779 CC lib/env_dpdk/pci_dpdk.o 00:07:13.779 LIB libspdk_vmd.a 00:07:13.779 CC lib/env_dpdk/pci_dpdk_2207.o 00:07:13.779 SO libspdk_vmd.so.6.0 00:07:13.779 CC lib/env_dpdk/pci_dpdk_2211.o 00:07:13.779 SYMLINK libspdk_vmd.so 00:07:13.779 CC lib/jsonrpc/jsonrpc_server.o 00:07:13.779 CC lib/jsonrpc/jsonrpc_server_tcp.o 00:07:13.779 CC lib/jsonrpc/jsonrpc_client.o 00:07:13.779 CC lib/jsonrpc/jsonrpc_client_tcp.o 00:07:13.779 LIB libspdk_jsonrpc.a 00:07:13.779 SO libspdk_jsonrpc.so.6.0 00:07:13.779 SYMLINK libspdk_jsonrpc.so 00:07:13.779 LIB libspdk_env_dpdk.a 00:07:13.779 SO libspdk_env_dpdk.so.15.0 00:07:13.779 CC lib/rpc/rpc.o 00:07:13.779 SYMLINK libspdk_env_dpdk.so 00:07:13.779 LIB libspdk_rpc.a 00:07:13.779 SO libspdk_rpc.so.6.0 00:07:13.779 SYMLINK libspdk_rpc.so 00:07:13.779 CC lib/keyring/keyring.o 00:07:13.779 CC lib/keyring/keyring_rpc.o 00:07:13.779 CC lib/trace/trace.o 00:07:13.779 CC lib/notify/notify.o 00:07:13.779 CC lib/trace/trace_rpc.o 00:07:13.779 CC lib/trace/trace_flags.o 00:07:13.779 CC lib/notify/notify_rpc.o 00:07:13.779 LIB libspdk_notify.a 00:07:13.779 SO libspdk_notify.so.6.0 00:07:13.779 SYMLINK libspdk_notify.so 00:07:13.779 LIB libspdk_keyring.a 00:07:13.779 LIB libspdk_trace.a 00:07:13.779 SO libspdk_keyring.so.2.0 00:07:13.779 SO libspdk_trace.so.11.0 00:07:13.779 SYMLINK libspdk_keyring.so 00:07:13.779 SYMLINK libspdk_trace.so 00:07:14.036 CC lib/sock/sock.o 00:07:14.036 CC lib/sock/sock_rpc.o 00:07:14.036 CC lib/thread/thread.o 00:07:14.036 CC lib/thread/iobuf.o 00:07:14.294 LIB libspdk_sock.a 00:07:14.294 SO libspdk_sock.so.10.0 00:07:14.552 SYMLINK libspdk_sock.so 00:07:14.810 CC lib/nvme/nvme_ctrlr_cmd.o 00:07:14.810 CC lib/nvme/nvme_ctrlr.o 00:07:14.810 CC lib/nvme/nvme_fabric.o 00:07:14.810 CC lib/nvme/nvme_ns.o 00:07:14.810 CC lib/nvme/nvme_ns_cmd.o 00:07:14.810 CC lib/nvme/nvme_pcie_common.o 00:07:14.810 CC lib/nvme/nvme_pcie.o 00:07:14.810 CC lib/nvme/nvme_qpair.o 00:07:14.810 CC lib/nvme/nvme.o 00:07:15.743 LIB libspdk_thread.a 00:07:15.743 SO libspdk_thread.so.10.2 00:07:15.743 SYMLINK libspdk_thread.so 00:07:15.743 CC lib/nvme/nvme_quirks.o 00:07:15.743 CC lib/nvme/nvme_transport.o 00:07:15.743 CC lib/nvme/nvme_discovery.o 00:07:16.000 CC lib/nvme/nvme_ctrlr_ocssd_cmd.o 00:07:16.000 CC lib/nvme/nvme_ns_ocssd_cmd.o 00:07:16.258 CC lib/accel/accel.o 00:07:16.258 CC lib/blob/blobstore.o 00:07:16.516 CC lib/init/json_config.o 00:07:16.516 CC lib/init/subsystem.o 00:07:16.774 CC lib/virtio/virtio.o 00:07:16.774 CC lib/init/subsystem_rpc.o 00:07:16.774 CC lib/init/rpc.o 00:07:16.774 CC lib/blob/request.o 00:07:17.031 CC lib/blob/zeroes.o 00:07:17.031 CC lib/blob/blob_bs_dev.o 00:07:17.031 CC lib/nvme/nvme_tcp.o 00:07:17.031 LIB libspdk_init.a 00:07:17.031 CC lib/fsdev/fsdev.o 00:07:17.031 CC lib/fsdev/fsdev_io.o 00:07:17.031 SO libspdk_init.so.6.0 00:07:17.289 CC lib/virtio/virtio_vhost_user.o 00:07:17.289 SYMLINK libspdk_init.so 00:07:17.289 CC lib/virtio/virtio_vfio_user.o 00:07:17.289 CC lib/fsdev/fsdev_rpc.o 00:07:17.546 CC lib/event/app.o 00:07:17.546 CC lib/accel/accel_rpc.o 00:07:17.546 CC lib/virtio/virtio_pci.o 00:07:17.546 CC lib/accel/accel_sw.o 00:07:17.546 CC lib/event/reactor.o 00:07:17.804 CC lib/nvme/nvme_opal.o 00:07:17.804 CC lib/nvme/nvme_io_msg.o 00:07:17.804 CC lib/nvme/nvme_poll_group.o 00:07:17.804 CC lib/event/log_rpc.o 00:07:17.804 LIB libspdk_virtio.a 00:07:18.061 SO libspdk_virtio.so.7.0 00:07:18.061 LIB libspdk_accel.a 00:07:18.061 SO libspdk_accel.so.16.0 00:07:18.061 SYMLINK libspdk_virtio.so 00:07:18.061 CC lib/event/app_rpc.o 00:07:18.061 CC lib/nvme/nvme_zns.o 00:07:18.061 SYMLINK libspdk_accel.so 00:07:18.061 CC lib/nvme/nvme_stubs.o 00:07:18.319 LIB libspdk_fsdev.a 00:07:18.319 SO libspdk_fsdev.so.1.0 00:07:18.319 CC lib/event/scheduler_static.o 00:07:18.319 CC lib/nvme/nvme_auth.o 00:07:18.319 SYMLINK libspdk_fsdev.so 00:07:18.320 CC lib/nvme/nvme_cuse.o 00:07:18.577 CC lib/nvme/nvme_rdma.o 00:07:18.577 LIB libspdk_event.a 00:07:18.577 SO libspdk_event.so.15.0 00:07:18.835 SYMLINK libspdk_event.so 00:07:18.835 CC lib/bdev/bdev.o 00:07:18.835 CC lib/bdev/bdev_rpc.o 00:07:18.835 CC lib/bdev/bdev_zone.o 00:07:18.835 CC lib/bdev/part.o 00:07:18.835 CC lib/fuse_dispatcher/fuse_dispatcher.o 00:07:19.092 CC lib/bdev/scsi_nvme.o 00:07:19.657 LIB libspdk_fuse_dispatcher.a 00:07:19.657 SO libspdk_fuse_dispatcher.so.1.0 00:07:19.657 SYMLINK libspdk_fuse_dispatcher.so 00:07:19.915 LIB libspdk_blob.a 00:07:19.915 SO libspdk_blob.so.11.0 00:07:19.915 SYMLINK libspdk_blob.so 00:07:20.174 LIB libspdk_nvme.a 00:07:20.174 CC lib/lvol/lvol.o 00:07:20.174 CC lib/blobfs/tree.o 00:07:20.174 CC lib/blobfs/blobfs.o 00:07:20.174 SO libspdk_nvme.so.14.0 00:07:20.432 SYMLINK libspdk_nvme.so 00:07:21.368 LIB libspdk_blobfs.a 00:07:21.368 SO libspdk_blobfs.so.10.0 00:07:21.368 SYMLINK libspdk_blobfs.so 00:07:21.368 LIB libspdk_lvol.a 00:07:21.368 SO libspdk_lvol.so.10.0 00:07:21.368 SYMLINK libspdk_lvol.so 00:07:21.933 LIB libspdk_bdev.a 00:07:21.933 SO libspdk_bdev.so.17.0 00:07:21.933 SYMLINK libspdk_bdev.so 00:07:22.191 CC lib/ftl/ftl_core.o 00:07:22.191 CC lib/ftl/ftl_layout.o 00:07:22.191 CC lib/ftl/ftl_init.o 00:07:22.191 CC lib/ftl/ftl_debug.o 00:07:22.191 CC lib/ftl/ftl_io.o 00:07:22.191 CC lib/ftl/ftl_sb.o 00:07:22.191 CC lib/nbd/nbd.o 00:07:22.191 CC lib/nvmf/ctrlr.o 00:07:22.191 CC lib/scsi/dev.o 00:07:22.191 CC lib/ublk/ublk.o 00:07:22.448 CC lib/ublk/ublk_rpc.o 00:07:22.448 CC lib/scsi/lun.o 00:07:22.705 CC lib/nbd/nbd_rpc.o 00:07:22.705 CC lib/ftl/ftl_l2p.o 00:07:22.705 CC lib/ftl/ftl_l2p_flat.o 00:07:22.705 CC lib/ftl/ftl_nv_cache.o 00:07:22.705 CC lib/nvmf/ctrlr_discovery.o 00:07:22.705 CC lib/ftl/ftl_band.o 00:07:22.962 CC lib/scsi/port.o 00:07:22.962 LIB libspdk_nbd.a 00:07:22.962 CC lib/scsi/scsi.o 00:07:22.962 CC lib/ftl/ftl_band_ops.o 00:07:22.962 SO libspdk_nbd.so.7.0 00:07:22.962 LIB libspdk_ublk.a 00:07:22.962 CC lib/scsi/scsi_bdev.o 00:07:22.962 SYMLINK libspdk_nbd.so 00:07:22.962 CC lib/scsi/scsi_pr.o 00:07:22.962 CC lib/ftl/ftl_writer.o 00:07:23.219 SO libspdk_ublk.so.3.0 00:07:23.219 SYMLINK libspdk_ublk.so 00:07:23.219 CC lib/ftl/ftl_rq.o 00:07:23.219 CC lib/scsi/scsi_rpc.o 00:07:23.219 CC lib/ftl/ftl_reloc.o 00:07:23.219 CC lib/nvmf/ctrlr_bdev.o 00:07:23.477 CC lib/ftl/ftl_l2p_cache.o 00:07:23.477 CC lib/nvmf/subsystem.o 00:07:23.477 CC lib/nvmf/nvmf.o 00:07:23.477 CC lib/ftl/ftl_p2l.o 00:07:23.477 CC lib/nvmf/nvmf_rpc.o 00:07:23.735 CC lib/scsi/task.o 00:07:23.735 CC lib/ftl/ftl_p2l_log.o 00:07:23.993 CC lib/ftl/mngt/ftl_mngt.o 00:07:23.993 CC lib/ftl/mngt/ftl_mngt_bdev.o 00:07:23.993 CC lib/ftl/mngt/ftl_mngt_shutdown.o 00:07:23.993 CC lib/ftl/mngt/ftl_mngt_startup.o 00:07:23.993 CC lib/ftl/mngt/ftl_mngt_md.o 00:07:23.993 LIB libspdk_scsi.a 00:07:24.251 SO libspdk_scsi.so.9.0 00:07:24.251 CC lib/nvmf/transport.o 00:07:24.251 CC lib/nvmf/tcp.o 00:07:24.251 CC lib/nvmf/stubs.o 00:07:24.251 SYMLINK libspdk_scsi.so 00:07:24.251 CC lib/nvmf/mdns_server.o 00:07:24.251 CC lib/nvmf/rdma.o 00:07:24.510 CC lib/ftl/mngt/ftl_mngt_misc.o 00:07:24.510 CC lib/ftl/mngt/ftl_mngt_ioch.o 00:07:24.767 CC lib/nvmf/auth.o 00:07:24.767 CC lib/ftl/mngt/ftl_mngt_l2p.o 00:07:24.767 CC lib/iscsi/conn.o 00:07:24.767 CC lib/ftl/mngt/ftl_mngt_band.o 00:07:24.767 CC lib/ftl/mngt/ftl_mngt_self_test.o 00:07:24.767 CC lib/ftl/mngt/ftl_mngt_p2l.o 00:07:25.025 CC lib/vhost/vhost.o 00:07:25.025 CC lib/ftl/mngt/ftl_mngt_recovery.o 00:07:25.025 CC lib/ftl/mngt/ftl_mngt_upgrade.o 00:07:25.284 CC lib/ftl/utils/ftl_conf.o 00:07:25.284 CC lib/ftl/utils/ftl_md.o 00:07:25.284 CC lib/vhost/vhost_rpc.o 00:07:25.284 CC lib/vhost/vhost_scsi.o 00:07:25.284 CC lib/iscsi/init_grp.o 00:07:25.542 CC lib/vhost/vhost_blk.o 00:07:25.542 CC lib/vhost/rte_vhost_user.o 00:07:25.542 CC lib/iscsi/iscsi.o 00:07:25.799 CC lib/iscsi/param.o 00:07:25.799 CC lib/iscsi/portal_grp.o 00:07:26.057 CC lib/ftl/utils/ftl_mempool.o 00:07:26.057 CC lib/ftl/utils/ftl_bitmap.o 00:07:26.057 CC lib/iscsi/tgt_node.o 00:07:26.057 CC lib/iscsi/iscsi_subsystem.o 00:07:26.315 CC lib/iscsi/iscsi_rpc.o 00:07:26.315 CC lib/ftl/utils/ftl_property.o 00:07:26.315 CC lib/ftl/utils/ftl_layout_tracker_bdev.o 00:07:26.573 CC lib/ftl/upgrade/ftl_layout_upgrade.o 00:07:26.573 CC lib/iscsi/task.o 00:07:26.573 CC lib/ftl/upgrade/ftl_sb_upgrade.o 00:07:26.573 CC lib/ftl/upgrade/ftl_p2l_upgrade.o 00:07:26.573 LIB libspdk_nvmf.a 00:07:26.573 CC lib/ftl/upgrade/ftl_band_upgrade.o 00:07:26.573 CC lib/ftl/upgrade/ftl_chunk_upgrade.o 00:07:26.573 CC lib/ftl/upgrade/ftl_trim_upgrade.o 00:07:26.831 LIB libspdk_vhost.a 00:07:26.831 SO libspdk_nvmf.so.19.0 00:07:26.831 SO libspdk_vhost.so.8.0 00:07:26.831 CC lib/ftl/upgrade/ftl_sb_v3.o 00:07:26.831 CC lib/ftl/upgrade/ftl_sb_v5.o 00:07:26.831 CC lib/ftl/nvc/ftl_nvc_dev.o 00:07:26.831 CC lib/ftl/nvc/ftl_nvc_bdev_vss.o 00:07:26.831 CC lib/ftl/nvc/ftl_nvc_bdev_non_vss.o 00:07:26.831 SYMLINK libspdk_vhost.so 00:07:26.831 CC lib/ftl/nvc/ftl_nvc_bdev_common.o 00:07:26.831 CC lib/ftl/base/ftl_base_dev.o 00:07:26.831 SYMLINK libspdk_nvmf.so 00:07:26.831 CC lib/ftl/base/ftl_base_bdev.o 00:07:27.092 CC lib/ftl/ftl_trace.o 00:07:27.092 LIB libspdk_iscsi.a 00:07:27.092 SO libspdk_iscsi.so.8.0 00:07:27.350 LIB libspdk_ftl.a 00:07:27.350 SYMLINK libspdk_iscsi.so 00:07:27.607 SO libspdk_ftl.so.9.0 00:07:27.865 SYMLINK libspdk_ftl.so 00:07:28.124 CC module/env_dpdk/env_dpdk_rpc.o 00:07:28.124 CC module/keyring/file/keyring.o 00:07:28.382 CC module/accel/ioat/accel_ioat.o 00:07:28.382 CC module/sock/posix/posix.o 00:07:28.382 CC module/accel/error/accel_error.o 00:07:28.382 CC module/accel/dsa/accel_dsa.o 00:07:28.382 CC module/accel/iaa/accel_iaa.o 00:07:28.382 CC module/scheduler/dynamic/scheduler_dynamic.o 00:07:28.382 CC module/blob/bdev/blob_bdev.o 00:07:28.382 CC module/fsdev/aio/fsdev_aio.o 00:07:28.382 LIB libspdk_env_dpdk_rpc.a 00:07:28.382 SO libspdk_env_dpdk_rpc.so.6.0 00:07:28.382 SYMLINK libspdk_env_dpdk_rpc.so 00:07:28.382 CC module/accel/iaa/accel_iaa_rpc.o 00:07:28.382 CC module/keyring/file/keyring_rpc.o 00:07:28.382 CC module/accel/ioat/accel_ioat_rpc.o 00:07:28.382 CC module/accel/error/accel_error_rpc.o 00:07:28.641 CC module/fsdev/aio/fsdev_aio_rpc.o 00:07:28.641 LIB libspdk_accel_iaa.a 00:07:28.641 LIB libspdk_blob_bdev.a 00:07:28.641 CC module/accel/dsa/accel_dsa_rpc.o 00:07:28.641 LIB libspdk_scheduler_dynamic.a 00:07:28.641 LIB libspdk_keyring_file.a 00:07:28.641 SO libspdk_accel_iaa.so.3.0 00:07:28.641 SO libspdk_blob_bdev.so.11.0 00:07:28.641 LIB libspdk_accel_ioat.a 00:07:28.641 SO libspdk_scheduler_dynamic.so.4.0 00:07:28.641 SO libspdk_keyring_file.so.2.0 00:07:28.641 LIB libspdk_accel_error.a 00:07:28.641 SO libspdk_accel_ioat.so.6.0 00:07:28.641 SYMLINK libspdk_blob_bdev.so 00:07:28.641 SYMLINK libspdk_scheduler_dynamic.so 00:07:28.641 SYMLINK libspdk_accel_iaa.so 00:07:28.641 SO libspdk_accel_error.so.2.0 00:07:28.641 SYMLINK libspdk_accel_ioat.so 00:07:28.641 SYMLINK libspdk_keyring_file.so 00:07:28.641 CC module/fsdev/aio/linux_aio_mgr.o 00:07:28.641 LIB libspdk_accel_dsa.a 00:07:28.641 SYMLINK libspdk_accel_error.so 00:07:28.899 SO libspdk_accel_dsa.so.5.0 00:07:28.899 SYMLINK libspdk_accel_dsa.so 00:07:28.899 CC module/scheduler/dpdk_governor/dpdk_governor.o 00:07:28.899 CC module/scheduler/gscheduler/gscheduler.o 00:07:28.899 CC module/keyring/linux/keyring.o 00:07:28.899 CC module/keyring/linux/keyring_rpc.o 00:07:28.899 LIB libspdk_fsdev_aio.a 00:07:28.899 CC module/blobfs/bdev/blobfs_bdev.o 00:07:28.899 CC module/bdev/delay/vbdev_delay.o 00:07:28.899 CC module/bdev/error/vbdev_error.o 00:07:28.899 SO libspdk_fsdev_aio.so.1.0 00:07:28.899 LIB libspdk_sock_posix.a 00:07:28.899 CC module/bdev/gpt/gpt.o 00:07:29.157 LIB libspdk_scheduler_gscheduler.a 00:07:29.157 LIB libspdk_scheduler_dpdk_governor.a 00:07:29.157 SO libspdk_scheduler_gscheduler.so.4.0 00:07:29.157 SO libspdk_sock_posix.so.6.0 00:07:29.157 SYMLINK libspdk_fsdev_aio.so 00:07:29.157 LIB libspdk_keyring_linux.a 00:07:29.157 SO libspdk_scheduler_dpdk_governor.so.4.0 00:07:29.157 SO libspdk_keyring_linux.so.1.0 00:07:29.157 SYMLINK libspdk_scheduler_dpdk_governor.so 00:07:29.157 SYMLINK libspdk_scheduler_gscheduler.so 00:07:29.157 CC module/blobfs/bdev/blobfs_bdev_rpc.o 00:07:29.157 SYMLINK libspdk_sock_posix.so 00:07:29.157 CC module/bdev/gpt/vbdev_gpt.o 00:07:29.157 SYMLINK libspdk_keyring_linux.so 00:07:29.157 CC module/bdev/error/vbdev_error_rpc.o 00:07:29.157 CC module/bdev/lvol/vbdev_lvol.o 00:07:29.157 CC module/bdev/lvol/vbdev_lvol_rpc.o 00:07:29.415 CC module/bdev/malloc/bdev_malloc.o 00:07:29.415 CC module/bdev/null/bdev_null.o 00:07:29.415 CC module/bdev/delay/vbdev_delay_rpc.o 00:07:29.415 LIB libspdk_bdev_error.a 00:07:29.415 LIB libspdk_blobfs_bdev.a 00:07:29.415 CC module/bdev/nvme/bdev_nvme.o 00:07:29.415 SO libspdk_blobfs_bdev.so.6.0 00:07:29.415 SO libspdk_bdev_error.so.6.0 00:07:29.415 LIB libspdk_bdev_gpt.a 00:07:29.415 CC module/bdev/passthru/vbdev_passthru.o 00:07:29.415 SYMLINK libspdk_bdev_error.so 00:07:29.415 SYMLINK libspdk_blobfs_bdev.so 00:07:29.415 SO libspdk_bdev_gpt.so.6.0 00:07:29.672 LIB libspdk_bdev_delay.a 00:07:29.672 SYMLINK libspdk_bdev_gpt.so 00:07:29.672 CC module/bdev/malloc/bdev_malloc_rpc.o 00:07:29.672 SO libspdk_bdev_delay.so.6.0 00:07:29.672 CC module/bdev/null/bdev_null_rpc.o 00:07:29.672 CC module/bdev/nvme/bdev_nvme_rpc.o 00:07:29.672 CC module/bdev/raid/bdev_raid.o 00:07:29.672 CC module/bdev/split/vbdev_split.o 00:07:29.672 SYMLINK libspdk_bdev_delay.so 00:07:29.672 CC module/bdev/split/vbdev_split_rpc.o 00:07:29.931 LIB libspdk_bdev_malloc.a 00:07:29.931 LIB libspdk_bdev_lvol.a 00:07:29.931 SO libspdk_bdev_malloc.so.6.0 00:07:29.931 CC module/bdev/passthru/vbdev_passthru_rpc.o 00:07:29.931 LIB libspdk_bdev_null.a 00:07:29.931 SO libspdk_bdev_lvol.so.6.0 00:07:29.931 SO libspdk_bdev_null.so.6.0 00:07:29.931 SYMLINK libspdk_bdev_malloc.so 00:07:29.931 CC module/bdev/zone_block/vbdev_zone_block.o 00:07:29.931 CC module/bdev/raid/bdev_raid_rpc.o 00:07:29.931 CC module/bdev/raid/bdev_raid_sb.o 00:07:29.931 SYMLINK libspdk_bdev_lvol.so 00:07:29.931 CC module/bdev/raid/raid0.o 00:07:29.931 LIB libspdk_bdev_split.a 00:07:29.931 SYMLINK libspdk_bdev_null.so 00:07:29.931 SO libspdk_bdev_split.so.6.0 00:07:29.931 LIB libspdk_bdev_passthru.a 00:07:30.189 SO libspdk_bdev_passthru.so.6.0 00:07:30.189 SYMLINK libspdk_bdev_split.so 00:07:30.189 CC module/bdev/raid/raid1.o 00:07:30.189 SYMLINK libspdk_bdev_passthru.so 00:07:30.189 CC module/bdev/raid/concat.o 00:07:30.189 CC module/bdev/zone_block/vbdev_zone_block_rpc.o 00:07:30.189 CC module/bdev/aio/bdev_aio.o 00:07:30.189 CC module/bdev/aio/bdev_aio_rpc.o 00:07:30.446 LIB libspdk_bdev_zone_block.a 00:07:30.446 CC module/bdev/nvme/nvme_rpc.o 00:07:30.446 SO libspdk_bdev_zone_block.so.6.0 00:07:30.446 CC module/bdev/ftl/bdev_ftl.o 00:07:30.446 CC module/bdev/nvme/bdev_mdns_client.o 00:07:30.446 SYMLINK libspdk_bdev_zone_block.so 00:07:30.446 CC module/bdev/nvme/vbdev_opal.o 00:07:30.446 CC module/bdev/nvme/vbdev_opal_rpc.o 00:07:30.446 CC module/bdev/iscsi/bdev_iscsi.o 00:07:30.447 LIB libspdk_bdev_aio.a 00:07:30.705 SO libspdk_bdev_aio.so.6.0 00:07:30.705 CC module/bdev/virtio/bdev_virtio_scsi.o 00:07:30.705 CC module/bdev/virtio/bdev_virtio_blk.o 00:07:30.705 SYMLINK libspdk_bdev_aio.so 00:07:30.705 CC module/bdev/virtio/bdev_virtio_rpc.o 00:07:30.705 CC module/bdev/iscsi/bdev_iscsi_rpc.o 00:07:30.705 LIB libspdk_bdev_raid.a 00:07:30.705 CC module/bdev/ftl/bdev_ftl_rpc.o 00:07:30.705 CC module/bdev/nvme/bdev_nvme_cuse_rpc.o 00:07:30.705 SO libspdk_bdev_raid.so.6.0 00:07:30.963 SYMLINK libspdk_bdev_raid.so 00:07:30.963 LIB libspdk_bdev_iscsi.a 00:07:30.963 SO libspdk_bdev_iscsi.so.6.0 00:07:30.963 LIB libspdk_bdev_ftl.a 00:07:30.963 SYMLINK libspdk_bdev_iscsi.so 00:07:30.963 SO libspdk_bdev_ftl.so.6.0 00:07:31.221 SYMLINK libspdk_bdev_ftl.so 00:07:31.221 LIB libspdk_bdev_virtio.a 00:07:31.221 SO libspdk_bdev_virtio.so.6.0 00:07:31.221 SYMLINK libspdk_bdev_virtio.so 00:07:32.153 LIB libspdk_bdev_nvme.a 00:07:32.153 SO libspdk_bdev_nvme.so.7.0 00:07:32.153 SYMLINK libspdk_bdev_nvme.so 00:07:32.719 CC module/event/subsystems/sock/sock.o 00:07:32.719 CC module/event/subsystems/vhost_blk/vhost_blk.o 00:07:32.719 CC module/event/subsystems/vmd/vmd_rpc.o 00:07:32.719 CC module/event/subsystems/vmd/vmd.o 00:07:32.719 CC module/event/subsystems/keyring/keyring.o 00:07:32.719 CC module/event/subsystems/scheduler/scheduler.o 00:07:32.719 CC module/event/subsystems/fsdev/fsdev.o 00:07:32.719 CC module/event/subsystems/iobuf/iobuf.o 00:07:32.719 CC module/event/subsystems/iobuf/iobuf_rpc.o 00:07:32.719 LIB libspdk_event_sock.a 00:07:32.719 LIB libspdk_event_keyring.a 00:07:32.720 LIB libspdk_event_scheduler.a 00:07:32.720 SO libspdk_event_sock.so.5.0 00:07:32.720 LIB libspdk_event_vhost_blk.a 00:07:32.720 SO libspdk_event_keyring.so.1.0 00:07:32.720 LIB libspdk_event_fsdev.a 00:07:32.720 SO libspdk_event_scheduler.so.4.0 00:07:32.720 LIB libspdk_event_vmd.a 00:07:32.720 SO libspdk_event_fsdev.so.1.0 00:07:32.720 SO libspdk_event_vhost_blk.so.3.0 00:07:32.720 LIB libspdk_event_iobuf.a 00:07:32.977 SO libspdk_event_vmd.so.6.0 00:07:32.977 SYMLINK libspdk_event_sock.so 00:07:32.977 SYMLINK libspdk_event_scheduler.so 00:07:32.977 SYMLINK libspdk_event_keyring.so 00:07:32.977 SO libspdk_event_iobuf.so.3.0 00:07:32.977 SYMLINK libspdk_event_fsdev.so 00:07:32.977 SYMLINK libspdk_event_vhost_blk.so 00:07:32.977 SYMLINK libspdk_event_vmd.so 00:07:32.977 SYMLINK libspdk_event_iobuf.so 00:07:33.236 CC module/event/subsystems/accel/accel.o 00:07:33.494 LIB libspdk_event_accel.a 00:07:33.494 SO libspdk_event_accel.so.6.0 00:07:33.494 SYMLINK libspdk_event_accel.so 00:07:33.753 CC module/event/subsystems/bdev/bdev.o 00:07:34.011 LIB libspdk_event_bdev.a 00:07:34.011 SO libspdk_event_bdev.so.6.0 00:07:34.011 SYMLINK libspdk_event_bdev.so 00:07:34.268 CC module/event/subsystems/nvmf/nvmf_rpc.o 00:07:34.269 CC module/event/subsystems/nvmf/nvmf_tgt.o 00:07:34.269 CC module/event/subsystems/scsi/scsi.o 00:07:34.269 CC module/event/subsystems/nbd/nbd.o 00:07:34.269 CC module/event/subsystems/ublk/ublk.o 00:07:34.527 LIB libspdk_event_ublk.a 00:07:34.527 SO libspdk_event_ublk.so.3.0 00:07:34.527 LIB libspdk_event_scsi.a 00:07:34.527 LIB libspdk_event_nbd.a 00:07:34.527 SO libspdk_event_scsi.so.6.0 00:07:34.527 SYMLINK libspdk_event_ublk.so 00:07:34.527 SO libspdk_event_nbd.so.6.0 00:07:34.527 LIB libspdk_event_nvmf.a 00:07:34.527 SYMLINK libspdk_event_scsi.so 00:07:34.784 SYMLINK libspdk_event_nbd.so 00:07:34.784 SO libspdk_event_nvmf.so.6.0 00:07:34.784 SYMLINK libspdk_event_nvmf.so 00:07:34.784 CC module/event/subsystems/vhost_scsi/vhost_scsi.o 00:07:34.784 CC module/event/subsystems/iscsi/iscsi.o 00:07:35.094 LIB libspdk_event_vhost_scsi.a 00:07:35.094 SO libspdk_event_vhost_scsi.so.3.0 00:07:35.094 LIB libspdk_event_iscsi.a 00:07:35.094 SO libspdk_event_iscsi.so.6.0 00:07:35.094 SYMLINK libspdk_event_vhost_scsi.so 00:07:35.094 SYMLINK libspdk_event_iscsi.so 00:07:35.378 SO libspdk.so.6.0 00:07:35.378 SYMLINK libspdk.so 00:07:35.637 TEST_HEADER include/spdk/accel.h 00:07:35.637 TEST_HEADER include/spdk/accel_module.h 00:07:35.637 TEST_HEADER include/spdk/assert.h 00:07:35.637 TEST_HEADER include/spdk/barrier.h 00:07:35.637 TEST_HEADER include/spdk/base64.h 00:07:35.637 CXX app/trace/trace.o 00:07:35.637 TEST_HEADER include/spdk/bdev.h 00:07:35.637 TEST_HEADER include/spdk/bdev_module.h 00:07:35.637 TEST_HEADER include/spdk/bdev_zone.h 00:07:35.637 CC examples/interrupt_tgt/interrupt_tgt.o 00:07:35.637 TEST_HEADER include/spdk/bit_array.h 00:07:35.637 TEST_HEADER include/spdk/bit_pool.h 00:07:35.637 TEST_HEADER include/spdk/blob_bdev.h 00:07:35.637 TEST_HEADER include/spdk/blobfs_bdev.h 00:07:35.637 TEST_HEADER include/spdk/blobfs.h 00:07:35.637 TEST_HEADER include/spdk/blob.h 00:07:35.637 TEST_HEADER include/spdk/conf.h 00:07:35.637 TEST_HEADER include/spdk/config.h 00:07:35.637 TEST_HEADER include/spdk/cpuset.h 00:07:35.637 TEST_HEADER include/spdk/crc16.h 00:07:35.637 TEST_HEADER include/spdk/crc32.h 00:07:35.637 TEST_HEADER include/spdk/crc64.h 00:07:35.637 TEST_HEADER include/spdk/dif.h 00:07:35.637 TEST_HEADER include/spdk/dma.h 00:07:35.637 TEST_HEADER include/spdk/endian.h 00:07:35.637 TEST_HEADER include/spdk/env_dpdk.h 00:07:35.637 TEST_HEADER include/spdk/env.h 00:07:35.637 TEST_HEADER include/spdk/event.h 00:07:35.637 TEST_HEADER include/spdk/fd_group.h 00:07:35.637 TEST_HEADER include/spdk/fd.h 00:07:35.637 TEST_HEADER include/spdk/file.h 00:07:35.637 TEST_HEADER include/spdk/fsdev.h 00:07:35.637 TEST_HEADER include/spdk/fsdev_module.h 00:07:35.637 TEST_HEADER include/spdk/ftl.h 00:07:35.637 TEST_HEADER include/spdk/fuse_dispatcher.h 00:07:35.637 TEST_HEADER include/spdk/gpt_spec.h 00:07:35.637 TEST_HEADER include/spdk/hexlify.h 00:07:35.637 TEST_HEADER include/spdk/histogram_data.h 00:07:35.637 TEST_HEADER include/spdk/idxd.h 00:07:35.637 TEST_HEADER include/spdk/idxd_spec.h 00:07:35.637 TEST_HEADER include/spdk/init.h 00:07:35.637 TEST_HEADER include/spdk/ioat.h 00:07:35.637 CC test/thread/poller_perf/poller_perf.o 00:07:35.637 TEST_HEADER include/spdk/ioat_spec.h 00:07:35.637 CC examples/ioat/perf/perf.o 00:07:35.637 TEST_HEADER include/spdk/iscsi_spec.h 00:07:35.637 TEST_HEADER include/spdk/json.h 00:07:35.637 CC examples/util/zipf/zipf.o 00:07:35.637 TEST_HEADER include/spdk/jsonrpc.h 00:07:35.637 TEST_HEADER include/spdk/keyring.h 00:07:35.637 TEST_HEADER include/spdk/keyring_module.h 00:07:35.637 TEST_HEADER include/spdk/likely.h 00:07:35.637 TEST_HEADER include/spdk/log.h 00:07:35.637 TEST_HEADER include/spdk/lvol.h 00:07:35.637 TEST_HEADER include/spdk/md5.h 00:07:35.637 TEST_HEADER include/spdk/memory.h 00:07:35.637 TEST_HEADER include/spdk/mmio.h 00:07:35.637 TEST_HEADER include/spdk/nbd.h 00:07:35.637 TEST_HEADER include/spdk/net.h 00:07:35.637 TEST_HEADER include/spdk/notify.h 00:07:35.637 TEST_HEADER include/spdk/nvme.h 00:07:35.637 TEST_HEADER include/spdk/nvme_intel.h 00:07:35.637 TEST_HEADER include/spdk/nvme_ocssd.h 00:07:35.637 TEST_HEADER include/spdk/nvme_ocssd_spec.h 00:07:35.637 TEST_HEADER include/spdk/nvme_spec.h 00:07:35.637 TEST_HEADER include/spdk/nvme_zns.h 00:07:35.637 TEST_HEADER include/spdk/nvmf_cmd.h 00:07:35.637 CC test/app/bdev_svc/bdev_svc.o 00:07:35.637 TEST_HEADER include/spdk/nvmf_fc_spec.h 00:07:35.896 TEST_HEADER include/spdk/nvmf.h 00:07:35.896 TEST_HEADER include/spdk/nvmf_spec.h 00:07:35.896 TEST_HEADER include/spdk/nvmf_transport.h 00:07:35.896 TEST_HEADER include/spdk/opal.h 00:07:35.896 TEST_HEADER include/spdk/opal_spec.h 00:07:35.896 TEST_HEADER include/spdk/pci_ids.h 00:07:35.896 TEST_HEADER include/spdk/pipe.h 00:07:35.896 CC test/dma/test_dma/test_dma.o 00:07:35.896 TEST_HEADER include/spdk/queue.h 00:07:35.896 TEST_HEADER include/spdk/reduce.h 00:07:35.896 TEST_HEADER include/spdk/rpc.h 00:07:35.896 TEST_HEADER include/spdk/scheduler.h 00:07:35.896 CC test/env/mem_callbacks/mem_callbacks.o 00:07:35.896 TEST_HEADER include/spdk/scsi.h 00:07:35.896 TEST_HEADER include/spdk/scsi_spec.h 00:07:35.896 TEST_HEADER include/spdk/sock.h 00:07:35.896 TEST_HEADER include/spdk/stdinc.h 00:07:35.896 TEST_HEADER include/spdk/string.h 00:07:35.896 TEST_HEADER include/spdk/thread.h 00:07:35.896 TEST_HEADER include/spdk/trace.h 00:07:35.896 TEST_HEADER include/spdk/trace_parser.h 00:07:35.896 TEST_HEADER include/spdk/tree.h 00:07:35.896 TEST_HEADER include/spdk/ublk.h 00:07:35.896 TEST_HEADER include/spdk/util.h 00:07:35.896 TEST_HEADER include/spdk/uuid.h 00:07:35.896 TEST_HEADER include/spdk/version.h 00:07:35.896 TEST_HEADER include/spdk/vfio_user_pci.h 00:07:35.896 TEST_HEADER include/spdk/vfio_user_spec.h 00:07:35.896 TEST_HEADER include/spdk/vhost.h 00:07:35.896 TEST_HEADER include/spdk/vmd.h 00:07:35.896 TEST_HEADER include/spdk/xor.h 00:07:35.896 TEST_HEADER include/spdk/zipf.h 00:07:35.896 CXX test/cpp_headers/accel.o 00:07:35.896 LINK interrupt_tgt 00:07:35.896 LINK zipf 00:07:35.896 LINK poller_perf 00:07:36.154 LINK ioat_perf 00:07:36.154 CXX test/cpp_headers/accel_module.o 00:07:36.154 LINK spdk_trace 00:07:36.154 CXX test/cpp_headers/assert.o 00:07:36.154 LINK bdev_svc 00:07:36.154 CXX test/cpp_headers/barrier.o 00:07:36.154 CC examples/ioat/verify/verify.o 00:07:36.154 CXX test/cpp_headers/base64.o 00:07:36.412 CC test/rpc_client/rpc_client_test.o 00:07:36.412 CC test/env/vtophys/vtophys.o 00:07:36.412 LINK verify 00:07:36.412 CXX test/cpp_headers/bdev.o 00:07:36.412 CC app/trace_record/trace_record.o 00:07:36.412 CC test/env/env_dpdk_post_init/env_dpdk_post_init.o 00:07:36.412 LINK test_dma 00:07:36.671 LINK rpc_client_test 00:07:36.671 LINK vtophys 00:07:36.671 LINK mem_callbacks 00:07:36.671 CXX test/cpp_headers/bdev_module.o 00:07:36.671 CC test/app/fuzz/nvme_fuzz/nvme_fuzz.o 00:07:36.671 LINK env_dpdk_post_init 00:07:36.929 LINK spdk_trace_record 00:07:36.929 CC examples/thread/thread/thread_ex.o 00:07:36.929 CXX test/cpp_headers/bdev_zone.o 00:07:37.187 CC test/env/memory/memory_ut.o 00:07:37.187 CC examples/sock/hello_world/hello_sock.o 00:07:37.187 CC examples/vmd/lsvmd/lsvmd.o 00:07:37.187 CC examples/idxd/perf/perf.o 00:07:37.187 CC test/env/pci/pci_ut.o 00:07:37.187 CC app/nvmf_tgt/nvmf_main.o 00:07:37.445 LINK lsvmd 00:07:37.445 LINK thread 00:07:37.445 CXX test/cpp_headers/bit_array.o 00:07:37.445 LINK hello_sock 00:07:37.445 LINK nvme_fuzz 00:07:37.445 LINK nvmf_tgt 00:07:37.703 CXX test/cpp_headers/bit_pool.o 00:07:37.703 LINK idxd_perf 00:07:37.703 CC examples/vmd/led/led.o 00:07:37.703 LINK pci_ut 00:07:37.703 CC test/app/fuzz/iscsi_fuzz/iscsi_fuzz.o 00:07:37.703 CC test/app/fuzz/vhost_fuzz/vhost_fuzz_rpc.o 00:07:37.961 LINK led 00:07:37.961 CXX test/cpp_headers/blob_bdev.o 00:07:37.961 CC test/event/event_perf/event_perf.o 00:07:37.961 CC test/app/fuzz/vhost_fuzz/vhost_fuzz.o 00:07:37.961 CC app/iscsi_tgt/iscsi_tgt.o 00:07:37.961 CXX test/cpp_headers/blobfs_bdev.o 00:07:38.220 CC examples/accel/perf/accel_perf.o 00:07:38.220 LINK event_perf 00:07:38.220 CXX test/cpp_headers/blobfs.o 00:07:38.220 CC test/app/histogram_perf/histogram_perf.o 00:07:38.478 CC test/nvme/aer/aer.o 00:07:38.478 LINK iscsi_tgt 00:07:38.478 CXX test/cpp_headers/blob.o 00:07:38.478 CC test/event/reactor/reactor.o 00:07:38.478 LINK histogram_perf 00:07:38.735 LINK memory_ut 00:07:38.735 LINK accel_perf 00:07:38.735 LINK vhost_fuzz 00:07:38.735 LINK aer 00:07:38.735 LINK reactor 00:07:38.993 CXX test/cpp_headers/conf.o 00:07:38.993 CC test/nvme/reset/reset.o 00:07:38.993 CC app/spdk_lspci/spdk_lspci.o 00:07:39.250 CC app/spdk_nvme_perf/perf.o 00:07:39.250 CC app/spdk_tgt/spdk_tgt.o 00:07:39.250 CC test/event/reactor_perf/reactor_perf.o 00:07:39.250 CXX test/cpp_headers/config.o 00:07:39.250 LINK reset 00:07:39.250 CXX test/cpp_headers/cpuset.o 00:07:39.250 LINK spdk_lspci 00:07:39.250 CC test/accel/dif/dif.o 00:07:39.250 CC test/blobfs/mkfs/mkfs.o 00:07:39.250 LINK reactor_perf 00:07:39.508 LINK spdk_tgt 00:07:39.508 CXX test/cpp_headers/crc16.o 00:07:39.508 CC test/nvme/sgl/sgl.o 00:07:39.508 LINK mkfs 00:07:39.508 CC test/app/jsoncat/jsoncat.o 00:07:39.765 CXX test/cpp_headers/crc32.o 00:07:39.765 CC test/event/app_repeat/app_repeat.o 00:07:39.765 CXX test/cpp_headers/crc64.o 00:07:39.765 LINK jsoncat 00:07:40.024 LINK iscsi_fuzz 00:07:40.024 LINK app_repeat 00:07:40.024 LINK sgl 00:07:40.024 CC test/app/stub/stub.o 00:07:40.024 CXX test/cpp_headers/dif.o 00:07:40.282 CXX test/cpp_headers/dma.o 00:07:40.282 CC test/nvme/e2edp/nvme_dp.o 00:07:40.282 LINK stub 00:07:40.282 LINK spdk_nvme_perf 00:07:40.539 CXX test/cpp_headers/endian.o 00:07:40.539 LINK dif 00:07:40.539 CC app/spdk_nvme_discover/discovery_aer.o 00:07:40.539 CC app/spdk_nvme_identify/identify.o 00:07:40.539 CC app/spdk_top/spdk_top.o 00:07:40.539 CC test/event/scheduler/scheduler.o 00:07:40.797 LINK spdk_nvme_discover 00:07:40.797 LINK nvme_dp 00:07:40.797 CXX test/cpp_headers/env_dpdk.o 00:07:40.797 CXX test/cpp_headers/env.o 00:07:40.797 CC app/vhost/vhost.o 00:07:40.797 LINK scheduler 00:07:41.055 CC app/spdk_dd/spdk_dd.o 00:07:41.055 CXX test/cpp_headers/event.o 00:07:41.055 LINK vhost 00:07:41.055 CC test/nvme/overhead/overhead.o 00:07:41.055 CC test/nvme/err_injection/err_injection.o 00:07:41.369 CXX test/cpp_headers/fd_group.o 00:07:41.369 LINK err_injection 00:07:41.369 CC test/lvol/esnap/esnap.o 00:07:41.643 CXX test/cpp_headers/fd.o 00:07:41.643 LINK overhead 00:07:41.643 CC examples/blob/hello_world/hello_blob.o 00:07:41.643 LINK spdk_dd 00:07:41.643 CC examples/blob/cli/blobcli.o 00:07:41.643 LINK spdk_top 00:07:41.643 LINK spdk_nvme_identify 00:07:41.643 CXX test/cpp_headers/file.o 00:07:41.901 CXX test/cpp_headers/fsdev.o 00:07:41.901 CC test/nvme/startup/startup.o 00:07:41.901 LINK hello_blob 00:07:41.901 CC test/bdev/bdevio/bdevio.o 00:07:42.159 CXX test/cpp_headers/fsdev_module.o 00:07:42.159 LINK startup 00:07:42.159 CC examples/nvme/hello_world/hello_world.o 00:07:42.159 CC app/fio/nvme/fio_plugin.o 00:07:42.159 LINK blobcli 00:07:42.159 CC examples/fsdev/hello_world/hello_fsdev.o 00:07:42.159 CXX test/cpp_headers/ftl.o 00:07:42.417 CC app/fio/bdev/fio_plugin.o 00:07:42.417 CC test/nvme/reserve/reserve.o 00:07:42.417 LINK hello_world 00:07:42.417 LINK bdevio 00:07:42.417 CXX test/cpp_headers/fuse_dispatcher.o 00:07:42.417 LINK hello_fsdev 00:07:42.675 LINK reserve 00:07:42.675 CXX test/cpp_headers/gpt_spec.o 00:07:42.675 CXX test/cpp_headers/hexlify.o 00:07:42.675 CC examples/nvme/reconnect/reconnect.o 00:07:42.675 CC examples/bdev/hello_world/hello_bdev.o 00:07:42.675 LINK spdk_nvme 00:07:42.932 CXX test/cpp_headers/histogram_data.o 00:07:42.932 CC test/nvme/simple_copy/simple_copy.o 00:07:42.932 LINK spdk_bdev 00:07:42.932 CC examples/bdev/bdevperf/bdevperf.o 00:07:42.932 CC examples/nvme/nvme_manage/nvme_manage.o 00:07:42.932 LINK hello_bdev 00:07:42.932 CXX test/cpp_headers/idxd.o 00:07:43.189 CC examples/nvme/arbitration/arbitration.o 00:07:43.189 LINK reconnect 00:07:43.189 LINK simple_copy 00:07:43.189 CC test/nvme/connect_stress/connect_stress.o 00:07:43.446 CXX test/cpp_headers/idxd_spec.o 00:07:43.446 CXX test/cpp_headers/init.o 00:07:43.446 CXX test/cpp_headers/ioat.o 00:07:43.446 CC examples/nvme/hotplug/hotplug.o 00:07:43.446 LINK connect_stress 00:07:43.446 LINK arbitration 00:07:43.446 CXX test/cpp_headers/ioat_spec.o 00:07:43.703 CXX test/cpp_headers/iscsi_spec.o 00:07:43.703 LINK nvme_manage 00:07:43.703 LINK hotplug 00:07:43.703 CXX test/cpp_headers/json.o 00:07:43.703 CC test/nvme/boot_partition/boot_partition.o 00:07:43.703 CXX test/cpp_headers/jsonrpc.o 00:07:43.703 CC examples/nvme/cmb_copy/cmb_copy.o 00:07:43.703 LINK bdevperf 00:07:43.961 CC examples/nvme/abort/abort.o 00:07:43.961 CC examples/nvme/pmr_persistence/pmr_persistence.o 00:07:43.961 CC test/nvme/compliance/nvme_compliance.o 00:07:43.961 LINK boot_partition 00:07:43.961 CXX test/cpp_headers/keyring.o 00:07:43.961 LINK cmb_copy 00:07:43.961 CC test/nvme/fused_ordering/fused_ordering.o 00:07:43.961 CC test/nvme/doorbell_aers/doorbell_aers.o 00:07:44.218 LINK pmr_persistence 00:07:44.218 CC test/nvme/fdp/fdp.o 00:07:44.218 CXX test/cpp_headers/keyring_module.o 00:07:44.218 CXX test/cpp_headers/likely.o 00:07:44.218 LINK abort 00:07:44.218 CC test/nvme/cuse/cuse.o 00:07:44.218 LINK doorbell_aers 00:07:44.218 CXX test/cpp_headers/log.o 00:07:44.218 LINK fused_ordering 00:07:44.218 LINK nvme_compliance 00:07:44.525 CXX test/cpp_headers/lvol.o 00:07:44.525 CXX test/cpp_headers/md5.o 00:07:44.525 CXX test/cpp_headers/memory.o 00:07:44.525 CXX test/cpp_headers/mmio.o 00:07:44.525 CXX test/cpp_headers/nbd.o 00:07:44.525 LINK fdp 00:07:44.525 CXX test/cpp_headers/net.o 00:07:44.525 CXX test/cpp_headers/notify.o 00:07:44.525 CXX test/cpp_headers/nvme.o 00:07:44.808 CXX test/cpp_headers/nvme_intel.o 00:07:44.808 CC examples/nvmf/nvmf/nvmf.o 00:07:44.808 CXX test/cpp_headers/nvme_ocssd.o 00:07:44.808 CXX test/cpp_headers/nvme_ocssd_spec.o 00:07:44.808 CXX test/cpp_headers/nvme_spec.o 00:07:44.808 CXX test/cpp_headers/nvme_zns.o 00:07:44.808 CXX test/cpp_headers/nvmf_cmd.o 00:07:44.808 CXX test/cpp_headers/nvmf_fc_spec.o 00:07:44.808 CXX test/cpp_headers/nvmf.o 00:07:44.808 CXX test/cpp_headers/nvmf_spec.o 00:07:44.808 CXX test/cpp_headers/nvmf_transport.o 00:07:44.808 CXX test/cpp_headers/opal.o 00:07:44.808 CXX test/cpp_headers/opal_spec.o 00:07:44.808 CXX test/cpp_headers/pci_ids.o 00:07:45.066 LINK nvmf 00:07:45.066 CXX test/cpp_headers/pipe.o 00:07:45.066 CXX test/cpp_headers/queue.o 00:07:45.066 CXX test/cpp_headers/reduce.o 00:07:45.066 CXX test/cpp_headers/rpc.o 00:07:45.066 CXX test/cpp_headers/scheduler.o 00:07:45.066 CXX test/cpp_headers/scsi.o 00:07:45.066 CXX test/cpp_headers/scsi_spec.o 00:07:45.066 CXX test/cpp_headers/sock.o 00:07:45.066 CXX test/cpp_headers/stdinc.o 00:07:45.324 CXX test/cpp_headers/string.o 00:07:45.324 CXX test/cpp_headers/thread.o 00:07:45.324 CXX test/cpp_headers/trace.o 00:07:45.324 CXX test/cpp_headers/trace_parser.o 00:07:45.324 CXX test/cpp_headers/tree.o 00:07:45.324 CXX test/cpp_headers/ublk.o 00:07:45.324 CXX test/cpp_headers/util.o 00:07:45.324 CXX test/cpp_headers/uuid.o 00:07:45.324 CXX test/cpp_headers/version.o 00:07:45.324 CXX test/cpp_headers/vfio_user_pci.o 00:07:45.324 CXX test/cpp_headers/vfio_user_spec.o 00:07:45.324 CXX test/cpp_headers/vhost.o 00:07:45.324 CXX test/cpp_headers/vmd.o 00:07:45.324 CXX test/cpp_headers/xor.o 00:07:45.583 CXX test/cpp_headers/zipf.o 00:07:45.583 LINK cuse 00:07:46.957 LINK esnap 00:07:47.523 00:07:47.523 real 1m45.710s 00:07:47.523 user 10m8.439s 00:07:47.523 sys 1m57.246s 00:07:47.523 11:18:42 make -- common/autotest_common.sh@1126 -- $ xtrace_disable 00:07:47.523 11:18:42 make -- common/autotest_common.sh@10 -- $ set +x 00:07:47.523 ************************************ 00:07:47.523 END TEST make 00:07:47.523 ************************************ 00:07:47.523 11:18:43 -- spdk/autobuild.sh@1 -- $ stop_monitor_resources 00:07:47.523 11:18:43 -- pm/common@29 -- $ signal_monitor_resources TERM 00:07:47.523 11:18:43 -- pm/common@40 -- $ local monitor pid pids signal=TERM 00:07:47.523 11:18:43 -- pm/common@42 -- $ for monitor in "${MONITOR_RESOURCES[@]}" 00:07:47.523 11:18:43 -- pm/common@43 -- $ [[ -e /home/vagrant/spdk_repo/spdk/../output/power/collect-cpu-load.pid ]] 00:07:47.523 11:18:43 -- pm/common@44 -- $ pid=5295 00:07:47.523 11:18:43 -- pm/common@50 -- $ kill -TERM 5295 00:07:47.523 11:18:43 -- pm/common@42 -- $ for monitor in "${MONITOR_RESOURCES[@]}" 00:07:47.523 11:18:43 -- pm/common@43 -- $ [[ -e /home/vagrant/spdk_repo/spdk/../output/power/collect-vmstat.pid ]] 00:07:47.781 11:18:43 -- pm/common@44 -- $ pid=5297 00:07:47.781 11:18:43 -- pm/common@50 -- $ kill -TERM 5297 00:07:47.782 11:18:43 -- common/autotest_common.sh@1680 -- # [[ y == y ]] 00:07:47.782 11:18:43 -- common/autotest_common.sh@1681 -- # lcov --version 00:07:47.782 11:18:43 -- common/autotest_common.sh@1681 -- # awk '{print $NF}' 00:07:47.782 11:18:43 -- common/autotest_common.sh@1681 -- # lt 1.15 2 00:07:47.782 11:18:43 -- scripts/common.sh@373 -- # cmp_versions 1.15 '<' 2 00:07:47.782 11:18:43 -- scripts/common.sh@333 -- # local ver1 ver1_l 00:07:47.782 11:18:43 -- scripts/common.sh@334 -- # local ver2 ver2_l 00:07:47.782 11:18:43 -- scripts/common.sh@336 -- # IFS=.-: 00:07:47.782 11:18:43 -- scripts/common.sh@336 -- # read -ra ver1 00:07:47.782 11:18:43 -- scripts/common.sh@337 -- # IFS=.-: 00:07:47.782 11:18:43 -- scripts/common.sh@337 -- # read -ra ver2 00:07:47.782 11:18:43 -- scripts/common.sh@338 -- # local 'op=<' 00:07:47.782 11:18:43 -- scripts/common.sh@340 -- # ver1_l=2 00:07:47.782 11:18:43 -- scripts/common.sh@341 -- # ver2_l=1 00:07:47.782 11:18:43 -- scripts/common.sh@343 -- # local lt=0 gt=0 eq=0 v 00:07:47.782 11:18:43 -- scripts/common.sh@344 -- # case "$op" in 00:07:47.782 11:18:43 -- scripts/common.sh@345 -- # : 1 00:07:47.782 11:18:43 -- scripts/common.sh@364 -- # (( v = 0 )) 00:07:47.782 11:18:43 -- scripts/common.sh@364 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:07:47.782 11:18:43 -- scripts/common.sh@365 -- # decimal 1 00:07:47.782 11:18:43 -- scripts/common.sh@353 -- # local d=1 00:07:47.782 11:18:43 -- scripts/common.sh@354 -- # [[ 1 =~ ^[0-9]+$ ]] 00:07:47.782 11:18:43 -- scripts/common.sh@355 -- # echo 1 00:07:47.782 11:18:43 -- scripts/common.sh@365 -- # ver1[v]=1 00:07:47.782 11:18:43 -- scripts/common.sh@366 -- # decimal 2 00:07:47.782 11:18:43 -- scripts/common.sh@353 -- # local d=2 00:07:47.782 11:18:43 -- scripts/common.sh@354 -- # [[ 2 =~ ^[0-9]+$ ]] 00:07:47.782 11:18:43 -- scripts/common.sh@355 -- # echo 2 00:07:47.782 11:18:43 -- scripts/common.sh@366 -- # ver2[v]=2 00:07:47.782 11:18:43 -- scripts/common.sh@367 -- # (( ver1[v] > ver2[v] )) 00:07:47.782 11:18:43 -- scripts/common.sh@368 -- # (( ver1[v] < ver2[v] )) 00:07:47.782 11:18:43 -- scripts/common.sh@368 -- # return 0 00:07:47.782 11:18:43 -- common/autotest_common.sh@1682 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:07:47.782 11:18:43 -- common/autotest_common.sh@1694 -- # export 'LCOV_OPTS= 00:07:47.782 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:47.782 --rc genhtml_branch_coverage=1 00:07:47.782 --rc genhtml_function_coverage=1 00:07:47.782 --rc genhtml_legend=1 00:07:47.782 --rc geninfo_all_blocks=1 00:07:47.782 --rc geninfo_unexecuted_blocks=1 00:07:47.782 00:07:47.782 ' 00:07:47.782 11:18:43 -- common/autotest_common.sh@1694 -- # LCOV_OPTS=' 00:07:47.782 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:47.782 --rc genhtml_branch_coverage=1 00:07:47.782 --rc genhtml_function_coverage=1 00:07:47.782 --rc genhtml_legend=1 00:07:47.782 --rc geninfo_all_blocks=1 00:07:47.782 --rc geninfo_unexecuted_blocks=1 00:07:47.782 00:07:47.782 ' 00:07:47.782 11:18:43 -- common/autotest_common.sh@1695 -- # export 'LCOV=lcov 00:07:47.782 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:47.782 --rc genhtml_branch_coverage=1 00:07:47.782 --rc genhtml_function_coverage=1 00:07:47.782 --rc genhtml_legend=1 00:07:47.782 --rc geninfo_all_blocks=1 00:07:47.782 --rc geninfo_unexecuted_blocks=1 00:07:47.782 00:07:47.782 ' 00:07:47.782 11:18:43 -- common/autotest_common.sh@1695 -- # LCOV='lcov 00:07:47.782 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:47.782 --rc genhtml_branch_coverage=1 00:07:47.782 --rc genhtml_function_coverage=1 00:07:47.782 --rc genhtml_legend=1 00:07:47.782 --rc geninfo_all_blocks=1 00:07:47.782 --rc geninfo_unexecuted_blocks=1 00:07:47.782 00:07:47.782 ' 00:07:47.782 11:18:43 -- spdk/autotest.sh@25 -- # source /home/vagrant/spdk_repo/spdk/test/nvmf/common.sh 00:07:47.782 11:18:43 -- nvmf/common.sh@7 -- # uname -s 00:07:47.782 11:18:43 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:07:47.782 11:18:43 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:07:47.782 11:18:43 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:07:47.782 11:18:43 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:07:47.782 11:18:43 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:07:47.782 11:18:43 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:07:47.782 11:18:43 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:07:47.782 11:18:43 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:07:47.782 11:18:43 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:07:47.782 11:18:43 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:07:47.782 11:18:43 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:c758a4ed-f09f-4c82-9afb-3d096f035464 00:07:47.782 11:18:43 -- nvmf/common.sh@18 -- # NVME_HOSTID=c758a4ed-f09f-4c82-9afb-3d096f035464 00:07:47.782 11:18:43 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:07:47.782 11:18:43 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:07:47.782 11:18:43 -- nvmf/common.sh@21 -- # NET_TYPE=virt 00:07:47.782 11:18:43 -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:07:47.782 11:18:43 -- nvmf/common.sh@49 -- # source /home/vagrant/spdk_repo/spdk/scripts/common.sh 00:07:47.782 11:18:43 -- scripts/common.sh@15 -- # shopt -s extglob 00:07:47.782 11:18:43 -- scripts/common.sh@544 -- # [[ -e /bin/wpdk_common.sh ]] 00:07:47.782 11:18:43 -- scripts/common.sh@552 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:07:47.782 11:18:43 -- scripts/common.sh@553 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:07:47.782 11:18:43 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:47.782 11:18:43 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:47.782 11:18:43 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:47.782 11:18:43 -- paths/export.sh@5 -- # export PATH 00:07:47.782 11:18:43 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:47.782 11:18:43 -- nvmf/common.sh@51 -- # : 0 00:07:47.782 11:18:43 -- nvmf/common.sh@52 -- # export NVMF_APP_SHM_ID 00:07:47.782 11:18:43 -- nvmf/common.sh@53 -- # build_nvmf_app_args 00:07:47.782 11:18:43 -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:07:47.782 11:18:43 -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:07:47.782 11:18:43 -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:07:47.782 11:18:43 -- nvmf/common.sh@33 -- # '[' '' -eq 1 ']' 00:07:47.782 /home/vagrant/spdk_repo/spdk/test/nvmf/common.sh: line 33: [: : integer expression expected 00:07:47.782 11:18:43 -- nvmf/common.sh@37 -- # '[' -n '' ']' 00:07:47.782 11:18:43 -- nvmf/common.sh@39 -- # '[' 0 -eq 1 ']' 00:07:47.782 11:18:43 -- nvmf/common.sh@55 -- # have_pci_nics=0 00:07:47.782 11:18:43 -- spdk/autotest.sh@27 -- # '[' 0 -ne 0 ']' 00:07:47.782 11:18:43 -- spdk/autotest.sh@32 -- # uname -s 00:07:47.782 11:18:43 -- spdk/autotest.sh@32 -- # '[' Linux = Linux ']' 00:07:47.782 11:18:43 -- spdk/autotest.sh@33 -- # old_core_pattern='|/usr/lib/systemd/systemd-coredump %P %u %g %s %t %c %h' 00:07:47.782 11:18:43 -- spdk/autotest.sh@34 -- # mkdir -p /home/vagrant/spdk_repo/spdk/../output/coredumps 00:07:47.782 11:18:43 -- spdk/autotest.sh@39 -- # echo '|/home/vagrant/spdk_repo/spdk/scripts/core-collector.sh %P %s %t' 00:07:47.782 11:18:43 -- spdk/autotest.sh@40 -- # echo /home/vagrant/spdk_repo/spdk/../output/coredumps 00:07:47.782 11:18:43 -- spdk/autotest.sh@44 -- # modprobe nbd 00:07:48.040 11:18:43 -- spdk/autotest.sh@46 -- # type -P udevadm 00:07:48.040 11:18:43 -- spdk/autotest.sh@46 -- # udevadm=/usr/sbin/udevadm 00:07:48.040 11:18:43 -- spdk/autotest.sh@48 -- # udevadm_pid=56250 00:07:48.040 11:18:43 -- spdk/autotest.sh@53 -- # start_monitor_resources 00:07:48.040 11:18:43 -- pm/common@17 -- # local monitor 00:07:48.040 11:18:43 -- pm/common@19 -- # for monitor in "${MONITOR_RESOURCES[@]}" 00:07:48.040 11:18:43 -- pm/common@19 -- # for monitor in "${MONITOR_RESOURCES[@]}" 00:07:48.040 11:18:43 -- spdk/autotest.sh@47 -- # /usr/sbin/udevadm monitor --property 00:07:48.040 11:18:43 -- pm/common@25 -- # sleep 1 00:07:48.040 11:18:43 -- pm/common@21 -- # date +%s 00:07:48.040 11:18:43 -- pm/common@21 -- # date +%s 00:07:48.040 11:18:43 -- pm/common@21 -- # /home/vagrant/spdk_repo/spdk/scripts/perf/pm/collect-cpu-load -d /home/vagrant/spdk_repo/spdk/../output/power -l -p monitor.autotest.sh.1728299923 00:07:48.040 11:18:43 -- pm/common@21 -- # /home/vagrant/spdk_repo/spdk/scripts/perf/pm/collect-vmstat -d /home/vagrant/spdk_repo/spdk/../output/power -l -p monitor.autotest.sh.1728299923 00:07:48.040 Redirecting to /home/vagrant/spdk_repo/spdk/../output/power/monitor.autotest.sh.1728299923_collect-vmstat.pm.log 00:07:48.040 Redirecting to /home/vagrant/spdk_repo/spdk/../output/power/monitor.autotest.sh.1728299923_collect-cpu-load.pm.log 00:07:48.973 11:18:44 -- spdk/autotest.sh@55 -- # trap 'autotest_cleanup || :; exit 1' SIGINT SIGTERM EXIT 00:07:48.973 11:18:44 -- spdk/autotest.sh@57 -- # timing_enter autotest 00:07:48.973 11:18:44 -- common/autotest_common.sh@724 -- # xtrace_disable 00:07:48.973 11:18:44 -- common/autotest_common.sh@10 -- # set +x 00:07:48.973 11:18:44 -- spdk/autotest.sh@59 -- # create_test_list 00:07:48.973 11:18:44 -- common/autotest_common.sh@748 -- # xtrace_disable 00:07:48.973 11:18:44 -- common/autotest_common.sh@10 -- # set +x 00:07:48.973 11:18:44 -- spdk/autotest.sh@61 -- # dirname /home/vagrant/spdk_repo/spdk/autotest.sh 00:07:48.973 11:18:44 -- spdk/autotest.sh@61 -- # readlink -f /home/vagrant/spdk_repo/spdk 00:07:48.973 11:18:44 -- spdk/autotest.sh@61 -- # src=/home/vagrant/spdk_repo/spdk 00:07:48.973 11:18:44 -- spdk/autotest.sh@62 -- # out=/home/vagrant/spdk_repo/spdk/../output 00:07:48.973 11:18:44 -- spdk/autotest.sh@63 -- # cd /home/vagrant/spdk_repo/spdk 00:07:48.973 11:18:44 -- spdk/autotest.sh@65 -- # freebsd_update_contigmem_mod 00:07:48.973 11:18:44 -- common/autotest_common.sh@1455 -- # uname 00:07:48.973 11:18:44 -- common/autotest_common.sh@1455 -- # '[' Linux = FreeBSD ']' 00:07:48.973 11:18:44 -- spdk/autotest.sh@66 -- # freebsd_set_maxsock_buf 00:07:48.973 11:18:44 -- common/autotest_common.sh@1475 -- # uname 00:07:48.973 11:18:44 -- common/autotest_common.sh@1475 -- # [[ Linux = FreeBSD ]] 00:07:48.973 11:18:44 -- spdk/autotest.sh@68 -- # [[ y == y ]] 00:07:48.973 11:18:44 -- spdk/autotest.sh@70 -- # lcov --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 --rc genhtml_branch_coverage=1 --rc genhtml_function_coverage=1 --rc genhtml_legend=1 --rc geninfo_all_blocks=1 --rc geninfo_unexecuted_blocks=1 --version 00:07:48.973 lcov: LCOV version 1.15 00:07:48.973 11:18:44 -- spdk/autotest.sh@72 -- # lcov --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 --rc genhtml_branch_coverage=1 --rc genhtml_function_coverage=1 --rc genhtml_legend=1 --rc geninfo_all_blocks=1 --rc geninfo_unexecuted_blocks=1 -q -c --no-external -i -t Baseline -d /home/vagrant/spdk_repo/spdk -o /home/vagrant/spdk_repo/spdk/../output/cov_base.info 00:08:07.059 /home/vagrant/spdk_repo/spdk/lib/nvme/nvme_stubs.gcno:no functions found 00:08:07.059 geninfo: WARNING: GCOV did not produce any data for /home/vagrant/spdk_repo/spdk/lib/nvme/nvme_stubs.gcno 00:08:25.132 11:19:17 -- spdk/autotest.sh@76 -- # timing_enter pre_cleanup 00:08:25.132 11:19:17 -- common/autotest_common.sh@724 -- # xtrace_disable 00:08:25.132 11:19:17 -- common/autotest_common.sh@10 -- # set +x 00:08:25.132 11:19:17 -- spdk/autotest.sh@78 -- # rm -f 00:08:25.132 11:19:17 -- spdk/autotest.sh@81 -- # /home/vagrant/spdk_repo/spdk/scripts/setup.sh reset 00:08:25.132 0000:00:03.0 (1af4 1001): Active devices: mount@vda:vda2,mount@vda:vda3,mount@vda:vda5, so not binding PCI dev 00:08:25.132 0000:00:11.0 (1b36 0010): Already using the nvme driver 00:08:25.132 0000:00:10.0 (1b36 0010): Already using the nvme driver 00:08:25.132 11:19:18 -- spdk/autotest.sh@83 -- # get_zoned_devs 00:08:25.132 11:19:18 -- common/autotest_common.sh@1655 -- # zoned_devs=() 00:08:25.132 11:19:18 -- common/autotest_common.sh@1655 -- # local -gA zoned_devs 00:08:25.132 11:19:18 -- common/autotest_common.sh@1656 -- # local nvme bdf 00:08:25.132 11:19:18 -- common/autotest_common.sh@1658 -- # for nvme in /sys/block/nvme* 00:08:25.132 11:19:18 -- common/autotest_common.sh@1659 -- # is_block_zoned nvme0n1 00:08:25.132 11:19:18 -- common/autotest_common.sh@1648 -- # local device=nvme0n1 00:08:25.132 11:19:18 -- common/autotest_common.sh@1650 -- # [[ -e /sys/block/nvme0n1/queue/zoned ]] 00:08:25.132 11:19:18 -- common/autotest_common.sh@1651 -- # [[ none != none ]] 00:08:25.132 11:19:18 -- common/autotest_common.sh@1658 -- # for nvme in /sys/block/nvme* 00:08:25.132 11:19:18 -- common/autotest_common.sh@1659 -- # is_block_zoned nvme0n2 00:08:25.132 11:19:18 -- common/autotest_common.sh@1648 -- # local device=nvme0n2 00:08:25.132 11:19:18 -- common/autotest_common.sh@1650 -- # [[ -e /sys/block/nvme0n2/queue/zoned ]] 00:08:25.132 11:19:18 -- common/autotest_common.sh@1651 -- # [[ none != none ]] 00:08:25.132 11:19:18 -- common/autotest_common.sh@1658 -- # for nvme in /sys/block/nvme* 00:08:25.132 11:19:18 -- common/autotest_common.sh@1659 -- # is_block_zoned nvme0n3 00:08:25.132 11:19:18 -- common/autotest_common.sh@1648 -- # local device=nvme0n3 00:08:25.132 11:19:18 -- common/autotest_common.sh@1650 -- # [[ -e /sys/block/nvme0n3/queue/zoned ]] 00:08:25.132 11:19:18 -- common/autotest_common.sh@1651 -- # [[ none != none ]] 00:08:25.132 11:19:18 -- common/autotest_common.sh@1658 -- # for nvme in /sys/block/nvme* 00:08:25.132 11:19:18 -- common/autotest_common.sh@1659 -- # is_block_zoned nvme1n1 00:08:25.132 11:19:18 -- common/autotest_common.sh@1648 -- # local device=nvme1n1 00:08:25.132 11:19:18 -- common/autotest_common.sh@1650 -- # [[ -e /sys/block/nvme1n1/queue/zoned ]] 00:08:25.132 11:19:18 -- common/autotest_common.sh@1651 -- # [[ none != none ]] 00:08:25.132 11:19:18 -- spdk/autotest.sh@85 -- # (( 0 > 0 )) 00:08:25.132 11:19:18 -- spdk/autotest.sh@97 -- # for dev in /dev/nvme*n!(*p*) 00:08:25.132 11:19:18 -- spdk/autotest.sh@99 -- # [[ -z '' ]] 00:08:25.132 11:19:18 -- spdk/autotest.sh@100 -- # block_in_use /dev/nvme0n1 00:08:25.132 11:19:18 -- scripts/common.sh@381 -- # local block=/dev/nvme0n1 pt 00:08:25.132 11:19:18 -- scripts/common.sh@390 -- # /home/vagrant/spdk_repo/spdk/scripts/spdk-gpt.py /dev/nvme0n1 00:08:25.132 No valid GPT data, bailing 00:08:25.132 11:19:18 -- scripts/common.sh@394 -- # blkid -s PTTYPE -o value /dev/nvme0n1 00:08:25.132 11:19:18 -- scripts/common.sh@394 -- # pt= 00:08:25.132 11:19:18 -- scripts/common.sh@395 -- # return 1 00:08:25.132 11:19:18 -- spdk/autotest.sh@101 -- # dd if=/dev/zero of=/dev/nvme0n1 bs=1M count=1 00:08:25.132 1+0 records in 00:08:25.132 1+0 records out 00:08:25.132 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00433243 s, 242 MB/s 00:08:25.132 11:19:18 -- spdk/autotest.sh@97 -- # for dev in /dev/nvme*n!(*p*) 00:08:25.132 11:19:18 -- spdk/autotest.sh@99 -- # [[ -z '' ]] 00:08:25.132 11:19:18 -- spdk/autotest.sh@100 -- # block_in_use /dev/nvme0n2 00:08:25.132 11:19:18 -- scripts/common.sh@381 -- # local block=/dev/nvme0n2 pt 00:08:25.132 11:19:18 -- scripts/common.sh@390 -- # /home/vagrant/spdk_repo/spdk/scripts/spdk-gpt.py /dev/nvme0n2 00:08:25.132 No valid GPT data, bailing 00:08:25.132 11:19:18 -- scripts/common.sh@394 -- # blkid -s PTTYPE -o value /dev/nvme0n2 00:08:25.132 11:19:18 -- scripts/common.sh@394 -- # pt= 00:08:25.132 11:19:18 -- scripts/common.sh@395 -- # return 1 00:08:25.132 11:19:18 -- spdk/autotest.sh@101 -- # dd if=/dev/zero of=/dev/nvme0n2 bs=1M count=1 00:08:25.132 1+0 records in 00:08:25.132 1+0 records out 00:08:25.132 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00457669 s, 229 MB/s 00:08:25.132 11:19:18 -- spdk/autotest.sh@97 -- # for dev in /dev/nvme*n!(*p*) 00:08:25.132 11:19:18 -- spdk/autotest.sh@99 -- # [[ -z '' ]] 00:08:25.132 11:19:18 -- spdk/autotest.sh@100 -- # block_in_use /dev/nvme0n3 00:08:25.132 11:19:18 -- scripts/common.sh@381 -- # local block=/dev/nvme0n3 pt 00:08:25.132 11:19:18 -- scripts/common.sh@390 -- # /home/vagrant/spdk_repo/spdk/scripts/spdk-gpt.py /dev/nvme0n3 00:08:25.132 No valid GPT data, bailing 00:08:25.132 11:19:18 -- scripts/common.sh@394 -- # blkid -s PTTYPE -o value /dev/nvme0n3 00:08:25.132 11:19:18 -- scripts/common.sh@394 -- # pt= 00:08:25.132 11:19:18 -- scripts/common.sh@395 -- # return 1 00:08:25.132 11:19:18 -- spdk/autotest.sh@101 -- # dd if=/dev/zero of=/dev/nvme0n3 bs=1M count=1 00:08:25.132 1+0 records in 00:08:25.132 1+0 records out 00:08:25.132 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00484325 s, 217 MB/s 00:08:25.132 11:19:18 -- spdk/autotest.sh@97 -- # for dev in /dev/nvme*n!(*p*) 00:08:25.132 11:19:18 -- spdk/autotest.sh@99 -- # [[ -z '' ]] 00:08:25.132 11:19:18 -- spdk/autotest.sh@100 -- # block_in_use /dev/nvme1n1 00:08:25.132 11:19:18 -- scripts/common.sh@381 -- # local block=/dev/nvme1n1 pt 00:08:25.132 11:19:18 -- scripts/common.sh@390 -- # /home/vagrant/spdk_repo/spdk/scripts/spdk-gpt.py /dev/nvme1n1 00:08:25.132 No valid GPT data, bailing 00:08:25.132 11:19:18 -- scripts/common.sh@394 -- # blkid -s PTTYPE -o value /dev/nvme1n1 00:08:25.132 11:19:18 -- scripts/common.sh@394 -- # pt= 00:08:25.132 11:19:18 -- scripts/common.sh@395 -- # return 1 00:08:25.133 11:19:18 -- spdk/autotest.sh@101 -- # dd if=/dev/zero of=/dev/nvme1n1 bs=1M count=1 00:08:25.133 1+0 records in 00:08:25.133 1+0 records out 00:08:25.133 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00438032 s, 239 MB/s 00:08:25.133 11:19:18 -- spdk/autotest.sh@105 -- # sync 00:08:25.133 11:19:19 -- spdk/autotest.sh@107 -- # xtrace_disable_per_cmd reap_spdk_processes 00:08:25.133 11:19:19 -- common/autotest_common.sh@22 -- # eval 'reap_spdk_processes 12> /dev/null' 00:08:25.133 11:19:19 -- common/autotest_common.sh@22 -- # reap_spdk_processes 00:08:25.761 11:19:20 -- spdk/autotest.sh@111 -- # uname -s 00:08:25.761 11:19:20 -- spdk/autotest.sh@111 -- # [[ Linux == Linux ]] 00:08:25.761 11:19:20 -- spdk/autotest.sh@111 -- # [[ 0 -eq 1 ]] 00:08:25.761 11:19:20 -- spdk/autotest.sh@115 -- # /home/vagrant/spdk_repo/spdk/scripts/setup.sh status 00:08:26.329 0000:00:03.0 (1af4 1001): Active devices: mount@vda:vda2,mount@vda:vda3,mount@vda:vda5, so not binding PCI dev 00:08:26.329 Hugepages 00:08:26.329 node hugesize free / total 00:08:26.329 node0 1048576kB 0 / 0 00:08:26.329 node0 2048kB 0 / 0 00:08:26.329 00:08:26.329 Type BDF Vendor Device NUMA Driver Device Block devices 00:08:26.329 virtio 0000:00:03.0 1af4 1001 unknown virtio-pci - vda 00:08:26.329 NVMe 0000:00:10.0 1b36 0010 unknown nvme nvme1 nvme1n1 00:08:26.329 NVMe 0000:00:11.0 1b36 0010 unknown nvme nvme0 nvme0n1 nvme0n2 nvme0n3 00:08:26.329 11:19:21 -- spdk/autotest.sh@117 -- # uname -s 00:08:26.329 11:19:21 -- spdk/autotest.sh@117 -- # [[ Linux == Linux ]] 00:08:26.329 11:19:21 -- spdk/autotest.sh@119 -- # nvme_namespace_revert 00:08:26.329 11:19:21 -- common/autotest_common.sh@1514 -- # /home/vagrant/spdk_repo/spdk/scripts/setup.sh 00:08:27.263 0000:00:03.0 (1af4 1001): Active devices: mount@vda:vda2,mount@vda:vda3,mount@vda:vda5, so not binding PCI dev 00:08:27.263 0000:00:10.0 (1b36 0010): nvme -> uio_pci_generic 00:08:27.263 0000:00:11.0 (1b36 0010): nvme -> uio_pci_generic 00:08:27.263 11:19:22 -- common/autotest_common.sh@1515 -- # sleep 1 00:08:28.642 11:19:23 -- common/autotest_common.sh@1516 -- # bdfs=() 00:08:28.642 11:19:23 -- common/autotest_common.sh@1516 -- # local bdfs 00:08:28.642 11:19:23 -- common/autotest_common.sh@1518 -- # bdfs=($(get_nvme_bdfs)) 00:08:28.642 11:19:23 -- common/autotest_common.sh@1518 -- # get_nvme_bdfs 00:08:28.642 11:19:23 -- common/autotest_common.sh@1496 -- # bdfs=() 00:08:28.642 11:19:23 -- common/autotest_common.sh@1496 -- # local bdfs 00:08:28.642 11:19:23 -- common/autotest_common.sh@1497 -- # bdfs=($("$rootdir/scripts/gen_nvme.sh" | jq -r '.config[].params.traddr')) 00:08:28.642 11:19:23 -- common/autotest_common.sh@1497 -- # /home/vagrant/spdk_repo/spdk/scripts/gen_nvme.sh 00:08:28.642 11:19:23 -- common/autotest_common.sh@1497 -- # jq -r '.config[].params.traddr' 00:08:28.642 11:19:23 -- common/autotest_common.sh@1498 -- # (( 2 == 0 )) 00:08:28.642 11:19:23 -- common/autotest_common.sh@1502 -- # printf '%s\n' 0000:00:10.0 0000:00:11.0 00:08:28.642 11:19:23 -- common/autotest_common.sh@1520 -- # /home/vagrant/spdk_repo/spdk/scripts/setup.sh reset 00:08:28.642 0000:00:03.0 (1af4 1001): Active devices: mount@vda:vda2,mount@vda:vda3,mount@vda:vda5, so not binding PCI dev 00:08:28.642 Waiting for block devices as requested 00:08:28.912 0000:00:11.0 (1b36 0010): uio_pci_generic -> nvme 00:08:28.912 0000:00:10.0 (1b36 0010): uio_pci_generic -> nvme 00:08:28.912 11:19:24 -- common/autotest_common.sh@1522 -- # for bdf in "${bdfs[@]}" 00:08:28.912 11:19:24 -- common/autotest_common.sh@1523 -- # get_nvme_ctrlr_from_bdf 0000:00:10.0 00:08:28.912 11:19:24 -- common/autotest_common.sh@1485 -- # readlink -f /sys/class/nvme/nvme0 /sys/class/nvme/nvme1 00:08:28.912 11:19:24 -- common/autotest_common.sh@1485 -- # grep 0000:00:10.0/nvme/nvme 00:08:28.912 11:19:24 -- common/autotest_common.sh@1485 -- # bdf_sysfs_path=/sys/devices/pci0000:00/0000:00:10.0/nvme/nvme1 00:08:28.912 11:19:24 -- common/autotest_common.sh@1486 -- # [[ -z /sys/devices/pci0000:00/0000:00:10.0/nvme/nvme1 ]] 00:08:28.912 11:19:24 -- common/autotest_common.sh@1490 -- # basename /sys/devices/pci0000:00/0000:00:10.0/nvme/nvme1 00:08:28.912 11:19:24 -- common/autotest_common.sh@1490 -- # printf '%s\n' nvme1 00:08:28.912 11:19:24 -- common/autotest_common.sh@1523 -- # nvme_ctrlr=/dev/nvme1 00:08:28.912 11:19:24 -- common/autotest_common.sh@1524 -- # [[ -z /dev/nvme1 ]] 00:08:28.912 11:19:24 -- common/autotest_common.sh@1529 -- # grep oacs 00:08:28.912 11:19:24 -- common/autotest_common.sh@1529 -- # nvme id-ctrl /dev/nvme1 00:08:28.912 11:19:24 -- common/autotest_common.sh@1529 -- # cut -d: -f2 00:08:28.912 11:19:24 -- common/autotest_common.sh@1529 -- # oacs=' 0x12a' 00:08:28.912 11:19:24 -- common/autotest_common.sh@1530 -- # oacs_ns_manage=8 00:08:28.912 11:19:24 -- common/autotest_common.sh@1532 -- # [[ 8 -ne 0 ]] 00:08:28.912 11:19:24 -- common/autotest_common.sh@1538 -- # grep unvmcap 00:08:28.912 11:19:24 -- common/autotest_common.sh@1538 -- # nvme id-ctrl /dev/nvme1 00:08:28.912 11:19:24 -- common/autotest_common.sh@1538 -- # cut -d: -f2 00:08:28.912 11:19:24 -- common/autotest_common.sh@1538 -- # unvmcap=' 0' 00:08:28.912 11:19:24 -- common/autotest_common.sh@1539 -- # [[ 0 -eq 0 ]] 00:08:28.912 11:19:24 -- common/autotest_common.sh@1541 -- # continue 00:08:28.912 11:19:24 -- common/autotest_common.sh@1522 -- # for bdf in "${bdfs[@]}" 00:08:28.912 11:19:24 -- common/autotest_common.sh@1523 -- # get_nvme_ctrlr_from_bdf 0000:00:11.0 00:08:28.912 11:19:24 -- common/autotest_common.sh@1485 -- # grep 0000:00:11.0/nvme/nvme 00:08:28.912 11:19:24 -- common/autotest_common.sh@1485 -- # readlink -f /sys/class/nvme/nvme0 /sys/class/nvme/nvme1 00:08:28.912 11:19:24 -- common/autotest_common.sh@1485 -- # bdf_sysfs_path=/sys/devices/pci0000:00/0000:00:11.0/nvme/nvme0 00:08:28.912 11:19:24 -- common/autotest_common.sh@1486 -- # [[ -z /sys/devices/pci0000:00/0000:00:11.0/nvme/nvme0 ]] 00:08:28.912 11:19:24 -- common/autotest_common.sh@1490 -- # basename /sys/devices/pci0000:00/0000:00:11.0/nvme/nvme0 00:08:28.912 11:19:24 -- common/autotest_common.sh@1490 -- # printf '%s\n' nvme0 00:08:28.912 11:19:24 -- common/autotest_common.sh@1523 -- # nvme_ctrlr=/dev/nvme0 00:08:28.912 11:19:24 -- common/autotest_common.sh@1524 -- # [[ -z /dev/nvme0 ]] 00:08:28.912 11:19:24 -- common/autotest_common.sh@1529 -- # nvme id-ctrl /dev/nvme0 00:08:28.912 11:19:24 -- common/autotest_common.sh@1529 -- # grep oacs 00:08:28.912 11:19:24 -- common/autotest_common.sh@1529 -- # cut -d: -f2 00:08:28.912 11:19:24 -- common/autotest_common.sh@1529 -- # oacs=' 0x12a' 00:08:28.912 11:19:24 -- common/autotest_common.sh@1530 -- # oacs_ns_manage=8 00:08:28.912 11:19:24 -- common/autotest_common.sh@1532 -- # [[ 8 -ne 0 ]] 00:08:28.912 11:19:24 -- common/autotest_common.sh@1538 -- # nvme id-ctrl /dev/nvme0 00:08:28.912 11:19:24 -- common/autotest_common.sh@1538 -- # grep unvmcap 00:08:29.171 11:19:24 -- common/autotest_common.sh@1538 -- # cut -d: -f2 00:08:29.171 11:19:24 -- common/autotest_common.sh@1538 -- # unvmcap=' 0' 00:08:29.171 11:19:24 -- common/autotest_common.sh@1539 -- # [[ 0 -eq 0 ]] 00:08:29.171 11:19:24 -- common/autotest_common.sh@1541 -- # continue 00:08:29.171 11:19:24 -- spdk/autotest.sh@122 -- # timing_exit pre_cleanup 00:08:29.171 11:19:24 -- common/autotest_common.sh@730 -- # xtrace_disable 00:08:29.171 11:19:24 -- common/autotest_common.sh@10 -- # set +x 00:08:29.171 11:19:24 -- spdk/autotest.sh@125 -- # timing_enter afterboot 00:08:29.171 11:19:24 -- common/autotest_common.sh@724 -- # xtrace_disable 00:08:29.171 11:19:24 -- common/autotest_common.sh@10 -- # set +x 00:08:29.171 11:19:24 -- spdk/autotest.sh@126 -- # /home/vagrant/spdk_repo/spdk/scripts/setup.sh 00:08:29.739 0000:00:03.0 (1af4 1001): Active devices: mount@vda:vda2,mount@vda:vda3,mount@vda:vda5, so not binding PCI dev 00:08:29.739 0000:00:10.0 (1b36 0010): nvme -> uio_pci_generic 00:08:29.997 0000:00:11.0 (1b36 0010): nvme -> uio_pci_generic 00:08:29.997 11:19:25 -- spdk/autotest.sh@127 -- # timing_exit afterboot 00:08:29.997 11:19:25 -- common/autotest_common.sh@730 -- # xtrace_disable 00:08:29.997 11:19:25 -- common/autotest_common.sh@10 -- # set +x 00:08:29.997 11:19:25 -- spdk/autotest.sh@131 -- # opal_revert_cleanup 00:08:29.997 11:19:25 -- common/autotest_common.sh@1576 -- # mapfile -t bdfs 00:08:29.997 11:19:25 -- common/autotest_common.sh@1576 -- # get_nvme_bdfs_by_id 0x0a54 00:08:29.997 11:19:25 -- common/autotest_common.sh@1561 -- # bdfs=() 00:08:29.997 11:19:25 -- common/autotest_common.sh@1561 -- # _bdfs=() 00:08:29.997 11:19:25 -- common/autotest_common.sh@1561 -- # local bdfs _bdfs 00:08:29.997 11:19:25 -- common/autotest_common.sh@1562 -- # _bdfs=($(get_nvme_bdfs)) 00:08:29.997 11:19:25 -- common/autotest_common.sh@1562 -- # get_nvme_bdfs 00:08:29.997 11:19:25 -- common/autotest_common.sh@1496 -- # bdfs=() 00:08:29.997 11:19:25 -- common/autotest_common.sh@1496 -- # local bdfs 00:08:29.997 11:19:25 -- common/autotest_common.sh@1497 -- # bdfs=($("$rootdir/scripts/gen_nvme.sh" | jq -r '.config[].params.traddr')) 00:08:29.997 11:19:25 -- common/autotest_common.sh@1497 -- # /home/vagrant/spdk_repo/spdk/scripts/gen_nvme.sh 00:08:29.997 11:19:25 -- common/autotest_common.sh@1497 -- # jq -r '.config[].params.traddr' 00:08:29.997 11:19:25 -- common/autotest_common.sh@1498 -- # (( 2 == 0 )) 00:08:29.997 11:19:25 -- common/autotest_common.sh@1502 -- # printf '%s\n' 0000:00:10.0 0000:00:11.0 00:08:29.997 11:19:25 -- common/autotest_common.sh@1563 -- # for bdf in "${_bdfs[@]}" 00:08:29.997 11:19:25 -- common/autotest_common.sh@1564 -- # cat /sys/bus/pci/devices/0000:00:10.0/device 00:08:29.997 11:19:25 -- common/autotest_common.sh@1564 -- # device=0x0010 00:08:29.997 11:19:25 -- common/autotest_common.sh@1565 -- # [[ 0x0010 == \0\x\0\a\5\4 ]] 00:08:29.997 11:19:25 -- common/autotest_common.sh@1563 -- # for bdf in "${_bdfs[@]}" 00:08:29.997 11:19:25 -- common/autotest_common.sh@1564 -- # cat /sys/bus/pci/devices/0000:00:11.0/device 00:08:29.997 11:19:25 -- common/autotest_common.sh@1564 -- # device=0x0010 00:08:29.997 11:19:25 -- common/autotest_common.sh@1565 -- # [[ 0x0010 == \0\x\0\a\5\4 ]] 00:08:29.997 11:19:25 -- common/autotest_common.sh@1570 -- # (( 0 > 0 )) 00:08:29.997 11:19:25 -- common/autotest_common.sh@1570 -- # return 0 00:08:29.997 11:19:25 -- common/autotest_common.sh@1577 -- # [[ -z '' ]] 00:08:29.997 11:19:25 -- common/autotest_common.sh@1578 -- # return 0 00:08:29.997 11:19:25 -- spdk/autotest.sh@137 -- # '[' 0 -eq 1 ']' 00:08:29.997 11:19:25 -- spdk/autotest.sh@141 -- # '[' 1 -eq 1 ']' 00:08:29.997 11:19:25 -- spdk/autotest.sh@142 -- # [[ 0 -eq 1 ]] 00:08:29.997 11:19:25 -- spdk/autotest.sh@142 -- # [[ 0 -eq 1 ]] 00:08:29.997 11:19:25 -- spdk/autotest.sh@149 -- # timing_enter lib 00:08:29.997 11:19:25 -- common/autotest_common.sh@724 -- # xtrace_disable 00:08:29.997 11:19:25 -- common/autotest_common.sh@10 -- # set +x 00:08:29.997 11:19:25 -- spdk/autotest.sh@151 -- # [[ 0 -eq 1 ]] 00:08:29.997 11:19:25 -- spdk/autotest.sh@155 -- # run_test env /home/vagrant/spdk_repo/spdk/test/env/env.sh 00:08:29.997 11:19:25 -- common/autotest_common.sh@1101 -- # '[' 2 -le 1 ']' 00:08:29.997 11:19:25 -- common/autotest_common.sh@1107 -- # xtrace_disable 00:08:29.997 11:19:25 -- common/autotest_common.sh@10 -- # set +x 00:08:29.997 ************************************ 00:08:29.997 START TEST env 00:08:29.997 ************************************ 00:08:29.997 11:19:25 env -- common/autotest_common.sh@1125 -- # /home/vagrant/spdk_repo/spdk/test/env/env.sh 00:08:30.256 * Looking for test storage... 00:08:30.256 * Found test storage at /home/vagrant/spdk_repo/spdk/test/env 00:08:30.256 11:19:25 env -- common/autotest_common.sh@1680 -- # [[ y == y ]] 00:08:30.256 11:19:25 env -- common/autotest_common.sh@1681 -- # lcov --version 00:08:30.256 11:19:25 env -- common/autotest_common.sh@1681 -- # awk '{print $NF}' 00:08:30.256 11:19:25 env -- common/autotest_common.sh@1681 -- # lt 1.15 2 00:08:30.256 11:19:25 env -- scripts/common.sh@373 -- # cmp_versions 1.15 '<' 2 00:08:30.256 11:19:25 env -- scripts/common.sh@333 -- # local ver1 ver1_l 00:08:30.256 11:19:25 env -- scripts/common.sh@334 -- # local ver2 ver2_l 00:08:30.256 11:19:25 env -- scripts/common.sh@336 -- # IFS=.-: 00:08:30.256 11:19:25 env -- scripts/common.sh@336 -- # read -ra ver1 00:08:30.256 11:19:25 env -- scripts/common.sh@337 -- # IFS=.-: 00:08:30.256 11:19:25 env -- scripts/common.sh@337 -- # read -ra ver2 00:08:30.256 11:19:25 env -- scripts/common.sh@338 -- # local 'op=<' 00:08:30.256 11:19:25 env -- scripts/common.sh@340 -- # ver1_l=2 00:08:30.256 11:19:25 env -- scripts/common.sh@341 -- # ver2_l=1 00:08:30.256 11:19:25 env -- scripts/common.sh@343 -- # local lt=0 gt=0 eq=0 v 00:08:30.256 11:19:25 env -- scripts/common.sh@344 -- # case "$op" in 00:08:30.256 11:19:25 env -- scripts/common.sh@345 -- # : 1 00:08:30.256 11:19:25 env -- scripts/common.sh@364 -- # (( v = 0 )) 00:08:30.256 11:19:25 env -- scripts/common.sh@364 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:08:30.256 11:19:25 env -- scripts/common.sh@365 -- # decimal 1 00:08:30.256 11:19:25 env -- scripts/common.sh@353 -- # local d=1 00:08:30.256 11:19:25 env -- scripts/common.sh@354 -- # [[ 1 =~ ^[0-9]+$ ]] 00:08:30.256 11:19:25 env -- scripts/common.sh@355 -- # echo 1 00:08:30.256 11:19:25 env -- scripts/common.sh@365 -- # ver1[v]=1 00:08:30.256 11:19:25 env -- scripts/common.sh@366 -- # decimal 2 00:08:30.256 11:19:25 env -- scripts/common.sh@353 -- # local d=2 00:08:30.256 11:19:25 env -- scripts/common.sh@354 -- # [[ 2 =~ ^[0-9]+$ ]] 00:08:30.256 11:19:25 env -- scripts/common.sh@355 -- # echo 2 00:08:30.256 11:19:25 env -- scripts/common.sh@366 -- # ver2[v]=2 00:08:30.256 11:19:25 env -- scripts/common.sh@367 -- # (( ver1[v] > ver2[v] )) 00:08:30.256 11:19:25 env -- scripts/common.sh@368 -- # (( ver1[v] < ver2[v] )) 00:08:30.256 11:19:25 env -- scripts/common.sh@368 -- # return 0 00:08:30.256 11:19:25 env -- common/autotest_common.sh@1682 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:08:30.256 11:19:25 env -- common/autotest_common.sh@1694 -- # export 'LCOV_OPTS= 00:08:30.256 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:08:30.256 --rc genhtml_branch_coverage=1 00:08:30.256 --rc genhtml_function_coverage=1 00:08:30.256 --rc genhtml_legend=1 00:08:30.256 --rc geninfo_all_blocks=1 00:08:30.256 --rc geninfo_unexecuted_blocks=1 00:08:30.256 00:08:30.256 ' 00:08:30.256 11:19:25 env -- common/autotest_common.sh@1694 -- # LCOV_OPTS=' 00:08:30.256 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:08:30.256 --rc genhtml_branch_coverage=1 00:08:30.256 --rc genhtml_function_coverage=1 00:08:30.256 --rc genhtml_legend=1 00:08:30.256 --rc geninfo_all_blocks=1 00:08:30.256 --rc geninfo_unexecuted_blocks=1 00:08:30.256 00:08:30.256 ' 00:08:30.256 11:19:25 env -- common/autotest_common.sh@1695 -- # export 'LCOV=lcov 00:08:30.256 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:08:30.256 --rc genhtml_branch_coverage=1 00:08:30.256 --rc genhtml_function_coverage=1 00:08:30.256 --rc genhtml_legend=1 00:08:30.256 --rc geninfo_all_blocks=1 00:08:30.256 --rc geninfo_unexecuted_blocks=1 00:08:30.256 00:08:30.256 ' 00:08:30.256 11:19:25 env -- common/autotest_common.sh@1695 -- # LCOV='lcov 00:08:30.256 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:08:30.256 --rc genhtml_branch_coverage=1 00:08:30.256 --rc genhtml_function_coverage=1 00:08:30.256 --rc genhtml_legend=1 00:08:30.256 --rc geninfo_all_blocks=1 00:08:30.256 --rc geninfo_unexecuted_blocks=1 00:08:30.256 00:08:30.256 ' 00:08:30.256 11:19:25 env -- env/env.sh@10 -- # run_test env_memory /home/vagrant/spdk_repo/spdk/test/env/memory/memory_ut 00:08:30.256 11:19:25 env -- common/autotest_common.sh@1101 -- # '[' 2 -le 1 ']' 00:08:30.256 11:19:25 env -- common/autotest_common.sh@1107 -- # xtrace_disable 00:08:30.256 11:19:25 env -- common/autotest_common.sh@10 -- # set +x 00:08:30.256 ************************************ 00:08:30.256 START TEST env_memory 00:08:30.256 ************************************ 00:08:30.256 11:19:25 env.env_memory -- common/autotest_common.sh@1125 -- # /home/vagrant/spdk_repo/spdk/test/env/memory/memory_ut 00:08:30.256 00:08:30.256 00:08:30.256 CUnit - A unit testing framework for C - Version 2.1-3 00:08:30.256 http://cunit.sourceforge.net/ 00:08:30.256 00:08:30.256 00:08:30.256 Suite: memory 00:08:30.256 Test: alloc and free memory map ...[2024-10-07 11:19:25.694556] /home/vagrant/spdk_repo/spdk/lib/env_dpdk/memory.c: 283:spdk_mem_map_alloc: *ERROR*: Initial mem_map notify failed 00:08:30.256 passed 00:08:30.256 Test: mem map translation ...[2024-10-07 11:19:25.725775] /home/vagrant/spdk_repo/spdk/lib/env_dpdk/memory.c: 595:spdk_mem_map_set_translation: *ERROR*: invalid spdk_mem_map_set_translation parameters, vaddr=2097152 len=1234 00:08:30.256 [2024-10-07 11:19:25.725815] /home/vagrant/spdk_repo/spdk/lib/env_dpdk/memory.c: 595:spdk_mem_map_set_translation: *ERROR*: invalid spdk_mem_map_set_translation parameters, vaddr=1234 len=2097152 00:08:30.256 [2024-10-07 11:19:25.725871] /home/vagrant/spdk_repo/spdk/lib/env_dpdk/memory.c: 589:spdk_mem_map_set_translation: *ERROR*: invalid usermode virtual address 281474976710656 00:08:30.256 [2024-10-07 11:19:25.725882] /home/vagrant/spdk_repo/spdk/lib/env_dpdk/memory.c: 605:spdk_mem_map_set_translation: *ERROR*: could not get 0xffffffe00000 map 00:08:30.256 passed 00:08:30.514 Test: mem map registration ...[2024-10-07 11:19:25.789557] /home/vagrant/spdk_repo/spdk/lib/env_dpdk/memory.c: 347:spdk_mem_register: *ERROR*: invalid spdk_mem_register parameters, vaddr=200000 len=1234 00:08:30.514 [2024-10-07 11:19:25.789605] /home/vagrant/spdk_repo/spdk/lib/env_dpdk/memory.c: 347:spdk_mem_register: *ERROR*: invalid spdk_mem_register parameters, vaddr=4d2 len=2097152 00:08:30.515 passed 00:08:30.515 Test: mem map adjacent registrations ...passed 00:08:30.515 00:08:30.515 Run Summary: Type Total Ran Passed Failed Inactive 00:08:30.515 suites 1 1 n/a 0 0 00:08:30.515 tests 4 4 4 0 0 00:08:30.515 asserts 152 152 152 0 n/a 00:08:30.515 00:08:30.515 Elapsed time = 0.214 seconds 00:08:30.515 00:08:30.515 real 0m0.232s 00:08:30.515 user 0m0.217s 00:08:30.515 sys 0m0.012s 00:08:30.515 11:19:25 env.env_memory -- common/autotest_common.sh@1126 -- # xtrace_disable 00:08:30.515 11:19:25 env.env_memory -- common/autotest_common.sh@10 -- # set +x 00:08:30.515 ************************************ 00:08:30.515 END TEST env_memory 00:08:30.515 ************************************ 00:08:30.515 11:19:25 env -- env/env.sh@11 -- # run_test env_vtophys /home/vagrant/spdk_repo/spdk/test/env/vtophys/vtophys 00:08:30.515 11:19:25 env -- common/autotest_common.sh@1101 -- # '[' 2 -le 1 ']' 00:08:30.515 11:19:25 env -- common/autotest_common.sh@1107 -- # xtrace_disable 00:08:30.515 11:19:25 env -- common/autotest_common.sh@10 -- # set +x 00:08:30.515 ************************************ 00:08:30.515 START TEST env_vtophys 00:08:30.515 ************************************ 00:08:30.515 11:19:25 env.env_vtophys -- common/autotest_common.sh@1125 -- # /home/vagrant/spdk_repo/spdk/test/env/vtophys/vtophys 00:08:30.515 EAL: lib.eal log level changed from notice to debug 00:08:30.515 EAL: Detected lcore 0 as core 0 on socket 0 00:08:30.515 EAL: Detected lcore 1 as core 0 on socket 0 00:08:30.515 EAL: Detected lcore 2 as core 0 on socket 0 00:08:30.515 EAL: Detected lcore 3 as core 0 on socket 0 00:08:30.515 EAL: Detected lcore 4 as core 0 on socket 0 00:08:30.515 EAL: Detected lcore 5 as core 0 on socket 0 00:08:30.515 EAL: Detected lcore 6 as core 0 on socket 0 00:08:30.515 EAL: Detected lcore 7 as core 0 on socket 0 00:08:30.515 EAL: Detected lcore 8 as core 0 on socket 0 00:08:30.515 EAL: Detected lcore 9 as core 0 on socket 0 00:08:30.515 EAL: Maximum logical cores by configuration: 128 00:08:30.515 EAL: Detected CPU lcores: 10 00:08:30.515 EAL: Detected NUMA nodes: 1 00:08:30.515 EAL: Checking presence of .so 'librte_eal.so.24.1' 00:08:30.515 EAL: Detected shared linkage of DPDK 00:08:30.515 EAL: No shared files mode enabled, IPC will be disabled 00:08:30.515 EAL: Selected IOVA mode 'PA' 00:08:30.515 EAL: Probing VFIO support... 00:08:30.515 EAL: Module /sys/module/vfio not found! error 2 (No such file or directory) 00:08:30.515 EAL: VFIO modules not loaded, skipping VFIO support... 00:08:30.515 EAL: Ask a virtual area of 0x2e000 bytes 00:08:30.515 EAL: Virtual area found at 0x200000000000 (size = 0x2e000) 00:08:30.515 EAL: Setting up physically contiguous memory... 00:08:30.515 EAL: Setting maximum number of open files to 524288 00:08:30.515 EAL: Detected memory type: socket_id:0 hugepage_sz:2097152 00:08:30.515 EAL: Creating 4 segment lists: n_segs:8192 socket_id:0 hugepage_sz:2097152 00:08:30.515 EAL: Ask a virtual area of 0x61000 bytes 00:08:30.515 EAL: Virtual area found at 0x20000002e000 (size = 0x61000) 00:08:30.515 EAL: Memseg list allocated at socket 0, page size 0x800kB 00:08:30.515 EAL: Ask a virtual area of 0x400000000 bytes 00:08:30.515 EAL: Virtual area found at 0x200000200000 (size = 0x400000000) 00:08:30.515 EAL: VA reserved for memseg list at 0x200000200000, size 400000000 00:08:30.515 EAL: Ask a virtual area of 0x61000 bytes 00:08:30.515 EAL: Virtual area found at 0x200400200000 (size = 0x61000) 00:08:30.515 EAL: Memseg list allocated at socket 0, page size 0x800kB 00:08:30.515 EAL: Ask a virtual area of 0x400000000 bytes 00:08:30.515 EAL: Virtual area found at 0x200400400000 (size = 0x400000000) 00:08:30.515 EAL: VA reserved for memseg list at 0x200400400000, size 400000000 00:08:30.515 EAL: Ask a virtual area of 0x61000 bytes 00:08:30.515 EAL: Virtual area found at 0x200800400000 (size = 0x61000) 00:08:30.515 EAL: Memseg list allocated at socket 0, page size 0x800kB 00:08:30.515 EAL: Ask a virtual area of 0x400000000 bytes 00:08:30.515 EAL: Virtual area found at 0x200800600000 (size = 0x400000000) 00:08:30.515 EAL: VA reserved for memseg list at 0x200800600000, size 400000000 00:08:30.515 EAL: Ask a virtual area of 0x61000 bytes 00:08:30.515 EAL: Virtual area found at 0x200c00600000 (size = 0x61000) 00:08:30.515 EAL: Memseg list allocated at socket 0, page size 0x800kB 00:08:30.515 EAL: Ask a virtual area of 0x400000000 bytes 00:08:30.515 EAL: Virtual area found at 0x200c00800000 (size = 0x400000000) 00:08:30.515 EAL: VA reserved for memseg list at 0x200c00800000, size 400000000 00:08:30.515 EAL: Hugepages will be freed exactly as allocated. 00:08:30.515 EAL: No shared files mode enabled, IPC is disabled 00:08:30.515 EAL: No shared files mode enabled, IPC is disabled 00:08:30.774 EAL: TSC frequency is ~2200000 KHz 00:08:30.774 EAL: Main lcore 0 is ready (tid=7fae55c9fa00;cpuset=[0]) 00:08:30.774 EAL: Trying to obtain current memory policy. 00:08:30.774 EAL: Setting policy MPOL_PREFERRED for socket 0 00:08:30.774 EAL: Restoring previous memory policy: 0 00:08:30.774 EAL: request: mp_malloc_sync 00:08:30.774 EAL: No shared files mode enabled, IPC is disabled 00:08:30.774 EAL: Heap on socket 0 was expanded by 2MB 00:08:30.774 EAL: Module /sys/module/vfio not found! error 2 (No such file or directory) 00:08:30.774 EAL: No PCI address specified using 'addr=' in: bus=pci 00:08:30.774 EAL: Mem event callback 'spdk:(nil)' registered 00:08:30.774 EAL: Module /sys/module/vfio_pci not found! error 2 (No such file or directory) 00:08:30.774 00:08:30.774 00:08:30.774 CUnit - A unit testing framework for C - Version 2.1-3 00:08:30.774 http://cunit.sourceforge.net/ 00:08:30.774 00:08:30.774 00:08:30.774 Suite: components_suite 00:08:30.774 Test: vtophys_malloc_test ...passed 00:08:30.774 Test: vtophys_spdk_malloc_test ...EAL: Trying to obtain current memory policy. 00:08:30.774 EAL: Setting policy MPOL_PREFERRED for socket 0 00:08:30.774 EAL: Restoring previous memory policy: 4 00:08:30.774 EAL: Calling mem event callback 'spdk:(nil)' 00:08:30.774 EAL: request: mp_malloc_sync 00:08:30.774 EAL: No shared files mode enabled, IPC is disabled 00:08:30.774 EAL: Heap on socket 0 was expanded by 4MB 00:08:30.774 EAL: Calling mem event callback 'spdk:(nil)' 00:08:30.774 EAL: request: mp_malloc_sync 00:08:30.774 EAL: No shared files mode enabled, IPC is disabled 00:08:30.774 EAL: Heap on socket 0 was shrunk by 4MB 00:08:30.774 EAL: Trying to obtain current memory policy. 00:08:30.774 EAL: Setting policy MPOL_PREFERRED for socket 0 00:08:30.774 EAL: Restoring previous memory policy: 4 00:08:30.774 EAL: Calling mem event callback 'spdk:(nil)' 00:08:30.774 EAL: request: mp_malloc_sync 00:08:30.774 EAL: No shared files mode enabled, IPC is disabled 00:08:30.774 EAL: Heap on socket 0 was expanded by 6MB 00:08:30.774 EAL: Calling mem event callback 'spdk:(nil)' 00:08:30.774 EAL: request: mp_malloc_sync 00:08:30.774 EAL: No shared files mode enabled, IPC is disabled 00:08:30.774 EAL: Heap on socket 0 was shrunk by 6MB 00:08:30.774 EAL: Trying to obtain current memory policy. 00:08:30.774 EAL: Setting policy MPOL_PREFERRED for socket 0 00:08:30.774 EAL: Restoring previous memory policy: 4 00:08:30.774 EAL: Calling mem event callback 'spdk:(nil)' 00:08:30.774 EAL: request: mp_malloc_sync 00:08:30.774 EAL: No shared files mode enabled, IPC is disabled 00:08:30.774 EAL: Heap on socket 0 was expanded by 10MB 00:08:30.774 EAL: Calling mem event callback 'spdk:(nil)' 00:08:30.774 EAL: request: mp_malloc_sync 00:08:30.774 EAL: No shared files mode enabled, IPC is disabled 00:08:30.774 EAL: Heap on socket 0 was shrunk by 10MB 00:08:30.774 EAL: Trying to obtain current memory policy. 00:08:30.774 EAL: Setting policy MPOL_PREFERRED for socket 0 00:08:30.774 EAL: Restoring previous memory policy: 4 00:08:30.774 EAL: Calling mem event callback 'spdk:(nil)' 00:08:30.774 EAL: request: mp_malloc_sync 00:08:30.774 EAL: No shared files mode enabled, IPC is disabled 00:08:30.774 EAL: Heap on socket 0 was expanded by 18MB 00:08:30.774 EAL: Calling mem event callback 'spdk:(nil)' 00:08:30.774 EAL: request: mp_malloc_sync 00:08:30.774 EAL: No shared files mode enabled, IPC is disabled 00:08:30.774 EAL: Heap on socket 0 was shrunk by 18MB 00:08:30.774 EAL: Trying to obtain current memory policy. 00:08:30.774 EAL: Setting policy MPOL_PREFERRED for socket 0 00:08:30.774 EAL: Restoring previous memory policy: 4 00:08:30.774 EAL: Calling mem event callback 'spdk:(nil)' 00:08:30.774 EAL: request: mp_malloc_sync 00:08:30.774 EAL: No shared files mode enabled, IPC is disabled 00:08:30.774 EAL: Heap on socket 0 was expanded by 34MB 00:08:30.774 EAL: Calling mem event callback 'spdk:(nil)' 00:08:30.774 EAL: request: mp_malloc_sync 00:08:30.774 EAL: No shared files mode enabled, IPC is disabled 00:08:30.774 EAL: Heap on socket 0 was shrunk by 34MB 00:08:30.774 EAL: Trying to obtain current memory policy. 00:08:30.774 EAL: Setting policy MPOL_PREFERRED for socket 0 00:08:30.774 EAL: Restoring previous memory policy: 4 00:08:30.774 EAL: Calling mem event callback 'spdk:(nil)' 00:08:30.774 EAL: request: mp_malloc_sync 00:08:30.774 EAL: No shared files mode enabled, IPC is disabled 00:08:30.774 EAL: Heap on socket 0 was expanded by 66MB 00:08:30.774 EAL: Calling mem event callback 'spdk:(nil)' 00:08:30.774 EAL: request: mp_malloc_sync 00:08:30.774 EAL: No shared files mode enabled, IPC is disabled 00:08:30.774 EAL: Heap on socket 0 was shrunk by 66MB 00:08:30.774 EAL: Trying to obtain current memory policy. 00:08:30.774 EAL: Setting policy MPOL_PREFERRED for socket 0 00:08:30.774 EAL: Restoring previous memory policy: 4 00:08:30.774 EAL: Calling mem event callback 'spdk:(nil)' 00:08:30.774 EAL: request: mp_malloc_sync 00:08:30.774 EAL: No shared files mode enabled, IPC is disabled 00:08:30.774 EAL: Heap on socket 0 was expanded by 130MB 00:08:30.774 EAL: Calling mem event callback 'spdk:(nil)' 00:08:30.774 EAL: request: mp_malloc_sync 00:08:30.774 EAL: No shared files mode enabled, IPC is disabled 00:08:30.774 EAL: Heap on socket 0 was shrunk by 130MB 00:08:30.774 EAL: Trying to obtain current memory policy. 00:08:30.774 EAL: Setting policy MPOL_PREFERRED for socket 0 00:08:31.032 EAL: Restoring previous memory policy: 4 00:08:31.032 EAL: Calling mem event callback 'spdk:(nil)' 00:08:31.032 EAL: request: mp_malloc_sync 00:08:31.032 EAL: No shared files mode enabled, IPC is disabled 00:08:31.032 EAL: Heap on socket 0 was expanded by 258MB 00:08:31.032 EAL: Calling mem event callback 'spdk:(nil)' 00:08:31.032 EAL: request: mp_malloc_sync 00:08:31.032 EAL: No shared files mode enabled, IPC is disabled 00:08:31.032 EAL: Heap on socket 0 was shrunk by 258MB 00:08:31.032 EAL: Trying to obtain current memory policy. 00:08:31.032 EAL: Setting policy MPOL_PREFERRED for socket 0 00:08:31.032 EAL: Restoring previous memory policy: 4 00:08:31.032 EAL: Calling mem event callback 'spdk:(nil)' 00:08:31.032 EAL: request: mp_malloc_sync 00:08:31.032 EAL: No shared files mode enabled, IPC is disabled 00:08:31.032 EAL: Heap on socket 0 was expanded by 514MB 00:08:31.291 EAL: Calling mem event callback 'spdk:(nil)' 00:08:31.291 EAL: request: mp_malloc_sync 00:08:31.291 EAL: No shared files mode enabled, IPC is disabled 00:08:31.291 EAL: Heap on socket 0 was shrunk by 514MB 00:08:31.291 EAL: Trying to obtain current memory policy. 00:08:31.291 EAL: Setting policy MPOL_PREFERRED for socket 0 00:08:31.550 EAL: Restoring previous memory policy: 4 00:08:31.550 EAL: Calling mem event callback 'spdk:(nil)' 00:08:31.550 EAL: request: mp_malloc_sync 00:08:31.550 EAL: No shared files mode enabled, IPC is disabled 00:08:31.550 EAL: Heap on socket 0 was expanded by 1026MB 00:08:31.809 EAL: Calling mem event callback 'spdk:(nil)' 00:08:32.067 EAL: request: mp_malloc_sync 00:08:32.067 EAL: No shared files mode enabled, IPC is disabled 00:08:32.067 EAL: Heap on socket 0 was shrunk by 1026MB 00:08:32.067 passed 00:08:32.067 00:08:32.067 Run Summary: Type Total Ran Passed Failed Inactive 00:08:32.067 suites 1 1 n/a 0 0 00:08:32.067 tests 2 2 2 0 0 00:08:32.067 asserts 5498 5498 5498 0 n/a 00:08:32.067 00:08:32.067 Elapsed time = 1.304 seconds 00:08:32.067 EAL: Calling mem event callback 'spdk:(nil)' 00:08:32.067 EAL: request: mp_malloc_sync 00:08:32.067 EAL: No shared files mode enabled, IPC is disabled 00:08:32.067 EAL: Heap on socket 0 was shrunk by 2MB 00:08:32.067 EAL: No shared files mode enabled, IPC is disabled 00:08:32.067 EAL: No shared files mode enabled, IPC is disabled 00:08:32.067 EAL: No shared files mode enabled, IPC is disabled 00:08:32.067 00:08:32.067 real 0m1.522s 00:08:32.067 user 0m0.839s 00:08:32.067 sys 0m0.548s 00:08:32.067 11:19:27 env.env_vtophys -- common/autotest_common.sh@1126 -- # xtrace_disable 00:08:32.067 11:19:27 env.env_vtophys -- common/autotest_common.sh@10 -- # set +x 00:08:32.067 ************************************ 00:08:32.067 END TEST env_vtophys 00:08:32.067 ************************************ 00:08:32.067 11:19:27 env -- env/env.sh@12 -- # run_test env_pci /home/vagrant/spdk_repo/spdk/test/env/pci/pci_ut 00:08:32.067 11:19:27 env -- common/autotest_common.sh@1101 -- # '[' 2 -le 1 ']' 00:08:32.067 11:19:27 env -- common/autotest_common.sh@1107 -- # xtrace_disable 00:08:32.067 11:19:27 env -- common/autotest_common.sh@10 -- # set +x 00:08:32.067 ************************************ 00:08:32.067 START TEST env_pci 00:08:32.068 ************************************ 00:08:32.068 11:19:27 env.env_pci -- common/autotest_common.sh@1125 -- # /home/vagrant/spdk_repo/spdk/test/env/pci/pci_ut 00:08:32.068 00:08:32.068 00:08:32.068 CUnit - A unit testing framework for C - Version 2.1-3 00:08:32.068 http://cunit.sourceforge.net/ 00:08:32.068 00:08:32.068 00:08:32.068 Suite: pci 00:08:32.068 Test: pci_hook ...[2024-10-07 11:19:27.517068] /home/vagrant/spdk_repo/spdk/lib/env_dpdk/pci.c:1049:spdk_pci_device_claim: *ERROR*: Cannot create lock on device /var/tmp/spdk_pci_lock_10000:00:01.0, probably process 58502 has claimed it 00:08:32.068 passed 00:08:32.068 00:08:32.068 Run Summary: Type Total Ran Passed Failed Inactive 00:08:32.068 suites 1 1 n/a 0 0 00:08:32.068 tests 1 1 1 0 0 00:08:32.068 asserts 25 25 25 0 n/a 00:08:32.068 00:08:32.068 Elapsed time = 0.002 seconds 00:08:32.068 EAL: Cannot find device (10000:00:01.0) 00:08:32.068 EAL: Failed to attach device on primary process 00:08:32.068 00:08:32.068 real 0m0.018s 00:08:32.068 user 0m0.011s 00:08:32.068 sys 0m0.007s 00:08:32.068 ************************************ 00:08:32.068 END TEST env_pci 00:08:32.068 ************************************ 00:08:32.068 11:19:27 env.env_pci -- common/autotest_common.sh@1126 -- # xtrace_disable 00:08:32.068 11:19:27 env.env_pci -- common/autotest_common.sh@10 -- # set +x 00:08:32.068 11:19:27 env -- env/env.sh@14 -- # argv='-c 0x1 ' 00:08:32.068 11:19:27 env -- env/env.sh@15 -- # uname 00:08:32.068 11:19:27 env -- env/env.sh@15 -- # '[' Linux = Linux ']' 00:08:32.068 11:19:27 env -- env/env.sh@22 -- # argv+=--base-virtaddr=0x200000000000 00:08:32.068 11:19:27 env -- env/env.sh@24 -- # run_test env_dpdk_post_init /home/vagrant/spdk_repo/spdk/test/env/env_dpdk_post_init/env_dpdk_post_init -c 0x1 --base-virtaddr=0x200000000000 00:08:32.068 11:19:27 env -- common/autotest_common.sh@1101 -- # '[' 5 -le 1 ']' 00:08:32.068 11:19:27 env -- common/autotest_common.sh@1107 -- # xtrace_disable 00:08:32.068 11:19:27 env -- common/autotest_common.sh@10 -- # set +x 00:08:32.068 ************************************ 00:08:32.068 START TEST env_dpdk_post_init 00:08:32.068 ************************************ 00:08:32.068 11:19:27 env.env_dpdk_post_init -- common/autotest_common.sh@1125 -- # /home/vagrant/spdk_repo/spdk/test/env/env_dpdk_post_init/env_dpdk_post_init -c 0x1 --base-virtaddr=0x200000000000 00:08:32.326 EAL: Detected CPU lcores: 10 00:08:32.326 EAL: Detected NUMA nodes: 1 00:08:32.326 EAL: Detected shared linkage of DPDK 00:08:32.326 EAL: Multi-process socket /var/run/dpdk/rte/mp_socket 00:08:32.326 EAL: Selected IOVA mode 'PA' 00:08:32.326 TELEMETRY: No legacy callbacks, legacy socket not created 00:08:32.326 EAL: Probe PCI driver: spdk_nvme (1b36:0010) device: 0000:00:10.0 (socket -1) 00:08:32.326 EAL: Probe PCI driver: spdk_nvme (1b36:0010) device: 0000:00:11.0 (socket -1) 00:08:32.326 Starting DPDK initialization... 00:08:32.326 Starting SPDK post initialization... 00:08:32.326 SPDK NVMe probe 00:08:32.326 Attaching to 0000:00:10.0 00:08:32.326 Attaching to 0000:00:11.0 00:08:32.326 Attached to 0000:00:10.0 00:08:32.326 Attached to 0000:00:11.0 00:08:32.326 Cleaning up... 00:08:32.326 00:08:32.326 real 0m0.176s 00:08:32.326 user 0m0.045s 00:08:32.326 sys 0m0.031s 00:08:32.326 11:19:27 env.env_dpdk_post_init -- common/autotest_common.sh@1126 -- # xtrace_disable 00:08:32.326 11:19:27 env.env_dpdk_post_init -- common/autotest_common.sh@10 -- # set +x 00:08:32.326 ************************************ 00:08:32.326 END TEST env_dpdk_post_init 00:08:32.326 ************************************ 00:08:32.326 11:19:27 env -- env/env.sh@26 -- # uname 00:08:32.326 11:19:27 env -- env/env.sh@26 -- # '[' Linux = Linux ']' 00:08:32.326 11:19:27 env -- env/env.sh@29 -- # run_test env_mem_callbacks /home/vagrant/spdk_repo/spdk/test/env/mem_callbacks/mem_callbacks 00:08:32.326 11:19:27 env -- common/autotest_common.sh@1101 -- # '[' 2 -le 1 ']' 00:08:32.326 11:19:27 env -- common/autotest_common.sh@1107 -- # xtrace_disable 00:08:32.326 11:19:27 env -- common/autotest_common.sh@10 -- # set +x 00:08:32.326 ************************************ 00:08:32.326 START TEST env_mem_callbacks 00:08:32.326 ************************************ 00:08:32.326 11:19:27 env.env_mem_callbacks -- common/autotest_common.sh@1125 -- # /home/vagrant/spdk_repo/spdk/test/env/mem_callbacks/mem_callbacks 00:08:32.326 EAL: Detected CPU lcores: 10 00:08:32.326 EAL: Detected NUMA nodes: 1 00:08:32.326 EAL: Detected shared linkage of DPDK 00:08:32.326 EAL: Multi-process socket /var/run/dpdk/rte/mp_socket 00:08:32.326 EAL: Selected IOVA mode 'PA' 00:08:32.584 00:08:32.584 00:08:32.584 CUnit - A unit testing framework for C - Version 2.1-3 00:08:32.584 http://cunit.sourceforge.net/ 00:08:32.584 00:08:32.584 00:08:32.584 Suite: memory 00:08:32.584 Test: test ... 00:08:32.584 register 0x200000200000 2097152 00:08:32.584 malloc 3145728 00:08:32.584 TELEMETRY: No legacy callbacks, legacy socket not created 00:08:32.584 register 0x200000400000 4194304 00:08:32.584 buf 0x200000500000 len 3145728 PASSED 00:08:32.584 malloc 64 00:08:32.584 buf 0x2000004fff40 len 64 PASSED 00:08:32.584 malloc 4194304 00:08:32.584 register 0x200000800000 6291456 00:08:32.584 buf 0x200000a00000 len 4194304 PASSED 00:08:32.584 free 0x200000500000 3145728 00:08:32.584 free 0x2000004fff40 64 00:08:32.584 unregister 0x200000400000 4194304 PASSED 00:08:32.584 free 0x200000a00000 4194304 00:08:32.584 unregister 0x200000800000 6291456 PASSED 00:08:32.584 malloc 8388608 00:08:32.585 register 0x200000400000 10485760 00:08:32.585 buf 0x200000600000 len 8388608 PASSED 00:08:32.585 free 0x200000600000 8388608 00:08:32.585 unregister 0x200000400000 10485760 PASSED 00:08:32.585 passed 00:08:32.585 00:08:32.585 Run Summary: Type Total Ran Passed Failed Inactive 00:08:32.585 suites 1 1 n/a 0 0 00:08:32.585 tests 1 1 1 0 0 00:08:32.585 asserts 15 15 15 0 n/a 00:08:32.585 00:08:32.585 Elapsed time = 0.007 seconds 00:08:32.585 00:08:32.585 real 0m0.143s 00:08:32.585 user 0m0.018s 00:08:32.585 sys 0m0.022s 00:08:32.585 11:19:27 env.env_mem_callbacks -- common/autotest_common.sh@1126 -- # xtrace_disable 00:08:32.585 ************************************ 00:08:32.585 END TEST env_mem_callbacks 00:08:32.585 ************************************ 00:08:32.585 11:19:27 env.env_mem_callbacks -- common/autotest_common.sh@10 -- # set +x 00:08:32.585 ************************************ 00:08:32.585 END TEST env 00:08:32.585 ************************************ 00:08:32.585 00:08:32.585 real 0m2.544s 00:08:32.585 user 0m1.313s 00:08:32.585 sys 0m0.867s 00:08:32.585 11:19:27 env -- common/autotest_common.sh@1126 -- # xtrace_disable 00:08:32.585 11:19:27 env -- common/autotest_common.sh@10 -- # set +x 00:08:32.585 11:19:28 -- spdk/autotest.sh@156 -- # run_test rpc /home/vagrant/spdk_repo/spdk/test/rpc/rpc.sh 00:08:32.585 11:19:28 -- common/autotest_common.sh@1101 -- # '[' 2 -le 1 ']' 00:08:32.585 11:19:28 -- common/autotest_common.sh@1107 -- # xtrace_disable 00:08:32.585 11:19:28 -- common/autotest_common.sh@10 -- # set +x 00:08:32.585 ************************************ 00:08:32.585 START TEST rpc 00:08:32.585 ************************************ 00:08:32.585 11:19:28 rpc -- common/autotest_common.sh@1125 -- # /home/vagrant/spdk_repo/spdk/test/rpc/rpc.sh 00:08:32.843 * Looking for test storage... 00:08:32.843 * Found test storage at /home/vagrant/spdk_repo/spdk/test/rpc 00:08:32.843 11:19:28 rpc -- common/autotest_common.sh@1680 -- # [[ y == y ]] 00:08:32.843 11:19:28 rpc -- common/autotest_common.sh@1681 -- # awk '{print $NF}' 00:08:32.843 11:19:28 rpc -- common/autotest_common.sh@1681 -- # lcov --version 00:08:32.843 11:19:28 rpc -- common/autotest_common.sh@1681 -- # lt 1.15 2 00:08:32.843 11:19:28 rpc -- scripts/common.sh@373 -- # cmp_versions 1.15 '<' 2 00:08:32.843 11:19:28 rpc -- scripts/common.sh@333 -- # local ver1 ver1_l 00:08:32.843 11:19:28 rpc -- scripts/common.sh@334 -- # local ver2 ver2_l 00:08:32.843 11:19:28 rpc -- scripts/common.sh@336 -- # IFS=.-: 00:08:32.843 11:19:28 rpc -- scripts/common.sh@336 -- # read -ra ver1 00:08:32.843 11:19:28 rpc -- scripts/common.sh@337 -- # IFS=.-: 00:08:32.843 11:19:28 rpc -- scripts/common.sh@337 -- # read -ra ver2 00:08:32.843 11:19:28 rpc -- scripts/common.sh@338 -- # local 'op=<' 00:08:32.843 11:19:28 rpc -- scripts/common.sh@340 -- # ver1_l=2 00:08:32.843 11:19:28 rpc -- scripts/common.sh@341 -- # ver2_l=1 00:08:32.843 11:19:28 rpc -- scripts/common.sh@343 -- # local lt=0 gt=0 eq=0 v 00:08:32.843 11:19:28 rpc -- scripts/common.sh@344 -- # case "$op" in 00:08:32.843 11:19:28 rpc -- scripts/common.sh@345 -- # : 1 00:08:32.843 11:19:28 rpc -- scripts/common.sh@364 -- # (( v = 0 )) 00:08:32.843 11:19:28 rpc -- scripts/common.sh@364 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:08:32.843 11:19:28 rpc -- scripts/common.sh@365 -- # decimal 1 00:08:32.843 11:19:28 rpc -- scripts/common.sh@353 -- # local d=1 00:08:32.843 11:19:28 rpc -- scripts/common.sh@354 -- # [[ 1 =~ ^[0-9]+$ ]] 00:08:32.843 11:19:28 rpc -- scripts/common.sh@355 -- # echo 1 00:08:32.843 11:19:28 rpc -- scripts/common.sh@365 -- # ver1[v]=1 00:08:32.843 11:19:28 rpc -- scripts/common.sh@366 -- # decimal 2 00:08:32.843 11:19:28 rpc -- scripts/common.sh@353 -- # local d=2 00:08:32.843 11:19:28 rpc -- scripts/common.sh@354 -- # [[ 2 =~ ^[0-9]+$ ]] 00:08:32.843 11:19:28 rpc -- scripts/common.sh@355 -- # echo 2 00:08:32.843 11:19:28 rpc -- scripts/common.sh@366 -- # ver2[v]=2 00:08:32.843 11:19:28 rpc -- scripts/common.sh@367 -- # (( ver1[v] > ver2[v] )) 00:08:32.843 11:19:28 rpc -- scripts/common.sh@368 -- # (( ver1[v] < ver2[v] )) 00:08:32.843 11:19:28 rpc -- scripts/common.sh@368 -- # return 0 00:08:32.843 11:19:28 rpc -- common/autotest_common.sh@1682 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:08:32.843 11:19:28 rpc -- common/autotest_common.sh@1694 -- # export 'LCOV_OPTS= 00:08:32.843 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:08:32.843 --rc genhtml_branch_coverage=1 00:08:32.843 --rc genhtml_function_coverage=1 00:08:32.843 --rc genhtml_legend=1 00:08:32.843 --rc geninfo_all_blocks=1 00:08:32.843 --rc geninfo_unexecuted_blocks=1 00:08:32.843 00:08:32.843 ' 00:08:32.843 11:19:28 rpc -- common/autotest_common.sh@1694 -- # LCOV_OPTS=' 00:08:32.843 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:08:32.843 --rc genhtml_branch_coverage=1 00:08:32.843 --rc genhtml_function_coverage=1 00:08:32.843 --rc genhtml_legend=1 00:08:32.843 --rc geninfo_all_blocks=1 00:08:32.843 --rc geninfo_unexecuted_blocks=1 00:08:32.843 00:08:32.843 ' 00:08:32.843 11:19:28 rpc -- common/autotest_common.sh@1695 -- # export 'LCOV=lcov 00:08:32.843 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:08:32.843 --rc genhtml_branch_coverage=1 00:08:32.843 --rc genhtml_function_coverage=1 00:08:32.843 --rc genhtml_legend=1 00:08:32.843 --rc geninfo_all_blocks=1 00:08:32.843 --rc geninfo_unexecuted_blocks=1 00:08:32.843 00:08:32.843 ' 00:08:32.843 11:19:28 rpc -- common/autotest_common.sh@1695 -- # LCOV='lcov 00:08:32.843 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:08:32.843 --rc genhtml_branch_coverage=1 00:08:32.843 --rc genhtml_function_coverage=1 00:08:32.843 --rc genhtml_legend=1 00:08:32.843 --rc geninfo_all_blocks=1 00:08:32.843 --rc geninfo_unexecuted_blocks=1 00:08:32.843 00:08:32.843 ' 00:08:32.843 11:19:28 rpc -- rpc/rpc.sh@65 -- # spdk_pid=58619 00:08:32.843 11:19:28 rpc -- rpc/rpc.sh@66 -- # trap 'killprocess $spdk_pid; exit 1' SIGINT SIGTERM EXIT 00:08:32.843 11:19:28 rpc -- rpc/rpc.sh@64 -- # /home/vagrant/spdk_repo/spdk/build/bin/spdk_tgt -e bdev 00:08:32.843 11:19:28 rpc -- rpc/rpc.sh@67 -- # waitforlisten 58619 00:08:32.843 11:19:28 rpc -- common/autotest_common.sh@831 -- # '[' -z 58619 ']' 00:08:32.843 11:19:28 rpc -- common/autotest_common.sh@835 -- # local rpc_addr=/var/tmp/spdk.sock 00:08:32.843 11:19:28 rpc -- common/autotest_common.sh@836 -- # local max_retries=100 00:08:32.843 11:19:28 rpc -- common/autotest_common.sh@838 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:08:32.843 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:08:32.843 11:19:28 rpc -- common/autotest_common.sh@840 -- # xtrace_disable 00:08:32.843 11:19:28 rpc -- common/autotest_common.sh@10 -- # set +x 00:08:32.843 [2024-10-07 11:19:28.318112] Starting SPDK v25.01-pre git sha1 2a4f56c54 / DPDK 24.03.0 initialization... 00:08:32.843 [2024-10-07 11:19:28.318450] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --iova-mode=pa --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid58619 ] 00:08:33.101 [2024-10-07 11:19:28.463465] app.c: 917:spdk_app_start: *NOTICE*: Total cores available: 1 00:08:33.101 [2024-10-07 11:19:28.588662] app.c: 610:app_setup_trace: *NOTICE*: Tracepoint Group Mask bdev specified. 00:08:33.101 [2024-10-07 11:19:28.588995] app.c: 611:app_setup_trace: *NOTICE*: Use 'spdk_trace -s spdk_tgt -p 58619' to capture a snapshot of events at runtime. 00:08:33.101 [2024-10-07 11:19:28.589169] app.c: 616:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:08:33.101 [2024-10-07 11:19:28.589315] app.c: 617:app_setup_trace: *NOTICE*: SPDK application currently running. 00:08:33.101 [2024-10-07 11:19:28.589365] app.c: 618:app_setup_trace: *NOTICE*: Or copy /dev/shm/spdk_tgt_trace.pid58619 for offline analysis/debug. 00:08:33.101 [2024-10-07 11:19:28.590013] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 0 00:08:33.385 11:19:28 rpc -- common/autotest_common.sh@860 -- # (( i == 0 )) 00:08:33.385 11:19:28 rpc -- common/autotest_common.sh@864 -- # return 0 00:08:33.385 11:19:28 rpc -- rpc/rpc.sh@69 -- # export PYTHONPATH=:/home/vagrant/spdk_repo/spdk/python:/home/vagrant/spdk_repo/spdk/test/rpc_plugins:/home/vagrant/spdk_repo/spdk/python:/home/vagrant/spdk_repo/spdk/test/rpc_plugins:/home/vagrant/spdk_repo/spdk/test/rpc 00:08:33.385 11:19:28 rpc -- rpc/rpc.sh@69 -- # PYTHONPATH=:/home/vagrant/spdk_repo/spdk/python:/home/vagrant/spdk_repo/spdk/test/rpc_plugins:/home/vagrant/spdk_repo/spdk/python:/home/vagrant/spdk_repo/spdk/test/rpc_plugins:/home/vagrant/spdk_repo/spdk/test/rpc 00:08:33.385 11:19:28 rpc -- rpc/rpc.sh@72 -- # rpc=rpc_cmd 00:08:33.385 11:19:28 rpc -- rpc/rpc.sh@73 -- # run_test rpc_integrity rpc_integrity 00:08:33.385 11:19:28 rpc -- common/autotest_common.sh@1101 -- # '[' 2 -le 1 ']' 00:08:33.385 11:19:28 rpc -- common/autotest_common.sh@1107 -- # xtrace_disable 00:08:33.385 11:19:28 rpc -- common/autotest_common.sh@10 -- # set +x 00:08:33.385 ************************************ 00:08:33.385 START TEST rpc_integrity 00:08:33.385 ************************************ 00:08:33.385 11:19:28 rpc.rpc_integrity -- common/autotest_common.sh@1125 -- # rpc_integrity 00:08:33.385 11:19:28 rpc.rpc_integrity -- rpc/rpc.sh@12 -- # rpc_cmd bdev_get_bdevs 00:08:33.385 11:19:28 rpc.rpc_integrity -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:33.385 11:19:28 rpc.rpc_integrity -- common/autotest_common.sh@10 -- # set +x 00:08:33.385 11:19:28 rpc.rpc_integrity -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:33.385 11:19:28 rpc.rpc_integrity -- rpc/rpc.sh@12 -- # bdevs='[]' 00:08:33.385 11:19:28 rpc.rpc_integrity -- rpc/rpc.sh@13 -- # jq length 00:08:33.643 11:19:28 rpc.rpc_integrity -- rpc/rpc.sh@13 -- # '[' 0 == 0 ']' 00:08:33.643 11:19:28 rpc.rpc_integrity -- rpc/rpc.sh@15 -- # rpc_cmd bdev_malloc_create 8 512 00:08:33.643 11:19:28 rpc.rpc_integrity -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:33.643 11:19:28 rpc.rpc_integrity -- common/autotest_common.sh@10 -- # set +x 00:08:33.643 11:19:28 rpc.rpc_integrity -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:33.643 11:19:28 rpc.rpc_integrity -- rpc/rpc.sh@15 -- # malloc=Malloc0 00:08:33.643 11:19:28 rpc.rpc_integrity -- rpc/rpc.sh@16 -- # rpc_cmd bdev_get_bdevs 00:08:33.643 11:19:28 rpc.rpc_integrity -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:33.643 11:19:28 rpc.rpc_integrity -- common/autotest_common.sh@10 -- # set +x 00:08:33.643 11:19:29 rpc.rpc_integrity -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:33.643 11:19:29 rpc.rpc_integrity -- rpc/rpc.sh@16 -- # bdevs='[ 00:08:33.643 { 00:08:33.643 "aliases": [ 00:08:33.643 "f06ccc3d-3cbd-4aed-b89f-98759b664eab" 00:08:33.643 ], 00:08:33.643 "assigned_rate_limits": { 00:08:33.643 "r_mbytes_per_sec": 0, 00:08:33.643 "rw_ios_per_sec": 0, 00:08:33.643 "rw_mbytes_per_sec": 0, 00:08:33.643 "w_mbytes_per_sec": 0 00:08:33.643 }, 00:08:33.643 "block_size": 512, 00:08:33.643 "claimed": false, 00:08:33.643 "driver_specific": {}, 00:08:33.643 "memory_domains": [ 00:08:33.643 { 00:08:33.643 "dma_device_id": "system", 00:08:33.643 "dma_device_type": 1 00:08:33.643 }, 00:08:33.643 { 00:08:33.643 "dma_device_id": "SPDK_ACCEL_DMA_DEVICE", 00:08:33.643 "dma_device_type": 2 00:08:33.643 } 00:08:33.643 ], 00:08:33.643 "name": "Malloc0", 00:08:33.643 "num_blocks": 16384, 00:08:33.643 "product_name": "Malloc disk", 00:08:33.643 "supported_io_types": { 00:08:33.643 "abort": true, 00:08:33.643 "compare": false, 00:08:33.643 "compare_and_write": false, 00:08:33.643 "copy": true, 00:08:33.643 "flush": true, 00:08:33.643 "get_zone_info": false, 00:08:33.643 "nvme_admin": false, 00:08:33.643 "nvme_io": false, 00:08:33.643 "nvme_io_md": false, 00:08:33.643 "nvme_iov_md": false, 00:08:33.643 "read": true, 00:08:33.643 "reset": true, 00:08:33.643 "seek_data": false, 00:08:33.643 "seek_hole": false, 00:08:33.643 "unmap": true, 00:08:33.643 "write": true, 00:08:33.643 "write_zeroes": true, 00:08:33.643 "zcopy": true, 00:08:33.643 "zone_append": false, 00:08:33.643 "zone_management": false 00:08:33.643 }, 00:08:33.643 "uuid": "f06ccc3d-3cbd-4aed-b89f-98759b664eab", 00:08:33.643 "zoned": false 00:08:33.643 } 00:08:33.643 ]' 00:08:33.643 11:19:29 rpc.rpc_integrity -- rpc/rpc.sh@17 -- # jq length 00:08:33.643 11:19:29 rpc.rpc_integrity -- rpc/rpc.sh@17 -- # '[' 1 == 1 ']' 00:08:33.643 11:19:29 rpc.rpc_integrity -- rpc/rpc.sh@19 -- # rpc_cmd bdev_passthru_create -b Malloc0 -p Passthru0 00:08:33.643 11:19:29 rpc.rpc_integrity -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:33.643 11:19:29 rpc.rpc_integrity -- common/autotest_common.sh@10 -- # set +x 00:08:33.643 [2024-10-07 11:19:29.068463] vbdev_passthru.c: 607:vbdev_passthru_register: *NOTICE*: Match on Malloc0 00:08:33.643 [2024-10-07 11:19:29.068526] vbdev_passthru.c: 635:vbdev_passthru_register: *NOTICE*: base bdev opened 00:08:33.643 [2024-10-07 11:19:29.068557] vbdev_passthru.c: 681:vbdev_passthru_register: *NOTICE*: io_device created at: 0x0x19e3ca0 00:08:33.643 [2024-10-07 11:19:29.068566] vbdev_passthru.c: 696:vbdev_passthru_register: *NOTICE*: bdev claimed 00:08:33.643 [2024-10-07 11:19:29.070390] vbdev_passthru.c: 709:vbdev_passthru_register: *NOTICE*: pt_bdev registered 00:08:33.643 [2024-10-07 11:19:29.070429] vbdev_passthru.c: 710:vbdev_passthru_register: *NOTICE*: created pt_bdev for: Passthru0 00:08:33.643 Passthru0 00:08:33.643 11:19:29 rpc.rpc_integrity -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:33.643 11:19:29 rpc.rpc_integrity -- rpc/rpc.sh@20 -- # rpc_cmd bdev_get_bdevs 00:08:33.643 11:19:29 rpc.rpc_integrity -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:33.643 11:19:29 rpc.rpc_integrity -- common/autotest_common.sh@10 -- # set +x 00:08:33.643 11:19:29 rpc.rpc_integrity -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:33.643 11:19:29 rpc.rpc_integrity -- rpc/rpc.sh@20 -- # bdevs='[ 00:08:33.643 { 00:08:33.643 "aliases": [ 00:08:33.643 "f06ccc3d-3cbd-4aed-b89f-98759b664eab" 00:08:33.643 ], 00:08:33.643 "assigned_rate_limits": { 00:08:33.643 "r_mbytes_per_sec": 0, 00:08:33.643 "rw_ios_per_sec": 0, 00:08:33.643 "rw_mbytes_per_sec": 0, 00:08:33.643 "w_mbytes_per_sec": 0 00:08:33.643 }, 00:08:33.643 "block_size": 512, 00:08:33.643 "claim_type": "exclusive_write", 00:08:33.643 "claimed": true, 00:08:33.643 "driver_specific": {}, 00:08:33.643 "memory_domains": [ 00:08:33.643 { 00:08:33.643 "dma_device_id": "system", 00:08:33.643 "dma_device_type": 1 00:08:33.643 }, 00:08:33.643 { 00:08:33.643 "dma_device_id": "SPDK_ACCEL_DMA_DEVICE", 00:08:33.643 "dma_device_type": 2 00:08:33.643 } 00:08:33.643 ], 00:08:33.643 "name": "Malloc0", 00:08:33.643 "num_blocks": 16384, 00:08:33.643 "product_name": "Malloc disk", 00:08:33.643 "supported_io_types": { 00:08:33.643 "abort": true, 00:08:33.643 "compare": false, 00:08:33.643 "compare_and_write": false, 00:08:33.643 "copy": true, 00:08:33.643 "flush": true, 00:08:33.643 "get_zone_info": false, 00:08:33.643 "nvme_admin": false, 00:08:33.643 "nvme_io": false, 00:08:33.643 "nvme_io_md": false, 00:08:33.643 "nvme_iov_md": false, 00:08:33.643 "read": true, 00:08:33.643 "reset": true, 00:08:33.643 "seek_data": false, 00:08:33.643 "seek_hole": false, 00:08:33.644 "unmap": true, 00:08:33.644 "write": true, 00:08:33.644 "write_zeroes": true, 00:08:33.644 "zcopy": true, 00:08:33.644 "zone_append": false, 00:08:33.644 "zone_management": false 00:08:33.644 }, 00:08:33.644 "uuid": "f06ccc3d-3cbd-4aed-b89f-98759b664eab", 00:08:33.644 "zoned": false 00:08:33.644 }, 00:08:33.644 { 00:08:33.644 "aliases": [ 00:08:33.644 "91c40c63-42a7-50b6-bfc5-c7ccc91197c6" 00:08:33.644 ], 00:08:33.644 "assigned_rate_limits": { 00:08:33.644 "r_mbytes_per_sec": 0, 00:08:33.644 "rw_ios_per_sec": 0, 00:08:33.644 "rw_mbytes_per_sec": 0, 00:08:33.644 "w_mbytes_per_sec": 0 00:08:33.644 }, 00:08:33.644 "block_size": 512, 00:08:33.644 "claimed": false, 00:08:33.644 "driver_specific": { 00:08:33.644 "passthru": { 00:08:33.644 "base_bdev_name": "Malloc0", 00:08:33.644 "name": "Passthru0" 00:08:33.644 } 00:08:33.644 }, 00:08:33.644 "memory_domains": [ 00:08:33.644 { 00:08:33.644 "dma_device_id": "system", 00:08:33.644 "dma_device_type": 1 00:08:33.644 }, 00:08:33.644 { 00:08:33.644 "dma_device_id": "SPDK_ACCEL_DMA_DEVICE", 00:08:33.644 "dma_device_type": 2 00:08:33.644 } 00:08:33.644 ], 00:08:33.644 "name": "Passthru0", 00:08:33.644 "num_blocks": 16384, 00:08:33.644 "product_name": "passthru", 00:08:33.644 "supported_io_types": { 00:08:33.644 "abort": true, 00:08:33.644 "compare": false, 00:08:33.644 "compare_and_write": false, 00:08:33.644 "copy": true, 00:08:33.644 "flush": true, 00:08:33.644 "get_zone_info": false, 00:08:33.644 "nvme_admin": false, 00:08:33.644 "nvme_io": false, 00:08:33.644 "nvme_io_md": false, 00:08:33.644 "nvme_iov_md": false, 00:08:33.644 "read": true, 00:08:33.644 "reset": true, 00:08:33.644 "seek_data": false, 00:08:33.644 "seek_hole": false, 00:08:33.644 "unmap": true, 00:08:33.644 "write": true, 00:08:33.644 "write_zeroes": true, 00:08:33.644 "zcopy": true, 00:08:33.644 "zone_append": false, 00:08:33.644 "zone_management": false 00:08:33.644 }, 00:08:33.644 "uuid": "91c40c63-42a7-50b6-bfc5-c7ccc91197c6", 00:08:33.644 "zoned": false 00:08:33.644 } 00:08:33.644 ]' 00:08:33.644 11:19:29 rpc.rpc_integrity -- rpc/rpc.sh@21 -- # jq length 00:08:33.902 11:19:29 rpc.rpc_integrity -- rpc/rpc.sh@21 -- # '[' 2 == 2 ']' 00:08:33.902 11:19:29 rpc.rpc_integrity -- rpc/rpc.sh@23 -- # rpc_cmd bdev_passthru_delete Passthru0 00:08:33.902 11:19:29 rpc.rpc_integrity -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:33.902 11:19:29 rpc.rpc_integrity -- common/autotest_common.sh@10 -- # set +x 00:08:33.902 11:19:29 rpc.rpc_integrity -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:33.902 11:19:29 rpc.rpc_integrity -- rpc/rpc.sh@24 -- # rpc_cmd bdev_malloc_delete Malloc0 00:08:33.902 11:19:29 rpc.rpc_integrity -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:33.902 11:19:29 rpc.rpc_integrity -- common/autotest_common.sh@10 -- # set +x 00:08:33.902 11:19:29 rpc.rpc_integrity -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:33.902 11:19:29 rpc.rpc_integrity -- rpc/rpc.sh@25 -- # rpc_cmd bdev_get_bdevs 00:08:33.902 11:19:29 rpc.rpc_integrity -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:33.902 11:19:29 rpc.rpc_integrity -- common/autotest_common.sh@10 -- # set +x 00:08:33.902 11:19:29 rpc.rpc_integrity -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:33.902 11:19:29 rpc.rpc_integrity -- rpc/rpc.sh@25 -- # bdevs='[]' 00:08:33.902 11:19:29 rpc.rpc_integrity -- rpc/rpc.sh@26 -- # jq length 00:08:33.902 ************************************ 00:08:33.902 END TEST rpc_integrity 00:08:33.902 ************************************ 00:08:33.902 11:19:29 rpc.rpc_integrity -- rpc/rpc.sh@26 -- # '[' 0 == 0 ']' 00:08:33.902 00:08:33.902 real 0m0.371s 00:08:33.902 user 0m0.250s 00:08:33.902 sys 0m0.043s 00:08:33.902 11:19:29 rpc.rpc_integrity -- common/autotest_common.sh@1126 -- # xtrace_disable 00:08:33.902 11:19:29 rpc.rpc_integrity -- common/autotest_common.sh@10 -- # set +x 00:08:33.902 11:19:29 rpc -- rpc/rpc.sh@74 -- # run_test rpc_plugins rpc_plugins 00:08:33.902 11:19:29 rpc -- common/autotest_common.sh@1101 -- # '[' 2 -le 1 ']' 00:08:33.902 11:19:29 rpc -- common/autotest_common.sh@1107 -- # xtrace_disable 00:08:33.902 11:19:29 rpc -- common/autotest_common.sh@10 -- # set +x 00:08:33.902 ************************************ 00:08:33.902 START TEST rpc_plugins 00:08:33.902 ************************************ 00:08:33.902 11:19:29 rpc.rpc_plugins -- common/autotest_common.sh@1125 -- # rpc_plugins 00:08:33.902 11:19:29 rpc.rpc_plugins -- rpc/rpc.sh@30 -- # rpc_cmd --plugin rpc_plugin create_malloc 00:08:33.902 11:19:29 rpc.rpc_plugins -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:33.902 11:19:29 rpc.rpc_plugins -- common/autotest_common.sh@10 -- # set +x 00:08:33.902 11:19:29 rpc.rpc_plugins -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:33.902 11:19:29 rpc.rpc_plugins -- rpc/rpc.sh@30 -- # malloc=Malloc1 00:08:33.902 11:19:29 rpc.rpc_plugins -- rpc/rpc.sh@31 -- # rpc_cmd bdev_get_bdevs 00:08:33.902 11:19:29 rpc.rpc_plugins -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:33.902 11:19:29 rpc.rpc_plugins -- common/autotest_common.sh@10 -- # set +x 00:08:33.902 11:19:29 rpc.rpc_plugins -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:33.902 11:19:29 rpc.rpc_plugins -- rpc/rpc.sh@31 -- # bdevs='[ 00:08:33.902 { 00:08:33.902 "aliases": [ 00:08:33.902 "5a7e1ced-dec4-4124-8fc7-de014b46e99c" 00:08:33.902 ], 00:08:33.902 "assigned_rate_limits": { 00:08:33.902 "r_mbytes_per_sec": 0, 00:08:33.902 "rw_ios_per_sec": 0, 00:08:33.902 "rw_mbytes_per_sec": 0, 00:08:33.902 "w_mbytes_per_sec": 0 00:08:33.902 }, 00:08:33.902 "block_size": 4096, 00:08:33.902 "claimed": false, 00:08:33.902 "driver_specific": {}, 00:08:33.902 "memory_domains": [ 00:08:33.902 { 00:08:33.902 "dma_device_id": "system", 00:08:33.902 "dma_device_type": 1 00:08:33.902 }, 00:08:33.902 { 00:08:33.902 "dma_device_id": "SPDK_ACCEL_DMA_DEVICE", 00:08:33.902 "dma_device_type": 2 00:08:33.902 } 00:08:33.902 ], 00:08:33.902 "name": "Malloc1", 00:08:33.902 "num_blocks": 256, 00:08:33.902 "product_name": "Malloc disk", 00:08:33.902 "supported_io_types": { 00:08:33.902 "abort": true, 00:08:33.902 "compare": false, 00:08:33.902 "compare_and_write": false, 00:08:33.902 "copy": true, 00:08:33.902 "flush": true, 00:08:33.902 "get_zone_info": false, 00:08:33.902 "nvme_admin": false, 00:08:33.902 "nvme_io": false, 00:08:33.902 "nvme_io_md": false, 00:08:33.902 "nvme_iov_md": false, 00:08:33.902 "read": true, 00:08:33.902 "reset": true, 00:08:33.902 "seek_data": false, 00:08:33.902 "seek_hole": false, 00:08:33.902 "unmap": true, 00:08:33.902 "write": true, 00:08:33.902 "write_zeroes": true, 00:08:33.902 "zcopy": true, 00:08:33.902 "zone_append": false, 00:08:33.902 "zone_management": false 00:08:33.902 }, 00:08:33.902 "uuid": "5a7e1ced-dec4-4124-8fc7-de014b46e99c", 00:08:33.902 "zoned": false 00:08:33.902 } 00:08:33.902 ]' 00:08:33.902 11:19:29 rpc.rpc_plugins -- rpc/rpc.sh@32 -- # jq length 00:08:33.902 11:19:29 rpc.rpc_plugins -- rpc/rpc.sh@32 -- # '[' 1 == 1 ']' 00:08:33.902 11:19:29 rpc.rpc_plugins -- rpc/rpc.sh@34 -- # rpc_cmd --plugin rpc_plugin delete_malloc Malloc1 00:08:33.902 11:19:29 rpc.rpc_plugins -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:33.902 11:19:29 rpc.rpc_plugins -- common/autotest_common.sh@10 -- # set +x 00:08:33.902 11:19:29 rpc.rpc_plugins -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:33.902 11:19:29 rpc.rpc_plugins -- rpc/rpc.sh@35 -- # rpc_cmd bdev_get_bdevs 00:08:33.902 11:19:29 rpc.rpc_plugins -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:33.902 11:19:29 rpc.rpc_plugins -- common/autotest_common.sh@10 -- # set +x 00:08:33.902 11:19:29 rpc.rpc_plugins -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:33.902 11:19:29 rpc.rpc_plugins -- rpc/rpc.sh@35 -- # bdevs='[]' 00:08:33.902 11:19:29 rpc.rpc_plugins -- rpc/rpc.sh@36 -- # jq length 00:08:34.161 ************************************ 00:08:34.161 END TEST rpc_plugins 00:08:34.161 ************************************ 00:08:34.161 11:19:29 rpc.rpc_plugins -- rpc/rpc.sh@36 -- # '[' 0 == 0 ']' 00:08:34.161 00:08:34.161 real 0m0.157s 00:08:34.161 user 0m0.106s 00:08:34.161 sys 0m0.012s 00:08:34.161 11:19:29 rpc.rpc_plugins -- common/autotest_common.sh@1126 -- # xtrace_disable 00:08:34.161 11:19:29 rpc.rpc_plugins -- common/autotest_common.sh@10 -- # set +x 00:08:34.161 11:19:29 rpc -- rpc/rpc.sh@75 -- # run_test rpc_trace_cmd_test rpc_trace_cmd_test 00:08:34.161 11:19:29 rpc -- common/autotest_common.sh@1101 -- # '[' 2 -le 1 ']' 00:08:34.161 11:19:29 rpc -- common/autotest_common.sh@1107 -- # xtrace_disable 00:08:34.161 11:19:29 rpc -- common/autotest_common.sh@10 -- # set +x 00:08:34.161 ************************************ 00:08:34.161 START TEST rpc_trace_cmd_test 00:08:34.161 ************************************ 00:08:34.161 11:19:29 rpc.rpc_trace_cmd_test -- common/autotest_common.sh@1125 -- # rpc_trace_cmd_test 00:08:34.161 11:19:29 rpc.rpc_trace_cmd_test -- rpc/rpc.sh@40 -- # local info 00:08:34.161 11:19:29 rpc.rpc_trace_cmd_test -- rpc/rpc.sh@42 -- # rpc_cmd trace_get_info 00:08:34.161 11:19:29 rpc.rpc_trace_cmd_test -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:34.161 11:19:29 rpc.rpc_trace_cmd_test -- common/autotest_common.sh@10 -- # set +x 00:08:34.161 11:19:29 rpc.rpc_trace_cmd_test -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:34.161 11:19:29 rpc.rpc_trace_cmd_test -- rpc/rpc.sh@42 -- # info='{ 00:08:34.161 "bdev": { 00:08:34.161 "mask": "0x8", 00:08:34.161 "tpoint_mask": "0xffffffffffffffff" 00:08:34.161 }, 00:08:34.161 "bdev_nvme": { 00:08:34.161 "mask": "0x4000", 00:08:34.161 "tpoint_mask": "0x0" 00:08:34.161 }, 00:08:34.161 "bdev_raid": { 00:08:34.161 "mask": "0x20000", 00:08:34.161 "tpoint_mask": "0x0" 00:08:34.161 }, 00:08:34.161 "blob": { 00:08:34.161 "mask": "0x10000", 00:08:34.161 "tpoint_mask": "0x0" 00:08:34.161 }, 00:08:34.161 "blobfs": { 00:08:34.161 "mask": "0x80", 00:08:34.161 "tpoint_mask": "0x0" 00:08:34.161 }, 00:08:34.161 "dsa": { 00:08:34.161 "mask": "0x200", 00:08:34.161 "tpoint_mask": "0x0" 00:08:34.161 }, 00:08:34.161 "ftl": { 00:08:34.161 "mask": "0x40", 00:08:34.161 "tpoint_mask": "0x0" 00:08:34.161 }, 00:08:34.161 "iaa": { 00:08:34.161 "mask": "0x1000", 00:08:34.161 "tpoint_mask": "0x0" 00:08:34.161 }, 00:08:34.161 "iscsi_conn": { 00:08:34.161 "mask": "0x2", 00:08:34.161 "tpoint_mask": "0x0" 00:08:34.161 }, 00:08:34.161 "nvme_pcie": { 00:08:34.161 "mask": "0x800", 00:08:34.161 "tpoint_mask": "0x0" 00:08:34.161 }, 00:08:34.161 "nvme_tcp": { 00:08:34.161 "mask": "0x2000", 00:08:34.161 "tpoint_mask": "0x0" 00:08:34.161 }, 00:08:34.161 "nvmf_rdma": { 00:08:34.161 "mask": "0x10", 00:08:34.161 "tpoint_mask": "0x0" 00:08:34.161 }, 00:08:34.161 "nvmf_tcp": { 00:08:34.161 "mask": "0x20", 00:08:34.161 "tpoint_mask": "0x0" 00:08:34.161 }, 00:08:34.161 "scheduler": { 00:08:34.161 "mask": "0x40000", 00:08:34.161 "tpoint_mask": "0x0" 00:08:34.161 }, 00:08:34.161 "scsi": { 00:08:34.161 "mask": "0x4", 00:08:34.161 "tpoint_mask": "0x0" 00:08:34.161 }, 00:08:34.161 "sock": { 00:08:34.161 "mask": "0x8000", 00:08:34.161 "tpoint_mask": "0x0" 00:08:34.161 }, 00:08:34.161 "thread": { 00:08:34.161 "mask": "0x400", 00:08:34.161 "tpoint_mask": "0x0" 00:08:34.161 }, 00:08:34.161 "tpoint_group_mask": "0x8", 00:08:34.161 "tpoint_shm_path": "/dev/shm/spdk_tgt_trace.pid58619" 00:08:34.161 }' 00:08:34.161 11:19:29 rpc.rpc_trace_cmd_test -- rpc/rpc.sh@43 -- # jq length 00:08:34.161 11:19:29 rpc.rpc_trace_cmd_test -- rpc/rpc.sh@43 -- # '[' 19 -gt 2 ']' 00:08:34.161 11:19:29 rpc.rpc_trace_cmd_test -- rpc/rpc.sh@44 -- # jq 'has("tpoint_group_mask")' 00:08:34.161 11:19:29 rpc.rpc_trace_cmd_test -- rpc/rpc.sh@44 -- # '[' true = true ']' 00:08:34.161 11:19:29 rpc.rpc_trace_cmd_test -- rpc/rpc.sh@45 -- # jq 'has("tpoint_shm_path")' 00:08:34.420 11:19:29 rpc.rpc_trace_cmd_test -- rpc/rpc.sh@45 -- # '[' true = true ']' 00:08:34.420 11:19:29 rpc.rpc_trace_cmd_test -- rpc/rpc.sh@46 -- # jq 'has("bdev")' 00:08:34.420 11:19:29 rpc.rpc_trace_cmd_test -- rpc/rpc.sh@46 -- # '[' true = true ']' 00:08:34.420 11:19:29 rpc.rpc_trace_cmd_test -- rpc/rpc.sh@47 -- # jq -r .bdev.tpoint_mask 00:08:34.420 ************************************ 00:08:34.420 END TEST rpc_trace_cmd_test 00:08:34.420 ************************************ 00:08:34.420 11:19:29 rpc.rpc_trace_cmd_test -- rpc/rpc.sh@47 -- # '[' 0xffffffffffffffff '!=' 0x0 ']' 00:08:34.420 00:08:34.420 real 0m0.289s 00:08:34.420 user 0m0.233s 00:08:34.420 sys 0m0.041s 00:08:34.420 11:19:29 rpc.rpc_trace_cmd_test -- common/autotest_common.sh@1126 -- # xtrace_disable 00:08:34.420 11:19:29 rpc.rpc_trace_cmd_test -- common/autotest_common.sh@10 -- # set +x 00:08:34.420 11:19:29 rpc -- rpc/rpc.sh@76 -- # [[ 1 -eq 1 ]] 00:08:34.420 11:19:29 rpc -- rpc/rpc.sh@77 -- # run_test go_rpc go_rpc 00:08:34.420 11:19:29 rpc -- common/autotest_common.sh@1101 -- # '[' 2 -le 1 ']' 00:08:34.420 11:19:29 rpc -- common/autotest_common.sh@1107 -- # xtrace_disable 00:08:34.420 11:19:29 rpc -- common/autotest_common.sh@10 -- # set +x 00:08:34.420 ************************************ 00:08:34.420 START TEST go_rpc 00:08:34.420 ************************************ 00:08:34.420 11:19:29 rpc.go_rpc -- common/autotest_common.sh@1125 -- # go_rpc 00:08:34.420 11:19:29 rpc.go_rpc -- rpc/rpc.sh@51 -- # /home/vagrant/spdk_repo/spdk/build/examples/hello_gorpc 00:08:34.420 11:19:29 rpc.go_rpc -- rpc/rpc.sh@51 -- # bdevs='[]' 00:08:34.420 11:19:29 rpc.go_rpc -- rpc/rpc.sh@52 -- # jq length 00:08:34.420 11:19:29 rpc.go_rpc -- rpc/rpc.sh@52 -- # '[' 0 == 0 ']' 00:08:34.420 11:19:29 rpc.go_rpc -- rpc/rpc.sh@54 -- # rpc_cmd bdev_malloc_create 8 512 00:08:34.420 11:19:29 rpc.go_rpc -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:34.420 11:19:29 rpc.go_rpc -- common/autotest_common.sh@10 -- # set +x 00:08:34.420 11:19:29 rpc.go_rpc -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:34.420 11:19:29 rpc.go_rpc -- rpc/rpc.sh@54 -- # malloc=Malloc2 00:08:34.420 11:19:29 rpc.go_rpc -- rpc/rpc.sh@56 -- # /home/vagrant/spdk_repo/spdk/build/examples/hello_gorpc 00:08:34.678 11:19:29 rpc.go_rpc -- rpc/rpc.sh@56 -- # bdevs='[{"aliases":["1423be1a-b709-4cf2-a41b-4645051c5f25"],"assigned_rate_limits":{"r_mbytes_per_sec":0,"rw_ios_per_sec":0,"rw_mbytes_per_sec":0,"w_mbytes_per_sec":0},"block_size":512,"claimed":false,"driver_specific":{},"memory_domains":[{"dma_device_id":"system","dma_device_type":1},{"dma_device_id":"SPDK_ACCEL_DMA_DEVICE","dma_device_type":2}],"name":"Malloc2","num_blocks":16384,"product_name":"Malloc disk","supported_io_types":{"abort":true,"compare":false,"compare_and_write":false,"copy":true,"flush":true,"get_zone_info":false,"nvme_admin":false,"nvme_io":false,"nvme_io_md":false,"nvme_iov_md":false,"read":true,"reset":true,"seek_data":false,"seek_hole":false,"unmap":true,"write":true,"write_zeroes":true,"zcopy":true,"zone_append":false,"zone_management":false},"uuid":"1423be1a-b709-4cf2-a41b-4645051c5f25","zoned":false}]' 00:08:34.678 11:19:29 rpc.go_rpc -- rpc/rpc.sh@57 -- # jq length 00:08:34.678 11:19:30 rpc.go_rpc -- rpc/rpc.sh@57 -- # '[' 1 == 1 ']' 00:08:34.678 11:19:30 rpc.go_rpc -- rpc/rpc.sh@59 -- # rpc_cmd bdev_malloc_delete Malloc2 00:08:34.678 11:19:30 rpc.go_rpc -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:34.678 11:19:30 rpc.go_rpc -- common/autotest_common.sh@10 -- # set +x 00:08:34.679 11:19:30 rpc.go_rpc -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:34.679 11:19:30 rpc.go_rpc -- rpc/rpc.sh@60 -- # /home/vagrant/spdk_repo/spdk/build/examples/hello_gorpc 00:08:34.679 11:19:30 rpc.go_rpc -- rpc/rpc.sh@60 -- # bdevs='[]' 00:08:34.679 11:19:30 rpc.go_rpc -- rpc/rpc.sh@61 -- # jq length 00:08:34.679 ************************************ 00:08:34.679 END TEST go_rpc 00:08:34.679 ************************************ 00:08:34.679 11:19:30 rpc.go_rpc -- rpc/rpc.sh@61 -- # '[' 0 == 0 ']' 00:08:34.679 00:08:34.679 real 0m0.240s 00:08:34.679 user 0m0.158s 00:08:34.679 sys 0m0.044s 00:08:34.679 11:19:30 rpc.go_rpc -- common/autotest_common.sh@1126 -- # xtrace_disable 00:08:34.679 11:19:30 rpc.go_rpc -- common/autotest_common.sh@10 -- # set +x 00:08:34.679 11:19:30 rpc -- rpc/rpc.sh@80 -- # rpc=rpc_cmd 00:08:34.679 11:19:30 rpc -- rpc/rpc.sh@81 -- # run_test rpc_daemon_integrity rpc_integrity 00:08:34.679 11:19:30 rpc -- common/autotest_common.sh@1101 -- # '[' 2 -le 1 ']' 00:08:34.679 11:19:30 rpc -- common/autotest_common.sh@1107 -- # xtrace_disable 00:08:34.679 11:19:30 rpc -- common/autotest_common.sh@10 -- # set +x 00:08:34.679 ************************************ 00:08:34.679 START TEST rpc_daemon_integrity 00:08:34.679 ************************************ 00:08:34.679 11:19:30 rpc.rpc_daemon_integrity -- common/autotest_common.sh@1125 -- # rpc_integrity 00:08:34.679 11:19:30 rpc.rpc_daemon_integrity -- rpc/rpc.sh@12 -- # rpc_cmd bdev_get_bdevs 00:08:34.679 11:19:30 rpc.rpc_daemon_integrity -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:34.679 11:19:30 rpc.rpc_daemon_integrity -- common/autotest_common.sh@10 -- # set +x 00:08:34.679 11:19:30 rpc.rpc_daemon_integrity -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:34.679 11:19:30 rpc.rpc_daemon_integrity -- rpc/rpc.sh@12 -- # bdevs='[]' 00:08:34.679 11:19:30 rpc.rpc_daemon_integrity -- rpc/rpc.sh@13 -- # jq length 00:08:34.937 11:19:30 rpc.rpc_daemon_integrity -- rpc/rpc.sh@13 -- # '[' 0 == 0 ']' 00:08:34.937 11:19:30 rpc.rpc_daemon_integrity -- rpc/rpc.sh@15 -- # rpc_cmd bdev_malloc_create 8 512 00:08:34.937 11:19:30 rpc.rpc_daemon_integrity -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:34.937 11:19:30 rpc.rpc_daemon_integrity -- common/autotest_common.sh@10 -- # set +x 00:08:34.937 11:19:30 rpc.rpc_daemon_integrity -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:34.937 11:19:30 rpc.rpc_daemon_integrity -- rpc/rpc.sh@15 -- # malloc=Malloc3 00:08:34.937 11:19:30 rpc.rpc_daemon_integrity -- rpc/rpc.sh@16 -- # rpc_cmd bdev_get_bdevs 00:08:34.937 11:19:30 rpc.rpc_daemon_integrity -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:34.937 11:19:30 rpc.rpc_daemon_integrity -- common/autotest_common.sh@10 -- # set +x 00:08:34.937 11:19:30 rpc.rpc_daemon_integrity -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:34.937 11:19:30 rpc.rpc_daemon_integrity -- rpc/rpc.sh@16 -- # bdevs='[ 00:08:34.937 { 00:08:34.937 "aliases": [ 00:08:34.937 "c0bd35e0-e2e2-4108-accb-a7250602f733" 00:08:34.937 ], 00:08:34.937 "assigned_rate_limits": { 00:08:34.937 "r_mbytes_per_sec": 0, 00:08:34.937 "rw_ios_per_sec": 0, 00:08:34.937 "rw_mbytes_per_sec": 0, 00:08:34.937 "w_mbytes_per_sec": 0 00:08:34.937 }, 00:08:34.937 "block_size": 512, 00:08:34.937 "claimed": false, 00:08:34.937 "driver_specific": {}, 00:08:34.937 "memory_domains": [ 00:08:34.937 { 00:08:34.937 "dma_device_id": "system", 00:08:34.937 "dma_device_type": 1 00:08:34.937 }, 00:08:34.937 { 00:08:34.937 "dma_device_id": "SPDK_ACCEL_DMA_DEVICE", 00:08:34.937 "dma_device_type": 2 00:08:34.937 } 00:08:34.937 ], 00:08:34.937 "name": "Malloc3", 00:08:34.937 "num_blocks": 16384, 00:08:34.937 "product_name": "Malloc disk", 00:08:34.937 "supported_io_types": { 00:08:34.937 "abort": true, 00:08:34.937 "compare": false, 00:08:34.937 "compare_and_write": false, 00:08:34.937 "copy": true, 00:08:34.937 "flush": true, 00:08:34.937 "get_zone_info": false, 00:08:34.937 "nvme_admin": false, 00:08:34.937 "nvme_io": false, 00:08:34.937 "nvme_io_md": false, 00:08:34.937 "nvme_iov_md": false, 00:08:34.937 "read": true, 00:08:34.937 "reset": true, 00:08:34.937 "seek_data": false, 00:08:34.937 "seek_hole": false, 00:08:34.937 "unmap": true, 00:08:34.937 "write": true, 00:08:34.937 "write_zeroes": true, 00:08:34.937 "zcopy": true, 00:08:34.937 "zone_append": false, 00:08:34.937 "zone_management": false 00:08:34.937 }, 00:08:34.937 "uuid": "c0bd35e0-e2e2-4108-accb-a7250602f733", 00:08:34.937 "zoned": false 00:08:34.937 } 00:08:34.937 ]' 00:08:34.937 11:19:30 rpc.rpc_daemon_integrity -- rpc/rpc.sh@17 -- # jq length 00:08:34.937 11:19:30 rpc.rpc_daemon_integrity -- rpc/rpc.sh@17 -- # '[' 1 == 1 ']' 00:08:34.937 11:19:30 rpc.rpc_daemon_integrity -- rpc/rpc.sh@19 -- # rpc_cmd bdev_passthru_create -b Malloc3 -p Passthru0 00:08:34.937 11:19:30 rpc.rpc_daemon_integrity -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:34.937 11:19:30 rpc.rpc_daemon_integrity -- common/autotest_common.sh@10 -- # set +x 00:08:34.937 [2024-10-07 11:19:30.310458] vbdev_passthru.c: 607:vbdev_passthru_register: *NOTICE*: Match on Malloc3 00:08:34.937 [2024-10-07 11:19:30.310530] vbdev_passthru.c: 635:vbdev_passthru_register: *NOTICE*: base bdev opened 00:08:34.937 [2024-10-07 11:19:30.310568] vbdev_passthru.c: 681:vbdev_passthru_register: *NOTICE*: io_device created at: 0x0x1a3ff20 00:08:34.937 [2024-10-07 11:19:30.310577] vbdev_passthru.c: 696:vbdev_passthru_register: *NOTICE*: bdev claimed 00:08:34.937 [2024-10-07 11:19:30.312389] vbdev_passthru.c: 709:vbdev_passthru_register: *NOTICE*: pt_bdev registered 00:08:34.937 [2024-10-07 11:19:30.312425] vbdev_passthru.c: 710:vbdev_passthru_register: *NOTICE*: created pt_bdev for: Passthru0 00:08:34.937 Passthru0 00:08:34.937 11:19:30 rpc.rpc_daemon_integrity -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:34.937 11:19:30 rpc.rpc_daemon_integrity -- rpc/rpc.sh@20 -- # rpc_cmd bdev_get_bdevs 00:08:34.937 11:19:30 rpc.rpc_daemon_integrity -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:34.937 11:19:30 rpc.rpc_daemon_integrity -- common/autotest_common.sh@10 -- # set +x 00:08:34.937 11:19:30 rpc.rpc_daemon_integrity -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:34.937 11:19:30 rpc.rpc_daemon_integrity -- rpc/rpc.sh@20 -- # bdevs='[ 00:08:34.937 { 00:08:34.937 "aliases": [ 00:08:34.937 "c0bd35e0-e2e2-4108-accb-a7250602f733" 00:08:34.937 ], 00:08:34.937 "assigned_rate_limits": { 00:08:34.937 "r_mbytes_per_sec": 0, 00:08:34.937 "rw_ios_per_sec": 0, 00:08:34.937 "rw_mbytes_per_sec": 0, 00:08:34.937 "w_mbytes_per_sec": 0 00:08:34.937 }, 00:08:34.937 "block_size": 512, 00:08:34.937 "claim_type": "exclusive_write", 00:08:34.937 "claimed": true, 00:08:34.937 "driver_specific": {}, 00:08:34.937 "memory_domains": [ 00:08:34.937 { 00:08:34.937 "dma_device_id": "system", 00:08:34.937 "dma_device_type": 1 00:08:34.937 }, 00:08:34.937 { 00:08:34.937 "dma_device_id": "SPDK_ACCEL_DMA_DEVICE", 00:08:34.937 "dma_device_type": 2 00:08:34.937 } 00:08:34.937 ], 00:08:34.938 "name": "Malloc3", 00:08:34.938 "num_blocks": 16384, 00:08:34.938 "product_name": "Malloc disk", 00:08:34.938 "supported_io_types": { 00:08:34.938 "abort": true, 00:08:34.938 "compare": false, 00:08:34.938 "compare_and_write": false, 00:08:34.938 "copy": true, 00:08:34.938 "flush": true, 00:08:34.938 "get_zone_info": false, 00:08:34.938 "nvme_admin": false, 00:08:34.938 "nvme_io": false, 00:08:34.938 "nvme_io_md": false, 00:08:34.938 "nvme_iov_md": false, 00:08:34.938 "read": true, 00:08:34.938 "reset": true, 00:08:34.938 "seek_data": false, 00:08:34.938 "seek_hole": false, 00:08:34.938 "unmap": true, 00:08:34.938 "write": true, 00:08:34.938 "write_zeroes": true, 00:08:34.938 "zcopy": true, 00:08:34.938 "zone_append": false, 00:08:34.938 "zone_management": false 00:08:34.938 }, 00:08:34.938 "uuid": "c0bd35e0-e2e2-4108-accb-a7250602f733", 00:08:34.938 "zoned": false 00:08:34.938 }, 00:08:34.938 { 00:08:34.938 "aliases": [ 00:08:34.938 "435a066d-c321-508c-9391-b3f15f1b95ca" 00:08:34.938 ], 00:08:34.938 "assigned_rate_limits": { 00:08:34.938 "r_mbytes_per_sec": 0, 00:08:34.938 "rw_ios_per_sec": 0, 00:08:34.938 "rw_mbytes_per_sec": 0, 00:08:34.938 "w_mbytes_per_sec": 0 00:08:34.938 }, 00:08:34.938 "block_size": 512, 00:08:34.938 "claimed": false, 00:08:34.938 "driver_specific": { 00:08:34.938 "passthru": { 00:08:34.938 "base_bdev_name": "Malloc3", 00:08:34.938 "name": "Passthru0" 00:08:34.938 } 00:08:34.938 }, 00:08:34.938 "memory_domains": [ 00:08:34.938 { 00:08:34.938 "dma_device_id": "system", 00:08:34.938 "dma_device_type": 1 00:08:34.938 }, 00:08:34.938 { 00:08:34.938 "dma_device_id": "SPDK_ACCEL_DMA_DEVICE", 00:08:34.938 "dma_device_type": 2 00:08:34.938 } 00:08:34.938 ], 00:08:34.938 "name": "Passthru0", 00:08:34.938 "num_blocks": 16384, 00:08:34.938 "product_name": "passthru", 00:08:34.938 "supported_io_types": { 00:08:34.938 "abort": true, 00:08:34.938 "compare": false, 00:08:34.938 "compare_and_write": false, 00:08:34.938 "copy": true, 00:08:34.938 "flush": true, 00:08:34.938 "get_zone_info": false, 00:08:34.938 "nvme_admin": false, 00:08:34.938 "nvme_io": false, 00:08:34.938 "nvme_io_md": false, 00:08:34.938 "nvme_iov_md": false, 00:08:34.938 "read": true, 00:08:34.938 "reset": true, 00:08:34.938 "seek_data": false, 00:08:34.938 "seek_hole": false, 00:08:34.938 "unmap": true, 00:08:34.938 "write": true, 00:08:34.938 "write_zeroes": true, 00:08:34.938 "zcopy": true, 00:08:34.938 "zone_append": false, 00:08:34.938 "zone_management": false 00:08:34.938 }, 00:08:34.938 "uuid": "435a066d-c321-508c-9391-b3f15f1b95ca", 00:08:34.938 "zoned": false 00:08:34.938 } 00:08:34.938 ]' 00:08:34.938 11:19:30 rpc.rpc_daemon_integrity -- rpc/rpc.sh@21 -- # jq length 00:08:34.938 11:19:30 rpc.rpc_daemon_integrity -- rpc/rpc.sh@21 -- # '[' 2 == 2 ']' 00:08:34.938 11:19:30 rpc.rpc_daemon_integrity -- rpc/rpc.sh@23 -- # rpc_cmd bdev_passthru_delete Passthru0 00:08:34.938 11:19:30 rpc.rpc_daemon_integrity -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:34.938 11:19:30 rpc.rpc_daemon_integrity -- common/autotest_common.sh@10 -- # set +x 00:08:34.938 11:19:30 rpc.rpc_daemon_integrity -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:34.938 11:19:30 rpc.rpc_daemon_integrity -- rpc/rpc.sh@24 -- # rpc_cmd bdev_malloc_delete Malloc3 00:08:34.938 11:19:30 rpc.rpc_daemon_integrity -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:34.938 11:19:30 rpc.rpc_daemon_integrity -- common/autotest_common.sh@10 -- # set +x 00:08:34.938 11:19:30 rpc.rpc_daemon_integrity -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:34.938 11:19:30 rpc.rpc_daemon_integrity -- rpc/rpc.sh@25 -- # rpc_cmd bdev_get_bdevs 00:08:34.938 11:19:30 rpc.rpc_daemon_integrity -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:34.938 11:19:30 rpc.rpc_daemon_integrity -- common/autotest_common.sh@10 -- # set +x 00:08:34.938 11:19:30 rpc.rpc_daemon_integrity -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:34.938 11:19:30 rpc.rpc_daemon_integrity -- rpc/rpc.sh@25 -- # bdevs='[]' 00:08:34.938 11:19:30 rpc.rpc_daemon_integrity -- rpc/rpc.sh@26 -- # jq length 00:08:35.197 ************************************ 00:08:35.197 END TEST rpc_daemon_integrity 00:08:35.197 ************************************ 00:08:35.197 11:19:30 rpc.rpc_daemon_integrity -- rpc/rpc.sh@26 -- # '[' 0 == 0 ']' 00:08:35.197 00:08:35.197 real 0m0.327s 00:08:35.197 user 0m0.212s 00:08:35.197 sys 0m0.040s 00:08:35.197 11:19:30 rpc.rpc_daemon_integrity -- common/autotest_common.sh@1126 -- # xtrace_disable 00:08:35.197 11:19:30 rpc.rpc_daemon_integrity -- common/autotest_common.sh@10 -- # set +x 00:08:35.197 11:19:30 rpc -- rpc/rpc.sh@83 -- # trap - SIGINT SIGTERM EXIT 00:08:35.197 11:19:30 rpc -- rpc/rpc.sh@84 -- # killprocess 58619 00:08:35.197 11:19:30 rpc -- common/autotest_common.sh@950 -- # '[' -z 58619 ']' 00:08:35.197 11:19:30 rpc -- common/autotest_common.sh@954 -- # kill -0 58619 00:08:35.197 11:19:30 rpc -- common/autotest_common.sh@955 -- # uname 00:08:35.197 11:19:30 rpc -- common/autotest_common.sh@955 -- # '[' Linux = Linux ']' 00:08:35.197 11:19:30 rpc -- common/autotest_common.sh@956 -- # ps --no-headers -o comm= 58619 00:08:35.197 11:19:30 rpc -- common/autotest_common.sh@956 -- # process_name=reactor_0 00:08:35.197 11:19:30 rpc -- common/autotest_common.sh@960 -- # '[' reactor_0 = sudo ']' 00:08:35.197 killing process with pid 58619 00:08:35.197 11:19:30 rpc -- common/autotest_common.sh@968 -- # echo 'killing process with pid 58619' 00:08:35.197 11:19:30 rpc -- common/autotest_common.sh@969 -- # kill 58619 00:08:35.197 11:19:30 rpc -- common/autotest_common.sh@974 -- # wait 58619 00:08:35.457 00:08:35.457 real 0m2.930s 00:08:35.457 user 0m3.766s 00:08:35.457 sys 0m0.829s 00:08:35.457 11:19:30 rpc -- common/autotest_common.sh@1126 -- # xtrace_disable 00:08:35.457 ************************************ 00:08:35.457 END TEST rpc 00:08:35.457 ************************************ 00:08:35.457 11:19:30 rpc -- common/autotest_common.sh@10 -- # set +x 00:08:35.716 11:19:31 -- spdk/autotest.sh@157 -- # run_test skip_rpc /home/vagrant/spdk_repo/spdk/test/rpc/skip_rpc.sh 00:08:35.716 11:19:31 -- common/autotest_common.sh@1101 -- # '[' 2 -le 1 ']' 00:08:35.716 11:19:31 -- common/autotest_common.sh@1107 -- # xtrace_disable 00:08:35.716 11:19:31 -- common/autotest_common.sh@10 -- # set +x 00:08:35.716 ************************************ 00:08:35.716 START TEST skip_rpc 00:08:35.716 ************************************ 00:08:35.716 11:19:31 skip_rpc -- common/autotest_common.sh@1125 -- # /home/vagrant/spdk_repo/spdk/test/rpc/skip_rpc.sh 00:08:35.716 * Looking for test storage... 00:08:35.716 * Found test storage at /home/vagrant/spdk_repo/spdk/test/rpc 00:08:35.716 11:19:31 skip_rpc -- common/autotest_common.sh@1680 -- # [[ y == y ]] 00:08:35.716 11:19:31 skip_rpc -- common/autotest_common.sh@1681 -- # lcov --version 00:08:35.716 11:19:31 skip_rpc -- common/autotest_common.sh@1681 -- # awk '{print $NF}' 00:08:35.716 11:19:31 skip_rpc -- common/autotest_common.sh@1681 -- # lt 1.15 2 00:08:35.716 11:19:31 skip_rpc -- scripts/common.sh@373 -- # cmp_versions 1.15 '<' 2 00:08:35.716 11:19:31 skip_rpc -- scripts/common.sh@333 -- # local ver1 ver1_l 00:08:35.716 11:19:31 skip_rpc -- scripts/common.sh@334 -- # local ver2 ver2_l 00:08:35.716 11:19:31 skip_rpc -- scripts/common.sh@336 -- # IFS=.-: 00:08:35.716 11:19:31 skip_rpc -- scripts/common.sh@336 -- # read -ra ver1 00:08:35.716 11:19:31 skip_rpc -- scripts/common.sh@337 -- # IFS=.-: 00:08:35.716 11:19:31 skip_rpc -- scripts/common.sh@337 -- # read -ra ver2 00:08:35.716 11:19:31 skip_rpc -- scripts/common.sh@338 -- # local 'op=<' 00:08:35.716 11:19:31 skip_rpc -- scripts/common.sh@340 -- # ver1_l=2 00:08:35.716 11:19:31 skip_rpc -- scripts/common.sh@341 -- # ver2_l=1 00:08:35.716 11:19:31 skip_rpc -- scripts/common.sh@343 -- # local lt=0 gt=0 eq=0 v 00:08:35.716 11:19:31 skip_rpc -- scripts/common.sh@344 -- # case "$op" in 00:08:35.716 11:19:31 skip_rpc -- scripts/common.sh@345 -- # : 1 00:08:35.716 11:19:31 skip_rpc -- scripts/common.sh@364 -- # (( v = 0 )) 00:08:35.716 11:19:31 skip_rpc -- scripts/common.sh@364 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:08:35.716 11:19:31 skip_rpc -- scripts/common.sh@365 -- # decimal 1 00:08:35.716 11:19:31 skip_rpc -- scripts/common.sh@353 -- # local d=1 00:08:35.716 11:19:31 skip_rpc -- scripts/common.sh@354 -- # [[ 1 =~ ^[0-9]+$ ]] 00:08:35.716 11:19:31 skip_rpc -- scripts/common.sh@355 -- # echo 1 00:08:35.716 11:19:31 skip_rpc -- scripts/common.sh@365 -- # ver1[v]=1 00:08:35.716 11:19:31 skip_rpc -- scripts/common.sh@366 -- # decimal 2 00:08:35.716 11:19:31 skip_rpc -- scripts/common.sh@353 -- # local d=2 00:08:35.716 11:19:31 skip_rpc -- scripts/common.sh@354 -- # [[ 2 =~ ^[0-9]+$ ]] 00:08:35.716 11:19:31 skip_rpc -- scripts/common.sh@355 -- # echo 2 00:08:35.716 11:19:31 skip_rpc -- scripts/common.sh@366 -- # ver2[v]=2 00:08:35.716 11:19:31 skip_rpc -- scripts/common.sh@367 -- # (( ver1[v] > ver2[v] )) 00:08:35.716 11:19:31 skip_rpc -- scripts/common.sh@368 -- # (( ver1[v] < ver2[v] )) 00:08:35.716 11:19:31 skip_rpc -- scripts/common.sh@368 -- # return 0 00:08:35.716 11:19:31 skip_rpc -- common/autotest_common.sh@1682 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:08:35.716 11:19:31 skip_rpc -- common/autotest_common.sh@1694 -- # export 'LCOV_OPTS= 00:08:35.716 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:08:35.716 --rc genhtml_branch_coverage=1 00:08:35.716 --rc genhtml_function_coverage=1 00:08:35.716 --rc genhtml_legend=1 00:08:35.716 --rc geninfo_all_blocks=1 00:08:35.716 --rc geninfo_unexecuted_blocks=1 00:08:35.716 00:08:35.716 ' 00:08:35.716 11:19:31 skip_rpc -- common/autotest_common.sh@1694 -- # LCOV_OPTS=' 00:08:35.716 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:08:35.716 --rc genhtml_branch_coverage=1 00:08:35.716 --rc genhtml_function_coverage=1 00:08:35.716 --rc genhtml_legend=1 00:08:35.716 --rc geninfo_all_blocks=1 00:08:35.716 --rc geninfo_unexecuted_blocks=1 00:08:35.716 00:08:35.716 ' 00:08:35.716 11:19:31 skip_rpc -- common/autotest_common.sh@1695 -- # export 'LCOV=lcov 00:08:35.716 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:08:35.716 --rc genhtml_branch_coverage=1 00:08:35.716 --rc genhtml_function_coverage=1 00:08:35.716 --rc genhtml_legend=1 00:08:35.716 --rc geninfo_all_blocks=1 00:08:35.716 --rc geninfo_unexecuted_blocks=1 00:08:35.716 00:08:35.716 ' 00:08:35.716 11:19:31 skip_rpc -- common/autotest_common.sh@1695 -- # LCOV='lcov 00:08:35.716 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:08:35.716 --rc genhtml_branch_coverage=1 00:08:35.716 --rc genhtml_function_coverage=1 00:08:35.716 --rc genhtml_legend=1 00:08:35.716 --rc geninfo_all_blocks=1 00:08:35.716 --rc geninfo_unexecuted_blocks=1 00:08:35.716 00:08:35.716 ' 00:08:35.716 11:19:31 skip_rpc -- rpc/skip_rpc.sh@11 -- # CONFIG_PATH=/home/vagrant/spdk_repo/spdk/test/rpc/config.json 00:08:35.716 11:19:31 skip_rpc -- rpc/skip_rpc.sh@12 -- # LOG_PATH=/home/vagrant/spdk_repo/spdk/test/rpc/log.txt 00:08:35.716 11:19:31 skip_rpc -- rpc/skip_rpc.sh@73 -- # run_test skip_rpc test_skip_rpc 00:08:35.716 11:19:31 skip_rpc -- common/autotest_common.sh@1101 -- # '[' 2 -le 1 ']' 00:08:35.716 11:19:31 skip_rpc -- common/autotest_common.sh@1107 -- # xtrace_disable 00:08:35.716 11:19:31 skip_rpc -- common/autotest_common.sh@10 -- # set +x 00:08:35.716 ************************************ 00:08:35.716 START TEST skip_rpc 00:08:35.716 ************************************ 00:08:35.716 11:19:31 skip_rpc.skip_rpc -- common/autotest_common.sh@1125 -- # test_skip_rpc 00:08:35.716 11:19:31 skip_rpc.skip_rpc -- rpc/skip_rpc.sh@16 -- # local spdk_pid=58880 00:08:35.716 11:19:31 skip_rpc.skip_rpc -- rpc/skip_rpc.sh@18 -- # trap 'killprocess $spdk_pid; exit 1' SIGINT SIGTERM EXIT 00:08:35.716 11:19:31 skip_rpc.skip_rpc -- rpc/skip_rpc.sh@15 -- # /home/vagrant/spdk_repo/spdk/build/bin/spdk_tgt --no-rpc-server -m 0x1 00:08:35.716 11:19:31 skip_rpc.skip_rpc -- rpc/skip_rpc.sh@19 -- # sleep 5 00:08:35.975 [2024-10-07 11:19:31.282451] Starting SPDK v25.01-pre git sha1 2a4f56c54 / DPDK 24.03.0 initialization... 00:08:35.975 [2024-10-07 11:19:31.282780] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --iova-mode=pa --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid58880 ] 00:08:35.975 [2024-10-07 11:19:31.414681] app.c: 917:spdk_app_start: *NOTICE*: Total cores available: 1 00:08:36.233 [2024-10-07 11:19:31.543696] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 0 00:08:41.513 11:19:36 skip_rpc.skip_rpc -- rpc/skip_rpc.sh@21 -- # NOT rpc_cmd spdk_get_version 00:08:41.513 11:19:36 skip_rpc.skip_rpc -- common/autotest_common.sh@650 -- # local es=0 00:08:41.513 11:19:36 skip_rpc.skip_rpc -- common/autotest_common.sh@652 -- # valid_exec_arg rpc_cmd spdk_get_version 00:08:41.513 11:19:36 skip_rpc.skip_rpc -- common/autotest_common.sh@638 -- # local arg=rpc_cmd 00:08:41.513 11:19:36 skip_rpc.skip_rpc -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:08:41.513 11:19:36 skip_rpc.skip_rpc -- common/autotest_common.sh@642 -- # type -t rpc_cmd 00:08:41.513 11:19:36 skip_rpc.skip_rpc -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:08:41.513 11:19:36 skip_rpc.skip_rpc -- common/autotest_common.sh@653 -- # rpc_cmd spdk_get_version 00:08:41.513 11:19:36 skip_rpc.skip_rpc -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:41.513 11:19:36 skip_rpc.skip_rpc -- common/autotest_common.sh@10 -- # set +x 00:08:41.513 2024/10/07 11:19:36 error on client creation, err: error during client creation for Unix socket, err: could not connect to a Unix socket on address /var/tmp/spdk.sock, err: dial unix /var/tmp/spdk.sock: connect: no such file or directory 00:08:41.513 11:19:36 skip_rpc.skip_rpc -- common/autotest_common.sh@589 -- # [[ 1 == 0 ]] 00:08:41.513 11:19:36 skip_rpc.skip_rpc -- common/autotest_common.sh@653 -- # es=1 00:08:41.513 11:19:36 skip_rpc.skip_rpc -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:08:41.513 11:19:36 skip_rpc.skip_rpc -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:08:41.513 11:19:36 skip_rpc.skip_rpc -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:08:41.513 11:19:36 skip_rpc.skip_rpc -- rpc/skip_rpc.sh@22 -- # trap - SIGINT SIGTERM EXIT 00:08:41.513 11:19:36 skip_rpc.skip_rpc -- rpc/skip_rpc.sh@23 -- # killprocess 58880 00:08:41.513 11:19:36 skip_rpc.skip_rpc -- common/autotest_common.sh@950 -- # '[' -z 58880 ']' 00:08:41.513 11:19:36 skip_rpc.skip_rpc -- common/autotest_common.sh@954 -- # kill -0 58880 00:08:41.513 11:19:36 skip_rpc.skip_rpc -- common/autotest_common.sh@955 -- # uname 00:08:41.513 11:19:36 skip_rpc.skip_rpc -- common/autotest_common.sh@955 -- # '[' Linux = Linux ']' 00:08:41.513 11:19:36 skip_rpc.skip_rpc -- common/autotest_common.sh@956 -- # ps --no-headers -o comm= 58880 00:08:41.513 killing process with pid 58880 00:08:41.513 11:19:36 skip_rpc.skip_rpc -- common/autotest_common.sh@956 -- # process_name=reactor_0 00:08:41.513 11:19:36 skip_rpc.skip_rpc -- common/autotest_common.sh@960 -- # '[' reactor_0 = sudo ']' 00:08:41.513 11:19:36 skip_rpc.skip_rpc -- common/autotest_common.sh@968 -- # echo 'killing process with pid 58880' 00:08:41.513 11:19:36 skip_rpc.skip_rpc -- common/autotest_common.sh@969 -- # kill 58880 00:08:41.513 11:19:36 skip_rpc.skip_rpc -- common/autotest_common.sh@974 -- # wait 58880 00:08:41.513 00:08:41.513 real 0m5.484s 00:08:41.513 user 0m5.079s 00:08:41.513 sys 0m0.310s 00:08:41.513 11:19:36 skip_rpc.skip_rpc -- common/autotest_common.sh@1126 -- # xtrace_disable 00:08:41.513 11:19:36 skip_rpc.skip_rpc -- common/autotest_common.sh@10 -- # set +x 00:08:41.513 ************************************ 00:08:41.513 END TEST skip_rpc 00:08:41.513 ************************************ 00:08:41.513 11:19:36 skip_rpc -- rpc/skip_rpc.sh@74 -- # run_test skip_rpc_with_json test_skip_rpc_with_json 00:08:41.513 11:19:36 skip_rpc -- common/autotest_common.sh@1101 -- # '[' 2 -le 1 ']' 00:08:41.513 11:19:36 skip_rpc -- common/autotest_common.sh@1107 -- # xtrace_disable 00:08:41.513 11:19:36 skip_rpc -- common/autotest_common.sh@10 -- # set +x 00:08:41.513 ************************************ 00:08:41.513 START TEST skip_rpc_with_json 00:08:41.513 ************************************ 00:08:41.513 11:19:36 skip_rpc.skip_rpc_with_json -- common/autotest_common.sh@1125 -- # test_skip_rpc_with_json 00:08:41.513 11:19:36 skip_rpc.skip_rpc_with_json -- rpc/skip_rpc.sh@44 -- # gen_json_config 00:08:41.513 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:08:41.513 11:19:36 skip_rpc.skip_rpc_with_json -- rpc/skip_rpc.sh@28 -- # local spdk_pid=58973 00:08:41.513 11:19:36 skip_rpc.skip_rpc_with_json -- rpc/skip_rpc.sh@30 -- # trap 'killprocess $spdk_pid; exit 1' SIGINT SIGTERM EXIT 00:08:41.513 11:19:36 skip_rpc.skip_rpc_with_json -- rpc/skip_rpc.sh@31 -- # waitforlisten 58973 00:08:41.513 11:19:36 skip_rpc.skip_rpc_with_json -- rpc/skip_rpc.sh@27 -- # /home/vagrant/spdk_repo/spdk/build/bin/spdk_tgt -m 0x1 00:08:41.513 11:19:36 skip_rpc.skip_rpc_with_json -- common/autotest_common.sh@831 -- # '[' -z 58973 ']' 00:08:41.513 11:19:36 skip_rpc.skip_rpc_with_json -- common/autotest_common.sh@835 -- # local rpc_addr=/var/tmp/spdk.sock 00:08:41.513 11:19:36 skip_rpc.skip_rpc_with_json -- common/autotest_common.sh@836 -- # local max_retries=100 00:08:41.513 11:19:36 skip_rpc.skip_rpc_with_json -- common/autotest_common.sh@838 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:08:41.513 11:19:36 skip_rpc.skip_rpc_with_json -- common/autotest_common.sh@840 -- # xtrace_disable 00:08:41.513 11:19:36 skip_rpc.skip_rpc_with_json -- common/autotest_common.sh@10 -- # set +x 00:08:41.513 [2024-10-07 11:19:36.831492] Starting SPDK v25.01-pre git sha1 2a4f56c54 / DPDK 24.03.0 initialization... 00:08:41.513 [2024-10-07 11:19:36.831827] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --iova-mode=pa --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid58973 ] 00:08:41.513 [2024-10-07 11:19:36.970707] app.c: 917:spdk_app_start: *NOTICE*: Total cores available: 1 00:08:41.771 [2024-10-07 11:19:37.091791] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 0 00:08:42.707 11:19:37 skip_rpc.skip_rpc_with_json -- common/autotest_common.sh@860 -- # (( i == 0 )) 00:08:42.707 11:19:37 skip_rpc.skip_rpc_with_json -- common/autotest_common.sh@864 -- # return 0 00:08:42.707 11:19:37 skip_rpc.skip_rpc_with_json -- rpc/skip_rpc.sh@34 -- # rpc_cmd nvmf_get_transports --trtype tcp 00:08:42.707 11:19:37 skip_rpc.skip_rpc_with_json -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:42.707 11:19:37 skip_rpc.skip_rpc_with_json -- common/autotest_common.sh@10 -- # set +x 00:08:42.707 [2024-10-07 11:19:37.883266] nvmf_rpc.c:2703:rpc_nvmf_get_transports: *ERROR*: transport 'tcp' does not exist 00:08:42.707 2024/10/07 11:19:37 error on JSON-RPC call, method: nvmf_get_transports, params: map[trtype:tcp], err: error received for nvmf_get_transports method, err: Code=-19 Msg=No such device 00:08:42.707 request: 00:08:42.707 { 00:08:42.707 "method": "nvmf_get_transports", 00:08:42.707 "params": { 00:08:42.707 "trtype": "tcp" 00:08:42.707 } 00:08:42.707 } 00:08:42.707 Got JSON-RPC error response 00:08:42.707 GoRPCClient: error on JSON-RPC call 00:08:42.707 11:19:37 skip_rpc.skip_rpc_with_json -- common/autotest_common.sh@589 -- # [[ 1 == 0 ]] 00:08:42.707 11:19:37 skip_rpc.skip_rpc_with_json -- rpc/skip_rpc.sh@34 -- # rpc_cmd nvmf_create_transport -t tcp 00:08:42.707 11:19:37 skip_rpc.skip_rpc_with_json -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:42.707 11:19:37 skip_rpc.skip_rpc_with_json -- common/autotest_common.sh@10 -- # set +x 00:08:42.707 [2024-10-07 11:19:37.895378] tcp.c: 738:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:08:42.707 11:19:37 skip_rpc.skip_rpc_with_json -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:42.707 11:19:37 skip_rpc.skip_rpc_with_json -- rpc/skip_rpc.sh@36 -- # rpc_cmd save_config 00:08:42.707 11:19:37 skip_rpc.skip_rpc_with_json -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:42.707 11:19:37 skip_rpc.skip_rpc_with_json -- common/autotest_common.sh@10 -- # set +x 00:08:42.707 11:19:38 skip_rpc.skip_rpc_with_json -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:42.707 11:19:38 skip_rpc.skip_rpc_with_json -- rpc/skip_rpc.sh@37 -- # cat /home/vagrant/spdk_repo/spdk/test/rpc/config.json 00:08:42.707 { 00:08:42.707 "subsystems": [ 00:08:42.707 { 00:08:42.707 "subsystem": "fsdev", 00:08:42.707 "config": [ 00:08:42.707 { 00:08:42.708 "method": "fsdev_set_opts", 00:08:42.708 "params": { 00:08:42.708 "fsdev_io_cache_size": 256, 00:08:42.708 "fsdev_io_pool_size": 65535 00:08:42.708 } 00:08:42.708 } 00:08:42.708 ] 00:08:42.708 }, 00:08:42.708 { 00:08:42.708 "subsystem": "keyring", 00:08:42.708 "config": [] 00:08:42.708 }, 00:08:42.708 { 00:08:42.708 "subsystem": "iobuf", 00:08:42.708 "config": [ 00:08:42.708 { 00:08:42.708 "method": "iobuf_set_options", 00:08:42.708 "params": { 00:08:42.708 "large_bufsize": 135168, 00:08:42.708 "large_pool_count": 1024, 00:08:42.708 "small_bufsize": 8192, 00:08:42.708 "small_pool_count": 8192 00:08:42.708 } 00:08:42.708 } 00:08:42.708 ] 00:08:42.708 }, 00:08:42.708 { 00:08:42.708 "subsystem": "sock", 00:08:42.708 "config": [ 00:08:42.708 { 00:08:42.708 "method": "sock_set_default_impl", 00:08:42.708 "params": { 00:08:42.708 "impl_name": "posix" 00:08:42.708 } 00:08:42.708 }, 00:08:42.708 { 00:08:42.708 "method": "sock_impl_set_options", 00:08:42.708 "params": { 00:08:42.708 "enable_ktls": false, 00:08:42.708 "enable_placement_id": 0, 00:08:42.708 "enable_quickack": false, 00:08:42.708 "enable_recv_pipe": true, 00:08:42.708 "enable_zerocopy_send_client": false, 00:08:42.708 "enable_zerocopy_send_server": true, 00:08:42.708 "impl_name": "ssl", 00:08:42.708 "recv_buf_size": 4096, 00:08:42.708 "send_buf_size": 4096, 00:08:42.708 "tls_version": 0, 00:08:42.708 "zerocopy_threshold": 0 00:08:42.708 } 00:08:42.708 }, 00:08:42.708 { 00:08:42.708 "method": "sock_impl_set_options", 00:08:42.708 "params": { 00:08:42.708 "enable_ktls": false, 00:08:42.708 "enable_placement_id": 0, 00:08:42.708 "enable_quickack": false, 00:08:42.708 "enable_recv_pipe": true, 00:08:42.708 "enable_zerocopy_send_client": false, 00:08:42.708 "enable_zerocopy_send_server": true, 00:08:42.708 "impl_name": "posix", 00:08:42.708 "recv_buf_size": 2097152, 00:08:42.708 "send_buf_size": 2097152, 00:08:42.708 "tls_version": 0, 00:08:42.708 "zerocopy_threshold": 0 00:08:42.708 } 00:08:42.708 } 00:08:42.708 ] 00:08:42.708 }, 00:08:42.708 { 00:08:42.708 "subsystem": "vmd", 00:08:42.708 "config": [] 00:08:42.708 }, 00:08:42.708 { 00:08:42.708 "subsystem": "accel", 00:08:42.708 "config": [ 00:08:42.708 { 00:08:42.708 "method": "accel_set_options", 00:08:42.708 "params": { 00:08:42.708 "buf_count": 2048, 00:08:42.708 "large_cache_size": 16, 00:08:42.708 "sequence_count": 2048, 00:08:42.708 "small_cache_size": 128, 00:08:42.708 "task_count": 2048 00:08:42.708 } 00:08:42.708 } 00:08:42.708 ] 00:08:42.708 }, 00:08:42.708 { 00:08:42.708 "subsystem": "bdev", 00:08:42.708 "config": [ 00:08:42.708 { 00:08:42.708 "method": "bdev_set_options", 00:08:42.708 "params": { 00:08:42.708 "bdev_auto_examine": true, 00:08:42.708 "bdev_io_cache_size": 256, 00:08:42.708 "bdev_io_pool_size": 65535, 00:08:42.708 "iobuf_large_cache_size": 16, 00:08:42.708 "iobuf_small_cache_size": 128 00:08:42.708 } 00:08:42.708 }, 00:08:42.708 { 00:08:42.708 "method": "bdev_raid_set_options", 00:08:42.708 "params": { 00:08:42.708 "process_max_bandwidth_mb_sec": 0, 00:08:42.708 "process_window_size_kb": 1024 00:08:42.708 } 00:08:42.708 }, 00:08:42.708 { 00:08:42.708 "method": "bdev_iscsi_set_options", 00:08:42.708 "params": { 00:08:42.708 "timeout_sec": 30 00:08:42.708 } 00:08:42.708 }, 00:08:42.708 { 00:08:42.708 "method": "bdev_nvme_set_options", 00:08:42.708 "params": { 00:08:42.708 "action_on_timeout": "none", 00:08:42.708 "allow_accel_sequence": false, 00:08:42.708 "arbitration_burst": 0, 00:08:42.708 "bdev_retry_count": 3, 00:08:42.708 "ctrlr_loss_timeout_sec": 0, 00:08:42.708 "delay_cmd_submit": true, 00:08:42.708 "dhchap_dhgroups": [ 00:08:42.708 "null", 00:08:42.708 "ffdhe2048", 00:08:42.708 "ffdhe3072", 00:08:42.708 "ffdhe4096", 00:08:42.708 "ffdhe6144", 00:08:42.708 "ffdhe8192" 00:08:42.708 ], 00:08:42.708 "dhchap_digests": [ 00:08:42.708 "sha256", 00:08:42.708 "sha384", 00:08:42.708 "sha512" 00:08:42.708 ], 00:08:42.708 "disable_auto_failback": false, 00:08:42.708 "fast_io_fail_timeout_sec": 0, 00:08:42.708 "generate_uuids": false, 00:08:42.708 "high_priority_weight": 0, 00:08:42.708 "io_path_stat": false, 00:08:42.708 "io_queue_requests": 0, 00:08:42.708 "keep_alive_timeout_ms": 10000, 00:08:42.708 "low_priority_weight": 0, 00:08:42.708 "medium_priority_weight": 0, 00:08:42.708 "nvme_adminq_poll_period_us": 10000, 00:08:42.708 "nvme_error_stat": false, 00:08:42.708 "nvme_ioq_poll_period_us": 0, 00:08:42.708 "rdma_cm_event_timeout_ms": 0, 00:08:42.708 "rdma_max_cq_size": 0, 00:08:42.708 "rdma_srq_size": 0, 00:08:42.708 "reconnect_delay_sec": 0, 00:08:42.708 "timeout_admin_us": 0, 00:08:42.708 "timeout_us": 0, 00:08:42.708 "transport_ack_timeout": 0, 00:08:42.708 "transport_retry_count": 4, 00:08:42.708 "transport_tos": 0 00:08:42.708 } 00:08:42.708 }, 00:08:42.708 { 00:08:42.708 "method": "bdev_nvme_set_hotplug", 00:08:42.708 "params": { 00:08:42.708 "enable": false, 00:08:42.708 "period_us": 100000 00:08:42.708 } 00:08:42.708 }, 00:08:42.708 { 00:08:42.708 "method": "bdev_wait_for_examine" 00:08:42.708 } 00:08:42.708 ] 00:08:42.708 }, 00:08:42.708 { 00:08:42.708 "subsystem": "scsi", 00:08:42.708 "config": null 00:08:42.708 }, 00:08:42.708 { 00:08:42.708 "subsystem": "scheduler", 00:08:42.708 "config": [ 00:08:42.708 { 00:08:42.708 "method": "framework_set_scheduler", 00:08:42.708 "params": { 00:08:42.708 "name": "static" 00:08:42.708 } 00:08:42.708 } 00:08:42.708 ] 00:08:42.708 }, 00:08:42.708 { 00:08:42.708 "subsystem": "vhost_scsi", 00:08:42.708 "config": [] 00:08:42.708 }, 00:08:42.708 { 00:08:42.708 "subsystem": "vhost_blk", 00:08:42.708 "config": [] 00:08:42.708 }, 00:08:42.708 { 00:08:42.708 "subsystem": "ublk", 00:08:42.708 "config": [] 00:08:42.708 }, 00:08:42.708 { 00:08:42.708 "subsystem": "nbd", 00:08:42.708 "config": [] 00:08:42.708 }, 00:08:42.708 { 00:08:42.708 "subsystem": "nvmf", 00:08:42.708 "config": [ 00:08:42.708 { 00:08:42.708 "method": "nvmf_set_config", 00:08:42.708 "params": { 00:08:42.708 "admin_cmd_passthru": { 00:08:42.708 "identify_ctrlr": false 00:08:42.708 }, 00:08:42.708 "dhchap_dhgroups": [ 00:08:42.708 "null", 00:08:42.708 "ffdhe2048", 00:08:42.708 "ffdhe3072", 00:08:42.708 "ffdhe4096", 00:08:42.708 "ffdhe6144", 00:08:42.708 "ffdhe8192" 00:08:42.708 ], 00:08:42.708 "dhchap_digests": [ 00:08:42.708 "sha256", 00:08:42.708 "sha384", 00:08:42.708 "sha512" 00:08:42.708 ], 00:08:42.708 "discovery_filter": "match_any" 00:08:42.708 } 00:08:42.708 }, 00:08:42.708 { 00:08:42.708 "method": "nvmf_set_max_subsystems", 00:08:42.708 "params": { 00:08:42.708 "max_subsystems": 1024 00:08:42.708 } 00:08:42.708 }, 00:08:42.708 { 00:08:42.708 "method": "nvmf_set_crdt", 00:08:42.708 "params": { 00:08:42.708 "crdt1": 0, 00:08:42.708 "crdt2": 0, 00:08:42.708 "crdt3": 0 00:08:42.708 } 00:08:42.708 }, 00:08:42.708 { 00:08:42.708 "method": "nvmf_create_transport", 00:08:42.708 "params": { 00:08:42.708 "abort_timeout_sec": 1, 00:08:42.708 "ack_timeout": 0, 00:08:42.708 "buf_cache_size": 4294967295, 00:08:42.708 "c2h_success": true, 00:08:42.708 "data_wr_pool_size": 0, 00:08:42.708 "dif_insert_or_strip": false, 00:08:42.708 "in_capsule_data_size": 4096, 00:08:42.708 "io_unit_size": 131072, 00:08:42.708 "max_aq_depth": 128, 00:08:42.708 "max_io_qpairs_per_ctrlr": 127, 00:08:42.708 "max_io_size": 131072, 00:08:42.708 "max_queue_depth": 128, 00:08:42.708 "num_shared_buffers": 511, 00:08:42.708 "sock_priority": 0, 00:08:42.708 "trtype": "TCP", 00:08:42.708 "zcopy": false 00:08:42.708 } 00:08:42.708 } 00:08:42.708 ] 00:08:42.708 }, 00:08:42.708 { 00:08:42.708 "subsystem": "iscsi", 00:08:42.708 "config": [ 00:08:42.708 { 00:08:42.708 "method": "iscsi_set_options", 00:08:42.708 "params": { 00:08:42.708 "allow_duplicated_isid": false, 00:08:42.708 "chap_group": 0, 00:08:42.708 "data_out_pool_size": 2048, 00:08:42.708 "default_time2retain": 20, 00:08:42.708 "default_time2wait": 2, 00:08:42.708 "disable_chap": false, 00:08:42.708 "error_recovery_level": 0, 00:08:42.708 "first_burst_length": 8192, 00:08:42.708 "immediate_data": true, 00:08:42.708 "immediate_data_pool_size": 16384, 00:08:42.708 "max_connections_per_session": 2, 00:08:42.708 "max_large_datain_per_connection": 64, 00:08:42.708 "max_queue_depth": 64, 00:08:42.708 "max_r2t_per_connection": 4, 00:08:42.708 "max_sessions": 128, 00:08:42.708 "mutual_chap": false, 00:08:42.708 "node_base": "iqn.2016-06.io.spdk", 00:08:42.708 "nop_in_interval": 30, 00:08:42.708 "nop_timeout": 60, 00:08:42.708 "pdu_pool_size": 36864, 00:08:42.708 "require_chap": false 00:08:42.708 } 00:08:42.708 } 00:08:42.708 ] 00:08:42.708 } 00:08:42.708 ] 00:08:42.708 } 00:08:42.708 11:19:38 skip_rpc.skip_rpc_with_json -- rpc/skip_rpc.sh@39 -- # trap - SIGINT SIGTERM EXIT 00:08:42.708 11:19:38 skip_rpc.skip_rpc_with_json -- rpc/skip_rpc.sh@40 -- # killprocess 58973 00:08:42.708 11:19:38 skip_rpc.skip_rpc_with_json -- common/autotest_common.sh@950 -- # '[' -z 58973 ']' 00:08:42.709 11:19:38 skip_rpc.skip_rpc_with_json -- common/autotest_common.sh@954 -- # kill -0 58973 00:08:42.709 11:19:38 skip_rpc.skip_rpc_with_json -- common/autotest_common.sh@955 -- # uname 00:08:42.709 11:19:38 skip_rpc.skip_rpc_with_json -- common/autotest_common.sh@955 -- # '[' Linux = Linux ']' 00:08:42.709 11:19:38 skip_rpc.skip_rpc_with_json -- common/autotest_common.sh@956 -- # ps --no-headers -o comm= 58973 00:08:42.709 killing process with pid 58973 00:08:42.709 11:19:38 skip_rpc.skip_rpc_with_json -- common/autotest_common.sh@956 -- # process_name=reactor_0 00:08:42.709 11:19:38 skip_rpc.skip_rpc_with_json -- common/autotest_common.sh@960 -- # '[' reactor_0 = sudo ']' 00:08:42.709 11:19:38 skip_rpc.skip_rpc_with_json -- common/autotest_common.sh@968 -- # echo 'killing process with pid 58973' 00:08:42.709 11:19:38 skip_rpc.skip_rpc_with_json -- common/autotest_common.sh@969 -- # kill 58973 00:08:42.709 11:19:38 skip_rpc.skip_rpc_with_json -- common/autotest_common.sh@974 -- # wait 58973 00:08:43.022 11:19:38 skip_rpc.skip_rpc_with_json -- rpc/skip_rpc.sh@47 -- # local spdk_pid=59012 00:08:43.022 11:19:38 skip_rpc.skip_rpc_with_json -- rpc/skip_rpc.sh@48 -- # sleep 5 00:08:43.022 11:19:38 skip_rpc.skip_rpc_with_json -- rpc/skip_rpc.sh@46 -- # /home/vagrant/spdk_repo/spdk/build/bin/spdk_tgt --no-rpc-server -m 0x1 --json /home/vagrant/spdk_repo/spdk/test/rpc/config.json 00:08:48.284 11:19:43 skip_rpc.skip_rpc_with_json -- rpc/skip_rpc.sh@50 -- # killprocess 59012 00:08:48.284 11:19:43 skip_rpc.skip_rpc_with_json -- common/autotest_common.sh@950 -- # '[' -z 59012 ']' 00:08:48.284 11:19:43 skip_rpc.skip_rpc_with_json -- common/autotest_common.sh@954 -- # kill -0 59012 00:08:48.284 11:19:43 skip_rpc.skip_rpc_with_json -- common/autotest_common.sh@955 -- # uname 00:08:48.284 11:19:43 skip_rpc.skip_rpc_with_json -- common/autotest_common.sh@955 -- # '[' Linux = Linux ']' 00:08:48.284 11:19:43 skip_rpc.skip_rpc_with_json -- common/autotest_common.sh@956 -- # ps --no-headers -o comm= 59012 00:08:48.284 killing process with pid 59012 00:08:48.284 11:19:43 skip_rpc.skip_rpc_with_json -- common/autotest_common.sh@956 -- # process_name=reactor_0 00:08:48.284 11:19:43 skip_rpc.skip_rpc_with_json -- common/autotest_common.sh@960 -- # '[' reactor_0 = sudo ']' 00:08:48.284 11:19:43 skip_rpc.skip_rpc_with_json -- common/autotest_common.sh@968 -- # echo 'killing process with pid 59012' 00:08:48.284 11:19:43 skip_rpc.skip_rpc_with_json -- common/autotest_common.sh@969 -- # kill 59012 00:08:48.284 11:19:43 skip_rpc.skip_rpc_with_json -- common/autotest_common.sh@974 -- # wait 59012 00:08:48.542 11:19:43 skip_rpc.skip_rpc_with_json -- rpc/skip_rpc.sh@51 -- # grep -q 'TCP Transport Init' /home/vagrant/spdk_repo/spdk/test/rpc/log.txt 00:08:48.542 11:19:43 skip_rpc.skip_rpc_with_json -- rpc/skip_rpc.sh@52 -- # rm /home/vagrant/spdk_repo/spdk/test/rpc/log.txt 00:08:48.542 ************************************ 00:08:48.542 END TEST skip_rpc_with_json 00:08:48.542 ************************************ 00:08:48.542 00:08:48.542 real 0m7.202s 00:08:48.542 user 0m6.995s 00:08:48.542 sys 0m0.687s 00:08:48.542 11:19:43 skip_rpc.skip_rpc_with_json -- common/autotest_common.sh@1126 -- # xtrace_disable 00:08:48.542 11:19:43 skip_rpc.skip_rpc_with_json -- common/autotest_common.sh@10 -- # set +x 00:08:48.542 11:19:43 skip_rpc -- rpc/skip_rpc.sh@75 -- # run_test skip_rpc_with_delay test_skip_rpc_with_delay 00:08:48.542 11:19:43 skip_rpc -- common/autotest_common.sh@1101 -- # '[' 2 -le 1 ']' 00:08:48.542 11:19:43 skip_rpc -- common/autotest_common.sh@1107 -- # xtrace_disable 00:08:48.542 11:19:43 skip_rpc -- common/autotest_common.sh@10 -- # set +x 00:08:48.542 ************************************ 00:08:48.542 START TEST skip_rpc_with_delay 00:08:48.542 ************************************ 00:08:48.542 11:19:44 skip_rpc.skip_rpc_with_delay -- common/autotest_common.sh@1125 -- # test_skip_rpc_with_delay 00:08:48.542 11:19:44 skip_rpc.skip_rpc_with_delay -- rpc/skip_rpc.sh@57 -- # NOT /home/vagrant/spdk_repo/spdk/build/bin/spdk_tgt --no-rpc-server -m 0x1 --wait-for-rpc 00:08:48.542 11:19:44 skip_rpc.skip_rpc_with_delay -- common/autotest_common.sh@650 -- # local es=0 00:08:48.542 11:19:44 skip_rpc.skip_rpc_with_delay -- common/autotest_common.sh@652 -- # valid_exec_arg /home/vagrant/spdk_repo/spdk/build/bin/spdk_tgt --no-rpc-server -m 0x1 --wait-for-rpc 00:08:48.542 11:19:44 skip_rpc.skip_rpc_with_delay -- common/autotest_common.sh@638 -- # local arg=/home/vagrant/spdk_repo/spdk/build/bin/spdk_tgt 00:08:48.542 11:19:44 skip_rpc.skip_rpc_with_delay -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:08:48.542 11:19:44 skip_rpc.skip_rpc_with_delay -- common/autotest_common.sh@642 -- # type -t /home/vagrant/spdk_repo/spdk/build/bin/spdk_tgt 00:08:48.542 11:19:44 skip_rpc.skip_rpc_with_delay -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:08:48.542 11:19:44 skip_rpc.skip_rpc_with_delay -- common/autotest_common.sh@644 -- # type -P /home/vagrant/spdk_repo/spdk/build/bin/spdk_tgt 00:08:48.542 11:19:44 skip_rpc.skip_rpc_with_delay -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:08:48.542 11:19:44 skip_rpc.skip_rpc_with_delay -- common/autotest_common.sh@644 -- # arg=/home/vagrant/spdk_repo/spdk/build/bin/spdk_tgt 00:08:48.542 11:19:44 skip_rpc.skip_rpc_with_delay -- common/autotest_common.sh@644 -- # [[ -x /home/vagrant/spdk_repo/spdk/build/bin/spdk_tgt ]] 00:08:48.542 11:19:44 skip_rpc.skip_rpc_with_delay -- common/autotest_common.sh@653 -- # /home/vagrant/spdk_repo/spdk/build/bin/spdk_tgt --no-rpc-server -m 0x1 --wait-for-rpc 00:08:48.802 [2024-10-07 11:19:44.067165] app.c: 840:spdk_app_start: *ERROR*: Cannot use '--wait-for-rpc' if no RPC server is going to be started. 00:08:48.802 [2024-10-07 11:19:44.067537] app.c: 719:unclaim_cpu_cores: *ERROR*: Failed to unlink lock fd for core 0, errno: 2 00:08:48.802 11:19:44 skip_rpc.skip_rpc_with_delay -- common/autotest_common.sh@653 -- # es=1 00:08:48.802 11:19:44 skip_rpc.skip_rpc_with_delay -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:08:48.802 11:19:44 skip_rpc.skip_rpc_with_delay -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:08:48.802 11:19:44 skip_rpc.skip_rpc_with_delay -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:08:48.802 00:08:48.802 real 0m0.077s 00:08:48.802 user 0m0.046s 00:08:48.802 sys 0m0.030s 00:08:48.802 11:19:44 skip_rpc.skip_rpc_with_delay -- common/autotest_common.sh@1126 -- # xtrace_disable 00:08:48.802 ************************************ 00:08:48.802 END TEST skip_rpc_with_delay 00:08:48.802 ************************************ 00:08:48.802 11:19:44 skip_rpc.skip_rpc_with_delay -- common/autotest_common.sh@10 -- # set +x 00:08:48.802 11:19:44 skip_rpc -- rpc/skip_rpc.sh@77 -- # uname 00:08:48.802 11:19:44 skip_rpc -- rpc/skip_rpc.sh@77 -- # '[' Linux '!=' FreeBSD ']' 00:08:48.802 11:19:44 skip_rpc -- rpc/skip_rpc.sh@78 -- # run_test exit_on_failed_rpc_init test_exit_on_failed_rpc_init 00:08:48.802 11:19:44 skip_rpc -- common/autotest_common.sh@1101 -- # '[' 2 -le 1 ']' 00:08:48.802 11:19:44 skip_rpc -- common/autotest_common.sh@1107 -- # xtrace_disable 00:08:48.802 11:19:44 skip_rpc -- common/autotest_common.sh@10 -- # set +x 00:08:48.802 ************************************ 00:08:48.802 START TEST exit_on_failed_rpc_init 00:08:48.802 ************************************ 00:08:48.802 11:19:44 skip_rpc.exit_on_failed_rpc_init -- common/autotest_common.sh@1125 -- # test_exit_on_failed_rpc_init 00:08:48.802 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:08:48.802 11:19:44 skip_rpc.exit_on_failed_rpc_init -- rpc/skip_rpc.sh@62 -- # local spdk_pid=59122 00:08:48.803 11:19:44 skip_rpc.exit_on_failed_rpc_init -- rpc/skip_rpc.sh@63 -- # waitforlisten 59122 00:08:48.803 11:19:44 skip_rpc.exit_on_failed_rpc_init -- rpc/skip_rpc.sh@61 -- # /home/vagrant/spdk_repo/spdk/build/bin/spdk_tgt -m 0x1 00:08:48.803 11:19:44 skip_rpc.exit_on_failed_rpc_init -- common/autotest_common.sh@831 -- # '[' -z 59122 ']' 00:08:48.803 11:19:44 skip_rpc.exit_on_failed_rpc_init -- common/autotest_common.sh@835 -- # local rpc_addr=/var/tmp/spdk.sock 00:08:48.803 11:19:44 skip_rpc.exit_on_failed_rpc_init -- common/autotest_common.sh@836 -- # local max_retries=100 00:08:48.803 11:19:44 skip_rpc.exit_on_failed_rpc_init -- common/autotest_common.sh@838 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:08:48.803 11:19:44 skip_rpc.exit_on_failed_rpc_init -- common/autotest_common.sh@840 -- # xtrace_disable 00:08:48.803 11:19:44 skip_rpc.exit_on_failed_rpc_init -- common/autotest_common.sh@10 -- # set +x 00:08:48.803 [2024-10-07 11:19:44.196003] Starting SPDK v25.01-pre git sha1 2a4f56c54 / DPDK 24.03.0 initialization... 00:08:48.803 [2024-10-07 11:19:44.196095] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --iova-mode=pa --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid59122 ] 00:08:49.120 [2024-10-07 11:19:44.330159] app.c: 917:spdk_app_start: *NOTICE*: Total cores available: 1 00:08:49.120 [2024-10-07 11:19:44.446628] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 0 00:08:50.055 11:19:45 skip_rpc.exit_on_failed_rpc_init -- common/autotest_common.sh@860 -- # (( i == 0 )) 00:08:50.055 11:19:45 skip_rpc.exit_on_failed_rpc_init -- common/autotest_common.sh@864 -- # return 0 00:08:50.055 11:19:45 skip_rpc.exit_on_failed_rpc_init -- rpc/skip_rpc.sh@65 -- # trap 'killprocess $spdk_pid; exit 1' SIGINT SIGTERM EXIT 00:08:50.055 11:19:45 skip_rpc.exit_on_failed_rpc_init -- rpc/skip_rpc.sh@67 -- # NOT /home/vagrant/spdk_repo/spdk/build/bin/spdk_tgt -m 0x2 00:08:50.055 11:19:45 skip_rpc.exit_on_failed_rpc_init -- common/autotest_common.sh@650 -- # local es=0 00:08:50.055 11:19:45 skip_rpc.exit_on_failed_rpc_init -- common/autotest_common.sh@652 -- # valid_exec_arg /home/vagrant/spdk_repo/spdk/build/bin/spdk_tgt -m 0x2 00:08:50.055 11:19:45 skip_rpc.exit_on_failed_rpc_init -- common/autotest_common.sh@638 -- # local arg=/home/vagrant/spdk_repo/spdk/build/bin/spdk_tgt 00:08:50.055 11:19:45 skip_rpc.exit_on_failed_rpc_init -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:08:50.055 11:19:45 skip_rpc.exit_on_failed_rpc_init -- common/autotest_common.sh@642 -- # type -t /home/vagrant/spdk_repo/spdk/build/bin/spdk_tgt 00:08:50.055 11:19:45 skip_rpc.exit_on_failed_rpc_init -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:08:50.055 11:19:45 skip_rpc.exit_on_failed_rpc_init -- common/autotest_common.sh@644 -- # type -P /home/vagrant/spdk_repo/spdk/build/bin/spdk_tgt 00:08:50.055 11:19:45 skip_rpc.exit_on_failed_rpc_init -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:08:50.055 11:19:45 skip_rpc.exit_on_failed_rpc_init -- common/autotest_common.sh@644 -- # arg=/home/vagrant/spdk_repo/spdk/build/bin/spdk_tgt 00:08:50.055 11:19:45 skip_rpc.exit_on_failed_rpc_init -- common/autotest_common.sh@644 -- # [[ -x /home/vagrant/spdk_repo/spdk/build/bin/spdk_tgt ]] 00:08:50.055 11:19:45 skip_rpc.exit_on_failed_rpc_init -- common/autotest_common.sh@653 -- # /home/vagrant/spdk_repo/spdk/build/bin/spdk_tgt -m 0x2 00:08:50.055 [2024-10-07 11:19:45.343267] Starting SPDK v25.01-pre git sha1 2a4f56c54 / DPDK 24.03.0 initialization... 00:08:50.055 [2024-10-07 11:19:45.343370] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x2 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --iova-mode=pa --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid59152 ] 00:08:50.055 [2024-10-07 11:19:45.483818] app.c: 917:spdk_app_start: *NOTICE*: Total cores available: 1 00:08:50.315 [2024-10-07 11:19:45.610236] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 1 00:08:50.315 [2024-10-07 11:19:45.610338] rpc.c: 180:_spdk_rpc_listen: *ERROR*: RPC Unix domain socket path /var/tmp/spdk.sock in use. Specify another. 00:08:50.315 [2024-10-07 11:19:45.610356] rpc.c: 166:spdk_rpc_initialize: *ERROR*: Unable to start RPC service at /var/tmp/spdk.sock 00:08:50.315 [2024-10-07 11:19:45.610367] app.c:1062:spdk_app_stop: *WARNING*: spdk_app_stop'd on non-zero 00:08:50.315 11:19:45 skip_rpc.exit_on_failed_rpc_init -- common/autotest_common.sh@653 -- # es=234 00:08:50.315 11:19:45 skip_rpc.exit_on_failed_rpc_init -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:08:50.315 11:19:45 skip_rpc.exit_on_failed_rpc_init -- common/autotest_common.sh@662 -- # es=106 00:08:50.315 11:19:45 skip_rpc.exit_on_failed_rpc_init -- common/autotest_common.sh@663 -- # case "$es" in 00:08:50.315 11:19:45 skip_rpc.exit_on_failed_rpc_init -- common/autotest_common.sh@670 -- # es=1 00:08:50.315 11:19:45 skip_rpc.exit_on_failed_rpc_init -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:08:50.315 11:19:45 skip_rpc.exit_on_failed_rpc_init -- rpc/skip_rpc.sh@69 -- # trap - SIGINT SIGTERM EXIT 00:08:50.315 11:19:45 skip_rpc.exit_on_failed_rpc_init -- rpc/skip_rpc.sh@70 -- # killprocess 59122 00:08:50.315 11:19:45 skip_rpc.exit_on_failed_rpc_init -- common/autotest_common.sh@950 -- # '[' -z 59122 ']' 00:08:50.315 11:19:45 skip_rpc.exit_on_failed_rpc_init -- common/autotest_common.sh@954 -- # kill -0 59122 00:08:50.315 11:19:45 skip_rpc.exit_on_failed_rpc_init -- common/autotest_common.sh@955 -- # uname 00:08:50.315 11:19:45 skip_rpc.exit_on_failed_rpc_init -- common/autotest_common.sh@955 -- # '[' Linux = Linux ']' 00:08:50.315 11:19:45 skip_rpc.exit_on_failed_rpc_init -- common/autotest_common.sh@956 -- # ps --no-headers -o comm= 59122 00:08:50.315 killing process with pid 59122 00:08:50.315 11:19:45 skip_rpc.exit_on_failed_rpc_init -- common/autotest_common.sh@956 -- # process_name=reactor_0 00:08:50.315 11:19:45 skip_rpc.exit_on_failed_rpc_init -- common/autotest_common.sh@960 -- # '[' reactor_0 = sudo ']' 00:08:50.315 11:19:45 skip_rpc.exit_on_failed_rpc_init -- common/autotest_common.sh@968 -- # echo 'killing process with pid 59122' 00:08:50.315 11:19:45 skip_rpc.exit_on_failed_rpc_init -- common/autotest_common.sh@969 -- # kill 59122 00:08:50.315 11:19:45 skip_rpc.exit_on_failed_rpc_init -- common/autotest_common.sh@974 -- # wait 59122 00:08:50.882 ************************************ 00:08:50.882 END TEST exit_on_failed_rpc_init 00:08:50.882 ************************************ 00:08:50.882 00:08:50.882 real 0m2.014s 00:08:50.882 user 0m2.425s 00:08:50.882 sys 0m0.466s 00:08:50.882 11:19:46 skip_rpc.exit_on_failed_rpc_init -- common/autotest_common.sh@1126 -- # xtrace_disable 00:08:50.882 11:19:46 skip_rpc.exit_on_failed_rpc_init -- common/autotest_common.sh@10 -- # set +x 00:08:50.882 11:19:46 skip_rpc -- rpc/skip_rpc.sh@81 -- # rm /home/vagrant/spdk_repo/spdk/test/rpc/config.json 00:08:50.882 ************************************ 00:08:50.882 END TEST skip_rpc 00:08:50.882 ************************************ 00:08:50.882 00:08:50.882 real 0m15.172s 00:08:50.882 user 0m14.733s 00:08:50.882 sys 0m1.691s 00:08:50.882 11:19:46 skip_rpc -- common/autotest_common.sh@1126 -- # xtrace_disable 00:08:50.882 11:19:46 skip_rpc -- common/autotest_common.sh@10 -- # set +x 00:08:50.882 11:19:46 -- spdk/autotest.sh@158 -- # run_test rpc_client /home/vagrant/spdk_repo/spdk/test/rpc_client/rpc_client.sh 00:08:50.882 11:19:46 -- common/autotest_common.sh@1101 -- # '[' 2 -le 1 ']' 00:08:50.882 11:19:46 -- common/autotest_common.sh@1107 -- # xtrace_disable 00:08:50.882 11:19:46 -- common/autotest_common.sh@10 -- # set +x 00:08:50.882 ************************************ 00:08:50.882 START TEST rpc_client 00:08:50.882 ************************************ 00:08:50.882 11:19:46 rpc_client -- common/autotest_common.sh@1125 -- # /home/vagrant/spdk_repo/spdk/test/rpc_client/rpc_client.sh 00:08:50.882 * Looking for test storage... 00:08:50.882 * Found test storage at /home/vagrant/spdk_repo/spdk/test/rpc_client 00:08:50.882 11:19:46 rpc_client -- common/autotest_common.sh@1680 -- # [[ y == y ]] 00:08:50.882 11:19:46 rpc_client -- common/autotest_common.sh@1681 -- # awk '{print $NF}' 00:08:50.882 11:19:46 rpc_client -- common/autotest_common.sh@1681 -- # lcov --version 00:08:50.882 11:19:46 rpc_client -- common/autotest_common.sh@1681 -- # lt 1.15 2 00:08:50.883 11:19:46 rpc_client -- scripts/common.sh@373 -- # cmp_versions 1.15 '<' 2 00:08:50.883 11:19:46 rpc_client -- scripts/common.sh@333 -- # local ver1 ver1_l 00:08:50.883 11:19:46 rpc_client -- scripts/common.sh@334 -- # local ver2 ver2_l 00:08:50.883 11:19:46 rpc_client -- scripts/common.sh@336 -- # IFS=.-: 00:08:50.883 11:19:46 rpc_client -- scripts/common.sh@336 -- # read -ra ver1 00:08:50.883 11:19:46 rpc_client -- scripts/common.sh@337 -- # IFS=.-: 00:08:50.883 11:19:46 rpc_client -- scripts/common.sh@337 -- # read -ra ver2 00:08:50.883 11:19:46 rpc_client -- scripts/common.sh@338 -- # local 'op=<' 00:08:50.883 11:19:46 rpc_client -- scripts/common.sh@340 -- # ver1_l=2 00:08:50.883 11:19:46 rpc_client -- scripts/common.sh@341 -- # ver2_l=1 00:08:50.883 11:19:46 rpc_client -- scripts/common.sh@343 -- # local lt=0 gt=0 eq=0 v 00:08:50.883 11:19:46 rpc_client -- scripts/common.sh@344 -- # case "$op" in 00:08:50.883 11:19:46 rpc_client -- scripts/common.sh@345 -- # : 1 00:08:50.883 11:19:46 rpc_client -- scripts/common.sh@364 -- # (( v = 0 )) 00:08:50.883 11:19:46 rpc_client -- scripts/common.sh@364 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:08:50.883 11:19:46 rpc_client -- scripts/common.sh@365 -- # decimal 1 00:08:51.142 11:19:46 rpc_client -- scripts/common.sh@353 -- # local d=1 00:08:51.142 11:19:46 rpc_client -- scripts/common.sh@354 -- # [[ 1 =~ ^[0-9]+$ ]] 00:08:51.142 11:19:46 rpc_client -- scripts/common.sh@355 -- # echo 1 00:08:51.142 11:19:46 rpc_client -- scripts/common.sh@365 -- # ver1[v]=1 00:08:51.142 11:19:46 rpc_client -- scripts/common.sh@366 -- # decimal 2 00:08:51.142 11:19:46 rpc_client -- scripts/common.sh@353 -- # local d=2 00:08:51.142 11:19:46 rpc_client -- scripts/common.sh@354 -- # [[ 2 =~ ^[0-9]+$ ]] 00:08:51.142 11:19:46 rpc_client -- scripts/common.sh@355 -- # echo 2 00:08:51.142 11:19:46 rpc_client -- scripts/common.sh@366 -- # ver2[v]=2 00:08:51.142 11:19:46 rpc_client -- scripts/common.sh@367 -- # (( ver1[v] > ver2[v] )) 00:08:51.142 11:19:46 rpc_client -- scripts/common.sh@368 -- # (( ver1[v] < ver2[v] )) 00:08:51.142 11:19:46 rpc_client -- scripts/common.sh@368 -- # return 0 00:08:51.142 11:19:46 rpc_client -- common/autotest_common.sh@1682 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:08:51.142 11:19:46 rpc_client -- common/autotest_common.sh@1694 -- # export 'LCOV_OPTS= 00:08:51.142 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:08:51.142 --rc genhtml_branch_coverage=1 00:08:51.142 --rc genhtml_function_coverage=1 00:08:51.142 --rc genhtml_legend=1 00:08:51.142 --rc geninfo_all_blocks=1 00:08:51.142 --rc geninfo_unexecuted_blocks=1 00:08:51.142 00:08:51.142 ' 00:08:51.142 11:19:46 rpc_client -- common/autotest_common.sh@1694 -- # LCOV_OPTS=' 00:08:51.142 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:08:51.142 --rc genhtml_branch_coverage=1 00:08:51.142 --rc genhtml_function_coverage=1 00:08:51.142 --rc genhtml_legend=1 00:08:51.142 --rc geninfo_all_blocks=1 00:08:51.142 --rc geninfo_unexecuted_blocks=1 00:08:51.142 00:08:51.142 ' 00:08:51.142 11:19:46 rpc_client -- common/autotest_common.sh@1695 -- # export 'LCOV=lcov 00:08:51.142 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:08:51.142 --rc genhtml_branch_coverage=1 00:08:51.142 --rc genhtml_function_coverage=1 00:08:51.142 --rc genhtml_legend=1 00:08:51.142 --rc geninfo_all_blocks=1 00:08:51.142 --rc geninfo_unexecuted_blocks=1 00:08:51.142 00:08:51.142 ' 00:08:51.142 11:19:46 rpc_client -- common/autotest_common.sh@1695 -- # LCOV='lcov 00:08:51.142 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:08:51.142 --rc genhtml_branch_coverage=1 00:08:51.142 --rc genhtml_function_coverage=1 00:08:51.142 --rc genhtml_legend=1 00:08:51.142 --rc geninfo_all_blocks=1 00:08:51.142 --rc geninfo_unexecuted_blocks=1 00:08:51.142 00:08:51.142 ' 00:08:51.142 11:19:46 rpc_client -- rpc_client/rpc_client.sh@10 -- # /home/vagrant/spdk_repo/spdk/test/rpc_client/rpc_client_test 00:08:51.142 OK 00:08:51.142 11:19:46 rpc_client -- rpc_client/rpc_client.sh@12 -- # trap - SIGINT SIGTERM EXIT 00:08:51.142 00:08:51.142 real 0m0.198s 00:08:51.142 user 0m0.125s 00:08:51.142 sys 0m0.083s 00:08:51.142 ************************************ 00:08:51.142 END TEST rpc_client 00:08:51.142 ************************************ 00:08:51.142 11:19:46 rpc_client -- common/autotest_common.sh@1126 -- # xtrace_disable 00:08:51.142 11:19:46 rpc_client -- common/autotest_common.sh@10 -- # set +x 00:08:51.142 11:19:46 -- spdk/autotest.sh@159 -- # run_test json_config /home/vagrant/spdk_repo/spdk/test/json_config/json_config.sh 00:08:51.142 11:19:46 -- common/autotest_common.sh@1101 -- # '[' 2 -le 1 ']' 00:08:51.142 11:19:46 -- common/autotest_common.sh@1107 -- # xtrace_disable 00:08:51.142 11:19:46 -- common/autotest_common.sh@10 -- # set +x 00:08:51.142 ************************************ 00:08:51.142 START TEST json_config 00:08:51.142 ************************************ 00:08:51.142 11:19:46 json_config -- common/autotest_common.sh@1125 -- # /home/vagrant/spdk_repo/spdk/test/json_config/json_config.sh 00:08:51.142 11:19:46 json_config -- common/autotest_common.sh@1680 -- # [[ y == y ]] 00:08:51.142 11:19:46 json_config -- common/autotest_common.sh@1681 -- # lcov --version 00:08:51.142 11:19:46 json_config -- common/autotest_common.sh@1681 -- # awk '{print $NF}' 00:08:51.142 11:19:46 json_config -- common/autotest_common.sh@1681 -- # lt 1.15 2 00:08:51.142 11:19:46 json_config -- scripts/common.sh@373 -- # cmp_versions 1.15 '<' 2 00:08:51.142 11:19:46 json_config -- scripts/common.sh@333 -- # local ver1 ver1_l 00:08:51.142 11:19:46 json_config -- scripts/common.sh@334 -- # local ver2 ver2_l 00:08:51.142 11:19:46 json_config -- scripts/common.sh@336 -- # IFS=.-: 00:08:51.142 11:19:46 json_config -- scripts/common.sh@336 -- # read -ra ver1 00:08:51.142 11:19:46 json_config -- scripts/common.sh@337 -- # IFS=.-: 00:08:51.142 11:19:46 json_config -- scripts/common.sh@337 -- # read -ra ver2 00:08:51.142 11:19:46 json_config -- scripts/common.sh@338 -- # local 'op=<' 00:08:51.142 11:19:46 json_config -- scripts/common.sh@340 -- # ver1_l=2 00:08:51.142 11:19:46 json_config -- scripts/common.sh@341 -- # ver2_l=1 00:08:51.142 11:19:46 json_config -- scripts/common.sh@343 -- # local lt=0 gt=0 eq=0 v 00:08:51.142 11:19:46 json_config -- scripts/common.sh@344 -- # case "$op" in 00:08:51.142 11:19:46 json_config -- scripts/common.sh@345 -- # : 1 00:08:51.143 11:19:46 json_config -- scripts/common.sh@364 -- # (( v = 0 )) 00:08:51.143 11:19:46 json_config -- scripts/common.sh@364 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:08:51.143 11:19:46 json_config -- scripts/common.sh@365 -- # decimal 1 00:08:51.143 11:19:46 json_config -- scripts/common.sh@353 -- # local d=1 00:08:51.143 11:19:46 json_config -- scripts/common.sh@354 -- # [[ 1 =~ ^[0-9]+$ ]] 00:08:51.143 11:19:46 json_config -- scripts/common.sh@355 -- # echo 1 00:08:51.143 11:19:46 json_config -- scripts/common.sh@365 -- # ver1[v]=1 00:08:51.143 11:19:46 json_config -- scripts/common.sh@366 -- # decimal 2 00:08:51.143 11:19:46 json_config -- scripts/common.sh@353 -- # local d=2 00:08:51.143 11:19:46 json_config -- scripts/common.sh@354 -- # [[ 2 =~ ^[0-9]+$ ]] 00:08:51.143 11:19:46 json_config -- scripts/common.sh@355 -- # echo 2 00:08:51.143 11:19:46 json_config -- scripts/common.sh@366 -- # ver2[v]=2 00:08:51.143 11:19:46 json_config -- scripts/common.sh@367 -- # (( ver1[v] > ver2[v] )) 00:08:51.143 11:19:46 json_config -- scripts/common.sh@368 -- # (( ver1[v] < ver2[v] )) 00:08:51.143 11:19:46 json_config -- scripts/common.sh@368 -- # return 0 00:08:51.143 11:19:46 json_config -- common/autotest_common.sh@1682 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:08:51.143 11:19:46 json_config -- common/autotest_common.sh@1694 -- # export 'LCOV_OPTS= 00:08:51.143 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:08:51.143 --rc genhtml_branch_coverage=1 00:08:51.143 --rc genhtml_function_coverage=1 00:08:51.143 --rc genhtml_legend=1 00:08:51.143 --rc geninfo_all_blocks=1 00:08:51.143 --rc geninfo_unexecuted_blocks=1 00:08:51.143 00:08:51.143 ' 00:08:51.143 11:19:46 json_config -- common/autotest_common.sh@1694 -- # LCOV_OPTS=' 00:08:51.143 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:08:51.143 --rc genhtml_branch_coverage=1 00:08:51.143 --rc genhtml_function_coverage=1 00:08:51.143 --rc genhtml_legend=1 00:08:51.143 --rc geninfo_all_blocks=1 00:08:51.143 --rc geninfo_unexecuted_blocks=1 00:08:51.143 00:08:51.143 ' 00:08:51.143 11:19:46 json_config -- common/autotest_common.sh@1695 -- # export 'LCOV=lcov 00:08:51.143 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:08:51.143 --rc genhtml_branch_coverage=1 00:08:51.143 --rc genhtml_function_coverage=1 00:08:51.143 --rc genhtml_legend=1 00:08:51.143 --rc geninfo_all_blocks=1 00:08:51.143 --rc geninfo_unexecuted_blocks=1 00:08:51.143 00:08:51.143 ' 00:08:51.143 11:19:46 json_config -- common/autotest_common.sh@1695 -- # LCOV='lcov 00:08:51.143 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:08:51.143 --rc genhtml_branch_coverage=1 00:08:51.143 --rc genhtml_function_coverage=1 00:08:51.143 --rc genhtml_legend=1 00:08:51.143 --rc geninfo_all_blocks=1 00:08:51.143 --rc geninfo_unexecuted_blocks=1 00:08:51.143 00:08:51.143 ' 00:08:51.143 11:19:46 json_config -- json_config/json_config.sh@8 -- # source /home/vagrant/spdk_repo/spdk/test/nvmf/common.sh 00:08:51.143 11:19:46 json_config -- nvmf/common.sh@7 -- # uname -s 00:08:51.143 11:19:46 json_config -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:08:51.143 11:19:46 json_config -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:08:51.143 11:19:46 json_config -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:08:51.143 11:19:46 json_config -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:08:51.143 11:19:46 json_config -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:08:51.143 11:19:46 json_config -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:08:51.143 11:19:46 json_config -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:08:51.143 11:19:46 json_config -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:08:51.143 11:19:46 json_config -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:08:51.143 11:19:46 json_config -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:08:51.143 11:19:46 json_config -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:c758a4ed-f09f-4c82-9afb-3d096f035464 00:08:51.143 11:19:46 json_config -- nvmf/common.sh@18 -- # NVME_HOSTID=c758a4ed-f09f-4c82-9afb-3d096f035464 00:08:51.143 11:19:46 json_config -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:08:51.143 11:19:46 json_config -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:08:51.143 11:19:46 json_config -- nvmf/common.sh@21 -- # NET_TYPE=phy-fallback 00:08:51.143 11:19:46 json_config -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:08:51.143 11:19:46 json_config -- nvmf/common.sh@49 -- # source /home/vagrant/spdk_repo/spdk/scripts/common.sh 00:08:51.143 11:19:46 json_config -- scripts/common.sh@15 -- # shopt -s extglob 00:08:51.143 11:19:46 json_config -- scripts/common.sh@544 -- # [[ -e /bin/wpdk_common.sh ]] 00:08:51.143 11:19:46 json_config -- scripts/common.sh@552 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:08:51.143 11:19:46 json_config -- scripts/common.sh@553 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:08:51.143 11:19:46 json_config -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:08:51.143 11:19:46 json_config -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:08:51.143 11:19:46 json_config -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:08:51.143 11:19:46 json_config -- paths/export.sh@5 -- # export PATH 00:08:51.143 11:19:46 json_config -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:08:51.143 11:19:46 json_config -- nvmf/common.sh@51 -- # : 0 00:08:51.143 11:19:46 json_config -- nvmf/common.sh@52 -- # export NVMF_APP_SHM_ID 00:08:51.143 11:19:46 json_config -- nvmf/common.sh@53 -- # build_nvmf_app_args 00:08:51.143 11:19:46 json_config -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:08:51.143 11:19:46 json_config -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:08:51.143 11:19:46 json_config -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:08:51.143 11:19:46 json_config -- nvmf/common.sh@33 -- # '[' '' -eq 1 ']' 00:08:51.143 /home/vagrant/spdk_repo/spdk/test/nvmf/common.sh: line 33: [: : integer expression expected 00:08:51.143 11:19:46 json_config -- nvmf/common.sh@37 -- # '[' -n '' ']' 00:08:51.143 11:19:46 json_config -- nvmf/common.sh@39 -- # '[' 0 -eq 1 ']' 00:08:51.143 11:19:46 json_config -- nvmf/common.sh@55 -- # have_pci_nics=0 00:08:51.143 11:19:46 json_config -- json_config/json_config.sh@9 -- # source /home/vagrant/spdk_repo/spdk/test/json_config/common.sh 00:08:51.143 11:19:46 json_config -- json_config/json_config.sh@11 -- # [[ 0 -eq 1 ]] 00:08:51.143 11:19:46 json_config -- json_config/json_config.sh@15 -- # [[ 0 -ne 1 ]] 00:08:51.143 11:19:46 json_config -- json_config/json_config.sh@15 -- # [[ 0 -eq 1 ]] 00:08:51.143 11:19:46 json_config -- json_config/json_config.sh@26 -- # (( SPDK_TEST_BLOCKDEV + SPDK_TEST_ISCSI + SPDK_TEST_NVMF + SPDK_TEST_VHOST + SPDK_TEST_VHOST_INIT + SPDK_TEST_RBD == 0 )) 00:08:51.143 11:19:46 json_config -- json_config/json_config.sh@31 -- # app_pid=(['target']='' ['initiator']='') 00:08:51.143 11:19:46 json_config -- json_config/json_config.sh@31 -- # declare -A app_pid 00:08:51.143 11:19:46 json_config -- json_config/json_config.sh@32 -- # app_socket=(['target']='/var/tmp/spdk_tgt.sock' ['initiator']='/var/tmp/spdk_initiator.sock') 00:08:51.143 11:19:46 json_config -- json_config/json_config.sh@32 -- # declare -A app_socket 00:08:51.143 11:19:46 json_config -- json_config/json_config.sh@33 -- # app_params=(['target']='-m 0x1 -s 1024' ['initiator']='-m 0x2 -g -u -s 1024') 00:08:51.143 11:19:46 json_config -- json_config/json_config.sh@33 -- # declare -A app_params 00:08:51.143 11:19:46 json_config -- json_config/json_config.sh@34 -- # configs_path=(['target']='/home/vagrant/spdk_repo/spdk/spdk_tgt_config.json' ['initiator']='/home/vagrant/spdk_repo/spdk/spdk_initiator_config.json') 00:08:51.143 11:19:46 json_config -- json_config/json_config.sh@34 -- # declare -A configs_path 00:08:51.143 INFO: JSON configuration test init 00:08:51.143 11:19:46 json_config -- json_config/json_config.sh@40 -- # last_event_id=0 00:08:51.143 11:19:46 json_config -- json_config/json_config.sh@362 -- # trap 'on_error_exit "${FUNCNAME}" "${LINENO}"' ERR 00:08:51.143 11:19:46 json_config -- json_config/json_config.sh@363 -- # echo 'INFO: JSON configuration test init' 00:08:51.143 11:19:46 json_config -- json_config/json_config.sh@364 -- # json_config_test_init 00:08:51.143 11:19:46 json_config -- json_config/json_config.sh@269 -- # timing_enter json_config_test_init 00:08:51.143 11:19:46 json_config -- common/autotest_common.sh@724 -- # xtrace_disable 00:08:51.143 11:19:46 json_config -- common/autotest_common.sh@10 -- # set +x 00:08:51.402 11:19:46 json_config -- json_config/json_config.sh@270 -- # timing_enter json_config_setup_target 00:08:51.402 11:19:46 json_config -- common/autotest_common.sh@724 -- # xtrace_disable 00:08:51.402 11:19:46 json_config -- common/autotest_common.sh@10 -- # set +x 00:08:51.402 Waiting for target to run... 00:08:51.402 11:19:46 json_config -- json_config/json_config.sh@272 -- # json_config_test_start_app target --wait-for-rpc 00:08:51.402 11:19:46 json_config -- json_config/common.sh@9 -- # local app=target 00:08:51.402 11:19:46 json_config -- json_config/common.sh@10 -- # shift 00:08:51.402 11:19:46 json_config -- json_config/common.sh@12 -- # [[ -n 22 ]] 00:08:51.402 11:19:46 json_config -- json_config/common.sh@13 -- # [[ -z '' ]] 00:08:51.402 11:19:46 json_config -- json_config/common.sh@15 -- # local app_extra_params= 00:08:51.402 11:19:46 json_config -- json_config/common.sh@16 -- # [[ 0 -eq 1 ]] 00:08:51.402 11:19:46 json_config -- json_config/common.sh@16 -- # [[ 0 -eq 1 ]] 00:08:51.402 11:19:46 json_config -- json_config/common.sh@22 -- # app_pid["$app"]=59291 00:08:51.402 11:19:46 json_config -- json_config/common.sh@24 -- # echo 'Waiting for target to run...' 00:08:51.402 11:19:46 json_config -- json_config/common.sh@25 -- # waitforlisten 59291 /var/tmp/spdk_tgt.sock 00:08:51.402 11:19:46 json_config -- json_config/common.sh@21 -- # /home/vagrant/spdk_repo/spdk/build/bin/spdk_tgt -m 0x1 -s 1024 -r /var/tmp/spdk_tgt.sock --wait-for-rpc 00:08:51.402 11:19:46 json_config -- common/autotest_common.sh@831 -- # '[' -z 59291 ']' 00:08:51.402 11:19:46 json_config -- common/autotest_common.sh@835 -- # local rpc_addr=/var/tmp/spdk_tgt.sock 00:08:51.402 11:19:46 json_config -- common/autotest_common.sh@836 -- # local max_retries=100 00:08:51.402 11:19:46 json_config -- common/autotest_common.sh@838 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk_tgt.sock...' 00:08:51.402 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk_tgt.sock... 00:08:51.402 11:19:46 json_config -- common/autotest_common.sh@840 -- # xtrace_disable 00:08:51.402 11:19:46 json_config -- common/autotest_common.sh@10 -- # set +x 00:08:51.402 [2024-10-07 11:19:46.746429] Starting SPDK v25.01-pre git sha1 2a4f56c54 / DPDK 24.03.0 initialization... 00:08:51.402 [2024-10-07 11:19:46.746716] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 -m 1024 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --iova-mode=pa --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid59291 ] 00:08:51.660 [2024-10-07 11:19:47.171842] app.c: 917:spdk_app_start: *NOTICE*: Total cores available: 1 00:08:51.919 [2024-10-07 11:19:47.259422] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 0 00:08:52.512 11:19:47 json_config -- common/autotest_common.sh@860 -- # (( i == 0 )) 00:08:52.512 11:19:47 json_config -- common/autotest_common.sh@864 -- # return 0 00:08:52.512 11:19:47 json_config -- json_config/common.sh@26 -- # echo '' 00:08:52.512 00:08:52.512 11:19:47 json_config -- json_config/json_config.sh@276 -- # create_accel_config 00:08:52.512 11:19:47 json_config -- json_config/json_config.sh@100 -- # timing_enter create_accel_config 00:08:52.512 11:19:47 json_config -- common/autotest_common.sh@724 -- # xtrace_disable 00:08:52.512 11:19:47 json_config -- common/autotest_common.sh@10 -- # set +x 00:08:52.512 11:19:47 json_config -- json_config/json_config.sh@102 -- # [[ 0 -eq 1 ]] 00:08:52.512 11:19:47 json_config -- json_config/json_config.sh@108 -- # timing_exit create_accel_config 00:08:52.512 11:19:47 json_config -- common/autotest_common.sh@730 -- # xtrace_disable 00:08:52.512 11:19:47 json_config -- common/autotest_common.sh@10 -- # set +x 00:08:52.512 11:19:47 json_config -- json_config/json_config.sh@280 -- # /home/vagrant/spdk_repo/spdk/scripts/gen_nvme.sh --json-with-subsystems 00:08:52.512 11:19:47 json_config -- json_config/json_config.sh@281 -- # tgt_rpc load_config 00:08:52.512 11:19:47 json_config -- json_config/common.sh@57 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock load_config 00:08:53.085 11:19:48 json_config -- json_config/json_config.sh@283 -- # tgt_check_notification_types 00:08:53.085 11:19:48 json_config -- json_config/json_config.sh@43 -- # timing_enter tgt_check_notification_types 00:08:53.085 11:19:48 json_config -- common/autotest_common.sh@724 -- # xtrace_disable 00:08:53.085 11:19:48 json_config -- common/autotest_common.sh@10 -- # set +x 00:08:53.085 11:19:48 json_config -- json_config/json_config.sh@45 -- # local ret=0 00:08:53.085 11:19:48 json_config -- json_config/json_config.sh@46 -- # enabled_types=('bdev_register' 'bdev_unregister') 00:08:53.085 11:19:48 json_config -- json_config/json_config.sh@46 -- # local enabled_types 00:08:53.085 11:19:48 json_config -- json_config/json_config.sh@47 -- # [[ y == y ]] 00:08:53.085 11:19:48 json_config -- json_config/json_config.sh@48 -- # enabled_types+=("fsdev_register" "fsdev_unregister") 00:08:53.085 11:19:48 json_config -- json_config/json_config.sh@51 -- # tgt_rpc notify_get_types 00:08:53.085 11:19:48 json_config -- json_config/json_config.sh@51 -- # jq -r '.[]' 00:08:53.085 11:19:48 json_config -- json_config/common.sh@57 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock notify_get_types 00:08:53.342 11:19:48 json_config -- json_config/json_config.sh@51 -- # get_types=('fsdev_register' 'fsdev_unregister' 'bdev_register' 'bdev_unregister') 00:08:53.342 11:19:48 json_config -- json_config/json_config.sh@51 -- # local get_types 00:08:53.342 11:19:48 json_config -- json_config/json_config.sh@53 -- # local type_diff 00:08:53.342 11:19:48 json_config -- json_config/json_config.sh@54 -- # tr ' ' '\n' 00:08:53.342 11:19:48 json_config -- json_config/json_config.sh@54 -- # echo bdev_register bdev_unregister fsdev_register fsdev_unregister fsdev_register fsdev_unregister bdev_register bdev_unregister 00:08:53.342 11:19:48 json_config -- json_config/json_config.sh@54 -- # uniq -u 00:08:53.342 11:19:48 json_config -- json_config/json_config.sh@54 -- # sort 00:08:53.342 11:19:48 json_config -- json_config/json_config.sh@54 -- # type_diff= 00:08:53.342 11:19:48 json_config -- json_config/json_config.sh@56 -- # [[ -n '' ]] 00:08:53.342 11:19:48 json_config -- json_config/json_config.sh@61 -- # timing_exit tgt_check_notification_types 00:08:53.342 11:19:48 json_config -- common/autotest_common.sh@730 -- # xtrace_disable 00:08:53.342 11:19:48 json_config -- common/autotest_common.sh@10 -- # set +x 00:08:53.342 11:19:48 json_config -- json_config/json_config.sh@62 -- # return 0 00:08:53.342 11:19:48 json_config -- json_config/json_config.sh@285 -- # [[ 0 -eq 1 ]] 00:08:53.342 11:19:48 json_config -- json_config/json_config.sh@289 -- # [[ 0 -eq 1 ]] 00:08:53.342 11:19:48 json_config -- json_config/json_config.sh@293 -- # [[ 0 -eq 1 ]] 00:08:53.342 11:19:48 json_config -- json_config/json_config.sh@297 -- # [[ 1 -eq 1 ]] 00:08:53.342 11:19:48 json_config -- json_config/json_config.sh@298 -- # create_nvmf_subsystem_config 00:08:53.342 11:19:48 json_config -- json_config/json_config.sh@237 -- # timing_enter create_nvmf_subsystem_config 00:08:53.342 11:19:48 json_config -- common/autotest_common.sh@724 -- # xtrace_disable 00:08:53.342 11:19:48 json_config -- common/autotest_common.sh@10 -- # set +x 00:08:53.342 11:19:48 json_config -- json_config/json_config.sh@239 -- # NVMF_FIRST_TARGET_IP=127.0.0.1 00:08:53.342 11:19:48 json_config -- json_config/json_config.sh@240 -- # [[ tcp == \r\d\m\a ]] 00:08:53.342 11:19:48 json_config -- json_config/json_config.sh@244 -- # [[ -z 127.0.0.1 ]] 00:08:53.342 11:19:48 json_config -- json_config/json_config.sh@249 -- # tgt_rpc bdev_malloc_create 8 512 --name MallocForNvmf0 00:08:53.342 11:19:48 json_config -- json_config/common.sh@57 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock bdev_malloc_create 8 512 --name MallocForNvmf0 00:08:53.600 MallocForNvmf0 00:08:53.600 11:19:49 json_config -- json_config/json_config.sh@250 -- # tgt_rpc bdev_malloc_create 4 1024 --name MallocForNvmf1 00:08:53.600 11:19:49 json_config -- json_config/common.sh@57 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock bdev_malloc_create 4 1024 --name MallocForNvmf1 00:08:53.859 MallocForNvmf1 00:08:53.859 11:19:49 json_config -- json_config/json_config.sh@252 -- # tgt_rpc nvmf_create_transport -t tcp -u 8192 -c 0 00:08:53.859 11:19:49 json_config -- json_config/common.sh@57 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock nvmf_create_transport -t tcp -u 8192 -c 0 00:08:54.118 [2024-10-07 11:19:49.545836] tcp.c: 738:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:08:54.118 11:19:49 json_config -- json_config/json_config.sh@253 -- # tgt_rpc nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:08:54.118 11:19:49 json_config -- json_config/common.sh@57 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:08:54.376 11:19:49 json_config -- json_config/json_config.sh@254 -- # tgt_rpc nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 MallocForNvmf0 00:08:54.376 11:19:49 json_config -- json_config/common.sh@57 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 MallocForNvmf0 00:08:54.634 11:19:50 json_config -- json_config/json_config.sh@255 -- # tgt_rpc nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 MallocForNvmf1 00:08:54.634 11:19:50 json_config -- json_config/common.sh@57 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 MallocForNvmf1 00:08:54.892 11:19:50 json_config -- json_config/json_config.sh@256 -- # tgt_rpc nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 127.0.0.1 -s 4420 00:08:54.892 11:19:50 json_config -- json_config/common.sh@57 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 127.0.0.1 -s 4420 00:08:55.151 [2024-10-07 11:19:50.586439] tcp.c:1081:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 127.0.0.1 port 4420 *** 00:08:55.151 11:19:50 json_config -- json_config/json_config.sh@258 -- # timing_exit create_nvmf_subsystem_config 00:08:55.151 11:19:50 json_config -- common/autotest_common.sh@730 -- # xtrace_disable 00:08:55.151 11:19:50 json_config -- common/autotest_common.sh@10 -- # set +x 00:08:55.151 11:19:50 json_config -- json_config/json_config.sh@300 -- # timing_exit json_config_setup_target 00:08:55.151 11:19:50 json_config -- common/autotest_common.sh@730 -- # xtrace_disable 00:08:55.151 11:19:50 json_config -- common/autotest_common.sh@10 -- # set +x 00:08:55.409 11:19:50 json_config -- json_config/json_config.sh@302 -- # [[ 0 -eq 1 ]] 00:08:55.409 11:19:50 json_config -- json_config/json_config.sh@307 -- # tgt_rpc bdev_malloc_create 8 512 --name MallocBdevForConfigChangeCheck 00:08:55.409 11:19:50 json_config -- json_config/common.sh@57 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock bdev_malloc_create 8 512 --name MallocBdevForConfigChangeCheck 00:08:55.671 MallocBdevForConfigChangeCheck 00:08:55.671 11:19:50 json_config -- json_config/json_config.sh@309 -- # timing_exit json_config_test_init 00:08:55.671 11:19:50 json_config -- common/autotest_common.sh@730 -- # xtrace_disable 00:08:55.671 11:19:50 json_config -- common/autotest_common.sh@10 -- # set +x 00:08:55.671 11:19:50 json_config -- json_config/json_config.sh@366 -- # tgt_rpc save_config 00:08:55.671 11:19:50 json_config -- json_config/common.sh@57 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock save_config 00:08:55.944 INFO: shutting down applications... 00:08:55.944 11:19:51 json_config -- json_config/json_config.sh@368 -- # echo 'INFO: shutting down applications...' 00:08:55.944 11:19:51 json_config -- json_config/json_config.sh@369 -- # [[ 0 -eq 1 ]] 00:08:55.944 11:19:51 json_config -- json_config/json_config.sh@375 -- # json_config_clear target 00:08:55.944 11:19:51 json_config -- json_config/json_config.sh@339 -- # [[ -n 22 ]] 00:08:55.944 11:19:51 json_config -- json_config/json_config.sh@340 -- # /home/vagrant/spdk_repo/spdk/test/json_config/clear_config.py -s /var/tmp/spdk_tgt.sock clear_config 00:08:56.510 Calling clear_iscsi_subsystem 00:08:56.510 Calling clear_nvmf_subsystem 00:08:56.510 Calling clear_nbd_subsystem 00:08:56.510 Calling clear_ublk_subsystem 00:08:56.510 Calling clear_vhost_blk_subsystem 00:08:56.510 Calling clear_vhost_scsi_subsystem 00:08:56.511 Calling clear_bdev_subsystem 00:08:56.511 11:19:51 json_config -- json_config/json_config.sh@344 -- # local config_filter=/home/vagrant/spdk_repo/spdk/test/json_config/config_filter.py 00:08:56.511 11:19:51 json_config -- json_config/json_config.sh@350 -- # count=100 00:08:56.511 11:19:51 json_config -- json_config/json_config.sh@351 -- # '[' 100 -gt 0 ']' 00:08:56.511 11:19:51 json_config -- json_config/json_config.sh@352 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock save_config 00:08:56.511 11:19:51 json_config -- json_config/json_config.sh@352 -- # /home/vagrant/spdk_repo/spdk/test/json_config/config_filter.py -method delete_global_parameters 00:08:56.511 11:19:51 json_config -- json_config/json_config.sh@352 -- # /home/vagrant/spdk_repo/spdk/test/json_config/config_filter.py -method check_empty 00:08:57.076 11:19:52 json_config -- json_config/json_config.sh@352 -- # break 00:08:57.076 11:19:52 json_config -- json_config/json_config.sh@357 -- # '[' 100 -eq 0 ']' 00:08:57.076 11:19:52 json_config -- json_config/json_config.sh@376 -- # json_config_test_shutdown_app target 00:08:57.076 11:19:52 json_config -- json_config/common.sh@31 -- # local app=target 00:08:57.076 11:19:52 json_config -- json_config/common.sh@34 -- # [[ -n 22 ]] 00:08:57.076 11:19:52 json_config -- json_config/common.sh@35 -- # [[ -n 59291 ]] 00:08:57.076 11:19:52 json_config -- json_config/common.sh@38 -- # kill -SIGINT 59291 00:08:57.076 11:19:52 json_config -- json_config/common.sh@40 -- # (( i = 0 )) 00:08:57.076 11:19:52 json_config -- json_config/common.sh@40 -- # (( i < 30 )) 00:08:57.076 11:19:52 json_config -- json_config/common.sh@41 -- # kill -0 59291 00:08:57.076 11:19:52 json_config -- json_config/common.sh@45 -- # sleep 0.5 00:08:57.335 11:19:52 json_config -- json_config/common.sh@40 -- # (( i++ )) 00:08:57.335 11:19:52 json_config -- json_config/common.sh@40 -- # (( i < 30 )) 00:08:57.335 11:19:52 json_config -- json_config/common.sh@41 -- # kill -0 59291 00:08:57.335 11:19:52 json_config -- json_config/common.sh@42 -- # app_pid["$app"]= 00:08:57.335 11:19:52 json_config -- json_config/common.sh@43 -- # break 00:08:57.335 11:19:52 json_config -- json_config/common.sh@48 -- # [[ -n '' ]] 00:08:57.335 11:19:52 json_config -- json_config/common.sh@53 -- # echo 'SPDK target shutdown done' 00:08:57.335 SPDK target shutdown done 00:08:57.335 INFO: relaunching applications... 00:08:57.335 11:19:52 json_config -- json_config/json_config.sh@378 -- # echo 'INFO: relaunching applications...' 00:08:57.335 11:19:52 json_config -- json_config/json_config.sh@379 -- # json_config_test_start_app target --json /home/vagrant/spdk_repo/spdk/spdk_tgt_config.json 00:08:57.335 11:19:52 json_config -- json_config/common.sh@9 -- # local app=target 00:08:57.335 11:19:52 json_config -- json_config/common.sh@10 -- # shift 00:08:57.335 11:19:52 json_config -- json_config/common.sh@12 -- # [[ -n 22 ]] 00:08:57.335 11:19:52 json_config -- json_config/common.sh@13 -- # [[ -z '' ]] 00:08:57.335 11:19:52 json_config -- json_config/common.sh@15 -- # local app_extra_params= 00:08:57.335 11:19:52 json_config -- json_config/common.sh@16 -- # [[ 0 -eq 1 ]] 00:08:57.335 11:19:52 json_config -- json_config/common.sh@16 -- # [[ 0 -eq 1 ]] 00:08:57.335 11:19:52 json_config -- json_config/common.sh@22 -- # app_pid["$app"]=59576 00:08:57.335 Waiting for target to run... 00:08:57.335 11:19:52 json_config -- json_config/common.sh@24 -- # echo 'Waiting for target to run...' 00:08:57.335 11:19:52 json_config -- json_config/common.sh@25 -- # waitforlisten 59576 /var/tmp/spdk_tgt.sock 00:08:57.335 11:19:52 json_config -- json_config/common.sh@21 -- # /home/vagrant/spdk_repo/spdk/build/bin/spdk_tgt -m 0x1 -s 1024 -r /var/tmp/spdk_tgt.sock --json /home/vagrant/spdk_repo/spdk/spdk_tgt_config.json 00:08:57.335 11:19:52 json_config -- common/autotest_common.sh@831 -- # '[' -z 59576 ']' 00:08:57.335 11:19:52 json_config -- common/autotest_common.sh@835 -- # local rpc_addr=/var/tmp/spdk_tgt.sock 00:08:57.335 11:19:52 json_config -- common/autotest_common.sh@836 -- # local max_retries=100 00:08:57.335 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk_tgt.sock... 00:08:57.335 11:19:52 json_config -- common/autotest_common.sh@838 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk_tgt.sock...' 00:08:57.335 11:19:52 json_config -- common/autotest_common.sh@840 -- # xtrace_disable 00:08:57.336 11:19:52 json_config -- common/autotest_common.sh@10 -- # set +x 00:08:57.593 [2024-10-07 11:19:52.876976] Starting SPDK v25.01-pre git sha1 2a4f56c54 / DPDK 24.03.0 initialization... 00:08:57.593 [2024-10-07 11:19:52.877076] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 -m 1024 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --iova-mode=pa --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid59576 ] 00:08:57.851 [2024-10-07 11:19:53.291516] app.c: 917:spdk_app_start: *NOTICE*: Total cores available: 1 00:08:58.109 [2024-10-07 11:19:53.381968] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 0 00:08:58.367 [2024-10-07 11:19:53.731063] tcp.c: 738:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:08:58.367 [2024-10-07 11:19:53.763146] tcp.c:1081:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 127.0.0.1 port 4420 *** 00:08:58.367 11:19:53 json_config -- common/autotest_common.sh@860 -- # (( i == 0 )) 00:08:58.367 11:19:53 json_config -- common/autotest_common.sh@864 -- # return 0 00:08:58.367 00:08:58.367 11:19:53 json_config -- json_config/common.sh@26 -- # echo '' 00:08:58.367 11:19:53 json_config -- json_config/json_config.sh@380 -- # [[ 0 -eq 1 ]] 00:08:58.367 INFO: Checking if target configuration is the same... 00:08:58.367 11:19:53 json_config -- json_config/json_config.sh@384 -- # echo 'INFO: Checking if target configuration is the same...' 00:08:58.367 11:19:53 json_config -- json_config/json_config.sh@385 -- # /home/vagrant/spdk_repo/spdk/test/json_config/json_diff.sh /dev/fd/62 /home/vagrant/spdk_repo/spdk/spdk_tgt_config.json 00:08:58.367 11:19:53 json_config -- json_config/json_config.sh@385 -- # tgt_rpc save_config 00:08:58.367 11:19:53 json_config -- json_config/common.sh@57 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock save_config 00:08:58.367 + '[' 2 -ne 2 ']' 00:08:58.367 +++ dirname /home/vagrant/spdk_repo/spdk/test/json_config/json_diff.sh 00:08:58.367 ++ readlink -f /home/vagrant/spdk_repo/spdk/test/json_config/../.. 00:08:58.367 + rootdir=/home/vagrant/spdk_repo/spdk 00:08:58.367 +++ basename /dev/fd/62 00:08:58.367 ++ mktemp /tmp/62.XXX 00:08:58.367 + tmp_file_1=/tmp/62.89a 00:08:58.367 +++ basename /home/vagrant/spdk_repo/spdk/spdk_tgt_config.json 00:08:58.367 ++ mktemp /tmp/spdk_tgt_config.json.XXX 00:08:58.367 + tmp_file_2=/tmp/spdk_tgt_config.json.Rua 00:08:58.367 + ret=0 00:08:58.367 + /home/vagrant/spdk_repo/spdk/test/json_config/config_filter.py -method sort 00:08:58.961 + /home/vagrant/spdk_repo/spdk/test/json_config/config_filter.py -method sort 00:08:58.961 + diff -u /tmp/62.89a /tmp/spdk_tgt_config.json.Rua 00:08:58.961 INFO: JSON config files are the same 00:08:58.961 + echo 'INFO: JSON config files are the same' 00:08:58.961 + rm /tmp/62.89a /tmp/spdk_tgt_config.json.Rua 00:08:58.961 + exit 0 00:08:58.961 11:19:54 json_config -- json_config/json_config.sh@386 -- # [[ 0 -eq 1 ]] 00:08:58.961 INFO: changing configuration and checking if this can be detected... 00:08:58.961 11:19:54 json_config -- json_config/json_config.sh@391 -- # echo 'INFO: changing configuration and checking if this can be detected...' 00:08:58.961 11:19:54 json_config -- json_config/json_config.sh@393 -- # tgt_rpc bdev_malloc_delete MallocBdevForConfigChangeCheck 00:08:58.961 11:19:54 json_config -- json_config/common.sh@57 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock bdev_malloc_delete MallocBdevForConfigChangeCheck 00:08:59.220 11:19:54 json_config -- json_config/json_config.sh@394 -- # /home/vagrant/spdk_repo/spdk/test/json_config/json_diff.sh /dev/fd/62 /home/vagrant/spdk_repo/spdk/spdk_tgt_config.json 00:08:59.220 11:19:54 json_config -- json_config/json_config.sh@394 -- # tgt_rpc save_config 00:08:59.220 11:19:54 json_config -- json_config/common.sh@57 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock save_config 00:08:59.220 + '[' 2 -ne 2 ']' 00:08:59.220 +++ dirname /home/vagrant/spdk_repo/spdk/test/json_config/json_diff.sh 00:08:59.220 ++ readlink -f /home/vagrant/spdk_repo/spdk/test/json_config/../.. 00:08:59.220 + rootdir=/home/vagrant/spdk_repo/spdk 00:08:59.220 +++ basename /dev/fd/62 00:08:59.220 ++ mktemp /tmp/62.XXX 00:08:59.220 + tmp_file_1=/tmp/62.snp 00:08:59.220 +++ basename /home/vagrant/spdk_repo/spdk/spdk_tgt_config.json 00:08:59.220 ++ mktemp /tmp/spdk_tgt_config.json.XXX 00:08:59.220 + tmp_file_2=/tmp/spdk_tgt_config.json.hYl 00:08:59.220 + ret=0 00:08:59.220 + /home/vagrant/spdk_repo/spdk/test/json_config/config_filter.py -method sort 00:08:59.787 + /home/vagrant/spdk_repo/spdk/test/json_config/config_filter.py -method sort 00:08:59.787 + diff -u /tmp/62.snp /tmp/spdk_tgt_config.json.hYl 00:08:59.787 + ret=1 00:08:59.787 + echo '=== Start of file: /tmp/62.snp ===' 00:08:59.787 + cat /tmp/62.snp 00:08:59.787 + echo '=== End of file: /tmp/62.snp ===' 00:08:59.787 + echo '' 00:08:59.787 + echo '=== Start of file: /tmp/spdk_tgt_config.json.hYl ===' 00:08:59.787 + cat /tmp/spdk_tgt_config.json.hYl 00:08:59.787 + echo '=== End of file: /tmp/spdk_tgt_config.json.hYl ===' 00:08:59.787 + echo '' 00:08:59.787 + rm /tmp/62.snp /tmp/spdk_tgt_config.json.hYl 00:08:59.787 + exit 1 00:08:59.787 INFO: configuration change detected. 00:08:59.787 11:19:55 json_config -- json_config/json_config.sh@398 -- # echo 'INFO: configuration change detected.' 00:08:59.787 11:19:55 json_config -- json_config/json_config.sh@401 -- # json_config_test_fini 00:08:59.787 11:19:55 json_config -- json_config/json_config.sh@313 -- # timing_enter json_config_test_fini 00:08:59.787 11:19:55 json_config -- common/autotest_common.sh@724 -- # xtrace_disable 00:08:59.788 11:19:55 json_config -- common/autotest_common.sh@10 -- # set +x 00:08:59.788 11:19:55 json_config -- json_config/json_config.sh@314 -- # local ret=0 00:08:59.788 11:19:55 json_config -- json_config/json_config.sh@316 -- # [[ -n '' ]] 00:08:59.788 11:19:55 json_config -- json_config/json_config.sh@324 -- # [[ -n 59576 ]] 00:08:59.788 11:19:55 json_config -- json_config/json_config.sh@327 -- # cleanup_bdev_subsystem_config 00:08:59.788 11:19:55 json_config -- json_config/json_config.sh@191 -- # timing_enter cleanup_bdev_subsystem_config 00:08:59.788 11:19:55 json_config -- common/autotest_common.sh@724 -- # xtrace_disable 00:08:59.788 11:19:55 json_config -- common/autotest_common.sh@10 -- # set +x 00:08:59.788 11:19:55 json_config -- json_config/json_config.sh@193 -- # [[ 0 -eq 1 ]] 00:08:59.788 11:19:55 json_config -- json_config/json_config.sh@200 -- # uname -s 00:08:59.788 11:19:55 json_config -- json_config/json_config.sh@200 -- # [[ Linux = Linux ]] 00:08:59.788 11:19:55 json_config -- json_config/json_config.sh@201 -- # rm -f /sample_aio 00:08:59.788 11:19:55 json_config -- json_config/json_config.sh@204 -- # [[ 0 -eq 1 ]] 00:08:59.788 11:19:55 json_config -- json_config/json_config.sh@208 -- # timing_exit cleanup_bdev_subsystem_config 00:08:59.788 11:19:55 json_config -- common/autotest_common.sh@730 -- # xtrace_disable 00:08:59.788 11:19:55 json_config -- common/autotest_common.sh@10 -- # set +x 00:08:59.788 11:19:55 json_config -- json_config/json_config.sh@330 -- # killprocess 59576 00:08:59.788 11:19:55 json_config -- common/autotest_common.sh@950 -- # '[' -z 59576 ']' 00:08:59.788 11:19:55 json_config -- common/autotest_common.sh@954 -- # kill -0 59576 00:08:59.788 11:19:55 json_config -- common/autotest_common.sh@955 -- # uname 00:08:59.788 11:19:55 json_config -- common/autotest_common.sh@955 -- # '[' Linux = Linux ']' 00:08:59.788 11:19:55 json_config -- common/autotest_common.sh@956 -- # ps --no-headers -o comm= 59576 00:09:00.046 11:19:55 json_config -- common/autotest_common.sh@956 -- # process_name=reactor_0 00:09:00.046 11:19:55 json_config -- common/autotest_common.sh@960 -- # '[' reactor_0 = sudo ']' 00:09:00.046 killing process with pid 59576 00:09:00.046 11:19:55 json_config -- common/autotest_common.sh@968 -- # echo 'killing process with pid 59576' 00:09:00.046 11:19:55 json_config -- common/autotest_common.sh@969 -- # kill 59576 00:09:00.046 11:19:55 json_config -- common/autotest_common.sh@974 -- # wait 59576 00:09:00.305 11:19:55 json_config -- json_config/json_config.sh@333 -- # rm -f /home/vagrant/spdk_repo/spdk/spdk_initiator_config.json /home/vagrant/spdk_repo/spdk/spdk_tgt_config.json 00:09:00.305 11:19:55 json_config -- json_config/json_config.sh@334 -- # timing_exit json_config_test_fini 00:09:00.305 11:19:55 json_config -- common/autotest_common.sh@730 -- # xtrace_disable 00:09:00.305 11:19:55 json_config -- common/autotest_common.sh@10 -- # set +x 00:09:00.305 11:19:55 json_config -- json_config/json_config.sh@335 -- # return 0 00:09:00.305 INFO: Success 00:09:00.305 11:19:55 json_config -- json_config/json_config.sh@403 -- # echo 'INFO: Success' 00:09:00.305 00:09:00.305 real 0m9.150s 00:09:00.305 user 0m13.284s 00:09:00.305 sys 0m1.926s 00:09:00.305 11:19:55 json_config -- common/autotest_common.sh@1126 -- # xtrace_disable 00:09:00.305 11:19:55 json_config -- common/autotest_common.sh@10 -- # set +x 00:09:00.305 ************************************ 00:09:00.305 END TEST json_config 00:09:00.305 ************************************ 00:09:00.305 11:19:55 -- spdk/autotest.sh@160 -- # run_test json_config_extra_key /home/vagrant/spdk_repo/spdk/test/json_config/json_config_extra_key.sh 00:09:00.305 11:19:55 -- common/autotest_common.sh@1101 -- # '[' 2 -le 1 ']' 00:09:00.305 11:19:55 -- common/autotest_common.sh@1107 -- # xtrace_disable 00:09:00.305 11:19:55 -- common/autotest_common.sh@10 -- # set +x 00:09:00.305 ************************************ 00:09:00.305 START TEST json_config_extra_key 00:09:00.305 ************************************ 00:09:00.305 11:19:55 json_config_extra_key -- common/autotest_common.sh@1125 -- # /home/vagrant/spdk_repo/spdk/test/json_config/json_config_extra_key.sh 00:09:00.305 11:19:55 json_config_extra_key -- common/autotest_common.sh@1680 -- # [[ y == y ]] 00:09:00.305 11:19:55 json_config_extra_key -- common/autotest_common.sh@1681 -- # lcov --version 00:09:00.305 11:19:55 json_config_extra_key -- common/autotest_common.sh@1681 -- # awk '{print $NF}' 00:09:00.305 11:19:55 json_config_extra_key -- common/autotest_common.sh@1681 -- # lt 1.15 2 00:09:00.305 11:19:55 json_config_extra_key -- scripts/common.sh@373 -- # cmp_versions 1.15 '<' 2 00:09:00.305 11:19:55 json_config_extra_key -- scripts/common.sh@333 -- # local ver1 ver1_l 00:09:00.305 11:19:55 json_config_extra_key -- scripts/common.sh@334 -- # local ver2 ver2_l 00:09:00.305 11:19:55 json_config_extra_key -- scripts/common.sh@336 -- # IFS=.-: 00:09:00.305 11:19:55 json_config_extra_key -- scripts/common.sh@336 -- # read -ra ver1 00:09:00.305 11:19:55 json_config_extra_key -- scripts/common.sh@337 -- # IFS=.-: 00:09:00.305 11:19:55 json_config_extra_key -- scripts/common.sh@337 -- # read -ra ver2 00:09:00.305 11:19:55 json_config_extra_key -- scripts/common.sh@338 -- # local 'op=<' 00:09:00.305 11:19:55 json_config_extra_key -- scripts/common.sh@340 -- # ver1_l=2 00:09:00.305 11:19:55 json_config_extra_key -- scripts/common.sh@341 -- # ver2_l=1 00:09:00.305 11:19:55 json_config_extra_key -- scripts/common.sh@343 -- # local lt=0 gt=0 eq=0 v 00:09:00.305 11:19:55 json_config_extra_key -- scripts/common.sh@344 -- # case "$op" in 00:09:00.305 11:19:55 json_config_extra_key -- scripts/common.sh@345 -- # : 1 00:09:00.305 11:19:55 json_config_extra_key -- scripts/common.sh@364 -- # (( v = 0 )) 00:09:00.305 11:19:55 json_config_extra_key -- scripts/common.sh@364 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:09:00.305 11:19:55 json_config_extra_key -- scripts/common.sh@365 -- # decimal 1 00:09:00.305 11:19:55 json_config_extra_key -- scripts/common.sh@353 -- # local d=1 00:09:00.305 11:19:55 json_config_extra_key -- scripts/common.sh@354 -- # [[ 1 =~ ^[0-9]+$ ]] 00:09:00.305 11:19:55 json_config_extra_key -- scripts/common.sh@355 -- # echo 1 00:09:00.305 11:19:55 json_config_extra_key -- scripts/common.sh@365 -- # ver1[v]=1 00:09:00.305 11:19:55 json_config_extra_key -- scripts/common.sh@366 -- # decimal 2 00:09:00.305 11:19:55 json_config_extra_key -- scripts/common.sh@353 -- # local d=2 00:09:00.305 11:19:55 json_config_extra_key -- scripts/common.sh@354 -- # [[ 2 =~ ^[0-9]+$ ]] 00:09:00.305 11:19:55 json_config_extra_key -- scripts/common.sh@355 -- # echo 2 00:09:00.564 11:19:55 json_config_extra_key -- scripts/common.sh@366 -- # ver2[v]=2 00:09:00.564 11:19:55 json_config_extra_key -- scripts/common.sh@367 -- # (( ver1[v] > ver2[v] )) 00:09:00.564 11:19:55 json_config_extra_key -- scripts/common.sh@368 -- # (( ver1[v] < ver2[v] )) 00:09:00.564 11:19:55 json_config_extra_key -- scripts/common.sh@368 -- # return 0 00:09:00.564 11:19:55 json_config_extra_key -- common/autotest_common.sh@1682 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:09:00.564 11:19:55 json_config_extra_key -- common/autotest_common.sh@1694 -- # export 'LCOV_OPTS= 00:09:00.564 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:09:00.564 --rc genhtml_branch_coverage=1 00:09:00.564 --rc genhtml_function_coverage=1 00:09:00.564 --rc genhtml_legend=1 00:09:00.564 --rc geninfo_all_blocks=1 00:09:00.564 --rc geninfo_unexecuted_blocks=1 00:09:00.564 00:09:00.564 ' 00:09:00.564 11:19:55 json_config_extra_key -- common/autotest_common.sh@1694 -- # LCOV_OPTS=' 00:09:00.564 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:09:00.564 --rc genhtml_branch_coverage=1 00:09:00.564 --rc genhtml_function_coverage=1 00:09:00.564 --rc genhtml_legend=1 00:09:00.565 --rc geninfo_all_blocks=1 00:09:00.565 --rc geninfo_unexecuted_blocks=1 00:09:00.565 00:09:00.565 ' 00:09:00.565 11:19:55 json_config_extra_key -- common/autotest_common.sh@1695 -- # export 'LCOV=lcov 00:09:00.565 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:09:00.565 --rc genhtml_branch_coverage=1 00:09:00.565 --rc genhtml_function_coverage=1 00:09:00.565 --rc genhtml_legend=1 00:09:00.565 --rc geninfo_all_blocks=1 00:09:00.565 --rc geninfo_unexecuted_blocks=1 00:09:00.565 00:09:00.565 ' 00:09:00.565 11:19:55 json_config_extra_key -- common/autotest_common.sh@1695 -- # LCOV='lcov 00:09:00.565 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:09:00.565 --rc genhtml_branch_coverage=1 00:09:00.565 --rc genhtml_function_coverage=1 00:09:00.565 --rc genhtml_legend=1 00:09:00.565 --rc geninfo_all_blocks=1 00:09:00.565 --rc geninfo_unexecuted_blocks=1 00:09:00.565 00:09:00.565 ' 00:09:00.565 11:19:55 json_config_extra_key -- json_config/json_config_extra_key.sh@9 -- # source /home/vagrant/spdk_repo/spdk/test/nvmf/common.sh 00:09:00.565 11:19:55 json_config_extra_key -- nvmf/common.sh@7 -- # uname -s 00:09:00.565 11:19:55 json_config_extra_key -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:09:00.565 11:19:55 json_config_extra_key -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:09:00.565 11:19:55 json_config_extra_key -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:09:00.565 11:19:55 json_config_extra_key -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:09:00.565 11:19:55 json_config_extra_key -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:09:00.565 11:19:55 json_config_extra_key -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:09:00.565 11:19:55 json_config_extra_key -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:09:00.565 11:19:55 json_config_extra_key -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:09:00.565 11:19:55 json_config_extra_key -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:09:00.565 11:19:55 json_config_extra_key -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:09:00.565 11:19:55 json_config_extra_key -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:c758a4ed-f09f-4c82-9afb-3d096f035464 00:09:00.565 11:19:55 json_config_extra_key -- nvmf/common.sh@18 -- # NVME_HOSTID=c758a4ed-f09f-4c82-9afb-3d096f035464 00:09:00.565 11:19:55 json_config_extra_key -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:09:00.565 11:19:55 json_config_extra_key -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:09:00.565 11:19:55 json_config_extra_key -- nvmf/common.sh@21 -- # NET_TYPE=phy-fallback 00:09:00.565 11:19:55 json_config_extra_key -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:09:00.565 11:19:55 json_config_extra_key -- nvmf/common.sh@49 -- # source /home/vagrant/spdk_repo/spdk/scripts/common.sh 00:09:00.565 11:19:55 json_config_extra_key -- scripts/common.sh@15 -- # shopt -s extglob 00:09:00.565 11:19:55 json_config_extra_key -- scripts/common.sh@544 -- # [[ -e /bin/wpdk_common.sh ]] 00:09:00.565 11:19:55 json_config_extra_key -- scripts/common.sh@552 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:09:00.565 11:19:55 json_config_extra_key -- scripts/common.sh@553 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:09:00.565 11:19:55 json_config_extra_key -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:09:00.565 11:19:55 json_config_extra_key -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:09:00.565 11:19:55 json_config_extra_key -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:09:00.565 11:19:55 json_config_extra_key -- paths/export.sh@5 -- # export PATH 00:09:00.565 11:19:55 json_config_extra_key -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:09:00.565 11:19:55 json_config_extra_key -- nvmf/common.sh@51 -- # : 0 00:09:00.565 11:19:55 json_config_extra_key -- nvmf/common.sh@52 -- # export NVMF_APP_SHM_ID 00:09:00.565 11:19:55 json_config_extra_key -- nvmf/common.sh@53 -- # build_nvmf_app_args 00:09:00.565 11:19:55 json_config_extra_key -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:09:00.565 11:19:55 json_config_extra_key -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:09:00.565 11:19:55 json_config_extra_key -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:09:00.565 11:19:55 json_config_extra_key -- nvmf/common.sh@33 -- # '[' '' -eq 1 ']' 00:09:00.565 /home/vagrant/spdk_repo/spdk/test/nvmf/common.sh: line 33: [: : integer expression expected 00:09:00.565 11:19:55 json_config_extra_key -- nvmf/common.sh@37 -- # '[' -n '' ']' 00:09:00.565 11:19:55 json_config_extra_key -- nvmf/common.sh@39 -- # '[' 0 -eq 1 ']' 00:09:00.565 11:19:55 json_config_extra_key -- nvmf/common.sh@55 -- # have_pci_nics=0 00:09:00.565 11:19:55 json_config_extra_key -- json_config/json_config_extra_key.sh@10 -- # source /home/vagrant/spdk_repo/spdk/test/json_config/common.sh 00:09:00.565 11:19:55 json_config_extra_key -- json_config/json_config_extra_key.sh@17 -- # app_pid=(['target']='') 00:09:00.565 11:19:55 json_config_extra_key -- json_config/json_config_extra_key.sh@17 -- # declare -A app_pid 00:09:00.565 11:19:55 json_config_extra_key -- json_config/json_config_extra_key.sh@18 -- # app_socket=(['target']='/var/tmp/spdk_tgt.sock') 00:09:00.565 11:19:55 json_config_extra_key -- json_config/json_config_extra_key.sh@18 -- # declare -A app_socket 00:09:00.565 11:19:55 json_config_extra_key -- json_config/json_config_extra_key.sh@19 -- # app_params=(['target']='-m 0x1 -s 1024') 00:09:00.565 11:19:55 json_config_extra_key -- json_config/json_config_extra_key.sh@19 -- # declare -A app_params 00:09:00.565 11:19:55 json_config_extra_key -- json_config/json_config_extra_key.sh@20 -- # configs_path=(['target']='/home/vagrant/spdk_repo/spdk/test/json_config/extra_key.json') 00:09:00.565 11:19:55 json_config_extra_key -- json_config/json_config_extra_key.sh@20 -- # declare -A configs_path 00:09:00.565 11:19:55 json_config_extra_key -- json_config/json_config_extra_key.sh@22 -- # trap 'on_error_exit "${FUNCNAME}" "${LINENO}"' ERR 00:09:00.565 INFO: launching applications... 00:09:00.565 11:19:55 json_config_extra_key -- json_config/json_config_extra_key.sh@24 -- # echo 'INFO: launching applications...' 00:09:00.565 11:19:55 json_config_extra_key -- json_config/json_config_extra_key.sh@25 -- # json_config_test_start_app target --json /home/vagrant/spdk_repo/spdk/test/json_config/extra_key.json 00:09:00.565 11:19:55 json_config_extra_key -- json_config/common.sh@9 -- # local app=target 00:09:00.565 11:19:55 json_config_extra_key -- json_config/common.sh@10 -- # shift 00:09:00.565 11:19:55 json_config_extra_key -- json_config/common.sh@12 -- # [[ -n 22 ]] 00:09:00.565 11:19:55 json_config_extra_key -- json_config/common.sh@13 -- # [[ -z '' ]] 00:09:00.565 11:19:55 json_config_extra_key -- json_config/common.sh@15 -- # local app_extra_params= 00:09:00.565 11:19:55 json_config_extra_key -- json_config/common.sh@16 -- # [[ 0 -eq 1 ]] 00:09:00.565 11:19:55 json_config_extra_key -- json_config/common.sh@16 -- # [[ 0 -eq 1 ]] 00:09:00.565 11:19:55 json_config_extra_key -- json_config/common.sh@22 -- # app_pid["$app"]=59760 00:09:00.565 Waiting for target to run... 00:09:00.565 11:19:55 json_config_extra_key -- json_config/common.sh@24 -- # echo 'Waiting for target to run...' 00:09:00.565 11:19:55 json_config_extra_key -- json_config/common.sh@21 -- # /home/vagrant/spdk_repo/spdk/build/bin/spdk_tgt -m 0x1 -s 1024 -r /var/tmp/spdk_tgt.sock --json /home/vagrant/spdk_repo/spdk/test/json_config/extra_key.json 00:09:00.565 11:19:55 json_config_extra_key -- json_config/common.sh@25 -- # waitforlisten 59760 /var/tmp/spdk_tgt.sock 00:09:00.565 11:19:55 json_config_extra_key -- common/autotest_common.sh@831 -- # '[' -z 59760 ']' 00:09:00.565 11:19:55 json_config_extra_key -- common/autotest_common.sh@835 -- # local rpc_addr=/var/tmp/spdk_tgt.sock 00:09:00.565 11:19:55 json_config_extra_key -- common/autotest_common.sh@836 -- # local max_retries=100 00:09:00.565 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk_tgt.sock... 00:09:00.565 11:19:55 json_config_extra_key -- common/autotest_common.sh@838 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk_tgt.sock...' 00:09:00.565 11:19:55 json_config_extra_key -- common/autotest_common.sh@840 -- # xtrace_disable 00:09:00.565 11:19:55 json_config_extra_key -- common/autotest_common.sh@10 -- # set +x 00:09:00.565 [2024-10-07 11:19:55.946358] Starting SPDK v25.01-pre git sha1 2a4f56c54 / DPDK 24.03.0 initialization... 00:09:00.565 [2024-10-07 11:19:55.946480] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 -m 1024 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --iova-mode=pa --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid59760 ] 00:09:01.134 [2024-10-07 11:19:56.363713] app.c: 917:spdk_app_start: *NOTICE*: Total cores available: 1 00:09:01.134 [2024-10-07 11:19:56.453710] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 0 00:09:01.700 11:19:56 json_config_extra_key -- common/autotest_common.sh@860 -- # (( i == 0 )) 00:09:01.700 11:19:56 json_config_extra_key -- common/autotest_common.sh@864 -- # return 0 00:09:01.700 11:19:56 json_config_extra_key -- json_config/common.sh@26 -- # echo '' 00:09:01.700 00:09:01.700 INFO: shutting down applications... 00:09:01.700 11:19:56 json_config_extra_key -- json_config/json_config_extra_key.sh@27 -- # echo 'INFO: shutting down applications...' 00:09:01.700 11:19:56 json_config_extra_key -- json_config/json_config_extra_key.sh@28 -- # json_config_test_shutdown_app target 00:09:01.700 11:19:56 json_config_extra_key -- json_config/common.sh@31 -- # local app=target 00:09:01.700 11:19:56 json_config_extra_key -- json_config/common.sh@34 -- # [[ -n 22 ]] 00:09:01.700 11:19:56 json_config_extra_key -- json_config/common.sh@35 -- # [[ -n 59760 ]] 00:09:01.700 11:19:56 json_config_extra_key -- json_config/common.sh@38 -- # kill -SIGINT 59760 00:09:01.700 11:19:56 json_config_extra_key -- json_config/common.sh@40 -- # (( i = 0 )) 00:09:01.700 11:19:56 json_config_extra_key -- json_config/common.sh@40 -- # (( i < 30 )) 00:09:01.701 11:19:56 json_config_extra_key -- json_config/common.sh@41 -- # kill -0 59760 00:09:01.701 11:19:56 json_config_extra_key -- json_config/common.sh@45 -- # sleep 0.5 00:09:01.959 11:19:57 json_config_extra_key -- json_config/common.sh@40 -- # (( i++ )) 00:09:01.959 11:19:57 json_config_extra_key -- json_config/common.sh@40 -- # (( i < 30 )) 00:09:01.959 11:19:57 json_config_extra_key -- json_config/common.sh@41 -- # kill -0 59760 00:09:01.959 11:19:57 json_config_extra_key -- json_config/common.sh@42 -- # app_pid["$app"]= 00:09:01.959 11:19:57 json_config_extra_key -- json_config/common.sh@43 -- # break 00:09:01.959 11:19:57 json_config_extra_key -- json_config/common.sh@48 -- # [[ -n '' ]] 00:09:01.959 11:19:57 json_config_extra_key -- json_config/common.sh@53 -- # echo 'SPDK target shutdown done' 00:09:01.959 SPDK target shutdown done 00:09:01.959 Success 00:09:01.959 11:19:57 json_config_extra_key -- json_config/json_config_extra_key.sh@30 -- # echo Success 00:09:01.959 00:09:01.959 real 0m1.777s 00:09:01.959 user 0m1.699s 00:09:01.959 sys 0m0.472s 00:09:01.959 11:19:57 json_config_extra_key -- common/autotest_common.sh@1126 -- # xtrace_disable 00:09:01.959 11:19:57 json_config_extra_key -- common/autotest_common.sh@10 -- # set +x 00:09:01.959 ************************************ 00:09:01.959 END TEST json_config_extra_key 00:09:01.959 ************************************ 00:09:02.218 11:19:57 -- spdk/autotest.sh@161 -- # run_test alias_rpc /home/vagrant/spdk_repo/spdk/test/json_config/alias_rpc/alias_rpc.sh 00:09:02.218 11:19:57 -- common/autotest_common.sh@1101 -- # '[' 2 -le 1 ']' 00:09:02.218 11:19:57 -- common/autotest_common.sh@1107 -- # xtrace_disable 00:09:02.218 11:19:57 -- common/autotest_common.sh@10 -- # set +x 00:09:02.218 ************************************ 00:09:02.218 START TEST alias_rpc 00:09:02.218 ************************************ 00:09:02.218 11:19:57 alias_rpc -- common/autotest_common.sh@1125 -- # /home/vagrant/spdk_repo/spdk/test/json_config/alias_rpc/alias_rpc.sh 00:09:02.218 * Looking for test storage... 00:09:02.218 * Found test storage at /home/vagrant/spdk_repo/spdk/test/json_config/alias_rpc 00:09:02.218 11:19:57 alias_rpc -- common/autotest_common.sh@1680 -- # [[ y == y ]] 00:09:02.218 11:19:57 alias_rpc -- common/autotest_common.sh@1681 -- # lcov --version 00:09:02.218 11:19:57 alias_rpc -- common/autotest_common.sh@1681 -- # awk '{print $NF}' 00:09:02.218 11:19:57 alias_rpc -- common/autotest_common.sh@1681 -- # lt 1.15 2 00:09:02.218 11:19:57 alias_rpc -- scripts/common.sh@373 -- # cmp_versions 1.15 '<' 2 00:09:02.218 11:19:57 alias_rpc -- scripts/common.sh@333 -- # local ver1 ver1_l 00:09:02.218 11:19:57 alias_rpc -- scripts/common.sh@334 -- # local ver2 ver2_l 00:09:02.218 11:19:57 alias_rpc -- scripts/common.sh@336 -- # IFS=.-: 00:09:02.218 11:19:57 alias_rpc -- scripts/common.sh@336 -- # read -ra ver1 00:09:02.218 11:19:57 alias_rpc -- scripts/common.sh@337 -- # IFS=.-: 00:09:02.218 11:19:57 alias_rpc -- scripts/common.sh@337 -- # read -ra ver2 00:09:02.218 11:19:57 alias_rpc -- scripts/common.sh@338 -- # local 'op=<' 00:09:02.218 11:19:57 alias_rpc -- scripts/common.sh@340 -- # ver1_l=2 00:09:02.218 11:19:57 alias_rpc -- scripts/common.sh@341 -- # ver2_l=1 00:09:02.218 11:19:57 alias_rpc -- scripts/common.sh@343 -- # local lt=0 gt=0 eq=0 v 00:09:02.218 11:19:57 alias_rpc -- scripts/common.sh@344 -- # case "$op" in 00:09:02.218 11:19:57 alias_rpc -- scripts/common.sh@345 -- # : 1 00:09:02.218 11:19:57 alias_rpc -- scripts/common.sh@364 -- # (( v = 0 )) 00:09:02.218 11:19:57 alias_rpc -- scripts/common.sh@364 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:09:02.218 11:19:57 alias_rpc -- scripts/common.sh@365 -- # decimal 1 00:09:02.218 11:19:57 alias_rpc -- scripts/common.sh@353 -- # local d=1 00:09:02.218 11:19:57 alias_rpc -- scripts/common.sh@354 -- # [[ 1 =~ ^[0-9]+$ ]] 00:09:02.218 11:19:57 alias_rpc -- scripts/common.sh@355 -- # echo 1 00:09:02.218 11:19:57 alias_rpc -- scripts/common.sh@365 -- # ver1[v]=1 00:09:02.218 11:19:57 alias_rpc -- scripts/common.sh@366 -- # decimal 2 00:09:02.218 11:19:57 alias_rpc -- scripts/common.sh@353 -- # local d=2 00:09:02.218 11:19:57 alias_rpc -- scripts/common.sh@354 -- # [[ 2 =~ ^[0-9]+$ ]] 00:09:02.218 11:19:57 alias_rpc -- scripts/common.sh@355 -- # echo 2 00:09:02.218 11:19:57 alias_rpc -- scripts/common.sh@366 -- # ver2[v]=2 00:09:02.218 11:19:57 alias_rpc -- scripts/common.sh@367 -- # (( ver1[v] > ver2[v] )) 00:09:02.218 11:19:57 alias_rpc -- scripts/common.sh@368 -- # (( ver1[v] < ver2[v] )) 00:09:02.218 11:19:57 alias_rpc -- scripts/common.sh@368 -- # return 0 00:09:02.218 11:19:57 alias_rpc -- common/autotest_common.sh@1682 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:09:02.218 11:19:57 alias_rpc -- common/autotest_common.sh@1694 -- # export 'LCOV_OPTS= 00:09:02.218 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:09:02.218 --rc genhtml_branch_coverage=1 00:09:02.218 --rc genhtml_function_coverage=1 00:09:02.218 --rc genhtml_legend=1 00:09:02.218 --rc geninfo_all_blocks=1 00:09:02.218 --rc geninfo_unexecuted_blocks=1 00:09:02.218 00:09:02.218 ' 00:09:02.218 11:19:57 alias_rpc -- common/autotest_common.sh@1694 -- # LCOV_OPTS=' 00:09:02.218 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:09:02.218 --rc genhtml_branch_coverage=1 00:09:02.218 --rc genhtml_function_coverage=1 00:09:02.218 --rc genhtml_legend=1 00:09:02.218 --rc geninfo_all_blocks=1 00:09:02.218 --rc geninfo_unexecuted_blocks=1 00:09:02.218 00:09:02.218 ' 00:09:02.218 11:19:57 alias_rpc -- common/autotest_common.sh@1695 -- # export 'LCOV=lcov 00:09:02.218 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:09:02.218 --rc genhtml_branch_coverage=1 00:09:02.218 --rc genhtml_function_coverage=1 00:09:02.218 --rc genhtml_legend=1 00:09:02.218 --rc geninfo_all_blocks=1 00:09:02.218 --rc geninfo_unexecuted_blocks=1 00:09:02.218 00:09:02.218 ' 00:09:02.218 11:19:57 alias_rpc -- common/autotest_common.sh@1695 -- # LCOV='lcov 00:09:02.218 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:09:02.218 --rc genhtml_branch_coverage=1 00:09:02.218 --rc genhtml_function_coverage=1 00:09:02.218 --rc genhtml_legend=1 00:09:02.218 --rc geninfo_all_blocks=1 00:09:02.218 --rc geninfo_unexecuted_blocks=1 00:09:02.218 00:09:02.218 ' 00:09:02.218 11:19:57 alias_rpc -- alias_rpc/alias_rpc.sh@10 -- # trap 'killprocess $spdk_tgt_pid; exit 1' ERR 00:09:02.218 11:19:57 alias_rpc -- alias_rpc/alias_rpc.sh@13 -- # spdk_tgt_pid=59845 00:09:02.218 11:19:57 alias_rpc -- alias_rpc/alias_rpc.sh@14 -- # waitforlisten 59845 00:09:02.218 11:19:57 alias_rpc -- alias_rpc/alias_rpc.sh@12 -- # /home/vagrant/spdk_repo/spdk/build/bin/spdk_tgt 00:09:02.218 11:19:57 alias_rpc -- common/autotest_common.sh@831 -- # '[' -z 59845 ']' 00:09:02.218 11:19:57 alias_rpc -- common/autotest_common.sh@835 -- # local rpc_addr=/var/tmp/spdk.sock 00:09:02.218 11:19:57 alias_rpc -- common/autotest_common.sh@836 -- # local max_retries=100 00:09:02.218 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:09:02.218 11:19:57 alias_rpc -- common/autotest_common.sh@838 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:09:02.218 11:19:57 alias_rpc -- common/autotest_common.sh@840 -- # xtrace_disable 00:09:02.218 11:19:57 alias_rpc -- common/autotest_common.sh@10 -- # set +x 00:09:02.218 [2024-10-07 11:19:57.739124] Starting SPDK v25.01-pre git sha1 2a4f56c54 / DPDK 24.03.0 initialization... 00:09:02.218 [2024-10-07 11:19:57.739236] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --iova-mode=pa --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid59845 ] 00:09:02.477 [2024-10-07 11:19:57.877780] app.c: 917:spdk_app_start: *NOTICE*: Total cores available: 1 00:09:02.477 [2024-10-07 11:19:57.994230] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 0 00:09:03.475 11:19:58 alias_rpc -- common/autotest_common.sh@860 -- # (( i == 0 )) 00:09:03.475 11:19:58 alias_rpc -- common/autotest_common.sh@864 -- # return 0 00:09:03.475 11:19:58 alias_rpc -- alias_rpc/alias_rpc.sh@17 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py load_config -i 00:09:03.733 11:19:59 alias_rpc -- alias_rpc/alias_rpc.sh@19 -- # killprocess 59845 00:09:03.734 11:19:59 alias_rpc -- common/autotest_common.sh@950 -- # '[' -z 59845 ']' 00:09:03.734 11:19:59 alias_rpc -- common/autotest_common.sh@954 -- # kill -0 59845 00:09:03.734 11:19:59 alias_rpc -- common/autotest_common.sh@955 -- # uname 00:09:03.734 11:19:59 alias_rpc -- common/autotest_common.sh@955 -- # '[' Linux = Linux ']' 00:09:03.734 11:19:59 alias_rpc -- common/autotest_common.sh@956 -- # ps --no-headers -o comm= 59845 00:09:03.734 11:19:59 alias_rpc -- common/autotest_common.sh@956 -- # process_name=reactor_0 00:09:03.734 11:19:59 alias_rpc -- common/autotest_common.sh@960 -- # '[' reactor_0 = sudo ']' 00:09:03.734 killing process with pid 59845 00:09:03.734 11:19:59 alias_rpc -- common/autotest_common.sh@968 -- # echo 'killing process with pid 59845' 00:09:03.734 11:19:59 alias_rpc -- common/autotest_common.sh@969 -- # kill 59845 00:09:03.734 11:19:59 alias_rpc -- common/autotest_common.sh@974 -- # wait 59845 00:09:04.301 00:09:04.301 real 0m2.050s 00:09:04.301 user 0m2.376s 00:09:04.301 sys 0m0.494s 00:09:04.301 11:19:59 alias_rpc -- common/autotest_common.sh@1126 -- # xtrace_disable 00:09:04.301 11:19:59 alias_rpc -- common/autotest_common.sh@10 -- # set +x 00:09:04.301 ************************************ 00:09:04.301 END TEST alias_rpc 00:09:04.301 ************************************ 00:09:04.301 11:19:59 -- spdk/autotest.sh@163 -- # [[ 1 -eq 0 ]] 00:09:04.301 11:19:59 -- spdk/autotest.sh@167 -- # run_test dpdk_mem_utility /home/vagrant/spdk_repo/spdk/test/dpdk_memory_utility/test_dpdk_mem_info.sh 00:09:04.301 11:19:59 -- common/autotest_common.sh@1101 -- # '[' 2 -le 1 ']' 00:09:04.301 11:19:59 -- common/autotest_common.sh@1107 -- # xtrace_disable 00:09:04.301 11:19:59 -- common/autotest_common.sh@10 -- # set +x 00:09:04.301 ************************************ 00:09:04.301 START TEST dpdk_mem_utility 00:09:04.301 ************************************ 00:09:04.301 11:19:59 dpdk_mem_utility -- common/autotest_common.sh@1125 -- # /home/vagrant/spdk_repo/spdk/test/dpdk_memory_utility/test_dpdk_mem_info.sh 00:09:04.301 * Looking for test storage... 00:09:04.301 * Found test storage at /home/vagrant/spdk_repo/spdk/test/dpdk_memory_utility 00:09:04.301 11:19:59 dpdk_mem_utility -- common/autotest_common.sh@1680 -- # [[ y == y ]] 00:09:04.301 11:19:59 dpdk_mem_utility -- common/autotest_common.sh@1681 -- # lcov --version 00:09:04.301 11:19:59 dpdk_mem_utility -- common/autotest_common.sh@1681 -- # awk '{print $NF}' 00:09:04.301 11:19:59 dpdk_mem_utility -- common/autotest_common.sh@1681 -- # lt 1.15 2 00:09:04.301 11:19:59 dpdk_mem_utility -- scripts/common.sh@373 -- # cmp_versions 1.15 '<' 2 00:09:04.301 11:19:59 dpdk_mem_utility -- scripts/common.sh@333 -- # local ver1 ver1_l 00:09:04.301 11:19:59 dpdk_mem_utility -- scripts/common.sh@334 -- # local ver2 ver2_l 00:09:04.301 11:19:59 dpdk_mem_utility -- scripts/common.sh@336 -- # IFS=.-: 00:09:04.301 11:19:59 dpdk_mem_utility -- scripts/common.sh@336 -- # read -ra ver1 00:09:04.301 11:19:59 dpdk_mem_utility -- scripts/common.sh@337 -- # IFS=.-: 00:09:04.301 11:19:59 dpdk_mem_utility -- scripts/common.sh@337 -- # read -ra ver2 00:09:04.301 11:19:59 dpdk_mem_utility -- scripts/common.sh@338 -- # local 'op=<' 00:09:04.301 11:19:59 dpdk_mem_utility -- scripts/common.sh@340 -- # ver1_l=2 00:09:04.301 11:19:59 dpdk_mem_utility -- scripts/common.sh@341 -- # ver2_l=1 00:09:04.301 11:19:59 dpdk_mem_utility -- scripts/common.sh@343 -- # local lt=0 gt=0 eq=0 v 00:09:04.301 11:19:59 dpdk_mem_utility -- scripts/common.sh@344 -- # case "$op" in 00:09:04.301 11:19:59 dpdk_mem_utility -- scripts/common.sh@345 -- # : 1 00:09:04.301 11:19:59 dpdk_mem_utility -- scripts/common.sh@364 -- # (( v = 0 )) 00:09:04.301 11:19:59 dpdk_mem_utility -- scripts/common.sh@364 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:09:04.301 11:19:59 dpdk_mem_utility -- scripts/common.sh@365 -- # decimal 1 00:09:04.301 11:19:59 dpdk_mem_utility -- scripts/common.sh@353 -- # local d=1 00:09:04.301 11:19:59 dpdk_mem_utility -- scripts/common.sh@354 -- # [[ 1 =~ ^[0-9]+$ ]] 00:09:04.301 11:19:59 dpdk_mem_utility -- scripts/common.sh@355 -- # echo 1 00:09:04.301 11:19:59 dpdk_mem_utility -- scripts/common.sh@365 -- # ver1[v]=1 00:09:04.301 11:19:59 dpdk_mem_utility -- scripts/common.sh@366 -- # decimal 2 00:09:04.301 11:19:59 dpdk_mem_utility -- scripts/common.sh@353 -- # local d=2 00:09:04.301 11:19:59 dpdk_mem_utility -- scripts/common.sh@354 -- # [[ 2 =~ ^[0-9]+$ ]] 00:09:04.301 11:19:59 dpdk_mem_utility -- scripts/common.sh@355 -- # echo 2 00:09:04.301 11:19:59 dpdk_mem_utility -- scripts/common.sh@366 -- # ver2[v]=2 00:09:04.301 11:19:59 dpdk_mem_utility -- scripts/common.sh@367 -- # (( ver1[v] > ver2[v] )) 00:09:04.301 11:19:59 dpdk_mem_utility -- scripts/common.sh@368 -- # (( ver1[v] < ver2[v] )) 00:09:04.301 11:19:59 dpdk_mem_utility -- scripts/common.sh@368 -- # return 0 00:09:04.301 11:19:59 dpdk_mem_utility -- common/autotest_common.sh@1682 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:09:04.301 11:19:59 dpdk_mem_utility -- common/autotest_common.sh@1694 -- # export 'LCOV_OPTS= 00:09:04.301 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:09:04.301 --rc genhtml_branch_coverage=1 00:09:04.301 --rc genhtml_function_coverage=1 00:09:04.301 --rc genhtml_legend=1 00:09:04.301 --rc geninfo_all_blocks=1 00:09:04.301 --rc geninfo_unexecuted_blocks=1 00:09:04.301 00:09:04.301 ' 00:09:04.301 11:19:59 dpdk_mem_utility -- common/autotest_common.sh@1694 -- # LCOV_OPTS=' 00:09:04.301 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:09:04.301 --rc genhtml_branch_coverage=1 00:09:04.301 --rc genhtml_function_coverage=1 00:09:04.301 --rc genhtml_legend=1 00:09:04.301 --rc geninfo_all_blocks=1 00:09:04.301 --rc geninfo_unexecuted_blocks=1 00:09:04.301 00:09:04.301 ' 00:09:04.301 11:19:59 dpdk_mem_utility -- common/autotest_common.sh@1695 -- # export 'LCOV=lcov 00:09:04.301 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:09:04.301 --rc genhtml_branch_coverage=1 00:09:04.301 --rc genhtml_function_coverage=1 00:09:04.301 --rc genhtml_legend=1 00:09:04.301 --rc geninfo_all_blocks=1 00:09:04.301 --rc geninfo_unexecuted_blocks=1 00:09:04.301 00:09:04.301 ' 00:09:04.301 11:19:59 dpdk_mem_utility -- common/autotest_common.sh@1695 -- # LCOV='lcov 00:09:04.301 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:09:04.301 --rc genhtml_branch_coverage=1 00:09:04.301 --rc genhtml_function_coverage=1 00:09:04.301 --rc genhtml_legend=1 00:09:04.301 --rc geninfo_all_blocks=1 00:09:04.301 --rc geninfo_unexecuted_blocks=1 00:09:04.301 00:09:04.301 ' 00:09:04.301 11:19:59 dpdk_mem_utility -- dpdk_memory_utility/test_dpdk_mem_info.sh@10 -- # MEM_SCRIPT=/home/vagrant/spdk_repo/spdk/scripts/dpdk_mem_info.py 00:09:04.301 11:19:59 dpdk_mem_utility -- dpdk_memory_utility/test_dpdk_mem_info.sh@13 -- # spdkpid=59945 00:09:04.301 11:19:59 dpdk_mem_utility -- dpdk_memory_utility/test_dpdk_mem_info.sh@12 -- # /home/vagrant/spdk_repo/spdk/build/bin/spdk_tgt 00:09:04.301 11:19:59 dpdk_mem_utility -- dpdk_memory_utility/test_dpdk_mem_info.sh@15 -- # waitforlisten 59945 00:09:04.301 11:19:59 dpdk_mem_utility -- common/autotest_common.sh@831 -- # '[' -z 59945 ']' 00:09:04.302 11:19:59 dpdk_mem_utility -- common/autotest_common.sh@835 -- # local rpc_addr=/var/tmp/spdk.sock 00:09:04.302 11:19:59 dpdk_mem_utility -- common/autotest_common.sh@836 -- # local max_retries=100 00:09:04.302 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:09:04.302 11:19:59 dpdk_mem_utility -- common/autotest_common.sh@838 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:09:04.302 11:19:59 dpdk_mem_utility -- common/autotest_common.sh@840 -- # xtrace_disable 00:09:04.302 11:19:59 dpdk_mem_utility -- common/autotest_common.sh@10 -- # set +x 00:09:04.560 [2024-10-07 11:19:59.846153] Starting SPDK v25.01-pre git sha1 2a4f56c54 / DPDK 24.03.0 initialization... 00:09:04.560 [2024-10-07 11:19:59.846268] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --iova-mode=pa --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid59945 ] 00:09:04.560 [2024-10-07 11:19:59.981009] app.c: 917:spdk_app_start: *NOTICE*: Total cores available: 1 00:09:04.818 [2024-10-07 11:20:00.097893] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 0 00:09:05.761 11:20:00 dpdk_mem_utility -- common/autotest_common.sh@860 -- # (( i == 0 )) 00:09:05.761 11:20:00 dpdk_mem_utility -- common/autotest_common.sh@864 -- # return 0 00:09:05.761 11:20:00 dpdk_mem_utility -- dpdk_memory_utility/test_dpdk_mem_info.sh@17 -- # trap 'killprocess $spdkpid' SIGINT SIGTERM EXIT 00:09:05.761 11:20:00 dpdk_mem_utility -- dpdk_memory_utility/test_dpdk_mem_info.sh@19 -- # rpc_cmd env_dpdk_get_mem_stats 00:09:05.761 11:20:00 dpdk_mem_utility -- common/autotest_common.sh@561 -- # xtrace_disable 00:09:05.761 11:20:00 dpdk_mem_utility -- common/autotest_common.sh@10 -- # set +x 00:09:05.761 { 00:09:05.761 "filename": "/tmp/spdk_mem_dump.txt" 00:09:05.761 } 00:09:05.761 11:20:00 dpdk_mem_utility -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:09:05.761 11:20:00 dpdk_mem_utility -- dpdk_memory_utility/test_dpdk_mem_info.sh@21 -- # /home/vagrant/spdk_repo/spdk/scripts/dpdk_mem_info.py 00:09:05.761 DPDK memory size 860.000000 MiB in 1 heap(s) 00:09:05.761 1 heaps totaling size 860.000000 MiB 00:09:05.761 size: 860.000000 MiB heap id: 0 00:09:05.761 end heaps---------- 00:09:05.761 9 mempools totaling size 642.649841 MiB 00:09:05.761 size: 212.674988 MiB name: PDU_immediate_data_Pool 00:09:05.761 size: 158.602051 MiB name: PDU_data_out_Pool 00:09:05.761 size: 92.545471 MiB name: bdev_io_59945 00:09:05.761 size: 51.011292 MiB name: evtpool_59945 00:09:05.761 size: 50.003479 MiB name: msgpool_59945 00:09:05.761 size: 36.509338 MiB name: fsdev_io_59945 00:09:05.761 size: 21.763794 MiB name: PDU_Pool 00:09:05.761 size: 19.513306 MiB name: SCSI_TASK_Pool 00:09:05.761 size: 0.026123 MiB name: Session_Pool 00:09:05.761 end mempools------- 00:09:05.761 6 memzones totaling size 4.142822 MiB 00:09:05.761 size: 1.000366 MiB name: RG_ring_0_59945 00:09:05.761 size: 1.000366 MiB name: RG_ring_1_59945 00:09:05.761 size: 1.000366 MiB name: RG_ring_4_59945 00:09:05.761 size: 1.000366 MiB name: RG_ring_5_59945 00:09:05.761 size: 0.125366 MiB name: RG_ring_2_59945 00:09:05.761 size: 0.015991 MiB name: RG_ring_3_59945 00:09:05.761 end memzones------- 00:09:05.761 11:20:00 dpdk_mem_utility -- dpdk_memory_utility/test_dpdk_mem_info.sh@23 -- # /home/vagrant/spdk_repo/spdk/scripts/dpdk_mem_info.py -m 0 00:09:05.761 heap id: 0 total size: 860.000000 MiB number of busy elements: 276 number of free elements: 16 00:09:05.761 list of free elements. size: 13.942200 MiB 00:09:05.761 element at address: 0x200000400000 with size: 1.999512 MiB 00:09:05.761 element at address: 0x200000800000 with size: 1.996948 MiB 00:09:05.761 element at address: 0x20001bc00000 with size: 0.999878 MiB 00:09:05.761 element at address: 0x20001be00000 with size: 0.999878 MiB 00:09:05.761 element at address: 0x200034a00000 with size: 0.994446 MiB 00:09:05.761 element at address: 0x200009600000 with size: 0.959839 MiB 00:09:05.761 element at address: 0x200015e00000 with size: 0.954285 MiB 00:09:05.761 element at address: 0x20001c000000 with size: 0.936584 MiB 00:09:05.761 element at address: 0x200000200000 with size: 0.834839 MiB 00:09:05.761 element at address: 0x20001d800000 with size: 0.572815 MiB 00:09:05.761 element at address: 0x20000d800000 with size: 0.489258 MiB 00:09:05.761 element at address: 0x200003e00000 with size: 0.487549 MiB 00:09:05.761 element at address: 0x20001c200000 with size: 0.485657 MiB 00:09:05.761 element at address: 0x200007000000 with size: 0.480286 MiB 00:09:05.761 element at address: 0x20002ac00000 with size: 0.398682 MiB 00:09:05.761 element at address: 0x200003a00000 with size: 0.351746 MiB 00:09:05.761 list of standard malloc elements. size: 199.261108 MiB 00:09:05.761 element at address: 0x20000d9fff80 with size: 132.000122 MiB 00:09:05.761 element at address: 0x2000097fff80 with size: 64.000122 MiB 00:09:05.761 element at address: 0x20001bcfff80 with size: 1.000122 MiB 00:09:05.761 element at address: 0x20001befff80 with size: 1.000122 MiB 00:09:05.761 element at address: 0x20001c0fff80 with size: 1.000122 MiB 00:09:05.761 element at address: 0x2000003d9f00 with size: 0.140747 MiB 00:09:05.761 element at address: 0x20001c0eff00 with size: 0.062622 MiB 00:09:05.761 element at address: 0x2000003fdf80 with size: 0.007935 MiB 00:09:05.761 element at address: 0x20001c0efdc0 with size: 0.000305 MiB 00:09:05.761 element at address: 0x2000002d5b80 with size: 0.000183 MiB 00:09:05.761 element at address: 0x2000002d5c40 with size: 0.000183 MiB 00:09:05.761 element at address: 0x2000002d5d00 with size: 0.000183 MiB 00:09:05.761 element at address: 0x2000002d5dc0 with size: 0.000183 MiB 00:09:05.761 element at address: 0x2000002d5e80 with size: 0.000183 MiB 00:09:05.761 element at address: 0x2000002d5f40 with size: 0.000183 MiB 00:09:05.761 element at address: 0x2000002d6000 with size: 0.000183 MiB 00:09:05.761 element at address: 0x2000002d60c0 with size: 0.000183 MiB 00:09:05.761 element at address: 0x2000002d6180 with size: 0.000183 MiB 00:09:05.761 element at address: 0x2000002d6240 with size: 0.000183 MiB 00:09:05.761 element at address: 0x2000002d6300 with size: 0.000183 MiB 00:09:05.761 element at address: 0x2000002d63c0 with size: 0.000183 MiB 00:09:05.761 element at address: 0x2000002d6480 with size: 0.000183 MiB 00:09:05.761 element at address: 0x2000002d6540 with size: 0.000183 MiB 00:09:05.761 element at address: 0x2000002d6600 with size: 0.000183 MiB 00:09:05.761 element at address: 0x2000002d66c0 with size: 0.000183 MiB 00:09:05.761 element at address: 0x2000002d6780 with size: 0.000183 MiB 00:09:05.761 element at address: 0x2000002d6840 with size: 0.000183 MiB 00:09:05.761 element at address: 0x2000002d6900 with size: 0.000183 MiB 00:09:05.761 element at address: 0x2000002d69c0 with size: 0.000183 MiB 00:09:05.761 element at address: 0x2000002d6a80 with size: 0.000183 MiB 00:09:05.761 element at address: 0x2000002d6b40 with size: 0.000183 MiB 00:09:05.761 element at address: 0x2000002d6c00 with size: 0.000183 MiB 00:09:05.761 element at address: 0x2000002d6cc0 with size: 0.000183 MiB 00:09:05.761 element at address: 0x2000002d6d80 with size: 0.000183 MiB 00:09:05.761 element at address: 0x2000002d6e40 with size: 0.000183 MiB 00:09:05.761 element at address: 0x2000002d6f00 with size: 0.000183 MiB 00:09:05.761 element at address: 0x2000002d7100 with size: 0.000183 MiB 00:09:05.761 element at address: 0x2000002d71c0 with size: 0.000183 MiB 00:09:05.761 element at address: 0x2000002d7280 with size: 0.000183 MiB 00:09:05.761 element at address: 0x2000002d7340 with size: 0.000183 MiB 00:09:05.761 element at address: 0x2000002d7400 with size: 0.000183 MiB 00:09:05.761 element at address: 0x2000002d74c0 with size: 0.000183 MiB 00:09:05.761 element at address: 0x2000002d7580 with size: 0.000183 MiB 00:09:05.761 element at address: 0x2000002d7640 with size: 0.000183 MiB 00:09:05.761 element at address: 0x2000002d7700 with size: 0.000183 MiB 00:09:05.761 element at address: 0x2000002d77c0 with size: 0.000183 MiB 00:09:05.761 element at address: 0x2000002d7880 with size: 0.000183 MiB 00:09:05.761 element at address: 0x2000002d7940 with size: 0.000183 MiB 00:09:05.761 element at address: 0x2000002d7a00 with size: 0.000183 MiB 00:09:05.761 element at address: 0x2000002d7ac0 with size: 0.000183 MiB 00:09:05.761 element at address: 0x2000002d7b80 with size: 0.000183 MiB 00:09:05.761 element at address: 0x2000002d7c40 with size: 0.000183 MiB 00:09:05.761 element at address: 0x2000003d9e40 with size: 0.000183 MiB 00:09:05.761 element at address: 0x200003a5a0c0 with size: 0.000183 MiB 00:09:05.761 element at address: 0x200003a5a2c0 with size: 0.000183 MiB 00:09:05.761 element at address: 0x200003a5e580 with size: 0.000183 MiB 00:09:05.761 element at address: 0x200003a7e840 with size: 0.000183 MiB 00:09:05.761 element at address: 0x200003a7e900 with size: 0.000183 MiB 00:09:05.761 element at address: 0x200003a7e9c0 with size: 0.000183 MiB 00:09:05.761 element at address: 0x200003a7ea80 with size: 0.000183 MiB 00:09:05.762 element at address: 0x200003a7eb40 with size: 0.000183 MiB 00:09:05.762 element at address: 0x200003a7ec00 with size: 0.000183 MiB 00:09:05.762 element at address: 0x200003a7ecc0 with size: 0.000183 MiB 00:09:05.762 element at address: 0x200003a7ed80 with size: 0.000183 MiB 00:09:05.762 element at address: 0x200003a7ee40 with size: 0.000183 MiB 00:09:05.762 element at address: 0x200003a7ef00 with size: 0.000183 MiB 00:09:05.762 element at address: 0x200003a7efc0 with size: 0.000183 MiB 00:09:05.762 element at address: 0x200003a7f080 with size: 0.000183 MiB 00:09:05.762 element at address: 0x200003a7f140 with size: 0.000183 MiB 00:09:05.762 element at address: 0x200003a7f200 with size: 0.000183 MiB 00:09:05.762 element at address: 0x200003a7f2c0 with size: 0.000183 MiB 00:09:05.762 element at address: 0x200003a7f380 with size: 0.000183 MiB 00:09:05.762 element at address: 0x200003a7f440 with size: 0.000183 MiB 00:09:05.762 element at address: 0x200003a7f500 with size: 0.000183 MiB 00:09:05.762 element at address: 0x200003a7f5c0 with size: 0.000183 MiB 00:09:05.762 element at address: 0x200003a7f680 with size: 0.000183 MiB 00:09:05.762 element at address: 0x200003aff940 with size: 0.000183 MiB 00:09:05.762 element at address: 0x200003affb40 with size: 0.000183 MiB 00:09:05.762 element at address: 0x200003e7cd00 with size: 0.000183 MiB 00:09:05.762 element at address: 0x200003e7cdc0 with size: 0.000183 MiB 00:09:05.762 element at address: 0x200003e7ce80 with size: 0.000183 MiB 00:09:05.762 element at address: 0x200003e7cf40 with size: 0.000183 MiB 00:09:05.762 element at address: 0x200003e7d000 with size: 0.000183 MiB 00:09:05.762 element at address: 0x200003e7d0c0 with size: 0.000183 MiB 00:09:05.762 element at address: 0x200003e7d180 with size: 0.000183 MiB 00:09:05.762 element at address: 0x200003e7d240 with size: 0.000183 MiB 00:09:05.762 element at address: 0x200003e7d300 with size: 0.000183 MiB 00:09:05.762 element at address: 0x200003e7d3c0 with size: 0.000183 MiB 00:09:05.762 element at address: 0x200003e7d480 with size: 0.000183 MiB 00:09:05.762 element at address: 0x200003e7d540 with size: 0.000183 MiB 00:09:05.762 element at address: 0x200003e7d600 with size: 0.000183 MiB 00:09:05.762 element at address: 0x200003e7d6c0 with size: 0.000183 MiB 00:09:05.762 element at address: 0x200003e7d780 with size: 0.000183 MiB 00:09:05.762 element at address: 0x200003e7d840 with size: 0.000183 MiB 00:09:05.762 element at address: 0x200003e7d900 with size: 0.000183 MiB 00:09:05.762 element at address: 0x200003e7d9c0 with size: 0.000183 MiB 00:09:05.762 element at address: 0x200003e7da80 with size: 0.000183 MiB 00:09:05.762 element at address: 0x200003e7db40 with size: 0.000183 MiB 00:09:05.762 element at address: 0x200003e7dc00 with size: 0.000183 MiB 00:09:05.762 element at address: 0x200003e7dcc0 with size: 0.000183 MiB 00:09:05.762 element at address: 0x200003e7dd80 with size: 0.000183 MiB 00:09:05.762 element at address: 0x200003e7de40 with size: 0.000183 MiB 00:09:05.762 element at address: 0x200003e7df00 with size: 0.000183 MiB 00:09:05.762 element at address: 0x200003e7dfc0 with size: 0.000183 MiB 00:09:05.762 element at address: 0x200003e7e080 with size: 0.000183 MiB 00:09:05.762 element at address: 0x200003e7e140 with size: 0.000183 MiB 00:09:05.762 element at address: 0x200003e7e200 with size: 0.000183 MiB 00:09:05.762 element at address: 0x200003e7e2c0 with size: 0.000183 MiB 00:09:05.762 element at address: 0x200003e7e380 with size: 0.000183 MiB 00:09:05.762 element at address: 0x200003e7e440 with size: 0.000183 MiB 00:09:05.762 element at address: 0x200003e7e500 with size: 0.000183 MiB 00:09:05.762 element at address: 0x200003e7e5c0 with size: 0.000183 MiB 00:09:05.762 element at address: 0x200003e7e680 with size: 0.000183 MiB 00:09:05.762 element at address: 0x200003e7e740 with size: 0.000183 MiB 00:09:05.762 element at address: 0x200003e7e800 with size: 0.000183 MiB 00:09:05.762 element at address: 0x200003e7e8c0 with size: 0.000183 MiB 00:09:05.762 element at address: 0x200003e7e980 with size: 0.000183 MiB 00:09:05.762 element at address: 0x200003e7ea40 with size: 0.000183 MiB 00:09:05.762 element at address: 0x200003e7eb00 with size: 0.000183 MiB 00:09:05.762 element at address: 0x200003e7ebc0 with size: 0.000183 MiB 00:09:05.762 element at address: 0x200003e7ec80 with size: 0.000183 MiB 00:09:05.762 element at address: 0x200003e7ed40 with size: 0.000183 MiB 00:09:05.762 element at address: 0x200003eff000 with size: 0.000183 MiB 00:09:05.762 element at address: 0x200003eff0c0 with size: 0.000183 MiB 00:09:05.762 element at address: 0x20000707af40 with size: 0.000183 MiB 00:09:05.762 element at address: 0x20000707b000 with size: 0.000183 MiB 00:09:05.762 element at address: 0x20000707b0c0 with size: 0.000183 MiB 00:09:05.762 element at address: 0x20000707b180 with size: 0.000183 MiB 00:09:05.762 element at address: 0x20000707b240 with size: 0.000183 MiB 00:09:05.762 element at address: 0x20000707b300 with size: 0.000183 MiB 00:09:05.762 element at address: 0x20000707b3c0 with size: 0.000183 MiB 00:09:05.762 element at address: 0x20000707b480 with size: 0.000183 MiB 00:09:05.762 element at address: 0x20000707b540 with size: 0.000183 MiB 00:09:05.762 element at address: 0x20000707b600 with size: 0.000183 MiB 00:09:05.762 element at address: 0x20000707b6c0 with size: 0.000183 MiB 00:09:05.762 element at address: 0x2000070fb980 with size: 0.000183 MiB 00:09:05.762 element at address: 0x2000096fdd80 with size: 0.000183 MiB 00:09:05.762 element at address: 0x20000d87d400 with size: 0.000183 MiB 00:09:05.762 element at address: 0x20000d87d4c0 with size: 0.000183 MiB 00:09:05.762 element at address: 0x20000d87d580 with size: 0.000183 MiB 00:09:05.762 element at address: 0x20000d87d640 with size: 0.000183 MiB 00:09:05.762 element at address: 0x20000d87d700 with size: 0.000183 MiB 00:09:05.762 element at address: 0x20000d87d7c0 with size: 0.000183 MiB 00:09:05.762 element at address: 0x20000d87d880 with size: 0.000183 MiB 00:09:05.762 element at address: 0x20000d87d940 with size: 0.000183 MiB 00:09:05.762 element at address: 0x20000d87da00 with size: 0.000183 MiB 00:09:05.762 element at address: 0x20000d87dac0 with size: 0.000183 MiB 00:09:05.762 element at address: 0x20000d8fdd80 with size: 0.000183 MiB 00:09:05.762 element at address: 0x200015ef44c0 with size: 0.000183 MiB 00:09:05.762 element at address: 0x20001c0efc40 with size: 0.000183 MiB 00:09:05.762 element at address: 0x20001c0efd00 with size: 0.000183 MiB 00:09:05.762 element at address: 0x20001c2bc740 with size: 0.000183 MiB 00:09:05.762 element at address: 0x20001d892a40 with size: 0.000183 MiB 00:09:05.762 element at address: 0x20001d892b00 with size: 0.000183 MiB 00:09:05.762 element at address: 0x20001d892bc0 with size: 0.000183 MiB 00:09:05.762 element at address: 0x20001d892c80 with size: 0.000183 MiB 00:09:05.762 element at address: 0x20001d892d40 with size: 0.000183 MiB 00:09:05.762 element at address: 0x20001d892e00 with size: 0.000183 MiB 00:09:05.762 element at address: 0x20001d892ec0 with size: 0.000183 MiB 00:09:05.762 element at address: 0x20001d892f80 with size: 0.000183 MiB 00:09:05.762 element at address: 0x20001d893040 with size: 0.000183 MiB 00:09:05.762 element at address: 0x20001d893100 with size: 0.000183 MiB 00:09:05.762 element at address: 0x20001d8931c0 with size: 0.000183 MiB 00:09:05.762 element at address: 0x20001d893280 with size: 0.000183 MiB 00:09:05.762 element at address: 0x20001d893340 with size: 0.000183 MiB 00:09:05.762 element at address: 0x20001d893400 with size: 0.000183 MiB 00:09:05.762 element at address: 0x20001d8934c0 with size: 0.000183 MiB 00:09:05.762 element at address: 0x20001d893580 with size: 0.000183 MiB 00:09:05.762 element at address: 0x20001d893640 with size: 0.000183 MiB 00:09:05.762 element at address: 0x20001d893700 with size: 0.000183 MiB 00:09:05.762 element at address: 0x20001d8937c0 with size: 0.000183 MiB 00:09:05.762 element at address: 0x20001d893880 with size: 0.000183 MiB 00:09:05.762 element at address: 0x20001d893940 with size: 0.000183 MiB 00:09:05.762 element at address: 0x20001d893a00 with size: 0.000183 MiB 00:09:05.762 element at address: 0x20001d893ac0 with size: 0.000183 MiB 00:09:05.762 element at address: 0x20001d893b80 with size: 0.000183 MiB 00:09:05.762 element at address: 0x20001d893c40 with size: 0.000183 MiB 00:09:05.762 element at address: 0x20001d893d00 with size: 0.000183 MiB 00:09:05.762 element at address: 0x20001d893dc0 with size: 0.000183 MiB 00:09:05.762 element at address: 0x20001d893e80 with size: 0.000183 MiB 00:09:05.762 element at address: 0x20001d893f40 with size: 0.000183 MiB 00:09:05.762 element at address: 0x20001d894000 with size: 0.000183 MiB 00:09:05.762 element at address: 0x20001d8940c0 with size: 0.000183 MiB 00:09:05.762 element at address: 0x20001d894180 with size: 0.000183 MiB 00:09:05.762 element at address: 0x20001d894240 with size: 0.000183 MiB 00:09:05.762 element at address: 0x20001d894300 with size: 0.000183 MiB 00:09:05.762 element at address: 0x20001d8943c0 with size: 0.000183 MiB 00:09:05.762 element at address: 0x20001d894480 with size: 0.000183 MiB 00:09:05.762 element at address: 0x20001d894540 with size: 0.000183 MiB 00:09:05.762 element at address: 0x20001d894600 with size: 0.000183 MiB 00:09:05.762 element at address: 0x20001d8946c0 with size: 0.000183 MiB 00:09:05.762 element at address: 0x20001d894780 with size: 0.000183 MiB 00:09:05.762 element at address: 0x20001d894840 with size: 0.000183 MiB 00:09:05.762 element at address: 0x20001d894900 with size: 0.000183 MiB 00:09:05.762 element at address: 0x20001d8949c0 with size: 0.000183 MiB 00:09:05.762 element at address: 0x20001d894a80 with size: 0.000183 MiB 00:09:05.762 element at address: 0x20001d894b40 with size: 0.000183 MiB 00:09:05.762 element at address: 0x20001d894c00 with size: 0.000183 MiB 00:09:05.762 element at address: 0x20001d894cc0 with size: 0.000183 MiB 00:09:05.762 element at address: 0x20001d894d80 with size: 0.000183 MiB 00:09:05.762 element at address: 0x20001d894e40 with size: 0.000183 MiB 00:09:05.762 element at address: 0x20001d894f00 with size: 0.000183 MiB 00:09:05.762 element at address: 0x20001d894fc0 with size: 0.000183 MiB 00:09:05.762 element at address: 0x20001d895080 with size: 0.000183 MiB 00:09:05.762 element at address: 0x20001d895140 with size: 0.000183 MiB 00:09:05.762 element at address: 0x20001d895200 with size: 0.000183 MiB 00:09:05.762 element at address: 0x20001d8952c0 with size: 0.000183 MiB 00:09:05.762 element at address: 0x20001d895380 with size: 0.000183 MiB 00:09:05.762 element at address: 0x20001d895440 with size: 0.000183 MiB 00:09:05.762 element at address: 0x20002ac66100 with size: 0.000183 MiB 00:09:05.762 element at address: 0x20002ac661c0 with size: 0.000183 MiB 00:09:05.763 element at address: 0x20002ac6cdc0 with size: 0.000183 MiB 00:09:05.763 element at address: 0x20002ac6cfc0 with size: 0.000183 MiB 00:09:05.763 element at address: 0x20002ac6d080 with size: 0.000183 MiB 00:09:05.763 element at address: 0x20002ac6d140 with size: 0.000183 MiB 00:09:05.763 element at address: 0x20002ac6d200 with size: 0.000183 MiB 00:09:05.763 element at address: 0x20002ac6d2c0 with size: 0.000183 MiB 00:09:05.763 element at address: 0x20002ac6d380 with size: 0.000183 MiB 00:09:05.763 element at address: 0x20002ac6d440 with size: 0.000183 MiB 00:09:05.763 element at address: 0x20002ac6d500 with size: 0.000183 MiB 00:09:05.763 element at address: 0x20002ac6d5c0 with size: 0.000183 MiB 00:09:05.763 element at address: 0x20002ac6d680 with size: 0.000183 MiB 00:09:05.763 element at address: 0x20002ac6d740 with size: 0.000183 MiB 00:09:05.763 element at address: 0x20002ac6d800 with size: 0.000183 MiB 00:09:05.763 element at address: 0x20002ac6d8c0 with size: 0.000183 MiB 00:09:05.763 element at address: 0x20002ac6d980 with size: 0.000183 MiB 00:09:05.763 element at address: 0x20002ac6da40 with size: 0.000183 MiB 00:09:05.763 element at address: 0x20002ac6db00 with size: 0.000183 MiB 00:09:05.763 element at address: 0x20002ac6dbc0 with size: 0.000183 MiB 00:09:05.763 element at address: 0x20002ac6dc80 with size: 0.000183 MiB 00:09:05.763 element at address: 0x20002ac6dd40 with size: 0.000183 MiB 00:09:05.763 element at address: 0x20002ac6de00 with size: 0.000183 MiB 00:09:05.763 element at address: 0x20002ac6dec0 with size: 0.000183 MiB 00:09:05.763 element at address: 0x20002ac6df80 with size: 0.000183 MiB 00:09:05.763 element at address: 0x20002ac6e040 with size: 0.000183 MiB 00:09:05.763 element at address: 0x20002ac6e100 with size: 0.000183 MiB 00:09:05.763 element at address: 0x20002ac6e1c0 with size: 0.000183 MiB 00:09:05.763 element at address: 0x20002ac6e280 with size: 0.000183 MiB 00:09:05.763 element at address: 0x20002ac6e340 with size: 0.000183 MiB 00:09:05.763 element at address: 0x20002ac6e400 with size: 0.000183 MiB 00:09:05.763 element at address: 0x20002ac6e4c0 with size: 0.000183 MiB 00:09:05.763 element at address: 0x20002ac6e580 with size: 0.000183 MiB 00:09:05.763 element at address: 0x20002ac6e640 with size: 0.000183 MiB 00:09:05.763 element at address: 0x20002ac6e700 with size: 0.000183 MiB 00:09:05.763 element at address: 0x20002ac6e7c0 with size: 0.000183 MiB 00:09:05.763 element at address: 0x20002ac6e880 with size: 0.000183 MiB 00:09:05.763 element at address: 0x20002ac6e940 with size: 0.000183 MiB 00:09:05.763 element at address: 0x20002ac6ea00 with size: 0.000183 MiB 00:09:05.763 element at address: 0x20002ac6eac0 with size: 0.000183 MiB 00:09:05.763 element at address: 0x20002ac6eb80 with size: 0.000183 MiB 00:09:05.763 element at address: 0x20002ac6ec40 with size: 0.000183 MiB 00:09:05.763 element at address: 0x20002ac6ed00 with size: 0.000183 MiB 00:09:05.763 element at address: 0x20002ac6edc0 with size: 0.000183 MiB 00:09:05.763 element at address: 0x20002ac6ee80 with size: 0.000183 MiB 00:09:05.763 element at address: 0x20002ac6ef40 with size: 0.000183 MiB 00:09:05.763 element at address: 0x20002ac6f000 with size: 0.000183 MiB 00:09:05.763 element at address: 0x20002ac6f0c0 with size: 0.000183 MiB 00:09:05.763 element at address: 0x20002ac6f180 with size: 0.000183 MiB 00:09:05.763 element at address: 0x20002ac6f240 with size: 0.000183 MiB 00:09:05.763 element at address: 0x20002ac6f300 with size: 0.000183 MiB 00:09:05.763 element at address: 0x20002ac6f3c0 with size: 0.000183 MiB 00:09:05.763 element at address: 0x20002ac6f480 with size: 0.000183 MiB 00:09:05.763 element at address: 0x20002ac6f540 with size: 0.000183 MiB 00:09:05.763 element at address: 0x20002ac6f600 with size: 0.000183 MiB 00:09:05.763 element at address: 0x20002ac6f6c0 with size: 0.000183 MiB 00:09:05.763 element at address: 0x20002ac6f780 with size: 0.000183 MiB 00:09:05.763 element at address: 0x20002ac6f840 with size: 0.000183 MiB 00:09:05.763 element at address: 0x20002ac6f900 with size: 0.000183 MiB 00:09:05.763 element at address: 0x20002ac6f9c0 with size: 0.000183 MiB 00:09:05.763 element at address: 0x20002ac6fa80 with size: 0.000183 MiB 00:09:05.763 element at address: 0x20002ac6fb40 with size: 0.000183 MiB 00:09:05.763 element at address: 0x20002ac6fc00 with size: 0.000183 MiB 00:09:05.763 element at address: 0x20002ac6fcc0 with size: 0.000183 MiB 00:09:05.763 element at address: 0x20002ac6fd80 with size: 0.000183 MiB 00:09:05.763 element at address: 0x20002ac6fe40 with size: 0.000183 MiB 00:09:05.763 element at address: 0x20002ac6ff00 with size: 0.000183 MiB 00:09:05.763 list of memzone associated elements. size: 646.796692 MiB 00:09:05.763 element at address: 0x20001d895500 with size: 211.416748 MiB 00:09:05.763 associated memzone info: size: 211.416626 MiB name: MP_PDU_immediate_data_Pool_0 00:09:05.763 element at address: 0x20002ac6ffc0 with size: 157.562561 MiB 00:09:05.763 associated memzone info: size: 157.562439 MiB name: MP_PDU_data_out_Pool_0 00:09:05.763 element at address: 0x200015ff4780 with size: 92.045044 MiB 00:09:05.763 associated memzone info: size: 92.044922 MiB name: MP_bdev_io_59945_0 00:09:05.763 element at address: 0x2000009ff380 with size: 48.003052 MiB 00:09:05.763 associated memzone info: size: 48.002930 MiB name: MP_evtpool_59945_0 00:09:05.763 element at address: 0x200003fff380 with size: 48.003052 MiB 00:09:05.763 associated memzone info: size: 48.002930 MiB name: MP_msgpool_59945_0 00:09:05.763 element at address: 0x2000071fdb80 with size: 36.008911 MiB 00:09:05.763 associated memzone info: size: 36.008789 MiB name: MP_fsdev_io_59945_0 00:09:05.763 element at address: 0x20001c3be940 with size: 20.255554 MiB 00:09:05.763 associated memzone info: size: 20.255432 MiB name: MP_PDU_Pool_0 00:09:05.763 element at address: 0x200034bfeb40 with size: 18.005066 MiB 00:09:05.763 associated memzone info: size: 18.004944 MiB name: MP_SCSI_TASK_Pool_0 00:09:05.763 element at address: 0x2000005ffe00 with size: 2.000488 MiB 00:09:05.763 associated memzone info: size: 2.000366 MiB name: RG_MP_evtpool_59945 00:09:05.763 element at address: 0x200003bffe00 with size: 2.000488 MiB 00:09:05.763 associated memzone info: size: 2.000366 MiB name: RG_MP_msgpool_59945 00:09:05.763 element at address: 0x2000002d7d00 with size: 1.008118 MiB 00:09:05.763 associated memzone info: size: 1.007996 MiB name: MP_evtpool_59945 00:09:05.763 element at address: 0x20000d8fde40 with size: 1.008118 MiB 00:09:05.763 associated memzone info: size: 1.007996 MiB name: MP_PDU_Pool 00:09:05.763 element at address: 0x20001c2bc800 with size: 1.008118 MiB 00:09:05.763 associated memzone info: size: 1.007996 MiB name: MP_PDU_immediate_data_Pool 00:09:05.763 element at address: 0x2000096fde40 with size: 1.008118 MiB 00:09:05.763 associated memzone info: size: 1.007996 MiB name: MP_PDU_data_out_Pool 00:09:05.763 element at address: 0x2000070fba40 with size: 1.008118 MiB 00:09:05.763 associated memzone info: size: 1.007996 MiB name: MP_SCSI_TASK_Pool 00:09:05.763 element at address: 0x200003eff180 with size: 1.000488 MiB 00:09:05.763 associated memzone info: size: 1.000366 MiB name: RG_ring_0_59945 00:09:05.763 element at address: 0x200003affc00 with size: 1.000488 MiB 00:09:05.763 associated memzone info: size: 1.000366 MiB name: RG_ring_1_59945 00:09:05.763 element at address: 0x200015ef4580 with size: 1.000488 MiB 00:09:05.763 associated memzone info: size: 1.000366 MiB name: RG_ring_4_59945 00:09:05.763 element at address: 0x200034afe940 with size: 1.000488 MiB 00:09:05.763 associated memzone info: size: 1.000366 MiB name: RG_ring_5_59945 00:09:05.763 element at address: 0x200003a7f740 with size: 0.500488 MiB 00:09:05.763 associated memzone info: size: 0.500366 MiB name: RG_MP_fsdev_io_59945 00:09:05.763 element at address: 0x200003e7ee00 with size: 0.500488 MiB 00:09:05.763 associated memzone info: size: 0.500366 MiB name: RG_MP_bdev_io_59945 00:09:05.763 element at address: 0x20000d87db80 with size: 0.500488 MiB 00:09:05.763 associated memzone info: size: 0.500366 MiB name: RG_MP_PDU_Pool 00:09:05.763 element at address: 0x20000707b780 with size: 0.500488 MiB 00:09:05.763 associated memzone info: size: 0.500366 MiB name: RG_MP_SCSI_TASK_Pool 00:09:05.763 element at address: 0x20001c27c540 with size: 0.250488 MiB 00:09:05.763 associated memzone info: size: 0.250366 MiB name: RG_MP_PDU_immediate_data_Pool 00:09:05.763 element at address: 0x200003a5e640 with size: 0.125488 MiB 00:09:05.763 associated memzone info: size: 0.125366 MiB name: RG_ring_2_59945 00:09:05.763 element at address: 0x2000096f5b80 with size: 0.031738 MiB 00:09:05.763 associated memzone info: size: 0.031616 MiB name: RG_MP_PDU_data_out_Pool 00:09:05.763 element at address: 0x20002ac66280 with size: 0.023743 MiB 00:09:05.763 associated memzone info: size: 0.023621 MiB name: MP_Session_Pool_0 00:09:05.763 element at address: 0x200003a5a380 with size: 0.016113 MiB 00:09:05.763 associated memzone info: size: 0.015991 MiB name: RG_ring_3_59945 00:09:05.763 element at address: 0x20002ac6c3c0 with size: 0.002441 MiB 00:09:05.763 associated memzone info: size: 0.002319 MiB name: RG_MP_Session_Pool 00:09:05.763 element at address: 0x2000002d6fc0 with size: 0.000305 MiB 00:09:05.763 associated memzone info: size: 0.000183 MiB name: MP_msgpool_59945 00:09:05.763 element at address: 0x200003affa00 with size: 0.000305 MiB 00:09:05.763 associated memzone info: size: 0.000183 MiB name: MP_fsdev_io_59945 00:09:05.763 element at address: 0x200003a5a180 with size: 0.000305 MiB 00:09:05.763 associated memzone info: size: 0.000183 MiB name: MP_bdev_io_59945 00:09:05.763 element at address: 0x20002ac6ce80 with size: 0.000305 MiB 00:09:05.763 associated memzone info: size: 0.000183 MiB name: MP_Session_Pool 00:09:05.763 11:20:01 dpdk_mem_utility -- dpdk_memory_utility/test_dpdk_mem_info.sh@25 -- # trap - SIGINT SIGTERM EXIT 00:09:05.763 11:20:01 dpdk_mem_utility -- dpdk_memory_utility/test_dpdk_mem_info.sh@26 -- # killprocess 59945 00:09:05.763 11:20:01 dpdk_mem_utility -- common/autotest_common.sh@950 -- # '[' -z 59945 ']' 00:09:05.763 11:20:01 dpdk_mem_utility -- common/autotest_common.sh@954 -- # kill -0 59945 00:09:05.763 11:20:01 dpdk_mem_utility -- common/autotest_common.sh@955 -- # uname 00:09:05.763 11:20:01 dpdk_mem_utility -- common/autotest_common.sh@955 -- # '[' Linux = Linux ']' 00:09:05.763 11:20:01 dpdk_mem_utility -- common/autotest_common.sh@956 -- # ps --no-headers -o comm= 59945 00:09:05.763 11:20:01 dpdk_mem_utility -- common/autotest_common.sh@956 -- # process_name=reactor_0 00:09:05.763 killing process with pid 59945 00:09:05.763 11:20:01 dpdk_mem_utility -- common/autotest_common.sh@960 -- # '[' reactor_0 = sudo ']' 00:09:05.763 11:20:01 dpdk_mem_utility -- common/autotest_common.sh@968 -- # echo 'killing process with pid 59945' 00:09:05.763 11:20:01 dpdk_mem_utility -- common/autotest_common.sh@969 -- # kill 59945 00:09:05.763 11:20:01 dpdk_mem_utility -- common/autotest_common.sh@974 -- # wait 59945 00:09:06.049 00:09:06.049 real 0m1.899s 00:09:06.049 user 0m2.120s 00:09:06.049 sys 0m0.450s 00:09:06.049 11:20:01 dpdk_mem_utility -- common/autotest_common.sh@1126 -- # xtrace_disable 00:09:06.049 ************************************ 00:09:06.049 END TEST dpdk_mem_utility 00:09:06.049 11:20:01 dpdk_mem_utility -- common/autotest_common.sh@10 -- # set +x 00:09:06.049 ************************************ 00:09:06.049 11:20:01 -- spdk/autotest.sh@168 -- # run_test event /home/vagrant/spdk_repo/spdk/test/event/event.sh 00:09:06.049 11:20:01 -- common/autotest_common.sh@1101 -- # '[' 2 -le 1 ']' 00:09:06.049 11:20:01 -- common/autotest_common.sh@1107 -- # xtrace_disable 00:09:06.049 11:20:01 -- common/autotest_common.sh@10 -- # set +x 00:09:06.049 ************************************ 00:09:06.049 START TEST event 00:09:06.049 ************************************ 00:09:06.049 11:20:01 event -- common/autotest_common.sh@1125 -- # /home/vagrant/spdk_repo/spdk/test/event/event.sh 00:09:06.308 * Looking for test storage... 00:09:06.308 * Found test storage at /home/vagrant/spdk_repo/spdk/test/event 00:09:06.308 11:20:01 event -- common/autotest_common.sh@1680 -- # [[ y == y ]] 00:09:06.308 11:20:01 event -- common/autotest_common.sh@1681 -- # lcov --version 00:09:06.308 11:20:01 event -- common/autotest_common.sh@1681 -- # awk '{print $NF}' 00:09:06.308 11:20:01 event -- common/autotest_common.sh@1681 -- # lt 1.15 2 00:09:06.308 11:20:01 event -- scripts/common.sh@373 -- # cmp_versions 1.15 '<' 2 00:09:06.308 11:20:01 event -- scripts/common.sh@333 -- # local ver1 ver1_l 00:09:06.308 11:20:01 event -- scripts/common.sh@334 -- # local ver2 ver2_l 00:09:06.308 11:20:01 event -- scripts/common.sh@336 -- # IFS=.-: 00:09:06.308 11:20:01 event -- scripts/common.sh@336 -- # read -ra ver1 00:09:06.308 11:20:01 event -- scripts/common.sh@337 -- # IFS=.-: 00:09:06.308 11:20:01 event -- scripts/common.sh@337 -- # read -ra ver2 00:09:06.308 11:20:01 event -- scripts/common.sh@338 -- # local 'op=<' 00:09:06.308 11:20:01 event -- scripts/common.sh@340 -- # ver1_l=2 00:09:06.308 11:20:01 event -- scripts/common.sh@341 -- # ver2_l=1 00:09:06.308 11:20:01 event -- scripts/common.sh@343 -- # local lt=0 gt=0 eq=0 v 00:09:06.308 11:20:01 event -- scripts/common.sh@344 -- # case "$op" in 00:09:06.308 11:20:01 event -- scripts/common.sh@345 -- # : 1 00:09:06.308 11:20:01 event -- scripts/common.sh@364 -- # (( v = 0 )) 00:09:06.308 11:20:01 event -- scripts/common.sh@364 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:09:06.308 11:20:01 event -- scripts/common.sh@365 -- # decimal 1 00:09:06.308 11:20:01 event -- scripts/common.sh@353 -- # local d=1 00:09:06.308 11:20:01 event -- scripts/common.sh@354 -- # [[ 1 =~ ^[0-9]+$ ]] 00:09:06.308 11:20:01 event -- scripts/common.sh@355 -- # echo 1 00:09:06.308 11:20:01 event -- scripts/common.sh@365 -- # ver1[v]=1 00:09:06.308 11:20:01 event -- scripts/common.sh@366 -- # decimal 2 00:09:06.308 11:20:01 event -- scripts/common.sh@353 -- # local d=2 00:09:06.308 11:20:01 event -- scripts/common.sh@354 -- # [[ 2 =~ ^[0-9]+$ ]] 00:09:06.308 11:20:01 event -- scripts/common.sh@355 -- # echo 2 00:09:06.308 11:20:01 event -- scripts/common.sh@366 -- # ver2[v]=2 00:09:06.308 11:20:01 event -- scripts/common.sh@367 -- # (( ver1[v] > ver2[v] )) 00:09:06.308 11:20:01 event -- scripts/common.sh@368 -- # (( ver1[v] < ver2[v] )) 00:09:06.308 11:20:01 event -- scripts/common.sh@368 -- # return 0 00:09:06.308 11:20:01 event -- common/autotest_common.sh@1682 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:09:06.308 11:20:01 event -- common/autotest_common.sh@1694 -- # export 'LCOV_OPTS= 00:09:06.308 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:09:06.308 --rc genhtml_branch_coverage=1 00:09:06.308 --rc genhtml_function_coverage=1 00:09:06.308 --rc genhtml_legend=1 00:09:06.308 --rc geninfo_all_blocks=1 00:09:06.308 --rc geninfo_unexecuted_blocks=1 00:09:06.308 00:09:06.308 ' 00:09:06.308 11:20:01 event -- common/autotest_common.sh@1694 -- # LCOV_OPTS=' 00:09:06.308 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:09:06.308 --rc genhtml_branch_coverage=1 00:09:06.308 --rc genhtml_function_coverage=1 00:09:06.308 --rc genhtml_legend=1 00:09:06.308 --rc geninfo_all_blocks=1 00:09:06.308 --rc geninfo_unexecuted_blocks=1 00:09:06.308 00:09:06.308 ' 00:09:06.308 11:20:01 event -- common/autotest_common.sh@1695 -- # export 'LCOV=lcov 00:09:06.308 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:09:06.308 --rc genhtml_branch_coverage=1 00:09:06.308 --rc genhtml_function_coverage=1 00:09:06.308 --rc genhtml_legend=1 00:09:06.308 --rc geninfo_all_blocks=1 00:09:06.308 --rc geninfo_unexecuted_blocks=1 00:09:06.308 00:09:06.308 ' 00:09:06.308 11:20:01 event -- common/autotest_common.sh@1695 -- # LCOV='lcov 00:09:06.308 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:09:06.308 --rc genhtml_branch_coverage=1 00:09:06.308 --rc genhtml_function_coverage=1 00:09:06.308 --rc genhtml_legend=1 00:09:06.308 --rc geninfo_all_blocks=1 00:09:06.308 --rc geninfo_unexecuted_blocks=1 00:09:06.308 00:09:06.308 ' 00:09:06.308 11:20:01 event -- event/event.sh@9 -- # source /home/vagrant/spdk_repo/spdk/test/bdev/nbd_common.sh 00:09:06.308 11:20:01 event -- bdev/nbd_common.sh@6 -- # set -e 00:09:06.308 11:20:01 event -- event/event.sh@45 -- # run_test event_perf /home/vagrant/spdk_repo/spdk/test/event/event_perf/event_perf -m 0xF -t 1 00:09:06.308 11:20:01 event -- common/autotest_common.sh@1101 -- # '[' 6 -le 1 ']' 00:09:06.308 11:20:01 event -- common/autotest_common.sh@1107 -- # xtrace_disable 00:09:06.308 11:20:01 event -- common/autotest_common.sh@10 -- # set +x 00:09:06.308 ************************************ 00:09:06.308 START TEST event_perf 00:09:06.308 ************************************ 00:09:06.308 11:20:01 event.event_perf -- common/autotest_common.sh@1125 -- # /home/vagrant/spdk_repo/spdk/test/event/event_perf/event_perf -m 0xF -t 1 00:09:06.308 Running I/O for 1 seconds...[2024-10-07 11:20:01.767767] Starting SPDK v25.01-pre git sha1 2a4f56c54 / DPDK 24.03.0 initialization... 00:09:06.308 [2024-10-07 11:20:01.767863] [ DPDK EAL parameters: event_perf --no-shconf -c 0xF --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --iova-mode=pa --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid60048 ] 00:09:06.566 [2024-10-07 11:20:01.906641] app.c: 917:spdk_app_start: *NOTICE*: Total cores available: 4 00:09:06.566 [2024-10-07 11:20:02.027680] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 1 00:09:06.566 [2024-10-07 11:20:02.027804] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 2 00:09:06.566 [2024-10-07 11:20:02.027926] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 3 00:09:06.566 [2024-10-07 11:20:02.027929] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 0 00:09:07.940 Running I/O for 1 seconds... 00:09:07.940 lcore 0: 193216 00:09:07.940 lcore 1: 193216 00:09:07.940 lcore 2: 193215 00:09:07.940 lcore 3: 193215 00:09:07.940 done. 00:09:07.940 00:09:07.940 real 0m1.370s 00:09:07.940 user 0m4.175s 00:09:07.940 sys 0m0.072s 00:09:07.940 11:20:03 event.event_perf -- common/autotest_common.sh@1126 -- # xtrace_disable 00:09:07.940 11:20:03 event.event_perf -- common/autotest_common.sh@10 -- # set +x 00:09:07.940 ************************************ 00:09:07.940 END TEST event_perf 00:09:07.940 ************************************ 00:09:07.940 11:20:03 event -- event/event.sh@46 -- # run_test event_reactor /home/vagrant/spdk_repo/spdk/test/event/reactor/reactor -t 1 00:09:07.940 11:20:03 event -- common/autotest_common.sh@1101 -- # '[' 4 -le 1 ']' 00:09:07.940 11:20:03 event -- common/autotest_common.sh@1107 -- # xtrace_disable 00:09:07.940 11:20:03 event -- common/autotest_common.sh@10 -- # set +x 00:09:07.940 ************************************ 00:09:07.940 START TEST event_reactor 00:09:07.940 ************************************ 00:09:07.940 11:20:03 event.event_reactor -- common/autotest_common.sh@1125 -- # /home/vagrant/spdk_repo/spdk/test/event/reactor/reactor -t 1 00:09:07.940 [2024-10-07 11:20:03.180418] Starting SPDK v25.01-pre git sha1 2a4f56c54 / DPDK 24.03.0 initialization... 00:09:07.940 [2024-10-07 11:20:03.180506] [ DPDK EAL parameters: reactor --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --iova-mode=pa --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid60092 ] 00:09:07.940 [2024-10-07 11:20:03.311546] app.c: 917:spdk_app_start: *NOTICE*: Total cores available: 1 00:09:07.940 [2024-10-07 11:20:03.427146] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 0 00:09:09.356 test_start 00:09:09.356 oneshot 00:09:09.356 tick 100 00:09:09.356 tick 100 00:09:09.356 tick 250 00:09:09.356 tick 100 00:09:09.356 tick 100 00:09:09.356 tick 250 00:09:09.356 tick 100 00:09:09.356 tick 500 00:09:09.356 tick 100 00:09:09.356 tick 100 00:09:09.356 tick 250 00:09:09.356 tick 100 00:09:09.356 tick 100 00:09:09.356 test_end 00:09:09.356 00:09:09.356 real 0m1.345s 00:09:09.356 user 0m1.188s 00:09:09.356 sys 0m0.051s 00:09:09.356 11:20:04 event.event_reactor -- common/autotest_common.sh@1126 -- # xtrace_disable 00:09:09.356 11:20:04 event.event_reactor -- common/autotest_common.sh@10 -- # set +x 00:09:09.356 ************************************ 00:09:09.356 END TEST event_reactor 00:09:09.356 ************************************ 00:09:09.356 11:20:04 event -- event/event.sh@47 -- # run_test event_reactor_perf /home/vagrant/spdk_repo/spdk/test/event/reactor_perf/reactor_perf -t 1 00:09:09.356 11:20:04 event -- common/autotest_common.sh@1101 -- # '[' 4 -le 1 ']' 00:09:09.356 11:20:04 event -- common/autotest_common.sh@1107 -- # xtrace_disable 00:09:09.356 11:20:04 event -- common/autotest_common.sh@10 -- # set +x 00:09:09.356 ************************************ 00:09:09.356 START TEST event_reactor_perf 00:09:09.356 ************************************ 00:09:09.356 11:20:04 event.event_reactor_perf -- common/autotest_common.sh@1125 -- # /home/vagrant/spdk_repo/spdk/test/event/reactor_perf/reactor_perf -t 1 00:09:09.356 [2024-10-07 11:20:04.582121] Starting SPDK v25.01-pre git sha1 2a4f56c54 / DPDK 24.03.0 initialization... 00:09:09.356 [2024-10-07 11:20:04.582233] [ DPDK EAL parameters: reactor_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --iova-mode=pa --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid60122 ] 00:09:09.356 [2024-10-07 11:20:04.721564] app.c: 917:spdk_app_start: *NOTICE*: Total cores available: 1 00:09:09.356 [2024-10-07 11:20:04.843261] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 0 00:09:10.730 test_start 00:09:10.730 test_end 00:09:10.730 Performance: 372661 events per second 00:09:10.730 00:09:10.730 real 0m1.369s 00:09:10.730 user 0m1.203s 00:09:10.730 sys 0m0.059s 00:09:10.730 11:20:05 event.event_reactor_perf -- common/autotest_common.sh@1126 -- # xtrace_disable 00:09:10.730 11:20:05 event.event_reactor_perf -- common/autotest_common.sh@10 -- # set +x 00:09:10.730 ************************************ 00:09:10.730 END TEST event_reactor_perf 00:09:10.730 ************************************ 00:09:10.730 11:20:05 event -- event/event.sh@49 -- # uname -s 00:09:10.730 11:20:05 event -- event/event.sh@49 -- # '[' Linux = Linux ']' 00:09:10.730 11:20:05 event -- event/event.sh@50 -- # run_test event_scheduler /home/vagrant/spdk_repo/spdk/test/event/scheduler/scheduler.sh 00:09:10.730 11:20:05 event -- common/autotest_common.sh@1101 -- # '[' 2 -le 1 ']' 00:09:10.730 11:20:05 event -- common/autotest_common.sh@1107 -- # xtrace_disable 00:09:10.730 11:20:05 event -- common/autotest_common.sh@10 -- # set +x 00:09:10.730 ************************************ 00:09:10.730 START TEST event_scheduler 00:09:10.730 ************************************ 00:09:10.730 11:20:05 event.event_scheduler -- common/autotest_common.sh@1125 -- # /home/vagrant/spdk_repo/spdk/test/event/scheduler/scheduler.sh 00:09:10.730 * Looking for test storage... 00:09:10.730 * Found test storage at /home/vagrant/spdk_repo/spdk/test/event/scheduler 00:09:10.730 11:20:06 event.event_scheduler -- common/autotest_common.sh@1680 -- # [[ y == y ]] 00:09:10.730 11:20:06 event.event_scheduler -- common/autotest_common.sh@1681 -- # lcov --version 00:09:10.730 11:20:06 event.event_scheduler -- common/autotest_common.sh@1681 -- # awk '{print $NF}' 00:09:10.730 11:20:06 event.event_scheduler -- common/autotest_common.sh@1681 -- # lt 1.15 2 00:09:10.730 11:20:06 event.event_scheduler -- scripts/common.sh@373 -- # cmp_versions 1.15 '<' 2 00:09:10.730 11:20:06 event.event_scheduler -- scripts/common.sh@333 -- # local ver1 ver1_l 00:09:10.730 11:20:06 event.event_scheduler -- scripts/common.sh@334 -- # local ver2 ver2_l 00:09:10.730 11:20:06 event.event_scheduler -- scripts/common.sh@336 -- # IFS=.-: 00:09:10.730 11:20:06 event.event_scheduler -- scripts/common.sh@336 -- # read -ra ver1 00:09:10.730 11:20:06 event.event_scheduler -- scripts/common.sh@337 -- # IFS=.-: 00:09:10.730 11:20:06 event.event_scheduler -- scripts/common.sh@337 -- # read -ra ver2 00:09:10.730 11:20:06 event.event_scheduler -- scripts/common.sh@338 -- # local 'op=<' 00:09:10.730 11:20:06 event.event_scheduler -- scripts/common.sh@340 -- # ver1_l=2 00:09:10.730 11:20:06 event.event_scheduler -- scripts/common.sh@341 -- # ver2_l=1 00:09:10.730 11:20:06 event.event_scheduler -- scripts/common.sh@343 -- # local lt=0 gt=0 eq=0 v 00:09:10.730 11:20:06 event.event_scheduler -- scripts/common.sh@344 -- # case "$op" in 00:09:10.730 11:20:06 event.event_scheduler -- scripts/common.sh@345 -- # : 1 00:09:10.730 11:20:06 event.event_scheduler -- scripts/common.sh@364 -- # (( v = 0 )) 00:09:10.730 11:20:06 event.event_scheduler -- scripts/common.sh@364 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:09:10.730 11:20:06 event.event_scheduler -- scripts/common.sh@365 -- # decimal 1 00:09:10.730 11:20:06 event.event_scheduler -- scripts/common.sh@353 -- # local d=1 00:09:10.730 11:20:06 event.event_scheduler -- scripts/common.sh@354 -- # [[ 1 =~ ^[0-9]+$ ]] 00:09:10.730 11:20:06 event.event_scheduler -- scripts/common.sh@355 -- # echo 1 00:09:10.730 11:20:06 event.event_scheduler -- scripts/common.sh@365 -- # ver1[v]=1 00:09:10.730 11:20:06 event.event_scheduler -- scripts/common.sh@366 -- # decimal 2 00:09:10.730 11:20:06 event.event_scheduler -- scripts/common.sh@353 -- # local d=2 00:09:10.730 11:20:06 event.event_scheduler -- scripts/common.sh@354 -- # [[ 2 =~ ^[0-9]+$ ]] 00:09:10.730 11:20:06 event.event_scheduler -- scripts/common.sh@355 -- # echo 2 00:09:10.730 11:20:06 event.event_scheduler -- scripts/common.sh@366 -- # ver2[v]=2 00:09:10.730 11:20:06 event.event_scheduler -- scripts/common.sh@367 -- # (( ver1[v] > ver2[v] )) 00:09:10.730 11:20:06 event.event_scheduler -- scripts/common.sh@368 -- # (( ver1[v] < ver2[v] )) 00:09:10.730 11:20:06 event.event_scheduler -- scripts/common.sh@368 -- # return 0 00:09:10.730 11:20:06 event.event_scheduler -- common/autotest_common.sh@1682 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:09:10.730 11:20:06 event.event_scheduler -- common/autotest_common.sh@1694 -- # export 'LCOV_OPTS= 00:09:10.730 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:09:10.730 --rc genhtml_branch_coverage=1 00:09:10.730 --rc genhtml_function_coverage=1 00:09:10.730 --rc genhtml_legend=1 00:09:10.730 --rc geninfo_all_blocks=1 00:09:10.730 --rc geninfo_unexecuted_blocks=1 00:09:10.730 00:09:10.730 ' 00:09:10.730 11:20:06 event.event_scheduler -- common/autotest_common.sh@1694 -- # LCOV_OPTS=' 00:09:10.730 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:09:10.730 --rc genhtml_branch_coverage=1 00:09:10.730 --rc genhtml_function_coverage=1 00:09:10.730 --rc genhtml_legend=1 00:09:10.730 --rc geninfo_all_blocks=1 00:09:10.730 --rc geninfo_unexecuted_blocks=1 00:09:10.730 00:09:10.730 ' 00:09:10.730 11:20:06 event.event_scheduler -- common/autotest_common.sh@1695 -- # export 'LCOV=lcov 00:09:10.730 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:09:10.730 --rc genhtml_branch_coverage=1 00:09:10.730 --rc genhtml_function_coverage=1 00:09:10.730 --rc genhtml_legend=1 00:09:10.730 --rc geninfo_all_blocks=1 00:09:10.730 --rc geninfo_unexecuted_blocks=1 00:09:10.730 00:09:10.730 ' 00:09:10.730 11:20:06 event.event_scheduler -- common/autotest_common.sh@1695 -- # LCOV='lcov 00:09:10.730 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:09:10.730 --rc genhtml_branch_coverage=1 00:09:10.730 --rc genhtml_function_coverage=1 00:09:10.730 --rc genhtml_legend=1 00:09:10.730 --rc geninfo_all_blocks=1 00:09:10.730 --rc geninfo_unexecuted_blocks=1 00:09:10.730 00:09:10.730 ' 00:09:10.730 11:20:06 event.event_scheduler -- scheduler/scheduler.sh@29 -- # rpc=rpc_cmd 00:09:10.730 11:20:06 event.event_scheduler -- scheduler/scheduler.sh@35 -- # scheduler_pid=60196 00:09:10.730 11:20:06 event.event_scheduler -- scheduler/scheduler.sh@34 -- # /home/vagrant/spdk_repo/spdk/test/event/scheduler/scheduler -m 0xF -p 0x2 --wait-for-rpc -f 00:09:10.730 11:20:06 event.event_scheduler -- scheduler/scheduler.sh@36 -- # trap 'killprocess $scheduler_pid; exit 1' SIGINT SIGTERM EXIT 00:09:10.730 11:20:06 event.event_scheduler -- scheduler/scheduler.sh@37 -- # waitforlisten 60196 00:09:10.730 11:20:06 event.event_scheduler -- common/autotest_common.sh@831 -- # '[' -z 60196 ']' 00:09:10.730 11:20:06 event.event_scheduler -- common/autotest_common.sh@835 -- # local rpc_addr=/var/tmp/spdk.sock 00:09:10.730 11:20:06 event.event_scheduler -- common/autotest_common.sh@836 -- # local max_retries=100 00:09:10.730 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:09:10.730 11:20:06 event.event_scheduler -- common/autotest_common.sh@838 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:09:10.730 11:20:06 event.event_scheduler -- common/autotest_common.sh@840 -- # xtrace_disable 00:09:10.730 11:20:06 event.event_scheduler -- common/autotest_common.sh@10 -- # set +x 00:09:10.730 [2024-10-07 11:20:06.212686] Starting SPDK v25.01-pre git sha1 2a4f56c54 / DPDK 24.03.0 initialization... 00:09:10.731 [2024-10-07 11:20:06.212796] [ DPDK EAL parameters: scheduler --no-shconf -c 0xF --main-lcore=2 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --iova-mode=pa --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid60196 ] 00:09:10.990 [2024-10-07 11:20:06.352696] app.c: 917:spdk_app_start: *NOTICE*: Total cores available: 4 00:09:10.990 [2024-10-07 11:20:06.511208] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 0 00:09:10.990 [2024-10-07 11:20:06.511322] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 1 00:09:10.990 [2024-10-07 11:20:06.511419] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 3 00:09:10.990 [2024-10-07 11:20:06.511730] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 2 00:09:11.924 11:20:07 event.event_scheduler -- common/autotest_common.sh@860 -- # (( i == 0 )) 00:09:11.924 11:20:07 event.event_scheduler -- common/autotest_common.sh@864 -- # return 0 00:09:11.924 11:20:07 event.event_scheduler -- scheduler/scheduler.sh@39 -- # rpc_cmd framework_set_scheduler dynamic 00:09:11.924 11:20:07 event.event_scheduler -- common/autotest_common.sh@561 -- # xtrace_disable 00:09:11.924 11:20:07 event.event_scheduler -- common/autotest_common.sh@10 -- # set +x 00:09:11.924 POWER: failed to open /sys/devices/system/cpu/cpu%u/cpufreq/scaling_governor 00:09:11.924 POWER: Cannot set governor of lcore 0 to userspace 00:09:11.924 POWER: failed to open /sys/devices/system/cpu/cpu%u/cpufreq/scaling_governor 00:09:11.924 POWER: Cannot set governor of lcore 0 to performance 00:09:11.924 POWER: failed to open /sys/devices/system/cpu/cpu%u/cpufreq/scaling_governor 00:09:11.924 POWER: Cannot set governor of lcore 0 to userspace 00:09:11.924 POWER: failed to open /sys/devices/system/cpu/cpu%u/cpufreq/scaling_governor 00:09:11.924 POWER: Cannot set governor of lcore 0 to userspace 00:09:11.924 GUEST_CHANNEL: Opening channel '/dev/virtio-ports/virtio.serial.port.poweragent.0' for lcore 0 00:09:11.924 GUEST_CHANNEL: Unable to connect to '/dev/virtio-ports/virtio.serial.port.poweragent.0' with error No such file or directory 00:09:11.924 POWER: Unable to set Power Management Environment for lcore 0 00:09:11.924 [2024-10-07 11:20:07.325986] dpdk_governor.c: 130:_init_core: *ERROR*: Failed to initialize on core0 00:09:11.924 [2024-10-07 11:20:07.326076] dpdk_governor.c: 191:_init: *ERROR*: Failed to initialize on core0 00:09:11.924 [2024-10-07 11:20:07.326141] scheduler_dynamic.c: 280:init: *NOTICE*: Unable to initialize dpdk governor 00:09:11.924 [2024-10-07 11:20:07.326221] scheduler_dynamic.c: 427:set_opts: *NOTICE*: Setting scheduler load limit to 20 00:09:11.924 [2024-10-07 11:20:07.326292] scheduler_dynamic.c: 429:set_opts: *NOTICE*: Setting scheduler core limit to 80 00:09:11.924 [2024-10-07 11:20:07.326355] scheduler_dynamic.c: 431:set_opts: *NOTICE*: Setting scheduler core busy to 95 00:09:11.924 11:20:07 event.event_scheduler -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:09:11.924 11:20:07 event.event_scheduler -- scheduler/scheduler.sh@40 -- # rpc_cmd framework_start_init 00:09:11.924 11:20:07 event.event_scheduler -- common/autotest_common.sh@561 -- # xtrace_disable 00:09:11.924 11:20:07 event.event_scheduler -- common/autotest_common.sh@10 -- # set +x 00:09:11.924 [2024-10-07 11:20:07.426267] scheduler.c: 382:test_start: *NOTICE*: Scheduler test application started. 00:09:11.924 11:20:07 event.event_scheduler -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:09:11.924 11:20:07 event.event_scheduler -- scheduler/scheduler.sh@43 -- # run_test scheduler_create_thread scheduler_create_thread 00:09:11.924 11:20:07 event.event_scheduler -- common/autotest_common.sh@1101 -- # '[' 2 -le 1 ']' 00:09:11.924 11:20:07 event.event_scheduler -- common/autotest_common.sh@1107 -- # xtrace_disable 00:09:11.924 11:20:07 event.event_scheduler -- common/autotest_common.sh@10 -- # set +x 00:09:11.924 ************************************ 00:09:11.924 START TEST scheduler_create_thread 00:09:11.924 ************************************ 00:09:11.924 11:20:07 event.event_scheduler.scheduler_create_thread -- common/autotest_common.sh@1125 -- # scheduler_create_thread 00:09:11.924 11:20:07 event.event_scheduler.scheduler_create_thread -- scheduler/scheduler.sh@12 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n active_pinned -m 0x1 -a 100 00:09:11.924 11:20:07 event.event_scheduler.scheduler_create_thread -- common/autotest_common.sh@561 -- # xtrace_disable 00:09:11.924 11:20:07 event.event_scheduler.scheduler_create_thread -- common/autotest_common.sh@10 -- # set +x 00:09:12.183 2 00:09:12.183 11:20:07 event.event_scheduler.scheduler_create_thread -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:09:12.183 11:20:07 event.event_scheduler.scheduler_create_thread -- scheduler/scheduler.sh@13 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n active_pinned -m 0x2 -a 100 00:09:12.183 11:20:07 event.event_scheduler.scheduler_create_thread -- common/autotest_common.sh@561 -- # xtrace_disable 00:09:12.183 11:20:07 event.event_scheduler.scheduler_create_thread -- common/autotest_common.sh@10 -- # set +x 00:09:12.183 3 00:09:12.183 11:20:07 event.event_scheduler.scheduler_create_thread -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:09:12.183 11:20:07 event.event_scheduler.scheduler_create_thread -- scheduler/scheduler.sh@14 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n active_pinned -m 0x4 -a 100 00:09:12.183 11:20:07 event.event_scheduler.scheduler_create_thread -- common/autotest_common.sh@561 -- # xtrace_disable 00:09:12.183 11:20:07 event.event_scheduler.scheduler_create_thread -- common/autotest_common.sh@10 -- # set +x 00:09:12.183 4 00:09:12.183 11:20:07 event.event_scheduler.scheduler_create_thread -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:09:12.183 11:20:07 event.event_scheduler.scheduler_create_thread -- scheduler/scheduler.sh@15 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n active_pinned -m 0x8 -a 100 00:09:12.183 11:20:07 event.event_scheduler.scheduler_create_thread -- common/autotest_common.sh@561 -- # xtrace_disable 00:09:12.183 11:20:07 event.event_scheduler.scheduler_create_thread -- common/autotest_common.sh@10 -- # set +x 00:09:12.183 5 00:09:12.183 11:20:07 event.event_scheduler.scheduler_create_thread -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:09:12.183 11:20:07 event.event_scheduler.scheduler_create_thread -- scheduler/scheduler.sh@16 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n idle_pinned -m 0x1 -a 0 00:09:12.183 11:20:07 event.event_scheduler.scheduler_create_thread -- common/autotest_common.sh@561 -- # xtrace_disable 00:09:12.183 11:20:07 event.event_scheduler.scheduler_create_thread -- common/autotest_common.sh@10 -- # set +x 00:09:12.183 6 00:09:12.183 11:20:07 event.event_scheduler.scheduler_create_thread -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:09:12.183 11:20:07 event.event_scheduler.scheduler_create_thread -- scheduler/scheduler.sh@17 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n idle_pinned -m 0x2 -a 0 00:09:12.183 11:20:07 event.event_scheduler.scheduler_create_thread -- common/autotest_common.sh@561 -- # xtrace_disable 00:09:12.183 11:20:07 event.event_scheduler.scheduler_create_thread -- common/autotest_common.sh@10 -- # set +x 00:09:12.183 7 00:09:12.183 11:20:07 event.event_scheduler.scheduler_create_thread -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:09:12.183 11:20:07 event.event_scheduler.scheduler_create_thread -- scheduler/scheduler.sh@18 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n idle_pinned -m 0x4 -a 0 00:09:12.183 11:20:07 event.event_scheduler.scheduler_create_thread -- common/autotest_common.sh@561 -- # xtrace_disable 00:09:12.183 11:20:07 event.event_scheduler.scheduler_create_thread -- common/autotest_common.sh@10 -- # set +x 00:09:12.183 8 00:09:12.183 11:20:07 event.event_scheduler.scheduler_create_thread -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:09:12.183 11:20:07 event.event_scheduler.scheduler_create_thread -- scheduler/scheduler.sh@19 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n idle_pinned -m 0x8 -a 0 00:09:12.183 11:20:07 event.event_scheduler.scheduler_create_thread -- common/autotest_common.sh@561 -- # xtrace_disable 00:09:12.183 11:20:07 event.event_scheduler.scheduler_create_thread -- common/autotest_common.sh@10 -- # set +x 00:09:12.183 9 00:09:12.183 11:20:07 event.event_scheduler.scheduler_create_thread -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:09:12.183 11:20:07 event.event_scheduler.scheduler_create_thread -- scheduler/scheduler.sh@21 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n one_third_active -a 30 00:09:12.183 11:20:07 event.event_scheduler.scheduler_create_thread -- common/autotest_common.sh@561 -- # xtrace_disable 00:09:12.183 11:20:07 event.event_scheduler.scheduler_create_thread -- common/autotest_common.sh@10 -- # set +x 00:09:12.183 10 00:09:12.183 11:20:07 event.event_scheduler.scheduler_create_thread -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:09:12.183 11:20:07 event.event_scheduler.scheduler_create_thread -- scheduler/scheduler.sh@22 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n half_active -a 0 00:09:12.184 11:20:07 event.event_scheduler.scheduler_create_thread -- common/autotest_common.sh@561 -- # xtrace_disable 00:09:12.184 11:20:07 event.event_scheduler.scheduler_create_thread -- common/autotest_common.sh@10 -- # set +x 00:09:12.184 11:20:07 event.event_scheduler.scheduler_create_thread -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:09:12.184 11:20:07 event.event_scheduler.scheduler_create_thread -- scheduler/scheduler.sh@22 -- # thread_id=11 00:09:12.184 11:20:07 event.event_scheduler.scheduler_create_thread -- scheduler/scheduler.sh@23 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_set_active 11 50 00:09:12.184 11:20:07 event.event_scheduler.scheduler_create_thread -- common/autotest_common.sh@561 -- # xtrace_disable 00:09:12.184 11:20:07 event.event_scheduler.scheduler_create_thread -- common/autotest_common.sh@10 -- # set +x 00:09:13.138 11:20:08 event.event_scheduler.scheduler_create_thread -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:09:13.138 11:20:08 event.event_scheduler.scheduler_create_thread -- scheduler/scheduler.sh@25 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n deleted -a 100 00:09:13.138 11:20:08 event.event_scheduler.scheduler_create_thread -- common/autotest_common.sh@561 -- # xtrace_disable 00:09:13.138 11:20:08 event.event_scheduler.scheduler_create_thread -- common/autotest_common.sh@10 -- # set +x 00:09:14.511 11:20:09 event.event_scheduler.scheduler_create_thread -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:09:14.511 11:20:09 event.event_scheduler.scheduler_create_thread -- scheduler/scheduler.sh@25 -- # thread_id=12 00:09:14.511 11:20:09 event.event_scheduler.scheduler_create_thread -- scheduler/scheduler.sh@26 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_delete 12 00:09:14.511 11:20:09 event.event_scheduler.scheduler_create_thread -- common/autotest_common.sh@561 -- # xtrace_disable 00:09:14.511 11:20:09 event.event_scheduler.scheduler_create_thread -- common/autotest_common.sh@10 -- # set +x 00:09:15.444 11:20:10 event.event_scheduler.scheduler_create_thread -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:09:15.444 00:09:15.444 real 0m3.377s 00:09:15.444 user 0m0.020s 00:09:15.444 sys 0m0.006s 00:09:15.444 11:20:10 event.event_scheduler.scheduler_create_thread -- common/autotest_common.sh@1126 -- # xtrace_disable 00:09:15.444 11:20:10 event.event_scheduler.scheduler_create_thread -- common/autotest_common.sh@10 -- # set +x 00:09:15.444 ************************************ 00:09:15.444 END TEST scheduler_create_thread 00:09:15.444 ************************************ 00:09:15.444 11:20:10 event.event_scheduler -- scheduler/scheduler.sh@45 -- # trap - SIGINT SIGTERM EXIT 00:09:15.444 11:20:10 event.event_scheduler -- scheduler/scheduler.sh@46 -- # killprocess 60196 00:09:15.444 11:20:10 event.event_scheduler -- common/autotest_common.sh@950 -- # '[' -z 60196 ']' 00:09:15.444 11:20:10 event.event_scheduler -- common/autotest_common.sh@954 -- # kill -0 60196 00:09:15.444 11:20:10 event.event_scheduler -- common/autotest_common.sh@955 -- # uname 00:09:15.444 11:20:10 event.event_scheduler -- common/autotest_common.sh@955 -- # '[' Linux = Linux ']' 00:09:15.444 11:20:10 event.event_scheduler -- common/autotest_common.sh@956 -- # ps --no-headers -o comm= 60196 00:09:15.444 11:20:10 event.event_scheduler -- common/autotest_common.sh@956 -- # process_name=reactor_2 00:09:15.444 11:20:10 event.event_scheduler -- common/autotest_common.sh@960 -- # '[' reactor_2 = sudo ']' 00:09:15.444 killing process with pid 60196 00:09:15.444 11:20:10 event.event_scheduler -- common/autotest_common.sh@968 -- # echo 'killing process with pid 60196' 00:09:15.444 11:20:10 event.event_scheduler -- common/autotest_common.sh@969 -- # kill 60196 00:09:15.444 11:20:10 event.event_scheduler -- common/autotest_common.sh@974 -- # wait 60196 00:09:15.703 [2024-10-07 11:20:11.195411] scheduler.c: 360:test_shutdown: *NOTICE*: Scheduler test application stopped. 00:09:15.960 00:09:15.960 real 0m5.492s 00:09:15.960 user 0m11.389s 00:09:15.960 sys 0m0.409s 00:09:15.960 11:20:11 event.event_scheduler -- common/autotest_common.sh@1126 -- # xtrace_disable 00:09:15.960 11:20:11 event.event_scheduler -- common/autotest_common.sh@10 -- # set +x 00:09:15.960 ************************************ 00:09:15.960 END TEST event_scheduler 00:09:15.960 ************************************ 00:09:16.218 11:20:11 event -- event/event.sh@51 -- # modprobe -n nbd 00:09:16.218 11:20:11 event -- event/event.sh@52 -- # run_test app_repeat app_repeat_test 00:09:16.218 11:20:11 event -- common/autotest_common.sh@1101 -- # '[' 2 -le 1 ']' 00:09:16.218 11:20:11 event -- common/autotest_common.sh@1107 -- # xtrace_disable 00:09:16.218 11:20:11 event -- common/autotest_common.sh@10 -- # set +x 00:09:16.218 ************************************ 00:09:16.218 START TEST app_repeat 00:09:16.218 ************************************ 00:09:16.218 11:20:11 event.app_repeat -- common/autotest_common.sh@1125 -- # app_repeat_test 00:09:16.218 11:20:11 event.app_repeat -- event/event.sh@12 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:09:16.218 11:20:11 event.app_repeat -- event/event.sh@13 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:09:16.218 11:20:11 event.app_repeat -- event/event.sh@13 -- # local nbd_list 00:09:16.218 11:20:11 event.app_repeat -- event/event.sh@14 -- # bdev_list=('Malloc0' 'Malloc1') 00:09:16.218 11:20:11 event.app_repeat -- event/event.sh@14 -- # local bdev_list 00:09:16.218 11:20:11 event.app_repeat -- event/event.sh@15 -- # local repeat_times=4 00:09:16.218 11:20:11 event.app_repeat -- event/event.sh@17 -- # modprobe nbd 00:09:16.218 11:20:11 event.app_repeat -- event/event.sh@19 -- # repeat_pid=60320 00:09:16.218 11:20:11 event.app_repeat -- event/event.sh@20 -- # trap 'killprocess $repeat_pid; exit 1' SIGINT SIGTERM EXIT 00:09:16.218 11:20:11 event.app_repeat -- event/event.sh@18 -- # /home/vagrant/spdk_repo/spdk/test/event/app_repeat/app_repeat -r /var/tmp/spdk-nbd.sock -m 0x3 -t 4 00:09:16.218 Process app_repeat pid: 60320 00:09:16.218 11:20:11 event.app_repeat -- event/event.sh@21 -- # echo 'Process app_repeat pid: 60320' 00:09:16.218 11:20:11 event.app_repeat -- event/event.sh@23 -- # for i in {0..2} 00:09:16.218 spdk_app_start Round 0 00:09:16.218 11:20:11 event.app_repeat -- event/event.sh@24 -- # echo 'spdk_app_start Round 0' 00:09:16.218 11:20:11 event.app_repeat -- event/event.sh@25 -- # waitforlisten 60320 /var/tmp/spdk-nbd.sock 00:09:16.218 11:20:11 event.app_repeat -- common/autotest_common.sh@831 -- # '[' -z 60320 ']' 00:09:16.218 11:20:11 event.app_repeat -- common/autotest_common.sh@835 -- # local rpc_addr=/var/tmp/spdk-nbd.sock 00:09:16.218 11:20:11 event.app_repeat -- common/autotest_common.sh@836 -- # local max_retries=100 00:09:16.218 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk-nbd.sock... 00:09:16.219 11:20:11 event.app_repeat -- common/autotest_common.sh@838 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk-nbd.sock...' 00:09:16.219 11:20:11 event.app_repeat -- common/autotest_common.sh@840 -- # xtrace_disable 00:09:16.219 11:20:11 event.app_repeat -- common/autotest_common.sh@10 -- # set +x 00:09:16.219 [2024-10-07 11:20:11.558625] Starting SPDK v25.01-pre git sha1 2a4f56c54 / DPDK 24.03.0 initialization... 00:09:16.219 [2024-10-07 11:20:11.558744] [ DPDK EAL parameters: app_repeat --no-shconf -c 0x3 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --iova-mode=pa --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid60320 ] 00:09:16.219 [2024-10-07 11:20:11.698252] app.c: 917:spdk_app_start: *NOTICE*: Total cores available: 2 00:09:16.476 [2024-10-07 11:20:11.833085] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 1 00:09:16.476 [2024-10-07 11:20:11.833101] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 0 00:09:17.411 11:20:12 event.app_repeat -- common/autotest_common.sh@860 -- # (( i == 0 )) 00:09:17.411 11:20:12 event.app_repeat -- common/autotest_common.sh@864 -- # return 0 00:09:17.411 11:20:12 event.app_repeat -- event/event.sh@27 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock bdev_malloc_create 64 4096 00:09:17.411 Malloc0 00:09:17.669 11:20:12 event.app_repeat -- event/event.sh@28 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock bdev_malloc_create 64 4096 00:09:17.927 Malloc1 00:09:17.927 11:20:13 event.app_repeat -- event/event.sh@30 -- # nbd_rpc_data_verify /var/tmp/spdk-nbd.sock 'Malloc0 Malloc1' '/dev/nbd0 /dev/nbd1' 00:09:17.927 11:20:13 event.app_repeat -- bdev/nbd_common.sh@90 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:09:17.927 11:20:13 event.app_repeat -- bdev/nbd_common.sh@91 -- # bdev_list=('Malloc0' 'Malloc1') 00:09:17.927 11:20:13 event.app_repeat -- bdev/nbd_common.sh@91 -- # local bdev_list 00:09:17.927 11:20:13 event.app_repeat -- bdev/nbd_common.sh@92 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:09:17.927 11:20:13 event.app_repeat -- bdev/nbd_common.sh@92 -- # local nbd_list 00:09:17.928 11:20:13 event.app_repeat -- bdev/nbd_common.sh@94 -- # nbd_start_disks /var/tmp/spdk-nbd.sock 'Malloc0 Malloc1' '/dev/nbd0 /dev/nbd1' 00:09:17.928 11:20:13 event.app_repeat -- bdev/nbd_common.sh@9 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:09:17.928 11:20:13 event.app_repeat -- bdev/nbd_common.sh@10 -- # bdev_list=('Malloc0' 'Malloc1') 00:09:17.928 11:20:13 event.app_repeat -- bdev/nbd_common.sh@10 -- # local bdev_list 00:09:17.928 11:20:13 event.app_repeat -- bdev/nbd_common.sh@11 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:09:17.928 11:20:13 event.app_repeat -- bdev/nbd_common.sh@11 -- # local nbd_list 00:09:17.928 11:20:13 event.app_repeat -- bdev/nbd_common.sh@12 -- # local i 00:09:17.928 11:20:13 event.app_repeat -- bdev/nbd_common.sh@14 -- # (( i = 0 )) 00:09:17.928 11:20:13 event.app_repeat -- bdev/nbd_common.sh@14 -- # (( i < 2 )) 00:09:17.928 11:20:13 event.app_repeat -- bdev/nbd_common.sh@15 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_start_disk Malloc0 /dev/nbd0 00:09:18.186 /dev/nbd0 00:09:18.186 11:20:13 event.app_repeat -- bdev/nbd_common.sh@17 -- # basename /dev/nbd0 00:09:18.186 11:20:13 event.app_repeat -- bdev/nbd_common.sh@17 -- # waitfornbd nbd0 00:09:18.186 11:20:13 event.app_repeat -- common/autotest_common.sh@868 -- # local nbd_name=nbd0 00:09:18.186 11:20:13 event.app_repeat -- common/autotest_common.sh@869 -- # local i 00:09:18.186 11:20:13 event.app_repeat -- common/autotest_common.sh@871 -- # (( i = 1 )) 00:09:18.186 11:20:13 event.app_repeat -- common/autotest_common.sh@871 -- # (( i <= 20 )) 00:09:18.186 11:20:13 event.app_repeat -- common/autotest_common.sh@872 -- # grep -q -w nbd0 /proc/partitions 00:09:18.186 11:20:13 event.app_repeat -- common/autotest_common.sh@873 -- # break 00:09:18.186 11:20:13 event.app_repeat -- common/autotest_common.sh@884 -- # (( i = 1 )) 00:09:18.186 11:20:13 event.app_repeat -- common/autotest_common.sh@884 -- # (( i <= 20 )) 00:09:18.186 11:20:13 event.app_repeat -- common/autotest_common.sh@885 -- # dd if=/dev/nbd0 of=/home/vagrant/spdk_repo/spdk/test/event/nbdtest bs=4096 count=1 iflag=direct 00:09:18.186 1+0 records in 00:09:18.186 1+0 records out 00:09:18.186 4096 bytes (4.1 kB, 4.0 KiB) copied, 0.000199357 s, 20.5 MB/s 00:09:18.186 11:20:13 event.app_repeat -- common/autotest_common.sh@886 -- # stat -c %s /home/vagrant/spdk_repo/spdk/test/event/nbdtest 00:09:18.186 11:20:13 event.app_repeat -- common/autotest_common.sh@886 -- # size=4096 00:09:18.186 11:20:13 event.app_repeat -- common/autotest_common.sh@887 -- # rm -f /home/vagrant/spdk_repo/spdk/test/event/nbdtest 00:09:18.186 11:20:13 event.app_repeat -- common/autotest_common.sh@888 -- # '[' 4096 '!=' 0 ']' 00:09:18.186 11:20:13 event.app_repeat -- common/autotest_common.sh@889 -- # return 0 00:09:18.186 11:20:13 event.app_repeat -- bdev/nbd_common.sh@14 -- # (( i++ )) 00:09:18.186 11:20:13 event.app_repeat -- bdev/nbd_common.sh@14 -- # (( i < 2 )) 00:09:18.186 11:20:13 event.app_repeat -- bdev/nbd_common.sh@15 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_start_disk Malloc1 /dev/nbd1 00:09:18.445 /dev/nbd1 00:09:18.445 11:20:13 event.app_repeat -- bdev/nbd_common.sh@17 -- # basename /dev/nbd1 00:09:18.445 11:20:13 event.app_repeat -- bdev/nbd_common.sh@17 -- # waitfornbd nbd1 00:09:18.445 11:20:13 event.app_repeat -- common/autotest_common.sh@868 -- # local nbd_name=nbd1 00:09:18.445 11:20:13 event.app_repeat -- common/autotest_common.sh@869 -- # local i 00:09:18.445 11:20:13 event.app_repeat -- common/autotest_common.sh@871 -- # (( i = 1 )) 00:09:18.445 11:20:13 event.app_repeat -- common/autotest_common.sh@871 -- # (( i <= 20 )) 00:09:18.445 11:20:13 event.app_repeat -- common/autotest_common.sh@872 -- # grep -q -w nbd1 /proc/partitions 00:09:18.445 11:20:13 event.app_repeat -- common/autotest_common.sh@873 -- # break 00:09:18.445 11:20:13 event.app_repeat -- common/autotest_common.sh@884 -- # (( i = 1 )) 00:09:18.445 11:20:13 event.app_repeat -- common/autotest_common.sh@884 -- # (( i <= 20 )) 00:09:18.445 11:20:13 event.app_repeat -- common/autotest_common.sh@885 -- # dd if=/dev/nbd1 of=/home/vagrant/spdk_repo/spdk/test/event/nbdtest bs=4096 count=1 iflag=direct 00:09:18.445 1+0 records in 00:09:18.445 1+0 records out 00:09:18.445 4096 bytes (4.1 kB, 4.0 KiB) copied, 0.000334147 s, 12.3 MB/s 00:09:18.445 11:20:13 event.app_repeat -- common/autotest_common.sh@886 -- # stat -c %s /home/vagrant/spdk_repo/spdk/test/event/nbdtest 00:09:18.445 11:20:13 event.app_repeat -- common/autotest_common.sh@886 -- # size=4096 00:09:18.445 11:20:13 event.app_repeat -- common/autotest_common.sh@887 -- # rm -f /home/vagrant/spdk_repo/spdk/test/event/nbdtest 00:09:18.445 11:20:13 event.app_repeat -- common/autotest_common.sh@888 -- # '[' 4096 '!=' 0 ']' 00:09:18.445 11:20:13 event.app_repeat -- common/autotest_common.sh@889 -- # return 0 00:09:18.445 11:20:13 event.app_repeat -- bdev/nbd_common.sh@14 -- # (( i++ )) 00:09:18.445 11:20:13 event.app_repeat -- bdev/nbd_common.sh@14 -- # (( i < 2 )) 00:09:18.445 11:20:13 event.app_repeat -- bdev/nbd_common.sh@95 -- # nbd_get_count /var/tmp/spdk-nbd.sock 00:09:18.704 11:20:13 event.app_repeat -- bdev/nbd_common.sh@61 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:09:18.704 11:20:13 event.app_repeat -- bdev/nbd_common.sh@63 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_get_disks 00:09:18.963 11:20:14 event.app_repeat -- bdev/nbd_common.sh@63 -- # nbd_disks_json='[ 00:09:18.963 { 00:09:18.963 "bdev_name": "Malloc0", 00:09:18.963 "nbd_device": "/dev/nbd0" 00:09:18.963 }, 00:09:18.963 { 00:09:18.963 "bdev_name": "Malloc1", 00:09:18.963 "nbd_device": "/dev/nbd1" 00:09:18.963 } 00:09:18.963 ]' 00:09:18.963 11:20:14 event.app_repeat -- bdev/nbd_common.sh@64 -- # echo '[ 00:09:18.963 { 00:09:18.963 "bdev_name": "Malloc0", 00:09:18.963 "nbd_device": "/dev/nbd0" 00:09:18.963 }, 00:09:18.963 { 00:09:18.963 "bdev_name": "Malloc1", 00:09:18.963 "nbd_device": "/dev/nbd1" 00:09:18.963 } 00:09:18.963 ]' 00:09:18.963 11:20:14 event.app_repeat -- bdev/nbd_common.sh@64 -- # jq -r '.[] | .nbd_device' 00:09:18.963 11:20:14 event.app_repeat -- bdev/nbd_common.sh@64 -- # nbd_disks_name='/dev/nbd0 00:09:18.963 /dev/nbd1' 00:09:18.963 11:20:14 event.app_repeat -- bdev/nbd_common.sh@65 -- # grep -c /dev/nbd 00:09:18.963 11:20:14 event.app_repeat -- bdev/nbd_common.sh@65 -- # echo '/dev/nbd0 00:09:18.963 /dev/nbd1' 00:09:18.963 11:20:14 event.app_repeat -- bdev/nbd_common.sh@65 -- # count=2 00:09:18.963 11:20:14 event.app_repeat -- bdev/nbd_common.sh@66 -- # echo 2 00:09:18.963 11:20:14 event.app_repeat -- bdev/nbd_common.sh@95 -- # count=2 00:09:18.963 11:20:14 event.app_repeat -- bdev/nbd_common.sh@96 -- # '[' 2 -ne 2 ']' 00:09:18.963 11:20:14 event.app_repeat -- bdev/nbd_common.sh@100 -- # nbd_dd_data_verify '/dev/nbd0 /dev/nbd1' write 00:09:18.963 11:20:14 event.app_repeat -- bdev/nbd_common.sh@70 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:09:18.963 11:20:14 event.app_repeat -- bdev/nbd_common.sh@70 -- # local nbd_list 00:09:18.963 11:20:14 event.app_repeat -- bdev/nbd_common.sh@71 -- # local operation=write 00:09:18.963 11:20:14 event.app_repeat -- bdev/nbd_common.sh@72 -- # local tmp_file=/home/vagrant/spdk_repo/spdk/test/event/nbdrandtest 00:09:18.963 11:20:14 event.app_repeat -- bdev/nbd_common.sh@74 -- # '[' write = write ']' 00:09:18.963 11:20:14 event.app_repeat -- bdev/nbd_common.sh@76 -- # dd if=/dev/urandom of=/home/vagrant/spdk_repo/spdk/test/event/nbdrandtest bs=4096 count=256 00:09:18.963 256+0 records in 00:09:18.963 256+0 records out 00:09:18.963 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00615812 s, 170 MB/s 00:09:18.963 11:20:14 event.app_repeat -- bdev/nbd_common.sh@77 -- # for i in "${nbd_list[@]}" 00:09:18.963 11:20:14 event.app_repeat -- bdev/nbd_common.sh@78 -- # dd if=/home/vagrant/spdk_repo/spdk/test/event/nbdrandtest of=/dev/nbd0 bs=4096 count=256 oflag=direct 00:09:18.963 256+0 records in 00:09:18.963 256+0 records out 00:09:18.963 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0203508 s, 51.5 MB/s 00:09:18.963 11:20:14 event.app_repeat -- bdev/nbd_common.sh@77 -- # for i in "${nbd_list[@]}" 00:09:18.963 11:20:14 event.app_repeat -- bdev/nbd_common.sh@78 -- # dd if=/home/vagrant/spdk_repo/spdk/test/event/nbdrandtest of=/dev/nbd1 bs=4096 count=256 oflag=direct 00:09:18.963 256+0 records in 00:09:18.963 256+0 records out 00:09:18.963 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0296971 s, 35.3 MB/s 00:09:18.963 11:20:14 event.app_repeat -- bdev/nbd_common.sh@101 -- # nbd_dd_data_verify '/dev/nbd0 /dev/nbd1' verify 00:09:18.963 11:20:14 event.app_repeat -- bdev/nbd_common.sh@70 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:09:18.963 11:20:14 event.app_repeat -- bdev/nbd_common.sh@70 -- # local nbd_list 00:09:18.963 11:20:14 event.app_repeat -- bdev/nbd_common.sh@71 -- # local operation=verify 00:09:18.963 11:20:14 event.app_repeat -- bdev/nbd_common.sh@72 -- # local tmp_file=/home/vagrant/spdk_repo/spdk/test/event/nbdrandtest 00:09:18.963 11:20:14 event.app_repeat -- bdev/nbd_common.sh@74 -- # '[' verify = write ']' 00:09:18.963 11:20:14 event.app_repeat -- bdev/nbd_common.sh@80 -- # '[' verify = verify ']' 00:09:18.963 11:20:14 event.app_repeat -- bdev/nbd_common.sh@82 -- # for i in "${nbd_list[@]}" 00:09:18.963 11:20:14 event.app_repeat -- bdev/nbd_common.sh@83 -- # cmp -b -n 1M /home/vagrant/spdk_repo/spdk/test/event/nbdrandtest /dev/nbd0 00:09:18.963 11:20:14 event.app_repeat -- bdev/nbd_common.sh@82 -- # for i in "${nbd_list[@]}" 00:09:18.963 11:20:14 event.app_repeat -- bdev/nbd_common.sh@83 -- # cmp -b -n 1M /home/vagrant/spdk_repo/spdk/test/event/nbdrandtest /dev/nbd1 00:09:18.963 11:20:14 event.app_repeat -- bdev/nbd_common.sh@85 -- # rm /home/vagrant/spdk_repo/spdk/test/event/nbdrandtest 00:09:18.963 11:20:14 event.app_repeat -- bdev/nbd_common.sh@103 -- # nbd_stop_disks /var/tmp/spdk-nbd.sock '/dev/nbd0 /dev/nbd1' 00:09:18.963 11:20:14 event.app_repeat -- bdev/nbd_common.sh@49 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:09:18.963 11:20:14 event.app_repeat -- bdev/nbd_common.sh@50 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:09:18.963 11:20:14 event.app_repeat -- bdev/nbd_common.sh@50 -- # local nbd_list 00:09:18.963 11:20:14 event.app_repeat -- bdev/nbd_common.sh@51 -- # local i 00:09:18.963 11:20:14 event.app_repeat -- bdev/nbd_common.sh@53 -- # for i in "${nbd_list[@]}" 00:09:18.963 11:20:14 event.app_repeat -- bdev/nbd_common.sh@54 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_stop_disk /dev/nbd0 00:09:19.222 11:20:14 event.app_repeat -- bdev/nbd_common.sh@55 -- # basename /dev/nbd0 00:09:19.480 11:20:14 event.app_repeat -- bdev/nbd_common.sh@55 -- # waitfornbd_exit nbd0 00:09:19.480 11:20:14 event.app_repeat -- bdev/nbd_common.sh@35 -- # local nbd_name=nbd0 00:09:19.480 11:20:14 event.app_repeat -- bdev/nbd_common.sh@37 -- # (( i = 1 )) 00:09:19.480 11:20:14 event.app_repeat -- bdev/nbd_common.sh@37 -- # (( i <= 20 )) 00:09:19.480 11:20:14 event.app_repeat -- bdev/nbd_common.sh@38 -- # grep -q -w nbd0 /proc/partitions 00:09:19.480 11:20:14 event.app_repeat -- bdev/nbd_common.sh@41 -- # break 00:09:19.480 11:20:14 event.app_repeat -- bdev/nbd_common.sh@45 -- # return 0 00:09:19.480 11:20:14 event.app_repeat -- bdev/nbd_common.sh@53 -- # for i in "${nbd_list[@]}" 00:09:19.480 11:20:14 event.app_repeat -- bdev/nbd_common.sh@54 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_stop_disk /dev/nbd1 00:09:19.739 11:20:15 event.app_repeat -- bdev/nbd_common.sh@55 -- # basename /dev/nbd1 00:09:19.739 11:20:15 event.app_repeat -- bdev/nbd_common.sh@55 -- # waitfornbd_exit nbd1 00:09:19.739 11:20:15 event.app_repeat -- bdev/nbd_common.sh@35 -- # local nbd_name=nbd1 00:09:19.739 11:20:15 event.app_repeat -- bdev/nbd_common.sh@37 -- # (( i = 1 )) 00:09:19.739 11:20:15 event.app_repeat -- bdev/nbd_common.sh@37 -- # (( i <= 20 )) 00:09:19.739 11:20:15 event.app_repeat -- bdev/nbd_common.sh@38 -- # grep -q -w nbd1 /proc/partitions 00:09:19.739 11:20:15 event.app_repeat -- bdev/nbd_common.sh@41 -- # break 00:09:19.739 11:20:15 event.app_repeat -- bdev/nbd_common.sh@45 -- # return 0 00:09:19.739 11:20:15 event.app_repeat -- bdev/nbd_common.sh@104 -- # nbd_get_count /var/tmp/spdk-nbd.sock 00:09:19.739 11:20:15 event.app_repeat -- bdev/nbd_common.sh@61 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:09:19.739 11:20:15 event.app_repeat -- bdev/nbd_common.sh@63 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_get_disks 00:09:19.997 11:20:15 event.app_repeat -- bdev/nbd_common.sh@63 -- # nbd_disks_json='[]' 00:09:19.998 11:20:15 event.app_repeat -- bdev/nbd_common.sh@64 -- # jq -r '.[] | .nbd_device' 00:09:19.998 11:20:15 event.app_repeat -- bdev/nbd_common.sh@64 -- # echo '[]' 00:09:19.998 11:20:15 event.app_repeat -- bdev/nbd_common.sh@64 -- # nbd_disks_name= 00:09:19.998 11:20:15 event.app_repeat -- bdev/nbd_common.sh@65 -- # echo '' 00:09:19.998 11:20:15 event.app_repeat -- bdev/nbd_common.sh@65 -- # grep -c /dev/nbd 00:09:19.998 11:20:15 event.app_repeat -- bdev/nbd_common.sh@65 -- # true 00:09:19.998 11:20:15 event.app_repeat -- bdev/nbd_common.sh@65 -- # count=0 00:09:19.998 11:20:15 event.app_repeat -- bdev/nbd_common.sh@66 -- # echo 0 00:09:19.998 11:20:15 event.app_repeat -- bdev/nbd_common.sh@104 -- # count=0 00:09:19.998 11:20:15 event.app_repeat -- bdev/nbd_common.sh@105 -- # '[' 0 -ne 0 ']' 00:09:19.998 11:20:15 event.app_repeat -- bdev/nbd_common.sh@109 -- # return 0 00:09:19.998 11:20:15 event.app_repeat -- event/event.sh@34 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock spdk_kill_instance SIGTERM 00:09:20.256 11:20:15 event.app_repeat -- event/event.sh@35 -- # sleep 3 00:09:20.515 [2024-10-07 11:20:15.967995] app.c: 917:spdk_app_start: *NOTICE*: Total cores available: 2 00:09:20.773 [2024-10-07 11:20:16.073375] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 1 00:09:20.773 [2024-10-07 11:20:16.073389] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 0 00:09:20.773 [2024-10-07 11:20:16.126261] notify.c: 45:spdk_notify_type_register: *NOTICE*: Notification type 'bdev_register' already registered. 00:09:20.773 [2024-10-07 11:20:16.126323] notify.c: 45:spdk_notify_type_register: *NOTICE*: Notification type 'bdev_unregister' already registered. 00:09:23.303 11:20:18 event.app_repeat -- event/event.sh@23 -- # for i in {0..2} 00:09:23.303 spdk_app_start Round 1 00:09:23.303 11:20:18 event.app_repeat -- event/event.sh@24 -- # echo 'spdk_app_start Round 1' 00:09:23.303 11:20:18 event.app_repeat -- event/event.sh@25 -- # waitforlisten 60320 /var/tmp/spdk-nbd.sock 00:09:23.303 11:20:18 event.app_repeat -- common/autotest_common.sh@831 -- # '[' -z 60320 ']' 00:09:23.303 11:20:18 event.app_repeat -- common/autotest_common.sh@835 -- # local rpc_addr=/var/tmp/spdk-nbd.sock 00:09:23.303 11:20:18 event.app_repeat -- common/autotest_common.sh@836 -- # local max_retries=100 00:09:23.303 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk-nbd.sock... 00:09:23.303 11:20:18 event.app_repeat -- common/autotest_common.sh@838 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk-nbd.sock...' 00:09:23.303 11:20:18 event.app_repeat -- common/autotest_common.sh@840 -- # xtrace_disable 00:09:23.304 11:20:18 event.app_repeat -- common/autotest_common.sh@10 -- # set +x 00:09:23.579 11:20:19 event.app_repeat -- common/autotest_common.sh@860 -- # (( i == 0 )) 00:09:23.579 11:20:19 event.app_repeat -- common/autotest_common.sh@864 -- # return 0 00:09:23.579 11:20:19 event.app_repeat -- event/event.sh@27 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock bdev_malloc_create 64 4096 00:09:24.144 Malloc0 00:09:24.144 11:20:19 event.app_repeat -- event/event.sh@28 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock bdev_malloc_create 64 4096 00:09:24.401 Malloc1 00:09:24.402 11:20:19 event.app_repeat -- event/event.sh@30 -- # nbd_rpc_data_verify /var/tmp/spdk-nbd.sock 'Malloc0 Malloc1' '/dev/nbd0 /dev/nbd1' 00:09:24.402 11:20:19 event.app_repeat -- bdev/nbd_common.sh@90 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:09:24.402 11:20:19 event.app_repeat -- bdev/nbd_common.sh@91 -- # bdev_list=('Malloc0' 'Malloc1') 00:09:24.402 11:20:19 event.app_repeat -- bdev/nbd_common.sh@91 -- # local bdev_list 00:09:24.402 11:20:19 event.app_repeat -- bdev/nbd_common.sh@92 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:09:24.402 11:20:19 event.app_repeat -- bdev/nbd_common.sh@92 -- # local nbd_list 00:09:24.402 11:20:19 event.app_repeat -- bdev/nbd_common.sh@94 -- # nbd_start_disks /var/tmp/spdk-nbd.sock 'Malloc0 Malloc1' '/dev/nbd0 /dev/nbd1' 00:09:24.402 11:20:19 event.app_repeat -- bdev/nbd_common.sh@9 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:09:24.402 11:20:19 event.app_repeat -- bdev/nbd_common.sh@10 -- # bdev_list=('Malloc0' 'Malloc1') 00:09:24.402 11:20:19 event.app_repeat -- bdev/nbd_common.sh@10 -- # local bdev_list 00:09:24.402 11:20:19 event.app_repeat -- bdev/nbd_common.sh@11 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:09:24.402 11:20:19 event.app_repeat -- bdev/nbd_common.sh@11 -- # local nbd_list 00:09:24.402 11:20:19 event.app_repeat -- bdev/nbd_common.sh@12 -- # local i 00:09:24.402 11:20:19 event.app_repeat -- bdev/nbd_common.sh@14 -- # (( i = 0 )) 00:09:24.402 11:20:19 event.app_repeat -- bdev/nbd_common.sh@14 -- # (( i < 2 )) 00:09:24.402 11:20:19 event.app_repeat -- bdev/nbd_common.sh@15 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_start_disk Malloc0 /dev/nbd0 00:09:24.659 /dev/nbd0 00:09:24.659 11:20:20 event.app_repeat -- bdev/nbd_common.sh@17 -- # basename /dev/nbd0 00:09:24.659 11:20:20 event.app_repeat -- bdev/nbd_common.sh@17 -- # waitfornbd nbd0 00:09:24.659 11:20:20 event.app_repeat -- common/autotest_common.sh@868 -- # local nbd_name=nbd0 00:09:24.659 11:20:20 event.app_repeat -- common/autotest_common.sh@869 -- # local i 00:09:24.659 11:20:20 event.app_repeat -- common/autotest_common.sh@871 -- # (( i = 1 )) 00:09:24.659 11:20:20 event.app_repeat -- common/autotest_common.sh@871 -- # (( i <= 20 )) 00:09:24.659 11:20:20 event.app_repeat -- common/autotest_common.sh@872 -- # grep -q -w nbd0 /proc/partitions 00:09:24.659 11:20:20 event.app_repeat -- common/autotest_common.sh@873 -- # break 00:09:24.659 11:20:20 event.app_repeat -- common/autotest_common.sh@884 -- # (( i = 1 )) 00:09:24.659 11:20:20 event.app_repeat -- common/autotest_common.sh@884 -- # (( i <= 20 )) 00:09:24.659 11:20:20 event.app_repeat -- common/autotest_common.sh@885 -- # dd if=/dev/nbd0 of=/home/vagrant/spdk_repo/spdk/test/event/nbdtest bs=4096 count=1 iflag=direct 00:09:24.659 1+0 records in 00:09:24.659 1+0 records out 00:09:24.659 4096 bytes (4.1 kB, 4.0 KiB) copied, 0.000288449 s, 14.2 MB/s 00:09:24.659 11:20:20 event.app_repeat -- common/autotest_common.sh@886 -- # stat -c %s /home/vagrant/spdk_repo/spdk/test/event/nbdtest 00:09:24.659 11:20:20 event.app_repeat -- common/autotest_common.sh@886 -- # size=4096 00:09:24.659 11:20:20 event.app_repeat -- common/autotest_common.sh@887 -- # rm -f /home/vagrant/spdk_repo/spdk/test/event/nbdtest 00:09:24.659 11:20:20 event.app_repeat -- common/autotest_common.sh@888 -- # '[' 4096 '!=' 0 ']' 00:09:24.659 11:20:20 event.app_repeat -- common/autotest_common.sh@889 -- # return 0 00:09:24.659 11:20:20 event.app_repeat -- bdev/nbd_common.sh@14 -- # (( i++ )) 00:09:24.659 11:20:20 event.app_repeat -- bdev/nbd_common.sh@14 -- # (( i < 2 )) 00:09:24.659 11:20:20 event.app_repeat -- bdev/nbd_common.sh@15 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_start_disk Malloc1 /dev/nbd1 00:09:24.917 /dev/nbd1 00:09:25.174 11:20:20 event.app_repeat -- bdev/nbd_common.sh@17 -- # basename /dev/nbd1 00:09:25.174 11:20:20 event.app_repeat -- bdev/nbd_common.sh@17 -- # waitfornbd nbd1 00:09:25.174 11:20:20 event.app_repeat -- common/autotest_common.sh@868 -- # local nbd_name=nbd1 00:09:25.174 11:20:20 event.app_repeat -- common/autotest_common.sh@869 -- # local i 00:09:25.174 11:20:20 event.app_repeat -- common/autotest_common.sh@871 -- # (( i = 1 )) 00:09:25.174 11:20:20 event.app_repeat -- common/autotest_common.sh@871 -- # (( i <= 20 )) 00:09:25.174 11:20:20 event.app_repeat -- common/autotest_common.sh@872 -- # grep -q -w nbd1 /proc/partitions 00:09:25.174 11:20:20 event.app_repeat -- common/autotest_common.sh@873 -- # break 00:09:25.174 11:20:20 event.app_repeat -- common/autotest_common.sh@884 -- # (( i = 1 )) 00:09:25.174 11:20:20 event.app_repeat -- common/autotest_common.sh@884 -- # (( i <= 20 )) 00:09:25.174 11:20:20 event.app_repeat -- common/autotest_common.sh@885 -- # dd if=/dev/nbd1 of=/home/vagrant/spdk_repo/spdk/test/event/nbdtest bs=4096 count=1 iflag=direct 00:09:25.174 1+0 records in 00:09:25.174 1+0 records out 00:09:25.174 4096 bytes (4.1 kB, 4.0 KiB) copied, 0.000343942 s, 11.9 MB/s 00:09:25.174 11:20:20 event.app_repeat -- common/autotest_common.sh@886 -- # stat -c %s /home/vagrant/spdk_repo/spdk/test/event/nbdtest 00:09:25.174 11:20:20 event.app_repeat -- common/autotest_common.sh@886 -- # size=4096 00:09:25.174 11:20:20 event.app_repeat -- common/autotest_common.sh@887 -- # rm -f /home/vagrant/spdk_repo/spdk/test/event/nbdtest 00:09:25.174 11:20:20 event.app_repeat -- common/autotest_common.sh@888 -- # '[' 4096 '!=' 0 ']' 00:09:25.174 11:20:20 event.app_repeat -- common/autotest_common.sh@889 -- # return 0 00:09:25.174 11:20:20 event.app_repeat -- bdev/nbd_common.sh@14 -- # (( i++ )) 00:09:25.174 11:20:20 event.app_repeat -- bdev/nbd_common.sh@14 -- # (( i < 2 )) 00:09:25.175 11:20:20 event.app_repeat -- bdev/nbd_common.sh@95 -- # nbd_get_count /var/tmp/spdk-nbd.sock 00:09:25.175 11:20:20 event.app_repeat -- bdev/nbd_common.sh@61 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:09:25.175 11:20:20 event.app_repeat -- bdev/nbd_common.sh@63 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_get_disks 00:09:25.432 11:20:20 event.app_repeat -- bdev/nbd_common.sh@63 -- # nbd_disks_json='[ 00:09:25.432 { 00:09:25.433 "bdev_name": "Malloc0", 00:09:25.433 "nbd_device": "/dev/nbd0" 00:09:25.433 }, 00:09:25.433 { 00:09:25.433 "bdev_name": "Malloc1", 00:09:25.433 "nbd_device": "/dev/nbd1" 00:09:25.433 } 00:09:25.433 ]' 00:09:25.433 11:20:20 event.app_repeat -- bdev/nbd_common.sh@64 -- # echo '[ 00:09:25.433 { 00:09:25.433 "bdev_name": "Malloc0", 00:09:25.433 "nbd_device": "/dev/nbd0" 00:09:25.433 }, 00:09:25.433 { 00:09:25.433 "bdev_name": "Malloc1", 00:09:25.433 "nbd_device": "/dev/nbd1" 00:09:25.433 } 00:09:25.433 ]' 00:09:25.433 11:20:20 event.app_repeat -- bdev/nbd_common.sh@64 -- # jq -r '.[] | .nbd_device' 00:09:25.433 11:20:20 event.app_repeat -- bdev/nbd_common.sh@64 -- # nbd_disks_name='/dev/nbd0 00:09:25.433 /dev/nbd1' 00:09:25.433 11:20:20 event.app_repeat -- bdev/nbd_common.sh@65 -- # echo '/dev/nbd0 00:09:25.433 /dev/nbd1' 00:09:25.433 11:20:20 event.app_repeat -- bdev/nbd_common.sh@65 -- # grep -c /dev/nbd 00:09:25.433 11:20:20 event.app_repeat -- bdev/nbd_common.sh@65 -- # count=2 00:09:25.433 11:20:20 event.app_repeat -- bdev/nbd_common.sh@66 -- # echo 2 00:09:25.433 11:20:20 event.app_repeat -- bdev/nbd_common.sh@95 -- # count=2 00:09:25.433 11:20:20 event.app_repeat -- bdev/nbd_common.sh@96 -- # '[' 2 -ne 2 ']' 00:09:25.433 11:20:20 event.app_repeat -- bdev/nbd_common.sh@100 -- # nbd_dd_data_verify '/dev/nbd0 /dev/nbd1' write 00:09:25.433 11:20:20 event.app_repeat -- bdev/nbd_common.sh@70 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:09:25.433 11:20:20 event.app_repeat -- bdev/nbd_common.sh@70 -- # local nbd_list 00:09:25.433 11:20:20 event.app_repeat -- bdev/nbd_common.sh@71 -- # local operation=write 00:09:25.433 11:20:20 event.app_repeat -- bdev/nbd_common.sh@72 -- # local tmp_file=/home/vagrant/spdk_repo/spdk/test/event/nbdrandtest 00:09:25.433 11:20:20 event.app_repeat -- bdev/nbd_common.sh@74 -- # '[' write = write ']' 00:09:25.433 11:20:20 event.app_repeat -- bdev/nbd_common.sh@76 -- # dd if=/dev/urandom of=/home/vagrant/spdk_repo/spdk/test/event/nbdrandtest bs=4096 count=256 00:09:25.433 256+0 records in 00:09:25.433 256+0 records out 00:09:25.433 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00741701 s, 141 MB/s 00:09:25.433 11:20:20 event.app_repeat -- bdev/nbd_common.sh@77 -- # for i in "${nbd_list[@]}" 00:09:25.433 11:20:20 event.app_repeat -- bdev/nbd_common.sh@78 -- # dd if=/home/vagrant/spdk_repo/spdk/test/event/nbdrandtest of=/dev/nbd0 bs=4096 count=256 oflag=direct 00:09:25.433 256+0 records in 00:09:25.433 256+0 records out 00:09:25.433 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0249894 s, 42.0 MB/s 00:09:25.433 11:20:20 event.app_repeat -- bdev/nbd_common.sh@77 -- # for i in "${nbd_list[@]}" 00:09:25.433 11:20:20 event.app_repeat -- bdev/nbd_common.sh@78 -- # dd if=/home/vagrant/spdk_repo/spdk/test/event/nbdrandtest of=/dev/nbd1 bs=4096 count=256 oflag=direct 00:09:25.433 256+0 records in 00:09:25.433 256+0 records out 00:09:25.433 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0305056 s, 34.4 MB/s 00:09:25.433 11:20:20 event.app_repeat -- bdev/nbd_common.sh@101 -- # nbd_dd_data_verify '/dev/nbd0 /dev/nbd1' verify 00:09:25.433 11:20:20 event.app_repeat -- bdev/nbd_common.sh@70 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:09:25.433 11:20:20 event.app_repeat -- bdev/nbd_common.sh@70 -- # local nbd_list 00:09:25.433 11:20:20 event.app_repeat -- bdev/nbd_common.sh@71 -- # local operation=verify 00:09:25.433 11:20:20 event.app_repeat -- bdev/nbd_common.sh@72 -- # local tmp_file=/home/vagrant/spdk_repo/spdk/test/event/nbdrandtest 00:09:25.433 11:20:20 event.app_repeat -- bdev/nbd_common.sh@74 -- # '[' verify = write ']' 00:09:25.433 11:20:20 event.app_repeat -- bdev/nbd_common.sh@80 -- # '[' verify = verify ']' 00:09:25.433 11:20:20 event.app_repeat -- bdev/nbd_common.sh@82 -- # for i in "${nbd_list[@]}" 00:09:25.433 11:20:20 event.app_repeat -- bdev/nbd_common.sh@83 -- # cmp -b -n 1M /home/vagrant/spdk_repo/spdk/test/event/nbdrandtest /dev/nbd0 00:09:25.433 11:20:20 event.app_repeat -- bdev/nbd_common.sh@82 -- # for i in "${nbd_list[@]}" 00:09:25.433 11:20:20 event.app_repeat -- bdev/nbd_common.sh@83 -- # cmp -b -n 1M /home/vagrant/spdk_repo/spdk/test/event/nbdrandtest /dev/nbd1 00:09:25.433 11:20:20 event.app_repeat -- bdev/nbd_common.sh@85 -- # rm /home/vagrant/spdk_repo/spdk/test/event/nbdrandtest 00:09:25.433 11:20:20 event.app_repeat -- bdev/nbd_common.sh@103 -- # nbd_stop_disks /var/tmp/spdk-nbd.sock '/dev/nbd0 /dev/nbd1' 00:09:25.433 11:20:20 event.app_repeat -- bdev/nbd_common.sh@49 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:09:25.433 11:20:20 event.app_repeat -- bdev/nbd_common.sh@50 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:09:25.433 11:20:20 event.app_repeat -- bdev/nbd_common.sh@50 -- # local nbd_list 00:09:25.433 11:20:20 event.app_repeat -- bdev/nbd_common.sh@51 -- # local i 00:09:25.433 11:20:20 event.app_repeat -- bdev/nbd_common.sh@53 -- # for i in "${nbd_list[@]}" 00:09:25.433 11:20:20 event.app_repeat -- bdev/nbd_common.sh@54 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_stop_disk /dev/nbd0 00:09:25.999 11:20:21 event.app_repeat -- bdev/nbd_common.sh@55 -- # basename /dev/nbd0 00:09:25.999 11:20:21 event.app_repeat -- bdev/nbd_common.sh@55 -- # waitfornbd_exit nbd0 00:09:25.999 11:20:21 event.app_repeat -- bdev/nbd_common.sh@35 -- # local nbd_name=nbd0 00:09:25.999 11:20:21 event.app_repeat -- bdev/nbd_common.sh@37 -- # (( i = 1 )) 00:09:25.999 11:20:21 event.app_repeat -- bdev/nbd_common.sh@37 -- # (( i <= 20 )) 00:09:25.999 11:20:21 event.app_repeat -- bdev/nbd_common.sh@38 -- # grep -q -w nbd0 /proc/partitions 00:09:25.999 11:20:21 event.app_repeat -- bdev/nbd_common.sh@41 -- # break 00:09:25.999 11:20:21 event.app_repeat -- bdev/nbd_common.sh@45 -- # return 0 00:09:25.999 11:20:21 event.app_repeat -- bdev/nbd_common.sh@53 -- # for i in "${nbd_list[@]}" 00:09:25.999 11:20:21 event.app_repeat -- bdev/nbd_common.sh@54 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_stop_disk /dev/nbd1 00:09:26.256 11:20:21 event.app_repeat -- bdev/nbd_common.sh@55 -- # basename /dev/nbd1 00:09:26.256 11:20:21 event.app_repeat -- bdev/nbd_common.sh@55 -- # waitfornbd_exit nbd1 00:09:26.256 11:20:21 event.app_repeat -- bdev/nbd_common.sh@35 -- # local nbd_name=nbd1 00:09:26.256 11:20:21 event.app_repeat -- bdev/nbd_common.sh@37 -- # (( i = 1 )) 00:09:26.256 11:20:21 event.app_repeat -- bdev/nbd_common.sh@37 -- # (( i <= 20 )) 00:09:26.256 11:20:21 event.app_repeat -- bdev/nbd_common.sh@38 -- # grep -q -w nbd1 /proc/partitions 00:09:26.256 11:20:21 event.app_repeat -- bdev/nbd_common.sh@41 -- # break 00:09:26.256 11:20:21 event.app_repeat -- bdev/nbd_common.sh@45 -- # return 0 00:09:26.256 11:20:21 event.app_repeat -- bdev/nbd_common.sh@104 -- # nbd_get_count /var/tmp/spdk-nbd.sock 00:09:26.256 11:20:21 event.app_repeat -- bdev/nbd_common.sh@61 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:09:26.256 11:20:21 event.app_repeat -- bdev/nbd_common.sh@63 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_get_disks 00:09:26.529 11:20:21 event.app_repeat -- bdev/nbd_common.sh@63 -- # nbd_disks_json='[]' 00:09:26.529 11:20:21 event.app_repeat -- bdev/nbd_common.sh@64 -- # echo '[]' 00:09:26.529 11:20:21 event.app_repeat -- bdev/nbd_common.sh@64 -- # jq -r '.[] | .nbd_device' 00:09:26.529 11:20:21 event.app_repeat -- bdev/nbd_common.sh@64 -- # nbd_disks_name= 00:09:26.529 11:20:21 event.app_repeat -- bdev/nbd_common.sh@65 -- # echo '' 00:09:26.529 11:20:21 event.app_repeat -- bdev/nbd_common.sh@65 -- # grep -c /dev/nbd 00:09:26.529 11:20:21 event.app_repeat -- bdev/nbd_common.sh@65 -- # true 00:09:26.529 11:20:21 event.app_repeat -- bdev/nbd_common.sh@65 -- # count=0 00:09:26.529 11:20:21 event.app_repeat -- bdev/nbd_common.sh@66 -- # echo 0 00:09:26.529 11:20:21 event.app_repeat -- bdev/nbd_common.sh@104 -- # count=0 00:09:26.529 11:20:21 event.app_repeat -- bdev/nbd_common.sh@105 -- # '[' 0 -ne 0 ']' 00:09:26.529 11:20:21 event.app_repeat -- bdev/nbd_common.sh@109 -- # return 0 00:09:26.529 11:20:21 event.app_repeat -- event/event.sh@34 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock spdk_kill_instance SIGTERM 00:09:26.809 11:20:22 event.app_repeat -- event/event.sh@35 -- # sleep 3 00:09:27.068 [2024-10-07 11:20:22.527422] app.c: 917:spdk_app_start: *NOTICE*: Total cores available: 2 00:09:27.326 [2024-10-07 11:20:22.639772] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 1 00:09:27.326 [2024-10-07 11:20:22.639780] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 0 00:09:27.326 [2024-10-07 11:20:22.694442] notify.c: 45:spdk_notify_type_register: *NOTICE*: Notification type 'bdev_register' already registered. 00:09:27.326 [2024-10-07 11:20:22.694501] notify.c: 45:spdk_notify_type_register: *NOTICE*: Notification type 'bdev_unregister' already registered. 00:09:29.857 11:20:25 event.app_repeat -- event/event.sh@23 -- # for i in {0..2} 00:09:29.857 spdk_app_start Round 2 00:09:29.857 11:20:25 event.app_repeat -- event/event.sh@24 -- # echo 'spdk_app_start Round 2' 00:09:29.857 11:20:25 event.app_repeat -- event/event.sh@25 -- # waitforlisten 60320 /var/tmp/spdk-nbd.sock 00:09:29.857 11:20:25 event.app_repeat -- common/autotest_common.sh@831 -- # '[' -z 60320 ']' 00:09:29.857 11:20:25 event.app_repeat -- common/autotest_common.sh@835 -- # local rpc_addr=/var/tmp/spdk-nbd.sock 00:09:29.857 11:20:25 event.app_repeat -- common/autotest_common.sh@836 -- # local max_retries=100 00:09:29.857 11:20:25 event.app_repeat -- common/autotest_common.sh@838 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk-nbd.sock...' 00:09:29.857 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk-nbd.sock... 00:09:29.857 11:20:25 event.app_repeat -- common/autotest_common.sh@840 -- # xtrace_disable 00:09:29.857 11:20:25 event.app_repeat -- common/autotest_common.sh@10 -- # set +x 00:09:30.115 11:20:25 event.app_repeat -- common/autotest_common.sh@860 -- # (( i == 0 )) 00:09:30.115 11:20:25 event.app_repeat -- common/autotest_common.sh@864 -- # return 0 00:09:30.115 11:20:25 event.app_repeat -- event/event.sh@27 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock bdev_malloc_create 64 4096 00:09:30.373 Malloc0 00:09:30.631 11:20:25 event.app_repeat -- event/event.sh@28 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock bdev_malloc_create 64 4096 00:09:30.889 Malloc1 00:09:30.889 11:20:26 event.app_repeat -- event/event.sh@30 -- # nbd_rpc_data_verify /var/tmp/spdk-nbd.sock 'Malloc0 Malloc1' '/dev/nbd0 /dev/nbd1' 00:09:30.889 11:20:26 event.app_repeat -- bdev/nbd_common.sh@90 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:09:30.889 11:20:26 event.app_repeat -- bdev/nbd_common.sh@91 -- # bdev_list=('Malloc0' 'Malloc1') 00:09:30.889 11:20:26 event.app_repeat -- bdev/nbd_common.sh@91 -- # local bdev_list 00:09:30.889 11:20:26 event.app_repeat -- bdev/nbd_common.sh@92 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:09:30.889 11:20:26 event.app_repeat -- bdev/nbd_common.sh@92 -- # local nbd_list 00:09:30.889 11:20:26 event.app_repeat -- bdev/nbd_common.sh@94 -- # nbd_start_disks /var/tmp/spdk-nbd.sock 'Malloc0 Malloc1' '/dev/nbd0 /dev/nbd1' 00:09:30.889 11:20:26 event.app_repeat -- bdev/nbd_common.sh@9 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:09:30.889 11:20:26 event.app_repeat -- bdev/nbd_common.sh@10 -- # bdev_list=('Malloc0' 'Malloc1') 00:09:30.889 11:20:26 event.app_repeat -- bdev/nbd_common.sh@10 -- # local bdev_list 00:09:30.889 11:20:26 event.app_repeat -- bdev/nbd_common.sh@11 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:09:30.889 11:20:26 event.app_repeat -- bdev/nbd_common.sh@11 -- # local nbd_list 00:09:30.889 11:20:26 event.app_repeat -- bdev/nbd_common.sh@12 -- # local i 00:09:30.889 11:20:26 event.app_repeat -- bdev/nbd_common.sh@14 -- # (( i = 0 )) 00:09:30.889 11:20:26 event.app_repeat -- bdev/nbd_common.sh@14 -- # (( i < 2 )) 00:09:30.889 11:20:26 event.app_repeat -- bdev/nbd_common.sh@15 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_start_disk Malloc0 /dev/nbd0 00:09:31.148 /dev/nbd0 00:09:31.148 11:20:26 event.app_repeat -- bdev/nbd_common.sh@17 -- # basename /dev/nbd0 00:09:31.148 11:20:26 event.app_repeat -- bdev/nbd_common.sh@17 -- # waitfornbd nbd0 00:09:31.148 11:20:26 event.app_repeat -- common/autotest_common.sh@868 -- # local nbd_name=nbd0 00:09:31.148 11:20:26 event.app_repeat -- common/autotest_common.sh@869 -- # local i 00:09:31.148 11:20:26 event.app_repeat -- common/autotest_common.sh@871 -- # (( i = 1 )) 00:09:31.148 11:20:26 event.app_repeat -- common/autotest_common.sh@871 -- # (( i <= 20 )) 00:09:31.148 11:20:26 event.app_repeat -- common/autotest_common.sh@872 -- # grep -q -w nbd0 /proc/partitions 00:09:31.148 11:20:26 event.app_repeat -- common/autotest_common.sh@873 -- # break 00:09:31.148 11:20:26 event.app_repeat -- common/autotest_common.sh@884 -- # (( i = 1 )) 00:09:31.148 11:20:26 event.app_repeat -- common/autotest_common.sh@884 -- # (( i <= 20 )) 00:09:31.148 11:20:26 event.app_repeat -- common/autotest_common.sh@885 -- # dd if=/dev/nbd0 of=/home/vagrant/spdk_repo/spdk/test/event/nbdtest bs=4096 count=1 iflag=direct 00:09:31.148 1+0 records in 00:09:31.148 1+0 records out 00:09:31.148 4096 bytes (4.1 kB, 4.0 KiB) copied, 0.000390505 s, 10.5 MB/s 00:09:31.148 11:20:26 event.app_repeat -- common/autotest_common.sh@886 -- # stat -c %s /home/vagrant/spdk_repo/spdk/test/event/nbdtest 00:09:31.148 11:20:26 event.app_repeat -- common/autotest_common.sh@886 -- # size=4096 00:09:31.148 11:20:26 event.app_repeat -- common/autotest_common.sh@887 -- # rm -f /home/vagrant/spdk_repo/spdk/test/event/nbdtest 00:09:31.148 11:20:26 event.app_repeat -- common/autotest_common.sh@888 -- # '[' 4096 '!=' 0 ']' 00:09:31.148 11:20:26 event.app_repeat -- common/autotest_common.sh@889 -- # return 0 00:09:31.148 11:20:26 event.app_repeat -- bdev/nbd_common.sh@14 -- # (( i++ )) 00:09:31.148 11:20:26 event.app_repeat -- bdev/nbd_common.sh@14 -- # (( i < 2 )) 00:09:31.148 11:20:26 event.app_repeat -- bdev/nbd_common.sh@15 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_start_disk Malloc1 /dev/nbd1 00:09:31.406 /dev/nbd1 00:09:31.406 11:20:26 event.app_repeat -- bdev/nbd_common.sh@17 -- # basename /dev/nbd1 00:09:31.406 11:20:26 event.app_repeat -- bdev/nbd_common.sh@17 -- # waitfornbd nbd1 00:09:31.406 11:20:26 event.app_repeat -- common/autotest_common.sh@868 -- # local nbd_name=nbd1 00:09:31.406 11:20:26 event.app_repeat -- common/autotest_common.sh@869 -- # local i 00:09:31.406 11:20:26 event.app_repeat -- common/autotest_common.sh@871 -- # (( i = 1 )) 00:09:31.406 11:20:26 event.app_repeat -- common/autotest_common.sh@871 -- # (( i <= 20 )) 00:09:31.406 11:20:26 event.app_repeat -- common/autotest_common.sh@872 -- # grep -q -w nbd1 /proc/partitions 00:09:31.406 11:20:26 event.app_repeat -- common/autotest_common.sh@873 -- # break 00:09:31.406 11:20:26 event.app_repeat -- common/autotest_common.sh@884 -- # (( i = 1 )) 00:09:31.406 11:20:26 event.app_repeat -- common/autotest_common.sh@884 -- # (( i <= 20 )) 00:09:31.406 11:20:26 event.app_repeat -- common/autotest_common.sh@885 -- # dd if=/dev/nbd1 of=/home/vagrant/spdk_repo/spdk/test/event/nbdtest bs=4096 count=1 iflag=direct 00:09:31.406 1+0 records in 00:09:31.406 1+0 records out 00:09:31.406 4096 bytes (4.1 kB, 4.0 KiB) copied, 0.000240001 s, 17.1 MB/s 00:09:31.406 11:20:26 event.app_repeat -- common/autotest_common.sh@886 -- # stat -c %s /home/vagrant/spdk_repo/spdk/test/event/nbdtest 00:09:31.406 11:20:26 event.app_repeat -- common/autotest_common.sh@886 -- # size=4096 00:09:31.406 11:20:26 event.app_repeat -- common/autotest_common.sh@887 -- # rm -f /home/vagrant/spdk_repo/spdk/test/event/nbdtest 00:09:31.406 11:20:26 event.app_repeat -- common/autotest_common.sh@888 -- # '[' 4096 '!=' 0 ']' 00:09:31.406 11:20:26 event.app_repeat -- common/autotest_common.sh@889 -- # return 0 00:09:31.406 11:20:26 event.app_repeat -- bdev/nbd_common.sh@14 -- # (( i++ )) 00:09:31.406 11:20:26 event.app_repeat -- bdev/nbd_common.sh@14 -- # (( i < 2 )) 00:09:31.406 11:20:26 event.app_repeat -- bdev/nbd_common.sh@95 -- # nbd_get_count /var/tmp/spdk-nbd.sock 00:09:31.406 11:20:26 event.app_repeat -- bdev/nbd_common.sh@61 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:09:31.406 11:20:26 event.app_repeat -- bdev/nbd_common.sh@63 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_get_disks 00:09:31.973 11:20:27 event.app_repeat -- bdev/nbd_common.sh@63 -- # nbd_disks_json='[ 00:09:31.973 { 00:09:31.973 "bdev_name": "Malloc0", 00:09:31.973 "nbd_device": "/dev/nbd0" 00:09:31.973 }, 00:09:31.973 { 00:09:31.973 "bdev_name": "Malloc1", 00:09:31.973 "nbd_device": "/dev/nbd1" 00:09:31.973 } 00:09:31.973 ]' 00:09:31.973 11:20:27 event.app_repeat -- bdev/nbd_common.sh@64 -- # echo '[ 00:09:31.973 { 00:09:31.973 "bdev_name": "Malloc0", 00:09:31.973 "nbd_device": "/dev/nbd0" 00:09:31.973 }, 00:09:31.973 { 00:09:31.973 "bdev_name": "Malloc1", 00:09:31.973 "nbd_device": "/dev/nbd1" 00:09:31.973 } 00:09:31.973 ]' 00:09:31.973 11:20:27 event.app_repeat -- bdev/nbd_common.sh@64 -- # jq -r '.[] | .nbd_device' 00:09:31.973 11:20:27 event.app_repeat -- bdev/nbd_common.sh@64 -- # nbd_disks_name='/dev/nbd0 00:09:31.973 /dev/nbd1' 00:09:31.973 11:20:27 event.app_repeat -- bdev/nbd_common.sh@65 -- # grep -c /dev/nbd 00:09:31.973 11:20:27 event.app_repeat -- bdev/nbd_common.sh@65 -- # echo '/dev/nbd0 00:09:31.973 /dev/nbd1' 00:09:31.973 11:20:27 event.app_repeat -- bdev/nbd_common.sh@65 -- # count=2 00:09:31.973 11:20:27 event.app_repeat -- bdev/nbd_common.sh@66 -- # echo 2 00:09:31.973 11:20:27 event.app_repeat -- bdev/nbd_common.sh@95 -- # count=2 00:09:31.973 11:20:27 event.app_repeat -- bdev/nbd_common.sh@96 -- # '[' 2 -ne 2 ']' 00:09:31.973 11:20:27 event.app_repeat -- bdev/nbd_common.sh@100 -- # nbd_dd_data_verify '/dev/nbd0 /dev/nbd1' write 00:09:31.973 11:20:27 event.app_repeat -- bdev/nbd_common.sh@70 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:09:31.973 11:20:27 event.app_repeat -- bdev/nbd_common.sh@70 -- # local nbd_list 00:09:31.973 11:20:27 event.app_repeat -- bdev/nbd_common.sh@71 -- # local operation=write 00:09:31.973 11:20:27 event.app_repeat -- bdev/nbd_common.sh@72 -- # local tmp_file=/home/vagrant/spdk_repo/spdk/test/event/nbdrandtest 00:09:31.973 11:20:27 event.app_repeat -- bdev/nbd_common.sh@74 -- # '[' write = write ']' 00:09:31.973 11:20:27 event.app_repeat -- bdev/nbd_common.sh@76 -- # dd if=/dev/urandom of=/home/vagrant/spdk_repo/spdk/test/event/nbdrandtest bs=4096 count=256 00:09:31.973 256+0 records in 00:09:31.973 256+0 records out 00:09:31.973 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0107101 s, 97.9 MB/s 00:09:31.973 11:20:27 event.app_repeat -- bdev/nbd_common.sh@77 -- # for i in "${nbd_list[@]}" 00:09:31.973 11:20:27 event.app_repeat -- bdev/nbd_common.sh@78 -- # dd if=/home/vagrant/spdk_repo/spdk/test/event/nbdrandtest of=/dev/nbd0 bs=4096 count=256 oflag=direct 00:09:31.973 256+0 records in 00:09:31.973 256+0 records out 00:09:31.973 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0202628 s, 51.7 MB/s 00:09:31.973 11:20:27 event.app_repeat -- bdev/nbd_common.sh@77 -- # for i in "${nbd_list[@]}" 00:09:31.973 11:20:27 event.app_repeat -- bdev/nbd_common.sh@78 -- # dd if=/home/vagrant/spdk_repo/spdk/test/event/nbdrandtest of=/dev/nbd1 bs=4096 count=256 oflag=direct 00:09:31.973 256+0 records in 00:09:31.973 256+0 records out 00:09:31.973 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0259808 s, 40.4 MB/s 00:09:31.973 11:20:27 event.app_repeat -- bdev/nbd_common.sh@101 -- # nbd_dd_data_verify '/dev/nbd0 /dev/nbd1' verify 00:09:31.973 11:20:27 event.app_repeat -- bdev/nbd_common.sh@70 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:09:31.973 11:20:27 event.app_repeat -- bdev/nbd_common.sh@70 -- # local nbd_list 00:09:31.973 11:20:27 event.app_repeat -- bdev/nbd_common.sh@71 -- # local operation=verify 00:09:31.973 11:20:27 event.app_repeat -- bdev/nbd_common.sh@72 -- # local tmp_file=/home/vagrant/spdk_repo/spdk/test/event/nbdrandtest 00:09:31.973 11:20:27 event.app_repeat -- bdev/nbd_common.sh@74 -- # '[' verify = write ']' 00:09:31.973 11:20:27 event.app_repeat -- bdev/nbd_common.sh@80 -- # '[' verify = verify ']' 00:09:31.973 11:20:27 event.app_repeat -- bdev/nbd_common.sh@82 -- # for i in "${nbd_list[@]}" 00:09:31.973 11:20:27 event.app_repeat -- bdev/nbd_common.sh@83 -- # cmp -b -n 1M /home/vagrant/spdk_repo/spdk/test/event/nbdrandtest /dev/nbd0 00:09:31.973 11:20:27 event.app_repeat -- bdev/nbd_common.sh@82 -- # for i in "${nbd_list[@]}" 00:09:31.973 11:20:27 event.app_repeat -- bdev/nbd_common.sh@83 -- # cmp -b -n 1M /home/vagrant/spdk_repo/spdk/test/event/nbdrandtest /dev/nbd1 00:09:31.973 11:20:27 event.app_repeat -- bdev/nbd_common.sh@85 -- # rm /home/vagrant/spdk_repo/spdk/test/event/nbdrandtest 00:09:31.973 11:20:27 event.app_repeat -- bdev/nbd_common.sh@103 -- # nbd_stop_disks /var/tmp/spdk-nbd.sock '/dev/nbd0 /dev/nbd1' 00:09:31.973 11:20:27 event.app_repeat -- bdev/nbd_common.sh@49 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:09:31.973 11:20:27 event.app_repeat -- bdev/nbd_common.sh@50 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:09:31.973 11:20:27 event.app_repeat -- bdev/nbd_common.sh@50 -- # local nbd_list 00:09:31.973 11:20:27 event.app_repeat -- bdev/nbd_common.sh@51 -- # local i 00:09:31.973 11:20:27 event.app_repeat -- bdev/nbd_common.sh@53 -- # for i in "${nbd_list[@]}" 00:09:31.973 11:20:27 event.app_repeat -- bdev/nbd_common.sh@54 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_stop_disk /dev/nbd0 00:09:32.231 11:20:27 event.app_repeat -- bdev/nbd_common.sh@55 -- # basename /dev/nbd0 00:09:32.231 11:20:27 event.app_repeat -- bdev/nbd_common.sh@55 -- # waitfornbd_exit nbd0 00:09:32.231 11:20:27 event.app_repeat -- bdev/nbd_common.sh@35 -- # local nbd_name=nbd0 00:09:32.231 11:20:27 event.app_repeat -- bdev/nbd_common.sh@37 -- # (( i = 1 )) 00:09:32.231 11:20:27 event.app_repeat -- bdev/nbd_common.sh@37 -- # (( i <= 20 )) 00:09:32.231 11:20:27 event.app_repeat -- bdev/nbd_common.sh@38 -- # grep -q -w nbd0 /proc/partitions 00:09:32.231 11:20:27 event.app_repeat -- bdev/nbd_common.sh@41 -- # break 00:09:32.231 11:20:27 event.app_repeat -- bdev/nbd_common.sh@45 -- # return 0 00:09:32.231 11:20:27 event.app_repeat -- bdev/nbd_common.sh@53 -- # for i in "${nbd_list[@]}" 00:09:32.231 11:20:27 event.app_repeat -- bdev/nbd_common.sh@54 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_stop_disk /dev/nbd1 00:09:32.796 11:20:28 event.app_repeat -- bdev/nbd_common.sh@55 -- # basename /dev/nbd1 00:09:32.796 11:20:28 event.app_repeat -- bdev/nbd_common.sh@55 -- # waitfornbd_exit nbd1 00:09:32.796 11:20:28 event.app_repeat -- bdev/nbd_common.sh@35 -- # local nbd_name=nbd1 00:09:32.796 11:20:28 event.app_repeat -- bdev/nbd_common.sh@37 -- # (( i = 1 )) 00:09:32.796 11:20:28 event.app_repeat -- bdev/nbd_common.sh@37 -- # (( i <= 20 )) 00:09:32.796 11:20:28 event.app_repeat -- bdev/nbd_common.sh@38 -- # grep -q -w nbd1 /proc/partitions 00:09:32.796 11:20:28 event.app_repeat -- bdev/nbd_common.sh@41 -- # break 00:09:32.796 11:20:28 event.app_repeat -- bdev/nbd_common.sh@45 -- # return 0 00:09:32.796 11:20:28 event.app_repeat -- bdev/nbd_common.sh@104 -- # nbd_get_count /var/tmp/spdk-nbd.sock 00:09:32.796 11:20:28 event.app_repeat -- bdev/nbd_common.sh@61 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:09:32.796 11:20:28 event.app_repeat -- bdev/nbd_common.sh@63 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_get_disks 00:09:33.055 11:20:28 event.app_repeat -- bdev/nbd_common.sh@63 -- # nbd_disks_json='[]' 00:09:33.055 11:20:28 event.app_repeat -- bdev/nbd_common.sh@64 -- # echo '[]' 00:09:33.055 11:20:28 event.app_repeat -- bdev/nbd_common.sh@64 -- # jq -r '.[] | .nbd_device' 00:09:33.055 11:20:28 event.app_repeat -- bdev/nbd_common.sh@64 -- # nbd_disks_name= 00:09:33.055 11:20:28 event.app_repeat -- bdev/nbd_common.sh@65 -- # echo '' 00:09:33.055 11:20:28 event.app_repeat -- bdev/nbd_common.sh@65 -- # grep -c /dev/nbd 00:09:33.055 11:20:28 event.app_repeat -- bdev/nbd_common.sh@65 -- # true 00:09:33.055 11:20:28 event.app_repeat -- bdev/nbd_common.sh@65 -- # count=0 00:09:33.055 11:20:28 event.app_repeat -- bdev/nbd_common.sh@66 -- # echo 0 00:09:33.055 11:20:28 event.app_repeat -- bdev/nbd_common.sh@104 -- # count=0 00:09:33.055 11:20:28 event.app_repeat -- bdev/nbd_common.sh@105 -- # '[' 0 -ne 0 ']' 00:09:33.055 11:20:28 event.app_repeat -- bdev/nbd_common.sh@109 -- # return 0 00:09:33.055 11:20:28 event.app_repeat -- event/event.sh@34 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock spdk_kill_instance SIGTERM 00:09:33.620 11:20:28 event.app_repeat -- event/event.sh@35 -- # sleep 3 00:09:33.620 [2024-10-07 11:20:29.101221] app.c: 917:spdk_app_start: *NOTICE*: Total cores available: 2 00:09:33.878 [2024-10-07 11:20:29.206125] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 1 00:09:33.878 [2024-10-07 11:20:29.206137] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 0 00:09:33.878 [2024-10-07 11:20:29.261635] notify.c: 45:spdk_notify_type_register: *NOTICE*: Notification type 'bdev_register' already registered. 00:09:33.878 [2024-10-07 11:20:29.261705] notify.c: 45:spdk_notify_type_register: *NOTICE*: Notification type 'bdev_unregister' already registered. 00:09:36.408 11:20:31 event.app_repeat -- event/event.sh@38 -- # waitforlisten 60320 /var/tmp/spdk-nbd.sock 00:09:36.408 11:20:31 event.app_repeat -- common/autotest_common.sh@831 -- # '[' -z 60320 ']' 00:09:36.408 11:20:31 event.app_repeat -- common/autotest_common.sh@835 -- # local rpc_addr=/var/tmp/spdk-nbd.sock 00:09:36.408 11:20:31 event.app_repeat -- common/autotest_common.sh@836 -- # local max_retries=100 00:09:36.408 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk-nbd.sock... 00:09:36.408 11:20:31 event.app_repeat -- common/autotest_common.sh@838 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk-nbd.sock...' 00:09:36.408 11:20:31 event.app_repeat -- common/autotest_common.sh@840 -- # xtrace_disable 00:09:36.408 11:20:31 event.app_repeat -- common/autotest_common.sh@10 -- # set +x 00:09:36.974 11:20:32 event.app_repeat -- common/autotest_common.sh@860 -- # (( i == 0 )) 00:09:36.974 11:20:32 event.app_repeat -- common/autotest_common.sh@864 -- # return 0 00:09:36.974 11:20:32 event.app_repeat -- event/event.sh@39 -- # killprocess 60320 00:09:36.974 11:20:32 event.app_repeat -- common/autotest_common.sh@950 -- # '[' -z 60320 ']' 00:09:36.974 11:20:32 event.app_repeat -- common/autotest_common.sh@954 -- # kill -0 60320 00:09:36.974 11:20:32 event.app_repeat -- common/autotest_common.sh@955 -- # uname 00:09:36.974 11:20:32 event.app_repeat -- common/autotest_common.sh@955 -- # '[' Linux = Linux ']' 00:09:36.974 11:20:32 event.app_repeat -- common/autotest_common.sh@956 -- # ps --no-headers -o comm= 60320 00:09:36.974 11:20:32 event.app_repeat -- common/autotest_common.sh@956 -- # process_name=reactor_0 00:09:36.974 11:20:32 event.app_repeat -- common/autotest_common.sh@960 -- # '[' reactor_0 = sudo ']' 00:09:36.974 killing process with pid 60320 00:09:36.974 11:20:32 event.app_repeat -- common/autotest_common.sh@968 -- # echo 'killing process with pid 60320' 00:09:36.974 11:20:32 event.app_repeat -- common/autotest_common.sh@969 -- # kill 60320 00:09:36.974 11:20:32 event.app_repeat -- common/autotest_common.sh@974 -- # wait 60320 00:09:36.974 spdk_app_start is called in Round 0. 00:09:36.974 Shutdown signal received, stop current app iteration 00:09:36.974 Starting SPDK v25.01-pre git sha1 2a4f56c54 / DPDK 24.03.0 reinitialization... 00:09:36.974 spdk_app_start is called in Round 1. 00:09:36.974 Shutdown signal received, stop current app iteration 00:09:36.974 Starting SPDK v25.01-pre git sha1 2a4f56c54 / DPDK 24.03.0 reinitialization... 00:09:36.974 spdk_app_start is called in Round 2. 00:09:36.974 Shutdown signal received, stop current app iteration 00:09:36.974 Starting SPDK v25.01-pre git sha1 2a4f56c54 / DPDK 24.03.0 reinitialization... 00:09:36.974 spdk_app_start is called in Round 3. 00:09:36.974 Shutdown signal received, stop current app iteration 00:09:36.974 11:20:32 event.app_repeat -- event/event.sh@40 -- # trap - SIGINT SIGTERM EXIT 00:09:36.974 11:20:32 event.app_repeat -- event/event.sh@42 -- # return 0 00:09:36.974 00:09:36.974 real 0m20.939s 00:09:36.974 user 0m47.621s 00:09:36.974 sys 0m3.456s 00:09:36.974 11:20:32 event.app_repeat -- common/autotest_common.sh@1126 -- # xtrace_disable 00:09:36.974 11:20:32 event.app_repeat -- common/autotest_common.sh@10 -- # set +x 00:09:36.974 ************************************ 00:09:36.974 END TEST app_repeat 00:09:36.974 ************************************ 00:09:37.234 11:20:32 event -- event/event.sh@54 -- # (( SPDK_TEST_CRYPTO == 0 )) 00:09:37.234 11:20:32 event -- event/event.sh@55 -- # run_test cpu_locks /home/vagrant/spdk_repo/spdk/test/event/cpu_locks.sh 00:09:37.234 11:20:32 event -- common/autotest_common.sh@1101 -- # '[' 2 -le 1 ']' 00:09:37.234 11:20:32 event -- common/autotest_common.sh@1107 -- # xtrace_disable 00:09:37.234 11:20:32 event -- common/autotest_common.sh@10 -- # set +x 00:09:37.234 ************************************ 00:09:37.234 START TEST cpu_locks 00:09:37.234 ************************************ 00:09:37.234 11:20:32 event.cpu_locks -- common/autotest_common.sh@1125 -- # /home/vagrant/spdk_repo/spdk/test/event/cpu_locks.sh 00:09:37.234 * Looking for test storage... 00:09:37.234 * Found test storage at /home/vagrant/spdk_repo/spdk/test/event 00:09:37.234 11:20:32 event.cpu_locks -- common/autotest_common.sh@1680 -- # [[ y == y ]] 00:09:37.234 11:20:32 event.cpu_locks -- common/autotest_common.sh@1681 -- # lcov --version 00:09:37.234 11:20:32 event.cpu_locks -- common/autotest_common.sh@1681 -- # awk '{print $NF}' 00:09:37.234 11:20:32 event.cpu_locks -- common/autotest_common.sh@1681 -- # lt 1.15 2 00:09:37.234 11:20:32 event.cpu_locks -- scripts/common.sh@373 -- # cmp_versions 1.15 '<' 2 00:09:37.234 11:20:32 event.cpu_locks -- scripts/common.sh@333 -- # local ver1 ver1_l 00:09:37.234 11:20:32 event.cpu_locks -- scripts/common.sh@334 -- # local ver2 ver2_l 00:09:37.234 11:20:32 event.cpu_locks -- scripts/common.sh@336 -- # IFS=.-: 00:09:37.234 11:20:32 event.cpu_locks -- scripts/common.sh@336 -- # read -ra ver1 00:09:37.234 11:20:32 event.cpu_locks -- scripts/common.sh@337 -- # IFS=.-: 00:09:37.234 11:20:32 event.cpu_locks -- scripts/common.sh@337 -- # read -ra ver2 00:09:37.234 11:20:32 event.cpu_locks -- scripts/common.sh@338 -- # local 'op=<' 00:09:37.234 11:20:32 event.cpu_locks -- scripts/common.sh@340 -- # ver1_l=2 00:09:37.234 11:20:32 event.cpu_locks -- scripts/common.sh@341 -- # ver2_l=1 00:09:37.234 11:20:32 event.cpu_locks -- scripts/common.sh@343 -- # local lt=0 gt=0 eq=0 v 00:09:37.234 11:20:32 event.cpu_locks -- scripts/common.sh@344 -- # case "$op" in 00:09:37.234 11:20:32 event.cpu_locks -- scripts/common.sh@345 -- # : 1 00:09:37.234 11:20:32 event.cpu_locks -- scripts/common.sh@364 -- # (( v = 0 )) 00:09:37.234 11:20:32 event.cpu_locks -- scripts/common.sh@364 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:09:37.234 11:20:32 event.cpu_locks -- scripts/common.sh@365 -- # decimal 1 00:09:37.234 11:20:32 event.cpu_locks -- scripts/common.sh@353 -- # local d=1 00:09:37.234 11:20:32 event.cpu_locks -- scripts/common.sh@354 -- # [[ 1 =~ ^[0-9]+$ ]] 00:09:37.234 11:20:32 event.cpu_locks -- scripts/common.sh@355 -- # echo 1 00:09:37.234 11:20:32 event.cpu_locks -- scripts/common.sh@365 -- # ver1[v]=1 00:09:37.234 11:20:32 event.cpu_locks -- scripts/common.sh@366 -- # decimal 2 00:09:37.234 11:20:32 event.cpu_locks -- scripts/common.sh@353 -- # local d=2 00:09:37.234 11:20:32 event.cpu_locks -- scripts/common.sh@354 -- # [[ 2 =~ ^[0-9]+$ ]] 00:09:37.234 11:20:32 event.cpu_locks -- scripts/common.sh@355 -- # echo 2 00:09:37.234 11:20:32 event.cpu_locks -- scripts/common.sh@366 -- # ver2[v]=2 00:09:37.234 11:20:32 event.cpu_locks -- scripts/common.sh@367 -- # (( ver1[v] > ver2[v] )) 00:09:37.234 11:20:32 event.cpu_locks -- scripts/common.sh@368 -- # (( ver1[v] < ver2[v] )) 00:09:37.234 11:20:32 event.cpu_locks -- scripts/common.sh@368 -- # return 0 00:09:37.234 11:20:32 event.cpu_locks -- common/autotest_common.sh@1682 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:09:37.234 11:20:32 event.cpu_locks -- common/autotest_common.sh@1694 -- # export 'LCOV_OPTS= 00:09:37.234 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:09:37.234 --rc genhtml_branch_coverage=1 00:09:37.234 --rc genhtml_function_coverage=1 00:09:37.234 --rc genhtml_legend=1 00:09:37.234 --rc geninfo_all_blocks=1 00:09:37.234 --rc geninfo_unexecuted_blocks=1 00:09:37.234 00:09:37.234 ' 00:09:37.234 11:20:32 event.cpu_locks -- common/autotest_common.sh@1694 -- # LCOV_OPTS=' 00:09:37.234 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:09:37.234 --rc genhtml_branch_coverage=1 00:09:37.234 --rc genhtml_function_coverage=1 00:09:37.234 --rc genhtml_legend=1 00:09:37.234 --rc geninfo_all_blocks=1 00:09:37.234 --rc geninfo_unexecuted_blocks=1 00:09:37.234 00:09:37.234 ' 00:09:37.234 11:20:32 event.cpu_locks -- common/autotest_common.sh@1695 -- # export 'LCOV=lcov 00:09:37.234 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:09:37.234 --rc genhtml_branch_coverage=1 00:09:37.234 --rc genhtml_function_coverage=1 00:09:37.234 --rc genhtml_legend=1 00:09:37.234 --rc geninfo_all_blocks=1 00:09:37.234 --rc geninfo_unexecuted_blocks=1 00:09:37.234 00:09:37.234 ' 00:09:37.234 11:20:32 event.cpu_locks -- common/autotest_common.sh@1695 -- # LCOV='lcov 00:09:37.234 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:09:37.234 --rc genhtml_branch_coverage=1 00:09:37.234 --rc genhtml_function_coverage=1 00:09:37.234 --rc genhtml_legend=1 00:09:37.234 --rc geninfo_all_blocks=1 00:09:37.234 --rc geninfo_unexecuted_blocks=1 00:09:37.234 00:09:37.234 ' 00:09:37.234 11:20:32 event.cpu_locks -- event/cpu_locks.sh@11 -- # rpc_sock1=/var/tmp/spdk.sock 00:09:37.235 11:20:32 event.cpu_locks -- event/cpu_locks.sh@12 -- # rpc_sock2=/var/tmp/spdk2.sock 00:09:37.235 11:20:32 event.cpu_locks -- event/cpu_locks.sh@164 -- # trap cleanup EXIT SIGTERM SIGINT 00:09:37.235 11:20:32 event.cpu_locks -- event/cpu_locks.sh@166 -- # run_test default_locks default_locks 00:09:37.235 11:20:32 event.cpu_locks -- common/autotest_common.sh@1101 -- # '[' 2 -le 1 ']' 00:09:37.235 11:20:32 event.cpu_locks -- common/autotest_common.sh@1107 -- # xtrace_disable 00:09:37.235 11:20:32 event.cpu_locks -- common/autotest_common.sh@10 -- # set +x 00:09:37.235 ************************************ 00:09:37.235 START TEST default_locks 00:09:37.235 ************************************ 00:09:37.235 11:20:32 event.cpu_locks.default_locks -- common/autotest_common.sh@1125 -- # default_locks 00:09:37.235 11:20:32 event.cpu_locks.default_locks -- event/cpu_locks.sh@46 -- # spdk_tgt_pid=60974 00:09:37.235 11:20:32 event.cpu_locks.default_locks -- event/cpu_locks.sh@47 -- # waitforlisten 60974 00:09:37.235 11:20:32 event.cpu_locks.default_locks -- common/autotest_common.sh@831 -- # '[' -z 60974 ']' 00:09:37.235 11:20:32 event.cpu_locks.default_locks -- event/cpu_locks.sh@45 -- # /home/vagrant/spdk_repo/spdk/build/bin/spdk_tgt -m 0x1 00:09:37.235 11:20:32 event.cpu_locks.default_locks -- common/autotest_common.sh@835 -- # local rpc_addr=/var/tmp/spdk.sock 00:09:37.235 11:20:32 event.cpu_locks.default_locks -- common/autotest_common.sh@836 -- # local max_retries=100 00:09:37.235 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:09:37.235 11:20:32 event.cpu_locks.default_locks -- common/autotest_common.sh@838 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:09:37.235 11:20:32 event.cpu_locks.default_locks -- common/autotest_common.sh@840 -- # xtrace_disable 00:09:37.235 11:20:32 event.cpu_locks.default_locks -- common/autotest_common.sh@10 -- # set +x 00:09:37.551 [2024-10-07 11:20:32.786078] Starting SPDK v25.01-pre git sha1 2a4f56c54 / DPDK 24.03.0 initialization... 00:09:37.551 [2024-10-07 11:20:32.786210] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --iova-mode=pa --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid60974 ] 00:09:37.551 [2024-10-07 11:20:32.922456] app.c: 917:spdk_app_start: *NOTICE*: Total cores available: 1 00:09:37.551 [2024-10-07 11:20:33.031317] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 0 00:09:38.502 11:20:33 event.cpu_locks.default_locks -- common/autotest_common.sh@860 -- # (( i == 0 )) 00:09:38.502 11:20:33 event.cpu_locks.default_locks -- common/autotest_common.sh@864 -- # return 0 00:09:38.502 11:20:33 event.cpu_locks.default_locks -- event/cpu_locks.sh@49 -- # locks_exist 60974 00:09:38.502 11:20:33 event.cpu_locks.default_locks -- event/cpu_locks.sh@22 -- # lslocks -p 60974 00:09:38.502 11:20:33 event.cpu_locks.default_locks -- event/cpu_locks.sh@22 -- # grep -q spdk_cpu_lock 00:09:38.761 11:20:34 event.cpu_locks.default_locks -- event/cpu_locks.sh@50 -- # killprocess 60974 00:09:38.761 11:20:34 event.cpu_locks.default_locks -- common/autotest_common.sh@950 -- # '[' -z 60974 ']' 00:09:38.761 11:20:34 event.cpu_locks.default_locks -- common/autotest_common.sh@954 -- # kill -0 60974 00:09:38.761 11:20:34 event.cpu_locks.default_locks -- common/autotest_common.sh@955 -- # uname 00:09:38.761 11:20:34 event.cpu_locks.default_locks -- common/autotest_common.sh@955 -- # '[' Linux = Linux ']' 00:09:38.761 11:20:34 event.cpu_locks.default_locks -- common/autotest_common.sh@956 -- # ps --no-headers -o comm= 60974 00:09:38.761 11:20:34 event.cpu_locks.default_locks -- common/autotest_common.sh@956 -- # process_name=reactor_0 00:09:38.761 11:20:34 event.cpu_locks.default_locks -- common/autotest_common.sh@960 -- # '[' reactor_0 = sudo ']' 00:09:38.761 killing process with pid 60974 00:09:38.761 11:20:34 event.cpu_locks.default_locks -- common/autotest_common.sh@968 -- # echo 'killing process with pid 60974' 00:09:38.761 11:20:34 event.cpu_locks.default_locks -- common/autotest_common.sh@969 -- # kill 60974 00:09:38.761 11:20:34 event.cpu_locks.default_locks -- common/autotest_common.sh@974 -- # wait 60974 00:09:39.327 11:20:34 event.cpu_locks.default_locks -- event/cpu_locks.sh@52 -- # NOT waitforlisten 60974 00:09:39.327 11:20:34 event.cpu_locks.default_locks -- common/autotest_common.sh@650 -- # local es=0 00:09:39.327 11:20:34 event.cpu_locks.default_locks -- common/autotest_common.sh@652 -- # valid_exec_arg waitforlisten 60974 00:09:39.327 11:20:34 event.cpu_locks.default_locks -- common/autotest_common.sh@638 -- # local arg=waitforlisten 00:09:39.327 11:20:34 event.cpu_locks.default_locks -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:09:39.327 11:20:34 event.cpu_locks.default_locks -- common/autotest_common.sh@642 -- # type -t waitforlisten 00:09:39.327 11:20:34 event.cpu_locks.default_locks -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:09:39.327 11:20:34 event.cpu_locks.default_locks -- common/autotest_common.sh@653 -- # waitforlisten 60974 00:09:39.327 11:20:34 event.cpu_locks.default_locks -- common/autotest_common.sh@831 -- # '[' -z 60974 ']' 00:09:39.327 11:20:34 event.cpu_locks.default_locks -- common/autotest_common.sh@835 -- # local rpc_addr=/var/tmp/spdk.sock 00:09:39.328 11:20:34 event.cpu_locks.default_locks -- common/autotest_common.sh@836 -- # local max_retries=100 00:09:39.328 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:09:39.328 11:20:34 event.cpu_locks.default_locks -- common/autotest_common.sh@838 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:09:39.328 11:20:34 event.cpu_locks.default_locks -- common/autotest_common.sh@840 -- # xtrace_disable 00:09:39.328 11:20:34 event.cpu_locks.default_locks -- common/autotest_common.sh@10 -- # set +x 00:09:39.328 ERROR: process (pid: 60974) is no longer running 00:09:39.328 /home/vagrant/spdk_repo/spdk/test/common/autotest_common.sh: line 846: kill: (60974) - No such process 00:09:39.328 11:20:34 event.cpu_locks.default_locks -- common/autotest_common.sh@860 -- # (( i == 0 )) 00:09:39.328 11:20:34 event.cpu_locks.default_locks -- common/autotest_common.sh@864 -- # return 1 00:09:39.328 11:20:34 event.cpu_locks.default_locks -- common/autotest_common.sh@653 -- # es=1 00:09:39.328 11:20:34 event.cpu_locks.default_locks -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:09:39.328 11:20:34 event.cpu_locks.default_locks -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:09:39.328 11:20:34 event.cpu_locks.default_locks -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:09:39.328 11:20:34 event.cpu_locks.default_locks -- event/cpu_locks.sh@54 -- # no_locks 00:09:39.328 11:20:34 event.cpu_locks.default_locks -- event/cpu_locks.sh@26 -- # lock_files=() 00:09:39.328 11:20:34 event.cpu_locks.default_locks -- event/cpu_locks.sh@26 -- # local lock_files 00:09:39.328 11:20:34 event.cpu_locks.default_locks -- event/cpu_locks.sh@27 -- # (( 0 != 0 )) 00:09:39.328 00:09:39.328 real 0m1.971s 00:09:39.328 user 0m2.137s 00:09:39.328 sys 0m0.583s 00:09:39.328 11:20:34 event.cpu_locks.default_locks -- common/autotest_common.sh@1126 -- # xtrace_disable 00:09:39.328 11:20:34 event.cpu_locks.default_locks -- common/autotest_common.sh@10 -- # set +x 00:09:39.328 ************************************ 00:09:39.328 END TEST default_locks 00:09:39.328 ************************************ 00:09:39.328 11:20:34 event.cpu_locks -- event/cpu_locks.sh@167 -- # run_test default_locks_via_rpc default_locks_via_rpc 00:09:39.328 11:20:34 event.cpu_locks -- common/autotest_common.sh@1101 -- # '[' 2 -le 1 ']' 00:09:39.328 11:20:34 event.cpu_locks -- common/autotest_common.sh@1107 -- # xtrace_disable 00:09:39.328 11:20:34 event.cpu_locks -- common/autotest_common.sh@10 -- # set +x 00:09:39.328 ************************************ 00:09:39.328 START TEST default_locks_via_rpc 00:09:39.328 ************************************ 00:09:39.328 11:20:34 event.cpu_locks.default_locks_via_rpc -- common/autotest_common.sh@1125 -- # default_locks_via_rpc 00:09:39.328 11:20:34 event.cpu_locks.default_locks_via_rpc -- event/cpu_locks.sh@62 -- # spdk_tgt_pid=61033 00:09:39.328 11:20:34 event.cpu_locks.default_locks_via_rpc -- event/cpu_locks.sh@63 -- # waitforlisten 61033 00:09:39.328 11:20:34 event.cpu_locks.default_locks_via_rpc -- event/cpu_locks.sh@61 -- # /home/vagrant/spdk_repo/spdk/build/bin/spdk_tgt -m 0x1 00:09:39.328 11:20:34 event.cpu_locks.default_locks_via_rpc -- common/autotest_common.sh@831 -- # '[' -z 61033 ']' 00:09:39.328 11:20:34 event.cpu_locks.default_locks_via_rpc -- common/autotest_common.sh@835 -- # local rpc_addr=/var/tmp/spdk.sock 00:09:39.328 11:20:34 event.cpu_locks.default_locks_via_rpc -- common/autotest_common.sh@836 -- # local max_retries=100 00:09:39.328 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:09:39.328 11:20:34 event.cpu_locks.default_locks_via_rpc -- common/autotest_common.sh@838 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:09:39.328 11:20:34 event.cpu_locks.default_locks_via_rpc -- common/autotest_common.sh@840 -- # xtrace_disable 00:09:39.328 11:20:34 event.cpu_locks.default_locks_via_rpc -- common/autotest_common.sh@10 -- # set +x 00:09:39.328 [2024-10-07 11:20:34.822866] Starting SPDK v25.01-pre git sha1 2a4f56c54 / DPDK 24.03.0 initialization... 00:09:39.328 [2024-10-07 11:20:34.823008] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --iova-mode=pa --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid61033 ] 00:09:39.586 [2024-10-07 11:20:34.959927] app.c: 917:spdk_app_start: *NOTICE*: Total cores available: 1 00:09:39.586 [2024-10-07 11:20:35.092083] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 0 00:09:40.522 11:20:35 event.cpu_locks.default_locks_via_rpc -- common/autotest_common.sh@860 -- # (( i == 0 )) 00:09:40.522 11:20:35 event.cpu_locks.default_locks_via_rpc -- common/autotest_common.sh@864 -- # return 0 00:09:40.522 11:20:35 event.cpu_locks.default_locks_via_rpc -- event/cpu_locks.sh@65 -- # rpc_cmd framework_disable_cpumask_locks 00:09:40.522 11:20:35 event.cpu_locks.default_locks_via_rpc -- common/autotest_common.sh@561 -- # xtrace_disable 00:09:40.522 11:20:35 event.cpu_locks.default_locks_via_rpc -- common/autotest_common.sh@10 -- # set +x 00:09:40.522 11:20:35 event.cpu_locks.default_locks_via_rpc -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:09:40.522 11:20:35 event.cpu_locks.default_locks_via_rpc -- event/cpu_locks.sh@67 -- # no_locks 00:09:40.522 11:20:35 event.cpu_locks.default_locks_via_rpc -- event/cpu_locks.sh@26 -- # lock_files=() 00:09:40.522 11:20:35 event.cpu_locks.default_locks_via_rpc -- event/cpu_locks.sh@26 -- # local lock_files 00:09:40.522 11:20:35 event.cpu_locks.default_locks_via_rpc -- event/cpu_locks.sh@27 -- # (( 0 != 0 )) 00:09:40.522 11:20:35 event.cpu_locks.default_locks_via_rpc -- event/cpu_locks.sh@69 -- # rpc_cmd framework_enable_cpumask_locks 00:09:40.522 11:20:35 event.cpu_locks.default_locks_via_rpc -- common/autotest_common.sh@561 -- # xtrace_disable 00:09:40.522 11:20:35 event.cpu_locks.default_locks_via_rpc -- common/autotest_common.sh@10 -- # set +x 00:09:40.522 11:20:35 event.cpu_locks.default_locks_via_rpc -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:09:40.522 11:20:35 event.cpu_locks.default_locks_via_rpc -- event/cpu_locks.sh@71 -- # locks_exist 61033 00:09:40.522 11:20:35 event.cpu_locks.default_locks_via_rpc -- event/cpu_locks.sh@22 -- # lslocks -p 61033 00:09:40.522 11:20:35 event.cpu_locks.default_locks_via_rpc -- event/cpu_locks.sh@22 -- # grep -q spdk_cpu_lock 00:09:40.780 11:20:36 event.cpu_locks.default_locks_via_rpc -- event/cpu_locks.sh@73 -- # killprocess 61033 00:09:40.780 11:20:36 event.cpu_locks.default_locks_via_rpc -- common/autotest_common.sh@950 -- # '[' -z 61033 ']' 00:09:40.780 11:20:36 event.cpu_locks.default_locks_via_rpc -- common/autotest_common.sh@954 -- # kill -0 61033 00:09:40.780 11:20:36 event.cpu_locks.default_locks_via_rpc -- common/autotest_common.sh@955 -- # uname 00:09:40.780 11:20:36 event.cpu_locks.default_locks_via_rpc -- common/autotest_common.sh@955 -- # '[' Linux = Linux ']' 00:09:40.780 11:20:36 event.cpu_locks.default_locks_via_rpc -- common/autotest_common.sh@956 -- # ps --no-headers -o comm= 61033 00:09:40.780 killing process with pid 61033 00:09:40.780 11:20:36 event.cpu_locks.default_locks_via_rpc -- common/autotest_common.sh@956 -- # process_name=reactor_0 00:09:40.780 11:20:36 event.cpu_locks.default_locks_via_rpc -- common/autotest_common.sh@960 -- # '[' reactor_0 = sudo ']' 00:09:40.780 11:20:36 event.cpu_locks.default_locks_via_rpc -- common/autotest_common.sh@968 -- # echo 'killing process with pid 61033' 00:09:40.780 11:20:36 event.cpu_locks.default_locks_via_rpc -- common/autotest_common.sh@969 -- # kill 61033 00:09:40.780 11:20:36 event.cpu_locks.default_locks_via_rpc -- common/autotest_common.sh@974 -- # wait 61033 00:09:41.378 00:09:41.378 real 0m1.967s 00:09:41.378 user 0m2.118s 00:09:41.378 sys 0m0.592s 00:09:41.378 11:20:36 event.cpu_locks.default_locks_via_rpc -- common/autotest_common.sh@1126 -- # xtrace_disable 00:09:41.378 11:20:36 event.cpu_locks.default_locks_via_rpc -- common/autotest_common.sh@10 -- # set +x 00:09:41.378 ************************************ 00:09:41.378 END TEST default_locks_via_rpc 00:09:41.378 ************************************ 00:09:41.378 11:20:36 event.cpu_locks -- event/cpu_locks.sh@168 -- # run_test non_locking_app_on_locked_coremask non_locking_app_on_locked_coremask 00:09:41.378 11:20:36 event.cpu_locks -- common/autotest_common.sh@1101 -- # '[' 2 -le 1 ']' 00:09:41.378 11:20:36 event.cpu_locks -- common/autotest_common.sh@1107 -- # xtrace_disable 00:09:41.378 11:20:36 event.cpu_locks -- common/autotest_common.sh@10 -- # set +x 00:09:41.378 ************************************ 00:09:41.378 START TEST non_locking_app_on_locked_coremask 00:09:41.378 ************************************ 00:09:41.378 11:20:36 event.cpu_locks.non_locking_app_on_locked_coremask -- common/autotest_common.sh@1125 -- # non_locking_app_on_locked_coremask 00:09:41.378 11:20:36 event.cpu_locks.non_locking_app_on_locked_coremask -- event/cpu_locks.sh@80 -- # spdk_tgt_pid=61102 00:09:41.378 11:20:36 event.cpu_locks.non_locking_app_on_locked_coremask -- event/cpu_locks.sh@81 -- # waitforlisten 61102 /var/tmp/spdk.sock 00:09:41.378 11:20:36 event.cpu_locks.non_locking_app_on_locked_coremask -- common/autotest_common.sh@831 -- # '[' -z 61102 ']' 00:09:41.378 11:20:36 event.cpu_locks.non_locking_app_on_locked_coremask -- common/autotest_common.sh@835 -- # local rpc_addr=/var/tmp/spdk.sock 00:09:41.378 11:20:36 event.cpu_locks.non_locking_app_on_locked_coremask -- event/cpu_locks.sh@79 -- # /home/vagrant/spdk_repo/spdk/build/bin/spdk_tgt -m 0x1 00:09:41.378 11:20:36 event.cpu_locks.non_locking_app_on_locked_coremask -- common/autotest_common.sh@836 -- # local max_retries=100 00:09:41.378 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:09:41.378 11:20:36 event.cpu_locks.non_locking_app_on_locked_coremask -- common/autotest_common.sh@838 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:09:41.378 11:20:36 event.cpu_locks.non_locking_app_on_locked_coremask -- common/autotest_common.sh@840 -- # xtrace_disable 00:09:41.378 11:20:36 event.cpu_locks.non_locking_app_on_locked_coremask -- common/autotest_common.sh@10 -- # set +x 00:09:41.378 [2024-10-07 11:20:36.819740] Starting SPDK v25.01-pre git sha1 2a4f56c54 / DPDK 24.03.0 initialization... 00:09:41.378 [2024-10-07 11:20:36.819828] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --iova-mode=pa --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid61102 ] 00:09:41.637 [2024-10-07 11:20:36.954036] app.c: 917:spdk_app_start: *NOTICE*: Total cores available: 1 00:09:41.637 [2024-10-07 11:20:37.072587] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 0 00:09:42.598 11:20:37 event.cpu_locks.non_locking_app_on_locked_coremask -- common/autotest_common.sh@860 -- # (( i == 0 )) 00:09:42.598 11:20:37 event.cpu_locks.non_locking_app_on_locked_coremask -- common/autotest_common.sh@864 -- # return 0 00:09:42.598 11:20:37 event.cpu_locks.non_locking_app_on_locked_coremask -- event/cpu_locks.sh@83 -- # /home/vagrant/spdk_repo/spdk/build/bin/spdk_tgt -m 0x1 --disable-cpumask-locks -r /var/tmp/spdk2.sock 00:09:42.598 11:20:37 event.cpu_locks.non_locking_app_on_locked_coremask -- event/cpu_locks.sh@84 -- # spdk_tgt_pid2=61136 00:09:42.598 11:20:37 event.cpu_locks.non_locking_app_on_locked_coremask -- event/cpu_locks.sh@85 -- # waitforlisten 61136 /var/tmp/spdk2.sock 00:09:42.598 11:20:37 event.cpu_locks.non_locking_app_on_locked_coremask -- common/autotest_common.sh@831 -- # '[' -z 61136 ']' 00:09:42.598 11:20:37 event.cpu_locks.non_locking_app_on_locked_coremask -- common/autotest_common.sh@835 -- # local rpc_addr=/var/tmp/spdk2.sock 00:09:42.598 11:20:37 event.cpu_locks.non_locking_app_on_locked_coremask -- common/autotest_common.sh@836 -- # local max_retries=100 00:09:42.598 11:20:37 event.cpu_locks.non_locking_app_on_locked_coremask -- common/autotest_common.sh@838 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock...' 00:09:42.598 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock... 00:09:42.598 11:20:37 event.cpu_locks.non_locking_app_on_locked_coremask -- common/autotest_common.sh@840 -- # xtrace_disable 00:09:42.598 11:20:37 event.cpu_locks.non_locking_app_on_locked_coremask -- common/autotest_common.sh@10 -- # set +x 00:09:42.598 [2024-10-07 11:20:38.002779] Starting SPDK v25.01-pre git sha1 2a4f56c54 / DPDK 24.03.0 initialization... 00:09:42.598 [2024-10-07 11:20:38.002873] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --iova-mode=pa --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid61136 ] 00:09:42.857 [2024-10-07 11:20:38.141288] app.c: 914:spdk_app_start: *NOTICE*: CPU core locks deactivated. 00:09:42.857 [2024-10-07 11:20:38.141373] app.c: 917:spdk_app_start: *NOTICE*: Total cores available: 1 00:09:43.116 [2024-10-07 11:20:38.394077] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 0 00:09:43.684 11:20:39 event.cpu_locks.non_locking_app_on_locked_coremask -- common/autotest_common.sh@860 -- # (( i == 0 )) 00:09:43.684 11:20:39 event.cpu_locks.non_locking_app_on_locked_coremask -- common/autotest_common.sh@864 -- # return 0 00:09:43.684 11:20:39 event.cpu_locks.non_locking_app_on_locked_coremask -- event/cpu_locks.sh@87 -- # locks_exist 61102 00:09:43.684 11:20:39 event.cpu_locks.non_locking_app_on_locked_coremask -- event/cpu_locks.sh@22 -- # lslocks -p 61102 00:09:43.684 11:20:39 event.cpu_locks.non_locking_app_on_locked_coremask -- event/cpu_locks.sh@22 -- # grep -q spdk_cpu_lock 00:09:44.665 11:20:39 event.cpu_locks.non_locking_app_on_locked_coremask -- event/cpu_locks.sh@89 -- # killprocess 61102 00:09:44.665 11:20:39 event.cpu_locks.non_locking_app_on_locked_coremask -- common/autotest_common.sh@950 -- # '[' -z 61102 ']' 00:09:44.665 11:20:39 event.cpu_locks.non_locking_app_on_locked_coremask -- common/autotest_common.sh@954 -- # kill -0 61102 00:09:44.665 11:20:39 event.cpu_locks.non_locking_app_on_locked_coremask -- common/autotest_common.sh@955 -- # uname 00:09:44.665 11:20:39 event.cpu_locks.non_locking_app_on_locked_coremask -- common/autotest_common.sh@955 -- # '[' Linux = Linux ']' 00:09:44.665 11:20:39 event.cpu_locks.non_locking_app_on_locked_coremask -- common/autotest_common.sh@956 -- # ps --no-headers -o comm= 61102 00:09:44.665 11:20:40 event.cpu_locks.non_locking_app_on_locked_coremask -- common/autotest_common.sh@956 -- # process_name=reactor_0 00:09:44.665 11:20:40 event.cpu_locks.non_locking_app_on_locked_coremask -- common/autotest_common.sh@960 -- # '[' reactor_0 = sudo ']' 00:09:44.665 killing process with pid 61102 00:09:44.665 11:20:40 event.cpu_locks.non_locking_app_on_locked_coremask -- common/autotest_common.sh@968 -- # echo 'killing process with pid 61102' 00:09:44.665 11:20:40 event.cpu_locks.non_locking_app_on_locked_coremask -- common/autotest_common.sh@969 -- # kill 61102 00:09:44.665 11:20:40 event.cpu_locks.non_locking_app_on_locked_coremask -- common/autotest_common.sh@974 -- # wait 61102 00:09:45.599 11:20:40 event.cpu_locks.non_locking_app_on_locked_coremask -- event/cpu_locks.sh@90 -- # killprocess 61136 00:09:45.599 11:20:40 event.cpu_locks.non_locking_app_on_locked_coremask -- common/autotest_common.sh@950 -- # '[' -z 61136 ']' 00:09:45.599 11:20:40 event.cpu_locks.non_locking_app_on_locked_coremask -- common/autotest_common.sh@954 -- # kill -0 61136 00:09:45.599 11:20:40 event.cpu_locks.non_locking_app_on_locked_coremask -- common/autotest_common.sh@955 -- # uname 00:09:45.599 11:20:40 event.cpu_locks.non_locking_app_on_locked_coremask -- common/autotest_common.sh@955 -- # '[' Linux = Linux ']' 00:09:45.599 11:20:40 event.cpu_locks.non_locking_app_on_locked_coremask -- common/autotest_common.sh@956 -- # ps --no-headers -o comm= 61136 00:09:45.599 11:20:40 event.cpu_locks.non_locking_app_on_locked_coremask -- common/autotest_common.sh@956 -- # process_name=reactor_0 00:09:45.599 11:20:40 event.cpu_locks.non_locking_app_on_locked_coremask -- common/autotest_common.sh@960 -- # '[' reactor_0 = sudo ']' 00:09:45.599 killing process with pid 61136 00:09:45.599 11:20:40 event.cpu_locks.non_locking_app_on_locked_coremask -- common/autotest_common.sh@968 -- # echo 'killing process with pid 61136' 00:09:45.599 11:20:40 event.cpu_locks.non_locking_app_on_locked_coremask -- common/autotest_common.sh@969 -- # kill 61136 00:09:45.599 11:20:40 event.cpu_locks.non_locking_app_on_locked_coremask -- common/autotest_common.sh@974 -- # wait 61136 00:09:45.857 00:09:45.857 real 0m4.520s 00:09:45.857 user 0m5.158s 00:09:45.857 sys 0m1.222s 00:09:45.857 11:20:41 event.cpu_locks.non_locking_app_on_locked_coremask -- common/autotest_common.sh@1126 -- # xtrace_disable 00:09:45.857 11:20:41 event.cpu_locks.non_locking_app_on_locked_coremask -- common/autotest_common.sh@10 -- # set +x 00:09:45.857 ************************************ 00:09:45.858 END TEST non_locking_app_on_locked_coremask 00:09:45.858 ************************************ 00:09:45.858 11:20:41 event.cpu_locks -- event/cpu_locks.sh@169 -- # run_test locking_app_on_unlocked_coremask locking_app_on_unlocked_coremask 00:09:45.858 11:20:41 event.cpu_locks -- common/autotest_common.sh@1101 -- # '[' 2 -le 1 ']' 00:09:45.858 11:20:41 event.cpu_locks -- common/autotest_common.sh@1107 -- # xtrace_disable 00:09:45.858 11:20:41 event.cpu_locks -- common/autotest_common.sh@10 -- # set +x 00:09:45.858 ************************************ 00:09:45.858 START TEST locking_app_on_unlocked_coremask 00:09:45.858 ************************************ 00:09:45.858 11:20:41 event.cpu_locks.locking_app_on_unlocked_coremask -- common/autotest_common.sh@1125 -- # locking_app_on_unlocked_coremask 00:09:45.858 11:20:41 event.cpu_locks.locking_app_on_unlocked_coremask -- event/cpu_locks.sh@98 -- # spdk_tgt_pid=61215 00:09:45.858 11:20:41 event.cpu_locks.locking_app_on_unlocked_coremask -- event/cpu_locks.sh@99 -- # waitforlisten 61215 /var/tmp/spdk.sock 00:09:45.858 11:20:41 event.cpu_locks.locking_app_on_unlocked_coremask -- event/cpu_locks.sh@97 -- # /home/vagrant/spdk_repo/spdk/build/bin/spdk_tgt -m 0x1 --disable-cpumask-locks 00:09:45.858 11:20:41 event.cpu_locks.locking_app_on_unlocked_coremask -- common/autotest_common.sh@831 -- # '[' -z 61215 ']' 00:09:45.858 11:20:41 event.cpu_locks.locking_app_on_unlocked_coremask -- common/autotest_common.sh@835 -- # local rpc_addr=/var/tmp/spdk.sock 00:09:45.858 11:20:41 event.cpu_locks.locking_app_on_unlocked_coremask -- common/autotest_common.sh@836 -- # local max_retries=100 00:09:45.858 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:09:45.858 11:20:41 event.cpu_locks.locking_app_on_unlocked_coremask -- common/autotest_common.sh@838 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:09:45.858 11:20:41 event.cpu_locks.locking_app_on_unlocked_coremask -- common/autotest_common.sh@840 -- # xtrace_disable 00:09:45.858 11:20:41 event.cpu_locks.locking_app_on_unlocked_coremask -- common/autotest_common.sh@10 -- # set +x 00:09:46.115 [2024-10-07 11:20:41.402425] Starting SPDK v25.01-pre git sha1 2a4f56c54 / DPDK 24.03.0 initialization... 00:09:46.115 [2024-10-07 11:20:41.402533] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --iova-mode=pa --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid61215 ] 00:09:46.115 [2024-10-07 11:20:41.539199] app.c: 914:spdk_app_start: *NOTICE*: CPU core locks deactivated. 00:09:46.115 [2024-10-07 11:20:41.539281] app.c: 917:spdk_app_start: *NOTICE*: Total cores available: 1 00:09:46.374 [2024-10-07 11:20:41.690112] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 0 00:09:46.940 11:20:42 event.cpu_locks.locking_app_on_unlocked_coremask -- common/autotest_common.sh@860 -- # (( i == 0 )) 00:09:46.940 11:20:42 event.cpu_locks.locking_app_on_unlocked_coremask -- common/autotest_common.sh@864 -- # return 0 00:09:46.940 11:20:42 event.cpu_locks.locking_app_on_unlocked_coremask -- event/cpu_locks.sh@102 -- # spdk_tgt_pid2=61243 00:09:46.940 11:20:42 event.cpu_locks.locking_app_on_unlocked_coremask -- event/cpu_locks.sh@101 -- # /home/vagrant/spdk_repo/spdk/build/bin/spdk_tgt -m 0x1 -r /var/tmp/spdk2.sock 00:09:46.940 11:20:42 event.cpu_locks.locking_app_on_unlocked_coremask -- event/cpu_locks.sh@103 -- # waitforlisten 61243 /var/tmp/spdk2.sock 00:09:46.940 11:20:42 event.cpu_locks.locking_app_on_unlocked_coremask -- common/autotest_common.sh@831 -- # '[' -z 61243 ']' 00:09:46.940 11:20:42 event.cpu_locks.locking_app_on_unlocked_coremask -- common/autotest_common.sh@835 -- # local rpc_addr=/var/tmp/spdk2.sock 00:09:46.940 11:20:42 event.cpu_locks.locking_app_on_unlocked_coremask -- common/autotest_common.sh@836 -- # local max_retries=100 00:09:46.940 11:20:42 event.cpu_locks.locking_app_on_unlocked_coremask -- common/autotest_common.sh@838 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock...' 00:09:46.940 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock... 00:09:46.940 11:20:42 event.cpu_locks.locking_app_on_unlocked_coremask -- common/autotest_common.sh@840 -- # xtrace_disable 00:09:46.940 11:20:42 event.cpu_locks.locking_app_on_unlocked_coremask -- common/autotest_common.sh@10 -- # set +x 00:09:47.199 [2024-10-07 11:20:42.509348] Starting SPDK v25.01-pre git sha1 2a4f56c54 / DPDK 24.03.0 initialization... 00:09:47.199 [2024-10-07 11:20:42.509457] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --iova-mode=pa --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid61243 ] 00:09:47.199 [2024-10-07 11:20:42.653994] app.c: 917:spdk_app_start: *NOTICE*: Total cores available: 1 00:09:47.458 [2024-10-07 11:20:42.884032] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 0 00:09:48.025 11:20:43 event.cpu_locks.locking_app_on_unlocked_coremask -- common/autotest_common.sh@860 -- # (( i == 0 )) 00:09:48.025 11:20:43 event.cpu_locks.locking_app_on_unlocked_coremask -- common/autotest_common.sh@864 -- # return 0 00:09:48.025 11:20:43 event.cpu_locks.locking_app_on_unlocked_coremask -- event/cpu_locks.sh@105 -- # locks_exist 61243 00:09:48.025 11:20:43 event.cpu_locks.locking_app_on_unlocked_coremask -- event/cpu_locks.sh@22 -- # lslocks -p 61243 00:09:48.025 11:20:43 event.cpu_locks.locking_app_on_unlocked_coremask -- event/cpu_locks.sh@22 -- # grep -q spdk_cpu_lock 00:09:48.964 11:20:44 event.cpu_locks.locking_app_on_unlocked_coremask -- event/cpu_locks.sh@107 -- # killprocess 61215 00:09:48.964 11:20:44 event.cpu_locks.locking_app_on_unlocked_coremask -- common/autotest_common.sh@950 -- # '[' -z 61215 ']' 00:09:48.964 11:20:44 event.cpu_locks.locking_app_on_unlocked_coremask -- common/autotest_common.sh@954 -- # kill -0 61215 00:09:48.964 11:20:44 event.cpu_locks.locking_app_on_unlocked_coremask -- common/autotest_common.sh@955 -- # uname 00:09:48.964 11:20:44 event.cpu_locks.locking_app_on_unlocked_coremask -- common/autotest_common.sh@955 -- # '[' Linux = Linux ']' 00:09:48.964 11:20:44 event.cpu_locks.locking_app_on_unlocked_coremask -- common/autotest_common.sh@956 -- # ps --no-headers -o comm= 61215 00:09:48.964 killing process with pid 61215 00:09:48.964 11:20:44 event.cpu_locks.locking_app_on_unlocked_coremask -- common/autotest_common.sh@956 -- # process_name=reactor_0 00:09:48.964 11:20:44 event.cpu_locks.locking_app_on_unlocked_coremask -- common/autotest_common.sh@960 -- # '[' reactor_0 = sudo ']' 00:09:48.964 11:20:44 event.cpu_locks.locking_app_on_unlocked_coremask -- common/autotest_common.sh@968 -- # echo 'killing process with pid 61215' 00:09:48.964 11:20:44 event.cpu_locks.locking_app_on_unlocked_coremask -- common/autotest_common.sh@969 -- # kill 61215 00:09:48.964 11:20:44 event.cpu_locks.locking_app_on_unlocked_coremask -- common/autotest_common.sh@974 -- # wait 61215 00:09:49.900 11:20:45 event.cpu_locks.locking_app_on_unlocked_coremask -- event/cpu_locks.sh@108 -- # killprocess 61243 00:09:49.900 11:20:45 event.cpu_locks.locking_app_on_unlocked_coremask -- common/autotest_common.sh@950 -- # '[' -z 61243 ']' 00:09:49.900 11:20:45 event.cpu_locks.locking_app_on_unlocked_coremask -- common/autotest_common.sh@954 -- # kill -0 61243 00:09:49.900 11:20:45 event.cpu_locks.locking_app_on_unlocked_coremask -- common/autotest_common.sh@955 -- # uname 00:09:49.900 11:20:45 event.cpu_locks.locking_app_on_unlocked_coremask -- common/autotest_common.sh@955 -- # '[' Linux = Linux ']' 00:09:49.900 11:20:45 event.cpu_locks.locking_app_on_unlocked_coremask -- common/autotest_common.sh@956 -- # ps --no-headers -o comm= 61243 00:09:49.900 11:20:45 event.cpu_locks.locking_app_on_unlocked_coremask -- common/autotest_common.sh@956 -- # process_name=reactor_0 00:09:49.900 11:20:45 event.cpu_locks.locking_app_on_unlocked_coremask -- common/autotest_common.sh@960 -- # '[' reactor_0 = sudo ']' 00:09:49.900 11:20:45 event.cpu_locks.locking_app_on_unlocked_coremask -- common/autotest_common.sh@968 -- # echo 'killing process with pid 61243' 00:09:49.900 killing process with pid 61243 00:09:49.900 11:20:45 event.cpu_locks.locking_app_on_unlocked_coremask -- common/autotest_common.sh@969 -- # kill 61243 00:09:49.900 11:20:45 event.cpu_locks.locking_app_on_unlocked_coremask -- common/autotest_common.sh@974 -- # wait 61243 00:09:50.159 ************************************ 00:09:50.159 END TEST locking_app_on_unlocked_coremask 00:09:50.159 ************************************ 00:09:50.159 00:09:50.159 real 0m4.299s 00:09:50.159 user 0m4.860s 00:09:50.159 sys 0m1.169s 00:09:50.159 11:20:45 event.cpu_locks.locking_app_on_unlocked_coremask -- common/autotest_common.sh@1126 -- # xtrace_disable 00:09:50.159 11:20:45 event.cpu_locks.locking_app_on_unlocked_coremask -- common/autotest_common.sh@10 -- # set +x 00:09:50.159 11:20:45 event.cpu_locks -- event/cpu_locks.sh@170 -- # run_test locking_app_on_locked_coremask locking_app_on_locked_coremask 00:09:50.159 11:20:45 event.cpu_locks -- common/autotest_common.sh@1101 -- # '[' 2 -le 1 ']' 00:09:50.159 11:20:45 event.cpu_locks -- common/autotest_common.sh@1107 -- # xtrace_disable 00:09:50.159 11:20:45 event.cpu_locks -- common/autotest_common.sh@10 -- # set +x 00:09:50.159 ************************************ 00:09:50.159 START TEST locking_app_on_locked_coremask 00:09:50.159 ************************************ 00:09:50.159 11:20:45 event.cpu_locks.locking_app_on_locked_coremask -- common/autotest_common.sh@1125 -- # locking_app_on_locked_coremask 00:09:50.159 11:20:45 event.cpu_locks.locking_app_on_locked_coremask -- event/cpu_locks.sh@115 -- # spdk_tgt_pid=61327 00:09:50.159 11:20:45 event.cpu_locks.locking_app_on_locked_coremask -- event/cpu_locks.sh@116 -- # waitforlisten 61327 /var/tmp/spdk.sock 00:09:50.159 11:20:45 event.cpu_locks.locking_app_on_locked_coremask -- common/autotest_common.sh@831 -- # '[' -z 61327 ']' 00:09:50.159 11:20:45 event.cpu_locks.locking_app_on_locked_coremask -- common/autotest_common.sh@835 -- # local rpc_addr=/var/tmp/spdk.sock 00:09:50.159 11:20:45 event.cpu_locks.locking_app_on_locked_coremask -- common/autotest_common.sh@836 -- # local max_retries=100 00:09:50.159 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:09:50.159 11:20:45 event.cpu_locks.locking_app_on_locked_coremask -- common/autotest_common.sh@838 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:09:50.159 11:20:45 event.cpu_locks.locking_app_on_locked_coremask -- common/autotest_common.sh@840 -- # xtrace_disable 00:09:50.159 11:20:45 event.cpu_locks.locking_app_on_locked_coremask -- common/autotest_common.sh@10 -- # set +x 00:09:50.159 11:20:45 event.cpu_locks.locking_app_on_locked_coremask -- event/cpu_locks.sh@114 -- # /home/vagrant/spdk_repo/spdk/build/bin/spdk_tgt -m 0x1 00:09:50.418 [2024-10-07 11:20:45.757433] Starting SPDK v25.01-pre git sha1 2a4f56c54 / DPDK 24.03.0 initialization... 00:09:50.418 [2024-10-07 11:20:45.757558] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --iova-mode=pa --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid61327 ] 00:09:50.418 [2024-10-07 11:20:45.893971] app.c: 917:spdk_app_start: *NOTICE*: Total cores available: 1 00:09:50.741 [2024-10-07 11:20:46.007618] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 0 00:09:51.308 11:20:46 event.cpu_locks.locking_app_on_locked_coremask -- common/autotest_common.sh@860 -- # (( i == 0 )) 00:09:51.308 11:20:46 event.cpu_locks.locking_app_on_locked_coremask -- common/autotest_common.sh@864 -- # return 0 00:09:51.308 11:20:46 event.cpu_locks.locking_app_on_locked_coremask -- event/cpu_locks.sh@119 -- # spdk_tgt_pid2=61355 00:09:51.308 11:20:46 event.cpu_locks.locking_app_on_locked_coremask -- event/cpu_locks.sh@118 -- # /home/vagrant/spdk_repo/spdk/build/bin/spdk_tgt -m 0x1 -r /var/tmp/spdk2.sock 00:09:51.308 11:20:46 event.cpu_locks.locking_app_on_locked_coremask -- event/cpu_locks.sh@120 -- # NOT waitforlisten 61355 /var/tmp/spdk2.sock 00:09:51.308 11:20:46 event.cpu_locks.locking_app_on_locked_coremask -- common/autotest_common.sh@650 -- # local es=0 00:09:51.308 11:20:46 event.cpu_locks.locking_app_on_locked_coremask -- common/autotest_common.sh@652 -- # valid_exec_arg waitforlisten 61355 /var/tmp/spdk2.sock 00:09:51.308 11:20:46 event.cpu_locks.locking_app_on_locked_coremask -- common/autotest_common.sh@638 -- # local arg=waitforlisten 00:09:51.308 11:20:46 event.cpu_locks.locking_app_on_locked_coremask -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:09:51.308 11:20:46 event.cpu_locks.locking_app_on_locked_coremask -- common/autotest_common.sh@642 -- # type -t waitforlisten 00:09:51.308 11:20:46 event.cpu_locks.locking_app_on_locked_coremask -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:09:51.308 11:20:46 event.cpu_locks.locking_app_on_locked_coremask -- common/autotest_common.sh@653 -- # waitforlisten 61355 /var/tmp/spdk2.sock 00:09:51.308 11:20:46 event.cpu_locks.locking_app_on_locked_coremask -- common/autotest_common.sh@831 -- # '[' -z 61355 ']' 00:09:51.308 11:20:46 event.cpu_locks.locking_app_on_locked_coremask -- common/autotest_common.sh@835 -- # local rpc_addr=/var/tmp/spdk2.sock 00:09:51.308 11:20:46 event.cpu_locks.locking_app_on_locked_coremask -- common/autotest_common.sh@836 -- # local max_retries=100 00:09:51.308 11:20:46 event.cpu_locks.locking_app_on_locked_coremask -- common/autotest_common.sh@838 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock...' 00:09:51.308 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock... 00:09:51.308 11:20:46 event.cpu_locks.locking_app_on_locked_coremask -- common/autotest_common.sh@840 -- # xtrace_disable 00:09:51.308 11:20:46 event.cpu_locks.locking_app_on_locked_coremask -- common/autotest_common.sh@10 -- # set +x 00:09:51.308 [2024-10-07 11:20:46.799832] Starting SPDK v25.01-pre git sha1 2a4f56c54 / DPDK 24.03.0 initialization... 00:09:51.308 [2024-10-07 11:20:46.799938] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --iova-mode=pa --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid61355 ] 00:09:51.566 [2024-10-07 11:20:46.943909] app.c: 779:claim_cpu_cores: *ERROR*: Cannot create lock on core 0, probably process 61327 has claimed it. 00:09:51.566 [2024-10-07 11:20:46.943979] app.c: 910:spdk_app_start: *ERROR*: Unable to acquire lock on assigned core mask - exiting. 00:09:52.133 /home/vagrant/spdk_repo/spdk/test/common/autotest_common.sh: line 846: kill: (61355) - No such process 00:09:52.133 ERROR: process (pid: 61355) is no longer running 00:09:52.133 11:20:47 event.cpu_locks.locking_app_on_locked_coremask -- common/autotest_common.sh@860 -- # (( i == 0 )) 00:09:52.133 11:20:47 event.cpu_locks.locking_app_on_locked_coremask -- common/autotest_common.sh@864 -- # return 1 00:09:52.133 11:20:47 event.cpu_locks.locking_app_on_locked_coremask -- common/autotest_common.sh@653 -- # es=1 00:09:52.133 11:20:47 event.cpu_locks.locking_app_on_locked_coremask -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:09:52.133 11:20:47 event.cpu_locks.locking_app_on_locked_coremask -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:09:52.133 11:20:47 event.cpu_locks.locking_app_on_locked_coremask -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:09:52.133 11:20:47 event.cpu_locks.locking_app_on_locked_coremask -- event/cpu_locks.sh@122 -- # locks_exist 61327 00:09:52.133 11:20:47 event.cpu_locks.locking_app_on_locked_coremask -- event/cpu_locks.sh@22 -- # lslocks -p 61327 00:09:52.133 11:20:47 event.cpu_locks.locking_app_on_locked_coremask -- event/cpu_locks.sh@22 -- # grep -q spdk_cpu_lock 00:09:52.391 11:20:47 event.cpu_locks.locking_app_on_locked_coremask -- event/cpu_locks.sh@124 -- # killprocess 61327 00:09:52.391 11:20:47 event.cpu_locks.locking_app_on_locked_coremask -- common/autotest_common.sh@950 -- # '[' -z 61327 ']' 00:09:52.391 11:20:47 event.cpu_locks.locking_app_on_locked_coremask -- common/autotest_common.sh@954 -- # kill -0 61327 00:09:52.391 11:20:47 event.cpu_locks.locking_app_on_locked_coremask -- common/autotest_common.sh@955 -- # uname 00:09:52.391 11:20:47 event.cpu_locks.locking_app_on_locked_coremask -- common/autotest_common.sh@955 -- # '[' Linux = Linux ']' 00:09:52.391 11:20:47 event.cpu_locks.locking_app_on_locked_coremask -- common/autotest_common.sh@956 -- # ps --no-headers -o comm= 61327 00:09:52.391 11:20:47 event.cpu_locks.locking_app_on_locked_coremask -- common/autotest_common.sh@956 -- # process_name=reactor_0 00:09:52.391 11:20:47 event.cpu_locks.locking_app_on_locked_coremask -- common/autotest_common.sh@960 -- # '[' reactor_0 = sudo ']' 00:09:52.391 11:20:47 event.cpu_locks.locking_app_on_locked_coremask -- common/autotest_common.sh@968 -- # echo 'killing process with pid 61327' 00:09:52.391 killing process with pid 61327 00:09:52.391 11:20:47 event.cpu_locks.locking_app_on_locked_coremask -- common/autotest_common.sh@969 -- # kill 61327 00:09:52.391 11:20:47 event.cpu_locks.locking_app_on_locked_coremask -- common/autotest_common.sh@974 -- # wait 61327 00:09:52.958 00:09:52.958 real 0m2.636s 00:09:52.958 user 0m3.057s 00:09:52.958 sys 0m0.631s 00:09:52.958 11:20:48 event.cpu_locks.locking_app_on_locked_coremask -- common/autotest_common.sh@1126 -- # xtrace_disable 00:09:52.958 ************************************ 00:09:52.958 END TEST locking_app_on_locked_coremask 00:09:52.958 ************************************ 00:09:52.958 11:20:48 event.cpu_locks.locking_app_on_locked_coremask -- common/autotest_common.sh@10 -- # set +x 00:09:52.958 11:20:48 event.cpu_locks -- event/cpu_locks.sh@171 -- # run_test locking_overlapped_coremask locking_overlapped_coremask 00:09:52.958 11:20:48 event.cpu_locks -- common/autotest_common.sh@1101 -- # '[' 2 -le 1 ']' 00:09:52.958 11:20:48 event.cpu_locks -- common/autotest_common.sh@1107 -- # xtrace_disable 00:09:52.958 11:20:48 event.cpu_locks -- common/autotest_common.sh@10 -- # set +x 00:09:52.958 ************************************ 00:09:52.958 START TEST locking_overlapped_coremask 00:09:52.958 ************************************ 00:09:52.958 11:20:48 event.cpu_locks.locking_overlapped_coremask -- common/autotest_common.sh@1125 -- # locking_overlapped_coremask 00:09:52.958 11:20:48 event.cpu_locks.locking_overlapped_coremask -- event/cpu_locks.sh@132 -- # spdk_tgt_pid=61407 00:09:52.958 11:20:48 event.cpu_locks.locking_overlapped_coremask -- event/cpu_locks.sh@133 -- # waitforlisten 61407 /var/tmp/spdk.sock 00:09:52.958 11:20:48 event.cpu_locks.locking_overlapped_coremask -- event/cpu_locks.sh@131 -- # /home/vagrant/spdk_repo/spdk/build/bin/spdk_tgt -m 0x7 00:09:52.958 11:20:48 event.cpu_locks.locking_overlapped_coremask -- common/autotest_common.sh@831 -- # '[' -z 61407 ']' 00:09:52.958 11:20:48 event.cpu_locks.locking_overlapped_coremask -- common/autotest_common.sh@835 -- # local rpc_addr=/var/tmp/spdk.sock 00:09:52.958 11:20:48 event.cpu_locks.locking_overlapped_coremask -- common/autotest_common.sh@836 -- # local max_retries=100 00:09:52.958 11:20:48 event.cpu_locks.locking_overlapped_coremask -- common/autotest_common.sh@838 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:09:52.958 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:09:52.958 11:20:48 event.cpu_locks.locking_overlapped_coremask -- common/autotest_common.sh@840 -- # xtrace_disable 00:09:52.958 11:20:48 event.cpu_locks.locking_overlapped_coremask -- common/autotest_common.sh@10 -- # set +x 00:09:52.958 [2024-10-07 11:20:48.423572] Starting SPDK v25.01-pre git sha1 2a4f56c54 / DPDK 24.03.0 initialization... 00:09:52.958 [2024-10-07 11:20:48.423696] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x7 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --iova-mode=pa --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid61407 ] 00:09:53.216 [2024-10-07 11:20:48.559317] app.c: 917:spdk_app_start: *NOTICE*: Total cores available: 3 00:09:53.216 [2024-10-07 11:20:48.680323] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 1 00:09:53.216 [2024-10-07 11:20:48.680468] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 2 00:09:53.216 [2024-10-07 11:20:48.680472] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 0 00:09:54.164 11:20:49 event.cpu_locks.locking_overlapped_coremask -- common/autotest_common.sh@860 -- # (( i == 0 )) 00:09:54.164 11:20:49 event.cpu_locks.locking_overlapped_coremask -- common/autotest_common.sh@864 -- # return 0 00:09:54.164 11:20:49 event.cpu_locks.locking_overlapped_coremask -- event/cpu_locks.sh@136 -- # spdk_tgt_pid2=61437 00:09:54.164 11:20:49 event.cpu_locks.locking_overlapped_coremask -- event/cpu_locks.sh@137 -- # NOT waitforlisten 61437 /var/tmp/spdk2.sock 00:09:54.164 11:20:49 event.cpu_locks.locking_overlapped_coremask -- event/cpu_locks.sh@135 -- # /home/vagrant/spdk_repo/spdk/build/bin/spdk_tgt -m 0x1c -r /var/tmp/spdk2.sock 00:09:54.164 11:20:49 event.cpu_locks.locking_overlapped_coremask -- common/autotest_common.sh@650 -- # local es=0 00:09:54.164 11:20:49 event.cpu_locks.locking_overlapped_coremask -- common/autotest_common.sh@652 -- # valid_exec_arg waitforlisten 61437 /var/tmp/spdk2.sock 00:09:54.164 11:20:49 event.cpu_locks.locking_overlapped_coremask -- common/autotest_common.sh@638 -- # local arg=waitforlisten 00:09:54.164 11:20:49 event.cpu_locks.locking_overlapped_coremask -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:09:54.164 11:20:49 event.cpu_locks.locking_overlapped_coremask -- common/autotest_common.sh@642 -- # type -t waitforlisten 00:09:54.164 11:20:49 event.cpu_locks.locking_overlapped_coremask -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:09:54.164 11:20:49 event.cpu_locks.locking_overlapped_coremask -- common/autotest_common.sh@653 -- # waitforlisten 61437 /var/tmp/spdk2.sock 00:09:54.164 11:20:49 event.cpu_locks.locking_overlapped_coremask -- common/autotest_common.sh@831 -- # '[' -z 61437 ']' 00:09:54.164 11:20:49 event.cpu_locks.locking_overlapped_coremask -- common/autotest_common.sh@835 -- # local rpc_addr=/var/tmp/spdk2.sock 00:09:54.164 11:20:49 event.cpu_locks.locking_overlapped_coremask -- common/autotest_common.sh@836 -- # local max_retries=100 00:09:54.164 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock... 00:09:54.164 11:20:49 event.cpu_locks.locking_overlapped_coremask -- common/autotest_common.sh@838 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock...' 00:09:54.164 11:20:49 event.cpu_locks.locking_overlapped_coremask -- common/autotest_common.sh@840 -- # xtrace_disable 00:09:54.164 11:20:49 event.cpu_locks.locking_overlapped_coremask -- common/autotest_common.sh@10 -- # set +x 00:09:54.164 [2024-10-07 11:20:49.592163] Starting SPDK v25.01-pre git sha1 2a4f56c54 / DPDK 24.03.0 initialization... 00:09:54.164 [2024-10-07 11:20:49.592270] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1c --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --iova-mode=pa --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid61437 ] 00:09:54.448 [2024-10-07 11:20:49.737309] app.c: 779:claim_cpu_cores: *ERROR*: Cannot create lock on core 2, probably process 61407 has claimed it. 00:09:54.448 [2024-10-07 11:20:49.737374] app.c: 910:spdk_app_start: *ERROR*: Unable to acquire lock on assigned core mask - exiting. 00:09:55.013 ERROR: process (pid: 61437) is no longer running 00:09:55.013 /home/vagrant/spdk_repo/spdk/test/common/autotest_common.sh: line 846: kill: (61437) - No such process 00:09:55.013 11:20:50 event.cpu_locks.locking_overlapped_coremask -- common/autotest_common.sh@860 -- # (( i == 0 )) 00:09:55.013 11:20:50 event.cpu_locks.locking_overlapped_coremask -- common/autotest_common.sh@864 -- # return 1 00:09:55.013 11:20:50 event.cpu_locks.locking_overlapped_coremask -- common/autotest_common.sh@653 -- # es=1 00:09:55.013 11:20:50 event.cpu_locks.locking_overlapped_coremask -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:09:55.013 11:20:50 event.cpu_locks.locking_overlapped_coremask -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:09:55.013 11:20:50 event.cpu_locks.locking_overlapped_coremask -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:09:55.013 11:20:50 event.cpu_locks.locking_overlapped_coremask -- event/cpu_locks.sh@139 -- # check_remaining_locks 00:09:55.013 11:20:50 event.cpu_locks.locking_overlapped_coremask -- event/cpu_locks.sh@36 -- # locks=(/var/tmp/spdk_cpu_lock_*) 00:09:55.013 11:20:50 event.cpu_locks.locking_overlapped_coremask -- event/cpu_locks.sh@37 -- # locks_expected=(/var/tmp/spdk_cpu_lock_{000..002}) 00:09:55.013 11:20:50 event.cpu_locks.locking_overlapped_coremask -- event/cpu_locks.sh@38 -- # [[ /var/tmp/spdk_cpu_lock_000 /var/tmp/spdk_cpu_lock_001 /var/tmp/spdk_cpu_lock_002 == \/\v\a\r\/\t\m\p\/\s\p\d\k\_\c\p\u\_\l\o\c\k\_\0\0\0\ \/\v\a\r\/\t\m\p\/\s\p\d\k\_\c\p\u\_\l\o\c\k\_\0\0\1\ \/\v\a\r\/\t\m\p\/\s\p\d\k\_\c\p\u\_\l\o\c\k\_\0\0\2 ]] 00:09:55.013 11:20:50 event.cpu_locks.locking_overlapped_coremask -- event/cpu_locks.sh@141 -- # killprocess 61407 00:09:55.013 11:20:50 event.cpu_locks.locking_overlapped_coremask -- common/autotest_common.sh@950 -- # '[' -z 61407 ']' 00:09:55.013 11:20:50 event.cpu_locks.locking_overlapped_coremask -- common/autotest_common.sh@954 -- # kill -0 61407 00:09:55.013 11:20:50 event.cpu_locks.locking_overlapped_coremask -- common/autotest_common.sh@955 -- # uname 00:09:55.013 11:20:50 event.cpu_locks.locking_overlapped_coremask -- common/autotest_common.sh@955 -- # '[' Linux = Linux ']' 00:09:55.013 11:20:50 event.cpu_locks.locking_overlapped_coremask -- common/autotest_common.sh@956 -- # ps --no-headers -o comm= 61407 00:09:55.013 11:20:50 event.cpu_locks.locking_overlapped_coremask -- common/autotest_common.sh@956 -- # process_name=reactor_0 00:09:55.013 killing process with pid 61407 00:09:55.013 11:20:50 event.cpu_locks.locking_overlapped_coremask -- common/autotest_common.sh@960 -- # '[' reactor_0 = sudo ']' 00:09:55.013 11:20:50 event.cpu_locks.locking_overlapped_coremask -- common/autotest_common.sh@968 -- # echo 'killing process with pid 61407' 00:09:55.013 11:20:50 event.cpu_locks.locking_overlapped_coremask -- common/autotest_common.sh@969 -- # kill 61407 00:09:55.013 11:20:50 event.cpu_locks.locking_overlapped_coremask -- common/autotest_common.sh@974 -- # wait 61407 00:09:55.271 00:09:55.271 real 0m2.409s 00:09:55.271 user 0m6.842s 00:09:55.271 sys 0m0.461s 00:09:55.271 ************************************ 00:09:55.271 END TEST locking_overlapped_coremask 00:09:55.271 ************************************ 00:09:55.271 11:20:50 event.cpu_locks.locking_overlapped_coremask -- common/autotest_common.sh@1126 -- # xtrace_disable 00:09:55.271 11:20:50 event.cpu_locks.locking_overlapped_coremask -- common/autotest_common.sh@10 -- # set +x 00:09:55.529 11:20:50 event.cpu_locks -- event/cpu_locks.sh@172 -- # run_test locking_overlapped_coremask_via_rpc locking_overlapped_coremask_via_rpc 00:09:55.529 11:20:50 event.cpu_locks -- common/autotest_common.sh@1101 -- # '[' 2 -le 1 ']' 00:09:55.529 11:20:50 event.cpu_locks -- common/autotest_common.sh@1107 -- # xtrace_disable 00:09:55.529 11:20:50 event.cpu_locks -- common/autotest_common.sh@10 -- # set +x 00:09:55.529 ************************************ 00:09:55.529 START TEST locking_overlapped_coremask_via_rpc 00:09:55.529 ************************************ 00:09:55.529 11:20:50 event.cpu_locks.locking_overlapped_coremask_via_rpc -- common/autotest_common.sh@1125 -- # locking_overlapped_coremask_via_rpc 00:09:55.529 11:20:50 event.cpu_locks.locking_overlapped_coremask_via_rpc -- event/cpu_locks.sh@148 -- # spdk_tgt_pid=61483 00:09:55.529 11:20:50 event.cpu_locks.locking_overlapped_coremask_via_rpc -- event/cpu_locks.sh@147 -- # /home/vagrant/spdk_repo/spdk/build/bin/spdk_tgt -m 0x7 --disable-cpumask-locks 00:09:55.529 11:20:50 event.cpu_locks.locking_overlapped_coremask_via_rpc -- event/cpu_locks.sh@149 -- # waitforlisten 61483 /var/tmp/spdk.sock 00:09:55.529 11:20:50 event.cpu_locks.locking_overlapped_coremask_via_rpc -- common/autotest_common.sh@831 -- # '[' -z 61483 ']' 00:09:55.529 11:20:50 event.cpu_locks.locking_overlapped_coremask_via_rpc -- common/autotest_common.sh@835 -- # local rpc_addr=/var/tmp/spdk.sock 00:09:55.529 11:20:50 event.cpu_locks.locking_overlapped_coremask_via_rpc -- common/autotest_common.sh@836 -- # local max_retries=100 00:09:55.529 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:09:55.529 11:20:50 event.cpu_locks.locking_overlapped_coremask_via_rpc -- common/autotest_common.sh@838 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:09:55.529 11:20:50 event.cpu_locks.locking_overlapped_coremask_via_rpc -- common/autotest_common.sh@840 -- # xtrace_disable 00:09:55.529 11:20:50 event.cpu_locks.locking_overlapped_coremask_via_rpc -- common/autotest_common.sh@10 -- # set +x 00:09:55.529 [2024-10-07 11:20:50.878938] Starting SPDK v25.01-pre git sha1 2a4f56c54 / DPDK 24.03.0 initialization... 00:09:55.529 [2024-10-07 11:20:50.879020] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x7 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --iova-mode=pa --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid61483 ] 00:09:55.529 [2024-10-07 11:20:51.012625] app.c: 914:spdk_app_start: *NOTICE*: CPU core locks deactivated. 00:09:55.529 [2024-10-07 11:20:51.012696] app.c: 917:spdk_app_start: *NOTICE*: Total cores available: 3 00:09:55.787 [2024-10-07 11:20:51.135818] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 1 00:09:55.787 [2024-10-07 11:20:51.135966] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 2 00:09:55.787 [2024-10-07 11:20:51.135970] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 0 00:09:56.352 11:20:51 event.cpu_locks.locking_overlapped_coremask_via_rpc -- common/autotest_common.sh@860 -- # (( i == 0 )) 00:09:56.352 11:20:51 event.cpu_locks.locking_overlapped_coremask_via_rpc -- common/autotest_common.sh@864 -- # return 0 00:09:56.352 11:20:51 event.cpu_locks.locking_overlapped_coremask_via_rpc -- event/cpu_locks.sh@152 -- # spdk_tgt_pid2=61513 00:09:56.352 11:20:51 event.cpu_locks.locking_overlapped_coremask_via_rpc -- event/cpu_locks.sh@153 -- # waitforlisten 61513 /var/tmp/spdk2.sock 00:09:56.352 11:20:51 event.cpu_locks.locking_overlapped_coremask_via_rpc -- event/cpu_locks.sh@151 -- # /home/vagrant/spdk_repo/spdk/build/bin/spdk_tgt -m 0x1c -r /var/tmp/spdk2.sock --disable-cpumask-locks 00:09:56.352 11:20:51 event.cpu_locks.locking_overlapped_coremask_via_rpc -- common/autotest_common.sh@831 -- # '[' -z 61513 ']' 00:09:56.352 11:20:51 event.cpu_locks.locking_overlapped_coremask_via_rpc -- common/autotest_common.sh@835 -- # local rpc_addr=/var/tmp/spdk2.sock 00:09:56.352 11:20:51 event.cpu_locks.locking_overlapped_coremask_via_rpc -- common/autotest_common.sh@836 -- # local max_retries=100 00:09:56.352 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock... 00:09:56.352 11:20:51 event.cpu_locks.locking_overlapped_coremask_via_rpc -- common/autotest_common.sh@838 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock...' 00:09:56.352 11:20:51 event.cpu_locks.locking_overlapped_coremask_via_rpc -- common/autotest_common.sh@840 -- # xtrace_disable 00:09:56.352 11:20:51 event.cpu_locks.locking_overlapped_coremask_via_rpc -- common/autotest_common.sh@10 -- # set +x 00:09:56.609 [2024-10-07 11:20:51.931949] Starting SPDK v25.01-pre git sha1 2a4f56c54 / DPDK 24.03.0 initialization... 00:09:56.609 [2024-10-07 11:20:51.932044] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1c --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --iova-mode=pa --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid61513 ] 00:09:56.610 [2024-10-07 11:20:52.075277] app.c: 914:spdk_app_start: *NOTICE*: CPU core locks deactivated. 00:09:56.610 [2024-10-07 11:20:52.075338] app.c: 917:spdk_app_start: *NOTICE*: Total cores available: 3 00:09:56.867 [2024-10-07 11:20:52.320731] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 3 00:09:56.867 [2024-10-07 11:20:52.323793] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 4 00:09:56.867 [2024-10-07 11:20:52.323794] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 2 00:09:57.825 11:20:53 event.cpu_locks.locking_overlapped_coremask_via_rpc -- common/autotest_common.sh@860 -- # (( i == 0 )) 00:09:57.826 11:20:53 event.cpu_locks.locking_overlapped_coremask_via_rpc -- common/autotest_common.sh@864 -- # return 0 00:09:57.826 11:20:53 event.cpu_locks.locking_overlapped_coremask_via_rpc -- event/cpu_locks.sh@155 -- # rpc_cmd framework_enable_cpumask_locks 00:09:57.826 11:20:53 event.cpu_locks.locking_overlapped_coremask_via_rpc -- common/autotest_common.sh@561 -- # xtrace_disable 00:09:57.826 11:20:53 event.cpu_locks.locking_overlapped_coremask_via_rpc -- common/autotest_common.sh@10 -- # set +x 00:09:57.826 11:20:53 event.cpu_locks.locking_overlapped_coremask_via_rpc -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:09:57.826 11:20:53 event.cpu_locks.locking_overlapped_coremask_via_rpc -- event/cpu_locks.sh@156 -- # NOT rpc_cmd -s /var/tmp/spdk2.sock framework_enable_cpumask_locks 00:09:57.826 11:20:53 event.cpu_locks.locking_overlapped_coremask_via_rpc -- common/autotest_common.sh@650 -- # local es=0 00:09:57.826 11:20:53 event.cpu_locks.locking_overlapped_coremask_via_rpc -- common/autotest_common.sh@652 -- # valid_exec_arg rpc_cmd -s /var/tmp/spdk2.sock framework_enable_cpumask_locks 00:09:57.826 11:20:53 event.cpu_locks.locking_overlapped_coremask_via_rpc -- common/autotest_common.sh@638 -- # local arg=rpc_cmd 00:09:57.826 11:20:53 event.cpu_locks.locking_overlapped_coremask_via_rpc -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:09:57.826 11:20:53 event.cpu_locks.locking_overlapped_coremask_via_rpc -- common/autotest_common.sh@642 -- # type -t rpc_cmd 00:09:57.826 11:20:53 event.cpu_locks.locking_overlapped_coremask_via_rpc -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:09:57.826 11:20:53 event.cpu_locks.locking_overlapped_coremask_via_rpc -- common/autotest_common.sh@653 -- # rpc_cmd -s /var/tmp/spdk2.sock framework_enable_cpumask_locks 00:09:57.826 11:20:53 event.cpu_locks.locking_overlapped_coremask_via_rpc -- common/autotest_common.sh@561 -- # xtrace_disable 00:09:57.826 11:20:53 event.cpu_locks.locking_overlapped_coremask_via_rpc -- common/autotest_common.sh@10 -- # set +x 00:09:57.826 [2024-10-07 11:20:53.025781] app.c: 779:claim_cpu_cores: *ERROR*: Cannot create lock on core 2, probably process 61483 has claimed it. 00:09:57.826 2024/10/07 11:20:53 error on JSON-RPC call, method: framework_enable_cpumask_locks, params: map[], err: error received for framework_enable_cpumask_locks method, err: Code=-32603 Msg=Failed to claim CPU core: 2 00:09:57.826 request: 00:09:57.826 { 00:09:57.826 "method": "framework_enable_cpumask_locks", 00:09:57.826 "params": {} 00:09:57.826 } 00:09:57.826 Got JSON-RPC error response 00:09:57.826 GoRPCClient: error on JSON-RPC call 00:09:57.826 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:09:57.826 11:20:53 event.cpu_locks.locking_overlapped_coremask_via_rpc -- common/autotest_common.sh@589 -- # [[ 1 == 0 ]] 00:09:57.826 11:20:53 event.cpu_locks.locking_overlapped_coremask_via_rpc -- common/autotest_common.sh@653 -- # es=1 00:09:57.826 11:20:53 event.cpu_locks.locking_overlapped_coremask_via_rpc -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:09:57.826 11:20:53 event.cpu_locks.locking_overlapped_coremask_via_rpc -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:09:57.826 11:20:53 event.cpu_locks.locking_overlapped_coremask_via_rpc -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:09:57.826 11:20:53 event.cpu_locks.locking_overlapped_coremask_via_rpc -- event/cpu_locks.sh@158 -- # waitforlisten 61483 /var/tmp/spdk.sock 00:09:57.826 11:20:53 event.cpu_locks.locking_overlapped_coremask_via_rpc -- common/autotest_common.sh@831 -- # '[' -z 61483 ']' 00:09:57.826 11:20:53 event.cpu_locks.locking_overlapped_coremask_via_rpc -- common/autotest_common.sh@835 -- # local rpc_addr=/var/tmp/spdk.sock 00:09:57.826 11:20:53 event.cpu_locks.locking_overlapped_coremask_via_rpc -- common/autotest_common.sh@836 -- # local max_retries=100 00:09:57.826 11:20:53 event.cpu_locks.locking_overlapped_coremask_via_rpc -- common/autotest_common.sh@838 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:09:57.826 11:20:53 event.cpu_locks.locking_overlapped_coremask_via_rpc -- common/autotest_common.sh@840 -- # xtrace_disable 00:09:57.826 11:20:53 event.cpu_locks.locking_overlapped_coremask_via_rpc -- common/autotest_common.sh@10 -- # set +x 00:09:57.826 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock... 00:09:57.826 11:20:53 event.cpu_locks.locking_overlapped_coremask_via_rpc -- common/autotest_common.sh@860 -- # (( i == 0 )) 00:09:57.826 11:20:53 event.cpu_locks.locking_overlapped_coremask_via_rpc -- common/autotest_common.sh@864 -- # return 0 00:09:57.826 11:20:53 event.cpu_locks.locking_overlapped_coremask_via_rpc -- event/cpu_locks.sh@159 -- # waitforlisten 61513 /var/tmp/spdk2.sock 00:09:57.826 11:20:53 event.cpu_locks.locking_overlapped_coremask_via_rpc -- common/autotest_common.sh@831 -- # '[' -z 61513 ']' 00:09:57.826 11:20:53 event.cpu_locks.locking_overlapped_coremask_via_rpc -- common/autotest_common.sh@835 -- # local rpc_addr=/var/tmp/spdk2.sock 00:09:57.826 11:20:53 event.cpu_locks.locking_overlapped_coremask_via_rpc -- common/autotest_common.sh@836 -- # local max_retries=100 00:09:57.826 11:20:53 event.cpu_locks.locking_overlapped_coremask_via_rpc -- common/autotest_common.sh@838 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock...' 00:09:57.826 11:20:53 event.cpu_locks.locking_overlapped_coremask_via_rpc -- common/autotest_common.sh@840 -- # xtrace_disable 00:09:57.826 11:20:53 event.cpu_locks.locking_overlapped_coremask_via_rpc -- common/autotest_common.sh@10 -- # set +x 00:09:58.391 ************************************ 00:09:58.391 END TEST locking_overlapped_coremask_via_rpc 00:09:58.391 ************************************ 00:09:58.391 11:20:53 event.cpu_locks.locking_overlapped_coremask_via_rpc -- common/autotest_common.sh@860 -- # (( i == 0 )) 00:09:58.391 11:20:53 event.cpu_locks.locking_overlapped_coremask_via_rpc -- common/autotest_common.sh@864 -- # return 0 00:09:58.391 11:20:53 event.cpu_locks.locking_overlapped_coremask_via_rpc -- event/cpu_locks.sh@161 -- # check_remaining_locks 00:09:58.391 11:20:53 event.cpu_locks.locking_overlapped_coremask_via_rpc -- event/cpu_locks.sh@36 -- # locks=(/var/tmp/spdk_cpu_lock_*) 00:09:58.391 11:20:53 event.cpu_locks.locking_overlapped_coremask_via_rpc -- event/cpu_locks.sh@37 -- # locks_expected=(/var/tmp/spdk_cpu_lock_{000..002}) 00:09:58.391 11:20:53 event.cpu_locks.locking_overlapped_coremask_via_rpc -- event/cpu_locks.sh@38 -- # [[ /var/tmp/spdk_cpu_lock_000 /var/tmp/spdk_cpu_lock_001 /var/tmp/spdk_cpu_lock_002 == \/\v\a\r\/\t\m\p\/\s\p\d\k\_\c\p\u\_\l\o\c\k\_\0\0\0\ \/\v\a\r\/\t\m\p\/\s\p\d\k\_\c\p\u\_\l\o\c\k\_\0\0\1\ \/\v\a\r\/\t\m\p\/\s\p\d\k\_\c\p\u\_\l\o\c\k\_\0\0\2 ]] 00:09:58.391 00:09:58.391 real 0m2.816s 00:09:58.391 user 0m1.506s 00:09:58.391 sys 0m0.240s 00:09:58.391 11:20:53 event.cpu_locks.locking_overlapped_coremask_via_rpc -- common/autotest_common.sh@1126 -- # xtrace_disable 00:09:58.391 11:20:53 event.cpu_locks.locking_overlapped_coremask_via_rpc -- common/autotest_common.sh@10 -- # set +x 00:09:58.391 11:20:53 event.cpu_locks -- event/cpu_locks.sh@174 -- # cleanup 00:09:58.391 11:20:53 event.cpu_locks -- event/cpu_locks.sh@15 -- # [[ -z 61483 ]] 00:09:58.391 11:20:53 event.cpu_locks -- event/cpu_locks.sh@15 -- # killprocess 61483 00:09:58.391 11:20:53 event.cpu_locks -- common/autotest_common.sh@950 -- # '[' -z 61483 ']' 00:09:58.391 11:20:53 event.cpu_locks -- common/autotest_common.sh@954 -- # kill -0 61483 00:09:58.391 11:20:53 event.cpu_locks -- common/autotest_common.sh@955 -- # uname 00:09:58.391 11:20:53 event.cpu_locks -- common/autotest_common.sh@955 -- # '[' Linux = Linux ']' 00:09:58.391 11:20:53 event.cpu_locks -- common/autotest_common.sh@956 -- # ps --no-headers -o comm= 61483 00:09:58.391 killing process with pid 61483 00:09:58.391 11:20:53 event.cpu_locks -- common/autotest_common.sh@956 -- # process_name=reactor_0 00:09:58.391 11:20:53 event.cpu_locks -- common/autotest_common.sh@960 -- # '[' reactor_0 = sudo ']' 00:09:58.391 11:20:53 event.cpu_locks -- common/autotest_common.sh@968 -- # echo 'killing process with pid 61483' 00:09:58.391 11:20:53 event.cpu_locks -- common/autotest_common.sh@969 -- # kill 61483 00:09:58.391 11:20:53 event.cpu_locks -- common/autotest_common.sh@974 -- # wait 61483 00:09:58.648 11:20:54 event.cpu_locks -- event/cpu_locks.sh@16 -- # [[ -z 61513 ]] 00:09:58.648 11:20:54 event.cpu_locks -- event/cpu_locks.sh@16 -- # killprocess 61513 00:09:58.648 11:20:54 event.cpu_locks -- common/autotest_common.sh@950 -- # '[' -z 61513 ']' 00:09:58.648 11:20:54 event.cpu_locks -- common/autotest_common.sh@954 -- # kill -0 61513 00:09:58.648 11:20:54 event.cpu_locks -- common/autotest_common.sh@955 -- # uname 00:09:58.648 11:20:54 event.cpu_locks -- common/autotest_common.sh@955 -- # '[' Linux = Linux ']' 00:09:58.648 11:20:54 event.cpu_locks -- common/autotest_common.sh@956 -- # ps --no-headers -o comm= 61513 00:09:58.648 11:20:54 event.cpu_locks -- common/autotest_common.sh@956 -- # process_name=reactor_2 00:09:58.648 killing process with pid 61513 00:09:58.648 11:20:54 event.cpu_locks -- common/autotest_common.sh@960 -- # '[' reactor_2 = sudo ']' 00:09:58.648 11:20:54 event.cpu_locks -- common/autotest_common.sh@968 -- # echo 'killing process with pid 61513' 00:09:58.648 11:20:54 event.cpu_locks -- common/autotest_common.sh@969 -- # kill 61513 00:09:58.648 11:20:54 event.cpu_locks -- common/autotest_common.sh@974 -- # wait 61513 00:09:59.214 11:20:54 event.cpu_locks -- event/cpu_locks.sh@18 -- # rm -f 00:09:59.214 11:20:54 event.cpu_locks -- event/cpu_locks.sh@1 -- # cleanup 00:09:59.214 11:20:54 event.cpu_locks -- event/cpu_locks.sh@15 -- # [[ -z 61483 ]] 00:09:59.214 11:20:54 event.cpu_locks -- event/cpu_locks.sh@15 -- # killprocess 61483 00:09:59.214 11:20:54 event.cpu_locks -- common/autotest_common.sh@950 -- # '[' -z 61483 ']' 00:09:59.214 11:20:54 event.cpu_locks -- common/autotest_common.sh@954 -- # kill -0 61483 00:09:59.214 /home/vagrant/spdk_repo/spdk/test/common/autotest_common.sh: line 954: kill: (61483) - No such process 00:09:59.214 Process with pid 61483 is not found 00:09:59.214 11:20:54 event.cpu_locks -- common/autotest_common.sh@977 -- # echo 'Process with pid 61483 is not found' 00:09:59.214 11:20:54 event.cpu_locks -- event/cpu_locks.sh@16 -- # [[ -z 61513 ]] 00:09:59.214 11:20:54 event.cpu_locks -- event/cpu_locks.sh@16 -- # killprocess 61513 00:09:59.214 11:20:54 event.cpu_locks -- common/autotest_common.sh@950 -- # '[' -z 61513 ']' 00:09:59.214 11:20:54 event.cpu_locks -- common/autotest_common.sh@954 -- # kill -0 61513 00:09:59.214 /home/vagrant/spdk_repo/spdk/test/common/autotest_common.sh: line 954: kill: (61513) - No such process 00:09:59.214 Process with pid 61513 is not found 00:09:59.214 11:20:54 event.cpu_locks -- common/autotest_common.sh@977 -- # echo 'Process with pid 61513 is not found' 00:09:59.214 11:20:54 event.cpu_locks -- event/cpu_locks.sh@18 -- # rm -f 00:09:59.214 00:09:59.214 real 0m22.044s 00:09:59.214 user 0m39.088s 00:09:59.214 sys 0m5.785s 00:09:59.214 ************************************ 00:09:59.214 END TEST cpu_locks 00:09:59.214 ************************************ 00:09:59.214 11:20:54 event.cpu_locks -- common/autotest_common.sh@1126 -- # xtrace_disable 00:09:59.214 11:20:54 event.cpu_locks -- common/autotest_common.sh@10 -- # set +x 00:09:59.214 00:09:59.215 real 0m53.056s 00:09:59.215 user 1m44.885s 00:09:59.215 sys 0m10.086s 00:09:59.215 11:20:54 event -- common/autotest_common.sh@1126 -- # xtrace_disable 00:09:59.215 ************************************ 00:09:59.215 END TEST event 00:09:59.215 ************************************ 00:09:59.215 11:20:54 event -- common/autotest_common.sh@10 -- # set +x 00:09:59.215 11:20:54 -- spdk/autotest.sh@169 -- # run_test thread /home/vagrant/spdk_repo/spdk/test/thread/thread.sh 00:09:59.215 11:20:54 -- common/autotest_common.sh@1101 -- # '[' 2 -le 1 ']' 00:09:59.215 11:20:54 -- common/autotest_common.sh@1107 -- # xtrace_disable 00:09:59.215 11:20:54 -- common/autotest_common.sh@10 -- # set +x 00:09:59.215 ************************************ 00:09:59.215 START TEST thread 00:09:59.215 ************************************ 00:09:59.215 11:20:54 thread -- common/autotest_common.sh@1125 -- # /home/vagrant/spdk_repo/spdk/test/thread/thread.sh 00:09:59.215 * Looking for test storage... 00:09:59.215 * Found test storage at /home/vagrant/spdk_repo/spdk/test/thread 00:09:59.215 11:20:54 thread -- common/autotest_common.sh@1680 -- # [[ y == y ]] 00:09:59.473 11:20:54 thread -- common/autotest_common.sh@1681 -- # lcov --version 00:09:59.473 11:20:54 thread -- common/autotest_common.sh@1681 -- # awk '{print $NF}' 00:09:59.473 11:20:54 thread -- common/autotest_common.sh@1681 -- # lt 1.15 2 00:09:59.473 11:20:54 thread -- scripts/common.sh@373 -- # cmp_versions 1.15 '<' 2 00:09:59.473 11:20:54 thread -- scripts/common.sh@333 -- # local ver1 ver1_l 00:09:59.473 11:20:54 thread -- scripts/common.sh@334 -- # local ver2 ver2_l 00:09:59.473 11:20:54 thread -- scripts/common.sh@336 -- # IFS=.-: 00:09:59.473 11:20:54 thread -- scripts/common.sh@336 -- # read -ra ver1 00:09:59.473 11:20:54 thread -- scripts/common.sh@337 -- # IFS=.-: 00:09:59.473 11:20:54 thread -- scripts/common.sh@337 -- # read -ra ver2 00:09:59.473 11:20:54 thread -- scripts/common.sh@338 -- # local 'op=<' 00:09:59.473 11:20:54 thread -- scripts/common.sh@340 -- # ver1_l=2 00:09:59.473 11:20:54 thread -- scripts/common.sh@341 -- # ver2_l=1 00:09:59.473 11:20:54 thread -- scripts/common.sh@343 -- # local lt=0 gt=0 eq=0 v 00:09:59.473 11:20:54 thread -- scripts/common.sh@344 -- # case "$op" in 00:09:59.473 11:20:54 thread -- scripts/common.sh@345 -- # : 1 00:09:59.473 11:20:54 thread -- scripts/common.sh@364 -- # (( v = 0 )) 00:09:59.473 11:20:54 thread -- scripts/common.sh@364 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:09:59.473 11:20:54 thread -- scripts/common.sh@365 -- # decimal 1 00:09:59.473 11:20:54 thread -- scripts/common.sh@353 -- # local d=1 00:09:59.473 11:20:54 thread -- scripts/common.sh@354 -- # [[ 1 =~ ^[0-9]+$ ]] 00:09:59.473 11:20:54 thread -- scripts/common.sh@355 -- # echo 1 00:09:59.473 11:20:54 thread -- scripts/common.sh@365 -- # ver1[v]=1 00:09:59.473 11:20:54 thread -- scripts/common.sh@366 -- # decimal 2 00:09:59.473 11:20:54 thread -- scripts/common.sh@353 -- # local d=2 00:09:59.473 11:20:54 thread -- scripts/common.sh@354 -- # [[ 2 =~ ^[0-9]+$ ]] 00:09:59.473 11:20:54 thread -- scripts/common.sh@355 -- # echo 2 00:09:59.473 11:20:54 thread -- scripts/common.sh@366 -- # ver2[v]=2 00:09:59.473 11:20:54 thread -- scripts/common.sh@367 -- # (( ver1[v] > ver2[v] )) 00:09:59.473 11:20:54 thread -- scripts/common.sh@368 -- # (( ver1[v] < ver2[v] )) 00:09:59.473 11:20:54 thread -- scripts/common.sh@368 -- # return 0 00:09:59.473 11:20:54 thread -- common/autotest_common.sh@1682 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:09:59.473 11:20:54 thread -- common/autotest_common.sh@1694 -- # export 'LCOV_OPTS= 00:09:59.473 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:09:59.473 --rc genhtml_branch_coverage=1 00:09:59.473 --rc genhtml_function_coverage=1 00:09:59.473 --rc genhtml_legend=1 00:09:59.473 --rc geninfo_all_blocks=1 00:09:59.473 --rc geninfo_unexecuted_blocks=1 00:09:59.473 00:09:59.473 ' 00:09:59.473 11:20:54 thread -- common/autotest_common.sh@1694 -- # LCOV_OPTS=' 00:09:59.473 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:09:59.473 --rc genhtml_branch_coverage=1 00:09:59.473 --rc genhtml_function_coverage=1 00:09:59.473 --rc genhtml_legend=1 00:09:59.473 --rc geninfo_all_blocks=1 00:09:59.473 --rc geninfo_unexecuted_blocks=1 00:09:59.473 00:09:59.473 ' 00:09:59.473 11:20:54 thread -- common/autotest_common.sh@1695 -- # export 'LCOV=lcov 00:09:59.473 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:09:59.473 --rc genhtml_branch_coverage=1 00:09:59.473 --rc genhtml_function_coverage=1 00:09:59.473 --rc genhtml_legend=1 00:09:59.473 --rc geninfo_all_blocks=1 00:09:59.473 --rc geninfo_unexecuted_blocks=1 00:09:59.473 00:09:59.473 ' 00:09:59.473 11:20:54 thread -- common/autotest_common.sh@1695 -- # LCOV='lcov 00:09:59.473 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:09:59.473 --rc genhtml_branch_coverage=1 00:09:59.473 --rc genhtml_function_coverage=1 00:09:59.473 --rc genhtml_legend=1 00:09:59.473 --rc geninfo_all_blocks=1 00:09:59.473 --rc geninfo_unexecuted_blocks=1 00:09:59.473 00:09:59.473 ' 00:09:59.473 11:20:54 thread -- thread/thread.sh@11 -- # run_test thread_poller_perf /home/vagrant/spdk_repo/spdk/test/thread/poller_perf/poller_perf -b 1000 -l 1 -t 1 00:09:59.473 11:20:54 thread -- common/autotest_common.sh@1101 -- # '[' 8 -le 1 ']' 00:09:59.473 11:20:54 thread -- common/autotest_common.sh@1107 -- # xtrace_disable 00:09:59.473 11:20:54 thread -- common/autotest_common.sh@10 -- # set +x 00:09:59.473 ************************************ 00:09:59.473 START TEST thread_poller_perf 00:09:59.473 ************************************ 00:09:59.473 11:20:54 thread.thread_poller_perf -- common/autotest_common.sh@1125 -- # /home/vagrant/spdk_repo/spdk/test/thread/poller_perf/poller_perf -b 1000 -l 1 -t 1 00:09:59.473 [2024-10-07 11:20:54.871947] Starting SPDK v25.01-pre git sha1 2a4f56c54 / DPDK 24.03.0 initialization... 00:09:59.473 [2024-10-07 11:20:54.872047] [ DPDK EAL parameters: poller_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --iova-mode=pa --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid61675 ] 00:09:59.732 [2024-10-07 11:20:55.008890] app.c: 917:spdk_app_start: *NOTICE*: Total cores available: 1 00:09:59.732 Running 1000 pollers for 1 seconds with 1 microseconds period. 00:09:59.732 [2024-10-07 11:20:55.140016] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 0 00:10:01.108 [2024-10-07T11:20:56.631Z] ====================================== 00:10:01.108 [2024-10-07T11:20:56.631Z] busy:2213600401 (cyc) 00:10:01.108 [2024-10-07T11:20:56.631Z] total_run_count: 303000 00:10:01.108 [2024-10-07T11:20:56.631Z] tsc_hz: 2200000000 (cyc) 00:10:01.108 [2024-10-07T11:20:56.631Z] ====================================== 00:10:01.108 [2024-10-07T11:20:56.631Z] poller_cost: 7305 (cyc), 3320 (nsec) 00:10:01.108 00:10:01.108 real 0m1.383s 00:10:01.108 user 0m1.220s 00:10:01.108 sys 0m0.055s 00:10:01.108 11:20:56 thread.thread_poller_perf -- common/autotest_common.sh@1126 -- # xtrace_disable 00:10:01.108 11:20:56 thread.thread_poller_perf -- common/autotest_common.sh@10 -- # set +x 00:10:01.108 ************************************ 00:10:01.108 END TEST thread_poller_perf 00:10:01.108 ************************************ 00:10:01.108 11:20:56 thread -- thread/thread.sh@12 -- # run_test thread_poller_perf /home/vagrant/spdk_repo/spdk/test/thread/poller_perf/poller_perf -b 1000 -l 0 -t 1 00:10:01.108 11:20:56 thread -- common/autotest_common.sh@1101 -- # '[' 8 -le 1 ']' 00:10:01.108 11:20:56 thread -- common/autotest_common.sh@1107 -- # xtrace_disable 00:10:01.108 11:20:56 thread -- common/autotest_common.sh@10 -- # set +x 00:10:01.108 ************************************ 00:10:01.108 START TEST thread_poller_perf 00:10:01.108 ************************************ 00:10:01.108 11:20:56 thread.thread_poller_perf -- common/autotest_common.sh@1125 -- # /home/vagrant/spdk_repo/spdk/test/thread/poller_perf/poller_perf -b 1000 -l 0 -t 1 00:10:01.108 [2024-10-07 11:20:56.307112] Starting SPDK v25.01-pre git sha1 2a4f56c54 / DPDK 24.03.0 initialization... 00:10:01.108 [2024-10-07 11:20:56.307223] [ DPDK EAL parameters: poller_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --iova-mode=pa --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid61718 ] 00:10:01.108 [2024-10-07 11:20:56.444323] app.c: 917:spdk_app_start: *NOTICE*: Total cores available: 1 00:10:01.109 Running 1000 pollers for 1 seconds with 0 microseconds period. 00:10:01.109 [2024-10-07 11:20:56.579101] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 0 00:10:02.485 [2024-10-07T11:20:58.008Z] ====================================== 00:10:02.485 [2024-10-07T11:20:58.008Z] busy:2202482872 (cyc) 00:10:02.485 [2024-10-07T11:20:58.008Z] total_run_count: 3889000 00:10:02.485 [2024-10-07T11:20:58.008Z] tsc_hz: 2200000000 (cyc) 00:10:02.485 [2024-10-07T11:20:58.008Z] ====================================== 00:10:02.485 [2024-10-07T11:20:58.008Z] poller_cost: 566 (cyc), 257 (nsec) 00:10:02.485 00:10:02.485 real 0m1.382s 00:10:02.485 user 0m1.212s 00:10:02.485 sys 0m0.062s 00:10:02.485 11:20:57 thread.thread_poller_perf -- common/autotest_common.sh@1126 -- # xtrace_disable 00:10:02.485 11:20:57 thread.thread_poller_perf -- common/autotest_common.sh@10 -- # set +x 00:10:02.485 ************************************ 00:10:02.485 END TEST thread_poller_perf 00:10:02.485 ************************************ 00:10:02.485 11:20:57 thread -- thread/thread.sh@17 -- # [[ y != \y ]] 00:10:02.485 00:10:02.485 real 0m3.060s 00:10:02.485 user 0m2.575s 00:10:02.485 sys 0m0.273s 00:10:02.485 11:20:57 thread -- common/autotest_common.sh@1126 -- # xtrace_disable 00:10:02.485 11:20:57 thread -- common/autotest_common.sh@10 -- # set +x 00:10:02.485 ************************************ 00:10:02.485 END TEST thread 00:10:02.485 ************************************ 00:10:02.485 11:20:57 -- spdk/autotest.sh@171 -- # [[ 0 -eq 1 ]] 00:10:02.485 11:20:57 -- spdk/autotest.sh@176 -- # run_test app_cmdline /home/vagrant/spdk_repo/spdk/test/app/cmdline.sh 00:10:02.485 11:20:57 -- common/autotest_common.sh@1101 -- # '[' 2 -le 1 ']' 00:10:02.485 11:20:57 -- common/autotest_common.sh@1107 -- # xtrace_disable 00:10:02.485 11:20:57 -- common/autotest_common.sh@10 -- # set +x 00:10:02.485 ************************************ 00:10:02.485 START TEST app_cmdline 00:10:02.485 ************************************ 00:10:02.485 11:20:57 app_cmdline -- common/autotest_common.sh@1125 -- # /home/vagrant/spdk_repo/spdk/test/app/cmdline.sh 00:10:02.485 * Looking for test storage... 00:10:02.485 * Found test storage at /home/vagrant/spdk_repo/spdk/test/app 00:10:02.485 11:20:57 app_cmdline -- common/autotest_common.sh@1680 -- # [[ y == y ]] 00:10:02.485 11:20:57 app_cmdline -- common/autotest_common.sh@1681 -- # awk '{print $NF}' 00:10:02.485 11:20:57 app_cmdline -- common/autotest_common.sh@1681 -- # lcov --version 00:10:02.485 11:20:57 app_cmdline -- common/autotest_common.sh@1681 -- # lt 1.15 2 00:10:02.485 11:20:57 app_cmdline -- scripts/common.sh@373 -- # cmp_versions 1.15 '<' 2 00:10:02.485 11:20:57 app_cmdline -- scripts/common.sh@333 -- # local ver1 ver1_l 00:10:02.485 11:20:57 app_cmdline -- scripts/common.sh@334 -- # local ver2 ver2_l 00:10:02.485 11:20:57 app_cmdline -- scripts/common.sh@336 -- # IFS=.-: 00:10:02.485 11:20:57 app_cmdline -- scripts/common.sh@336 -- # read -ra ver1 00:10:02.485 11:20:57 app_cmdline -- scripts/common.sh@337 -- # IFS=.-: 00:10:02.485 11:20:57 app_cmdline -- scripts/common.sh@337 -- # read -ra ver2 00:10:02.485 11:20:57 app_cmdline -- scripts/common.sh@338 -- # local 'op=<' 00:10:02.485 11:20:57 app_cmdline -- scripts/common.sh@340 -- # ver1_l=2 00:10:02.485 11:20:57 app_cmdline -- scripts/common.sh@341 -- # ver2_l=1 00:10:02.485 11:20:57 app_cmdline -- scripts/common.sh@343 -- # local lt=0 gt=0 eq=0 v 00:10:02.485 11:20:57 app_cmdline -- scripts/common.sh@344 -- # case "$op" in 00:10:02.485 11:20:57 app_cmdline -- scripts/common.sh@345 -- # : 1 00:10:02.485 11:20:57 app_cmdline -- scripts/common.sh@364 -- # (( v = 0 )) 00:10:02.485 11:20:57 app_cmdline -- scripts/common.sh@364 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:10:02.485 11:20:57 app_cmdline -- scripts/common.sh@365 -- # decimal 1 00:10:02.485 11:20:57 app_cmdline -- scripts/common.sh@353 -- # local d=1 00:10:02.485 11:20:57 app_cmdline -- scripts/common.sh@354 -- # [[ 1 =~ ^[0-9]+$ ]] 00:10:02.485 11:20:57 app_cmdline -- scripts/common.sh@355 -- # echo 1 00:10:02.485 11:20:57 app_cmdline -- scripts/common.sh@365 -- # ver1[v]=1 00:10:02.485 11:20:57 app_cmdline -- scripts/common.sh@366 -- # decimal 2 00:10:02.485 11:20:57 app_cmdline -- scripts/common.sh@353 -- # local d=2 00:10:02.485 11:20:57 app_cmdline -- scripts/common.sh@354 -- # [[ 2 =~ ^[0-9]+$ ]] 00:10:02.485 11:20:57 app_cmdline -- scripts/common.sh@355 -- # echo 2 00:10:02.485 11:20:57 app_cmdline -- scripts/common.sh@366 -- # ver2[v]=2 00:10:02.485 11:20:57 app_cmdline -- scripts/common.sh@367 -- # (( ver1[v] > ver2[v] )) 00:10:02.485 11:20:57 app_cmdline -- scripts/common.sh@368 -- # (( ver1[v] < ver2[v] )) 00:10:02.485 11:20:57 app_cmdline -- scripts/common.sh@368 -- # return 0 00:10:02.485 11:20:57 app_cmdline -- common/autotest_common.sh@1682 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:10:02.485 11:20:57 app_cmdline -- common/autotest_common.sh@1694 -- # export 'LCOV_OPTS= 00:10:02.485 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:10:02.485 --rc genhtml_branch_coverage=1 00:10:02.485 --rc genhtml_function_coverage=1 00:10:02.485 --rc genhtml_legend=1 00:10:02.485 --rc geninfo_all_blocks=1 00:10:02.485 --rc geninfo_unexecuted_blocks=1 00:10:02.485 00:10:02.485 ' 00:10:02.485 11:20:57 app_cmdline -- common/autotest_common.sh@1694 -- # LCOV_OPTS=' 00:10:02.485 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:10:02.485 --rc genhtml_branch_coverage=1 00:10:02.485 --rc genhtml_function_coverage=1 00:10:02.485 --rc genhtml_legend=1 00:10:02.485 --rc geninfo_all_blocks=1 00:10:02.485 --rc geninfo_unexecuted_blocks=1 00:10:02.485 00:10:02.485 ' 00:10:02.485 11:20:57 app_cmdline -- common/autotest_common.sh@1695 -- # export 'LCOV=lcov 00:10:02.485 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:10:02.485 --rc genhtml_branch_coverage=1 00:10:02.485 --rc genhtml_function_coverage=1 00:10:02.485 --rc genhtml_legend=1 00:10:02.485 --rc geninfo_all_blocks=1 00:10:02.485 --rc geninfo_unexecuted_blocks=1 00:10:02.485 00:10:02.485 ' 00:10:02.485 11:20:57 app_cmdline -- common/autotest_common.sh@1695 -- # LCOV='lcov 00:10:02.485 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:10:02.485 --rc genhtml_branch_coverage=1 00:10:02.485 --rc genhtml_function_coverage=1 00:10:02.485 --rc genhtml_legend=1 00:10:02.485 --rc geninfo_all_blocks=1 00:10:02.485 --rc geninfo_unexecuted_blocks=1 00:10:02.485 00:10:02.485 ' 00:10:02.485 11:20:57 app_cmdline -- app/cmdline.sh@14 -- # trap 'killprocess $spdk_tgt_pid' EXIT 00:10:02.485 11:20:57 app_cmdline -- app/cmdline.sh@17 -- # spdk_tgt_pid=61795 00:10:02.485 11:20:57 app_cmdline -- app/cmdline.sh@16 -- # /home/vagrant/spdk_repo/spdk/build/bin/spdk_tgt --rpcs-allowed spdk_get_version,rpc_get_methods 00:10:02.485 11:20:57 app_cmdline -- app/cmdline.sh@18 -- # waitforlisten 61795 00:10:02.485 11:20:57 app_cmdline -- common/autotest_common.sh@831 -- # '[' -z 61795 ']' 00:10:02.485 11:20:57 app_cmdline -- common/autotest_common.sh@835 -- # local rpc_addr=/var/tmp/spdk.sock 00:10:02.485 11:20:57 app_cmdline -- common/autotest_common.sh@836 -- # local max_retries=100 00:10:02.485 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:10:02.485 11:20:57 app_cmdline -- common/autotest_common.sh@838 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:10:02.485 11:20:57 app_cmdline -- common/autotest_common.sh@840 -- # xtrace_disable 00:10:02.485 11:20:57 app_cmdline -- common/autotest_common.sh@10 -- # set +x 00:10:02.744 [2024-10-07 11:20:58.028605] Starting SPDK v25.01-pre git sha1 2a4f56c54 / DPDK 24.03.0 initialization... 00:10:02.744 [2024-10-07 11:20:58.028764] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --iova-mode=pa --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid61795 ] 00:10:02.744 [2024-10-07 11:20:58.173738] app.c: 917:spdk_app_start: *NOTICE*: Total cores available: 1 00:10:03.002 [2024-10-07 11:20:58.307957] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 0 00:10:03.616 11:20:59 app_cmdline -- common/autotest_common.sh@860 -- # (( i == 0 )) 00:10:03.616 11:20:59 app_cmdline -- common/autotest_common.sh@864 -- # return 0 00:10:03.616 11:20:59 app_cmdline -- app/cmdline.sh@20 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py spdk_get_version 00:10:04.184 { 00:10:04.184 "fields": { 00:10:04.184 "commit": "2a4f56c54", 00:10:04.184 "major": 25, 00:10:04.184 "minor": 1, 00:10:04.184 "patch": 0, 00:10:04.184 "suffix": "-pre" 00:10:04.184 }, 00:10:04.184 "version": "SPDK v25.01-pre git sha1 2a4f56c54" 00:10:04.184 } 00:10:04.184 11:20:59 app_cmdline -- app/cmdline.sh@22 -- # expected_methods=() 00:10:04.184 11:20:59 app_cmdline -- app/cmdline.sh@23 -- # expected_methods+=("rpc_get_methods") 00:10:04.184 11:20:59 app_cmdline -- app/cmdline.sh@24 -- # expected_methods+=("spdk_get_version") 00:10:04.184 11:20:59 app_cmdline -- app/cmdline.sh@26 -- # methods=($(rpc_cmd rpc_get_methods | jq -r ".[]" | sort)) 00:10:04.184 11:20:59 app_cmdline -- app/cmdline.sh@26 -- # rpc_cmd rpc_get_methods 00:10:04.184 11:20:59 app_cmdline -- app/cmdline.sh@26 -- # jq -r '.[]' 00:10:04.184 11:20:59 app_cmdline -- common/autotest_common.sh@561 -- # xtrace_disable 00:10:04.184 11:20:59 app_cmdline -- common/autotest_common.sh@10 -- # set +x 00:10:04.184 11:20:59 app_cmdline -- app/cmdline.sh@26 -- # sort 00:10:04.184 11:20:59 app_cmdline -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:10:04.184 11:20:59 app_cmdline -- app/cmdline.sh@27 -- # (( 2 == 2 )) 00:10:04.184 11:20:59 app_cmdline -- app/cmdline.sh@28 -- # [[ rpc_get_methods spdk_get_version == \r\p\c\_\g\e\t\_\m\e\t\h\o\d\s\ \s\p\d\k\_\g\e\t\_\v\e\r\s\i\o\n ]] 00:10:04.184 11:20:59 app_cmdline -- app/cmdline.sh@30 -- # NOT /home/vagrant/spdk_repo/spdk/scripts/rpc.py env_dpdk_get_mem_stats 00:10:04.184 11:20:59 app_cmdline -- common/autotest_common.sh@650 -- # local es=0 00:10:04.184 11:20:59 app_cmdline -- common/autotest_common.sh@652 -- # valid_exec_arg /home/vagrant/spdk_repo/spdk/scripts/rpc.py env_dpdk_get_mem_stats 00:10:04.184 11:20:59 app_cmdline -- common/autotest_common.sh@638 -- # local arg=/home/vagrant/spdk_repo/spdk/scripts/rpc.py 00:10:04.184 11:20:59 app_cmdline -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:10:04.184 11:20:59 app_cmdline -- common/autotest_common.sh@642 -- # type -t /home/vagrant/spdk_repo/spdk/scripts/rpc.py 00:10:04.184 11:20:59 app_cmdline -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:10:04.184 11:20:59 app_cmdline -- common/autotest_common.sh@644 -- # type -P /home/vagrant/spdk_repo/spdk/scripts/rpc.py 00:10:04.184 11:20:59 app_cmdline -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:10:04.184 11:20:59 app_cmdline -- common/autotest_common.sh@644 -- # arg=/home/vagrant/spdk_repo/spdk/scripts/rpc.py 00:10:04.184 11:20:59 app_cmdline -- common/autotest_common.sh@644 -- # [[ -x /home/vagrant/spdk_repo/spdk/scripts/rpc.py ]] 00:10:04.184 11:20:59 app_cmdline -- common/autotest_common.sh@653 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py env_dpdk_get_mem_stats 00:10:04.443 2024/10/07 11:20:59 error on JSON-RPC call, method: env_dpdk_get_mem_stats, params: map[], err: error received for env_dpdk_get_mem_stats method, err: Code=-32601 Msg=Method not found 00:10:04.443 request: 00:10:04.443 { 00:10:04.443 "method": "env_dpdk_get_mem_stats", 00:10:04.443 "params": {} 00:10:04.443 } 00:10:04.443 Got JSON-RPC error response 00:10:04.443 GoRPCClient: error on JSON-RPC call 00:10:04.443 11:20:59 app_cmdline -- common/autotest_common.sh@653 -- # es=1 00:10:04.443 11:20:59 app_cmdline -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:10:04.443 11:20:59 app_cmdline -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:10:04.443 11:20:59 app_cmdline -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:10:04.443 11:20:59 app_cmdline -- app/cmdline.sh@1 -- # killprocess 61795 00:10:04.444 11:20:59 app_cmdline -- common/autotest_common.sh@950 -- # '[' -z 61795 ']' 00:10:04.444 11:20:59 app_cmdline -- common/autotest_common.sh@954 -- # kill -0 61795 00:10:04.444 11:20:59 app_cmdline -- common/autotest_common.sh@955 -- # uname 00:10:04.444 11:20:59 app_cmdline -- common/autotest_common.sh@955 -- # '[' Linux = Linux ']' 00:10:04.444 11:20:59 app_cmdline -- common/autotest_common.sh@956 -- # ps --no-headers -o comm= 61795 00:10:04.444 killing process with pid 61795 00:10:04.444 11:20:59 app_cmdline -- common/autotest_common.sh@956 -- # process_name=reactor_0 00:10:04.444 11:20:59 app_cmdline -- common/autotest_common.sh@960 -- # '[' reactor_0 = sudo ']' 00:10:04.444 11:20:59 app_cmdline -- common/autotest_common.sh@968 -- # echo 'killing process with pid 61795' 00:10:04.444 11:20:59 app_cmdline -- common/autotest_common.sh@969 -- # kill 61795 00:10:04.444 11:20:59 app_cmdline -- common/autotest_common.sh@974 -- # wait 61795 00:10:05.012 00:10:05.012 real 0m2.541s 00:10:05.012 user 0m3.251s 00:10:05.012 sys 0m0.580s 00:10:05.012 11:21:00 app_cmdline -- common/autotest_common.sh@1126 -- # xtrace_disable 00:10:05.012 11:21:00 app_cmdline -- common/autotest_common.sh@10 -- # set +x 00:10:05.012 ************************************ 00:10:05.012 END TEST app_cmdline 00:10:05.012 ************************************ 00:10:05.012 11:21:00 -- spdk/autotest.sh@177 -- # run_test version /home/vagrant/spdk_repo/spdk/test/app/version.sh 00:10:05.012 11:21:00 -- common/autotest_common.sh@1101 -- # '[' 2 -le 1 ']' 00:10:05.012 11:21:00 -- common/autotest_common.sh@1107 -- # xtrace_disable 00:10:05.012 11:21:00 -- common/autotest_common.sh@10 -- # set +x 00:10:05.012 ************************************ 00:10:05.012 START TEST version 00:10:05.012 ************************************ 00:10:05.012 11:21:00 version -- common/autotest_common.sh@1125 -- # /home/vagrant/spdk_repo/spdk/test/app/version.sh 00:10:05.012 * Looking for test storage... 00:10:05.012 * Found test storage at /home/vagrant/spdk_repo/spdk/test/app 00:10:05.012 11:21:00 version -- common/autotest_common.sh@1680 -- # [[ y == y ]] 00:10:05.012 11:21:00 version -- common/autotest_common.sh@1681 -- # awk '{print $NF}' 00:10:05.012 11:21:00 version -- common/autotest_common.sh@1681 -- # lcov --version 00:10:05.012 11:21:00 version -- common/autotest_common.sh@1681 -- # lt 1.15 2 00:10:05.012 11:21:00 version -- scripts/common.sh@373 -- # cmp_versions 1.15 '<' 2 00:10:05.012 11:21:00 version -- scripts/common.sh@333 -- # local ver1 ver1_l 00:10:05.012 11:21:00 version -- scripts/common.sh@334 -- # local ver2 ver2_l 00:10:05.012 11:21:00 version -- scripts/common.sh@336 -- # IFS=.-: 00:10:05.012 11:21:00 version -- scripts/common.sh@336 -- # read -ra ver1 00:10:05.012 11:21:00 version -- scripts/common.sh@337 -- # IFS=.-: 00:10:05.012 11:21:00 version -- scripts/common.sh@337 -- # read -ra ver2 00:10:05.012 11:21:00 version -- scripts/common.sh@338 -- # local 'op=<' 00:10:05.012 11:21:00 version -- scripts/common.sh@340 -- # ver1_l=2 00:10:05.012 11:21:00 version -- scripts/common.sh@341 -- # ver2_l=1 00:10:05.012 11:21:00 version -- scripts/common.sh@343 -- # local lt=0 gt=0 eq=0 v 00:10:05.012 11:21:00 version -- scripts/common.sh@344 -- # case "$op" in 00:10:05.012 11:21:00 version -- scripts/common.sh@345 -- # : 1 00:10:05.012 11:21:00 version -- scripts/common.sh@364 -- # (( v = 0 )) 00:10:05.012 11:21:00 version -- scripts/common.sh@364 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:10:05.012 11:21:00 version -- scripts/common.sh@365 -- # decimal 1 00:10:05.012 11:21:00 version -- scripts/common.sh@353 -- # local d=1 00:10:05.012 11:21:00 version -- scripts/common.sh@354 -- # [[ 1 =~ ^[0-9]+$ ]] 00:10:05.012 11:21:00 version -- scripts/common.sh@355 -- # echo 1 00:10:05.012 11:21:00 version -- scripts/common.sh@365 -- # ver1[v]=1 00:10:05.012 11:21:00 version -- scripts/common.sh@366 -- # decimal 2 00:10:05.012 11:21:00 version -- scripts/common.sh@353 -- # local d=2 00:10:05.012 11:21:00 version -- scripts/common.sh@354 -- # [[ 2 =~ ^[0-9]+$ ]] 00:10:05.012 11:21:00 version -- scripts/common.sh@355 -- # echo 2 00:10:05.271 11:21:00 version -- scripts/common.sh@366 -- # ver2[v]=2 00:10:05.271 11:21:00 version -- scripts/common.sh@367 -- # (( ver1[v] > ver2[v] )) 00:10:05.271 11:21:00 version -- scripts/common.sh@368 -- # (( ver1[v] < ver2[v] )) 00:10:05.271 11:21:00 version -- scripts/common.sh@368 -- # return 0 00:10:05.271 11:21:00 version -- common/autotest_common.sh@1682 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:10:05.271 11:21:00 version -- common/autotest_common.sh@1694 -- # export 'LCOV_OPTS= 00:10:05.271 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:10:05.271 --rc genhtml_branch_coverage=1 00:10:05.271 --rc genhtml_function_coverage=1 00:10:05.271 --rc genhtml_legend=1 00:10:05.272 --rc geninfo_all_blocks=1 00:10:05.272 --rc geninfo_unexecuted_blocks=1 00:10:05.272 00:10:05.272 ' 00:10:05.272 11:21:00 version -- common/autotest_common.sh@1694 -- # LCOV_OPTS=' 00:10:05.272 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:10:05.272 --rc genhtml_branch_coverage=1 00:10:05.272 --rc genhtml_function_coverage=1 00:10:05.272 --rc genhtml_legend=1 00:10:05.272 --rc geninfo_all_blocks=1 00:10:05.272 --rc geninfo_unexecuted_blocks=1 00:10:05.272 00:10:05.272 ' 00:10:05.272 11:21:00 version -- common/autotest_common.sh@1695 -- # export 'LCOV=lcov 00:10:05.272 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:10:05.272 --rc genhtml_branch_coverage=1 00:10:05.272 --rc genhtml_function_coverage=1 00:10:05.272 --rc genhtml_legend=1 00:10:05.272 --rc geninfo_all_blocks=1 00:10:05.272 --rc geninfo_unexecuted_blocks=1 00:10:05.272 00:10:05.272 ' 00:10:05.272 11:21:00 version -- common/autotest_common.sh@1695 -- # LCOV='lcov 00:10:05.272 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:10:05.272 --rc genhtml_branch_coverage=1 00:10:05.272 --rc genhtml_function_coverage=1 00:10:05.272 --rc genhtml_legend=1 00:10:05.272 --rc geninfo_all_blocks=1 00:10:05.272 --rc geninfo_unexecuted_blocks=1 00:10:05.272 00:10:05.272 ' 00:10:05.272 11:21:00 version -- app/version.sh@17 -- # get_header_version major 00:10:05.272 11:21:00 version -- app/version.sh@14 -- # cut -f2 00:10:05.272 11:21:00 version -- app/version.sh@13 -- # grep -E '^#define SPDK_VERSION_MAJOR[[:space:]]+' /home/vagrant/spdk_repo/spdk/include/spdk/version.h 00:10:05.272 11:21:00 version -- app/version.sh@14 -- # tr -d '"' 00:10:05.272 11:21:00 version -- app/version.sh@17 -- # major=25 00:10:05.272 11:21:00 version -- app/version.sh@18 -- # get_header_version minor 00:10:05.272 11:21:00 version -- app/version.sh@14 -- # cut -f2 00:10:05.272 11:21:00 version -- app/version.sh@13 -- # grep -E '^#define SPDK_VERSION_MINOR[[:space:]]+' /home/vagrant/spdk_repo/spdk/include/spdk/version.h 00:10:05.272 11:21:00 version -- app/version.sh@14 -- # tr -d '"' 00:10:05.272 11:21:00 version -- app/version.sh@18 -- # minor=1 00:10:05.272 11:21:00 version -- app/version.sh@19 -- # get_header_version patch 00:10:05.272 11:21:00 version -- app/version.sh@13 -- # grep -E '^#define SPDK_VERSION_PATCH[[:space:]]+' /home/vagrant/spdk_repo/spdk/include/spdk/version.h 00:10:05.272 11:21:00 version -- app/version.sh@14 -- # cut -f2 00:10:05.272 11:21:00 version -- app/version.sh@14 -- # tr -d '"' 00:10:05.272 11:21:00 version -- app/version.sh@19 -- # patch=0 00:10:05.272 11:21:00 version -- app/version.sh@20 -- # get_header_version suffix 00:10:05.272 11:21:00 version -- app/version.sh@14 -- # cut -f2 00:10:05.272 11:21:00 version -- app/version.sh@13 -- # grep -E '^#define SPDK_VERSION_SUFFIX[[:space:]]+' /home/vagrant/spdk_repo/spdk/include/spdk/version.h 00:10:05.272 11:21:00 version -- app/version.sh@14 -- # tr -d '"' 00:10:05.272 11:21:00 version -- app/version.sh@20 -- # suffix=-pre 00:10:05.272 11:21:00 version -- app/version.sh@22 -- # version=25.1 00:10:05.272 11:21:00 version -- app/version.sh@25 -- # (( patch != 0 )) 00:10:05.272 11:21:00 version -- app/version.sh@28 -- # version=25.1rc0 00:10:05.272 11:21:00 version -- app/version.sh@30 -- # PYTHONPATH=:/home/vagrant/spdk_repo/spdk/python:/home/vagrant/spdk_repo/spdk/test/rpc_plugins:/home/vagrant/spdk_repo/spdk/python:/home/vagrant/spdk_repo/spdk/test/rpc_plugins:/home/vagrant/spdk_repo/spdk/python 00:10:05.272 11:21:00 version -- app/version.sh@30 -- # python3 -c 'import spdk; print(spdk.__version__)' 00:10:05.272 11:21:00 version -- app/version.sh@30 -- # py_version=25.1rc0 00:10:05.272 11:21:00 version -- app/version.sh@31 -- # [[ 25.1rc0 == \2\5\.\1\r\c\0 ]] 00:10:05.272 00:10:05.272 real 0m0.254s 00:10:05.272 user 0m0.162s 00:10:05.272 sys 0m0.127s 00:10:05.272 11:21:00 version -- common/autotest_common.sh@1126 -- # xtrace_disable 00:10:05.272 11:21:00 version -- common/autotest_common.sh@10 -- # set +x 00:10:05.272 ************************************ 00:10:05.272 END TEST version 00:10:05.272 ************************************ 00:10:05.272 11:21:00 -- spdk/autotest.sh@179 -- # '[' 0 -eq 1 ']' 00:10:05.272 11:21:00 -- spdk/autotest.sh@188 -- # [[ 0 -eq 1 ]] 00:10:05.272 11:21:00 -- spdk/autotest.sh@194 -- # uname -s 00:10:05.272 11:21:00 -- spdk/autotest.sh@194 -- # [[ Linux == Linux ]] 00:10:05.272 11:21:00 -- spdk/autotest.sh@195 -- # [[ 0 -eq 1 ]] 00:10:05.272 11:21:00 -- spdk/autotest.sh@195 -- # [[ 0 -eq 1 ]] 00:10:05.272 11:21:00 -- spdk/autotest.sh@207 -- # '[' 0 -eq 1 ']' 00:10:05.272 11:21:00 -- spdk/autotest.sh@252 -- # '[' 0 -eq 1 ']' 00:10:05.272 11:21:00 -- spdk/autotest.sh@256 -- # timing_exit lib 00:10:05.272 11:21:00 -- common/autotest_common.sh@730 -- # xtrace_disable 00:10:05.272 11:21:00 -- common/autotest_common.sh@10 -- # set +x 00:10:05.272 11:21:00 -- spdk/autotest.sh@258 -- # '[' 0 -eq 1 ']' 00:10:05.272 11:21:00 -- spdk/autotest.sh@263 -- # '[' 0 -eq 1 ']' 00:10:05.272 11:21:00 -- spdk/autotest.sh@272 -- # '[' 1 -eq 1 ']' 00:10:05.272 11:21:00 -- spdk/autotest.sh@273 -- # export NET_TYPE 00:10:05.272 11:21:00 -- spdk/autotest.sh@276 -- # '[' tcp = rdma ']' 00:10:05.272 11:21:00 -- spdk/autotest.sh@279 -- # '[' tcp = tcp ']' 00:10:05.272 11:21:00 -- spdk/autotest.sh@280 -- # run_test nvmf_tcp /home/vagrant/spdk_repo/spdk/test/nvmf/nvmf.sh --transport=tcp 00:10:05.272 11:21:00 -- common/autotest_common.sh@1101 -- # '[' 3 -le 1 ']' 00:10:05.272 11:21:00 -- common/autotest_common.sh@1107 -- # xtrace_disable 00:10:05.272 11:21:00 -- common/autotest_common.sh@10 -- # set +x 00:10:05.272 ************************************ 00:10:05.272 START TEST nvmf_tcp 00:10:05.272 ************************************ 00:10:05.272 11:21:00 nvmf_tcp -- common/autotest_common.sh@1125 -- # /home/vagrant/spdk_repo/spdk/test/nvmf/nvmf.sh --transport=tcp 00:10:05.272 * Looking for test storage... 00:10:05.272 * Found test storage at /home/vagrant/spdk_repo/spdk/test/nvmf 00:10:05.272 11:21:00 nvmf_tcp -- common/autotest_common.sh@1680 -- # [[ y == y ]] 00:10:05.272 11:21:00 nvmf_tcp -- common/autotest_common.sh@1681 -- # lcov --version 00:10:05.272 11:21:00 nvmf_tcp -- common/autotest_common.sh@1681 -- # awk '{print $NF}' 00:10:05.532 11:21:00 nvmf_tcp -- common/autotest_common.sh@1681 -- # lt 1.15 2 00:10:05.532 11:21:00 nvmf_tcp -- scripts/common.sh@373 -- # cmp_versions 1.15 '<' 2 00:10:05.532 11:21:00 nvmf_tcp -- scripts/common.sh@333 -- # local ver1 ver1_l 00:10:05.532 11:21:00 nvmf_tcp -- scripts/common.sh@334 -- # local ver2 ver2_l 00:10:05.532 11:21:00 nvmf_tcp -- scripts/common.sh@336 -- # IFS=.-: 00:10:05.532 11:21:00 nvmf_tcp -- scripts/common.sh@336 -- # read -ra ver1 00:10:05.532 11:21:00 nvmf_tcp -- scripts/common.sh@337 -- # IFS=.-: 00:10:05.532 11:21:00 nvmf_tcp -- scripts/common.sh@337 -- # read -ra ver2 00:10:05.532 11:21:00 nvmf_tcp -- scripts/common.sh@338 -- # local 'op=<' 00:10:05.532 11:21:00 nvmf_tcp -- scripts/common.sh@340 -- # ver1_l=2 00:10:05.532 11:21:00 nvmf_tcp -- scripts/common.sh@341 -- # ver2_l=1 00:10:05.532 11:21:00 nvmf_tcp -- scripts/common.sh@343 -- # local lt=0 gt=0 eq=0 v 00:10:05.532 11:21:00 nvmf_tcp -- scripts/common.sh@344 -- # case "$op" in 00:10:05.532 11:21:00 nvmf_tcp -- scripts/common.sh@345 -- # : 1 00:10:05.532 11:21:00 nvmf_tcp -- scripts/common.sh@364 -- # (( v = 0 )) 00:10:05.532 11:21:00 nvmf_tcp -- scripts/common.sh@364 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:10:05.532 11:21:00 nvmf_tcp -- scripts/common.sh@365 -- # decimal 1 00:10:05.532 11:21:00 nvmf_tcp -- scripts/common.sh@353 -- # local d=1 00:10:05.532 11:21:00 nvmf_tcp -- scripts/common.sh@354 -- # [[ 1 =~ ^[0-9]+$ ]] 00:10:05.532 11:21:00 nvmf_tcp -- scripts/common.sh@355 -- # echo 1 00:10:05.532 11:21:00 nvmf_tcp -- scripts/common.sh@365 -- # ver1[v]=1 00:10:05.532 11:21:00 nvmf_tcp -- scripts/common.sh@366 -- # decimal 2 00:10:05.532 11:21:00 nvmf_tcp -- scripts/common.sh@353 -- # local d=2 00:10:05.532 11:21:00 nvmf_tcp -- scripts/common.sh@354 -- # [[ 2 =~ ^[0-9]+$ ]] 00:10:05.532 11:21:00 nvmf_tcp -- scripts/common.sh@355 -- # echo 2 00:10:05.532 11:21:00 nvmf_tcp -- scripts/common.sh@366 -- # ver2[v]=2 00:10:05.532 11:21:00 nvmf_tcp -- scripts/common.sh@367 -- # (( ver1[v] > ver2[v] )) 00:10:05.532 11:21:00 nvmf_tcp -- scripts/common.sh@368 -- # (( ver1[v] < ver2[v] )) 00:10:05.532 11:21:00 nvmf_tcp -- scripts/common.sh@368 -- # return 0 00:10:05.532 11:21:00 nvmf_tcp -- common/autotest_common.sh@1682 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:10:05.532 11:21:00 nvmf_tcp -- common/autotest_common.sh@1694 -- # export 'LCOV_OPTS= 00:10:05.532 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:10:05.532 --rc genhtml_branch_coverage=1 00:10:05.532 --rc genhtml_function_coverage=1 00:10:05.532 --rc genhtml_legend=1 00:10:05.532 --rc geninfo_all_blocks=1 00:10:05.532 --rc geninfo_unexecuted_blocks=1 00:10:05.532 00:10:05.532 ' 00:10:05.532 11:21:00 nvmf_tcp -- common/autotest_common.sh@1694 -- # LCOV_OPTS=' 00:10:05.532 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:10:05.532 --rc genhtml_branch_coverage=1 00:10:05.532 --rc genhtml_function_coverage=1 00:10:05.532 --rc genhtml_legend=1 00:10:05.532 --rc geninfo_all_blocks=1 00:10:05.532 --rc geninfo_unexecuted_blocks=1 00:10:05.532 00:10:05.532 ' 00:10:05.532 11:21:00 nvmf_tcp -- common/autotest_common.sh@1695 -- # export 'LCOV=lcov 00:10:05.532 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:10:05.532 --rc genhtml_branch_coverage=1 00:10:05.532 --rc genhtml_function_coverage=1 00:10:05.532 --rc genhtml_legend=1 00:10:05.532 --rc geninfo_all_blocks=1 00:10:05.532 --rc geninfo_unexecuted_blocks=1 00:10:05.532 00:10:05.532 ' 00:10:05.532 11:21:00 nvmf_tcp -- common/autotest_common.sh@1695 -- # LCOV='lcov 00:10:05.532 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:10:05.532 --rc genhtml_branch_coverage=1 00:10:05.532 --rc genhtml_function_coverage=1 00:10:05.532 --rc genhtml_legend=1 00:10:05.532 --rc geninfo_all_blocks=1 00:10:05.532 --rc geninfo_unexecuted_blocks=1 00:10:05.532 00:10:05.532 ' 00:10:05.532 11:21:00 nvmf_tcp -- nvmf/nvmf.sh@10 -- # uname -s 00:10:05.532 11:21:00 nvmf_tcp -- nvmf/nvmf.sh@10 -- # '[' '!' Linux = Linux ']' 00:10:05.532 11:21:00 nvmf_tcp -- nvmf/nvmf.sh@14 -- # run_test nvmf_target_core /home/vagrant/spdk_repo/spdk/test/nvmf/nvmf_target_core.sh --transport=tcp 00:10:05.532 11:21:00 nvmf_tcp -- common/autotest_common.sh@1101 -- # '[' 3 -le 1 ']' 00:10:05.532 11:21:00 nvmf_tcp -- common/autotest_common.sh@1107 -- # xtrace_disable 00:10:05.532 11:21:00 nvmf_tcp -- common/autotest_common.sh@10 -- # set +x 00:10:05.532 ************************************ 00:10:05.532 START TEST nvmf_target_core 00:10:05.532 ************************************ 00:10:05.532 11:21:00 nvmf_tcp.nvmf_target_core -- common/autotest_common.sh@1125 -- # /home/vagrant/spdk_repo/spdk/test/nvmf/nvmf_target_core.sh --transport=tcp 00:10:05.532 * Looking for test storage... 00:10:05.532 * Found test storage at /home/vagrant/spdk_repo/spdk/test/nvmf 00:10:05.532 11:21:00 nvmf_tcp.nvmf_target_core -- common/autotest_common.sh@1680 -- # [[ y == y ]] 00:10:05.532 11:21:00 nvmf_tcp.nvmf_target_core -- common/autotest_common.sh@1681 -- # lcov --version 00:10:05.532 11:21:00 nvmf_tcp.nvmf_target_core -- common/autotest_common.sh@1681 -- # awk '{print $NF}' 00:10:05.791 11:21:01 nvmf_tcp.nvmf_target_core -- common/autotest_common.sh@1681 -- # lt 1.15 2 00:10:05.791 11:21:01 nvmf_tcp.nvmf_target_core -- scripts/common.sh@373 -- # cmp_versions 1.15 '<' 2 00:10:05.791 11:21:01 nvmf_tcp.nvmf_target_core -- scripts/common.sh@333 -- # local ver1 ver1_l 00:10:05.791 11:21:01 nvmf_tcp.nvmf_target_core -- scripts/common.sh@334 -- # local ver2 ver2_l 00:10:05.791 11:21:01 nvmf_tcp.nvmf_target_core -- scripts/common.sh@336 -- # IFS=.-: 00:10:05.791 11:21:01 nvmf_tcp.nvmf_target_core -- scripts/common.sh@336 -- # read -ra ver1 00:10:05.791 11:21:01 nvmf_tcp.nvmf_target_core -- scripts/common.sh@337 -- # IFS=.-: 00:10:05.791 11:21:01 nvmf_tcp.nvmf_target_core -- scripts/common.sh@337 -- # read -ra ver2 00:10:05.791 11:21:01 nvmf_tcp.nvmf_target_core -- scripts/common.sh@338 -- # local 'op=<' 00:10:05.791 11:21:01 nvmf_tcp.nvmf_target_core -- scripts/common.sh@340 -- # ver1_l=2 00:10:05.791 11:21:01 nvmf_tcp.nvmf_target_core -- scripts/common.sh@341 -- # ver2_l=1 00:10:05.791 11:21:01 nvmf_tcp.nvmf_target_core -- scripts/common.sh@343 -- # local lt=0 gt=0 eq=0 v 00:10:05.791 11:21:01 nvmf_tcp.nvmf_target_core -- scripts/common.sh@344 -- # case "$op" in 00:10:05.791 11:21:01 nvmf_tcp.nvmf_target_core -- scripts/common.sh@345 -- # : 1 00:10:05.791 11:21:01 nvmf_tcp.nvmf_target_core -- scripts/common.sh@364 -- # (( v = 0 )) 00:10:05.791 11:21:01 nvmf_tcp.nvmf_target_core -- scripts/common.sh@364 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:10:05.791 11:21:01 nvmf_tcp.nvmf_target_core -- scripts/common.sh@365 -- # decimal 1 00:10:05.791 11:21:01 nvmf_tcp.nvmf_target_core -- scripts/common.sh@353 -- # local d=1 00:10:05.791 11:21:01 nvmf_tcp.nvmf_target_core -- scripts/common.sh@354 -- # [[ 1 =~ ^[0-9]+$ ]] 00:10:05.791 11:21:01 nvmf_tcp.nvmf_target_core -- scripts/common.sh@355 -- # echo 1 00:10:05.791 11:21:01 nvmf_tcp.nvmf_target_core -- scripts/common.sh@365 -- # ver1[v]=1 00:10:05.791 11:21:01 nvmf_tcp.nvmf_target_core -- scripts/common.sh@366 -- # decimal 2 00:10:05.791 11:21:01 nvmf_tcp.nvmf_target_core -- scripts/common.sh@353 -- # local d=2 00:10:05.791 11:21:01 nvmf_tcp.nvmf_target_core -- scripts/common.sh@354 -- # [[ 2 =~ ^[0-9]+$ ]] 00:10:05.791 11:21:01 nvmf_tcp.nvmf_target_core -- scripts/common.sh@355 -- # echo 2 00:10:05.791 11:21:01 nvmf_tcp.nvmf_target_core -- scripts/common.sh@366 -- # ver2[v]=2 00:10:05.791 11:21:01 nvmf_tcp.nvmf_target_core -- scripts/common.sh@367 -- # (( ver1[v] > ver2[v] )) 00:10:05.791 11:21:01 nvmf_tcp.nvmf_target_core -- scripts/common.sh@368 -- # (( ver1[v] < ver2[v] )) 00:10:05.791 11:21:01 nvmf_tcp.nvmf_target_core -- scripts/common.sh@368 -- # return 0 00:10:05.791 11:21:01 nvmf_tcp.nvmf_target_core -- common/autotest_common.sh@1682 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:10:05.791 11:21:01 nvmf_tcp.nvmf_target_core -- common/autotest_common.sh@1694 -- # export 'LCOV_OPTS= 00:10:05.791 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:10:05.791 --rc genhtml_branch_coverage=1 00:10:05.791 --rc genhtml_function_coverage=1 00:10:05.791 --rc genhtml_legend=1 00:10:05.791 --rc geninfo_all_blocks=1 00:10:05.791 --rc geninfo_unexecuted_blocks=1 00:10:05.791 00:10:05.791 ' 00:10:05.791 11:21:01 nvmf_tcp.nvmf_target_core -- common/autotest_common.sh@1694 -- # LCOV_OPTS=' 00:10:05.791 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:10:05.791 --rc genhtml_branch_coverage=1 00:10:05.791 --rc genhtml_function_coverage=1 00:10:05.791 --rc genhtml_legend=1 00:10:05.791 --rc geninfo_all_blocks=1 00:10:05.791 --rc geninfo_unexecuted_blocks=1 00:10:05.791 00:10:05.791 ' 00:10:05.791 11:21:01 nvmf_tcp.nvmf_target_core -- common/autotest_common.sh@1695 -- # export 'LCOV=lcov 00:10:05.791 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:10:05.791 --rc genhtml_branch_coverage=1 00:10:05.791 --rc genhtml_function_coverage=1 00:10:05.791 --rc genhtml_legend=1 00:10:05.791 --rc geninfo_all_blocks=1 00:10:05.791 --rc geninfo_unexecuted_blocks=1 00:10:05.791 00:10:05.791 ' 00:10:05.791 11:21:01 nvmf_tcp.nvmf_target_core -- common/autotest_common.sh@1695 -- # LCOV='lcov 00:10:05.791 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:10:05.791 --rc genhtml_branch_coverage=1 00:10:05.791 --rc genhtml_function_coverage=1 00:10:05.791 --rc genhtml_legend=1 00:10:05.791 --rc geninfo_all_blocks=1 00:10:05.791 --rc geninfo_unexecuted_blocks=1 00:10:05.791 00:10:05.791 ' 00:10:05.791 11:21:01 nvmf_tcp.nvmf_target_core -- nvmf/nvmf_target_core.sh@10 -- # uname -s 00:10:05.791 11:21:01 nvmf_tcp.nvmf_target_core -- nvmf/nvmf_target_core.sh@10 -- # '[' '!' Linux = Linux ']' 00:10:05.791 11:21:01 nvmf_tcp.nvmf_target_core -- nvmf/nvmf_target_core.sh@14 -- # source /home/vagrant/spdk_repo/spdk/test/nvmf/common.sh 00:10:05.791 11:21:01 nvmf_tcp.nvmf_target_core -- nvmf/common.sh@7 -- # uname -s 00:10:05.791 11:21:01 nvmf_tcp.nvmf_target_core -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:10:05.791 11:21:01 nvmf_tcp.nvmf_target_core -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:10:05.791 11:21:01 nvmf_tcp.nvmf_target_core -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:10:05.791 11:21:01 nvmf_tcp.nvmf_target_core -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:10:05.792 11:21:01 nvmf_tcp.nvmf_target_core -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:10:05.792 11:21:01 nvmf_tcp.nvmf_target_core -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:10:05.792 11:21:01 nvmf_tcp.nvmf_target_core -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:10:05.792 11:21:01 nvmf_tcp.nvmf_target_core -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:10:05.792 11:21:01 nvmf_tcp.nvmf_target_core -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:10:05.792 11:21:01 nvmf_tcp.nvmf_target_core -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:10:05.792 11:21:01 nvmf_tcp.nvmf_target_core -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:c758a4ed-f09f-4c82-9afb-3d096f035464 00:10:05.792 11:21:01 nvmf_tcp.nvmf_target_core -- nvmf/common.sh@18 -- # NVME_HOSTID=c758a4ed-f09f-4c82-9afb-3d096f035464 00:10:05.792 11:21:01 nvmf_tcp.nvmf_target_core -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:10:05.792 11:21:01 nvmf_tcp.nvmf_target_core -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:10:05.792 11:21:01 nvmf_tcp.nvmf_target_core -- nvmf/common.sh@21 -- # NET_TYPE=virt 00:10:05.792 11:21:01 nvmf_tcp.nvmf_target_core -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:10:05.792 11:21:01 nvmf_tcp.nvmf_target_core -- nvmf/common.sh@49 -- # source /home/vagrant/spdk_repo/spdk/scripts/common.sh 00:10:05.792 11:21:01 nvmf_tcp.nvmf_target_core -- scripts/common.sh@15 -- # shopt -s extglob 00:10:05.792 11:21:01 nvmf_tcp.nvmf_target_core -- scripts/common.sh@544 -- # [[ -e /bin/wpdk_common.sh ]] 00:10:05.792 11:21:01 nvmf_tcp.nvmf_target_core -- scripts/common.sh@552 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:10:05.792 11:21:01 nvmf_tcp.nvmf_target_core -- scripts/common.sh@553 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:10:05.792 11:21:01 nvmf_tcp.nvmf_target_core -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:10:05.792 11:21:01 nvmf_tcp.nvmf_target_core -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:10:05.792 11:21:01 nvmf_tcp.nvmf_target_core -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:10:05.792 11:21:01 nvmf_tcp.nvmf_target_core -- paths/export.sh@5 -- # export PATH 00:10:05.792 11:21:01 nvmf_tcp.nvmf_target_core -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:10:05.792 11:21:01 nvmf_tcp.nvmf_target_core -- nvmf/common.sh@51 -- # : 0 00:10:05.792 11:21:01 nvmf_tcp.nvmf_target_core -- nvmf/common.sh@52 -- # export NVMF_APP_SHM_ID 00:10:05.792 11:21:01 nvmf_tcp.nvmf_target_core -- nvmf/common.sh@53 -- # build_nvmf_app_args 00:10:05.792 11:21:01 nvmf_tcp.nvmf_target_core -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:10:05.792 11:21:01 nvmf_tcp.nvmf_target_core -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:10:05.792 11:21:01 nvmf_tcp.nvmf_target_core -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:10:05.792 11:21:01 nvmf_tcp.nvmf_target_core -- nvmf/common.sh@33 -- # '[' '' -eq 1 ']' 00:10:05.792 /home/vagrant/spdk_repo/spdk/test/nvmf/common.sh: line 33: [: : integer expression expected 00:10:05.792 11:21:01 nvmf_tcp.nvmf_target_core -- nvmf/common.sh@37 -- # '[' -n '' ']' 00:10:05.792 11:21:01 nvmf_tcp.nvmf_target_core -- nvmf/common.sh@39 -- # '[' 0 -eq 1 ']' 00:10:05.792 11:21:01 nvmf_tcp.nvmf_target_core -- nvmf/common.sh@55 -- # have_pci_nics=0 00:10:05.792 11:21:01 nvmf_tcp.nvmf_target_core -- nvmf/nvmf_target_core.sh@16 -- # trap 'exit 1' SIGINT SIGTERM EXIT 00:10:05.792 11:21:01 nvmf_tcp.nvmf_target_core -- nvmf/nvmf_target_core.sh@18 -- # TEST_ARGS=("$@") 00:10:05.792 11:21:01 nvmf_tcp.nvmf_target_core -- nvmf/nvmf_target_core.sh@20 -- # [[ 0 -eq 0 ]] 00:10:05.792 11:21:01 nvmf_tcp.nvmf_target_core -- nvmf/nvmf_target_core.sh@21 -- # run_test nvmf_abort /home/vagrant/spdk_repo/spdk/test/nvmf/target/abort.sh --transport=tcp 00:10:05.792 11:21:01 nvmf_tcp.nvmf_target_core -- common/autotest_common.sh@1101 -- # '[' 3 -le 1 ']' 00:10:05.792 11:21:01 nvmf_tcp.nvmf_target_core -- common/autotest_common.sh@1107 -- # xtrace_disable 00:10:05.792 11:21:01 nvmf_tcp.nvmf_target_core -- common/autotest_common.sh@10 -- # set +x 00:10:05.792 ************************************ 00:10:05.792 START TEST nvmf_abort 00:10:05.792 ************************************ 00:10:05.792 11:21:01 nvmf_tcp.nvmf_target_core.nvmf_abort -- common/autotest_common.sh@1125 -- # /home/vagrant/spdk_repo/spdk/test/nvmf/target/abort.sh --transport=tcp 00:10:05.792 * Looking for test storage... 00:10:05.792 * Found test storage at /home/vagrant/spdk_repo/spdk/test/nvmf/target 00:10:05.792 11:21:01 nvmf_tcp.nvmf_target_core.nvmf_abort -- common/autotest_common.sh@1680 -- # [[ y == y ]] 00:10:05.792 11:21:01 nvmf_tcp.nvmf_target_core.nvmf_abort -- common/autotest_common.sh@1681 -- # lcov --version 00:10:05.792 11:21:01 nvmf_tcp.nvmf_target_core.nvmf_abort -- common/autotest_common.sh@1681 -- # awk '{print $NF}' 00:10:06.051 11:21:01 nvmf_tcp.nvmf_target_core.nvmf_abort -- common/autotest_common.sh@1681 -- # lt 1.15 2 00:10:06.051 11:21:01 nvmf_tcp.nvmf_target_core.nvmf_abort -- scripts/common.sh@373 -- # cmp_versions 1.15 '<' 2 00:10:06.051 11:21:01 nvmf_tcp.nvmf_target_core.nvmf_abort -- scripts/common.sh@333 -- # local ver1 ver1_l 00:10:06.051 11:21:01 nvmf_tcp.nvmf_target_core.nvmf_abort -- scripts/common.sh@334 -- # local ver2 ver2_l 00:10:06.051 11:21:01 nvmf_tcp.nvmf_target_core.nvmf_abort -- scripts/common.sh@336 -- # IFS=.-: 00:10:06.051 11:21:01 nvmf_tcp.nvmf_target_core.nvmf_abort -- scripts/common.sh@336 -- # read -ra ver1 00:10:06.051 11:21:01 nvmf_tcp.nvmf_target_core.nvmf_abort -- scripts/common.sh@337 -- # IFS=.-: 00:10:06.051 11:21:01 nvmf_tcp.nvmf_target_core.nvmf_abort -- scripts/common.sh@337 -- # read -ra ver2 00:10:06.051 11:21:01 nvmf_tcp.nvmf_target_core.nvmf_abort -- scripts/common.sh@338 -- # local 'op=<' 00:10:06.051 11:21:01 nvmf_tcp.nvmf_target_core.nvmf_abort -- scripts/common.sh@340 -- # ver1_l=2 00:10:06.051 11:21:01 nvmf_tcp.nvmf_target_core.nvmf_abort -- scripts/common.sh@341 -- # ver2_l=1 00:10:06.051 11:21:01 nvmf_tcp.nvmf_target_core.nvmf_abort -- scripts/common.sh@343 -- # local lt=0 gt=0 eq=0 v 00:10:06.051 11:21:01 nvmf_tcp.nvmf_target_core.nvmf_abort -- scripts/common.sh@344 -- # case "$op" in 00:10:06.051 11:21:01 nvmf_tcp.nvmf_target_core.nvmf_abort -- scripts/common.sh@345 -- # : 1 00:10:06.051 11:21:01 nvmf_tcp.nvmf_target_core.nvmf_abort -- scripts/common.sh@364 -- # (( v = 0 )) 00:10:06.051 11:21:01 nvmf_tcp.nvmf_target_core.nvmf_abort -- scripts/common.sh@364 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:10:06.051 11:21:01 nvmf_tcp.nvmf_target_core.nvmf_abort -- scripts/common.sh@365 -- # decimal 1 00:10:06.051 11:21:01 nvmf_tcp.nvmf_target_core.nvmf_abort -- scripts/common.sh@353 -- # local d=1 00:10:06.051 11:21:01 nvmf_tcp.nvmf_target_core.nvmf_abort -- scripts/common.sh@354 -- # [[ 1 =~ ^[0-9]+$ ]] 00:10:06.051 11:21:01 nvmf_tcp.nvmf_target_core.nvmf_abort -- scripts/common.sh@355 -- # echo 1 00:10:06.051 11:21:01 nvmf_tcp.nvmf_target_core.nvmf_abort -- scripts/common.sh@365 -- # ver1[v]=1 00:10:06.051 11:21:01 nvmf_tcp.nvmf_target_core.nvmf_abort -- scripts/common.sh@366 -- # decimal 2 00:10:06.051 11:21:01 nvmf_tcp.nvmf_target_core.nvmf_abort -- scripts/common.sh@353 -- # local d=2 00:10:06.051 11:21:01 nvmf_tcp.nvmf_target_core.nvmf_abort -- scripts/common.sh@354 -- # [[ 2 =~ ^[0-9]+$ ]] 00:10:06.051 11:21:01 nvmf_tcp.nvmf_target_core.nvmf_abort -- scripts/common.sh@355 -- # echo 2 00:10:06.051 11:21:01 nvmf_tcp.nvmf_target_core.nvmf_abort -- scripts/common.sh@366 -- # ver2[v]=2 00:10:06.051 11:21:01 nvmf_tcp.nvmf_target_core.nvmf_abort -- scripts/common.sh@367 -- # (( ver1[v] > ver2[v] )) 00:10:06.051 11:21:01 nvmf_tcp.nvmf_target_core.nvmf_abort -- scripts/common.sh@368 -- # (( ver1[v] < ver2[v] )) 00:10:06.051 11:21:01 nvmf_tcp.nvmf_target_core.nvmf_abort -- scripts/common.sh@368 -- # return 0 00:10:06.051 11:21:01 nvmf_tcp.nvmf_target_core.nvmf_abort -- common/autotest_common.sh@1682 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:10:06.051 11:21:01 nvmf_tcp.nvmf_target_core.nvmf_abort -- common/autotest_common.sh@1694 -- # export 'LCOV_OPTS= 00:10:06.051 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:10:06.051 --rc genhtml_branch_coverage=1 00:10:06.051 --rc genhtml_function_coverage=1 00:10:06.051 --rc genhtml_legend=1 00:10:06.051 --rc geninfo_all_blocks=1 00:10:06.051 --rc geninfo_unexecuted_blocks=1 00:10:06.052 00:10:06.052 ' 00:10:06.052 11:21:01 nvmf_tcp.nvmf_target_core.nvmf_abort -- common/autotest_common.sh@1694 -- # LCOV_OPTS=' 00:10:06.052 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:10:06.052 --rc genhtml_branch_coverage=1 00:10:06.052 --rc genhtml_function_coverage=1 00:10:06.052 --rc genhtml_legend=1 00:10:06.052 --rc geninfo_all_blocks=1 00:10:06.052 --rc geninfo_unexecuted_blocks=1 00:10:06.052 00:10:06.052 ' 00:10:06.052 11:21:01 nvmf_tcp.nvmf_target_core.nvmf_abort -- common/autotest_common.sh@1695 -- # export 'LCOV=lcov 00:10:06.052 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:10:06.052 --rc genhtml_branch_coverage=1 00:10:06.052 --rc genhtml_function_coverage=1 00:10:06.052 --rc genhtml_legend=1 00:10:06.052 --rc geninfo_all_blocks=1 00:10:06.052 --rc geninfo_unexecuted_blocks=1 00:10:06.052 00:10:06.052 ' 00:10:06.052 11:21:01 nvmf_tcp.nvmf_target_core.nvmf_abort -- common/autotest_common.sh@1695 -- # LCOV='lcov 00:10:06.052 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:10:06.052 --rc genhtml_branch_coverage=1 00:10:06.052 --rc genhtml_function_coverage=1 00:10:06.052 --rc genhtml_legend=1 00:10:06.052 --rc geninfo_all_blocks=1 00:10:06.052 --rc geninfo_unexecuted_blocks=1 00:10:06.052 00:10:06.052 ' 00:10:06.052 11:21:01 nvmf_tcp.nvmf_target_core.nvmf_abort -- target/abort.sh@9 -- # source /home/vagrant/spdk_repo/spdk/test/nvmf/common.sh 00:10:06.052 11:21:01 nvmf_tcp.nvmf_target_core.nvmf_abort -- nvmf/common.sh@7 -- # uname -s 00:10:06.052 11:21:01 nvmf_tcp.nvmf_target_core.nvmf_abort -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:10:06.052 11:21:01 nvmf_tcp.nvmf_target_core.nvmf_abort -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:10:06.052 11:21:01 nvmf_tcp.nvmf_target_core.nvmf_abort -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:10:06.052 11:21:01 nvmf_tcp.nvmf_target_core.nvmf_abort -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:10:06.052 11:21:01 nvmf_tcp.nvmf_target_core.nvmf_abort -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:10:06.052 11:21:01 nvmf_tcp.nvmf_target_core.nvmf_abort -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:10:06.052 11:21:01 nvmf_tcp.nvmf_target_core.nvmf_abort -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:10:06.052 11:21:01 nvmf_tcp.nvmf_target_core.nvmf_abort -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:10:06.052 11:21:01 nvmf_tcp.nvmf_target_core.nvmf_abort -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:10:06.052 11:21:01 nvmf_tcp.nvmf_target_core.nvmf_abort -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:10:06.052 11:21:01 nvmf_tcp.nvmf_target_core.nvmf_abort -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:c758a4ed-f09f-4c82-9afb-3d096f035464 00:10:06.052 11:21:01 nvmf_tcp.nvmf_target_core.nvmf_abort -- nvmf/common.sh@18 -- # NVME_HOSTID=c758a4ed-f09f-4c82-9afb-3d096f035464 00:10:06.052 11:21:01 nvmf_tcp.nvmf_target_core.nvmf_abort -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:10:06.052 11:21:01 nvmf_tcp.nvmf_target_core.nvmf_abort -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:10:06.052 11:21:01 nvmf_tcp.nvmf_target_core.nvmf_abort -- nvmf/common.sh@21 -- # NET_TYPE=virt 00:10:06.052 11:21:01 nvmf_tcp.nvmf_target_core.nvmf_abort -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:10:06.052 11:21:01 nvmf_tcp.nvmf_target_core.nvmf_abort -- nvmf/common.sh@49 -- # source /home/vagrant/spdk_repo/spdk/scripts/common.sh 00:10:06.052 11:21:01 nvmf_tcp.nvmf_target_core.nvmf_abort -- scripts/common.sh@15 -- # shopt -s extglob 00:10:06.052 11:21:01 nvmf_tcp.nvmf_target_core.nvmf_abort -- scripts/common.sh@544 -- # [[ -e /bin/wpdk_common.sh ]] 00:10:06.052 11:21:01 nvmf_tcp.nvmf_target_core.nvmf_abort -- scripts/common.sh@552 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:10:06.052 11:21:01 nvmf_tcp.nvmf_target_core.nvmf_abort -- scripts/common.sh@553 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:10:06.052 11:21:01 nvmf_tcp.nvmf_target_core.nvmf_abort -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:10:06.052 11:21:01 nvmf_tcp.nvmf_target_core.nvmf_abort -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:10:06.052 11:21:01 nvmf_tcp.nvmf_target_core.nvmf_abort -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:10:06.052 11:21:01 nvmf_tcp.nvmf_target_core.nvmf_abort -- paths/export.sh@5 -- # export PATH 00:10:06.052 11:21:01 nvmf_tcp.nvmf_target_core.nvmf_abort -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:10:06.052 11:21:01 nvmf_tcp.nvmf_target_core.nvmf_abort -- nvmf/common.sh@51 -- # : 0 00:10:06.052 11:21:01 nvmf_tcp.nvmf_target_core.nvmf_abort -- nvmf/common.sh@52 -- # export NVMF_APP_SHM_ID 00:10:06.052 11:21:01 nvmf_tcp.nvmf_target_core.nvmf_abort -- nvmf/common.sh@53 -- # build_nvmf_app_args 00:10:06.052 11:21:01 nvmf_tcp.nvmf_target_core.nvmf_abort -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:10:06.052 11:21:01 nvmf_tcp.nvmf_target_core.nvmf_abort -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:10:06.052 11:21:01 nvmf_tcp.nvmf_target_core.nvmf_abort -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:10:06.052 11:21:01 nvmf_tcp.nvmf_target_core.nvmf_abort -- nvmf/common.sh@33 -- # '[' '' -eq 1 ']' 00:10:06.052 /home/vagrant/spdk_repo/spdk/test/nvmf/common.sh: line 33: [: : integer expression expected 00:10:06.052 11:21:01 nvmf_tcp.nvmf_target_core.nvmf_abort -- nvmf/common.sh@37 -- # '[' -n '' ']' 00:10:06.052 11:21:01 nvmf_tcp.nvmf_target_core.nvmf_abort -- nvmf/common.sh@39 -- # '[' 0 -eq 1 ']' 00:10:06.052 11:21:01 nvmf_tcp.nvmf_target_core.nvmf_abort -- nvmf/common.sh@55 -- # have_pci_nics=0 00:10:06.052 11:21:01 nvmf_tcp.nvmf_target_core.nvmf_abort -- target/abort.sh@11 -- # MALLOC_BDEV_SIZE=64 00:10:06.052 11:21:01 nvmf_tcp.nvmf_target_core.nvmf_abort -- target/abort.sh@12 -- # MALLOC_BLOCK_SIZE=4096 00:10:06.052 11:21:01 nvmf_tcp.nvmf_target_core.nvmf_abort -- target/abort.sh@14 -- # nvmftestinit 00:10:06.052 11:21:01 nvmf_tcp.nvmf_target_core.nvmf_abort -- nvmf/common.sh@467 -- # '[' -z tcp ']' 00:10:06.052 11:21:01 nvmf_tcp.nvmf_target_core.nvmf_abort -- nvmf/common.sh@472 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:10:06.052 11:21:01 nvmf_tcp.nvmf_target_core.nvmf_abort -- nvmf/common.sh@474 -- # prepare_net_devs 00:10:06.052 11:21:01 nvmf_tcp.nvmf_target_core.nvmf_abort -- nvmf/common.sh@436 -- # local -g is_hw=no 00:10:06.052 11:21:01 nvmf_tcp.nvmf_target_core.nvmf_abort -- nvmf/common.sh@438 -- # remove_spdk_ns 00:10:06.052 11:21:01 nvmf_tcp.nvmf_target_core.nvmf_abort -- nvmf/common.sh@654 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:10:06.052 11:21:01 nvmf_tcp.nvmf_target_core.nvmf_abort -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 15> /dev/null' 00:10:06.052 11:21:01 nvmf_tcp.nvmf_target_core.nvmf_abort -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:10:06.052 11:21:01 nvmf_tcp.nvmf_target_core.nvmf_abort -- nvmf/common.sh@440 -- # [[ virt != virt ]] 00:10:06.053 11:21:01 nvmf_tcp.nvmf_target_core.nvmf_abort -- nvmf/common.sh@442 -- # [[ no == yes ]] 00:10:06.053 11:21:01 nvmf_tcp.nvmf_target_core.nvmf_abort -- nvmf/common.sh@449 -- # [[ virt == phy ]] 00:10:06.053 11:21:01 nvmf_tcp.nvmf_target_core.nvmf_abort -- nvmf/common.sh@452 -- # [[ virt == phy-fallback ]] 00:10:06.053 11:21:01 nvmf_tcp.nvmf_target_core.nvmf_abort -- nvmf/common.sh@457 -- # [[ tcp == tcp ]] 00:10:06.053 11:21:01 nvmf_tcp.nvmf_target_core.nvmf_abort -- nvmf/common.sh@458 -- # nvmf_veth_init 00:10:06.053 11:21:01 nvmf_tcp.nvmf_target_core.nvmf_abort -- nvmf/common.sh@145 -- # NVMF_FIRST_INITIATOR_IP=10.0.0.1 00:10:06.053 11:21:01 nvmf_tcp.nvmf_target_core.nvmf_abort -- nvmf/common.sh@146 -- # NVMF_SECOND_INITIATOR_IP=10.0.0.2 00:10:06.053 11:21:01 nvmf_tcp.nvmf_target_core.nvmf_abort -- nvmf/common.sh@147 -- # NVMF_FIRST_TARGET_IP=10.0.0.3 00:10:06.053 11:21:01 nvmf_tcp.nvmf_target_core.nvmf_abort -- nvmf/common.sh@148 -- # NVMF_SECOND_TARGET_IP=10.0.0.4 00:10:06.053 11:21:01 nvmf_tcp.nvmf_target_core.nvmf_abort -- nvmf/common.sh@149 -- # NVMF_INITIATOR_IP=10.0.0.1 00:10:06.053 11:21:01 nvmf_tcp.nvmf_target_core.nvmf_abort -- nvmf/common.sh@150 -- # NVMF_BRIDGE=nvmf_br 00:10:06.053 11:21:01 nvmf_tcp.nvmf_target_core.nvmf_abort -- nvmf/common.sh@151 -- # NVMF_INITIATOR_INTERFACE=nvmf_init_if 00:10:06.053 11:21:01 nvmf_tcp.nvmf_target_core.nvmf_abort -- nvmf/common.sh@152 -- # NVMF_INITIATOR_INTERFACE2=nvmf_init_if2 00:10:06.053 11:21:01 nvmf_tcp.nvmf_target_core.nvmf_abort -- nvmf/common.sh@153 -- # NVMF_INITIATOR_BRIDGE=nvmf_init_br 00:10:06.053 11:21:01 nvmf_tcp.nvmf_target_core.nvmf_abort -- nvmf/common.sh@154 -- # NVMF_INITIATOR_BRIDGE2=nvmf_init_br2 00:10:06.053 11:21:01 nvmf_tcp.nvmf_target_core.nvmf_abort -- nvmf/common.sh@155 -- # NVMF_TARGET_NAMESPACE=nvmf_tgt_ns_spdk 00:10:06.053 11:21:01 nvmf_tcp.nvmf_target_core.nvmf_abort -- nvmf/common.sh@156 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:10:06.053 11:21:01 nvmf_tcp.nvmf_target_core.nvmf_abort -- nvmf/common.sh@157 -- # NVMF_TARGET_INTERFACE=nvmf_tgt_if 00:10:06.053 11:21:01 nvmf_tcp.nvmf_target_core.nvmf_abort -- nvmf/common.sh@158 -- # NVMF_TARGET_INTERFACE2=nvmf_tgt_if2 00:10:06.053 11:21:01 nvmf_tcp.nvmf_target_core.nvmf_abort -- nvmf/common.sh@159 -- # NVMF_TARGET_BRIDGE=nvmf_tgt_br 00:10:06.053 11:21:01 nvmf_tcp.nvmf_target_core.nvmf_abort -- nvmf/common.sh@160 -- # NVMF_TARGET_BRIDGE2=nvmf_tgt_br2 00:10:06.053 11:21:01 nvmf_tcp.nvmf_target_core.nvmf_abort -- nvmf/common.sh@162 -- # ip link set nvmf_init_br nomaster 00:10:06.053 Cannot find device "nvmf_init_br" 00:10:06.053 11:21:01 nvmf_tcp.nvmf_target_core.nvmf_abort -- nvmf/common.sh@162 -- # true 00:10:06.053 11:21:01 nvmf_tcp.nvmf_target_core.nvmf_abort -- nvmf/common.sh@163 -- # ip link set nvmf_init_br2 nomaster 00:10:06.053 Cannot find device "nvmf_init_br2" 00:10:06.053 11:21:01 nvmf_tcp.nvmf_target_core.nvmf_abort -- nvmf/common.sh@163 -- # true 00:10:06.053 11:21:01 nvmf_tcp.nvmf_target_core.nvmf_abort -- nvmf/common.sh@164 -- # ip link set nvmf_tgt_br nomaster 00:10:06.053 Cannot find device "nvmf_tgt_br" 00:10:06.053 11:21:01 nvmf_tcp.nvmf_target_core.nvmf_abort -- nvmf/common.sh@164 -- # true 00:10:06.053 11:21:01 nvmf_tcp.nvmf_target_core.nvmf_abort -- nvmf/common.sh@165 -- # ip link set nvmf_tgt_br2 nomaster 00:10:06.053 Cannot find device "nvmf_tgt_br2" 00:10:06.053 11:21:01 nvmf_tcp.nvmf_target_core.nvmf_abort -- nvmf/common.sh@165 -- # true 00:10:06.053 11:21:01 nvmf_tcp.nvmf_target_core.nvmf_abort -- nvmf/common.sh@166 -- # ip link set nvmf_init_br down 00:10:06.053 Cannot find device "nvmf_init_br" 00:10:06.053 11:21:01 nvmf_tcp.nvmf_target_core.nvmf_abort -- nvmf/common.sh@166 -- # true 00:10:06.053 11:21:01 nvmf_tcp.nvmf_target_core.nvmf_abort -- nvmf/common.sh@167 -- # ip link set nvmf_init_br2 down 00:10:06.053 Cannot find device "nvmf_init_br2" 00:10:06.053 11:21:01 nvmf_tcp.nvmf_target_core.nvmf_abort -- nvmf/common.sh@167 -- # true 00:10:06.053 11:21:01 nvmf_tcp.nvmf_target_core.nvmf_abort -- nvmf/common.sh@168 -- # ip link set nvmf_tgt_br down 00:10:06.053 Cannot find device "nvmf_tgt_br" 00:10:06.053 11:21:01 nvmf_tcp.nvmf_target_core.nvmf_abort -- nvmf/common.sh@168 -- # true 00:10:06.053 11:21:01 nvmf_tcp.nvmf_target_core.nvmf_abort -- nvmf/common.sh@169 -- # ip link set nvmf_tgt_br2 down 00:10:06.053 Cannot find device "nvmf_tgt_br2" 00:10:06.053 11:21:01 nvmf_tcp.nvmf_target_core.nvmf_abort -- nvmf/common.sh@169 -- # true 00:10:06.053 11:21:01 nvmf_tcp.nvmf_target_core.nvmf_abort -- nvmf/common.sh@170 -- # ip link delete nvmf_br type bridge 00:10:06.053 Cannot find device "nvmf_br" 00:10:06.053 11:21:01 nvmf_tcp.nvmf_target_core.nvmf_abort -- nvmf/common.sh@170 -- # true 00:10:06.053 11:21:01 nvmf_tcp.nvmf_target_core.nvmf_abort -- nvmf/common.sh@171 -- # ip link delete nvmf_init_if 00:10:06.053 Cannot find device "nvmf_init_if" 00:10:06.053 11:21:01 nvmf_tcp.nvmf_target_core.nvmf_abort -- nvmf/common.sh@171 -- # true 00:10:06.053 11:21:01 nvmf_tcp.nvmf_target_core.nvmf_abort -- nvmf/common.sh@172 -- # ip link delete nvmf_init_if2 00:10:06.053 Cannot find device "nvmf_init_if2" 00:10:06.312 11:21:01 nvmf_tcp.nvmf_target_core.nvmf_abort -- nvmf/common.sh@172 -- # true 00:10:06.312 11:21:01 nvmf_tcp.nvmf_target_core.nvmf_abort -- nvmf/common.sh@173 -- # ip netns exec nvmf_tgt_ns_spdk ip link delete nvmf_tgt_if 00:10:06.312 Cannot open network namespace "nvmf_tgt_ns_spdk": No such file or directory 00:10:06.312 11:21:01 nvmf_tcp.nvmf_target_core.nvmf_abort -- nvmf/common.sh@173 -- # true 00:10:06.312 11:21:01 nvmf_tcp.nvmf_target_core.nvmf_abort -- nvmf/common.sh@174 -- # ip netns exec nvmf_tgt_ns_spdk ip link delete nvmf_tgt_if2 00:10:06.312 Cannot open network namespace "nvmf_tgt_ns_spdk": No such file or directory 00:10:06.312 11:21:01 nvmf_tcp.nvmf_target_core.nvmf_abort -- nvmf/common.sh@174 -- # true 00:10:06.312 11:21:01 nvmf_tcp.nvmf_target_core.nvmf_abort -- nvmf/common.sh@177 -- # ip netns add nvmf_tgt_ns_spdk 00:10:06.312 11:21:01 nvmf_tcp.nvmf_target_core.nvmf_abort -- nvmf/common.sh@180 -- # ip link add nvmf_init_if type veth peer name nvmf_init_br 00:10:06.312 11:21:01 nvmf_tcp.nvmf_target_core.nvmf_abort -- nvmf/common.sh@181 -- # ip link add nvmf_init_if2 type veth peer name nvmf_init_br2 00:10:06.312 11:21:01 nvmf_tcp.nvmf_target_core.nvmf_abort -- nvmf/common.sh@182 -- # ip link add nvmf_tgt_if type veth peer name nvmf_tgt_br 00:10:06.312 11:21:01 nvmf_tcp.nvmf_target_core.nvmf_abort -- nvmf/common.sh@183 -- # ip link add nvmf_tgt_if2 type veth peer name nvmf_tgt_br2 00:10:06.312 11:21:01 nvmf_tcp.nvmf_target_core.nvmf_abort -- nvmf/common.sh@186 -- # ip link set nvmf_tgt_if netns nvmf_tgt_ns_spdk 00:10:06.312 11:21:01 nvmf_tcp.nvmf_target_core.nvmf_abort -- nvmf/common.sh@187 -- # ip link set nvmf_tgt_if2 netns nvmf_tgt_ns_spdk 00:10:06.312 11:21:01 nvmf_tcp.nvmf_target_core.nvmf_abort -- nvmf/common.sh@190 -- # ip addr add 10.0.0.1/24 dev nvmf_init_if 00:10:06.312 11:21:01 nvmf_tcp.nvmf_target_core.nvmf_abort -- nvmf/common.sh@191 -- # ip addr add 10.0.0.2/24 dev nvmf_init_if2 00:10:06.312 11:21:01 nvmf_tcp.nvmf_target_core.nvmf_abort -- nvmf/common.sh@192 -- # ip netns exec nvmf_tgt_ns_spdk ip addr add 10.0.0.3/24 dev nvmf_tgt_if 00:10:06.312 11:21:01 nvmf_tcp.nvmf_target_core.nvmf_abort -- nvmf/common.sh@193 -- # ip netns exec nvmf_tgt_ns_spdk ip addr add 10.0.0.4/24 dev nvmf_tgt_if2 00:10:06.312 11:21:01 nvmf_tcp.nvmf_target_core.nvmf_abort -- nvmf/common.sh@196 -- # ip link set nvmf_init_if up 00:10:06.312 11:21:01 nvmf_tcp.nvmf_target_core.nvmf_abort -- nvmf/common.sh@197 -- # ip link set nvmf_init_if2 up 00:10:06.312 11:21:01 nvmf_tcp.nvmf_target_core.nvmf_abort -- nvmf/common.sh@198 -- # ip link set nvmf_init_br up 00:10:06.312 11:21:01 nvmf_tcp.nvmf_target_core.nvmf_abort -- nvmf/common.sh@199 -- # ip link set nvmf_init_br2 up 00:10:06.312 11:21:01 nvmf_tcp.nvmf_target_core.nvmf_abort -- nvmf/common.sh@200 -- # ip link set nvmf_tgt_br up 00:10:06.312 11:21:01 nvmf_tcp.nvmf_target_core.nvmf_abort -- nvmf/common.sh@201 -- # ip link set nvmf_tgt_br2 up 00:10:06.312 11:21:01 nvmf_tcp.nvmf_target_core.nvmf_abort -- nvmf/common.sh@202 -- # ip netns exec nvmf_tgt_ns_spdk ip link set nvmf_tgt_if up 00:10:06.312 11:21:01 nvmf_tcp.nvmf_target_core.nvmf_abort -- nvmf/common.sh@203 -- # ip netns exec nvmf_tgt_ns_spdk ip link set nvmf_tgt_if2 up 00:10:06.312 11:21:01 nvmf_tcp.nvmf_target_core.nvmf_abort -- nvmf/common.sh@204 -- # ip netns exec nvmf_tgt_ns_spdk ip link set lo up 00:10:06.312 11:21:01 nvmf_tcp.nvmf_target_core.nvmf_abort -- nvmf/common.sh@207 -- # ip link add nvmf_br type bridge 00:10:06.312 11:21:01 nvmf_tcp.nvmf_target_core.nvmf_abort -- nvmf/common.sh@208 -- # ip link set nvmf_br up 00:10:06.312 11:21:01 nvmf_tcp.nvmf_target_core.nvmf_abort -- nvmf/common.sh@211 -- # ip link set nvmf_init_br master nvmf_br 00:10:06.312 11:21:01 nvmf_tcp.nvmf_target_core.nvmf_abort -- nvmf/common.sh@212 -- # ip link set nvmf_init_br2 master nvmf_br 00:10:06.571 11:21:01 nvmf_tcp.nvmf_target_core.nvmf_abort -- nvmf/common.sh@213 -- # ip link set nvmf_tgt_br master nvmf_br 00:10:06.571 11:21:01 nvmf_tcp.nvmf_target_core.nvmf_abort -- nvmf/common.sh@214 -- # ip link set nvmf_tgt_br2 master nvmf_br 00:10:06.571 11:21:01 nvmf_tcp.nvmf_target_core.nvmf_abort -- nvmf/common.sh@217 -- # ipts -I INPUT 1 -i nvmf_init_if -p tcp --dport 4420 -j ACCEPT 00:10:06.571 11:21:01 nvmf_tcp.nvmf_target_core.nvmf_abort -- nvmf/common.sh@788 -- # iptables -I INPUT 1 -i nvmf_init_if -p tcp --dport 4420 -j ACCEPT -m comment --comment 'SPDK_NVMF:-I INPUT 1 -i nvmf_init_if -p tcp --dport 4420 -j ACCEPT' 00:10:06.571 11:21:01 nvmf_tcp.nvmf_target_core.nvmf_abort -- nvmf/common.sh@218 -- # ipts -I INPUT 1 -i nvmf_init_if2 -p tcp --dport 4420 -j ACCEPT 00:10:06.571 11:21:01 nvmf_tcp.nvmf_target_core.nvmf_abort -- nvmf/common.sh@788 -- # iptables -I INPUT 1 -i nvmf_init_if2 -p tcp --dport 4420 -j ACCEPT -m comment --comment 'SPDK_NVMF:-I INPUT 1 -i nvmf_init_if2 -p tcp --dport 4420 -j ACCEPT' 00:10:06.571 11:21:01 nvmf_tcp.nvmf_target_core.nvmf_abort -- nvmf/common.sh@219 -- # ipts -A FORWARD -i nvmf_br -o nvmf_br -j ACCEPT 00:10:06.571 11:21:01 nvmf_tcp.nvmf_target_core.nvmf_abort -- nvmf/common.sh@788 -- # iptables -A FORWARD -i nvmf_br -o nvmf_br -j ACCEPT -m comment --comment 'SPDK_NVMF:-A FORWARD -i nvmf_br -o nvmf_br -j ACCEPT' 00:10:06.571 11:21:01 nvmf_tcp.nvmf_target_core.nvmf_abort -- nvmf/common.sh@222 -- # ping -c 1 10.0.0.3 00:10:06.571 PING 10.0.0.3 (10.0.0.3) 56(84) bytes of data. 00:10:06.571 64 bytes from 10.0.0.3: icmp_seq=1 ttl=64 time=0.114 ms 00:10:06.571 00:10:06.571 --- 10.0.0.3 ping statistics --- 00:10:06.571 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:10:06.571 rtt min/avg/max/mdev = 0.114/0.114/0.114/0.000 ms 00:10:06.571 11:21:01 nvmf_tcp.nvmf_target_core.nvmf_abort -- nvmf/common.sh@223 -- # ping -c 1 10.0.0.4 00:10:06.571 PING 10.0.0.4 (10.0.0.4) 56(84) bytes of data. 00:10:06.571 64 bytes from 10.0.0.4: icmp_seq=1 ttl=64 time=0.053 ms 00:10:06.571 00:10:06.571 --- 10.0.0.4 ping statistics --- 00:10:06.571 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:10:06.571 rtt min/avg/max/mdev = 0.053/0.053/0.053/0.000 ms 00:10:06.571 11:21:01 nvmf_tcp.nvmf_target_core.nvmf_abort -- nvmf/common.sh@224 -- # ip netns exec nvmf_tgt_ns_spdk ping -c 1 10.0.0.1 00:10:06.571 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:10:06.571 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.036 ms 00:10:06.571 00:10:06.571 --- 10.0.0.1 ping statistics --- 00:10:06.571 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:10:06.571 rtt min/avg/max/mdev = 0.036/0.036/0.036/0.000 ms 00:10:06.571 11:21:01 nvmf_tcp.nvmf_target_core.nvmf_abort -- nvmf/common.sh@225 -- # ip netns exec nvmf_tgt_ns_spdk ping -c 1 10.0.0.2 00:10:06.571 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:10:06.571 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.075 ms 00:10:06.571 00:10:06.571 --- 10.0.0.2 ping statistics --- 00:10:06.571 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:10:06.571 rtt min/avg/max/mdev = 0.075/0.075/0.075/0.000 ms 00:10:06.571 11:21:01 nvmf_tcp.nvmf_target_core.nvmf_abort -- nvmf/common.sh@227 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:10:06.571 11:21:01 nvmf_tcp.nvmf_target_core.nvmf_abort -- nvmf/common.sh@459 -- # return 0 00:10:06.571 11:21:01 nvmf_tcp.nvmf_target_core.nvmf_abort -- nvmf/common.sh@476 -- # '[' '' == iso ']' 00:10:06.571 11:21:01 nvmf_tcp.nvmf_target_core.nvmf_abort -- nvmf/common.sh@480 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:10:06.571 11:21:01 nvmf_tcp.nvmf_target_core.nvmf_abort -- nvmf/common.sh@481 -- # [[ tcp == \r\d\m\a ]] 00:10:06.571 11:21:01 nvmf_tcp.nvmf_target_core.nvmf_abort -- nvmf/common.sh@490 -- # [[ tcp == \t\c\p ]] 00:10:06.571 11:21:01 nvmf_tcp.nvmf_target_core.nvmf_abort -- nvmf/common.sh@491 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:10:06.571 11:21:01 nvmf_tcp.nvmf_target_core.nvmf_abort -- nvmf/common.sh@494 -- # '[' tcp == tcp ']' 00:10:06.572 11:21:01 nvmf_tcp.nvmf_target_core.nvmf_abort -- nvmf/common.sh@500 -- # modprobe nvme-tcp 00:10:06.572 11:21:01 nvmf_tcp.nvmf_target_core.nvmf_abort -- target/abort.sh@15 -- # nvmfappstart -m 0xE 00:10:06.572 11:21:01 nvmf_tcp.nvmf_target_core.nvmf_abort -- nvmf/common.sh@505 -- # timing_enter start_nvmf_tgt 00:10:06.572 11:21:01 nvmf_tcp.nvmf_target_core.nvmf_abort -- common/autotest_common.sh@724 -- # xtrace_disable 00:10:06.572 11:21:01 nvmf_tcp.nvmf_target_core.nvmf_abort -- common/autotest_common.sh@10 -- # set +x 00:10:06.572 11:21:01 nvmf_tcp.nvmf_target_core.nvmf_abort -- nvmf/common.sh@507 -- # nvmfpid=62240 00:10:06.572 11:21:01 nvmf_tcp.nvmf_target_core.nvmf_abort -- nvmf/common.sh@506 -- # ip netns exec nvmf_tgt_ns_spdk /home/vagrant/spdk_repo/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xE 00:10:06.572 11:21:01 nvmf_tcp.nvmf_target_core.nvmf_abort -- nvmf/common.sh@508 -- # waitforlisten 62240 00:10:06.572 11:21:01 nvmf_tcp.nvmf_target_core.nvmf_abort -- common/autotest_common.sh@831 -- # '[' -z 62240 ']' 00:10:06.572 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:10:06.572 11:21:01 nvmf_tcp.nvmf_target_core.nvmf_abort -- common/autotest_common.sh@835 -- # local rpc_addr=/var/tmp/spdk.sock 00:10:06.572 11:21:01 nvmf_tcp.nvmf_target_core.nvmf_abort -- common/autotest_common.sh@836 -- # local max_retries=100 00:10:06.572 11:21:01 nvmf_tcp.nvmf_target_core.nvmf_abort -- common/autotest_common.sh@838 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:10:06.572 11:21:01 nvmf_tcp.nvmf_target_core.nvmf_abort -- common/autotest_common.sh@840 -- # xtrace_disable 00:10:06.572 11:21:01 nvmf_tcp.nvmf_target_core.nvmf_abort -- common/autotest_common.sh@10 -- # set +x 00:10:06.572 [2024-10-07 11:21:02.018442] Starting SPDK v25.01-pre git sha1 2a4f56c54 / DPDK 24.03.0 initialization... 00:10:06.572 [2024-10-07 11:21:02.018579] [ DPDK EAL parameters: nvmf -c 0xE --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --iova-mode=pa --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:10:06.830 [2024-10-07 11:21:02.159691] app.c: 917:spdk_app_start: *NOTICE*: Total cores available: 3 00:10:06.830 [2024-10-07 11:21:02.295015] app.c: 610:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:10:06.830 [2024-10-07 11:21:02.295327] app.c: 611:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:10:06.830 [2024-10-07 11:21:02.295497] app.c: 616:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:10:06.830 [2024-10-07 11:21:02.295640] app.c: 617:app_setup_trace: *NOTICE*: SPDK application currently running. 00:10:06.830 [2024-10-07 11:21:02.295725] app.c: 618:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:10:06.830 [2024-10-07 11:21:02.296573] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 2 00:10:06.830 [2024-10-07 11:21:02.296674] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 3 00:10:06.830 [2024-10-07 11:21:02.296682] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 1 00:10:07.764 11:21:03 nvmf_tcp.nvmf_target_core.nvmf_abort -- common/autotest_common.sh@860 -- # (( i == 0 )) 00:10:07.764 11:21:03 nvmf_tcp.nvmf_target_core.nvmf_abort -- common/autotest_common.sh@864 -- # return 0 00:10:07.764 11:21:03 nvmf_tcp.nvmf_target_core.nvmf_abort -- nvmf/common.sh@509 -- # timing_exit start_nvmf_tgt 00:10:07.764 11:21:03 nvmf_tcp.nvmf_target_core.nvmf_abort -- common/autotest_common.sh@730 -- # xtrace_disable 00:10:07.764 11:21:03 nvmf_tcp.nvmf_target_core.nvmf_abort -- common/autotest_common.sh@10 -- # set +x 00:10:07.764 11:21:03 nvmf_tcp.nvmf_target_core.nvmf_abort -- nvmf/common.sh@510 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:10:07.764 11:21:03 nvmf_tcp.nvmf_target_core.nvmf_abort -- target/abort.sh@17 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 -a 256 00:10:07.764 11:21:03 nvmf_tcp.nvmf_target_core.nvmf_abort -- common/autotest_common.sh@561 -- # xtrace_disable 00:10:07.764 11:21:03 nvmf_tcp.nvmf_target_core.nvmf_abort -- common/autotest_common.sh@10 -- # set +x 00:10:07.764 [2024-10-07 11:21:03.181927] tcp.c: 738:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:10:07.764 11:21:03 nvmf_tcp.nvmf_target_core.nvmf_abort -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:10:07.764 11:21:03 nvmf_tcp.nvmf_target_core.nvmf_abort -- target/abort.sh@20 -- # rpc_cmd bdev_malloc_create 64 4096 -b Malloc0 00:10:07.764 11:21:03 nvmf_tcp.nvmf_target_core.nvmf_abort -- common/autotest_common.sh@561 -- # xtrace_disable 00:10:07.764 11:21:03 nvmf_tcp.nvmf_target_core.nvmf_abort -- common/autotest_common.sh@10 -- # set +x 00:10:07.764 Malloc0 00:10:07.764 11:21:03 nvmf_tcp.nvmf_target_core.nvmf_abort -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:10:07.764 11:21:03 nvmf_tcp.nvmf_target_core.nvmf_abort -- target/abort.sh@21 -- # rpc_cmd bdev_delay_create -b Malloc0 -d Delay0 -r 1000000 -t 1000000 -w 1000000 -n 1000000 00:10:07.764 11:21:03 nvmf_tcp.nvmf_target_core.nvmf_abort -- common/autotest_common.sh@561 -- # xtrace_disable 00:10:07.764 11:21:03 nvmf_tcp.nvmf_target_core.nvmf_abort -- common/autotest_common.sh@10 -- # set +x 00:10:07.764 Delay0 00:10:07.764 11:21:03 nvmf_tcp.nvmf_target_core.nvmf_abort -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:10:07.764 11:21:03 nvmf_tcp.nvmf_target_core.nvmf_abort -- target/abort.sh@24 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 -a -s SPDK0 00:10:07.764 11:21:03 nvmf_tcp.nvmf_target_core.nvmf_abort -- common/autotest_common.sh@561 -- # xtrace_disable 00:10:07.764 11:21:03 nvmf_tcp.nvmf_target_core.nvmf_abort -- common/autotest_common.sh@10 -- # set +x 00:10:07.764 11:21:03 nvmf_tcp.nvmf_target_core.nvmf_abort -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:10:07.764 11:21:03 nvmf_tcp.nvmf_target_core.nvmf_abort -- target/abort.sh@25 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 Delay0 00:10:07.764 11:21:03 nvmf_tcp.nvmf_target_core.nvmf_abort -- common/autotest_common.sh@561 -- # xtrace_disable 00:10:07.764 11:21:03 nvmf_tcp.nvmf_target_core.nvmf_abort -- common/autotest_common.sh@10 -- # set +x 00:10:07.764 11:21:03 nvmf_tcp.nvmf_target_core.nvmf_abort -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:10:07.764 11:21:03 nvmf_tcp.nvmf_target_core.nvmf_abort -- target/abort.sh@26 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.3 -s 4420 00:10:07.764 11:21:03 nvmf_tcp.nvmf_target_core.nvmf_abort -- common/autotest_common.sh@561 -- # xtrace_disable 00:10:07.764 11:21:03 nvmf_tcp.nvmf_target_core.nvmf_abort -- common/autotest_common.sh@10 -- # set +x 00:10:07.764 [2024-10-07 11:21:03.265244] tcp.c:1081:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.3 port 4420 *** 00:10:07.764 11:21:03 nvmf_tcp.nvmf_target_core.nvmf_abort -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:10:07.764 11:21:03 nvmf_tcp.nvmf_target_core.nvmf_abort -- target/abort.sh@27 -- # rpc_cmd nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.3 -s 4420 00:10:07.764 11:21:03 nvmf_tcp.nvmf_target_core.nvmf_abort -- common/autotest_common.sh@561 -- # xtrace_disable 00:10:07.764 11:21:03 nvmf_tcp.nvmf_target_core.nvmf_abort -- common/autotest_common.sh@10 -- # set +x 00:10:07.764 11:21:03 nvmf_tcp.nvmf_target_core.nvmf_abort -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:10:07.764 11:21:03 nvmf_tcp.nvmf_target_core.nvmf_abort -- target/abort.sh@30 -- # /home/vagrant/spdk_repo/spdk/build/examples/abort -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.3 trsvcid:4420' -c 0x1 -t 1 -l warning -q 128 00:10:08.022 [2024-10-07 11:21:03.447679] nvme_fabric.c: 295:nvme_fabric_discover_probe: *WARNING*: Skipping unsupported current discovery service or discovery service referral 00:10:10.553 Initializing NVMe Controllers 00:10:10.553 Attached to NVMe over Fabrics controller at 10.0.0.3:4420: nqn.2016-06.io.spdk:cnode0 00:10:10.553 controller IO queue size 128 less than required 00:10:10.553 Consider using lower queue depth or small IO size because IO requests may be queued at the NVMe driver. 00:10:10.553 Associating TCP (addr:10.0.0.3 subnqn:nqn.2016-06.io.spdk:cnode0) NSID 1 with lcore 0 00:10:10.553 Initialization complete. Launching workers. 00:10:10.553 NS: TCP (addr:10.0.0.3 subnqn:nqn.2016-06.io.spdk:cnode0) NSID 1 I/O completed: 123, failed: 27411 00:10:10.553 CTRLR: TCP (addr:10.0.0.3 subnqn:nqn.2016-06.io.spdk:cnode0) abort submitted 27472, failed to submit 62 00:10:10.553 success 27415, unsuccessful 57, failed 0 00:10:10.553 11:21:05 nvmf_tcp.nvmf_target_core.nvmf_abort -- target/abort.sh@34 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode0 00:10:10.553 11:21:05 nvmf_tcp.nvmf_target_core.nvmf_abort -- common/autotest_common.sh@561 -- # xtrace_disable 00:10:10.553 11:21:05 nvmf_tcp.nvmf_target_core.nvmf_abort -- common/autotest_common.sh@10 -- # set +x 00:10:10.553 11:21:05 nvmf_tcp.nvmf_target_core.nvmf_abort -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:10:10.553 11:21:05 nvmf_tcp.nvmf_target_core.nvmf_abort -- target/abort.sh@36 -- # trap - SIGINT SIGTERM EXIT 00:10:10.553 11:21:05 nvmf_tcp.nvmf_target_core.nvmf_abort -- target/abort.sh@38 -- # nvmftestfini 00:10:10.553 11:21:05 nvmf_tcp.nvmf_target_core.nvmf_abort -- nvmf/common.sh@514 -- # nvmfcleanup 00:10:10.553 11:21:05 nvmf_tcp.nvmf_target_core.nvmf_abort -- nvmf/common.sh@121 -- # sync 00:10:10.553 11:21:05 nvmf_tcp.nvmf_target_core.nvmf_abort -- nvmf/common.sh@123 -- # '[' tcp == tcp ']' 00:10:10.553 11:21:05 nvmf_tcp.nvmf_target_core.nvmf_abort -- nvmf/common.sh@124 -- # set +e 00:10:10.553 11:21:05 nvmf_tcp.nvmf_target_core.nvmf_abort -- nvmf/common.sh@125 -- # for i in {1..20} 00:10:10.553 11:21:05 nvmf_tcp.nvmf_target_core.nvmf_abort -- nvmf/common.sh@126 -- # modprobe -v -r nvme-tcp 00:10:10.553 rmmod nvme_tcp 00:10:10.553 rmmod nvme_fabrics 00:10:10.553 rmmod nvme_keyring 00:10:10.553 11:21:05 nvmf_tcp.nvmf_target_core.nvmf_abort -- nvmf/common.sh@127 -- # modprobe -v -r nvme-fabrics 00:10:10.553 11:21:05 nvmf_tcp.nvmf_target_core.nvmf_abort -- nvmf/common.sh@128 -- # set -e 00:10:10.553 11:21:05 nvmf_tcp.nvmf_target_core.nvmf_abort -- nvmf/common.sh@129 -- # return 0 00:10:10.553 11:21:05 nvmf_tcp.nvmf_target_core.nvmf_abort -- nvmf/common.sh@515 -- # '[' -n 62240 ']' 00:10:10.553 11:21:05 nvmf_tcp.nvmf_target_core.nvmf_abort -- nvmf/common.sh@516 -- # killprocess 62240 00:10:10.553 11:21:05 nvmf_tcp.nvmf_target_core.nvmf_abort -- common/autotest_common.sh@950 -- # '[' -z 62240 ']' 00:10:10.553 11:21:05 nvmf_tcp.nvmf_target_core.nvmf_abort -- common/autotest_common.sh@954 -- # kill -0 62240 00:10:10.553 11:21:05 nvmf_tcp.nvmf_target_core.nvmf_abort -- common/autotest_common.sh@955 -- # uname 00:10:10.553 11:21:05 nvmf_tcp.nvmf_target_core.nvmf_abort -- common/autotest_common.sh@955 -- # '[' Linux = Linux ']' 00:10:10.553 11:21:05 nvmf_tcp.nvmf_target_core.nvmf_abort -- common/autotest_common.sh@956 -- # ps --no-headers -o comm= 62240 00:10:10.553 killing process with pid 62240 00:10:10.553 11:21:05 nvmf_tcp.nvmf_target_core.nvmf_abort -- common/autotest_common.sh@956 -- # process_name=reactor_1 00:10:10.553 11:21:05 nvmf_tcp.nvmf_target_core.nvmf_abort -- common/autotest_common.sh@960 -- # '[' reactor_1 = sudo ']' 00:10:10.553 11:21:05 nvmf_tcp.nvmf_target_core.nvmf_abort -- common/autotest_common.sh@968 -- # echo 'killing process with pid 62240' 00:10:10.553 11:21:05 nvmf_tcp.nvmf_target_core.nvmf_abort -- common/autotest_common.sh@969 -- # kill 62240 00:10:10.553 11:21:05 nvmf_tcp.nvmf_target_core.nvmf_abort -- common/autotest_common.sh@974 -- # wait 62240 00:10:10.553 11:21:05 nvmf_tcp.nvmf_target_core.nvmf_abort -- nvmf/common.sh@518 -- # '[' '' == iso ']' 00:10:10.553 11:21:05 nvmf_tcp.nvmf_target_core.nvmf_abort -- nvmf/common.sh@521 -- # [[ tcp == \t\c\p ]] 00:10:10.553 11:21:05 nvmf_tcp.nvmf_target_core.nvmf_abort -- nvmf/common.sh@522 -- # nvmf_tcp_fini 00:10:10.553 11:21:05 nvmf_tcp.nvmf_target_core.nvmf_abort -- nvmf/common.sh@297 -- # iptr 00:10:10.553 11:21:05 nvmf_tcp.nvmf_target_core.nvmf_abort -- nvmf/common.sh@789 -- # iptables-save 00:10:10.553 11:21:05 nvmf_tcp.nvmf_target_core.nvmf_abort -- nvmf/common.sh@789 -- # grep -v SPDK_NVMF 00:10:10.553 11:21:05 nvmf_tcp.nvmf_target_core.nvmf_abort -- nvmf/common.sh@789 -- # iptables-restore 00:10:10.553 11:21:05 nvmf_tcp.nvmf_target_core.nvmf_abort -- nvmf/common.sh@298 -- # [[ nvmf_tgt_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s\_\s\p\d\k ]] 00:10:10.553 11:21:05 nvmf_tcp.nvmf_target_core.nvmf_abort -- nvmf/common.sh@299 -- # nvmf_veth_fini 00:10:10.553 11:21:05 nvmf_tcp.nvmf_target_core.nvmf_abort -- nvmf/common.sh@233 -- # ip link set nvmf_init_br nomaster 00:10:10.553 11:21:05 nvmf_tcp.nvmf_target_core.nvmf_abort -- nvmf/common.sh@234 -- # ip link set nvmf_init_br2 nomaster 00:10:10.553 11:21:05 nvmf_tcp.nvmf_target_core.nvmf_abort -- nvmf/common.sh@235 -- # ip link set nvmf_tgt_br nomaster 00:10:10.553 11:21:05 nvmf_tcp.nvmf_target_core.nvmf_abort -- nvmf/common.sh@236 -- # ip link set nvmf_tgt_br2 nomaster 00:10:10.553 11:21:05 nvmf_tcp.nvmf_target_core.nvmf_abort -- nvmf/common.sh@237 -- # ip link set nvmf_init_br down 00:10:10.553 11:21:05 nvmf_tcp.nvmf_target_core.nvmf_abort -- nvmf/common.sh@238 -- # ip link set nvmf_init_br2 down 00:10:10.553 11:21:05 nvmf_tcp.nvmf_target_core.nvmf_abort -- nvmf/common.sh@239 -- # ip link set nvmf_tgt_br down 00:10:10.553 11:21:05 nvmf_tcp.nvmf_target_core.nvmf_abort -- nvmf/common.sh@240 -- # ip link set nvmf_tgt_br2 down 00:10:10.553 11:21:05 nvmf_tcp.nvmf_target_core.nvmf_abort -- nvmf/common.sh@241 -- # ip link delete nvmf_br type bridge 00:10:10.553 11:21:06 nvmf_tcp.nvmf_target_core.nvmf_abort -- nvmf/common.sh@242 -- # ip link delete nvmf_init_if 00:10:10.812 11:21:06 nvmf_tcp.nvmf_target_core.nvmf_abort -- nvmf/common.sh@243 -- # ip link delete nvmf_init_if2 00:10:10.812 11:21:06 nvmf_tcp.nvmf_target_core.nvmf_abort -- nvmf/common.sh@244 -- # ip netns exec nvmf_tgt_ns_spdk ip link delete nvmf_tgt_if 00:10:10.812 11:21:06 nvmf_tcp.nvmf_target_core.nvmf_abort -- nvmf/common.sh@245 -- # ip netns exec nvmf_tgt_ns_spdk ip link delete nvmf_tgt_if2 00:10:10.812 11:21:06 nvmf_tcp.nvmf_target_core.nvmf_abort -- nvmf/common.sh@246 -- # remove_spdk_ns 00:10:10.812 11:21:06 nvmf_tcp.nvmf_target_core.nvmf_abort -- nvmf/common.sh@654 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:10:10.812 11:21:06 nvmf_tcp.nvmf_target_core.nvmf_abort -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 15> /dev/null' 00:10:10.812 11:21:06 nvmf_tcp.nvmf_target_core.nvmf_abort -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:10:10.812 11:21:06 nvmf_tcp.nvmf_target_core.nvmf_abort -- nvmf/common.sh@300 -- # return 0 00:10:10.812 00:10:10.812 real 0m5.024s 00:10:10.812 user 0m13.015s 00:10:10.812 sys 0m1.198s 00:10:10.812 11:21:06 nvmf_tcp.nvmf_target_core.nvmf_abort -- common/autotest_common.sh@1126 -- # xtrace_disable 00:10:10.812 ************************************ 00:10:10.812 END TEST nvmf_abort 00:10:10.812 ************************************ 00:10:10.812 11:21:06 nvmf_tcp.nvmf_target_core.nvmf_abort -- common/autotest_common.sh@10 -- # set +x 00:10:10.812 11:21:06 nvmf_tcp.nvmf_target_core -- nvmf/nvmf_target_core.sh@22 -- # run_test nvmf_ns_hotplug_stress /home/vagrant/spdk_repo/spdk/test/nvmf/target/ns_hotplug_stress.sh --transport=tcp 00:10:10.812 11:21:06 nvmf_tcp.nvmf_target_core -- common/autotest_common.sh@1101 -- # '[' 3 -le 1 ']' 00:10:10.812 11:21:06 nvmf_tcp.nvmf_target_core -- common/autotest_common.sh@1107 -- # xtrace_disable 00:10:10.812 11:21:06 nvmf_tcp.nvmf_target_core -- common/autotest_common.sh@10 -- # set +x 00:10:10.812 ************************************ 00:10:10.812 START TEST nvmf_ns_hotplug_stress 00:10:10.812 ************************************ 00:10:10.812 11:21:06 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- common/autotest_common.sh@1125 -- # /home/vagrant/spdk_repo/spdk/test/nvmf/target/ns_hotplug_stress.sh --transport=tcp 00:10:10.812 * Looking for test storage... 00:10:10.812 * Found test storage at /home/vagrant/spdk_repo/spdk/test/nvmf/target 00:10:10.812 11:21:06 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- common/autotest_common.sh@1680 -- # [[ y == y ]] 00:10:10.812 11:21:06 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- common/autotest_common.sh@1681 -- # lcov --version 00:10:10.812 11:21:06 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- common/autotest_common.sh@1681 -- # awk '{print $NF}' 00:10:11.071 11:21:06 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- common/autotest_common.sh@1681 -- # lt 1.15 2 00:10:11.071 11:21:06 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- scripts/common.sh@373 -- # cmp_versions 1.15 '<' 2 00:10:11.071 11:21:06 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- scripts/common.sh@333 -- # local ver1 ver1_l 00:10:11.071 11:21:06 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- scripts/common.sh@334 -- # local ver2 ver2_l 00:10:11.071 11:21:06 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- scripts/common.sh@336 -- # IFS=.-: 00:10:11.071 11:21:06 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- scripts/common.sh@336 -- # read -ra ver1 00:10:11.071 11:21:06 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- scripts/common.sh@337 -- # IFS=.-: 00:10:11.071 11:21:06 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- scripts/common.sh@337 -- # read -ra ver2 00:10:11.071 11:21:06 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- scripts/common.sh@338 -- # local 'op=<' 00:10:11.071 11:21:06 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- scripts/common.sh@340 -- # ver1_l=2 00:10:11.071 11:21:06 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- scripts/common.sh@341 -- # ver2_l=1 00:10:11.071 11:21:06 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- scripts/common.sh@343 -- # local lt=0 gt=0 eq=0 v 00:10:11.071 11:21:06 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- scripts/common.sh@344 -- # case "$op" in 00:10:11.071 11:21:06 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- scripts/common.sh@345 -- # : 1 00:10:11.071 11:21:06 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- scripts/common.sh@364 -- # (( v = 0 )) 00:10:11.071 11:21:06 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- scripts/common.sh@364 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:10:11.071 11:21:06 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- scripts/common.sh@365 -- # decimal 1 00:10:11.071 11:21:06 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- scripts/common.sh@353 -- # local d=1 00:10:11.071 11:21:06 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- scripts/common.sh@354 -- # [[ 1 =~ ^[0-9]+$ ]] 00:10:11.071 11:21:06 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- scripts/common.sh@355 -- # echo 1 00:10:11.071 11:21:06 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- scripts/common.sh@365 -- # ver1[v]=1 00:10:11.071 11:21:06 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- scripts/common.sh@366 -- # decimal 2 00:10:11.071 11:21:06 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- scripts/common.sh@353 -- # local d=2 00:10:11.071 11:21:06 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- scripts/common.sh@354 -- # [[ 2 =~ ^[0-9]+$ ]] 00:10:11.071 11:21:06 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- scripts/common.sh@355 -- # echo 2 00:10:11.071 11:21:06 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- scripts/common.sh@366 -- # ver2[v]=2 00:10:11.071 11:21:06 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- scripts/common.sh@367 -- # (( ver1[v] > ver2[v] )) 00:10:11.071 11:21:06 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- scripts/common.sh@368 -- # (( ver1[v] < ver2[v] )) 00:10:11.071 11:21:06 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- scripts/common.sh@368 -- # return 0 00:10:11.071 11:21:06 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- common/autotest_common.sh@1682 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:10:11.071 11:21:06 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- common/autotest_common.sh@1694 -- # export 'LCOV_OPTS= 00:10:11.071 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:10:11.071 --rc genhtml_branch_coverage=1 00:10:11.071 --rc genhtml_function_coverage=1 00:10:11.071 --rc genhtml_legend=1 00:10:11.071 --rc geninfo_all_blocks=1 00:10:11.071 --rc geninfo_unexecuted_blocks=1 00:10:11.071 00:10:11.071 ' 00:10:11.071 11:21:06 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- common/autotest_common.sh@1694 -- # LCOV_OPTS=' 00:10:11.071 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:10:11.071 --rc genhtml_branch_coverage=1 00:10:11.071 --rc genhtml_function_coverage=1 00:10:11.071 --rc genhtml_legend=1 00:10:11.071 --rc geninfo_all_blocks=1 00:10:11.071 --rc geninfo_unexecuted_blocks=1 00:10:11.071 00:10:11.071 ' 00:10:11.071 11:21:06 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- common/autotest_common.sh@1695 -- # export 'LCOV=lcov 00:10:11.071 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:10:11.071 --rc genhtml_branch_coverage=1 00:10:11.071 --rc genhtml_function_coverage=1 00:10:11.071 --rc genhtml_legend=1 00:10:11.071 --rc geninfo_all_blocks=1 00:10:11.071 --rc geninfo_unexecuted_blocks=1 00:10:11.071 00:10:11.071 ' 00:10:11.071 11:21:06 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- common/autotest_common.sh@1695 -- # LCOV='lcov 00:10:11.071 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:10:11.071 --rc genhtml_branch_coverage=1 00:10:11.071 --rc genhtml_function_coverage=1 00:10:11.071 --rc genhtml_legend=1 00:10:11.071 --rc geninfo_all_blocks=1 00:10:11.071 --rc geninfo_unexecuted_blocks=1 00:10:11.071 00:10:11.071 ' 00:10:11.071 11:21:06 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@9 -- # source /home/vagrant/spdk_repo/spdk/test/nvmf/common.sh 00:10:11.071 11:21:06 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- nvmf/common.sh@7 -- # uname -s 00:10:11.072 11:21:06 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:10:11.072 11:21:06 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:10:11.072 11:21:06 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:10:11.072 11:21:06 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:10:11.072 11:21:06 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:10:11.072 11:21:06 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:10:11.072 11:21:06 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:10:11.072 11:21:06 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:10:11.072 11:21:06 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:10:11.072 11:21:06 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:10:11.072 11:21:06 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:c758a4ed-f09f-4c82-9afb-3d096f035464 00:10:11.072 11:21:06 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- nvmf/common.sh@18 -- # NVME_HOSTID=c758a4ed-f09f-4c82-9afb-3d096f035464 00:10:11.072 11:21:06 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:10:11.072 11:21:06 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:10:11.072 11:21:06 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- nvmf/common.sh@21 -- # NET_TYPE=virt 00:10:11.072 11:21:06 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:10:11.072 11:21:06 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- nvmf/common.sh@49 -- # source /home/vagrant/spdk_repo/spdk/scripts/common.sh 00:10:11.072 11:21:06 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- scripts/common.sh@15 -- # shopt -s extglob 00:10:11.072 11:21:06 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- scripts/common.sh@544 -- # [[ -e /bin/wpdk_common.sh ]] 00:10:11.072 11:21:06 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- scripts/common.sh@552 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:10:11.072 11:21:06 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- scripts/common.sh@553 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:10:11.072 11:21:06 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:10:11.072 11:21:06 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:10:11.072 11:21:06 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:10:11.072 11:21:06 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- paths/export.sh@5 -- # export PATH 00:10:11.072 11:21:06 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:10:11.072 11:21:06 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- nvmf/common.sh@51 -- # : 0 00:10:11.072 11:21:06 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- nvmf/common.sh@52 -- # export NVMF_APP_SHM_ID 00:10:11.072 11:21:06 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- nvmf/common.sh@53 -- # build_nvmf_app_args 00:10:11.072 11:21:06 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:10:11.072 11:21:06 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:10:11.072 11:21:06 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:10:11.072 11:21:06 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- nvmf/common.sh@33 -- # '[' '' -eq 1 ']' 00:10:11.072 /home/vagrant/spdk_repo/spdk/test/nvmf/common.sh: line 33: [: : integer expression expected 00:10:11.072 11:21:06 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- nvmf/common.sh@37 -- # '[' -n '' ']' 00:10:11.072 11:21:06 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- nvmf/common.sh@39 -- # '[' 0 -eq 1 ']' 00:10:11.072 11:21:06 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- nvmf/common.sh@55 -- # have_pci_nics=0 00:10:11.072 11:21:06 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@11 -- # rpc_py=/home/vagrant/spdk_repo/spdk/scripts/rpc.py 00:10:11.072 11:21:06 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@22 -- # nvmftestinit 00:10:11.072 11:21:06 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- nvmf/common.sh@467 -- # '[' -z tcp ']' 00:10:11.072 11:21:06 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- nvmf/common.sh@472 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:10:11.072 11:21:06 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- nvmf/common.sh@474 -- # prepare_net_devs 00:10:11.072 11:21:06 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- nvmf/common.sh@436 -- # local -g is_hw=no 00:10:11.072 11:21:06 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- nvmf/common.sh@438 -- # remove_spdk_ns 00:10:11.072 11:21:06 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- nvmf/common.sh@654 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:10:11.072 11:21:06 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 15> /dev/null' 00:10:11.072 11:21:06 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:10:11.072 11:21:06 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- nvmf/common.sh@440 -- # [[ virt != virt ]] 00:10:11.072 11:21:06 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- nvmf/common.sh@442 -- # [[ no == yes ]] 00:10:11.072 11:21:06 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- nvmf/common.sh@449 -- # [[ virt == phy ]] 00:10:11.072 11:21:06 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- nvmf/common.sh@452 -- # [[ virt == phy-fallback ]] 00:10:11.072 11:21:06 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- nvmf/common.sh@457 -- # [[ tcp == tcp ]] 00:10:11.072 11:21:06 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- nvmf/common.sh@458 -- # nvmf_veth_init 00:10:11.072 11:21:06 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- nvmf/common.sh@145 -- # NVMF_FIRST_INITIATOR_IP=10.0.0.1 00:10:11.072 11:21:06 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- nvmf/common.sh@146 -- # NVMF_SECOND_INITIATOR_IP=10.0.0.2 00:10:11.072 11:21:06 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- nvmf/common.sh@147 -- # NVMF_FIRST_TARGET_IP=10.0.0.3 00:10:11.072 11:21:06 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- nvmf/common.sh@148 -- # NVMF_SECOND_TARGET_IP=10.0.0.4 00:10:11.072 11:21:06 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- nvmf/common.sh@149 -- # NVMF_INITIATOR_IP=10.0.0.1 00:10:11.072 11:21:06 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- nvmf/common.sh@150 -- # NVMF_BRIDGE=nvmf_br 00:10:11.072 11:21:06 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- nvmf/common.sh@151 -- # NVMF_INITIATOR_INTERFACE=nvmf_init_if 00:10:11.072 11:21:06 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- nvmf/common.sh@152 -- # NVMF_INITIATOR_INTERFACE2=nvmf_init_if2 00:10:11.072 11:21:06 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- nvmf/common.sh@153 -- # NVMF_INITIATOR_BRIDGE=nvmf_init_br 00:10:11.072 11:21:06 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- nvmf/common.sh@154 -- # NVMF_INITIATOR_BRIDGE2=nvmf_init_br2 00:10:11.072 11:21:06 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- nvmf/common.sh@155 -- # NVMF_TARGET_NAMESPACE=nvmf_tgt_ns_spdk 00:10:11.072 11:21:06 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- nvmf/common.sh@156 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:10:11.072 11:21:06 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- nvmf/common.sh@157 -- # NVMF_TARGET_INTERFACE=nvmf_tgt_if 00:10:11.072 11:21:06 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- nvmf/common.sh@158 -- # NVMF_TARGET_INTERFACE2=nvmf_tgt_if2 00:10:11.072 11:21:06 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- nvmf/common.sh@159 -- # NVMF_TARGET_BRIDGE=nvmf_tgt_br 00:10:11.072 11:21:06 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- nvmf/common.sh@160 -- # NVMF_TARGET_BRIDGE2=nvmf_tgt_br2 00:10:11.072 11:21:06 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- nvmf/common.sh@162 -- # ip link set nvmf_init_br nomaster 00:10:11.072 Cannot find device "nvmf_init_br" 00:10:11.072 11:21:06 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- nvmf/common.sh@162 -- # true 00:10:11.072 11:21:06 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- nvmf/common.sh@163 -- # ip link set nvmf_init_br2 nomaster 00:10:11.072 Cannot find device "nvmf_init_br2" 00:10:11.072 11:21:06 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- nvmf/common.sh@163 -- # true 00:10:11.072 11:21:06 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- nvmf/common.sh@164 -- # ip link set nvmf_tgt_br nomaster 00:10:11.072 Cannot find device "nvmf_tgt_br" 00:10:11.072 11:21:06 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- nvmf/common.sh@164 -- # true 00:10:11.072 11:21:06 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- nvmf/common.sh@165 -- # ip link set nvmf_tgt_br2 nomaster 00:10:11.072 Cannot find device "nvmf_tgt_br2" 00:10:11.072 11:21:06 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- nvmf/common.sh@165 -- # true 00:10:11.072 11:21:06 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- nvmf/common.sh@166 -- # ip link set nvmf_init_br down 00:10:11.072 Cannot find device "nvmf_init_br" 00:10:11.072 11:21:06 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- nvmf/common.sh@166 -- # true 00:10:11.072 11:21:06 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- nvmf/common.sh@167 -- # ip link set nvmf_init_br2 down 00:10:11.072 Cannot find device "nvmf_init_br2" 00:10:11.072 11:21:06 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- nvmf/common.sh@167 -- # true 00:10:11.072 11:21:06 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- nvmf/common.sh@168 -- # ip link set nvmf_tgt_br down 00:10:11.072 Cannot find device "nvmf_tgt_br" 00:10:11.072 11:21:06 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- nvmf/common.sh@168 -- # true 00:10:11.072 11:21:06 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- nvmf/common.sh@169 -- # ip link set nvmf_tgt_br2 down 00:10:11.072 Cannot find device "nvmf_tgt_br2" 00:10:11.072 11:21:06 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- nvmf/common.sh@169 -- # true 00:10:11.072 11:21:06 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- nvmf/common.sh@170 -- # ip link delete nvmf_br type bridge 00:10:11.331 Cannot find device "nvmf_br" 00:10:11.331 11:21:06 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- nvmf/common.sh@170 -- # true 00:10:11.331 11:21:06 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- nvmf/common.sh@171 -- # ip link delete nvmf_init_if 00:10:11.331 Cannot find device "nvmf_init_if" 00:10:11.331 11:21:06 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- nvmf/common.sh@171 -- # true 00:10:11.331 11:21:06 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- nvmf/common.sh@172 -- # ip link delete nvmf_init_if2 00:10:11.331 Cannot find device "nvmf_init_if2" 00:10:11.331 11:21:06 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- nvmf/common.sh@172 -- # true 00:10:11.331 11:21:06 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- nvmf/common.sh@173 -- # ip netns exec nvmf_tgt_ns_spdk ip link delete nvmf_tgt_if 00:10:11.331 Cannot open network namespace "nvmf_tgt_ns_spdk": No such file or directory 00:10:11.331 11:21:06 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- nvmf/common.sh@173 -- # true 00:10:11.331 11:21:06 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- nvmf/common.sh@174 -- # ip netns exec nvmf_tgt_ns_spdk ip link delete nvmf_tgt_if2 00:10:11.331 Cannot open network namespace "nvmf_tgt_ns_spdk": No such file or directory 00:10:11.331 11:21:06 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- nvmf/common.sh@174 -- # true 00:10:11.331 11:21:06 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- nvmf/common.sh@177 -- # ip netns add nvmf_tgt_ns_spdk 00:10:11.331 11:21:06 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- nvmf/common.sh@180 -- # ip link add nvmf_init_if type veth peer name nvmf_init_br 00:10:11.331 11:21:06 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- nvmf/common.sh@181 -- # ip link add nvmf_init_if2 type veth peer name nvmf_init_br2 00:10:11.331 11:21:06 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- nvmf/common.sh@182 -- # ip link add nvmf_tgt_if type veth peer name nvmf_tgt_br 00:10:11.331 11:21:06 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- nvmf/common.sh@183 -- # ip link add nvmf_tgt_if2 type veth peer name nvmf_tgt_br2 00:10:11.331 11:21:06 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- nvmf/common.sh@186 -- # ip link set nvmf_tgt_if netns nvmf_tgt_ns_spdk 00:10:11.331 11:21:06 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- nvmf/common.sh@187 -- # ip link set nvmf_tgt_if2 netns nvmf_tgt_ns_spdk 00:10:11.331 11:21:06 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- nvmf/common.sh@190 -- # ip addr add 10.0.0.1/24 dev nvmf_init_if 00:10:11.331 11:21:06 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- nvmf/common.sh@191 -- # ip addr add 10.0.0.2/24 dev nvmf_init_if2 00:10:11.331 11:21:06 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- nvmf/common.sh@192 -- # ip netns exec nvmf_tgt_ns_spdk ip addr add 10.0.0.3/24 dev nvmf_tgt_if 00:10:11.331 11:21:06 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- nvmf/common.sh@193 -- # ip netns exec nvmf_tgt_ns_spdk ip addr add 10.0.0.4/24 dev nvmf_tgt_if2 00:10:11.331 11:21:06 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- nvmf/common.sh@196 -- # ip link set nvmf_init_if up 00:10:11.331 11:21:06 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- nvmf/common.sh@197 -- # ip link set nvmf_init_if2 up 00:10:11.331 11:21:06 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- nvmf/common.sh@198 -- # ip link set nvmf_init_br up 00:10:11.331 11:21:06 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- nvmf/common.sh@199 -- # ip link set nvmf_init_br2 up 00:10:11.331 11:21:06 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- nvmf/common.sh@200 -- # ip link set nvmf_tgt_br up 00:10:11.331 11:21:06 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- nvmf/common.sh@201 -- # ip link set nvmf_tgt_br2 up 00:10:11.331 11:21:06 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- nvmf/common.sh@202 -- # ip netns exec nvmf_tgt_ns_spdk ip link set nvmf_tgt_if up 00:10:11.331 11:21:06 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- nvmf/common.sh@203 -- # ip netns exec nvmf_tgt_ns_spdk ip link set nvmf_tgt_if2 up 00:10:11.331 11:21:06 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- nvmf/common.sh@204 -- # ip netns exec nvmf_tgt_ns_spdk ip link set lo up 00:10:11.331 11:21:06 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- nvmf/common.sh@207 -- # ip link add nvmf_br type bridge 00:10:11.331 11:21:06 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- nvmf/common.sh@208 -- # ip link set nvmf_br up 00:10:11.331 11:21:06 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- nvmf/common.sh@211 -- # ip link set nvmf_init_br master nvmf_br 00:10:11.331 11:21:06 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- nvmf/common.sh@212 -- # ip link set nvmf_init_br2 master nvmf_br 00:10:11.331 11:21:06 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- nvmf/common.sh@213 -- # ip link set nvmf_tgt_br master nvmf_br 00:10:11.331 11:21:06 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- nvmf/common.sh@214 -- # ip link set nvmf_tgt_br2 master nvmf_br 00:10:11.590 11:21:06 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- nvmf/common.sh@217 -- # ipts -I INPUT 1 -i nvmf_init_if -p tcp --dport 4420 -j ACCEPT 00:10:11.590 11:21:06 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- nvmf/common.sh@788 -- # iptables -I INPUT 1 -i nvmf_init_if -p tcp --dport 4420 -j ACCEPT -m comment --comment 'SPDK_NVMF:-I INPUT 1 -i nvmf_init_if -p tcp --dport 4420 -j ACCEPT' 00:10:11.590 11:21:06 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- nvmf/common.sh@218 -- # ipts -I INPUT 1 -i nvmf_init_if2 -p tcp --dport 4420 -j ACCEPT 00:10:11.590 11:21:06 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- nvmf/common.sh@788 -- # iptables -I INPUT 1 -i nvmf_init_if2 -p tcp --dport 4420 -j ACCEPT -m comment --comment 'SPDK_NVMF:-I INPUT 1 -i nvmf_init_if2 -p tcp --dport 4420 -j ACCEPT' 00:10:11.590 11:21:06 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- nvmf/common.sh@219 -- # ipts -A FORWARD -i nvmf_br -o nvmf_br -j ACCEPT 00:10:11.590 11:21:06 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- nvmf/common.sh@788 -- # iptables -A FORWARD -i nvmf_br -o nvmf_br -j ACCEPT -m comment --comment 'SPDK_NVMF:-A FORWARD -i nvmf_br -o nvmf_br -j ACCEPT' 00:10:11.590 11:21:06 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- nvmf/common.sh@222 -- # ping -c 1 10.0.0.3 00:10:11.590 PING 10.0.0.3 (10.0.0.3) 56(84) bytes of data. 00:10:11.590 64 bytes from 10.0.0.3: icmp_seq=1 ttl=64 time=0.105 ms 00:10:11.590 00:10:11.590 --- 10.0.0.3 ping statistics --- 00:10:11.590 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:10:11.590 rtt min/avg/max/mdev = 0.105/0.105/0.105/0.000 ms 00:10:11.590 11:21:06 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- nvmf/common.sh@223 -- # ping -c 1 10.0.0.4 00:10:11.590 PING 10.0.0.4 (10.0.0.4) 56(84) bytes of data. 00:10:11.590 64 bytes from 10.0.0.4: icmp_seq=1 ttl=64 time=0.067 ms 00:10:11.590 00:10:11.590 --- 10.0.0.4 ping statistics --- 00:10:11.590 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:10:11.590 rtt min/avg/max/mdev = 0.067/0.067/0.067/0.000 ms 00:10:11.590 11:21:06 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- nvmf/common.sh@224 -- # ip netns exec nvmf_tgt_ns_spdk ping -c 1 10.0.0.1 00:10:11.590 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:10:11.590 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.042 ms 00:10:11.590 00:10:11.590 --- 10.0.0.1 ping statistics --- 00:10:11.590 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:10:11.590 rtt min/avg/max/mdev = 0.042/0.042/0.042/0.000 ms 00:10:11.590 11:21:06 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- nvmf/common.sh@225 -- # ip netns exec nvmf_tgt_ns_spdk ping -c 1 10.0.0.2 00:10:11.590 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:10:11.590 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.071 ms 00:10:11.590 00:10:11.590 --- 10.0.0.2 ping statistics --- 00:10:11.590 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:10:11.590 rtt min/avg/max/mdev = 0.071/0.071/0.071/0.000 ms 00:10:11.590 11:21:06 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- nvmf/common.sh@227 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:10:11.590 11:21:06 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- nvmf/common.sh@459 -- # return 0 00:10:11.590 11:21:06 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- nvmf/common.sh@476 -- # '[' '' == iso ']' 00:10:11.590 11:21:06 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- nvmf/common.sh@480 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:10:11.590 11:21:06 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- nvmf/common.sh@481 -- # [[ tcp == \r\d\m\a ]] 00:10:11.590 11:21:06 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- nvmf/common.sh@490 -- # [[ tcp == \t\c\p ]] 00:10:11.590 11:21:06 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- nvmf/common.sh@491 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:10:11.590 11:21:06 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- nvmf/common.sh@494 -- # '[' tcp == tcp ']' 00:10:11.590 11:21:06 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- nvmf/common.sh@500 -- # modprobe nvme-tcp 00:10:11.590 11:21:06 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@23 -- # nvmfappstart -m 0xE 00:10:11.590 11:21:06 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- nvmf/common.sh@505 -- # timing_enter start_nvmf_tgt 00:10:11.590 11:21:06 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- common/autotest_common.sh@724 -- # xtrace_disable 00:10:11.590 11:21:06 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- common/autotest_common.sh@10 -- # set +x 00:10:11.590 11:21:06 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- nvmf/common.sh@507 -- # nvmfpid=62563 00:10:11.590 11:21:06 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- nvmf/common.sh@508 -- # waitforlisten 62563 00:10:11.590 11:21:06 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- common/autotest_common.sh@831 -- # '[' -z 62563 ']' 00:10:11.590 11:21:06 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- nvmf/common.sh@506 -- # ip netns exec nvmf_tgt_ns_spdk /home/vagrant/spdk_repo/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xE 00:10:11.590 11:21:06 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- common/autotest_common.sh@835 -- # local rpc_addr=/var/tmp/spdk.sock 00:10:11.590 11:21:06 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- common/autotest_common.sh@836 -- # local max_retries=100 00:10:11.590 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:10:11.590 11:21:06 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- common/autotest_common.sh@838 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:10:11.590 11:21:06 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- common/autotest_common.sh@840 -- # xtrace_disable 00:10:11.590 11:21:06 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- common/autotest_common.sh@10 -- # set +x 00:10:11.590 [2024-10-07 11:21:06.987942] Starting SPDK v25.01-pre git sha1 2a4f56c54 / DPDK 24.03.0 initialization... 00:10:11.590 [2024-10-07 11:21:06.988059] [ DPDK EAL parameters: nvmf -c 0xE --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --iova-mode=pa --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:10:11.849 [2024-10-07 11:21:07.128485] app.c: 917:spdk_app_start: *NOTICE*: Total cores available: 3 00:10:11.849 [2024-10-07 11:21:07.249790] app.c: 610:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:10:11.849 [2024-10-07 11:21:07.250032] app.c: 611:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:10:11.849 [2024-10-07 11:21:07.250184] app.c: 616:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:10:11.849 [2024-10-07 11:21:07.250251] app.c: 617:app_setup_trace: *NOTICE*: SPDK application currently running. 00:10:11.849 [2024-10-07 11:21:07.250399] app.c: 618:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:10:11.849 [2024-10-07 11:21:07.251015] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 2 00:10:11.849 [2024-10-07 11:21:07.251106] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 3 00:10:11.849 [2024-10-07 11:21:07.251110] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 1 00:10:12.795 11:21:08 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- common/autotest_common.sh@860 -- # (( i == 0 )) 00:10:12.795 11:21:08 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- common/autotest_common.sh@864 -- # return 0 00:10:12.795 11:21:08 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- nvmf/common.sh@509 -- # timing_exit start_nvmf_tgt 00:10:12.795 11:21:08 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- common/autotest_common.sh@730 -- # xtrace_disable 00:10:12.795 11:21:08 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- common/autotest_common.sh@10 -- # set +x 00:10:12.795 11:21:08 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- nvmf/common.sh@510 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:10:12.795 11:21:08 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@25 -- # null_size=1000 00:10:12.795 11:21:08 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@27 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_create_transport -t tcp -o -u 8192 00:10:13.055 [2024-10-07 11:21:08.498038] tcp.c: 738:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:10:13.055 11:21:08 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@29 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 -m 10 00:10:13.620 11:21:08 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@30 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.3 -s 4420 00:10:13.878 [2024-10-07 11:21:09.236809] tcp.c:1081:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.3 port 4420 *** 00:10:13.878 11:21:09 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.3 -s 4420 00:10:14.137 11:21:09 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@32 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py bdev_malloc_create 32 512 -b Malloc0 00:10:14.396 Malloc0 00:10:14.396 11:21:09 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@33 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py bdev_delay_create -b Malloc0 -d Delay0 -r 1000000 -t 1000000 -w 1000000 -n 1000000 00:10:14.987 Delay0 00:10:14.987 11:21:10 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@34 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:10:15.246 11:21:10 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@35 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py bdev_null_create NULL1 1000 512 00:10:15.504 NULL1 00:10:15.504 11:21:10 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@36 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 NULL1 00:10:15.762 11:21:11 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@40 -- # /home/vagrant/spdk_repo/spdk/build/bin/spdk_nvme_perf -c 0x1 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.3 trsvcid:4420' -t 30 -q 128 -w randread -o 512 -Q 1000 00:10:15.762 11:21:11 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@42 -- # PERF_PID=62705 00:10:15.762 11:21:11 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@44 -- # kill -0 62705 00:10:15.762 11:21:11 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@45 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:10:17.136 Read completed with error (sct=0, sc=11) 00:10:17.136 11:21:12 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@46 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:10:17.136 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:10:17.136 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:10:17.137 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:10:17.137 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:10:17.137 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:10:17.137 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:10:17.137 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:10:17.394 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:10:17.394 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:10:17.394 11:21:12 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@49 -- # null_size=1001 00:10:17.394 11:21:12 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@50 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py bdev_null_resize NULL1 1001 00:10:17.652 true 00:10:17.909 11:21:13 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@44 -- # kill -0 62705 00:10:17.909 11:21:13 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@45 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:10:18.473 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:10:18.473 11:21:13 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@46 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:10:18.473 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:10:18.473 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:10:18.473 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:10:18.473 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:10:18.473 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:10:18.731 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:10:18.731 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:10:18.731 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:10:18.731 11:21:14 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@49 -- # null_size=1002 00:10:18.731 11:21:14 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@50 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py bdev_null_resize NULL1 1002 00:10:18.989 true 00:10:18.989 11:21:14 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@44 -- # kill -0 62705 00:10:18.989 11:21:14 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@45 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:10:19.923 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:10:19.923 11:21:15 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@46 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:10:19.923 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:10:19.923 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:10:19.923 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:10:19.923 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:10:19.923 11:21:15 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@49 -- # null_size=1003 00:10:19.923 11:21:15 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@50 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py bdev_null_resize NULL1 1003 00:10:20.181 true 00:10:20.181 11:21:15 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@44 -- # kill -0 62705 00:10:20.181 11:21:15 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@45 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:10:20.439 11:21:15 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@46 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:10:21.005 11:21:16 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@49 -- # null_size=1004 00:10:21.006 11:21:16 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@50 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py bdev_null_resize NULL1 1004 00:10:21.263 true 00:10:21.263 11:21:16 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@44 -- # kill -0 62705 00:10:21.263 11:21:16 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@45 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:10:22.196 11:21:17 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@46 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:10:22.196 11:21:17 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@49 -- # null_size=1005 00:10:22.196 11:21:17 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@50 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py bdev_null_resize NULL1 1005 00:10:22.455 true 00:10:22.455 11:21:17 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@44 -- # kill -0 62705 00:10:22.455 11:21:17 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@45 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:10:22.718 11:21:18 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@46 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:10:22.979 11:21:18 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@49 -- # null_size=1006 00:10:22.979 11:21:18 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@50 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py bdev_null_resize NULL1 1006 00:10:23.237 true 00:10:23.237 11:21:18 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@44 -- # kill -0 62705 00:10:23.237 11:21:18 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@45 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:10:23.495 11:21:19 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@46 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:10:23.753 11:21:19 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@49 -- # null_size=1007 00:10:23.753 11:21:19 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@50 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py bdev_null_resize NULL1 1007 00:10:24.011 true 00:10:24.011 11:21:19 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@44 -- # kill -0 62705 00:10:24.011 11:21:19 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@45 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:10:24.946 11:21:20 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@46 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:10:25.205 11:21:20 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@49 -- # null_size=1008 00:10:25.205 11:21:20 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@50 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py bdev_null_resize NULL1 1008 00:10:25.463 true 00:10:25.463 11:21:20 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@44 -- # kill -0 62705 00:10:25.463 11:21:20 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@45 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:10:25.771 11:21:21 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@46 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:10:26.029 11:21:21 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@49 -- # null_size=1009 00:10:26.029 11:21:21 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@50 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py bdev_null_resize NULL1 1009 00:10:26.287 true 00:10:26.287 11:21:21 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@44 -- # kill -0 62705 00:10:26.287 11:21:21 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@45 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:10:26.545 11:21:22 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@46 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:10:27.111 11:21:22 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@49 -- # null_size=1010 00:10:27.111 11:21:22 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@50 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py bdev_null_resize NULL1 1010 00:10:27.370 true 00:10:27.370 11:21:22 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@44 -- # kill -0 62705 00:10:27.370 11:21:22 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@45 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:10:27.936 11:21:23 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@46 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:10:27.936 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:10:28.195 11:21:23 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@49 -- # null_size=1011 00:10:28.195 11:21:23 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@50 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py bdev_null_resize NULL1 1011 00:10:28.453 true 00:10:28.453 11:21:23 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@44 -- # kill -0 62705 00:10:28.453 11:21:23 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@45 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:10:28.711 11:21:24 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@46 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:10:28.975 11:21:24 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@49 -- # null_size=1012 00:10:28.975 11:21:24 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@50 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py bdev_null_resize NULL1 1012 00:10:29.264 true 00:10:29.264 11:21:24 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@44 -- # kill -0 62705 00:10:29.264 11:21:24 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@45 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:10:29.522 11:21:24 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@46 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:10:29.778 11:21:25 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@49 -- # null_size=1013 00:10:29.778 11:21:25 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@50 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py bdev_null_resize NULL1 1013 00:10:30.035 true 00:10:30.293 11:21:25 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@44 -- # kill -0 62705 00:10:30.293 11:21:25 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@45 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:10:31.227 11:21:26 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@46 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:10:31.227 11:21:26 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@49 -- # null_size=1014 00:10:31.227 11:21:26 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@50 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py bdev_null_resize NULL1 1014 00:10:31.484 true 00:10:31.743 11:21:27 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@44 -- # kill -0 62705 00:10:31.743 11:21:27 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@45 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:10:32.001 11:21:27 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@46 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:10:32.258 11:21:27 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@49 -- # null_size=1015 00:10:32.258 11:21:27 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@50 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py bdev_null_resize NULL1 1015 00:10:32.517 true 00:10:32.517 11:21:27 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@44 -- # kill -0 62705 00:10:32.517 11:21:27 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@45 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:10:32.775 11:21:28 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@46 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:10:33.349 11:21:28 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@49 -- # null_size=1016 00:10:33.349 11:21:28 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@50 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py bdev_null_resize NULL1 1016 00:10:33.609 true 00:10:33.609 11:21:28 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@44 -- # kill -0 62705 00:10:33.610 11:21:28 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@45 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:10:33.868 11:21:29 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@46 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:10:34.125 11:21:29 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@49 -- # null_size=1017 00:10:34.125 11:21:29 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@50 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py bdev_null_resize NULL1 1017 00:10:34.383 true 00:10:34.383 11:21:29 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@44 -- # kill -0 62705 00:10:34.383 11:21:29 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@45 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:10:34.640 11:21:30 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@46 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:10:34.898 11:21:30 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@49 -- # null_size=1018 00:10:34.898 11:21:30 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@50 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py bdev_null_resize NULL1 1018 00:10:35.164 true 00:10:35.164 11:21:30 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@44 -- # kill -0 62705 00:10:35.164 11:21:30 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@45 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:10:36.098 11:21:31 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@46 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:10:36.356 11:21:31 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@49 -- # null_size=1019 00:10:36.356 11:21:31 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@50 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py bdev_null_resize NULL1 1019 00:10:36.619 true 00:10:36.619 11:21:32 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@44 -- # kill -0 62705 00:10:36.619 11:21:32 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@45 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:10:36.878 11:21:32 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@46 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:10:37.137 11:21:32 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@49 -- # null_size=1020 00:10:37.137 11:21:32 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@50 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py bdev_null_resize NULL1 1020 00:10:37.395 true 00:10:37.395 11:21:32 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@44 -- # kill -0 62705 00:10:37.395 11:21:32 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@45 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:10:37.653 11:21:33 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@46 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:10:37.911 11:21:33 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@49 -- # null_size=1021 00:10:37.911 11:21:33 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@50 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py bdev_null_resize NULL1 1021 00:10:38.169 true 00:10:38.169 11:21:33 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@44 -- # kill -0 62705 00:10:38.169 11:21:33 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@45 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:10:39.144 11:21:34 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@46 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:10:39.403 11:21:34 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@49 -- # null_size=1022 00:10:39.403 11:21:34 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@50 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py bdev_null_resize NULL1 1022 00:10:39.661 true 00:10:39.661 11:21:35 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@44 -- # kill -0 62705 00:10:39.661 11:21:35 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@45 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:10:39.920 11:21:35 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@46 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:10:40.179 11:21:35 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@49 -- # null_size=1023 00:10:40.179 11:21:35 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@50 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py bdev_null_resize NULL1 1023 00:10:40.437 true 00:10:40.437 11:21:35 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@44 -- # kill -0 62705 00:10:40.437 11:21:35 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@45 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:10:40.696 11:21:36 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@46 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:10:40.955 11:21:36 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@49 -- # null_size=1024 00:10:40.955 11:21:36 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@50 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py bdev_null_resize NULL1 1024 00:10:41.213 true 00:10:41.213 11:21:36 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@44 -- # kill -0 62705 00:10:41.213 11:21:36 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@45 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:10:42.193 11:21:37 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@46 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:10:42.452 11:21:37 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@49 -- # null_size=1025 00:10:42.452 11:21:37 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@50 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py bdev_null_resize NULL1 1025 00:10:42.710 true 00:10:42.710 11:21:38 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@44 -- # kill -0 62705 00:10:42.710 11:21:38 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@45 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:10:42.975 11:21:38 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@46 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:10:43.237 11:21:38 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@49 -- # null_size=1026 00:10:43.237 11:21:38 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@50 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py bdev_null_resize NULL1 1026 00:10:43.495 true 00:10:43.495 11:21:38 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@44 -- # kill -0 62705 00:10:43.495 11:21:38 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@45 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:10:43.754 11:21:39 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@46 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:10:44.013 11:21:39 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@49 -- # null_size=1027 00:10:44.013 11:21:39 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@50 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py bdev_null_resize NULL1 1027 00:10:44.273 true 00:10:44.273 11:21:39 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@44 -- # kill -0 62705 00:10:44.273 11:21:39 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@45 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:10:45.218 11:21:40 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@46 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:10:45.476 11:21:40 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@49 -- # null_size=1028 00:10:45.476 11:21:40 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@50 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py bdev_null_resize NULL1 1028 00:10:45.734 true 00:10:45.734 11:21:41 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@44 -- # kill -0 62705 00:10:45.734 11:21:41 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@45 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:10:45.992 11:21:41 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@46 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:10:45.992 Initializing NVMe Controllers 00:10:45.992 Attached to NVMe over Fabrics controller at 10.0.0.3:4420: nqn.2016-06.io.spdk:cnode1 00:10:45.992 Controller IO queue size 128, less than required. 00:10:45.992 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:10:45.992 Controller IO queue size 128, less than required. 00:10:45.992 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:10:45.992 Associating TCP (addr:10.0.0.3 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:10:45.992 Associating TCP (addr:10.0.0.3 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 with lcore 0 00:10:45.992 Initialization complete. Launching workers. 00:10:45.992 ======================================================== 00:10:45.992 Latency(us) 00:10:45.992 Device Information : IOPS MiB/s Average min max 00:10:45.992 TCP (addr:10.0.0.3 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 872.33 0.43 62025.35 2605.40 1044681.79 00:10:45.992 TCP (addr:10.0.0.3 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 from core 0: 8600.52 4.20 14882.24 3544.24 638291.77 00:10:45.992 ======================================================== 00:10:45.992 Total : 9472.84 4.63 19223.52 2605.40 1044681.79 00:10:45.992 00:10:46.251 11:21:41 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@49 -- # null_size=1029 00:10:46.251 11:21:41 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@50 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py bdev_null_resize NULL1 1029 00:10:46.509 true 00:10:46.509 11:21:41 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@44 -- # kill -0 62705 00:10:46.509 /home/vagrant/spdk_repo/spdk/test/nvmf/target/ns_hotplug_stress.sh: line 44: kill: (62705) - No such process 00:10:46.509 11:21:41 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@53 -- # wait 62705 00:10:46.509 11:21:41 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@54 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:10:46.767 11:21:42 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@55 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 2 00:10:47.026 11:21:42 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@58 -- # nthreads=8 00:10:47.026 11:21:42 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@58 -- # pids=() 00:10:47.026 11:21:42 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@59 -- # (( i = 0 )) 00:10:47.026 11:21:42 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@59 -- # (( i < nthreads )) 00:10:47.026 11:21:42 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@60 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py bdev_null_create null0 100 4096 00:10:47.285 null0 00:10:47.285 11:21:42 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@59 -- # (( ++i )) 00:10:47.285 11:21:42 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@59 -- # (( i < nthreads )) 00:10:47.285 11:21:42 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@60 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py bdev_null_create null1 100 4096 00:10:47.564 null1 00:10:47.564 11:21:42 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@59 -- # (( ++i )) 00:10:47.564 11:21:42 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@59 -- # (( i < nthreads )) 00:10:47.564 11:21:42 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@60 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py bdev_null_create null2 100 4096 00:10:47.823 null2 00:10:47.823 11:21:43 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@59 -- # (( ++i )) 00:10:47.823 11:21:43 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@59 -- # (( i < nthreads )) 00:10:47.823 11:21:43 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@60 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py bdev_null_create null3 100 4096 00:10:48.081 null3 00:10:48.081 11:21:43 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@59 -- # (( ++i )) 00:10:48.081 11:21:43 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@59 -- # (( i < nthreads )) 00:10:48.081 11:21:43 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@60 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py bdev_null_create null4 100 4096 00:10:48.340 null4 00:10:48.340 11:21:43 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@59 -- # (( ++i )) 00:10:48.340 11:21:43 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@59 -- # (( i < nthreads )) 00:10:48.340 11:21:43 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@60 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py bdev_null_create null5 100 4096 00:10:48.598 null5 00:10:48.858 11:21:44 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@59 -- # (( ++i )) 00:10:48.858 11:21:44 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@59 -- # (( i < nthreads )) 00:10:48.858 11:21:44 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@60 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py bdev_null_create null6 100 4096 00:10:48.858 null6 00:10:49.117 11:21:44 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@59 -- # (( ++i )) 00:10:49.117 11:21:44 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@59 -- # (( i < nthreads )) 00:10:49.117 11:21:44 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@60 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py bdev_null_create null7 100 4096 00:10:49.117 null7 00:10:49.376 11:21:44 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@59 -- # (( ++i )) 00:10:49.376 11:21:44 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@59 -- # (( i < nthreads )) 00:10:49.376 11:21:44 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@62 -- # (( i = 0 )) 00:10:49.376 11:21:44 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@62 -- # (( i < nthreads )) 00:10:49.376 11:21:44 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@64 -- # pids+=($!) 00:10:49.376 11:21:44 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@62 -- # (( ++i )) 00:10:49.376 11:21:44 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@63 -- # add_remove 1 null0 00:10:49.376 11:21:44 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@62 -- # (( i < nthreads )) 00:10:49.376 11:21:44 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@14 -- # local nsid=1 bdev=null0 00:10:49.376 11:21:44 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@16 -- # (( i = 0 )) 00:10:49.376 11:21:44 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:10:49.376 11:21:44 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@64 -- # pids+=($!) 00:10:49.376 11:21:44 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@63 -- # add_remove 2 null1 00:10:49.376 11:21:44 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@17 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 1 nqn.2016-06.io.spdk:cnode1 null0 00:10:49.376 11:21:44 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@62 -- # (( ++i )) 00:10:49.376 11:21:44 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@14 -- # local nsid=2 bdev=null1 00:10:49.376 11:21:44 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@16 -- # (( i = 0 )) 00:10:49.376 11:21:44 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:10:49.376 11:21:44 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@17 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 2 nqn.2016-06.io.spdk:cnode1 null1 00:10:49.376 11:21:44 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@62 -- # (( i < nthreads )) 00:10:49.376 11:21:44 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@64 -- # pids+=($!) 00:10:49.376 11:21:44 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@63 -- # add_remove 3 null2 00:10:49.376 11:21:44 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@62 -- # (( ++i )) 00:10:49.376 11:21:44 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@14 -- # local nsid=3 bdev=null2 00:10:49.376 11:21:44 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@16 -- # (( i = 0 )) 00:10:49.376 11:21:44 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@62 -- # (( i < nthreads )) 00:10:49.376 11:21:44 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:10:49.376 11:21:44 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@17 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 3 nqn.2016-06.io.spdk:cnode1 null2 00:10:49.376 11:21:44 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@64 -- # pids+=($!) 00:10:49.376 11:21:44 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@62 -- # (( ++i )) 00:10:49.376 11:21:44 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@63 -- # add_remove 4 null3 00:10:49.376 11:21:44 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@14 -- # local nsid=4 bdev=null3 00:10:49.376 11:21:44 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@16 -- # (( i = 0 )) 00:10:49.376 11:21:44 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@62 -- # (( i < nthreads )) 00:10:49.376 11:21:44 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:10:49.376 11:21:44 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@17 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 4 nqn.2016-06.io.spdk:cnode1 null3 00:10:49.376 11:21:44 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@64 -- # pids+=($!) 00:10:49.376 11:21:44 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@63 -- # add_remove 5 null4 00:10:49.376 11:21:44 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@14 -- # local nsid=5 bdev=null4 00:10:49.376 11:21:44 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@16 -- # (( i = 0 )) 00:10:49.376 11:21:44 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@62 -- # (( ++i )) 00:10:49.376 11:21:44 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:10:49.376 11:21:44 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@17 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 5 nqn.2016-06.io.spdk:cnode1 null4 00:10:49.376 11:21:44 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@62 -- # (( i < nthreads )) 00:10:49.376 11:21:44 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@64 -- # pids+=($!) 00:10:49.376 11:21:44 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@63 -- # add_remove 6 null5 00:10:49.376 11:21:44 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@62 -- # (( ++i )) 00:10:49.376 11:21:44 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@62 -- # (( i < nthreads )) 00:10:49.376 11:21:44 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@14 -- # local nsid=6 bdev=null5 00:10:49.376 11:21:44 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@16 -- # (( i = 0 )) 00:10:49.376 11:21:44 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:10:49.376 11:21:44 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@17 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 6 nqn.2016-06.io.spdk:cnode1 null5 00:10:49.376 11:21:44 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@64 -- # pids+=($!) 00:10:49.376 11:21:44 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@62 -- # (( ++i )) 00:10:49.376 11:21:44 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@62 -- # (( i < nthreads )) 00:10:49.376 11:21:44 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@64 -- # pids+=($!) 00:10:49.376 11:21:44 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@62 -- # (( ++i )) 00:10:49.376 11:21:44 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@62 -- # (( i < nthreads )) 00:10:49.376 11:21:44 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@63 -- # add_remove 8 null7 00:10:49.376 11:21:44 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@66 -- # wait 63752 63753 63756 63758 63760 63762 63763 63765 00:10:49.376 11:21:44 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@14 -- # local nsid=8 bdev=null7 00:10:49.376 11:21:44 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@16 -- # (( i = 0 )) 00:10:49.376 11:21:44 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:10:49.376 11:21:44 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@63 -- # add_remove 7 null6 00:10:49.376 11:21:44 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@17 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 8 nqn.2016-06.io.spdk:cnode1 null7 00:10:49.376 11:21:44 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@14 -- # local nsid=7 bdev=null6 00:10:49.376 11:21:44 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@16 -- # (( i = 0 )) 00:10:49.376 11:21:44 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:10:49.376 11:21:44 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@17 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 7 nqn.2016-06.io.spdk:cnode1 null6 00:10:49.635 11:21:44 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@18 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 3 00:10:49.635 11:21:44 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@18 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 2 00:10:49.635 11:21:44 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@18 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 4 00:10:49.635 11:21:45 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@18 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 7 00:10:49.635 11:21:45 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@18 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:10:49.635 11:21:45 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@18 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 6 00:10:49.635 11:21:45 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@18 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:10:49.635 11:21:45 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@18 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 8 00:10:49.893 11:21:45 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:10:49.893 11:21:45 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:10:49.893 11:21:45 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@17 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 3 nqn.2016-06.io.spdk:cnode1 null2 00:10:49.893 11:21:45 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:10:49.893 11:21:45 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:10:49.893 11:21:45 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@17 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 2 nqn.2016-06.io.spdk:cnode1 null1 00:10:49.893 11:21:45 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:10:49.893 11:21:45 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:10:49.893 11:21:45 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@17 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 4 nqn.2016-06.io.spdk:cnode1 null3 00:10:49.893 11:21:45 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:10:49.893 11:21:45 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:10:49.893 11:21:45 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@17 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 6 nqn.2016-06.io.spdk:cnode1 null5 00:10:49.893 11:21:45 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:10:49.893 11:21:45 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:10:49.893 11:21:45 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@17 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 1 nqn.2016-06.io.spdk:cnode1 null0 00:10:49.893 11:21:45 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:10:49.893 11:21:45 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:10:49.893 11:21:45 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@17 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 8 nqn.2016-06.io.spdk:cnode1 null7 00:10:49.893 11:21:45 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:10:49.893 11:21:45 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:10:49.893 11:21:45 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@17 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 5 nqn.2016-06.io.spdk:cnode1 null4 00:10:49.893 11:21:45 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:10:49.893 11:21:45 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:10:49.893 11:21:45 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@17 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 7 nqn.2016-06.io.spdk:cnode1 null6 00:10:50.151 11:21:45 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@18 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 4 00:10:50.151 11:21:45 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@18 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 3 00:10:50.151 11:21:45 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@18 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 2 00:10:50.151 11:21:45 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@18 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:10:50.151 11:21:45 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@18 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 6 00:10:50.151 11:21:45 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@18 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 8 00:10:50.151 11:21:45 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@18 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:10:50.409 11:21:45 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@18 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 7 00:10:50.409 11:21:45 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:10:50.409 11:21:45 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:10:50.409 11:21:45 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@17 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 3 nqn.2016-06.io.spdk:cnode1 null2 00:10:50.410 11:21:45 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:10:50.410 11:21:45 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:10:50.410 11:21:45 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@17 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 2 nqn.2016-06.io.spdk:cnode1 null1 00:10:50.410 11:21:45 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:10:50.410 11:21:45 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:10:50.410 11:21:45 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@17 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 4 nqn.2016-06.io.spdk:cnode1 null3 00:10:50.410 11:21:45 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:10:50.410 11:21:45 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:10:50.410 11:21:45 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@17 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 1 nqn.2016-06.io.spdk:cnode1 null0 00:10:50.668 11:21:45 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:10:50.668 11:21:45 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:10:50.668 11:21:45 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@17 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 8 nqn.2016-06.io.spdk:cnode1 null7 00:10:50.668 11:21:45 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:10:50.668 11:21:45 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:10:50.668 11:21:45 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@17 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 6 nqn.2016-06.io.spdk:cnode1 null5 00:10:50.668 11:21:46 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:10:50.668 11:21:46 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:10:50.668 11:21:46 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@17 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 5 nqn.2016-06.io.spdk:cnode1 null4 00:10:50.668 11:21:46 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@18 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 4 00:10:50.668 11:21:46 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:10:50.668 11:21:46 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:10:50.668 11:21:46 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@17 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 7 nqn.2016-06.io.spdk:cnode1 null6 00:10:50.668 11:21:46 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@18 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 3 00:10:50.668 11:21:46 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@18 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:10:50.926 11:21:46 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@18 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 2 00:10:50.926 11:21:46 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@18 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 6 00:10:50.926 11:21:46 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@18 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 8 00:10:50.926 11:21:46 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@18 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:10:50.926 11:21:46 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:10:50.926 11:21:46 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:10:50.926 11:21:46 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@17 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 4 nqn.2016-06.io.spdk:cnode1 null3 00:10:50.926 11:21:46 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@18 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 7 00:10:51.184 11:21:46 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:10:51.184 11:21:46 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:10:51.184 11:21:46 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@17 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 1 nqn.2016-06.io.spdk:cnode1 null0 00:10:51.184 11:21:46 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:10:51.184 11:21:46 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:10:51.184 11:21:46 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@17 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 3 nqn.2016-06.io.spdk:cnode1 null2 00:10:51.184 11:21:46 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:10:51.184 11:21:46 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:10:51.184 11:21:46 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@17 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 6 nqn.2016-06.io.spdk:cnode1 null5 00:10:51.184 11:21:46 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:10:51.184 11:21:46 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:10:51.184 11:21:46 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:10:51.184 11:21:46 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@17 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 8 nqn.2016-06.io.spdk:cnode1 null7 00:10:51.184 11:21:46 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:10:51.184 11:21:46 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@17 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 2 nqn.2016-06.io.spdk:cnode1 null1 00:10:51.184 11:21:46 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:10:51.184 11:21:46 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:10:51.184 11:21:46 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@17 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 5 nqn.2016-06.io.spdk:cnode1 null4 00:10:51.184 11:21:46 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@18 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 4 00:10:51.442 11:21:46 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:10:51.442 11:21:46 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:10:51.442 11:21:46 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@17 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 7 nqn.2016-06.io.spdk:cnode1 null6 00:10:51.442 11:21:46 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@18 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 3 00:10:51.442 11:21:46 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@18 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 6 00:10:51.442 11:21:46 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@18 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:10:51.442 11:21:46 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@18 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 8 00:10:51.442 11:21:46 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@18 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 2 00:10:51.442 11:21:46 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@18 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:10:51.701 11:21:46 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:10:51.701 11:21:46 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:10:51.701 11:21:46 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@17 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 4 nqn.2016-06.io.spdk:cnode1 null3 00:10:51.701 11:21:47 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@18 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 7 00:10:51.701 11:21:47 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:10:51.701 11:21:47 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:10:51.701 11:21:47 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@17 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 3 nqn.2016-06.io.spdk:cnode1 null2 00:10:51.701 11:21:47 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:10:51.701 11:21:47 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:10:51.701 11:21:47 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@17 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 1 nqn.2016-06.io.spdk:cnode1 null0 00:10:51.701 11:21:47 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:10:51.701 11:21:47 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:10:51.701 11:21:47 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@17 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 6 nqn.2016-06.io.spdk:cnode1 null5 00:10:51.701 11:21:47 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:10:51.701 11:21:47 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:10:51.701 11:21:47 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:10:51.701 11:21:47 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:10:51.701 11:21:47 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@17 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 8 nqn.2016-06.io.spdk:cnode1 null7 00:10:51.701 11:21:47 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@17 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 2 nqn.2016-06.io.spdk:cnode1 null1 00:10:51.960 11:21:47 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:10:51.960 11:21:47 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:10:51.960 11:21:47 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@17 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 5 nqn.2016-06.io.spdk:cnode1 null4 00:10:51.960 11:21:47 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@18 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 4 00:10:51.960 11:21:47 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:10:51.960 11:21:47 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:10:51.960 11:21:47 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@17 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 7 nqn.2016-06.io.spdk:cnode1 null6 00:10:51.960 11:21:47 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@18 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 3 00:10:51.960 11:21:47 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@18 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:10:51.960 11:21:47 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@18 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 2 00:10:51.960 11:21:47 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@18 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 6 00:10:51.960 11:21:47 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@18 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 8 00:10:52.218 11:21:47 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@18 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:10:52.218 11:21:47 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:10:52.218 11:21:47 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:10:52.218 11:21:47 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@17 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 4 nqn.2016-06.io.spdk:cnode1 null3 00:10:52.218 11:21:47 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@18 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 7 00:10:52.218 11:21:47 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:10:52.218 11:21:47 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:10:52.218 11:21:47 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@17 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 3 nqn.2016-06.io.spdk:cnode1 null2 00:10:52.477 11:21:47 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:10:52.477 11:21:47 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:10:52.477 11:21:47 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@17 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 8 nqn.2016-06.io.spdk:cnode1 null7 00:10:52.477 11:21:47 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:10:52.477 11:21:47 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:10:52.477 11:21:47 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@17 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 6 nqn.2016-06.io.spdk:cnode1 null5 00:10:52.477 11:21:47 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:10:52.477 11:21:47 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:10:52.477 11:21:47 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@17 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 1 nqn.2016-06.io.spdk:cnode1 null0 00:10:52.477 11:21:47 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:10:52.477 11:21:47 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:10:52.477 11:21:47 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@17 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 2 nqn.2016-06.io.spdk:cnode1 null1 00:10:52.477 11:21:47 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:10:52.477 11:21:47 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:10:52.477 11:21:47 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@17 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 7 nqn.2016-06.io.spdk:cnode1 null6 00:10:52.477 11:21:47 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:10:52.477 11:21:47 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:10:52.477 11:21:47 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@17 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 5 nqn.2016-06.io.spdk:cnode1 null4 00:10:52.477 11:21:47 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@18 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 3 00:10:52.477 11:21:47 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@18 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 4 00:10:52.735 11:21:48 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@18 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 8 00:10:52.735 11:21:48 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@18 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:10:52.735 11:21:48 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@18 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 6 00:10:52.735 11:21:48 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@18 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 2 00:10:52.735 11:21:48 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@18 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 7 00:10:52.735 11:21:48 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@18 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:10:52.998 11:21:48 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:10:52.998 11:21:48 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:10:52.998 11:21:48 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@17 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 3 nqn.2016-06.io.spdk:cnode1 null2 00:10:52.998 11:21:48 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:10:52.998 11:21:48 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:10:52.998 11:21:48 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@17 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 1 nqn.2016-06.io.spdk:cnode1 null0 00:10:52.998 11:21:48 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:10:52.998 11:21:48 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:10:52.998 11:21:48 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@17 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 6 nqn.2016-06.io.spdk:cnode1 null5 00:10:52.998 11:21:48 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:10:52.998 11:21:48 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:10:52.998 11:21:48 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@17 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 8 nqn.2016-06.io.spdk:cnode1 null7 00:10:52.998 11:21:48 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:10:52.998 11:21:48 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:10:52.998 11:21:48 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@17 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 2 nqn.2016-06.io.spdk:cnode1 null1 00:10:52.998 11:21:48 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:10:52.998 11:21:48 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:10:52.998 11:21:48 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@17 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 4 nqn.2016-06.io.spdk:cnode1 null3 00:10:52.998 11:21:48 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:10:52.998 11:21:48 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:10:52.998 11:21:48 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@17 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 5 nqn.2016-06.io.spdk:cnode1 null4 00:10:52.998 11:21:48 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:10:52.998 11:21:48 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:10:52.998 11:21:48 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@17 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 7 nqn.2016-06.io.spdk:cnode1 null6 00:10:53.256 11:21:48 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@18 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 3 00:10:53.256 11:21:48 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@18 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:10:53.256 11:21:48 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@18 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 6 00:10:53.256 11:21:48 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@18 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 8 00:10:53.256 11:21:48 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@18 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 2 00:10:53.256 11:21:48 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@18 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:10:53.256 11:21:48 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@18 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 4 00:10:53.515 11:21:48 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@18 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 7 00:10:53.515 11:21:48 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:10:53.515 11:21:48 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:10:53.515 11:21:48 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@17 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 3 nqn.2016-06.io.spdk:cnode1 null2 00:10:53.515 11:21:48 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:10:53.515 11:21:48 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:10:53.515 11:21:48 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@17 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 1 nqn.2016-06.io.spdk:cnode1 null0 00:10:53.515 11:21:48 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:10:53.515 11:21:48 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:10:53.515 11:21:48 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@17 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 6 nqn.2016-06.io.spdk:cnode1 null5 00:10:53.515 11:21:48 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:10:53.515 11:21:48 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:10:53.515 11:21:48 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@17 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 8 nqn.2016-06.io.spdk:cnode1 null7 00:10:53.515 11:21:48 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:10:53.515 11:21:48 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:10:53.515 11:21:48 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@17 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 2 nqn.2016-06.io.spdk:cnode1 null1 00:10:53.515 11:21:49 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:10:53.515 11:21:49 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:10:53.515 11:21:49 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@17 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 5 nqn.2016-06.io.spdk:cnode1 null4 00:10:53.772 11:21:49 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:10:53.772 11:21:49 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:10:53.772 11:21:49 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@17 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 4 nqn.2016-06.io.spdk:cnode1 null3 00:10:53.772 11:21:49 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:10:53.772 11:21:49 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:10:53.772 11:21:49 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@17 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 7 nqn.2016-06.io.spdk:cnode1 null6 00:10:53.772 11:21:49 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@18 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 3 00:10:53.772 11:21:49 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@18 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:10:53.772 11:21:49 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@18 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 8 00:10:53.772 11:21:49 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@18 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 6 00:10:53.772 11:21:49 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@18 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 2 00:10:54.030 11:21:49 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@18 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:10:54.030 11:21:49 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@18 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 4 00:10:54.030 11:21:49 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@18 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 7 00:10:54.030 11:21:49 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:10:54.030 11:21:49 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:10:54.030 11:21:49 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@17 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 3 nqn.2016-06.io.spdk:cnode1 null2 00:10:54.030 11:21:49 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:10:54.031 11:21:49 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:10:54.031 11:21:49 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@17 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 1 nqn.2016-06.io.spdk:cnode1 null0 00:10:54.031 11:21:49 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:10:54.031 11:21:49 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:10:54.031 11:21:49 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@17 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 2 nqn.2016-06.io.spdk:cnode1 null1 00:10:54.031 11:21:49 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:10:54.031 11:21:49 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:10:54.031 11:21:49 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@17 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 8 nqn.2016-06.io.spdk:cnode1 null7 00:10:54.288 11:21:49 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:10:54.288 11:21:49 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:10:54.288 11:21:49 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@17 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 6 nqn.2016-06.io.spdk:cnode1 null5 00:10:54.288 11:21:49 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:10:54.288 11:21:49 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:10:54.288 11:21:49 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@17 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 5 nqn.2016-06.io.spdk:cnode1 null4 00:10:54.288 11:21:49 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:10:54.288 11:21:49 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:10:54.288 11:21:49 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@17 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 4 nqn.2016-06.io.spdk:cnode1 null3 00:10:54.288 11:21:49 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:10:54.288 11:21:49 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:10:54.288 11:21:49 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@17 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 7 nqn.2016-06.io.spdk:cnode1 null6 00:10:54.288 11:21:49 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@18 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 3 00:10:54.288 11:21:49 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@18 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:10:54.288 11:21:49 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@18 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 2 00:10:54.546 11:21:49 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@18 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 8 00:10:54.546 11:21:49 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@18 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 6 00:10:54.546 11:21:49 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@18 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 7 00:10:54.546 11:21:49 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@18 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:10:54.546 11:21:49 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@18 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 4 00:10:54.546 11:21:50 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:10:54.546 11:21:50 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:10:54.546 11:21:50 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@17 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 1 nqn.2016-06.io.spdk:cnode1 null0 00:10:54.546 11:21:50 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:10:54.546 11:21:50 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:10:54.546 11:21:50 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@17 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 3 nqn.2016-06.io.spdk:cnode1 null2 00:10:54.803 11:21:50 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:10:54.803 11:21:50 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:10:54.803 11:21:50 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@17 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 2 nqn.2016-06.io.spdk:cnode1 null1 00:10:54.803 11:21:50 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:10:54.803 11:21:50 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:10:54.803 11:21:50 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@17 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 8 nqn.2016-06.io.spdk:cnode1 null7 00:10:54.803 11:21:50 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:10:54.803 11:21:50 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:10:54.803 11:21:50 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@17 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 6 nqn.2016-06.io.spdk:cnode1 null5 00:10:54.803 11:21:50 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:10:54.803 11:21:50 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:10:54.803 11:21:50 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@17 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 4 nqn.2016-06.io.spdk:cnode1 null3 00:10:54.803 11:21:50 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:10:54.803 11:21:50 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:10:54.803 11:21:50 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@17 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 7 nqn.2016-06.io.spdk:cnode1 null6 00:10:54.803 11:21:50 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:10:54.803 11:21:50 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:10:54.803 11:21:50 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@17 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 5 nqn.2016-06.io.spdk:cnode1 null4 00:10:54.803 11:21:50 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@18 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:10:55.061 11:21:50 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@18 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 3 00:10:55.061 11:21:50 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@18 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 2 00:10:55.061 11:21:50 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@18 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 6 00:10:55.061 11:21:50 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@18 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 4 00:10:55.061 11:21:50 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@18 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 7 00:10:55.061 11:21:50 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@18 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:10:55.061 11:21:50 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@18 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 8 00:10:55.318 11:21:50 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:10:55.318 11:21:50 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:10:55.318 11:21:50 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:10:55.318 11:21:50 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:10:55.318 11:21:50 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:10:55.318 11:21:50 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:10:55.318 11:21:50 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:10:55.319 11:21:50 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:10:55.319 11:21:50 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:10:55.319 11:21:50 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:10:55.319 11:21:50 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:10:55.319 11:21:50 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:10:55.319 11:21:50 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:10:55.319 11:21:50 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:10:55.319 11:21:50 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:10:55.319 11:21:50 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:10:55.576 11:21:50 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@68 -- # trap - SIGINT SIGTERM EXIT 00:10:55.576 11:21:50 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@70 -- # nvmftestfini 00:10:55.576 11:21:50 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- nvmf/common.sh@514 -- # nvmfcleanup 00:10:55.576 11:21:50 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- nvmf/common.sh@121 -- # sync 00:10:55.576 11:21:50 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- nvmf/common.sh@123 -- # '[' tcp == tcp ']' 00:10:55.576 11:21:50 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- nvmf/common.sh@124 -- # set +e 00:10:55.576 11:21:50 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- nvmf/common.sh@125 -- # for i in {1..20} 00:10:55.576 11:21:50 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- nvmf/common.sh@126 -- # modprobe -v -r nvme-tcp 00:10:55.576 rmmod nvme_tcp 00:10:55.576 rmmod nvme_fabrics 00:10:55.576 rmmod nvme_keyring 00:10:55.576 11:21:50 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- nvmf/common.sh@127 -- # modprobe -v -r nvme-fabrics 00:10:55.576 11:21:50 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- nvmf/common.sh@128 -- # set -e 00:10:55.576 11:21:50 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- nvmf/common.sh@129 -- # return 0 00:10:55.576 11:21:50 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- nvmf/common.sh@515 -- # '[' -n 62563 ']' 00:10:55.577 11:21:50 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- nvmf/common.sh@516 -- # killprocess 62563 00:10:55.577 11:21:50 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- common/autotest_common.sh@950 -- # '[' -z 62563 ']' 00:10:55.577 11:21:50 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- common/autotest_common.sh@954 -- # kill -0 62563 00:10:55.577 11:21:50 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- common/autotest_common.sh@955 -- # uname 00:10:55.577 11:21:50 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- common/autotest_common.sh@955 -- # '[' Linux = Linux ']' 00:10:55.577 11:21:50 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- common/autotest_common.sh@956 -- # ps --no-headers -o comm= 62563 00:10:55.577 11:21:50 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- common/autotest_common.sh@956 -- # process_name=reactor_1 00:10:55.577 11:21:50 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- common/autotest_common.sh@960 -- # '[' reactor_1 = sudo ']' 00:10:55.577 killing process with pid 62563 00:10:55.577 11:21:50 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- common/autotest_common.sh@968 -- # echo 'killing process with pid 62563' 00:10:55.577 11:21:50 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- common/autotest_common.sh@969 -- # kill 62563 00:10:55.577 11:21:50 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- common/autotest_common.sh@974 -- # wait 62563 00:10:55.834 11:21:51 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- nvmf/common.sh@518 -- # '[' '' == iso ']' 00:10:55.834 11:21:51 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- nvmf/common.sh@521 -- # [[ tcp == \t\c\p ]] 00:10:55.834 11:21:51 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- nvmf/common.sh@522 -- # nvmf_tcp_fini 00:10:55.834 11:21:51 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- nvmf/common.sh@297 -- # iptr 00:10:55.834 11:21:51 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- nvmf/common.sh@789 -- # grep -v SPDK_NVMF 00:10:55.834 11:21:51 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- nvmf/common.sh@789 -- # iptables-save 00:10:55.834 11:21:51 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- nvmf/common.sh@789 -- # iptables-restore 00:10:55.834 11:21:51 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- nvmf/common.sh@298 -- # [[ nvmf_tgt_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s\_\s\p\d\k ]] 00:10:55.834 11:21:51 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- nvmf/common.sh@299 -- # nvmf_veth_fini 00:10:55.834 11:21:51 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- nvmf/common.sh@233 -- # ip link set nvmf_init_br nomaster 00:10:55.834 11:21:51 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- nvmf/common.sh@234 -- # ip link set nvmf_init_br2 nomaster 00:10:55.834 11:21:51 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- nvmf/common.sh@235 -- # ip link set nvmf_tgt_br nomaster 00:10:55.834 11:21:51 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- nvmf/common.sh@236 -- # ip link set nvmf_tgt_br2 nomaster 00:10:55.834 11:21:51 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- nvmf/common.sh@237 -- # ip link set nvmf_init_br down 00:10:55.834 11:21:51 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- nvmf/common.sh@238 -- # ip link set nvmf_init_br2 down 00:10:55.834 11:21:51 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- nvmf/common.sh@239 -- # ip link set nvmf_tgt_br down 00:10:55.834 11:21:51 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- nvmf/common.sh@240 -- # ip link set nvmf_tgt_br2 down 00:10:55.834 11:21:51 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- nvmf/common.sh@241 -- # ip link delete nvmf_br type bridge 00:10:55.834 11:21:51 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- nvmf/common.sh@242 -- # ip link delete nvmf_init_if 00:10:55.834 11:21:51 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- nvmf/common.sh@243 -- # ip link delete nvmf_init_if2 00:10:55.834 11:21:51 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- nvmf/common.sh@244 -- # ip netns exec nvmf_tgt_ns_spdk ip link delete nvmf_tgt_if 00:10:56.126 11:21:51 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- nvmf/common.sh@245 -- # ip netns exec nvmf_tgt_ns_spdk ip link delete nvmf_tgt_if2 00:10:56.126 11:21:51 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- nvmf/common.sh@246 -- # remove_spdk_ns 00:10:56.126 11:21:51 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- nvmf/common.sh@654 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:10:56.126 11:21:51 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 15> /dev/null' 00:10:56.126 11:21:51 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:10:56.126 11:21:51 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- nvmf/common.sh@300 -- # return 0 00:10:56.126 00:10:56.126 real 0m45.184s 00:10:56.126 user 3m40.112s 00:10:56.126 sys 0m12.840s 00:10:56.126 11:21:51 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- common/autotest_common.sh@1126 -- # xtrace_disable 00:10:56.126 11:21:51 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- common/autotest_common.sh@10 -- # set +x 00:10:56.126 ************************************ 00:10:56.126 END TEST nvmf_ns_hotplug_stress 00:10:56.126 ************************************ 00:10:56.126 11:21:51 nvmf_tcp.nvmf_target_core -- nvmf/nvmf_target_core.sh@23 -- # run_test nvmf_delete_subsystem /home/vagrant/spdk_repo/spdk/test/nvmf/target/delete_subsystem.sh --transport=tcp 00:10:56.126 11:21:51 nvmf_tcp.nvmf_target_core -- common/autotest_common.sh@1101 -- # '[' 3 -le 1 ']' 00:10:56.126 11:21:51 nvmf_tcp.nvmf_target_core -- common/autotest_common.sh@1107 -- # xtrace_disable 00:10:56.126 11:21:51 nvmf_tcp.nvmf_target_core -- common/autotest_common.sh@10 -- # set +x 00:10:56.126 ************************************ 00:10:56.126 START TEST nvmf_delete_subsystem 00:10:56.126 ************************************ 00:10:56.126 11:21:51 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- common/autotest_common.sh@1125 -- # /home/vagrant/spdk_repo/spdk/test/nvmf/target/delete_subsystem.sh --transport=tcp 00:10:56.126 * Looking for test storage... 00:10:56.126 * Found test storage at /home/vagrant/spdk_repo/spdk/test/nvmf/target 00:10:56.126 11:21:51 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- common/autotest_common.sh@1680 -- # [[ y == y ]] 00:10:56.126 11:21:51 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- common/autotest_common.sh@1681 -- # lcov --version 00:10:56.126 11:21:51 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- common/autotest_common.sh@1681 -- # awk '{print $NF}' 00:10:56.385 11:21:51 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- common/autotest_common.sh@1681 -- # lt 1.15 2 00:10:56.386 11:21:51 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- scripts/common.sh@373 -- # cmp_versions 1.15 '<' 2 00:10:56.386 11:21:51 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- scripts/common.sh@333 -- # local ver1 ver1_l 00:10:56.386 11:21:51 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- scripts/common.sh@334 -- # local ver2 ver2_l 00:10:56.386 11:21:51 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- scripts/common.sh@336 -- # IFS=.-: 00:10:56.386 11:21:51 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- scripts/common.sh@336 -- # read -ra ver1 00:10:56.386 11:21:51 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- scripts/common.sh@337 -- # IFS=.-: 00:10:56.386 11:21:51 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- scripts/common.sh@337 -- # read -ra ver2 00:10:56.386 11:21:51 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- scripts/common.sh@338 -- # local 'op=<' 00:10:56.386 11:21:51 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- scripts/common.sh@340 -- # ver1_l=2 00:10:56.386 11:21:51 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- scripts/common.sh@341 -- # ver2_l=1 00:10:56.386 11:21:51 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- scripts/common.sh@343 -- # local lt=0 gt=0 eq=0 v 00:10:56.386 11:21:51 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- scripts/common.sh@344 -- # case "$op" in 00:10:56.386 11:21:51 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- scripts/common.sh@345 -- # : 1 00:10:56.386 11:21:51 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- scripts/common.sh@364 -- # (( v = 0 )) 00:10:56.386 11:21:51 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- scripts/common.sh@364 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:10:56.386 11:21:51 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- scripts/common.sh@365 -- # decimal 1 00:10:56.386 11:21:51 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- scripts/common.sh@353 -- # local d=1 00:10:56.386 11:21:51 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- scripts/common.sh@354 -- # [[ 1 =~ ^[0-9]+$ ]] 00:10:56.386 11:21:51 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- scripts/common.sh@355 -- # echo 1 00:10:56.386 11:21:51 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- scripts/common.sh@365 -- # ver1[v]=1 00:10:56.386 11:21:51 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- scripts/common.sh@366 -- # decimal 2 00:10:56.386 11:21:51 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- scripts/common.sh@353 -- # local d=2 00:10:56.386 11:21:51 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- scripts/common.sh@354 -- # [[ 2 =~ ^[0-9]+$ ]] 00:10:56.386 11:21:51 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- scripts/common.sh@355 -- # echo 2 00:10:56.386 11:21:51 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- scripts/common.sh@366 -- # ver2[v]=2 00:10:56.386 11:21:51 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- scripts/common.sh@367 -- # (( ver1[v] > ver2[v] )) 00:10:56.386 11:21:51 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- scripts/common.sh@368 -- # (( ver1[v] < ver2[v] )) 00:10:56.386 11:21:51 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- scripts/common.sh@368 -- # return 0 00:10:56.386 11:21:51 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- common/autotest_common.sh@1682 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:10:56.386 11:21:51 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- common/autotest_common.sh@1694 -- # export 'LCOV_OPTS= 00:10:56.386 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:10:56.386 --rc genhtml_branch_coverage=1 00:10:56.386 --rc genhtml_function_coverage=1 00:10:56.386 --rc genhtml_legend=1 00:10:56.386 --rc geninfo_all_blocks=1 00:10:56.386 --rc geninfo_unexecuted_blocks=1 00:10:56.386 00:10:56.386 ' 00:10:56.386 11:21:51 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- common/autotest_common.sh@1694 -- # LCOV_OPTS=' 00:10:56.386 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:10:56.386 --rc genhtml_branch_coverage=1 00:10:56.386 --rc genhtml_function_coverage=1 00:10:56.386 --rc genhtml_legend=1 00:10:56.386 --rc geninfo_all_blocks=1 00:10:56.386 --rc geninfo_unexecuted_blocks=1 00:10:56.386 00:10:56.386 ' 00:10:56.386 11:21:51 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- common/autotest_common.sh@1695 -- # export 'LCOV=lcov 00:10:56.386 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:10:56.386 --rc genhtml_branch_coverage=1 00:10:56.386 --rc genhtml_function_coverage=1 00:10:56.386 --rc genhtml_legend=1 00:10:56.386 --rc geninfo_all_blocks=1 00:10:56.386 --rc geninfo_unexecuted_blocks=1 00:10:56.386 00:10:56.386 ' 00:10:56.386 11:21:51 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- common/autotest_common.sh@1695 -- # LCOV='lcov 00:10:56.386 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:10:56.386 --rc genhtml_branch_coverage=1 00:10:56.386 --rc genhtml_function_coverage=1 00:10:56.386 --rc genhtml_legend=1 00:10:56.386 --rc geninfo_all_blocks=1 00:10:56.386 --rc geninfo_unexecuted_blocks=1 00:10:56.386 00:10:56.386 ' 00:10:56.386 11:21:51 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- target/delete_subsystem.sh@10 -- # source /home/vagrant/spdk_repo/spdk/test/nvmf/common.sh 00:10:56.386 11:21:51 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- nvmf/common.sh@7 -- # uname -s 00:10:56.386 11:21:51 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:10:56.386 11:21:51 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:10:56.386 11:21:51 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:10:56.386 11:21:51 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:10:56.386 11:21:51 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:10:56.386 11:21:51 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:10:56.386 11:21:51 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:10:56.386 11:21:51 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:10:56.386 11:21:51 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:10:56.386 11:21:51 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:10:56.386 11:21:51 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:c758a4ed-f09f-4c82-9afb-3d096f035464 00:10:56.386 11:21:51 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- nvmf/common.sh@18 -- # NVME_HOSTID=c758a4ed-f09f-4c82-9afb-3d096f035464 00:10:56.386 11:21:51 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:10:56.386 11:21:51 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:10:56.386 11:21:51 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- nvmf/common.sh@21 -- # NET_TYPE=virt 00:10:56.386 11:21:51 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:10:56.386 11:21:51 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- nvmf/common.sh@49 -- # source /home/vagrant/spdk_repo/spdk/scripts/common.sh 00:10:56.386 11:21:51 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- scripts/common.sh@15 -- # shopt -s extglob 00:10:56.386 11:21:51 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- scripts/common.sh@544 -- # [[ -e /bin/wpdk_common.sh ]] 00:10:56.386 11:21:51 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- scripts/common.sh@552 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:10:56.386 11:21:51 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- scripts/common.sh@553 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:10:56.386 11:21:51 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:10:56.386 11:21:51 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:10:56.386 11:21:51 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:10:56.386 11:21:51 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- paths/export.sh@5 -- # export PATH 00:10:56.386 11:21:51 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:10:56.386 11:21:51 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- nvmf/common.sh@51 -- # : 0 00:10:56.386 11:21:51 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- nvmf/common.sh@52 -- # export NVMF_APP_SHM_ID 00:10:56.386 11:21:51 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- nvmf/common.sh@53 -- # build_nvmf_app_args 00:10:56.386 11:21:51 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:10:56.386 11:21:51 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:10:56.386 11:21:51 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:10:56.386 11:21:51 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- nvmf/common.sh@33 -- # '[' '' -eq 1 ']' 00:10:56.386 /home/vagrant/spdk_repo/spdk/test/nvmf/common.sh: line 33: [: : integer expression expected 00:10:56.386 11:21:51 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- nvmf/common.sh@37 -- # '[' -n '' ']' 00:10:56.386 11:21:51 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- nvmf/common.sh@39 -- # '[' 0 -eq 1 ']' 00:10:56.386 11:21:51 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- nvmf/common.sh@55 -- # have_pci_nics=0 00:10:56.386 11:21:51 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- target/delete_subsystem.sh@12 -- # nvmftestinit 00:10:56.386 11:21:51 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- nvmf/common.sh@467 -- # '[' -z tcp ']' 00:10:56.386 11:21:51 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- nvmf/common.sh@472 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:10:56.387 11:21:51 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- nvmf/common.sh@474 -- # prepare_net_devs 00:10:56.387 11:21:51 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- nvmf/common.sh@436 -- # local -g is_hw=no 00:10:56.387 11:21:51 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- nvmf/common.sh@438 -- # remove_spdk_ns 00:10:56.387 11:21:51 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- nvmf/common.sh@654 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:10:56.387 11:21:51 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 15> /dev/null' 00:10:56.387 11:21:51 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:10:56.387 11:21:51 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- nvmf/common.sh@440 -- # [[ virt != virt ]] 00:10:56.387 11:21:51 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- nvmf/common.sh@442 -- # [[ no == yes ]] 00:10:56.387 11:21:51 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- nvmf/common.sh@449 -- # [[ virt == phy ]] 00:10:56.387 11:21:51 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- nvmf/common.sh@452 -- # [[ virt == phy-fallback ]] 00:10:56.387 11:21:51 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- nvmf/common.sh@457 -- # [[ tcp == tcp ]] 00:10:56.387 11:21:51 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- nvmf/common.sh@458 -- # nvmf_veth_init 00:10:56.387 11:21:51 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- nvmf/common.sh@145 -- # NVMF_FIRST_INITIATOR_IP=10.0.0.1 00:10:56.387 11:21:51 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- nvmf/common.sh@146 -- # NVMF_SECOND_INITIATOR_IP=10.0.0.2 00:10:56.387 11:21:51 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- nvmf/common.sh@147 -- # NVMF_FIRST_TARGET_IP=10.0.0.3 00:10:56.387 11:21:51 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- nvmf/common.sh@148 -- # NVMF_SECOND_TARGET_IP=10.0.0.4 00:10:56.387 11:21:51 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- nvmf/common.sh@149 -- # NVMF_INITIATOR_IP=10.0.0.1 00:10:56.387 11:21:51 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- nvmf/common.sh@150 -- # NVMF_BRIDGE=nvmf_br 00:10:56.387 11:21:51 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- nvmf/common.sh@151 -- # NVMF_INITIATOR_INTERFACE=nvmf_init_if 00:10:56.387 11:21:51 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- nvmf/common.sh@152 -- # NVMF_INITIATOR_INTERFACE2=nvmf_init_if2 00:10:56.387 11:21:51 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- nvmf/common.sh@153 -- # NVMF_INITIATOR_BRIDGE=nvmf_init_br 00:10:56.387 11:21:51 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- nvmf/common.sh@154 -- # NVMF_INITIATOR_BRIDGE2=nvmf_init_br2 00:10:56.387 11:21:51 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- nvmf/common.sh@155 -- # NVMF_TARGET_NAMESPACE=nvmf_tgt_ns_spdk 00:10:56.387 11:21:51 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- nvmf/common.sh@156 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:10:56.387 11:21:51 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- nvmf/common.sh@157 -- # NVMF_TARGET_INTERFACE=nvmf_tgt_if 00:10:56.387 11:21:51 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- nvmf/common.sh@158 -- # NVMF_TARGET_INTERFACE2=nvmf_tgt_if2 00:10:56.387 11:21:51 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- nvmf/common.sh@159 -- # NVMF_TARGET_BRIDGE=nvmf_tgt_br 00:10:56.387 11:21:51 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- nvmf/common.sh@160 -- # NVMF_TARGET_BRIDGE2=nvmf_tgt_br2 00:10:56.387 11:21:51 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- nvmf/common.sh@162 -- # ip link set nvmf_init_br nomaster 00:10:56.387 Cannot find device "nvmf_init_br" 00:10:56.387 11:21:51 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- nvmf/common.sh@162 -- # true 00:10:56.387 11:21:51 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- nvmf/common.sh@163 -- # ip link set nvmf_init_br2 nomaster 00:10:56.387 Cannot find device "nvmf_init_br2" 00:10:56.387 11:21:51 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- nvmf/common.sh@163 -- # true 00:10:56.387 11:21:51 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- nvmf/common.sh@164 -- # ip link set nvmf_tgt_br nomaster 00:10:56.387 Cannot find device "nvmf_tgt_br" 00:10:56.387 11:21:51 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- nvmf/common.sh@164 -- # true 00:10:56.387 11:21:51 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- nvmf/common.sh@165 -- # ip link set nvmf_tgt_br2 nomaster 00:10:56.387 Cannot find device "nvmf_tgt_br2" 00:10:56.387 11:21:51 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- nvmf/common.sh@165 -- # true 00:10:56.387 11:21:51 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- nvmf/common.sh@166 -- # ip link set nvmf_init_br down 00:10:56.387 Cannot find device "nvmf_init_br" 00:10:56.387 11:21:51 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- nvmf/common.sh@166 -- # true 00:10:56.387 11:21:51 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- nvmf/common.sh@167 -- # ip link set nvmf_init_br2 down 00:10:56.387 Cannot find device "nvmf_init_br2" 00:10:56.387 11:21:51 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- nvmf/common.sh@167 -- # true 00:10:56.387 11:21:51 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- nvmf/common.sh@168 -- # ip link set nvmf_tgt_br down 00:10:56.387 Cannot find device "nvmf_tgt_br" 00:10:56.387 11:21:51 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- nvmf/common.sh@168 -- # true 00:10:56.387 11:21:51 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- nvmf/common.sh@169 -- # ip link set nvmf_tgt_br2 down 00:10:56.387 Cannot find device "nvmf_tgt_br2" 00:10:56.387 11:21:51 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- nvmf/common.sh@169 -- # true 00:10:56.387 11:21:51 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- nvmf/common.sh@170 -- # ip link delete nvmf_br type bridge 00:10:56.387 Cannot find device "nvmf_br" 00:10:56.387 11:21:51 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- nvmf/common.sh@170 -- # true 00:10:56.387 11:21:51 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- nvmf/common.sh@171 -- # ip link delete nvmf_init_if 00:10:56.387 Cannot find device "nvmf_init_if" 00:10:56.387 11:21:51 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- nvmf/common.sh@171 -- # true 00:10:56.387 11:21:51 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- nvmf/common.sh@172 -- # ip link delete nvmf_init_if2 00:10:56.387 Cannot find device "nvmf_init_if2" 00:10:56.387 11:21:51 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- nvmf/common.sh@172 -- # true 00:10:56.387 11:21:51 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- nvmf/common.sh@173 -- # ip netns exec nvmf_tgt_ns_spdk ip link delete nvmf_tgt_if 00:10:56.387 Cannot open network namespace "nvmf_tgt_ns_spdk": No such file or directory 00:10:56.387 11:21:51 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- nvmf/common.sh@173 -- # true 00:10:56.387 11:21:51 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- nvmf/common.sh@174 -- # ip netns exec nvmf_tgt_ns_spdk ip link delete nvmf_tgt_if2 00:10:56.387 Cannot open network namespace "nvmf_tgt_ns_spdk": No such file or directory 00:10:56.387 11:21:51 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- nvmf/common.sh@174 -- # true 00:10:56.387 11:21:51 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- nvmf/common.sh@177 -- # ip netns add nvmf_tgt_ns_spdk 00:10:56.387 11:21:51 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- nvmf/common.sh@180 -- # ip link add nvmf_init_if type veth peer name nvmf_init_br 00:10:56.387 11:21:51 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- nvmf/common.sh@181 -- # ip link add nvmf_init_if2 type veth peer name nvmf_init_br2 00:10:56.387 11:21:51 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- nvmf/common.sh@182 -- # ip link add nvmf_tgt_if type veth peer name nvmf_tgt_br 00:10:56.387 11:21:51 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- nvmf/common.sh@183 -- # ip link add nvmf_tgt_if2 type veth peer name nvmf_tgt_br2 00:10:56.387 11:21:51 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- nvmf/common.sh@186 -- # ip link set nvmf_tgt_if netns nvmf_tgt_ns_spdk 00:10:56.387 11:21:51 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- nvmf/common.sh@187 -- # ip link set nvmf_tgt_if2 netns nvmf_tgt_ns_spdk 00:10:56.646 11:21:51 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- nvmf/common.sh@190 -- # ip addr add 10.0.0.1/24 dev nvmf_init_if 00:10:56.646 11:21:51 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- nvmf/common.sh@191 -- # ip addr add 10.0.0.2/24 dev nvmf_init_if2 00:10:56.646 11:21:51 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- nvmf/common.sh@192 -- # ip netns exec nvmf_tgt_ns_spdk ip addr add 10.0.0.3/24 dev nvmf_tgt_if 00:10:56.646 11:21:51 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- nvmf/common.sh@193 -- # ip netns exec nvmf_tgt_ns_spdk ip addr add 10.0.0.4/24 dev nvmf_tgt_if2 00:10:56.646 11:21:51 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- nvmf/common.sh@196 -- # ip link set nvmf_init_if up 00:10:56.646 11:21:51 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- nvmf/common.sh@197 -- # ip link set nvmf_init_if2 up 00:10:56.646 11:21:51 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- nvmf/common.sh@198 -- # ip link set nvmf_init_br up 00:10:56.646 11:21:51 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- nvmf/common.sh@199 -- # ip link set nvmf_init_br2 up 00:10:56.646 11:21:51 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- nvmf/common.sh@200 -- # ip link set nvmf_tgt_br up 00:10:56.646 11:21:51 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- nvmf/common.sh@201 -- # ip link set nvmf_tgt_br2 up 00:10:56.646 11:21:51 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- nvmf/common.sh@202 -- # ip netns exec nvmf_tgt_ns_spdk ip link set nvmf_tgt_if up 00:10:56.646 11:21:51 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- nvmf/common.sh@203 -- # ip netns exec nvmf_tgt_ns_spdk ip link set nvmf_tgt_if2 up 00:10:56.646 11:21:51 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- nvmf/common.sh@204 -- # ip netns exec nvmf_tgt_ns_spdk ip link set lo up 00:10:56.646 11:21:51 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- nvmf/common.sh@207 -- # ip link add nvmf_br type bridge 00:10:56.646 11:21:51 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- nvmf/common.sh@208 -- # ip link set nvmf_br up 00:10:56.646 11:21:51 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- nvmf/common.sh@211 -- # ip link set nvmf_init_br master nvmf_br 00:10:56.646 11:21:51 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- nvmf/common.sh@212 -- # ip link set nvmf_init_br2 master nvmf_br 00:10:56.646 11:21:51 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- nvmf/common.sh@213 -- # ip link set nvmf_tgt_br master nvmf_br 00:10:56.646 11:21:52 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- nvmf/common.sh@214 -- # ip link set nvmf_tgt_br2 master nvmf_br 00:10:56.646 11:21:52 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- nvmf/common.sh@217 -- # ipts -I INPUT 1 -i nvmf_init_if -p tcp --dport 4420 -j ACCEPT 00:10:56.646 11:21:52 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- nvmf/common.sh@788 -- # iptables -I INPUT 1 -i nvmf_init_if -p tcp --dport 4420 -j ACCEPT -m comment --comment 'SPDK_NVMF:-I INPUT 1 -i nvmf_init_if -p tcp --dport 4420 -j ACCEPT' 00:10:56.646 11:21:52 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- nvmf/common.sh@218 -- # ipts -I INPUT 1 -i nvmf_init_if2 -p tcp --dport 4420 -j ACCEPT 00:10:56.646 11:21:52 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- nvmf/common.sh@788 -- # iptables -I INPUT 1 -i nvmf_init_if2 -p tcp --dport 4420 -j ACCEPT -m comment --comment 'SPDK_NVMF:-I INPUT 1 -i nvmf_init_if2 -p tcp --dport 4420 -j ACCEPT' 00:10:56.646 11:21:52 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- nvmf/common.sh@219 -- # ipts -A FORWARD -i nvmf_br -o nvmf_br -j ACCEPT 00:10:56.646 11:21:52 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- nvmf/common.sh@788 -- # iptables -A FORWARD -i nvmf_br -o nvmf_br -j ACCEPT -m comment --comment 'SPDK_NVMF:-A FORWARD -i nvmf_br -o nvmf_br -j ACCEPT' 00:10:56.646 11:21:52 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- nvmf/common.sh@222 -- # ping -c 1 10.0.0.3 00:10:56.646 PING 10.0.0.3 (10.0.0.3) 56(84) bytes of data. 00:10:56.646 64 bytes from 10.0.0.3: icmp_seq=1 ttl=64 time=0.053 ms 00:10:56.646 00:10:56.646 --- 10.0.0.3 ping statistics --- 00:10:56.646 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:10:56.646 rtt min/avg/max/mdev = 0.053/0.053/0.053/0.000 ms 00:10:56.646 11:21:52 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- nvmf/common.sh@223 -- # ping -c 1 10.0.0.4 00:10:56.646 PING 10.0.0.4 (10.0.0.4) 56(84) bytes of data. 00:10:56.646 64 bytes from 10.0.0.4: icmp_seq=1 ttl=64 time=0.059 ms 00:10:56.646 00:10:56.646 --- 10.0.0.4 ping statistics --- 00:10:56.646 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:10:56.646 rtt min/avg/max/mdev = 0.059/0.059/0.059/0.000 ms 00:10:56.646 11:21:52 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- nvmf/common.sh@224 -- # ip netns exec nvmf_tgt_ns_spdk ping -c 1 10.0.0.1 00:10:56.646 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:10:56.646 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.026 ms 00:10:56.646 00:10:56.646 --- 10.0.0.1 ping statistics --- 00:10:56.646 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:10:56.646 rtt min/avg/max/mdev = 0.026/0.026/0.026/0.000 ms 00:10:56.646 11:21:52 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- nvmf/common.sh@225 -- # ip netns exec nvmf_tgt_ns_spdk ping -c 1 10.0.0.2 00:10:56.646 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:10:56.647 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.059 ms 00:10:56.647 00:10:56.647 --- 10.0.0.2 ping statistics --- 00:10:56.647 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:10:56.647 rtt min/avg/max/mdev = 0.059/0.059/0.059/0.000 ms 00:10:56.647 11:21:52 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- nvmf/common.sh@227 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:10:56.647 11:21:52 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- nvmf/common.sh@459 -- # return 0 00:10:56.647 11:21:52 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- nvmf/common.sh@476 -- # '[' '' == iso ']' 00:10:56.647 11:21:52 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- nvmf/common.sh@480 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:10:56.647 11:21:52 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- nvmf/common.sh@481 -- # [[ tcp == \r\d\m\a ]] 00:10:56.647 11:21:52 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- nvmf/common.sh@490 -- # [[ tcp == \t\c\p ]] 00:10:56.647 11:21:52 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- nvmf/common.sh@491 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:10:56.647 11:21:52 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- nvmf/common.sh@494 -- # '[' tcp == tcp ']' 00:10:56.647 11:21:52 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- nvmf/common.sh@500 -- # modprobe nvme-tcp 00:10:56.647 11:21:52 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- target/delete_subsystem.sh@13 -- # nvmfappstart -m 0x3 00:10:56.647 11:21:52 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- nvmf/common.sh@505 -- # timing_enter start_nvmf_tgt 00:10:56.647 11:21:52 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- common/autotest_common.sh@724 -- # xtrace_disable 00:10:56.647 11:21:52 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- common/autotest_common.sh@10 -- # set +x 00:10:56.647 11:21:52 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- nvmf/common.sh@507 -- # nvmfpid=65150 00:10:56.647 11:21:52 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- nvmf/common.sh@508 -- # waitforlisten 65150 00:10:56.647 11:21:52 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- nvmf/common.sh@506 -- # ip netns exec nvmf_tgt_ns_spdk /home/vagrant/spdk_repo/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x3 00:10:56.647 11:21:52 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- common/autotest_common.sh@831 -- # '[' -z 65150 ']' 00:10:56.647 11:21:52 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- common/autotest_common.sh@835 -- # local rpc_addr=/var/tmp/spdk.sock 00:10:56.647 11:21:52 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- common/autotest_common.sh@836 -- # local max_retries=100 00:10:56.647 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:10:56.647 11:21:52 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- common/autotest_common.sh@838 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:10:56.647 11:21:52 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- common/autotest_common.sh@840 -- # xtrace_disable 00:10:56.647 11:21:52 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- common/autotest_common.sh@10 -- # set +x 00:10:56.647 [2024-10-07 11:21:52.150607] Starting SPDK v25.01-pre git sha1 2a4f56c54 / DPDK 24.03.0 initialization... 00:10:56.647 [2024-10-07 11:21:52.150766] [ DPDK EAL parameters: nvmf -c 0x3 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --iova-mode=pa --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:10:56.906 [2024-10-07 11:21:52.293134] app.c: 917:spdk_app_start: *NOTICE*: Total cores available: 2 00:10:56.906 [2024-10-07 11:21:52.428440] app.c: 610:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:10:56.906 [2024-10-07 11:21:52.428505] app.c: 611:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:10:56.906 [2024-10-07 11:21:52.428520] app.c: 616:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:10:56.906 [2024-10-07 11:21:52.428531] app.c: 617:app_setup_trace: *NOTICE*: SPDK application currently running. 00:10:56.906 [2024-10-07 11:21:52.428540] app.c: 618:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:10:56.906 [2024-10-07 11:21:52.429156] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 1 00:10:56.906 [2024-10-07 11:21:52.429170] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 0 00:10:57.838 11:21:53 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- common/autotest_common.sh@860 -- # (( i == 0 )) 00:10:57.838 11:21:53 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- common/autotest_common.sh@864 -- # return 0 00:10:57.838 11:21:53 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- nvmf/common.sh@509 -- # timing_exit start_nvmf_tgt 00:10:57.838 11:21:53 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- common/autotest_common.sh@730 -- # xtrace_disable 00:10:57.838 11:21:53 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- common/autotest_common.sh@10 -- # set +x 00:10:57.838 11:21:53 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- nvmf/common.sh@510 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:10:57.838 11:21:53 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- target/delete_subsystem.sh@15 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:10:57.838 11:21:53 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- common/autotest_common.sh@561 -- # xtrace_disable 00:10:57.838 11:21:53 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- common/autotest_common.sh@10 -- # set +x 00:10:57.838 [2024-10-07 11:21:53.240111] tcp.c: 738:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:10:57.838 11:21:53 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:10:57.838 11:21:53 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- target/delete_subsystem.sh@16 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 -m 10 00:10:57.838 11:21:53 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- common/autotest_common.sh@561 -- # xtrace_disable 00:10:57.838 11:21:53 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- common/autotest_common.sh@10 -- # set +x 00:10:57.838 11:21:53 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:10:57.838 11:21:53 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- target/delete_subsystem.sh@17 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.3 -s 4420 00:10:57.838 11:21:53 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- common/autotest_common.sh@561 -- # xtrace_disable 00:10:57.838 11:21:53 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- common/autotest_common.sh@10 -- # set +x 00:10:57.838 [2024-10-07 11:21:53.256362] tcp.c:1081:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.3 port 4420 *** 00:10:57.838 11:21:53 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:10:57.838 11:21:53 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- target/delete_subsystem.sh@18 -- # rpc_cmd bdev_null_create NULL1 1000 512 00:10:57.838 11:21:53 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- common/autotest_common.sh@561 -- # xtrace_disable 00:10:57.838 11:21:53 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- common/autotest_common.sh@10 -- # set +x 00:10:57.838 NULL1 00:10:57.838 11:21:53 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:10:57.838 11:21:53 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- target/delete_subsystem.sh@23 -- # rpc_cmd bdev_delay_create -b NULL1 -d Delay0 -r 1000000 -t 1000000 -w 1000000 -n 1000000 00:10:57.838 11:21:53 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- common/autotest_common.sh@561 -- # xtrace_disable 00:10:57.838 11:21:53 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- common/autotest_common.sh@10 -- # set +x 00:10:57.838 Delay0 00:10:57.838 11:21:53 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:10:57.838 11:21:53 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- target/delete_subsystem.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:10:57.838 11:21:53 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- common/autotest_common.sh@561 -- # xtrace_disable 00:10:57.838 11:21:53 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- common/autotest_common.sh@10 -- # set +x 00:10:57.838 11:21:53 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:10:57.838 11:21:53 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- target/delete_subsystem.sh@28 -- # perf_pid=65201 00:10:57.838 11:21:53 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- target/delete_subsystem.sh@26 -- # /home/vagrant/spdk_repo/spdk/build/bin/spdk_nvme_perf -c 0xC -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.3 trsvcid:4420' -t 5 -q 128 -w randrw -M 70 -o 512 -P 4 00:10:57.838 11:21:53 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- target/delete_subsystem.sh@30 -- # sleep 2 00:10:58.096 [2024-10-07 11:21:53.450916] subsystem.c:1641:spdk_nvmf_subsystem_listener_allowed: *WARNING*: Allowing connection to discovery subsystem on TCP/10.0.0.3/4420, even though this listener was not added to the discovery subsystem. This behavior is deprecated and will be removed in a future release. 00:11:00.025 11:21:55 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- target/delete_subsystem.sh@32 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:11:00.025 11:21:55 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:00.025 11:21:55 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- common/autotest_common.sh@10 -- # set +x 00:11:00.025 Read completed with error (sct=0, sc=8) 00:11:00.025 Read completed with error (sct=0, sc=8) 00:11:00.025 Read completed with error (sct=0, sc=8) 00:11:00.025 starting I/O failed: -6 00:11:00.025 Read completed with error (sct=0, sc=8) 00:11:00.025 Write completed with error (sct=0, sc=8) 00:11:00.025 Write completed with error (sct=0, sc=8) 00:11:00.025 Write completed with error (sct=0, sc=8) 00:11:00.025 starting I/O failed: -6 00:11:00.025 Read completed with error (sct=0, sc=8) 00:11:00.025 Write completed with error (sct=0, sc=8) 00:11:00.025 Read completed with error (sct=0, sc=8) 00:11:00.025 Read completed with error (sct=0, sc=8) 00:11:00.025 starting I/O failed: -6 00:11:00.025 Read completed with error (sct=0, sc=8) 00:11:00.025 Write completed with error (sct=0, sc=8) 00:11:00.025 Write completed with error (sct=0, sc=8) 00:11:00.025 Read completed with error (sct=0, sc=8) 00:11:00.025 starting I/O failed: -6 00:11:00.025 Read completed with error (sct=0, sc=8) 00:11:00.025 Read completed with error (sct=0, sc=8) 00:11:00.025 Read completed with error (sct=0, sc=8) 00:11:00.025 Read completed with error (sct=0, sc=8) 00:11:00.025 starting I/O failed: -6 00:11:00.025 Read completed with error (sct=0, sc=8) 00:11:00.025 Read completed with error (sct=0, sc=8) 00:11:00.025 Read completed with error (sct=0, sc=8) 00:11:00.025 Read completed with error (sct=0, sc=8) 00:11:00.025 starting I/O failed: -6 00:11:00.025 Read completed with error (sct=0, sc=8) 00:11:00.025 Write completed with error (sct=0, sc=8) 00:11:00.025 Write completed with error (sct=0, sc=8) 00:11:00.025 Read completed with error (sct=0, sc=8) 00:11:00.025 starting I/O failed: -6 00:11:00.025 Read completed with error (sct=0, sc=8) 00:11:00.025 Read completed with error (sct=0, sc=8) 00:11:00.025 Write completed with error (sct=0, sc=8) 00:11:00.025 Read completed with error (sct=0, sc=8) 00:11:00.025 starting I/O failed: -6 00:11:00.025 Read completed with error (sct=0, sc=8) 00:11:00.025 Read completed with error (sct=0, sc=8) 00:11:00.025 Read completed with error (sct=0, sc=8) 00:11:00.025 Write completed with error (sct=0, sc=8) 00:11:00.025 starting I/O failed: -6 00:11:00.025 Write completed with error (sct=0, sc=8) 00:11:00.025 Read completed with error (sct=0, sc=8) 00:11:00.025 Read completed with error (sct=0, sc=8) 00:11:00.025 Write completed with error (sct=0, sc=8) 00:11:00.025 starting I/O failed: -6 00:11:00.025 Read completed with error (sct=0, sc=8) 00:11:00.025 Write completed with error (sct=0, sc=8) 00:11:00.025 Write completed with error (sct=0, sc=8) 00:11:00.025 Read completed with error (sct=0, sc=8) 00:11:00.025 starting I/O failed: -6 00:11:00.025 Read completed with error (sct=0, sc=8) 00:11:00.025 Read completed with error (sct=0, sc=8) 00:11:00.025 Read completed with error (sct=0, sc=8) 00:11:00.025 [2024-10-07 11:21:55.487858] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1383d00 is same with the state(6) to be set 00:11:00.025 Write completed with error (sct=0, sc=8) 00:11:00.025 Read completed with error (sct=0, sc=8) 00:11:00.025 Read completed with error (sct=0, sc=8) 00:11:00.025 Read completed with error (sct=0, sc=8) 00:11:00.025 Read completed with error (sct=0, sc=8) 00:11:00.025 Write completed with error (sct=0, sc=8) 00:11:00.025 Read completed with error (sct=0, sc=8) 00:11:00.025 Write completed with error (sct=0, sc=8) 00:11:00.025 Read completed with error (sct=0, sc=8) 00:11:00.025 Read completed with error (sct=0, sc=8) 00:11:00.025 Read completed with error (sct=0, sc=8) 00:11:00.025 Read completed with error (sct=0, sc=8) 00:11:00.025 Read completed with error (sct=0, sc=8) 00:11:00.025 Write completed with error (sct=0, sc=8) 00:11:00.025 Read completed with error (sct=0, sc=8) 00:11:00.025 Write completed with error (sct=0, sc=8) 00:11:00.025 Read completed with error (sct=0, sc=8) 00:11:00.025 Read completed with error (sct=0, sc=8) 00:11:00.025 Read completed with error (sct=0, sc=8) 00:11:00.025 Read completed with error (sct=0, sc=8) 00:11:00.025 Read completed with error (sct=0, sc=8) 00:11:00.025 Read completed with error (sct=0, sc=8) 00:11:00.025 Write completed with error (sct=0, sc=8) 00:11:00.025 Read completed with error (sct=0, sc=8) 00:11:00.025 Read completed with error (sct=0, sc=8) 00:11:00.025 Read completed with error (sct=0, sc=8) 00:11:00.025 Write completed with error (sct=0, sc=8) 00:11:00.025 Write completed with error (sct=0, sc=8) 00:11:00.025 Write completed with error (sct=0, sc=8) 00:11:00.025 Read completed with error (sct=0, sc=8) 00:11:00.025 Write completed with error (sct=0, sc=8) 00:11:00.025 Write completed with error (sct=0, sc=8) 00:11:00.025 Read completed with error (sct=0, sc=8) 00:11:00.025 Read completed with error (sct=0, sc=8) 00:11:00.025 Write completed with error (sct=0, sc=8) 00:11:00.025 Read completed with error (sct=0, sc=8) 00:11:00.025 Write completed with error (sct=0, sc=8) 00:11:00.025 Write completed with error (sct=0, sc=8) 00:11:00.025 Read completed with error (sct=0, sc=8) 00:11:00.025 Read completed with error (sct=0, sc=8) 00:11:00.025 Read completed with error (sct=0, sc=8) 00:11:00.025 Read completed with error (sct=0, sc=8) 00:11:00.025 Write completed with error (sct=0, sc=8) 00:11:00.025 Write completed with error (sct=0, sc=8) 00:11:00.025 Read completed with error (sct=0, sc=8) 00:11:00.025 Read completed with error (sct=0, sc=8) 00:11:00.025 Read completed with error (sct=0, sc=8) 00:11:00.025 Read completed with error (sct=0, sc=8) 00:11:00.025 Write completed with error (sct=0, sc=8) 00:11:00.025 Write completed with error (sct=0, sc=8) 00:11:00.025 Write completed with error (sct=0, sc=8) 00:11:00.025 Read completed with error (sct=0, sc=8) 00:11:00.025 Write completed with error (sct=0, sc=8) 00:11:00.025 Read completed with error (sct=0, sc=8) 00:11:00.025 Read completed with error (sct=0, sc=8) 00:11:00.025 Read completed with error (sct=0, sc=8) 00:11:00.025 Read completed with error (sct=0, sc=8) 00:11:00.025 Write completed with error (sct=0, sc=8) 00:11:00.025 Read completed with error (sct=0, sc=8) 00:11:00.025 starting I/O failed: -6 00:11:00.025 Read completed with error (sct=0, sc=8) 00:11:00.025 Write completed with error (sct=0, sc=8) 00:11:00.025 Read completed with error (sct=0, sc=8) 00:11:00.025 Write completed with error (sct=0, sc=8) 00:11:00.025 starting I/O failed: -6 00:11:00.025 Read completed with error (sct=0, sc=8) 00:11:00.025 Write completed with error (sct=0, sc=8) 00:11:00.025 Read completed with error (sct=0, sc=8) 00:11:00.025 Write completed with error (sct=0, sc=8) 00:11:00.025 starting I/O failed: -6 00:11:00.025 Write completed with error (sct=0, sc=8) 00:11:00.025 Write completed with error (sct=0, sc=8) 00:11:00.025 Write completed with error (sct=0, sc=8) 00:11:00.025 Read completed with error (sct=0, sc=8) 00:11:00.025 starting I/O failed: -6 00:11:00.025 Write completed with error (sct=0, sc=8) 00:11:00.025 Write completed with error (sct=0, sc=8) 00:11:00.025 Read completed with error (sct=0, sc=8) 00:11:00.025 Read completed with error (sct=0, sc=8) 00:11:00.025 starting I/O failed: -6 00:11:00.025 Write completed with error (sct=0, sc=8) 00:11:00.025 Read completed with error (sct=0, sc=8) 00:11:00.025 Read completed with error (sct=0, sc=8) 00:11:00.025 Write completed with error (sct=0, sc=8) 00:11:00.025 starting I/O failed: -6 00:11:00.025 Read completed with error (sct=0, sc=8) 00:11:00.025 Read completed with error (sct=0, sc=8) 00:11:00.025 Read completed with error (sct=0, sc=8) 00:11:00.025 Read completed with error (sct=0, sc=8) 00:11:00.025 starting I/O failed: -6 00:11:00.025 Read completed with error (sct=0, sc=8) 00:11:00.025 Read completed with error (sct=0, sc=8) 00:11:00.025 Write completed with error (sct=0, sc=8) 00:11:00.025 Write completed with error (sct=0, sc=8) 00:11:00.025 starting I/O failed: -6 00:11:00.025 Write completed with error (sct=0, sc=8) 00:11:00.025 Write completed with error (sct=0, sc=8) 00:11:00.025 Read completed with error (sct=0, sc=8) 00:11:00.025 Read completed with error (sct=0, sc=8) 00:11:00.025 starting I/O failed: -6 00:11:00.025 Read completed with error (sct=0, sc=8) 00:11:00.025 Write completed with error (sct=0, sc=8) 00:11:00.025 Read completed with error (sct=0, sc=8) 00:11:00.025 Read completed with error (sct=0, sc=8) 00:11:00.025 starting I/O failed: -6 00:11:00.025 Read completed with error (sct=0, sc=8) 00:11:00.025 Read completed with error (sct=0, sc=8) 00:11:00.025 Read completed with error (sct=0, sc=8) 00:11:00.025 Read completed with error (sct=0, sc=8) 00:11:00.025 starting I/O failed: -6 00:11:00.025 Write completed with error (sct=0, sc=8) 00:11:00.025 Read completed with error (sct=0, sc=8) 00:11:00.025 starting I/O failed: -6 00:11:00.025 Read completed with error (sct=0, sc=8) 00:11:00.025 Read completed with error (sct=0, sc=8) 00:11:00.025 starting I/O failed: -6 00:11:00.025 Read completed with error (sct=0, sc=8) 00:11:00.025 Read completed with error (sct=0, sc=8) 00:11:00.025 starting I/O failed: -6 00:11:00.025 Read completed with error (sct=0, sc=8) 00:11:00.025 Read completed with error (sct=0, sc=8) 00:11:00.025 starting I/O failed: -6 00:11:00.025 Write completed with error (sct=0, sc=8) 00:11:00.025 Read completed with error (sct=0, sc=8) 00:11:00.025 starting I/O failed: -6 00:11:00.025 Write completed with error (sct=0, sc=8) 00:11:00.025 Read completed with error (sct=0, sc=8) 00:11:00.025 starting I/O failed: -6 00:11:00.025 Write completed with error (sct=0, sc=8) 00:11:00.025 Read completed with error (sct=0, sc=8) 00:11:00.025 starting I/O failed: -6 00:11:00.025 Write completed with error (sct=0, sc=8) 00:11:00.025 Read completed with error (sct=0, sc=8) 00:11:00.025 starting I/O failed: -6 00:11:00.025 Read completed with error (sct=0, sc=8) 00:11:00.025 Read completed with error (sct=0, sc=8) 00:11:00.025 starting I/O failed: -6 00:11:00.025 Write completed with error (sct=0, sc=8) 00:11:00.025 Read completed with error (sct=0, sc=8) 00:11:00.025 starting I/O failed: -6 00:11:00.025 Read completed with error (sct=0, sc=8) 00:11:00.026 Write completed with error (sct=0, sc=8) 00:11:00.026 starting I/O failed: -6 00:11:00.026 Write completed with error (sct=0, sc=8) 00:11:00.026 Write completed with error (sct=0, sc=8) 00:11:00.026 starting I/O failed: -6 00:11:00.026 Read completed with error (sct=0, sc=8) 00:11:00.026 Write completed with error (sct=0, sc=8) 00:11:00.026 starting I/O failed: -6 00:11:00.026 Read completed with error (sct=0, sc=8) 00:11:00.026 Read completed with error (sct=0, sc=8) 00:11:00.026 starting I/O failed: -6 00:11:00.026 Write completed with error (sct=0, sc=8) 00:11:00.026 Write completed with error (sct=0, sc=8) 00:11:00.026 starting I/O failed: -6 00:11:00.026 Write completed with error (sct=0, sc=8) 00:11:00.026 Read completed with error (sct=0, sc=8) 00:11:00.026 starting I/O failed: -6 00:11:00.026 Write completed with error (sct=0, sc=8) 00:11:00.026 Read completed with error (sct=0, sc=8) 00:11:00.026 starting I/O failed: -6 00:11:00.026 Read completed with error (sct=0, sc=8) 00:11:00.026 Write completed with error (sct=0, sc=8) 00:11:00.026 starting I/O failed: -6 00:11:00.026 Read completed with error (sct=0, sc=8) 00:11:00.026 Read completed with error (sct=0, sc=8) 00:11:00.026 starting I/O failed: -6 00:11:00.026 Read completed with error (sct=0, sc=8) 00:11:00.026 Read completed with error (sct=0, sc=8) 00:11:00.026 starting I/O failed: -6 00:11:00.026 Read completed with error (sct=0, sc=8) 00:11:00.026 Write completed with error (sct=0, sc=8) 00:11:00.026 starting I/O failed: -6 00:11:00.026 Write completed with error (sct=0, sc=8) 00:11:00.026 Read completed with error (sct=0, sc=8) 00:11:00.026 starting I/O failed: -6 00:11:00.026 Read completed with error (sct=0, sc=8) 00:11:00.026 Read completed with error (sct=0, sc=8) 00:11:00.026 starting I/O failed: -6 00:11:00.026 Write completed with error (sct=0, sc=8) 00:11:00.026 Read completed with error (sct=0, sc=8) 00:11:00.026 starting I/O failed: -6 00:11:00.026 Read completed with error (sct=0, sc=8) 00:11:00.026 Read completed with error (sct=0, sc=8) 00:11:00.026 starting I/O failed: -6 00:11:00.026 Write completed with error (sct=0, sc=8) 00:11:00.026 starting I/O failed: -6 00:11:00.026 starting I/O failed: -6 00:11:00.026 starting I/O failed: -6 00:11:00.026 starting I/O failed: -6 00:11:00.026 starting I/O failed: -6 00:11:00.026 starting I/O failed: -6 00:11:00.026 starting I/O failed: -6 00:11:00.026 starting I/O failed: -6 00:11:00.960 [2024-10-07 11:21:56.465347] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x137ffb0 is same with the state(6) to be set 00:11:01.219 Write completed with error (sct=0, sc=8) 00:11:01.219 Read completed with error (sct=0, sc=8) 00:11:01.219 Read completed with error (sct=0, sc=8) 00:11:01.219 Read completed with error (sct=0, sc=8) 00:11:01.219 Read completed with error (sct=0, sc=8) 00:11:01.219 Write completed with error (sct=0, sc=8) 00:11:01.219 Read completed with error (sct=0, sc=8) 00:11:01.219 Write completed with error (sct=0, sc=8) 00:11:01.219 Read completed with error (sct=0, sc=8) 00:11:01.219 Read completed with error (sct=0, sc=8) 00:11:01.219 Write completed with error (sct=0, sc=8) 00:11:01.219 Write completed with error (sct=0, sc=8) 00:11:01.219 Read completed with error (sct=0, sc=8) 00:11:01.219 Read completed with error (sct=0, sc=8) 00:11:01.219 Write completed with error (sct=0, sc=8) 00:11:01.219 Write completed with error (sct=0, sc=8) 00:11:01.219 Read completed with error (sct=0, sc=8) 00:11:01.219 Read completed with error (sct=0, sc=8) 00:11:01.219 Read completed with error (sct=0, sc=8) 00:11:01.219 Read completed with error (sct=0, sc=8) 00:11:01.219 Write completed with error (sct=0, sc=8) 00:11:01.219 Read completed with error (sct=0, sc=8) 00:11:01.219 Write completed with error (sct=0, sc=8) 00:11:01.219 Read completed with error (sct=0, sc=8) 00:11:01.219 Read completed with error (sct=0, sc=8) 00:11:01.219 [2024-10-07 11:21:56.487783] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13c3be0 is same with the state(6) to be set 00:11:01.219 Write completed with error (sct=0, sc=8) 00:11:01.219 Write completed with error (sct=0, sc=8) 00:11:01.219 Read completed with error (sct=0, sc=8) 00:11:01.219 Read completed with error (sct=0, sc=8) 00:11:01.219 Read completed with error (sct=0, sc=8) 00:11:01.219 Read completed with error (sct=0, sc=8) 00:11:01.219 Write completed with error (sct=0, sc=8) 00:11:01.219 Read completed with error (sct=0, sc=8) 00:11:01.219 Read completed with error (sct=0, sc=8) 00:11:01.219 Write completed with error (sct=0, sc=8) 00:11:01.219 Read completed with error (sct=0, sc=8) 00:11:01.219 Read completed with error (sct=0, sc=8) 00:11:01.219 Read completed with error (sct=0, sc=8) 00:11:01.219 Read completed with error (sct=0, sc=8) 00:11:01.219 Read completed with error (sct=0, sc=8) 00:11:01.219 Read completed with error (sct=0, sc=8) 00:11:01.219 Read completed with error (sct=0, sc=8) 00:11:01.219 Read completed with error (sct=0, sc=8) 00:11:01.219 Read completed with error (sct=0, sc=8) 00:11:01.219 Write completed with error (sct=0, sc=8) 00:11:01.219 Read completed with error (sct=0, sc=8) 00:11:01.219 Read completed with error (sct=0, sc=8) 00:11:01.219 Read completed with error (sct=0, sc=8) 00:11:01.219 Read completed with error (sct=0, sc=8) 00:11:01.219 Read completed with error (sct=0, sc=8) 00:11:01.219 Write completed with error (sct=0, sc=8) 00:11:01.219 Read completed with error (sct=0, sc=8) 00:11:01.219 Read completed with error (sct=0, sc=8) 00:11:01.219 Read completed with error (sct=0, sc=8) 00:11:01.219 Write completed with error (sct=0, sc=8) 00:11:01.219 Write completed with error (sct=0, sc=8) 00:11:01.219 Read completed with error (sct=0, sc=8) 00:11:01.219 Read completed with error (sct=0, sc=8) 00:11:01.219 Write completed with error (sct=0, sc=8) 00:11:01.219 Read completed with error (sct=0, sc=8) 00:11:01.219 Write completed with error (sct=0, sc=8) 00:11:01.219 Write completed with error (sct=0, sc=8) 00:11:01.219 Write completed with error (sct=0, sc=8) 00:11:01.219 Read completed with error (sct=0, sc=8) 00:11:01.219 Read completed with error (sct=0, sc=8) 00:11:01.219 Read completed with error (sct=0, sc=8) 00:11:01.219 Read completed with error (sct=0, sc=8) 00:11:01.219 Read completed with error (sct=0, sc=8) 00:11:01.219 Read completed with error (sct=0, sc=8) 00:11:01.219 Write completed with error (sct=0, sc=8) 00:11:01.219 Read completed with error (sct=0, sc=8) 00:11:01.219 Read completed with error (sct=0, sc=8) 00:11:01.219 Read completed with error (sct=0, sc=8) 00:11:01.219 [2024-10-07 11:21:56.488923] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7fac8c00cfe0 is same with the state(6) to be set 00:11:01.219 Read completed with error (sct=0, sc=8) 00:11:01.219 Read completed with error (sct=0, sc=8) 00:11:01.219 Write completed with error (sct=0, sc=8) 00:11:01.219 Write completed with error (sct=0, sc=8) 00:11:01.219 Read completed with error (sct=0, sc=8) 00:11:01.219 Read completed with error (sct=0, sc=8) 00:11:01.219 Read completed with error (sct=0, sc=8) 00:11:01.219 Read completed with error (sct=0, sc=8) 00:11:01.219 Read completed with error (sct=0, sc=8) 00:11:01.219 Read completed with error (sct=0, sc=8) 00:11:01.219 Read completed with error (sct=0, sc=8) 00:11:01.219 Write completed with error (sct=0, sc=8) 00:11:01.219 Read completed with error (sct=0, sc=8) 00:11:01.219 Read completed with error (sct=0, sc=8) 00:11:01.219 Read completed with error (sct=0, sc=8) 00:11:01.219 Write completed with error (sct=0, sc=8) 00:11:01.219 Write completed with error (sct=0, sc=8) 00:11:01.219 Read completed with error (sct=0, sc=8) 00:11:01.219 Read completed with error (sct=0, sc=8) 00:11:01.219 Write completed with error (sct=0, sc=8) 00:11:01.219 Write completed with error (sct=0, sc=8) 00:11:01.219 Read completed with error (sct=0, sc=8) 00:11:01.219 Write completed with error (sct=0, sc=8) 00:11:01.219 Read completed with error (sct=0, sc=8) 00:11:01.219 Write completed with error (sct=0, sc=8) 00:11:01.219 Read completed with error (sct=0, sc=8) 00:11:01.220 [2024-10-07 11:21:56.489194] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1383b20 is same with the state(6) to be set 00:11:01.220 Write completed with error (sct=0, sc=8) 00:11:01.220 Read completed with error (sct=0, sc=8) 00:11:01.220 Read completed with error (sct=0, sc=8) 00:11:01.220 Read completed with error (sct=0, sc=8) 00:11:01.220 Read completed with error (sct=0, sc=8) 00:11:01.220 Read completed with error (sct=0, sc=8) 00:11:01.220 Write completed with error (sct=0, sc=8) 00:11:01.220 Read completed with error (sct=0, sc=8) 00:11:01.220 Read completed with error (sct=0, sc=8) 00:11:01.220 Write completed with error (sct=0, sc=8) 00:11:01.220 Read completed with error (sct=0, sc=8) 00:11:01.220 Write completed with error (sct=0, sc=8) 00:11:01.220 Write completed with error (sct=0, sc=8) 00:11:01.220 Read completed with error (sct=0, sc=8) 00:11:01.220 Read completed with error (sct=0, sc=8) 00:11:01.220 Read completed with error (sct=0, sc=8) 00:11:01.220 Write completed with error (sct=0, sc=8) 00:11:01.220 Read completed with error (sct=0, sc=8) 00:11:01.220 Write completed with error (sct=0, sc=8) 00:11:01.220 Read completed with error (sct=0, sc=8) 00:11:01.220 Write completed with error (sct=0, sc=8) 00:11:01.220 Read completed with error (sct=0, sc=8) 00:11:01.220 Read completed with error (sct=0, sc=8) 00:11:01.220 Write completed with error (sct=0, sc=8) 00:11:01.220 Write completed with error (sct=0, sc=8) 00:11:01.220 Write completed with error (sct=0, sc=8) 00:11:01.220 Read completed with error (sct=0, sc=8) 00:11:01.220 Write completed with error (sct=0, sc=8) 00:11:01.220 Read completed with error (sct=0, sc=8) 00:11:01.220 Read completed with error (sct=0, sc=8) 00:11:01.220 Write completed with error (sct=0, sc=8) 00:11:01.220 Read completed with error (sct=0, sc=8) 00:11:01.220 Read completed with error (sct=0, sc=8) 00:11:01.220 Read completed with error (sct=0, sc=8) 00:11:01.220 Write completed with error (sct=0, sc=8) 00:11:01.220 Read completed with error (sct=0, sc=8) 00:11:01.220 [2024-10-07 11:21:56.490484] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7fac8c00d640 is same with the state(6) to be set 00:11:01.220 Initializing NVMe Controllers 00:11:01.220 Attached to NVMe over Fabrics controller at 10.0.0.3:4420: nqn.2016-06.io.spdk:cnode1 00:11:01.220 Controller IO queue size 128, less than required. 00:11:01.220 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:11:01.220 Associating TCP (addr:10.0.0.3 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 2 00:11:01.220 Associating TCP (addr:10.0.0.3 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 3 00:11:01.220 Initialization complete. Launching workers. 00:11:01.220 ======================================================== 00:11:01.220 Latency(us) 00:11:01.220 Device Information : IOPS MiB/s Average min max 00:11:01.220 TCP (addr:10.0.0.3 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 2: 172.22 0.08 890189.44 415.94 1012031.40 00:11:01.220 TCP (addr:10.0.0.3 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 3: 176.69 0.09 960718.05 1288.32 2002240.13 00:11:01.220 ======================================================== 00:11:01.220 Total : 348.91 0.17 925905.21 415.94 2002240.13 00:11:01.220 00:11:01.220 [2024-10-07 11:21:56.491266] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x137ffb0 (9): Bad file descriptor 00:11:01.220 /home/vagrant/spdk_repo/spdk/build/bin/spdk_nvme_perf: errors occurred 00:11:01.220 11:21:56 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:01.220 11:21:56 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- target/delete_subsystem.sh@34 -- # delay=0 00:11:01.220 11:21:56 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- target/delete_subsystem.sh@35 -- # kill -0 65201 00:11:01.220 11:21:56 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- target/delete_subsystem.sh@36 -- # sleep 0.5 00:11:01.479 11:21:56 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- target/delete_subsystem.sh@38 -- # (( delay++ > 30 )) 00:11:01.479 11:21:56 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- target/delete_subsystem.sh@35 -- # kill -0 65201 00:11:01.479 /home/vagrant/spdk_repo/spdk/test/nvmf/target/delete_subsystem.sh: line 35: kill: (65201) - No such process 00:11:01.479 11:21:56 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- target/delete_subsystem.sh@45 -- # NOT wait 65201 00:11:01.479 11:21:56 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- common/autotest_common.sh@650 -- # local es=0 00:11:01.479 11:21:56 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- common/autotest_common.sh@652 -- # valid_exec_arg wait 65201 00:11:01.479 11:21:56 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- common/autotest_common.sh@638 -- # local arg=wait 00:11:01.479 11:21:56 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:11:01.479 11:21:56 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- common/autotest_common.sh@642 -- # type -t wait 00:11:01.479 11:21:56 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:11:01.479 11:21:57 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- common/autotest_common.sh@653 -- # wait 65201 00:11:01.479 11:21:57 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- common/autotest_common.sh@653 -- # es=1 00:11:01.479 11:21:57 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:11:01.737 11:21:57 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:11:01.737 11:21:57 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:11:01.737 11:21:57 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- target/delete_subsystem.sh@48 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 -m 10 00:11:01.737 11:21:57 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:01.737 11:21:57 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- common/autotest_common.sh@10 -- # set +x 00:11:01.737 11:21:57 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:01.737 11:21:57 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- target/delete_subsystem.sh@49 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.3 -s 4420 00:11:01.737 11:21:57 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:01.737 11:21:57 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- common/autotest_common.sh@10 -- # set +x 00:11:01.737 [2024-10-07 11:21:57.017126] tcp.c:1081:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.3 port 4420 *** 00:11:01.737 11:21:57 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:01.737 11:21:57 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- target/delete_subsystem.sh@50 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:11:01.737 11:21:57 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:01.737 11:21:57 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- common/autotest_common.sh@10 -- # set +x 00:11:01.737 11:21:57 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:01.737 11:21:57 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- target/delete_subsystem.sh@54 -- # perf_pid=65251 00:11:01.737 11:21:57 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- target/delete_subsystem.sh@56 -- # delay=0 00:11:01.737 11:21:57 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- target/delete_subsystem.sh@57 -- # kill -0 65251 00:11:01.737 11:21:57 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- target/delete_subsystem.sh@52 -- # /home/vagrant/spdk_repo/spdk/build/bin/spdk_nvme_perf -c 0xC -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.3 trsvcid:4420' -t 3 -q 128 -w randrw -M 70 -o 512 -P 4 00:11:01.737 11:21:57 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- target/delete_subsystem.sh@58 -- # sleep 0.5 00:11:01.737 [2024-10-07 11:21:57.205073] subsystem.c:1641:spdk_nvmf_subsystem_listener_allowed: *WARNING*: Allowing connection to discovery subsystem on TCP/10.0.0.3/4420, even though this listener was not added to the discovery subsystem. This behavior is deprecated and will be removed in a future release. 00:11:02.303 11:21:57 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- target/delete_subsystem.sh@60 -- # (( delay++ > 20 )) 00:11:02.303 11:21:57 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- target/delete_subsystem.sh@57 -- # kill -0 65251 00:11:02.303 11:21:57 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- target/delete_subsystem.sh@58 -- # sleep 0.5 00:11:02.562 11:21:58 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- target/delete_subsystem.sh@60 -- # (( delay++ > 20 )) 00:11:02.562 11:21:58 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- target/delete_subsystem.sh@57 -- # kill -0 65251 00:11:02.562 11:21:58 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- target/delete_subsystem.sh@58 -- # sleep 0.5 00:11:03.128 11:21:58 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- target/delete_subsystem.sh@60 -- # (( delay++ > 20 )) 00:11:03.128 11:21:58 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- target/delete_subsystem.sh@57 -- # kill -0 65251 00:11:03.128 11:21:58 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- target/delete_subsystem.sh@58 -- # sleep 0.5 00:11:03.694 11:21:59 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- target/delete_subsystem.sh@60 -- # (( delay++ > 20 )) 00:11:03.694 11:21:59 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- target/delete_subsystem.sh@57 -- # kill -0 65251 00:11:03.694 11:21:59 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- target/delete_subsystem.sh@58 -- # sleep 0.5 00:11:04.328 11:21:59 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- target/delete_subsystem.sh@60 -- # (( delay++ > 20 )) 00:11:04.328 11:21:59 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- target/delete_subsystem.sh@57 -- # kill -0 65251 00:11:04.328 11:21:59 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- target/delete_subsystem.sh@58 -- # sleep 0.5 00:11:04.604 11:22:00 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- target/delete_subsystem.sh@60 -- # (( delay++ > 20 )) 00:11:04.604 11:22:00 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- target/delete_subsystem.sh@57 -- # kill -0 65251 00:11:04.604 11:22:00 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- target/delete_subsystem.sh@58 -- # sleep 0.5 00:11:04.863 Initializing NVMe Controllers 00:11:04.863 Attached to NVMe over Fabrics controller at 10.0.0.3:4420: nqn.2016-06.io.spdk:cnode1 00:11:04.863 Controller IO queue size 128, less than required. 00:11:04.863 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:11:04.863 Associating TCP (addr:10.0.0.3 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 2 00:11:04.863 Associating TCP (addr:10.0.0.3 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 3 00:11:04.863 Initialization complete. Launching workers. 00:11:04.863 ======================================================== 00:11:04.863 Latency(us) 00:11:04.863 Device Information : IOPS MiB/s Average min max 00:11:04.863 TCP (addr:10.0.0.3 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 2: 128.00 0.06 1003788.15 1000163.51 1041245.63 00:11:04.863 TCP (addr:10.0.0.3 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 3: 128.00 0.06 1004467.34 1000223.95 1041190.74 00:11:04.863 ======================================================== 00:11:04.863 Total : 256.00 0.12 1004127.75 1000163.51 1041245.63 00:11:04.863 00:11:05.121 11:22:00 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- target/delete_subsystem.sh@60 -- # (( delay++ > 20 )) 00:11:05.121 11:22:00 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- target/delete_subsystem.sh@57 -- # kill -0 65251 00:11:05.121 /home/vagrant/spdk_repo/spdk/test/nvmf/target/delete_subsystem.sh: line 57: kill: (65251) - No such process 00:11:05.121 11:22:00 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- target/delete_subsystem.sh@67 -- # wait 65251 00:11:05.121 11:22:00 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- target/delete_subsystem.sh@69 -- # trap - SIGINT SIGTERM EXIT 00:11:05.121 11:22:00 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- target/delete_subsystem.sh@71 -- # nvmftestfini 00:11:05.121 11:22:00 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- nvmf/common.sh@514 -- # nvmfcleanup 00:11:05.121 11:22:00 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- nvmf/common.sh@121 -- # sync 00:11:05.121 11:22:00 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- nvmf/common.sh@123 -- # '[' tcp == tcp ']' 00:11:05.121 11:22:00 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- nvmf/common.sh@124 -- # set +e 00:11:05.121 11:22:00 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- nvmf/common.sh@125 -- # for i in {1..20} 00:11:05.121 11:22:00 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- nvmf/common.sh@126 -- # modprobe -v -r nvme-tcp 00:11:05.121 rmmod nvme_tcp 00:11:05.121 rmmod nvme_fabrics 00:11:05.121 rmmod nvme_keyring 00:11:05.379 11:22:00 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- nvmf/common.sh@127 -- # modprobe -v -r nvme-fabrics 00:11:05.379 11:22:00 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- nvmf/common.sh@128 -- # set -e 00:11:05.379 11:22:00 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- nvmf/common.sh@129 -- # return 0 00:11:05.379 11:22:00 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- nvmf/common.sh@515 -- # '[' -n 65150 ']' 00:11:05.379 11:22:00 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- nvmf/common.sh@516 -- # killprocess 65150 00:11:05.379 11:22:00 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- common/autotest_common.sh@950 -- # '[' -z 65150 ']' 00:11:05.379 11:22:00 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- common/autotest_common.sh@954 -- # kill -0 65150 00:11:05.379 11:22:00 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- common/autotest_common.sh@955 -- # uname 00:11:05.379 11:22:00 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- common/autotest_common.sh@955 -- # '[' Linux = Linux ']' 00:11:05.379 11:22:00 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- common/autotest_common.sh@956 -- # ps --no-headers -o comm= 65150 00:11:05.379 killing process with pid 65150 00:11:05.379 11:22:00 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- common/autotest_common.sh@956 -- # process_name=reactor_0 00:11:05.379 11:22:00 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- common/autotest_common.sh@960 -- # '[' reactor_0 = sudo ']' 00:11:05.379 11:22:00 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- common/autotest_common.sh@968 -- # echo 'killing process with pid 65150' 00:11:05.379 11:22:00 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- common/autotest_common.sh@969 -- # kill 65150 00:11:05.379 11:22:00 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- common/autotest_common.sh@974 -- # wait 65150 00:11:05.637 11:22:00 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- nvmf/common.sh@518 -- # '[' '' == iso ']' 00:11:05.637 11:22:00 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- nvmf/common.sh@521 -- # [[ tcp == \t\c\p ]] 00:11:05.637 11:22:00 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- nvmf/common.sh@522 -- # nvmf_tcp_fini 00:11:05.638 11:22:00 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- nvmf/common.sh@297 -- # iptr 00:11:05.638 11:22:00 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- nvmf/common.sh@789 -- # iptables-save 00:11:05.638 11:22:00 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- nvmf/common.sh@789 -- # grep -v SPDK_NVMF 00:11:05.638 11:22:00 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- nvmf/common.sh@789 -- # iptables-restore 00:11:05.638 11:22:00 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- nvmf/common.sh@298 -- # [[ nvmf_tgt_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s\_\s\p\d\k ]] 00:11:05.638 11:22:00 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- nvmf/common.sh@299 -- # nvmf_veth_fini 00:11:05.638 11:22:00 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- nvmf/common.sh@233 -- # ip link set nvmf_init_br nomaster 00:11:05.638 11:22:00 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- nvmf/common.sh@234 -- # ip link set nvmf_init_br2 nomaster 00:11:05.638 11:22:00 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- nvmf/common.sh@235 -- # ip link set nvmf_tgt_br nomaster 00:11:05.638 11:22:00 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- nvmf/common.sh@236 -- # ip link set nvmf_tgt_br2 nomaster 00:11:05.638 11:22:01 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- nvmf/common.sh@237 -- # ip link set nvmf_init_br down 00:11:05.638 11:22:01 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- nvmf/common.sh@238 -- # ip link set nvmf_init_br2 down 00:11:05.638 11:22:01 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- nvmf/common.sh@239 -- # ip link set nvmf_tgt_br down 00:11:05.638 11:22:01 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- nvmf/common.sh@240 -- # ip link set nvmf_tgt_br2 down 00:11:05.638 11:22:01 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- nvmf/common.sh@241 -- # ip link delete nvmf_br type bridge 00:11:05.638 11:22:01 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- nvmf/common.sh@242 -- # ip link delete nvmf_init_if 00:11:05.638 11:22:01 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- nvmf/common.sh@243 -- # ip link delete nvmf_init_if2 00:11:05.638 11:22:01 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- nvmf/common.sh@244 -- # ip netns exec nvmf_tgt_ns_spdk ip link delete nvmf_tgt_if 00:11:05.638 11:22:01 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- nvmf/common.sh@245 -- # ip netns exec nvmf_tgt_ns_spdk ip link delete nvmf_tgt_if2 00:11:05.638 11:22:01 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- nvmf/common.sh@246 -- # remove_spdk_ns 00:11:05.638 11:22:01 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- nvmf/common.sh@654 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:11:05.638 11:22:01 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 15> /dev/null' 00:11:05.638 11:22:01 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:11:05.896 11:22:01 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- nvmf/common.sh@300 -- # return 0 00:11:05.896 00:11:05.896 real 0m9.701s 00:11:05.896 user 0m28.986s 00:11:05.896 sys 0m1.675s 00:11:05.896 11:22:01 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- common/autotest_common.sh@1126 -- # xtrace_disable 00:11:05.896 ************************************ 00:11:05.896 END TEST nvmf_delete_subsystem 00:11:05.896 ************************************ 00:11:05.896 11:22:01 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- common/autotest_common.sh@10 -- # set +x 00:11:05.896 11:22:01 nvmf_tcp.nvmf_target_core -- nvmf/nvmf_target_core.sh@26 -- # run_test nvmf_host_management /home/vagrant/spdk_repo/spdk/test/nvmf/target/host_management.sh --transport=tcp 00:11:05.896 11:22:01 nvmf_tcp.nvmf_target_core -- common/autotest_common.sh@1101 -- # '[' 3 -le 1 ']' 00:11:05.896 11:22:01 nvmf_tcp.nvmf_target_core -- common/autotest_common.sh@1107 -- # xtrace_disable 00:11:05.896 11:22:01 nvmf_tcp.nvmf_target_core -- common/autotest_common.sh@10 -- # set +x 00:11:05.896 ************************************ 00:11:05.896 START TEST nvmf_host_management 00:11:05.896 ************************************ 00:11:05.896 11:22:01 nvmf_tcp.nvmf_target_core.nvmf_host_management -- common/autotest_common.sh@1125 -- # /home/vagrant/spdk_repo/spdk/test/nvmf/target/host_management.sh --transport=tcp 00:11:05.896 * Looking for test storage... 00:11:05.896 * Found test storage at /home/vagrant/spdk_repo/spdk/test/nvmf/target 00:11:05.896 11:22:01 nvmf_tcp.nvmf_target_core.nvmf_host_management -- common/autotest_common.sh@1680 -- # [[ y == y ]] 00:11:05.896 11:22:01 nvmf_tcp.nvmf_target_core.nvmf_host_management -- common/autotest_common.sh@1681 -- # lcov --version 00:11:05.896 11:22:01 nvmf_tcp.nvmf_target_core.nvmf_host_management -- common/autotest_common.sh@1681 -- # awk '{print $NF}' 00:11:05.896 11:22:01 nvmf_tcp.nvmf_target_core.nvmf_host_management -- common/autotest_common.sh@1681 -- # lt 1.15 2 00:11:05.896 11:22:01 nvmf_tcp.nvmf_target_core.nvmf_host_management -- scripts/common.sh@373 -- # cmp_versions 1.15 '<' 2 00:11:05.896 11:22:01 nvmf_tcp.nvmf_target_core.nvmf_host_management -- scripts/common.sh@333 -- # local ver1 ver1_l 00:11:05.896 11:22:01 nvmf_tcp.nvmf_target_core.nvmf_host_management -- scripts/common.sh@334 -- # local ver2 ver2_l 00:11:05.896 11:22:01 nvmf_tcp.nvmf_target_core.nvmf_host_management -- scripts/common.sh@336 -- # IFS=.-: 00:11:05.896 11:22:01 nvmf_tcp.nvmf_target_core.nvmf_host_management -- scripts/common.sh@336 -- # read -ra ver1 00:11:05.896 11:22:01 nvmf_tcp.nvmf_target_core.nvmf_host_management -- scripts/common.sh@337 -- # IFS=.-: 00:11:05.896 11:22:01 nvmf_tcp.nvmf_target_core.nvmf_host_management -- scripts/common.sh@337 -- # read -ra ver2 00:11:05.896 11:22:01 nvmf_tcp.nvmf_target_core.nvmf_host_management -- scripts/common.sh@338 -- # local 'op=<' 00:11:05.896 11:22:01 nvmf_tcp.nvmf_target_core.nvmf_host_management -- scripts/common.sh@340 -- # ver1_l=2 00:11:05.896 11:22:01 nvmf_tcp.nvmf_target_core.nvmf_host_management -- scripts/common.sh@341 -- # ver2_l=1 00:11:05.896 11:22:01 nvmf_tcp.nvmf_target_core.nvmf_host_management -- scripts/common.sh@343 -- # local lt=0 gt=0 eq=0 v 00:11:05.896 11:22:01 nvmf_tcp.nvmf_target_core.nvmf_host_management -- scripts/common.sh@344 -- # case "$op" in 00:11:05.896 11:22:01 nvmf_tcp.nvmf_target_core.nvmf_host_management -- scripts/common.sh@345 -- # : 1 00:11:05.896 11:22:01 nvmf_tcp.nvmf_target_core.nvmf_host_management -- scripts/common.sh@364 -- # (( v = 0 )) 00:11:05.896 11:22:01 nvmf_tcp.nvmf_target_core.nvmf_host_management -- scripts/common.sh@364 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:11:05.896 11:22:01 nvmf_tcp.nvmf_target_core.nvmf_host_management -- scripts/common.sh@365 -- # decimal 1 00:11:05.896 11:22:01 nvmf_tcp.nvmf_target_core.nvmf_host_management -- scripts/common.sh@353 -- # local d=1 00:11:05.896 11:22:01 nvmf_tcp.nvmf_target_core.nvmf_host_management -- scripts/common.sh@354 -- # [[ 1 =~ ^[0-9]+$ ]] 00:11:05.896 11:22:01 nvmf_tcp.nvmf_target_core.nvmf_host_management -- scripts/common.sh@355 -- # echo 1 00:11:05.896 11:22:01 nvmf_tcp.nvmf_target_core.nvmf_host_management -- scripts/common.sh@365 -- # ver1[v]=1 00:11:05.896 11:22:01 nvmf_tcp.nvmf_target_core.nvmf_host_management -- scripts/common.sh@366 -- # decimal 2 00:11:05.896 11:22:01 nvmf_tcp.nvmf_target_core.nvmf_host_management -- scripts/common.sh@353 -- # local d=2 00:11:05.896 11:22:01 nvmf_tcp.nvmf_target_core.nvmf_host_management -- scripts/common.sh@354 -- # [[ 2 =~ ^[0-9]+$ ]] 00:11:05.896 11:22:01 nvmf_tcp.nvmf_target_core.nvmf_host_management -- scripts/common.sh@355 -- # echo 2 00:11:06.155 11:22:01 nvmf_tcp.nvmf_target_core.nvmf_host_management -- scripts/common.sh@366 -- # ver2[v]=2 00:11:06.155 11:22:01 nvmf_tcp.nvmf_target_core.nvmf_host_management -- scripts/common.sh@367 -- # (( ver1[v] > ver2[v] )) 00:11:06.155 11:22:01 nvmf_tcp.nvmf_target_core.nvmf_host_management -- scripts/common.sh@368 -- # (( ver1[v] < ver2[v] )) 00:11:06.155 11:22:01 nvmf_tcp.nvmf_target_core.nvmf_host_management -- scripts/common.sh@368 -- # return 0 00:11:06.155 11:22:01 nvmf_tcp.nvmf_target_core.nvmf_host_management -- common/autotest_common.sh@1682 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:11:06.155 11:22:01 nvmf_tcp.nvmf_target_core.nvmf_host_management -- common/autotest_common.sh@1694 -- # export 'LCOV_OPTS= 00:11:06.155 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:11:06.155 --rc genhtml_branch_coverage=1 00:11:06.155 --rc genhtml_function_coverage=1 00:11:06.155 --rc genhtml_legend=1 00:11:06.155 --rc geninfo_all_blocks=1 00:11:06.155 --rc geninfo_unexecuted_blocks=1 00:11:06.155 00:11:06.155 ' 00:11:06.155 11:22:01 nvmf_tcp.nvmf_target_core.nvmf_host_management -- common/autotest_common.sh@1694 -- # LCOV_OPTS=' 00:11:06.155 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:11:06.155 --rc genhtml_branch_coverage=1 00:11:06.155 --rc genhtml_function_coverage=1 00:11:06.155 --rc genhtml_legend=1 00:11:06.155 --rc geninfo_all_blocks=1 00:11:06.155 --rc geninfo_unexecuted_blocks=1 00:11:06.155 00:11:06.155 ' 00:11:06.155 11:22:01 nvmf_tcp.nvmf_target_core.nvmf_host_management -- common/autotest_common.sh@1695 -- # export 'LCOV=lcov 00:11:06.155 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:11:06.155 --rc genhtml_branch_coverage=1 00:11:06.155 --rc genhtml_function_coverage=1 00:11:06.155 --rc genhtml_legend=1 00:11:06.155 --rc geninfo_all_blocks=1 00:11:06.155 --rc geninfo_unexecuted_blocks=1 00:11:06.155 00:11:06.155 ' 00:11:06.155 11:22:01 nvmf_tcp.nvmf_target_core.nvmf_host_management -- common/autotest_common.sh@1695 -- # LCOV='lcov 00:11:06.155 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:11:06.155 --rc genhtml_branch_coverage=1 00:11:06.155 --rc genhtml_function_coverage=1 00:11:06.155 --rc genhtml_legend=1 00:11:06.155 --rc geninfo_all_blocks=1 00:11:06.155 --rc geninfo_unexecuted_blocks=1 00:11:06.156 00:11:06.156 ' 00:11:06.156 11:22:01 nvmf_tcp.nvmf_target_core.nvmf_host_management -- target/host_management.sh@9 -- # source /home/vagrant/spdk_repo/spdk/test/nvmf/common.sh 00:11:06.156 11:22:01 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@7 -- # uname -s 00:11:06.156 11:22:01 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:11:06.156 11:22:01 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:11:06.156 11:22:01 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:11:06.156 11:22:01 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:11:06.156 11:22:01 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:11:06.156 11:22:01 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:11:06.156 11:22:01 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:11:06.156 11:22:01 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:11:06.156 11:22:01 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:11:06.156 11:22:01 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:11:06.156 11:22:01 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:c758a4ed-f09f-4c82-9afb-3d096f035464 00:11:06.156 11:22:01 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@18 -- # NVME_HOSTID=c758a4ed-f09f-4c82-9afb-3d096f035464 00:11:06.156 11:22:01 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:11:06.156 11:22:01 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:11:06.156 11:22:01 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@21 -- # NET_TYPE=virt 00:11:06.156 11:22:01 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:11:06.156 11:22:01 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@49 -- # source /home/vagrant/spdk_repo/spdk/scripts/common.sh 00:11:06.156 11:22:01 nvmf_tcp.nvmf_target_core.nvmf_host_management -- scripts/common.sh@15 -- # shopt -s extglob 00:11:06.156 11:22:01 nvmf_tcp.nvmf_target_core.nvmf_host_management -- scripts/common.sh@544 -- # [[ -e /bin/wpdk_common.sh ]] 00:11:06.156 11:22:01 nvmf_tcp.nvmf_target_core.nvmf_host_management -- scripts/common.sh@552 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:11:06.156 11:22:01 nvmf_tcp.nvmf_target_core.nvmf_host_management -- scripts/common.sh@553 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:11:06.156 11:22:01 nvmf_tcp.nvmf_target_core.nvmf_host_management -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:11:06.156 11:22:01 nvmf_tcp.nvmf_target_core.nvmf_host_management -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:11:06.156 11:22:01 nvmf_tcp.nvmf_target_core.nvmf_host_management -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:11:06.156 11:22:01 nvmf_tcp.nvmf_target_core.nvmf_host_management -- paths/export.sh@5 -- # export PATH 00:11:06.156 11:22:01 nvmf_tcp.nvmf_target_core.nvmf_host_management -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:11:06.156 11:22:01 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@51 -- # : 0 00:11:06.156 11:22:01 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@52 -- # export NVMF_APP_SHM_ID 00:11:06.156 11:22:01 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@53 -- # build_nvmf_app_args 00:11:06.156 11:22:01 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:11:06.156 11:22:01 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:11:06.156 11:22:01 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:11:06.156 11:22:01 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@33 -- # '[' '' -eq 1 ']' 00:11:06.156 /home/vagrant/spdk_repo/spdk/test/nvmf/common.sh: line 33: [: : integer expression expected 00:11:06.156 11:22:01 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@37 -- # '[' -n '' ']' 00:11:06.156 11:22:01 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@39 -- # '[' 0 -eq 1 ']' 00:11:06.156 11:22:01 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@55 -- # have_pci_nics=0 00:11:06.156 11:22:01 nvmf_tcp.nvmf_target_core.nvmf_host_management -- target/host_management.sh@11 -- # MALLOC_BDEV_SIZE=64 00:11:06.156 11:22:01 nvmf_tcp.nvmf_target_core.nvmf_host_management -- target/host_management.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:11:06.156 11:22:01 nvmf_tcp.nvmf_target_core.nvmf_host_management -- target/host_management.sh@105 -- # nvmftestinit 00:11:06.156 11:22:01 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@467 -- # '[' -z tcp ']' 00:11:06.156 11:22:01 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@472 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:11:06.156 11:22:01 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@474 -- # prepare_net_devs 00:11:06.156 11:22:01 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@436 -- # local -g is_hw=no 00:11:06.156 11:22:01 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@438 -- # remove_spdk_ns 00:11:06.156 11:22:01 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@654 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:11:06.156 11:22:01 nvmf_tcp.nvmf_target_core.nvmf_host_management -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 15> /dev/null' 00:11:06.156 11:22:01 nvmf_tcp.nvmf_target_core.nvmf_host_management -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:11:06.156 11:22:01 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@440 -- # [[ virt != virt ]] 00:11:06.156 11:22:01 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@442 -- # [[ no == yes ]] 00:11:06.156 11:22:01 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@449 -- # [[ virt == phy ]] 00:11:06.156 11:22:01 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@452 -- # [[ virt == phy-fallback ]] 00:11:06.156 11:22:01 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@457 -- # [[ tcp == tcp ]] 00:11:06.156 11:22:01 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@458 -- # nvmf_veth_init 00:11:06.156 11:22:01 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@145 -- # NVMF_FIRST_INITIATOR_IP=10.0.0.1 00:11:06.156 11:22:01 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@146 -- # NVMF_SECOND_INITIATOR_IP=10.0.0.2 00:11:06.156 11:22:01 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@147 -- # NVMF_FIRST_TARGET_IP=10.0.0.3 00:11:06.156 11:22:01 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@148 -- # NVMF_SECOND_TARGET_IP=10.0.0.4 00:11:06.156 11:22:01 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@149 -- # NVMF_INITIATOR_IP=10.0.0.1 00:11:06.156 11:22:01 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@150 -- # NVMF_BRIDGE=nvmf_br 00:11:06.156 11:22:01 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@151 -- # NVMF_INITIATOR_INTERFACE=nvmf_init_if 00:11:06.156 11:22:01 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@152 -- # NVMF_INITIATOR_INTERFACE2=nvmf_init_if2 00:11:06.156 11:22:01 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@153 -- # NVMF_INITIATOR_BRIDGE=nvmf_init_br 00:11:06.156 11:22:01 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@154 -- # NVMF_INITIATOR_BRIDGE2=nvmf_init_br2 00:11:06.156 11:22:01 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@155 -- # NVMF_TARGET_NAMESPACE=nvmf_tgt_ns_spdk 00:11:06.156 11:22:01 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@156 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:11:06.156 11:22:01 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@157 -- # NVMF_TARGET_INTERFACE=nvmf_tgt_if 00:11:06.156 11:22:01 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@158 -- # NVMF_TARGET_INTERFACE2=nvmf_tgt_if2 00:11:06.156 11:22:01 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@159 -- # NVMF_TARGET_BRIDGE=nvmf_tgt_br 00:11:06.156 11:22:01 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@160 -- # NVMF_TARGET_BRIDGE2=nvmf_tgt_br2 00:11:06.156 11:22:01 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@162 -- # ip link set nvmf_init_br nomaster 00:11:06.156 Cannot find device "nvmf_init_br" 00:11:06.156 11:22:01 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@162 -- # true 00:11:06.156 11:22:01 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@163 -- # ip link set nvmf_init_br2 nomaster 00:11:06.156 Cannot find device "nvmf_init_br2" 00:11:06.156 11:22:01 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@163 -- # true 00:11:06.156 11:22:01 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@164 -- # ip link set nvmf_tgt_br nomaster 00:11:06.156 Cannot find device "nvmf_tgt_br" 00:11:06.156 11:22:01 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@164 -- # true 00:11:06.156 11:22:01 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@165 -- # ip link set nvmf_tgt_br2 nomaster 00:11:06.156 Cannot find device "nvmf_tgt_br2" 00:11:06.156 11:22:01 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@165 -- # true 00:11:06.156 11:22:01 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@166 -- # ip link set nvmf_init_br down 00:11:06.156 Cannot find device "nvmf_init_br" 00:11:06.156 11:22:01 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@166 -- # true 00:11:06.156 11:22:01 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@167 -- # ip link set nvmf_init_br2 down 00:11:06.156 Cannot find device "nvmf_init_br2" 00:11:06.156 11:22:01 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@167 -- # true 00:11:06.156 11:22:01 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@168 -- # ip link set nvmf_tgt_br down 00:11:06.156 Cannot find device "nvmf_tgt_br" 00:11:06.156 11:22:01 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@168 -- # true 00:11:06.156 11:22:01 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@169 -- # ip link set nvmf_tgt_br2 down 00:11:06.156 Cannot find device "nvmf_tgt_br2" 00:11:06.156 11:22:01 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@169 -- # true 00:11:06.156 11:22:01 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@170 -- # ip link delete nvmf_br type bridge 00:11:06.156 Cannot find device "nvmf_br" 00:11:06.156 11:22:01 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@170 -- # true 00:11:06.156 11:22:01 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@171 -- # ip link delete nvmf_init_if 00:11:06.156 Cannot find device "nvmf_init_if" 00:11:06.157 11:22:01 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@171 -- # true 00:11:06.157 11:22:01 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@172 -- # ip link delete nvmf_init_if2 00:11:06.157 Cannot find device "nvmf_init_if2" 00:11:06.157 11:22:01 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@172 -- # true 00:11:06.157 11:22:01 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@173 -- # ip netns exec nvmf_tgt_ns_spdk ip link delete nvmf_tgt_if 00:11:06.157 Cannot open network namespace "nvmf_tgt_ns_spdk": No such file or directory 00:11:06.157 11:22:01 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@173 -- # true 00:11:06.157 11:22:01 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@174 -- # ip netns exec nvmf_tgt_ns_spdk ip link delete nvmf_tgt_if2 00:11:06.157 Cannot open network namespace "nvmf_tgt_ns_spdk": No such file or directory 00:11:06.157 11:22:01 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@174 -- # true 00:11:06.157 11:22:01 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@177 -- # ip netns add nvmf_tgt_ns_spdk 00:11:06.157 11:22:01 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@180 -- # ip link add nvmf_init_if type veth peer name nvmf_init_br 00:11:06.157 11:22:01 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@181 -- # ip link add nvmf_init_if2 type veth peer name nvmf_init_br2 00:11:06.157 11:22:01 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@182 -- # ip link add nvmf_tgt_if type veth peer name nvmf_tgt_br 00:11:06.157 11:22:01 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@183 -- # ip link add nvmf_tgt_if2 type veth peer name nvmf_tgt_br2 00:11:06.416 11:22:01 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@186 -- # ip link set nvmf_tgt_if netns nvmf_tgt_ns_spdk 00:11:06.416 11:22:01 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@187 -- # ip link set nvmf_tgt_if2 netns nvmf_tgt_ns_spdk 00:11:06.416 11:22:01 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@190 -- # ip addr add 10.0.0.1/24 dev nvmf_init_if 00:11:06.416 11:22:01 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@191 -- # ip addr add 10.0.0.2/24 dev nvmf_init_if2 00:11:06.416 11:22:01 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@192 -- # ip netns exec nvmf_tgt_ns_spdk ip addr add 10.0.0.3/24 dev nvmf_tgt_if 00:11:06.416 11:22:01 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@193 -- # ip netns exec nvmf_tgt_ns_spdk ip addr add 10.0.0.4/24 dev nvmf_tgt_if2 00:11:06.416 11:22:01 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@196 -- # ip link set nvmf_init_if up 00:11:06.416 11:22:01 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@197 -- # ip link set nvmf_init_if2 up 00:11:06.416 11:22:01 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@198 -- # ip link set nvmf_init_br up 00:11:06.416 11:22:01 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@199 -- # ip link set nvmf_init_br2 up 00:11:06.416 11:22:01 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@200 -- # ip link set nvmf_tgt_br up 00:11:06.416 11:22:01 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@201 -- # ip link set nvmf_tgt_br2 up 00:11:06.416 11:22:01 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@202 -- # ip netns exec nvmf_tgt_ns_spdk ip link set nvmf_tgt_if up 00:11:06.416 11:22:01 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@203 -- # ip netns exec nvmf_tgt_ns_spdk ip link set nvmf_tgt_if2 up 00:11:06.416 11:22:01 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@204 -- # ip netns exec nvmf_tgt_ns_spdk ip link set lo up 00:11:06.416 11:22:01 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@207 -- # ip link add nvmf_br type bridge 00:11:06.416 11:22:01 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@208 -- # ip link set nvmf_br up 00:11:06.416 11:22:01 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@211 -- # ip link set nvmf_init_br master nvmf_br 00:11:06.416 11:22:01 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@212 -- # ip link set nvmf_init_br2 master nvmf_br 00:11:06.416 11:22:01 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@213 -- # ip link set nvmf_tgt_br master nvmf_br 00:11:06.416 11:22:01 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@214 -- # ip link set nvmf_tgt_br2 master nvmf_br 00:11:06.416 11:22:01 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@217 -- # ipts -I INPUT 1 -i nvmf_init_if -p tcp --dport 4420 -j ACCEPT 00:11:06.416 11:22:01 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@788 -- # iptables -I INPUT 1 -i nvmf_init_if -p tcp --dport 4420 -j ACCEPT -m comment --comment 'SPDK_NVMF:-I INPUT 1 -i nvmf_init_if -p tcp --dport 4420 -j ACCEPT' 00:11:06.416 11:22:01 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@218 -- # ipts -I INPUT 1 -i nvmf_init_if2 -p tcp --dport 4420 -j ACCEPT 00:11:06.416 11:22:01 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@788 -- # iptables -I INPUT 1 -i nvmf_init_if2 -p tcp --dport 4420 -j ACCEPT -m comment --comment 'SPDK_NVMF:-I INPUT 1 -i nvmf_init_if2 -p tcp --dport 4420 -j ACCEPT' 00:11:06.416 11:22:01 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@219 -- # ipts -A FORWARD -i nvmf_br -o nvmf_br -j ACCEPT 00:11:06.416 11:22:01 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@788 -- # iptables -A FORWARD -i nvmf_br -o nvmf_br -j ACCEPT -m comment --comment 'SPDK_NVMF:-A FORWARD -i nvmf_br -o nvmf_br -j ACCEPT' 00:11:06.416 11:22:01 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@222 -- # ping -c 1 10.0.0.3 00:11:06.416 PING 10.0.0.3 (10.0.0.3) 56(84) bytes of data. 00:11:06.416 64 bytes from 10.0.0.3: icmp_seq=1 ttl=64 time=0.056 ms 00:11:06.416 00:11:06.416 --- 10.0.0.3 ping statistics --- 00:11:06.416 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:11:06.416 rtt min/avg/max/mdev = 0.056/0.056/0.056/0.000 ms 00:11:06.416 11:22:01 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@223 -- # ping -c 1 10.0.0.4 00:11:06.416 PING 10.0.0.4 (10.0.0.4) 56(84) bytes of data. 00:11:06.416 64 bytes from 10.0.0.4: icmp_seq=1 ttl=64 time=0.059 ms 00:11:06.416 00:11:06.416 --- 10.0.0.4 ping statistics --- 00:11:06.416 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:11:06.416 rtt min/avg/max/mdev = 0.059/0.059/0.059/0.000 ms 00:11:06.416 11:22:01 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@224 -- # ip netns exec nvmf_tgt_ns_spdk ping -c 1 10.0.0.1 00:11:06.416 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:11:06.416 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.061 ms 00:11:06.416 00:11:06.416 --- 10.0.0.1 ping statistics --- 00:11:06.416 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:11:06.416 rtt min/avg/max/mdev = 0.061/0.061/0.061/0.000 ms 00:11:06.416 11:22:01 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@225 -- # ip netns exec nvmf_tgt_ns_spdk ping -c 1 10.0.0.2 00:11:06.416 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:11:06.416 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.069 ms 00:11:06.416 00:11:06.416 --- 10.0.0.2 ping statistics --- 00:11:06.416 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:11:06.416 rtt min/avg/max/mdev = 0.069/0.069/0.069/0.000 ms 00:11:06.416 11:22:01 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@227 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:11:06.416 11:22:01 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@459 -- # return 0 00:11:06.416 11:22:01 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@476 -- # '[' '' == iso ']' 00:11:06.416 11:22:01 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@480 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:11:06.416 11:22:01 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@481 -- # [[ tcp == \r\d\m\a ]] 00:11:06.417 11:22:01 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@490 -- # [[ tcp == \t\c\p ]] 00:11:06.417 11:22:01 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@491 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:11:06.417 11:22:01 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@494 -- # '[' tcp == tcp ']' 00:11:06.417 11:22:01 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@500 -- # modprobe nvme-tcp 00:11:06.417 11:22:01 nvmf_tcp.nvmf_target_core.nvmf_host_management -- target/host_management.sh@107 -- # nvmf_host_management 00:11:06.417 11:22:01 nvmf_tcp.nvmf_target_core.nvmf_host_management -- target/host_management.sh@69 -- # starttarget 00:11:06.417 11:22:01 nvmf_tcp.nvmf_target_core.nvmf_host_management -- target/host_management.sh@16 -- # nvmfappstart -m 0x1E 00:11:06.417 11:22:01 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@505 -- # timing_enter start_nvmf_tgt 00:11:06.417 11:22:01 nvmf_tcp.nvmf_target_core.nvmf_host_management -- common/autotest_common.sh@724 -- # xtrace_disable 00:11:06.417 11:22:01 nvmf_tcp.nvmf_target_core.nvmf_host_management -- common/autotest_common.sh@10 -- # set +x 00:11:06.417 11:22:01 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@507 -- # nvmfpid=65537 00:11:06.417 11:22:01 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@508 -- # waitforlisten 65537 00:11:06.417 11:22:01 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@506 -- # ip netns exec nvmf_tgt_ns_spdk /home/vagrant/spdk_repo/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x1E 00:11:06.417 11:22:01 nvmf_tcp.nvmf_target_core.nvmf_host_management -- common/autotest_common.sh@831 -- # '[' -z 65537 ']' 00:11:06.417 11:22:01 nvmf_tcp.nvmf_target_core.nvmf_host_management -- common/autotest_common.sh@835 -- # local rpc_addr=/var/tmp/spdk.sock 00:11:06.417 11:22:01 nvmf_tcp.nvmf_target_core.nvmf_host_management -- common/autotest_common.sh@836 -- # local max_retries=100 00:11:06.417 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:11:06.417 11:22:01 nvmf_tcp.nvmf_target_core.nvmf_host_management -- common/autotest_common.sh@838 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:11:06.417 11:22:01 nvmf_tcp.nvmf_target_core.nvmf_host_management -- common/autotest_common.sh@840 -- # xtrace_disable 00:11:06.417 11:22:01 nvmf_tcp.nvmf_target_core.nvmf_host_management -- common/autotest_common.sh@10 -- # set +x 00:11:06.675 [2024-10-07 11:22:01.969461] Starting SPDK v25.01-pre git sha1 2a4f56c54 / DPDK 24.03.0 initialization... 00:11:06.675 [2024-10-07 11:22:01.969844] [ DPDK EAL parameters: nvmf -c 0x1E --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --iova-mode=pa --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:11:06.675 [2024-10-07 11:22:02.113803] app.c: 917:spdk_app_start: *NOTICE*: Total cores available: 4 00:11:06.933 [2024-10-07 11:22:02.281555] app.c: 610:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:11:06.933 [2024-10-07 11:22:02.282001] app.c: 611:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:11:06.933 [2024-10-07 11:22:02.282189] app.c: 616:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:11:06.933 [2024-10-07 11:22:02.282375] app.c: 617:app_setup_trace: *NOTICE*: SPDK application currently running. 00:11:06.933 [2024-10-07 11:22:02.282420] app.c: 618:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:11:06.933 [2024-10-07 11:22:02.284318] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 2 00:11:06.933 [2024-10-07 11:22:02.284474] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 3 00:11:06.933 [2024-10-07 11:22:02.284617] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 1 00:11:06.933 [2024-10-07 11:22:02.284618] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 4 00:11:07.500 11:22:02 nvmf_tcp.nvmf_target_core.nvmf_host_management -- common/autotest_common.sh@860 -- # (( i == 0 )) 00:11:07.500 11:22:02 nvmf_tcp.nvmf_target_core.nvmf_host_management -- common/autotest_common.sh@864 -- # return 0 00:11:07.500 11:22:02 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@509 -- # timing_exit start_nvmf_tgt 00:11:07.500 11:22:03 nvmf_tcp.nvmf_target_core.nvmf_host_management -- common/autotest_common.sh@730 -- # xtrace_disable 00:11:07.500 11:22:03 nvmf_tcp.nvmf_target_core.nvmf_host_management -- common/autotest_common.sh@10 -- # set +x 00:11:07.759 11:22:03 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@510 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:11:07.759 11:22:03 nvmf_tcp.nvmf_target_core.nvmf_host_management -- target/host_management.sh@18 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:11:07.759 11:22:03 nvmf_tcp.nvmf_target_core.nvmf_host_management -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:07.759 11:22:03 nvmf_tcp.nvmf_target_core.nvmf_host_management -- common/autotest_common.sh@10 -- # set +x 00:11:07.759 [2024-10-07 11:22:03.053296] tcp.c: 738:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:11:07.759 11:22:03 nvmf_tcp.nvmf_target_core.nvmf_host_management -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:07.759 11:22:03 nvmf_tcp.nvmf_target_core.nvmf_host_management -- target/host_management.sh@20 -- # timing_enter create_subsystem 00:11:07.759 11:22:03 nvmf_tcp.nvmf_target_core.nvmf_host_management -- common/autotest_common.sh@724 -- # xtrace_disable 00:11:07.759 11:22:03 nvmf_tcp.nvmf_target_core.nvmf_host_management -- common/autotest_common.sh@10 -- # set +x 00:11:07.760 11:22:03 nvmf_tcp.nvmf_target_core.nvmf_host_management -- target/host_management.sh@22 -- # rm -rf /home/vagrant/spdk_repo/spdk/test/nvmf/target/rpcs.txt 00:11:07.760 11:22:03 nvmf_tcp.nvmf_target_core.nvmf_host_management -- target/host_management.sh@23 -- # cat 00:11:07.760 11:22:03 nvmf_tcp.nvmf_target_core.nvmf_host_management -- target/host_management.sh@30 -- # rpc_cmd 00:11:07.760 11:22:03 nvmf_tcp.nvmf_target_core.nvmf_host_management -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:07.760 11:22:03 nvmf_tcp.nvmf_target_core.nvmf_host_management -- common/autotest_common.sh@10 -- # set +x 00:11:07.760 Malloc0 00:11:07.760 [2024-10-07 11:22:03.129340] tcp.c:1081:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.3 port 4420 *** 00:11:07.760 11:22:03 nvmf_tcp.nvmf_target_core.nvmf_host_management -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:07.760 11:22:03 nvmf_tcp.nvmf_target_core.nvmf_host_management -- target/host_management.sh@31 -- # timing_exit create_subsystems 00:11:07.760 11:22:03 nvmf_tcp.nvmf_target_core.nvmf_host_management -- common/autotest_common.sh@730 -- # xtrace_disable 00:11:07.760 11:22:03 nvmf_tcp.nvmf_target_core.nvmf_host_management -- common/autotest_common.sh@10 -- # set +x 00:11:07.760 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:11:07.760 11:22:03 nvmf_tcp.nvmf_target_core.nvmf_host_management -- target/host_management.sh@73 -- # perfpid=65609 00:11:07.760 11:22:03 nvmf_tcp.nvmf_target_core.nvmf_host_management -- target/host_management.sh@74 -- # waitforlisten 65609 /var/tmp/bdevperf.sock 00:11:07.760 11:22:03 nvmf_tcp.nvmf_target_core.nvmf_host_management -- common/autotest_common.sh@831 -- # '[' -z 65609 ']' 00:11:07.760 11:22:03 nvmf_tcp.nvmf_target_core.nvmf_host_management -- common/autotest_common.sh@835 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:11:07.760 11:22:03 nvmf_tcp.nvmf_target_core.nvmf_host_management -- common/autotest_common.sh@836 -- # local max_retries=100 00:11:07.760 11:22:03 nvmf_tcp.nvmf_target_core.nvmf_host_management -- common/autotest_common.sh@838 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:11:07.760 11:22:03 nvmf_tcp.nvmf_target_core.nvmf_host_management -- common/autotest_common.sh@840 -- # xtrace_disable 00:11:07.760 11:22:03 nvmf_tcp.nvmf_target_core.nvmf_host_management -- common/autotest_common.sh@10 -- # set +x 00:11:07.760 11:22:03 nvmf_tcp.nvmf_target_core.nvmf_host_management -- target/host_management.sh@72 -- # /home/vagrant/spdk_repo/spdk/build/examples/bdevperf -r /var/tmp/bdevperf.sock --json /dev/fd/63 -q 64 -o 65536 -w verify -t 10 00:11:07.760 11:22:03 nvmf_tcp.nvmf_target_core.nvmf_host_management -- target/host_management.sh@72 -- # gen_nvmf_target_json 0 00:11:07.760 11:22:03 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@558 -- # config=() 00:11:07.760 11:22:03 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@558 -- # local subsystem config 00:11:07.760 11:22:03 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@560 -- # for subsystem in "${@:-1}" 00:11:07.760 11:22:03 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@580 -- # config+=("$(cat <<-EOF 00:11:07.760 { 00:11:07.760 "params": { 00:11:07.760 "name": "Nvme$subsystem", 00:11:07.760 "trtype": "$TEST_TRANSPORT", 00:11:07.760 "traddr": "$NVMF_FIRST_TARGET_IP", 00:11:07.760 "adrfam": "ipv4", 00:11:07.760 "trsvcid": "$NVMF_PORT", 00:11:07.760 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:11:07.760 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:11:07.760 "hdgst": ${hdgst:-false}, 00:11:07.760 "ddgst": ${ddgst:-false} 00:11:07.760 }, 00:11:07.760 "method": "bdev_nvme_attach_controller" 00:11:07.760 } 00:11:07.760 EOF 00:11:07.760 )") 00:11:07.760 11:22:03 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@580 -- # cat 00:11:07.760 11:22:03 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@582 -- # jq . 00:11:07.760 11:22:03 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@583 -- # IFS=, 00:11:07.760 11:22:03 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@584 -- # printf '%s\n' '{ 00:11:07.760 "params": { 00:11:07.760 "name": "Nvme0", 00:11:07.760 "trtype": "tcp", 00:11:07.760 "traddr": "10.0.0.3", 00:11:07.760 "adrfam": "ipv4", 00:11:07.760 "trsvcid": "4420", 00:11:07.760 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:11:07.760 "hostnqn": "nqn.2016-06.io.spdk:host0", 00:11:07.760 "hdgst": false, 00:11:07.760 "ddgst": false 00:11:07.760 }, 00:11:07.760 "method": "bdev_nvme_attach_controller" 00:11:07.760 }' 00:11:07.760 [2024-10-07 11:22:03.241585] Starting SPDK v25.01-pre git sha1 2a4f56c54 / DPDK 24.03.0 initialization... 00:11:07.760 [2024-10-07 11:22:03.241742] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --iova-mode=pa --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid65609 ] 00:11:08.018 [2024-10-07 11:22:03.379253] app.c: 917:spdk_app_start: *NOTICE*: Total cores available: 1 00:11:08.018 [2024-10-07 11:22:03.512005] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 0 00:11:08.277 Running I/O for 10 seconds... 00:11:08.842 11:22:04 nvmf_tcp.nvmf_target_core.nvmf_host_management -- common/autotest_common.sh@860 -- # (( i == 0 )) 00:11:08.842 11:22:04 nvmf_tcp.nvmf_target_core.nvmf_host_management -- common/autotest_common.sh@864 -- # return 0 00:11:08.842 11:22:04 nvmf_tcp.nvmf_target_core.nvmf_host_management -- target/host_management.sh@75 -- # rpc_cmd -s /var/tmp/bdevperf.sock framework_wait_init 00:11:08.842 11:22:04 nvmf_tcp.nvmf_target_core.nvmf_host_management -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:08.842 11:22:04 nvmf_tcp.nvmf_target_core.nvmf_host_management -- common/autotest_common.sh@10 -- # set +x 00:11:08.842 11:22:04 nvmf_tcp.nvmf_target_core.nvmf_host_management -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:08.842 11:22:04 nvmf_tcp.nvmf_target_core.nvmf_host_management -- target/host_management.sh@78 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; kill -9 $perfpid || true; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:11:08.842 11:22:04 nvmf_tcp.nvmf_target_core.nvmf_host_management -- target/host_management.sh@80 -- # waitforio /var/tmp/bdevperf.sock Nvme0n1 00:11:08.842 11:22:04 nvmf_tcp.nvmf_target_core.nvmf_host_management -- target/host_management.sh@45 -- # '[' -z /var/tmp/bdevperf.sock ']' 00:11:08.842 11:22:04 nvmf_tcp.nvmf_target_core.nvmf_host_management -- target/host_management.sh@49 -- # '[' -z Nvme0n1 ']' 00:11:08.842 11:22:04 nvmf_tcp.nvmf_target_core.nvmf_host_management -- target/host_management.sh@52 -- # local ret=1 00:11:08.842 11:22:04 nvmf_tcp.nvmf_target_core.nvmf_host_management -- target/host_management.sh@53 -- # local i 00:11:08.842 11:22:04 nvmf_tcp.nvmf_target_core.nvmf_host_management -- target/host_management.sh@54 -- # (( i = 10 )) 00:11:08.842 11:22:04 nvmf_tcp.nvmf_target_core.nvmf_host_management -- target/host_management.sh@54 -- # (( i != 0 )) 00:11:08.842 11:22:04 nvmf_tcp.nvmf_target_core.nvmf_host_management -- target/host_management.sh@55 -- # jq -r '.bdevs[0].num_read_ops' 00:11:08.842 11:22:04 nvmf_tcp.nvmf_target_core.nvmf_host_management -- target/host_management.sh@55 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_get_iostat -b Nvme0n1 00:11:08.842 11:22:04 nvmf_tcp.nvmf_target_core.nvmf_host_management -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:08.842 11:22:04 nvmf_tcp.nvmf_target_core.nvmf_host_management -- common/autotest_common.sh@10 -- # set +x 00:11:08.842 11:22:04 nvmf_tcp.nvmf_target_core.nvmf_host_management -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:08.842 11:22:04 nvmf_tcp.nvmf_target_core.nvmf_host_management -- target/host_management.sh@55 -- # read_io_count=835 00:11:08.842 11:22:04 nvmf_tcp.nvmf_target_core.nvmf_host_management -- target/host_management.sh@58 -- # '[' 835 -ge 100 ']' 00:11:08.842 11:22:04 nvmf_tcp.nvmf_target_core.nvmf_host_management -- target/host_management.sh@59 -- # ret=0 00:11:08.842 11:22:04 nvmf_tcp.nvmf_target_core.nvmf_host_management -- target/host_management.sh@60 -- # break 00:11:08.842 11:22:04 nvmf_tcp.nvmf_target_core.nvmf_host_management -- target/host_management.sh@64 -- # return 0 00:11:08.842 11:22:04 nvmf_tcp.nvmf_target_core.nvmf_host_management -- target/host_management.sh@84 -- # rpc_cmd nvmf_subsystem_remove_host nqn.2016-06.io.spdk:cnode0 nqn.2016-06.io.spdk:host0 00:11:08.842 11:22:04 nvmf_tcp.nvmf_target_core.nvmf_host_management -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:08.842 11:22:04 nvmf_tcp.nvmf_target_core.nvmf_host_management -- common/autotest_common.sh@10 -- # set +x 00:11:08.842 [2024-10-07 11:22:04.355365] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x225bf60 is same with the state(6) to be set 00:11:08.842 11:22:04 nvmf_tcp.nvmf_target_core.nvmf_host_management -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:08.842 11:22:04 nvmf_tcp.nvmf_target_core.nvmf_host_management -- target/host_management.sh@85 -- # rpc_cmd nvmf_subsystem_add_host nqn.2016-06.io.spdk:cnode0 nqn.2016-06.io.spdk:host0 00:11:08.842 11:22:04 nvmf_tcp.nvmf_target_core.nvmf_host_management -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:08.842 11:22:04 nvmf_tcp.nvmf_target_core.nvmf_host_management -- common/autotest_common.sh@10 -- # set +x 00:11:09.101 11:22:04 nvmf_tcp.nvmf_target_core.nvmf_host_management -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:09.101 [2024-10-07 11:22:04.368056] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:11:09.101 [2024-10-07 11:22:04.368095] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:11:09.101 [2024-10-07 11:22:04.368110] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:11:09.101 [2024-10-07 11:22:04.368120] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:11:09.101 [2024-10-07 11:22:04.368130] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:11:09.101 [2024-10-07 11:22:04.368140] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:11:09.101 [2024-10-07 11:22:04.368151] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:11:09.101 [2024-10-07 11:22:04.368160] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:11:09.101 [2024-10-07 11:22:04.368170] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x6bb730 is same with the state(6) to be set 00:11:09.101 11:22:04 nvmf_tcp.nvmf_target_core.nvmf_host_management -- target/host_management.sh@87 -- # sleep 1 00:11:09.101 [2024-10-07 11:22:04.377152] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:122880 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:11:09.101 [2024-10-07 11:22:04.377422] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:11:09.101 [2024-10-07 11:22:04.377569] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:123008 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:11:09.101 [2024-10-07 11:22:04.377747] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:11:09.102 [2024-10-07 11:22:04.377886] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:123136 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:11:09.102 [2024-10-07 11:22:04.377902] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:11:09.102 [2024-10-07 11:22:04.377914] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:3 nsid:1 lba:123264 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:11:09.102 [2024-10-07 11:22:04.377924] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:11:09.102 [2024-10-07 11:22:04.377938] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:4 nsid:1 lba:123392 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:11:09.102 [2024-10-07 11:22:04.377948] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:11:09.102 [2024-10-07 11:22:04.377959] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:5 nsid:1 lba:123520 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:11:09.102 [2024-10-07 11:22:04.377969] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:11:09.102 [2024-10-07 11:22:04.377980] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:6 nsid:1 lba:123648 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:11:09.102 [2024-10-07 11:22:04.377990] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:11:09.102 [2024-10-07 11:22:04.378001] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:7 nsid:1 lba:123776 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:11:09.102 [2024-10-07 11:22:04.378011] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:11:09.102 [2024-10-07 11:22:04.378022] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:8 nsid:1 lba:123904 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:11:09.102 [2024-10-07 11:22:04.378046] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:11:09.102 [2024-10-07 11:22:04.378057] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:9 nsid:1 lba:124032 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:11:09.102 [2024-10-07 11:22:04.378067] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:11:09.102 [2024-10-07 11:22:04.378078] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:10 nsid:1 lba:124160 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:11:09.102 [2024-10-07 11:22:04.378087] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:11:09.102 [2024-10-07 11:22:04.378098] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:11 nsid:1 lba:124288 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:11:09.102 [2024-10-07 11:22:04.378108] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:11:09.102 [2024-10-07 11:22:04.378119] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:12 nsid:1 lba:124416 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:11:09.102 [2024-10-07 11:22:04.378130] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:11:09.102 [2024-10-07 11:22:04.378141] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:13 nsid:1 lba:124544 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:11:09.102 [2024-10-07 11:22:04.378165] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:11:09.102 [2024-10-07 11:22:04.378176] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:14 nsid:1 lba:124672 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:11:09.102 [2024-10-07 11:22:04.378187] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:11:09.102 [2024-10-07 11:22:04.378199] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:124800 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:11:09.102 [2024-10-07 11:22:04.378225] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:11:09.102 [2024-10-07 11:22:04.378238] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:16 nsid:1 lba:124928 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:11:09.102 [2024-10-07 11:22:04.378247] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:11:09.102 [2024-10-07 11:22:04.378259] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:17 nsid:1 lba:125056 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:11:09.102 [2024-10-07 11:22:04.378268] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:11:09.102 [2024-10-07 11:22:04.378279] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:18 nsid:1 lba:125184 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:11:09.102 [2024-10-07 11:22:04.378288] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:11:09.102 [2024-10-07 11:22:04.378298] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:19 nsid:1 lba:125312 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:11:09.102 [2024-10-07 11:22:04.378308] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:11:09.102 [2024-10-07 11:22:04.378319] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:20 nsid:1 lba:125440 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:11:09.102 [2024-10-07 11:22:04.378328] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:11:09.102 [2024-10-07 11:22:04.378355] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:21 nsid:1 lba:125568 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:11:09.102 [2024-10-07 11:22:04.378364] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:11:09.102 [2024-10-07 11:22:04.378376] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:22 nsid:1 lba:125696 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:11:09.102 [2024-10-07 11:22:04.378385] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:11:09.102 [2024-10-07 11:22:04.378396] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:23 nsid:1 lba:125824 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:11:09.102 [2024-10-07 11:22:04.378406] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:11:09.102 [2024-10-07 11:22:04.378416] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:24 nsid:1 lba:125952 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:11:09.102 [2024-10-07 11:22:04.378426] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:11:09.102 [2024-10-07 11:22:04.378437] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:25 nsid:1 lba:126080 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:11:09.102 [2024-10-07 11:22:04.378447] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:11:09.102 [2024-10-07 11:22:04.378459] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:26 nsid:1 lba:126208 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:11:09.102 [2024-10-07 11:22:04.378469] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:11:09.102 [2024-10-07 11:22:04.378479] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:27 nsid:1 lba:126336 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:11:09.102 [2024-10-07 11:22:04.378489] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:11:09.102 [2024-10-07 11:22:04.378500] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:28 nsid:1 lba:126464 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:11:09.102 [2024-10-07 11:22:04.378509] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:11:09.102 [2024-10-07 11:22:04.378520] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:29 nsid:1 lba:126592 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:11:09.102 [2024-10-07 11:22:04.378529] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:11:09.102 [2024-10-07 11:22:04.378540] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:30 nsid:1 lba:126720 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:11:09.102 [2024-10-07 11:22:04.378548] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:11:09.102 [2024-10-07 11:22:04.378559] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:31 nsid:1 lba:126848 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:11:09.102 [2024-10-07 11:22:04.378580] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:11:09.102 [2024-10-07 11:22:04.378592] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:32 nsid:1 lba:126976 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:11:09.102 [2024-10-07 11:22:04.378601] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:11:09.102 [2024-10-07 11:22:04.378612] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:33 nsid:1 lba:127104 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:11:09.102 [2024-10-07 11:22:04.378621] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:11:09.102 [2024-10-07 11:22:04.378632] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:34 nsid:1 lba:127232 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:11:09.102 [2024-10-07 11:22:04.378641] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:11:09.102 [2024-10-07 11:22:04.378910] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:35 nsid:1 lba:127360 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:11:09.102 [2024-10-07 11:22:04.379046] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:11:09.102 [2024-10-07 11:22:04.379181] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:36 nsid:1 lba:127488 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:11:09.102 [2024-10-07 11:22:04.379350] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:11:09.102 [2024-10-07 11:22:04.379486] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:37 nsid:1 lba:127616 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:11:09.102 [2024-10-07 11:22:04.379620] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:11:09.103 [2024-10-07 11:22:04.379748] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:38 nsid:1 lba:127744 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:11:09.103 [2024-10-07 11:22:04.379763] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:11:09.103 [2024-10-07 11:22:04.379774] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:39 nsid:1 lba:127872 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:11:09.103 [2024-10-07 11:22:04.379784] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:11:09.103 [2024-10-07 11:22:04.379796] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:40 nsid:1 lba:128000 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:11:09.103 [2024-10-07 11:22:04.379806] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:11:09.103 [2024-10-07 11:22:04.379817] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:41 nsid:1 lba:128128 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:11:09.103 [2024-10-07 11:22:04.379827] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:11:09.103 [2024-10-07 11:22:04.379838] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:42 nsid:1 lba:128256 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:11:09.103 [2024-10-07 11:22:04.379848] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:11:09.103 [2024-10-07 11:22:04.379859] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:43 nsid:1 lba:128384 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:11:09.103 [2024-10-07 11:22:04.379869] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:11:09.103 [2024-10-07 11:22:04.379880] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:44 nsid:1 lba:128512 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:11:09.103 [2024-10-07 11:22:04.379890] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:11:09.103 [2024-10-07 11:22:04.379901] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:45 nsid:1 lba:128640 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:11:09.103 [2024-10-07 11:22:04.379911] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:11:09.103 [2024-10-07 11:22:04.379923] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:46 nsid:1 lba:128768 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:11:09.103 [2024-10-07 11:22:04.379947] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:11:09.103 [2024-10-07 11:22:04.379959] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:47 nsid:1 lba:128896 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:11:09.103 [2024-10-07 11:22:04.379974] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:11:09.103 [2024-10-07 11:22:04.379985] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:48 nsid:1 lba:129024 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:11:09.103 [2024-10-07 11:22:04.379995] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:11:09.103 [2024-10-07 11:22:04.380006] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:49 nsid:1 lba:129152 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:11:09.103 [2024-10-07 11:22:04.380015] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:11:09.103 [2024-10-07 11:22:04.380026] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:50 nsid:1 lba:129280 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:11:09.103 [2024-10-07 11:22:04.380036] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:11:09.103 [2024-10-07 11:22:04.380063] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:51 nsid:1 lba:129408 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:11:09.103 [2024-10-07 11:22:04.380073] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:11:09.103 [2024-10-07 11:22:04.380085] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:52 nsid:1 lba:129536 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:11:09.103 [2024-10-07 11:22:04.380094] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:11:09.103 [2024-10-07 11:22:04.380105] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:53 nsid:1 lba:129664 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:11:09.103 [2024-10-07 11:22:04.380115] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:11:09.103 [2024-10-07 11:22:04.380127] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:54 nsid:1 lba:129792 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:11:09.103 [2024-10-07 11:22:04.380137] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:11:09.103 [2024-10-07 11:22:04.380148] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:55 nsid:1 lba:129920 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:11:09.103 [2024-10-07 11:22:04.380158] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:11:09.103 [2024-10-07 11:22:04.380170] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:56 nsid:1 lba:130048 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:11:09.103 [2024-10-07 11:22:04.380180] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:11:09.103 [2024-10-07 11:22:04.380191] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:57 nsid:1 lba:130176 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:11:09.103 [2024-10-07 11:22:04.380201] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:11:09.103 [2024-10-07 11:22:04.380212] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:58 nsid:1 lba:130304 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:11:09.103 [2024-10-07 11:22:04.380222] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:11:09.103 [2024-10-07 11:22:04.380233] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:59 nsid:1 lba:130432 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:11:09.103 [2024-10-07 11:22:04.380243] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:11:09.103 [2024-10-07 11:22:04.380254] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:60 nsid:1 lba:130560 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:11:09.103 [2024-10-07 11:22:04.380264] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:11:09.103 [2024-10-07 11:22:04.380275] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:61 nsid:1 lba:130688 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:11:09.103 [2024-10-07 11:22:04.380285] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:11:09.103 [2024-10-07 11:22:04.380297] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:62 nsid:1 lba:130816 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:11:09.103 [2024-10-07 11:22:04.380308] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:11:09.103 [2024-10-07 11:22:04.380319] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:63 nsid:1 lba:130944 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:11:09.103 [2024-10-07 11:22:04.380351] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:11:09.103 [2024-10-07 11:22:04.380452] bdev_nvme.c:1730:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0x6bb4f0 was disconnected and freed. reset controller. 00:11:09.103 [2024-10-07 11:22:04.380485] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x6bb730 (9): Bad file descriptor 00:11:09.103 [2024-10-07 11:22:04.381619] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode0] resetting controller 00:11:09.103 task offset: 122880 on job bdev=Nvme0n1 fails 00:11:09.103 00:11:09.103 Latency(us) 00:11:09.103 [2024-10-07T11:22:04.626Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:11:09.103 Job: Nvme0n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:11:09.103 Job: Nvme0n1 ended in about 0.68 seconds with error 00:11:09.103 Verification LBA range: start 0x0 length 0x400 00:11:09.103 Nvme0n1 : 0.68 1419.23 88.70 94.62 0.00 41218.26 3708.74 39321.60 00:11:09.103 [2024-10-07T11:22:04.626Z] =================================================================================================================== 00:11:09.103 [2024-10-07T11:22:04.626Z] Total : 1419.23 88.70 94.62 0.00 41218.26 3708.74 39321.60 00:11:09.103 [2024-10-07 11:22:04.383535] app.c:1062:spdk_app_stop: *WARNING*: spdk_app_stop'd on non-zero 00:11:09.103 [2024-10-07 11:22:04.392759] bdev_nvme.c:2183:_bdev_nvme_reset_ctrlr_complete: *NOTICE*: Resetting controller successful. 00:11:10.038 11:22:05 nvmf_tcp.nvmf_target_core.nvmf_host_management -- target/host_management.sh@91 -- # kill -9 65609 00:11:10.038 /home/vagrant/spdk_repo/spdk/test/nvmf/target/host_management.sh: line 91: kill: (65609) - No such process 00:11:10.038 11:22:05 nvmf_tcp.nvmf_target_core.nvmf_host_management -- target/host_management.sh@91 -- # true 00:11:10.038 11:22:05 nvmf_tcp.nvmf_target_core.nvmf_host_management -- target/host_management.sh@97 -- # rm -f /var/tmp/spdk_cpu_lock_001 /var/tmp/spdk_cpu_lock_002 /var/tmp/spdk_cpu_lock_003 /var/tmp/spdk_cpu_lock_004 00:11:10.038 11:22:05 nvmf_tcp.nvmf_target_core.nvmf_host_management -- target/host_management.sh@100 -- # /home/vagrant/spdk_repo/spdk/build/examples/bdevperf --json /dev/fd/62 -q 64 -o 65536 -w verify -t 1 00:11:10.038 11:22:05 nvmf_tcp.nvmf_target_core.nvmf_host_management -- target/host_management.sh@100 -- # gen_nvmf_target_json 0 00:11:10.038 11:22:05 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@558 -- # config=() 00:11:10.038 11:22:05 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@558 -- # local subsystem config 00:11:10.038 11:22:05 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@560 -- # for subsystem in "${@:-1}" 00:11:10.038 11:22:05 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@580 -- # config+=("$(cat <<-EOF 00:11:10.038 { 00:11:10.038 "params": { 00:11:10.038 "name": "Nvme$subsystem", 00:11:10.038 "trtype": "$TEST_TRANSPORT", 00:11:10.038 "traddr": "$NVMF_FIRST_TARGET_IP", 00:11:10.038 "adrfam": "ipv4", 00:11:10.038 "trsvcid": "$NVMF_PORT", 00:11:10.038 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:11:10.038 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:11:10.038 "hdgst": ${hdgst:-false}, 00:11:10.038 "ddgst": ${ddgst:-false} 00:11:10.038 }, 00:11:10.038 "method": "bdev_nvme_attach_controller" 00:11:10.038 } 00:11:10.038 EOF 00:11:10.038 )") 00:11:10.038 11:22:05 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@580 -- # cat 00:11:10.038 11:22:05 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@582 -- # jq . 00:11:10.038 11:22:05 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@583 -- # IFS=, 00:11:10.038 11:22:05 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@584 -- # printf '%s\n' '{ 00:11:10.038 "params": { 00:11:10.038 "name": "Nvme0", 00:11:10.038 "trtype": "tcp", 00:11:10.038 "traddr": "10.0.0.3", 00:11:10.038 "adrfam": "ipv4", 00:11:10.038 "trsvcid": "4420", 00:11:10.038 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:11:10.038 "hostnqn": "nqn.2016-06.io.spdk:host0", 00:11:10.038 "hdgst": false, 00:11:10.038 "ddgst": false 00:11:10.038 }, 00:11:10.038 "method": "bdev_nvme_attach_controller" 00:11:10.038 }' 00:11:10.038 [2024-10-07 11:22:05.439994] Starting SPDK v25.01-pre git sha1 2a4f56c54 / DPDK 24.03.0 initialization... 00:11:10.038 [2024-10-07 11:22:05.440101] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --iova-mode=pa --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid65659 ] 00:11:10.297 [2024-10-07 11:22:05.581201] app.c: 917:spdk_app_start: *NOTICE*: Total cores available: 1 00:11:10.297 [2024-10-07 11:22:05.711583] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 0 00:11:10.555 Running I/O for 1 seconds... 00:11:11.491 1471.00 IOPS, 91.94 MiB/s 00:11:11.491 Latency(us) 00:11:11.491 [2024-10-07T11:22:07.014Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:11:11.491 Job: Nvme0n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:11:11.491 Verification LBA range: start 0x0 length 0x400 00:11:11.491 Nvme0n1 : 1.03 1484.29 92.77 0.00 0.00 42289.64 5659.93 45041.11 00:11:11.491 [2024-10-07T11:22:07.014Z] =================================================================================================================== 00:11:11.491 [2024-10-07T11:22:07.014Z] Total : 1484.29 92.77 0.00 0.00 42289.64 5659.93 45041.11 00:11:11.750 11:22:07 nvmf_tcp.nvmf_target_core.nvmf_host_management -- target/host_management.sh@102 -- # stoptarget 00:11:11.750 11:22:07 nvmf_tcp.nvmf_target_core.nvmf_host_management -- target/host_management.sh@36 -- # rm -f ./local-job0-0-verify.state 00:11:11.750 11:22:07 nvmf_tcp.nvmf_target_core.nvmf_host_management -- target/host_management.sh@37 -- # rm -rf /home/vagrant/spdk_repo/spdk/test/nvmf/target/bdevperf.conf 00:11:11.750 11:22:07 nvmf_tcp.nvmf_target_core.nvmf_host_management -- target/host_management.sh@38 -- # rm -rf /home/vagrant/spdk_repo/spdk/test/nvmf/target/rpcs.txt 00:11:11.750 11:22:07 nvmf_tcp.nvmf_target_core.nvmf_host_management -- target/host_management.sh@40 -- # nvmftestfini 00:11:11.750 11:22:07 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@514 -- # nvmfcleanup 00:11:11.750 11:22:07 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@121 -- # sync 00:11:11.750 11:22:07 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@123 -- # '[' tcp == tcp ']' 00:11:11.750 11:22:07 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@124 -- # set +e 00:11:11.750 11:22:07 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@125 -- # for i in {1..20} 00:11:11.750 11:22:07 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@126 -- # modprobe -v -r nvme-tcp 00:11:11.750 rmmod nvme_tcp 00:11:11.750 rmmod nvme_fabrics 00:11:11.750 rmmod nvme_keyring 00:11:11.750 11:22:07 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@127 -- # modprobe -v -r nvme-fabrics 00:11:12.008 11:22:07 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@128 -- # set -e 00:11:12.008 11:22:07 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@129 -- # return 0 00:11:12.008 11:22:07 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@515 -- # '[' -n 65537 ']' 00:11:12.008 11:22:07 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@516 -- # killprocess 65537 00:11:12.008 11:22:07 nvmf_tcp.nvmf_target_core.nvmf_host_management -- common/autotest_common.sh@950 -- # '[' -z 65537 ']' 00:11:12.008 11:22:07 nvmf_tcp.nvmf_target_core.nvmf_host_management -- common/autotest_common.sh@954 -- # kill -0 65537 00:11:12.008 11:22:07 nvmf_tcp.nvmf_target_core.nvmf_host_management -- common/autotest_common.sh@955 -- # uname 00:11:12.009 11:22:07 nvmf_tcp.nvmf_target_core.nvmf_host_management -- common/autotest_common.sh@955 -- # '[' Linux = Linux ']' 00:11:12.009 11:22:07 nvmf_tcp.nvmf_target_core.nvmf_host_management -- common/autotest_common.sh@956 -- # ps --no-headers -o comm= 65537 00:11:12.009 killing process with pid 65537 00:11:12.009 11:22:07 nvmf_tcp.nvmf_target_core.nvmf_host_management -- common/autotest_common.sh@956 -- # process_name=reactor_1 00:11:12.009 11:22:07 nvmf_tcp.nvmf_target_core.nvmf_host_management -- common/autotest_common.sh@960 -- # '[' reactor_1 = sudo ']' 00:11:12.009 11:22:07 nvmf_tcp.nvmf_target_core.nvmf_host_management -- common/autotest_common.sh@968 -- # echo 'killing process with pid 65537' 00:11:12.009 11:22:07 nvmf_tcp.nvmf_target_core.nvmf_host_management -- common/autotest_common.sh@969 -- # kill 65537 00:11:12.009 11:22:07 nvmf_tcp.nvmf_target_core.nvmf_host_management -- common/autotest_common.sh@974 -- # wait 65537 00:11:12.267 [2024-10-07 11:22:07.630613] app.c: 719:unclaim_cpu_cores: *ERROR*: Failed to unlink lock fd for core 1, errno: 2 00:11:12.267 11:22:07 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@518 -- # '[' '' == iso ']' 00:11:12.267 11:22:07 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@521 -- # [[ tcp == \t\c\p ]] 00:11:12.267 11:22:07 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@522 -- # nvmf_tcp_fini 00:11:12.267 11:22:07 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@297 -- # iptr 00:11:12.267 11:22:07 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@789 -- # grep -v SPDK_NVMF 00:11:12.267 11:22:07 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@789 -- # iptables-save 00:11:12.267 11:22:07 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@789 -- # iptables-restore 00:11:12.267 11:22:07 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@298 -- # [[ nvmf_tgt_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s\_\s\p\d\k ]] 00:11:12.267 11:22:07 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@299 -- # nvmf_veth_fini 00:11:12.267 11:22:07 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@233 -- # ip link set nvmf_init_br nomaster 00:11:12.267 11:22:07 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@234 -- # ip link set nvmf_init_br2 nomaster 00:11:12.267 11:22:07 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@235 -- # ip link set nvmf_tgt_br nomaster 00:11:12.267 11:22:07 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@236 -- # ip link set nvmf_tgt_br2 nomaster 00:11:12.267 11:22:07 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@237 -- # ip link set nvmf_init_br down 00:11:12.267 11:22:07 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@238 -- # ip link set nvmf_init_br2 down 00:11:12.267 11:22:07 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@239 -- # ip link set nvmf_tgt_br down 00:11:12.267 11:22:07 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@240 -- # ip link set nvmf_tgt_br2 down 00:11:12.267 11:22:07 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@241 -- # ip link delete nvmf_br type bridge 00:11:12.526 11:22:07 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@242 -- # ip link delete nvmf_init_if 00:11:12.526 11:22:07 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@243 -- # ip link delete nvmf_init_if2 00:11:12.526 11:22:07 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@244 -- # ip netns exec nvmf_tgt_ns_spdk ip link delete nvmf_tgt_if 00:11:12.526 11:22:07 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@245 -- # ip netns exec nvmf_tgt_ns_spdk ip link delete nvmf_tgt_if2 00:11:12.526 11:22:07 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@246 -- # remove_spdk_ns 00:11:12.526 11:22:07 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@654 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:11:12.526 11:22:07 nvmf_tcp.nvmf_target_core.nvmf_host_management -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 15> /dev/null' 00:11:12.526 11:22:07 nvmf_tcp.nvmf_target_core.nvmf_host_management -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:11:12.526 11:22:07 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@300 -- # return 0 00:11:12.526 11:22:07 nvmf_tcp.nvmf_target_core.nvmf_host_management -- target/host_management.sh@109 -- # trap - SIGINT SIGTERM EXIT 00:11:12.526 00:11:12.526 real 0m6.692s 00:11:12.526 user 0m24.362s 00:11:12.526 sys 0m1.652s 00:11:12.526 ************************************ 00:11:12.526 END TEST nvmf_host_management 00:11:12.526 ************************************ 00:11:12.526 11:22:07 nvmf_tcp.nvmf_target_core.nvmf_host_management -- common/autotest_common.sh@1126 -- # xtrace_disable 00:11:12.526 11:22:07 nvmf_tcp.nvmf_target_core.nvmf_host_management -- common/autotest_common.sh@10 -- # set +x 00:11:12.526 11:22:07 nvmf_tcp.nvmf_target_core -- nvmf/nvmf_target_core.sh@27 -- # run_test nvmf_lvol /home/vagrant/spdk_repo/spdk/test/nvmf/target/nvmf_lvol.sh --transport=tcp 00:11:12.526 11:22:07 nvmf_tcp.nvmf_target_core -- common/autotest_common.sh@1101 -- # '[' 3 -le 1 ']' 00:11:12.526 11:22:07 nvmf_tcp.nvmf_target_core -- common/autotest_common.sh@1107 -- # xtrace_disable 00:11:12.526 11:22:07 nvmf_tcp.nvmf_target_core -- common/autotest_common.sh@10 -- # set +x 00:11:12.526 ************************************ 00:11:12.526 START TEST nvmf_lvol 00:11:12.526 ************************************ 00:11:12.526 11:22:07 nvmf_tcp.nvmf_target_core.nvmf_lvol -- common/autotest_common.sh@1125 -- # /home/vagrant/spdk_repo/spdk/test/nvmf/target/nvmf_lvol.sh --transport=tcp 00:11:12.786 * Looking for test storage... 00:11:12.786 * Found test storage at /home/vagrant/spdk_repo/spdk/test/nvmf/target 00:11:12.786 11:22:08 nvmf_tcp.nvmf_target_core.nvmf_lvol -- common/autotest_common.sh@1680 -- # [[ y == y ]] 00:11:12.786 11:22:08 nvmf_tcp.nvmf_target_core.nvmf_lvol -- common/autotest_common.sh@1681 -- # lcov --version 00:11:12.786 11:22:08 nvmf_tcp.nvmf_target_core.nvmf_lvol -- common/autotest_common.sh@1681 -- # awk '{print $NF}' 00:11:12.786 11:22:08 nvmf_tcp.nvmf_target_core.nvmf_lvol -- common/autotest_common.sh@1681 -- # lt 1.15 2 00:11:12.786 11:22:08 nvmf_tcp.nvmf_target_core.nvmf_lvol -- scripts/common.sh@373 -- # cmp_versions 1.15 '<' 2 00:11:12.786 11:22:08 nvmf_tcp.nvmf_target_core.nvmf_lvol -- scripts/common.sh@333 -- # local ver1 ver1_l 00:11:12.786 11:22:08 nvmf_tcp.nvmf_target_core.nvmf_lvol -- scripts/common.sh@334 -- # local ver2 ver2_l 00:11:12.786 11:22:08 nvmf_tcp.nvmf_target_core.nvmf_lvol -- scripts/common.sh@336 -- # IFS=.-: 00:11:12.786 11:22:08 nvmf_tcp.nvmf_target_core.nvmf_lvol -- scripts/common.sh@336 -- # read -ra ver1 00:11:12.786 11:22:08 nvmf_tcp.nvmf_target_core.nvmf_lvol -- scripts/common.sh@337 -- # IFS=.-: 00:11:12.786 11:22:08 nvmf_tcp.nvmf_target_core.nvmf_lvol -- scripts/common.sh@337 -- # read -ra ver2 00:11:12.786 11:22:08 nvmf_tcp.nvmf_target_core.nvmf_lvol -- scripts/common.sh@338 -- # local 'op=<' 00:11:12.786 11:22:08 nvmf_tcp.nvmf_target_core.nvmf_lvol -- scripts/common.sh@340 -- # ver1_l=2 00:11:12.786 11:22:08 nvmf_tcp.nvmf_target_core.nvmf_lvol -- scripts/common.sh@341 -- # ver2_l=1 00:11:12.786 11:22:08 nvmf_tcp.nvmf_target_core.nvmf_lvol -- scripts/common.sh@343 -- # local lt=0 gt=0 eq=0 v 00:11:12.786 11:22:08 nvmf_tcp.nvmf_target_core.nvmf_lvol -- scripts/common.sh@344 -- # case "$op" in 00:11:12.786 11:22:08 nvmf_tcp.nvmf_target_core.nvmf_lvol -- scripts/common.sh@345 -- # : 1 00:11:12.786 11:22:08 nvmf_tcp.nvmf_target_core.nvmf_lvol -- scripts/common.sh@364 -- # (( v = 0 )) 00:11:12.786 11:22:08 nvmf_tcp.nvmf_target_core.nvmf_lvol -- scripts/common.sh@364 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:11:12.786 11:22:08 nvmf_tcp.nvmf_target_core.nvmf_lvol -- scripts/common.sh@365 -- # decimal 1 00:11:12.786 11:22:08 nvmf_tcp.nvmf_target_core.nvmf_lvol -- scripts/common.sh@353 -- # local d=1 00:11:12.786 11:22:08 nvmf_tcp.nvmf_target_core.nvmf_lvol -- scripts/common.sh@354 -- # [[ 1 =~ ^[0-9]+$ ]] 00:11:12.786 11:22:08 nvmf_tcp.nvmf_target_core.nvmf_lvol -- scripts/common.sh@355 -- # echo 1 00:11:12.786 11:22:08 nvmf_tcp.nvmf_target_core.nvmf_lvol -- scripts/common.sh@365 -- # ver1[v]=1 00:11:12.786 11:22:08 nvmf_tcp.nvmf_target_core.nvmf_lvol -- scripts/common.sh@366 -- # decimal 2 00:11:12.786 11:22:08 nvmf_tcp.nvmf_target_core.nvmf_lvol -- scripts/common.sh@353 -- # local d=2 00:11:12.786 11:22:08 nvmf_tcp.nvmf_target_core.nvmf_lvol -- scripts/common.sh@354 -- # [[ 2 =~ ^[0-9]+$ ]] 00:11:12.786 11:22:08 nvmf_tcp.nvmf_target_core.nvmf_lvol -- scripts/common.sh@355 -- # echo 2 00:11:12.786 11:22:08 nvmf_tcp.nvmf_target_core.nvmf_lvol -- scripts/common.sh@366 -- # ver2[v]=2 00:11:12.786 11:22:08 nvmf_tcp.nvmf_target_core.nvmf_lvol -- scripts/common.sh@367 -- # (( ver1[v] > ver2[v] )) 00:11:12.786 11:22:08 nvmf_tcp.nvmf_target_core.nvmf_lvol -- scripts/common.sh@368 -- # (( ver1[v] < ver2[v] )) 00:11:12.786 11:22:08 nvmf_tcp.nvmf_target_core.nvmf_lvol -- scripts/common.sh@368 -- # return 0 00:11:12.786 11:22:08 nvmf_tcp.nvmf_target_core.nvmf_lvol -- common/autotest_common.sh@1682 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:11:12.786 11:22:08 nvmf_tcp.nvmf_target_core.nvmf_lvol -- common/autotest_common.sh@1694 -- # export 'LCOV_OPTS= 00:11:12.786 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:11:12.786 --rc genhtml_branch_coverage=1 00:11:12.786 --rc genhtml_function_coverage=1 00:11:12.786 --rc genhtml_legend=1 00:11:12.786 --rc geninfo_all_blocks=1 00:11:12.786 --rc geninfo_unexecuted_blocks=1 00:11:12.786 00:11:12.786 ' 00:11:12.786 11:22:08 nvmf_tcp.nvmf_target_core.nvmf_lvol -- common/autotest_common.sh@1694 -- # LCOV_OPTS=' 00:11:12.786 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:11:12.786 --rc genhtml_branch_coverage=1 00:11:12.786 --rc genhtml_function_coverage=1 00:11:12.786 --rc genhtml_legend=1 00:11:12.786 --rc geninfo_all_blocks=1 00:11:12.786 --rc geninfo_unexecuted_blocks=1 00:11:12.786 00:11:12.786 ' 00:11:12.786 11:22:08 nvmf_tcp.nvmf_target_core.nvmf_lvol -- common/autotest_common.sh@1695 -- # export 'LCOV=lcov 00:11:12.786 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:11:12.786 --rc genhtml_branch_coverage=1 00:11:12.786 --rc genhtml_function_coverage=1 00:11:12.786 --rc genhtml_legend=1 00:11:12.786 --rc geninfo_all_blocks=1 00:11:12.786 --rc geninfo_unexecuted_blocks=1 00:11:12.786 00:11:12.786 ' 00:11:12.786 11:22:08 nvmf_tcp.nvmf_target_core.nvmf_lvol -- common/autotest_common.sh@1695 -- # LCOV='lcov 00:11:12.786 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:11:12.786 --rc genhtml_branch_coverage=1 00:11:12.786 --rc genhtml_function_coverage=1 00:11:12.786 --rc genhtml_legend=1 00:11:12.786 --rc geninfo_all_blocks=1 00:11:12.786 --rc geninfo_unexecuted_blocks=1 00:11:12.786 00:11:12.786 ' 00:11:12.786 11:22:08 nvmf_tcp.nvmf_target_core.nvmf_lvol -- target/nvmf_lvol.sh@9 -- # source /home/vagrant/spdk_repo/spdk/test/nvmf/common.sh 00:11:12.786 11:22:08 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@7 -- # uname -s 00:11:12.786 11:22:08 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:11:12.786 11:22:08 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:11:12.786 11:22:08 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:11:12.786 11:22:08 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:11:12.786 11:22:08 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:11:12.786 11:22:08 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:11:12.786 11:22:08 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:11:12.786 11:22:08 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:11:12.786 11:22:08 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:11:12.786 11:22:08 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:11:12.786 11:22:08 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:c758a4ed-f09f-4c82-9afb-3d096f035464 00:11:12.786 11:22:08 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@18 -- # NVME_HOSTID=c758a4ed-f09f-4c82-9afb-3d096f035464 00:11:12.786 11:22:08 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:11:12.786 11:22:08 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:11:12.786 11:22:08 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@21 -- # NET_TYPE=virt 00:11:12.786 11:22:08 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:11:12.786 11:22:08 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@49 -- # source /home/vagrant/spdk_repo/spdk/scripts/common.sh 00:11:12.786 11:22:08 nvmf_tcp.nvmf_target_core.nvmf_lvol -- scripts/common.sh@15 -- # shopt -s extglob 00:11:12.786 11:22:08 nvmf_tcp.nvmf_target_core.nvmf_lvol -- scripts/common.sh@544 -- # [[ -e /bin/wpdk_common.sh ]] 00:11:12.786 11:22:08 nvmf_tcp.nvmf_target_core.nvmf_lvol -- scripts/common.sh@552 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:11:12.786 11:22:08 nvmf_tcp.nvmf_target_core.nvmf_lvol -- scripts/common.sh@553 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:11:12.786 11:22:08 nvmf_tcp.nvmf_target_core.nvmf_lvol -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:11:12.786 11:22:08 nvmf_tcp.nvmf_target_core.nvmf_lvol -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:11:12.786 11:22:08 nvmf_tcp.nvmf_target_core.nvmf_lvol -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:11:12.786 11:22:08 nvmf_tcp.nvmf_target_core.nvmf_lvol -- paths/export.sh@5 -- # export PATH 00:11:12.786 11:22:08 nvmf_tcp.nvmf_target_core.nvmf_lvol -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:11:12.786 11:22:08 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@51 -- # : 0 00:11:12.786 11:22:08 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@52 -- # export NVMF_APP_SHM_ID 00:11:12.786 11:22:08 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@53 -- # build_nvmf_app_args 00:11:12.786 11:22:08 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:11:12.786 11:22:08 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:11:12.786 11:22:08 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:11:12.786 11:22:08 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@33 -- # '[' '' -eq 1 ']' 00:11:12.786 /home/vagrant/spdk_repo/spdk/test/nvmf/common.sh: line 33: [: : integer expression expected 00:11:12.786 11:22:08 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@37 -- # '[' -n '' ']' 00:11:12.786 11:22:08 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@39 -- # '[' 0 -eq 1 ']' 00:11:12.786 11:22:08 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@55 -- # have_pci_nics=0 00:11:12.786 11:22:08 nvmf_tcp.nvmf_target_core.nvmf_lvol -- target/nvmf_lvol.sh@11 -- # MALLOC_BDEV_SIZE=64 00:11:12.786 11:22:08 nvmf_tcp.nvmf_target_core.nvmf_lvol -- target/nvmf_lvol.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:11:12.786 11:22:08 nvmf_tcp.nvmf_target_core.nvmf_lvol -- target/nvmf_lvol.sh@13 -- # LVOL_BDEV_INIT_SIZE=20 00:11:12.786 11:22:08 nvmf_tcp.nvmf_target_core.nvmf_lvol -- target/nvmf_lvol.sh@14 -- # LVOL_BDEV_FINAL_SIZE=30 00:11:12.786 11:22:08 nvmf_tcp.nvmf_target_core.nvmf_lvol -- target/nvmf_lvol.sh@16 -- # rpc_py=/home/vagrant/spdk_repo/spdk/scripts/rpc.py 00:11:12.786 11:22:08 nvmf_tcp.nvmf_target_core.nvmf_lvol -- target/nvmf_lvol.sh@18 -- # nvmftestinit 00:11:12.787 11:22:08 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@467 -- # '[' -z tcp ']' 00:11:12.787 11:22:08 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@472 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:11:12.787 11:22:08 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@474 -- # prepare_net_devs 00:11:12.787 11:22:08 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@436 -- # local -g is_hw=no 00:11:12.787 11:22:08 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@438 -- # remove_spdk_ns 00:11:12.787 11:22:08 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@654 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:11:12.787 11:22:08 nvmf_tcp.nvmf_target_core.nvmf_lvol -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 15> /dev/null' 00:11:12.787 11:22:08 nvmf_tcp.nvmf_target_core.nvmf_lvol -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:11:12.787 11:22:08 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@440 -- # [[ virt != virt ]] 00:11:12.787 11:22:08 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@442 -- # [[ no == yes ]] 00:11:12.787 11:22:08 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@449 -- # [[ virt == phy ]] 00:11:12.787 11:22:08 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@452 -- # [[ virt == phy-fallback ]] 00:11:12.787 11:22:08 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@457 -- # [[ tcp == tcp ]] 00:11:12.787 11:22:08 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@458 -- # nvmf_veth_init 00:11:12.787 11:22:08 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@145 -- # NVMF_FIRST_INITIATOR_IP=10.0.0.1 00:11:12.787 11:22:08 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@146 -- # NVMF_SECOND_INITIATOR_IP=10.0.0.2 00:11:12.787 11:22:08 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@147 -- # NVMF_FIRST_TARGET_IP=10.0.0.3 00:11:12.787 11:22:08 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@148 -- # NVMF_SECOND_TARGET_IP=10.0.0.4 00:11:12.787 11:22:08 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@149 -- # NVMF_INITIATOR_IP=10.0.0.1 00:11:12.787 11:22:08 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@150 -- # NVMF_BRIDGE=nvmf_br 00:11:12.787 11:22:08 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@151 -- # NVMF_INITIATOR_INTERFACE=nvmf_init_if 00:11:12.787 11:22:08 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@152 -- # NVMF_INITIATOR_INTERFACE2=nvmf_init_if2 00:11:12.787 11:22:08 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@153 -- # NVMF_INITIATOR_BRIDGE=nvmf_init_br 00:11:12.787 11:22:08 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@154 -- # NVMF_INITIATOR_BRIDGE2=nvmf_init_br2 00:11:12.787 11:22:08 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@155 -- # NVMF_TARGET_NAMESPACE=nvmf_tgt_ns_spdk 00:11:12.787 11:22:08 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@156 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:11:12.787 11:22:08 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@157 -- # NVMF_TARGET_INTERFACE=nvmf_tgt_if 00:11:12.787 11:22:08 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@158 -- # NVMF_TARGET_INTERFACE2=nvmf_tgt_if2 00:11:12.787 11:22:08 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@159 -- # NVMF_TARGET_BRIDGE=nvmf_tgt_br 00:11:12.787 11:22:08 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@160 -- # NVMF_TARGET_BRIDGE2=nvmf_tgt_br2 00:11:12.787 11:22:08 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@162 -- # ip link set nvmf_init_br nomaster 00:11:12.787 Cannot find device "nvmf_init_br" 00:11:12.787 11:22:08 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@162 -- # true 00:11:12.787 11:22:08 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@163 -- # ip link set nvmf_init_br2 nomaster 00:11:12.787 Cannot find device "nvmf_init_br2" 00:11:12.787 11:22:08 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@163 -- # true 00:11:12.787 11:22:08 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@164 -- # ip link set nvmf_tgt_br nomaster 00:11:12.787 Cannot find device "nvmf_tgt_br" 00:11:12.787 11:22:08 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@164 -- # true 00:11:12.787 11:22:08 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@165 -- # ip link set nvmf_tgt_br2 nomaster 00:11:12.787 Cannot find device "nvmf_tgt_br2" 00:11:12.787 11:22:08 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@165 -- # true 00:11:12.787 11:22:08 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@166 -- # ip link set nvmf_init_br down 00:11:12.787 Cannot find device "nvmf_init_br" 00:11:12.787 11:22:08 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@166 -- # true 00:11:12.787 11:22:08 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@167 -- # ip link set nvmf_init_br2 down 00:11:12.787 Cannot find device "nvmf_init_br2" 00:11:12.787 11:22:08 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@167 -- # true 00:11:12.787 11:22:08 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@168 -- # ip link set nvmf_tgt_br down 00:11:12.787 Cannot find device "nvmf_tgt_br" 00:11:12.787 11:22:08 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@168 -- # true 00:11:12.787 11:22:08 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@169 -- # ip link set nvmf_tgt_br2 down 00:11:12.787 Cannot find device "nvmf_tgt_br2" 00:11:12.787 11:22:08 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@169 -- # true 00:11:12.787 11:22:08 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@170 -- # ip link delete nvmf_br type bridge 00:11:13.047 Cannot find device "nvmf_br" 00:11:13.047 11:22:08 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@170 -- # true 00:11:13.047 11:22:08 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@171 -- # ip link delete nvmf_init_if 00:11:13.047 Cannot find device "nvmf_init_if" 00:11:13.047 11:22:08 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@171 -- # true 00:11:13.047 11:22:08 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@172 -- # ip link delete nvmf_init_if2 00:11:13.047 Cannot find device "nvmf_init_if2" 00:11:13.047 11:22:08 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@172 -- # true 00:11:13.047 11:22:08 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@173 -- # ip netns exec nvmf_tgt_ns_spdk ip link delete nvmf_tgt_if 00:11:13.047 Cannot open network namespace "nvmf_tgt_ns_spdk": No such file or directory 00:11:13.047 11:22:08 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@173 -- # true 00:11:13.047 11:22:08 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@174 -- # ip netns exec nvmf_tgt_ns_spdk ip link delete nvmf_tgt_if2 00:11:13.047 Cannot open network namespace "nvmf_tgt_ns_spdk": No such file or directory 00:11:13.047 11:22:08 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@174 -- # true 00:11:13.047 11:22:08 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@177 -- # ip netns add nvmf_tgt_ns_spdk 00:11:13.047 11:22:08 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@180 -- # ip link add nvmf_init_if type veth peer name nvmf_init_br 00:11:13.047 11:22:08 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@181 -- # ip link add nvmf_init_if2 type veth peer name nvmf_init_br2 00:11:13.047 11:22:08 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@182 -- # ip link add nvmf_tgt_if type veth peer name nvmf_tgt_br 00:11:13.047 11:22:08 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@183 -- # ip link add nvmf_tgt_if2 type veth peer name nvmf_tgt_br2 00:11:13.047 11:22:08 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@186 -- # ip link set nvmf_tgt_if netns nvmf_tgt_ns_spdk 00:11:13.047 11:22:08 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@187 -- # ip link set nvmf_tgt_if2 netns nvmf_tgt_ns_spdk 00:11:13.047 11:22:08 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@190 -- # ip addr add 10.0.0.1/24 dev nvmf_init_if 00:11:13.047 11:22:08 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@191 -- # ip addr add 10.0.0.2/24 dev nvmf_init_if2 00:11:13.047 11:22:08 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@192 -- # ip netns exec nvmf_tgt_ns_spdk ip addr add 10.0.0.3/24 dev nvmf_tgt_if 00:11:13.047 11:22:08 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@193 -- # ip netns exec nvmf_tgt_ns_spdk ip addr add 10.0.0.4/24 dev nvmf_tgt_if2 00:11:13.047 11:22:08 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@196 -- # ip link set nvmf_init_if up 00:11:13.047 11:22:08 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@197 -- # ip link set nvmf_init_if2 up 00:11:13.047 11:22:08 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@198 -- # ip link set nvmf_init_br up 00:11:13.047 11:22:08 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@199 -- # ip link set nvmf_init_br2 up 00:11:13.047 11:22:08 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@200 -- # ip link set nvmf_tgt_br up 00:11:13.047 11:22:08 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@201 -- # ip link set nvmf_tgt_br2 up 00:11:13.047 11:22:08 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@202 -- # ip netns exec nvmf_tgt_ns_spdk ip link set nvmf_tgt_if up 00:11:13.047 11:22:08 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@203 -- # ip netns exec nvmf_tgt_ns_spdk ip link set nvmf_tgt_if2 up 00:11:13.047 11:22:08 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@204 -- # ip netns exec nvmf_tgt_ns_spdk ip link set lo up 00:11:13.047 11:22:08 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@207 -- # ip link add nvmf_br type bridge 00:11:13.047 11:22:08 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@208 -- # ip link set nvmf_br up 00:11:13.047 11:22:08 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@211 -- # ip link set nvmf_init_br master nvmf_br 00:11:13.047 11:22:08 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@212 -- # ip link set nvmf_init_br2 master nvmf_br 00:11:13.047 11:22:08 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@213 -- # ip link set nvmf_tgt_br master nvmf_br 00:11:13.047 11:22:08 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@214 -- # ip link set nvmf_tgt_br2 master nvmf_br 00:11:13.047 11:22:08 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@217 -- # ipts -I INPUT 1 -i nvmf_init_if -p tcp --dport 4420 -j ACCEPT 00:11:13.047 11:22:08 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@788 -- # iptables -I INPUT 1 -i nvmf_init_if -p tcp --dport 4420 -j ACCEPT -m comment --comment 'SPDK_NVMF:-I INPUT 1 -i nvmf_init_if -p tcp --dport 4420 -j ACCEPT' 00:11:13.047 11:22:08 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@218 -- # ipts -I INPUT 1 -i nvmf_init_if2 -p tcp --dport 4420 -j ACCEPT 00:11:13.047 11:22:08 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@788 -- # iptables -I INPUT 1 -i nvmf_init_if2 -p tcp --dport 4420 -j ACCEPT -m comment --comment 'SPDK_NVMF:-I INPUT 1 -i nvmf_init_if2 -p tcp --dport 4420 -j ACCEPT' 00:11:13.047 11:22:08 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@219 -- # ipts -A FORWARD -i nvmf_br -o nvmf_br -j ACCEPT 00:11:13.047 11:22:08 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@788 -- # iptables -A FORWARD -i nvmf_br -o nvmf_br -j ACCEPT -m comment --comment 'SPDK_NVMF:-A FORWARD -i nvmf_br -o nvmf_br -j ACCEPT' 00:11:13.047 11:22:08 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@222 -- # ping -c 1 10.0.0.3 00:11:13.315 PING 10.0.0.3 (10.0.0.3) 56(84) bytes of data. 00:11:13.315 64 bytes from 10.0.0.3: icmp_seq=1 ttl=64 time=0.088 ms 00:11:13.315 00:11:13.315 --- 10.0.0.3 ping statistics --- 00:11:13.315 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:11:13.315 rtt min/avg/max/mdev = 0.088/0.088/0.088/0.000 ms 00:11:13.315 11:22:08 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@223 -- # ping -c 1 10.0.0.4 00:11:13.315 PING 10.0.0.4 (10.0.0.4) 56(84) bytes of data. 00:11:13.315 64 bytes from 10.0.0.4: icmp_seq=1 ttl=64 time=0.065 ms 00:11:13.315 00:11:13.315 --- 10.0.0.4 ping statistics --- 00:11:13.315 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:11:13.315 rtt min/avg/max/mdev = 0.065/0.065/0.065/0.000 ms 00:11:13.315 11:22:08 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@224 -- # ip netns exec nvmf_tgt_ns_spdk ping -c 1 10.0.0.1 00:11:13.315 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:11:13.315 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.023 ms 00:11:13.315 00:11:13.315 --- 10.0.0.1 ping statistics --- 00:11:13.315 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:11:13.315 rtt min/avg/max/mdev = 0.023/0.023/0.023/0.000 ms 00:11:13.315 11:22:08 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@225 -- # ip netns exec nvmf_tgt_ns_spdk ping -c 1 10.0.0.2 00:11:13.315 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:11:13.315 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.088 ms 00:11:13.315 00:11:13.315 --- 10.0.0.2 ping statistics --- 00:11:13.315 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:11:13.315 rtt min/avg/max/mdev = 0.088/0.088/0.088/0.000 ms 00:11:13.315 11:22:08 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@227 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:11:13.315 11:22:08 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@459 -- # return 0 00:11:13.315 11:22:08 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@476 -- # '[' '' == iso ']' 00:11:13.315 11:22:08 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@480 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:11:13.315 11:22:08 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@481 -- # [[ tcp == \r\d\m\a ]] 00:11:13.315 11:22:08 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@490 -- # [[ tcp == \t\c\p ]] 00:11:13.315 11:22:08 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@491 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:11:13.315 11:22:08 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@494 -- # '[' tcp == tcp ']' 00:11:13.315 11:22:08 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@500 -- # modprobe nvme-tcp 00:11:13.315 11:22:08 nvmf_tcp.nvmf_target_core.nvmf_lvol -- target/nvmf_lvol.sh@19 -- # nvmfappstart -m 0x7 00:11:13.315 11:22:08 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@505 -- # timing_enter start_nvmf_tgt 00:11:13.315 11:22:08 nvmf_tcp.nvmf_target_core.nvmf_lvol -- common/autotest_common.sh@724 -- # xtrace_disable 00:11:13.315 11:22:08 nvmf_tcp.nvmf_target_core.nvmf_lvol -- common/autotest_common.sh@10 -- # set +x 00:11:13.315 11:22:08 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@507 -- # nvmfpid=65934 00:11:13.315 11:22:08 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@506 -- # ip netns exec nvmf_tgt_ns_spdk /home/vagrant/spdk_repo/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x7 00:11:13.315 11:22:08 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@508 -- # waitforlisten 65934 00:11:13.315 11:22:08 nvmf_tcp.nvmf_target_core.nvmf_lvol -- common/autotest_common.sh@831 -- # '[' -z 65934 ']' 00:11:13.315 11:22:08 nvmf_tcp.nvmf_target_core.nvmf_lvol -- common/autotest_common.sh@835 -- # local rpc_addr=/var/tmp/spdk.sock 00:11:13.315 11:22:08 nvmf_tcp.nvmf_target_core.nvmf_lvol -- common/autotest_common.sh@836 -- # local max_retries=100 00:11:13.315 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:11:13.315 11:22:08 nvmf_tcp.nvmf_target_core.nvmf_lvol -- common/autotest_common.sh@838 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:11:13.315 11:22:08 nvmf_tcp.nvmf_target_core.nvmf_lvol -- common/autotest_common.sh@840 -- # xtrace_disable 00:11:13.315 11:22:08 nvmf_tcp.nvmf_target_core.nvmf_lvol -- common/autotest_common.sh@10 -- # set +x 00:11:13.315 [2024-10-07 11:22:08.693237] Starting SPDK v25.01-pre git sha1 2a4f56c54 / DPDK 24.03.0 initialization... 00:11:13.315 [2024-10-07 11:22:08.693354] [ DPDK EAL parameters: nvmf -c 0x7 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --iova-mode=pa --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:11:13.315 [2024-10-07 11:22:08.836705] app.c: 917:spdk_app_start: *NOTICE*: Total cores available: 3 00:11:13.574 [2024-10-07 11:22:08.966117] app.c: 610:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:11:13.574 [2024-10-07 11:22:08.966172] app.c: 611:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:11:13.574 [2024-10-07 11:22:08.966186] app.c: 616:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:11:13.574 [2024-10-07 11:22:08.966197] app.c: 617:app_setup_trace: *NOTICE*: SPDK application currently running. 00:11:13.574 [2024-10-07 11:22:08.966207] app.c: 618:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:11:13.574 [2024-10-07 11:22:08.967375] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 1 00:11:13.574 [2024-10-07 11:22:08.967532] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 2 00:11:13.574 [2024-10-07 11:22:08.967540] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 0 00:11:14.509 11:22:09 nvmf_tcp.nvmf_target_core.nvmf_lvol -- common/autotest_common.sh@860 -- # (( i == 0 )) 00:11:14.509 11:22:09 nvmf_tcp.nvmf_target_core.nvmf_lvol -- common/autotest_common.sh@864 -- # return 0 00:11:14.509 11:22:09 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@509 -- # timing_exit start_nvmf_tgt 00:11:14.509 11:22:09 nvmf_tcp.nvmf_target_core.nvmf_lvol -- common/autotest_common.sh@730 -- # xtrace_disable 00:11:14.509 11:22:09 nvmf_tcp.nvmf_target_core.nvmf_lvol -- common/autotest_common.sh@10 -- # set +x 00:11:14.509 11:22:09 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@510 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:11:14.509 11:22:09 nvmf_tcp.nvmf_target_core.nvmf_lvol -- target/nvmf_lvol.sh@21 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_create_transport -t tcp -o -u 8192 00:11:14.767 [2024-10-07 11:22:10.178150] tcp.c: 738:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:11:14.767 11:22:10 nvmf_tcp.nvmf_target_core.nvmf_lvol -- target/nvmf_lvol.sh@24 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py bdev_malloc_create 64 512 00:11:15.334 11:22:10 nvmf_tcp.nvmf_target_core.nvmf_lvol -- target/nvmf_lvol.sh@24 -- # base_bdevs='Malloc0 ' 00:11:15.334 11:22:10 nvmf_tcp.nvmf_target_core.nvmf_lvol -- target/nvmf_lvol.sh@25 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py bdev_malloc_create 64 512 00:11:15.334 11:22:10 nvmf_tcp.nvmf_target_core.nvmf_lvol -- target/nvmf_lvol.sh@25 -- # base_bdevs+=Malloc1 00:11:15.334 11:22:10 nvmf_tcp.nvmf_target_core.nvmf_lvol -- target/nvmf_lvol.sh@26 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py bdev_raid_create -n raid0 -z 64 -r 0 -b 'Malloc0 Malloc1' 00:11:15.592 11:22:11 nvmf_tcp.nvmf_target_core.nvmf_lvol -- target/nvmf_lvol.sh@29 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py bdev_lvol_create_lvstore raid0 lvs 00:11:16.158 11:22:11 nvmf_tcp.nvmf_target_core.nvmf_lvol -- target/nvmf_lvol.sh@29 -- # lvs=35146cf9-639c-4e5b-ae65-e24fa5a3eb35 00:11:16.158 11:22:11 nvmf_tcp.nvmf_target_core.nvmf_lvol -- target/nvmf_lvol.sh@32 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py bdev_lvol_create -u 35146cf9-639c-4e5b-ae65-e24fa5a3eb35 lvol 20 00:11:16.426 11:22:11 nvmf_tcp.nvmf_target_core.nvmf_lvol -- target/nvmf_lvol.sh@32 -- # lvol=3004b0bc-d72f-4590-89b0-ef4dd46e5b0a 00:11:16.427 11:22:11 nvmf_tcp.nvmf_target_core.nvmf_lvol -- target/nvmf_lvol.sh@35 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 -a -s SPDK0 00:11:16.684 11:22:12 nvmf_tcp.nvmf_target_core.nvmf_lvol -- target/nvmf_lvol.sh@36 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 3004b0bc-d72f-4590-89b0-ef4dd46e5b0a 00:11:16.943 11:22:12 nvmf_tcp.nvmf_target_core.nvmf_lvol -- target/nvmf_lvol.sh@37 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.3 -s 4420 00:11:17.201 [2024-10-07 11:22:12.653935] tcp.c:1081:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.3 port 4420 *** 00:11:17.201 11:22:12 nvmf_tcp.nvmf_target_core.nvmf_lvol -- target/nvmf_lvol.sh@38 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.3 -s 4420 00:11:17.459 11:22:12 nvmf_tcp.nvmf_target_core.nvmf_lvol -- target/nvmf_lvol.sh@42 -- # perf_pid=66098 00:11:17.459 11:22:12 nvmf_tcp.nvmf_target_core.nvmf_lvol -- target/nvmf_lvol.sh@41 -- # /home/vagrant/spdk_repo/spdk/build/bin/spdk_nvme_perf -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.3 trsvcid:4420' -o 4096 -q 128 -s 512 -w randwrite -t 10 -c 0x18 00:11:17.459 11:22:12 nvmf_tcp.nvmf_target_core.nvmf_lvol -- target/nvmf_lvol.sh@44 -- # sleep 1 00:11:18.832 11:22:13 nvmf_tcp.nvmf_target_core.nvmf_lvol -- target/nvmf_lvol.sh@47 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py bdev_lvol_snapshot 3004b0bc-d72f-4590-89b0-ef4dd46e5b0a MY_SNAPSHOT 00:11:18.832 11:22:14 nvmf_tcp.nvmf_target_core.nvmf_lvol -- target/nvmf_lvol.sh@47 -- # snapshot=f81d12f3-294d-4376-80d7-69818d17ca15 00:11:18.832 11:22:14 nvmf_tcp.nvmf_target_core.nvmf_lvol -- target/nvmf_lvol.sh@48 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py bdev_lvol_resize 3004b0bc-d72f-4590-89b0-ef4dd46e5b0a 30 00:11:19.397 11:22:14 nvmf_tcp.nvmf_target_core.nvmf_lvol -- target/nvmf_lvol.sh@49 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py bdev_lvol_clone f81d12f3-294d-4376-80d7-69818d17ca15 MY_CLONE 00:11:19.655 11:22:15 nvmf_tcp.nvmf_target_core.nvmf_lvol -- target/nvmf_lvol.sh@49 -- # clone=8699f3f9-364f-4a6a-a749-4cb41313a552 00:11:19.655 11:22:15 nvmf_tcp.nvmf_target_core.nvmf_lvol -- target/nvmf_lvol.sh@50 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py bdev_lvol_inflate 8699f3f9-364f-4a6a-a749-4cb41313a552 00:11:20.589 11:22:15 nvmf_tcp.nvmf_target_core.nvmf_lvol -- target/nvmf_lvol.sh@53 -- # wait 66098 00:11:28.701 Initializing NVMe Controllers 00:11:28.701 Attached to NVMe over Fabrics controller at 10.0.0.3:4420: nqn.2016-06.io.spdk:cnode0 00:11:28.701 Controller IO queue size 128, less than required. 00:11:28.701 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:11:28.701 Associating TCP (addr:10.0.0.3 subnqn:nqn.2016-06.io.spdk:cnode0) NSID 1 with lcore 3 00:11:28.701 Associating TCP (addr:10.0.0.3 subnqn:nqn.2016-06.io.spdk:cnode0) NSID 1 with lcore 4 00:11:28.701 Initialization complete. Launching workers. 00:11:28.701 ======================================================== 00:11:28.701 Latency(us) 00:11:28.701 Device Information : IOPS MiB/s Average min max 00:11:28.701 TCP (addr:10.0.0.3 subnqn:nqn.2016-06.io.spdk:cnode0) NSID 1 from core 3: 10463.00 40.87 12236.24 1653.35 147294.98 00:11:28.701 TCP (addr:10.0.0.3 subnqn:nqn.2016-06.io.spdk:cnode0) NSID 1 from core 4: 10292.50 40.21 12436.52 3146.60 61703.48 00:11:28.701 ======================================================== 00:11:28.701 Total : 20755.50 81.08 12335.56 1653.35 147294.98 00:11:28.701 00:11:28.701 11:22:23 nvmf_tcp.nvmf_target_core.nvmf_lvol -- target/nvmf_lvol.sh@56 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode0 00:11:28.701 11:22:23 nvmf_tcp.nvmf_target_core.nvmf_lvol -- target/nvmf_lvol.sh@57 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py bdev_lvol_delete 3004b0bc-d72f-4590-89b0-ef4dd46e5b0a 00:11:28.701 11:22:23 nvmf_tcp.nvmf_target_core.nvmf_lvol -- target/nvmf_lvol.sh@58 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py bdev_lvol_delete_lvstore -u 35146cf9-639c-4e5b-ae65-e24fa5a3eb35 00:11:28.701 11:22:24 nvmf_tcp.nvmf_target_core.nvmf_lvol -- target/nvmf_lvol.sh@60 -- # rm -f 00:11:28.701 11:22:24 nvmf_tcp.nvmf_target_core.nvmf_lvol -- target/nvmf_lvol.sh@62 -- # trap - SIGINT SIGTERM EXIT 00:11:28.701 11:22:24 nvmf_tcp.nvmf_target_core.nvmf_lvol -- target/nvmf_lvol.sh@64 -- # nvmftestfini 00:11:28.701 11:22:24 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@514 -- # nvmfcleanup 00:11:28.701 11:22:24 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@121 -- # sync 00:11:28.701 11:22:24 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@123 -- # '[' tcp == tcp ']' 00:11:28.701 11:22:24 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@124 -- # set +e 00:11:28.701 11:22:24 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@125 -- # for i in {1..20} 00:11:28.701 11:22:24 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@126 -- # modprobe -v -r nvme-tcp 00:11:28.701 rmmod nvme_tcp 00:11:28.701 rmmod nvme_fabrics 00:11:29.025 rmmod nvme_keyring 00:11:29.025 11:22:24 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@127 -- # modprobe -v -r nvme-fabrics 00:11:29.025 11:22:24 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@128 -- # set -e 00:11:29.025 11:22:24 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@129 -- # return 0 00:11:29.025 11:22:24 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@515 -- # '[' -n 65934 ']' 00:11:29.025 11:22:24 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@516 -- # killprocess 65934 00:11:29.025 11:22:24 nvmf_tcp.nvmf_target_core.nvmf_lvol -- common/autotest_common.sh@950 -- # '[' -z 65934 ']' 00:11:29.025 11:22:24 nvmf_tcp.nvmf_target_core.nvmf_lvol -- common/autotest_common.sh@954 -- # kill -0 65934 00:11:29.025 11:22:24 nvmf_tcp.nvmf_target_core.nvmf_lvol -- common/autotest_common.sh@955 -- # uname 00:11:29.025 11:22:24 nvmf_tcp.nvmf_target_core.nvmf_lvol -- common/autotest_common.sh@955 -- # '[' Linux = Linux ']' 00:11:29.025 11:22:24 nvmf_tcp.nvmf_target_core.nvmf_lvol -- common/autotest_common.sh@956 -- # ps --no-headers -o comm= 65934 00:11:29.025 killing process with pid 65934 00:11:29.025 11:22:24 nvmf_tcp.nvmf_target_core.nvmf_lvol -- common/autotest_common.sh@956 -- # process_name=reactor_0 00:11:29.025 11:22:24 nvmf_tcp.nvmf_target_core.nvmf_lvol -- common/autotest_common.sh@960 -- # '[' reactor_0 = sudo ']' 00:11:29.025 11:22:24 nvmf_tcp.nvmf_target_core.nvmf_lvol -- common/autotest_common.sh@968 -- # echo 'killing process with pid 65934' 00:11:29.025 11:22:24 nvmf_tcp.nvmf_target_core.nvmf_lvol -- common/autotest_common.sh@969 -- # kill 65934 00:11:29.025 11:22:24 nvmf_tcp.nvmf_target_core.nvmf_lvol -- common/autotest_common.sh@974 -- # wait 65934 00:11:29.292 11:22:24 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@518 -- # '[' '' == iso ']' 00:11:29.292 11:22:24 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@521 -- # [[ tcp == \t\c\p ]] 00:11:29.292 11:22:24 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@522 -- # nvmf_tcp_fini 00:11:29.292 11:22:24 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@297 -- # iptr 00:11:29.292 11:22:24 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@789 -- # iptables-save 00:11:29.292 11:22:24 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@789 -- # grep -v SPDK_NVMF 00:11:29.292 11:22:24 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@789 -- # iptables-restore 00:11:29.292 11:22:24 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@298 -- # [[ nvmf_tgt_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s\_\s\p\d\k ]] 00:11:29.292 11:22:24 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@299 -- # nvmf_veth_fini 00:11:29.292 11:22:24 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@233 -- # ip link set nvmf_init_br nomaster 00:11:29.292 11:22:24 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@234 -- # ip link set nvmf_init_br2 nomaster 00:11:29.292 11:22:24 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@235 -- # ip link set nvmf_tgt_br nomaster 00:11:29.292 11:22:24 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@236 -- # ip link set nvmf_tgt_br2 nomaster 00:11:29.292 11:22:24 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@237 -- # ip link set nvmf_init_br down 00:11:29.292 11:22:24 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@238 -- # ip link set nvmf_init_br2 down 00:11:29.292 11:22:24 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@239 -- # ip link set nvmf_tgt_br down 00:11:29.292 11:22:24 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@240 -- # ip link set nvmf_tgt_br2 down 00:11:29.292 11:22:24 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@241 -- # ip link delete nvmf_br type bridge 00:11:29.292 11:22:24 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@242 -- # ip link delete nvmf_init_if 00:11:29.292 11:22:24 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@243 -- # ip link delete nvmf_init_if2 00:11:29.292 11:22:24 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@244 -- # ip netns exec nvmf_tgt_ns_spdk ip link delete nvmf_tgt_if 00:11:29.292 11:22:24 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@245 -- # ip netns exec nvmf_tgt_ns_spdk ip link delete nvmf_tgt_if2 00:11:29.292 11:22:24 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@246 -- # remove_spdk_ns 00:11:29.292 11:22:24 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@654 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:11:29.292 11:22:24 nvmf_tcp.nvmf_target_core.nvmf_lvol -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 15> /dev/null' 00:11:29.292 11:22:24 nvmf_tcp.nvmf_target_core.nvmf_lvol -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:11:29.552 11:22:24 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@300 -- # return 0 00:11:29.552 00:11:29.552 real 0m16.868s 00:11:29.552 user 1m8.804s 00:11:29.552 sys 0m4.065s 00:11:29.552 11:22:24 nvmf_tcp.nvmf_target_core.nvmf_lvol -- common/autotest_common.sh@1126 -- # xtrace_disable 00:11:29.552 ************************************ 00:11:29.552 END TEST nvmf_lvol 00:11:29.552 ************************************ 00:11:29.552 11:22:24 nvmf_tcp.nvmf_target_core.nvmf_lvol -- common/autotest_common.sh@10 -- # set +x 00:11:29.552 11:22:24 nvmf_tcp.nvmf_target_core -- nvmf/nvmf_target_core.sh@28 -- # run_test nvmf_lvs_grow /home/vagrant/spdk_repo/spdk/test/nvmf/target/nvmf_lvs_grow.sh --transport=tcp 00:11:29.552 11:22:24 nvmf_tcp.nvmf_target_core -- common/autotest_common.sh@1101 -- # '[' 3 -le 1 ']' 00:11:29.552 11:22:24 nvmf_tcp.nvmf_target_core -- common/autotest_common.sh@1107 -- # xtrace_disable 00:11:29.552 11:22:24 nvmf_tcp.nvmf_target_core -- common/autotest_common.sh@10 -- # set +x 00:11:29.552 ************************************ 00:11:29.552 START TEST nvmf_lvs_grow 00:11:29.552 ************************************ 00:11:29.552 11:22:24 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- common/autotest_common.sh@1125 -- # /home/vagrant/spdk_repo/spdk/test/nvmf/target/nvmf_lvs_grow.sh --transport=tcp 00:11:29.552 * Looking for test storage... 00:11:29.552 * Found test storage at /home/vagrant/spdk_repo/spdk/test/nvmf/target 00:11:29.552 11:22:24 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- common/autotest_common.sh@1680 -- # [[ y == y ]] 00:11:29.552 11:22:24 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- common/autotest_common.sh@1681 -- # lcov --version 00:11:29.552 11:22:24 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- common/autotest_common.sh@1681 -- # awk '{print $NF}' 00:11:29.552 11:22:25 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- common/autotest_common.sh@1681 -- # lt 1.15 2 00:11:29.552 11:22:25 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- scripts/common.sh@373 -- # cmp_versions 1.15 '<' 2 00:11:29.552 11:22:25 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- scripts/common.sh@333 -- # local ver1 ver1_l 00:11:29.552 11:22:25 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- scripts/common.sh@334 -- # local ver2 ver2_l 00:11:29.552 11:22:25 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- scripts/common.sh@336 -- # IFS=.-: 00:11:29.552 11:22:25 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- scripts/common.sh@336 -- # read -ra ver1 00:11:29.552 11:22:25 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- scripts/common.sh@337 -- # IFS=.-: 00:11:29.552 11:22:25 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- scripts/common.sh@337 -- # read -ra ver2 00:11:29.552 11:22:25 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- scripts/common.sh@338 -- # local 'op=<' 00:11:29.552 11:22:25 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- scripts/common.sh@340 -- # ver1_l=2 00:11:29.552 11:22:25 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- scripts/common.sh@341 -- # ver2_l=1 00:11:29.552 11:22:25 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- scripts/common.sh@343 -- # local lt=0 gt=0 eq=0 v 00:11:29.552 11:22:25 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- scripts/common.sh@344 -- # case "$op" in 00:11:29.552 11:22:25 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- scripts/common.sh@345 -- # : 1 00:11:29.552 11:22:25 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- scripts/common.sh@364 -- # (( v = 0 )) 00:11:29.552 11:22:25 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- scripts/common.sh@364 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:11:29.552 11:22:25 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- scripts/common.sh@365 -- # decimal 1 00:11:29.552 11:22:25 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- scripts/common.sh@353 -- # local d=1 00:11:29.552 11:22:25 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- scripts/common.sh@354 -- # [[ 1 =~ ^[0-9]+$ ]] 00:11:29.552 11:22:25 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- scripts/common.sh@355 -- # echo 1 00:11:29.552 11:22:25 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- scripts/common.sh@365 -- # ver1[v]=1 00:11:29.552 11:22:25 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- scripts/common.sh@366 -- # decimal 2 00:11:29.552 11:22:25 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- scripts/common.sh@353 -- # local d=2 00:11:29.552 11:22:25 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- scripts/common.sh@354 -- # [[ 2 =~ ^[0-9]+$ ]] 00:11:29.552 11:22:25 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- scripts/common.sh@355 -- # echo 2 00:11:29.552 11:22:25 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- scripts/common.sh@366 -- # ver2[v]=2 00:11:29.552 11:22:25 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- scripts/common.sh@367 -- # (( ver1[v] > ver2[v] )) 00:11:29.552 11:22:25 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- scripts/common.sh@368 -- # (( ver1[v] < ver2[v] )) 00:11:29.552 11:22:25 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- scripts/common.sh@368 -- # return 0 00:11:29.552 11:22:25 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- common/autotest_common.sh@1682 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:11:29.552 11:22:25 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- common/autotest_common.sh@1694 -- # export 'LCOV_OPTS= 00:11:29.552 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:11:29.552 --rc genhtml_branch_coverage=1 00:11:29.552 --rc genhtml_function_coverage=1 00:11:29.552 --rc genhtml_legend=1 00:11:29.552 --rc geninfo_all_blocks=1 00:11:29.552 --rc geninfo_unexecuted_blocks=1 00:11:29.552 00:11:29.552 ' 00:11:29.552 11:22:25 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- common/autotest_common.sh@1694 -- # LCOV_OPTS=' 00:11:29.552 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:11:29.552 --rc genhtml_branch_coverage=1 00:11:29.552 --rc genhtml_function_coverage=1 00:11:29.552 --rc genhtml_legend=1 00:11:29.552 --rc geninfo_all_blocks=1 00:11:29.552 --rc geninfo_unexecuted_blocks=1 00:11:29.552 00:11:29.552 ' 00:11:29.552 11:22:25 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- common/autotest_common.sh@1695 -- # export 'LCOV=lcov 00:11:29.552 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:11:29.552 --rc genhtml_branch_coverage=1 00:11:29.552 --rc genhtml_function_coverage=1 00:11:29.553 --rc genhtml_legend=1 00:11:29.553 --rc geninfo_all_blocks=1 00:11:29.553 --rc geninfo_unexecuted_blocks=1 00:11:29.553 00:11:29.553 ' 00:11:29.553 11:22:25 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- common/autotest_common.sh@1695 -- # LCOV='lcov 00:11:29.553 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:11:29.553 --rc genhtml_branch_coverage=1 00:11:29.553 --rc genhtml_function_coverage=1 00:11:29.553 --rc genhtml_legend=1 00:11:29.553 --rc geninfo_all_blocks=1 00:11:29.553 --rc geninfo_unexecuted_blocks=1 00:11:29.553 00:11:29.553 ' 00:11:29.553 11:22:25 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- target/nvmf_lvs_grow.sh@9 -- # source /home/vagrant/spdk_repo/spdk/test/nvmf/common.sh 00:11:29.553 11:22:25 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@7 -- # uname -s 00:11:29.812 11:22:25 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:11:29.812 11:22:25 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:11:29.812 11:22:25 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:11:29.812 11:22:25 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:11:29.812 11:22:25 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:11:29.812 11:22:25 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:11:29.812 11:22:25 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:11:29.812 11:22:25 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:11:29.812 11:22:25 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:11:29.812 11:22:25 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:11:29.812 11:22:25 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:c758a4ed-f09f-4c82-9afb-3d096f035464 00:11:29.812 11:22:25 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@18 -- # NVME_HOSTID=c758a4ed-f09f-4c82-9afb-3d096f035464 00:11:29.812 11:22:25 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:11:29.812 11:22:25 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:11:29.812 11:22:25 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@21 -- # NET_TYPE=virt 00:11:29.812 11:22:25 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:11:29.812 11:22:25 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@49 -- # source /home/vagrant/spdk_repo/spdk/scripts/common.sh 00:11:29.812 11:22:25 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- scripts/common.sh@15 -- # shopt -s extglob 00:11:29.812 11:22:25 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- scripts/common.sh@544 -- # [[ -e /bin/wpdk_common.sh ]] 00:11:29.812 11:22:25 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- scripts/common.sh@552 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:11:29.812 11:22:25 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- scripts/common.sh@553 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:11:29.812 11:22:25 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:11:29.812 11:22:25 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:11:29.812 11:22:25 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:11:29.812 11:22:25 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- paths/export.sh@5 -- # export PATH 00:11:29.812 11:22:25 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:11:29.812 11:22:25 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@51 -- # : 0 00:11:29.812 11:22:25 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@52 -- # export NVMF_APP_SHM_ID 00:11:29.812 11:22:25 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@53 -- # build_nvmf_app_args 00:11:29.812 11:22:25 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:11:29.812 11:22:25 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:11:29.812 11:22:25 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:11:29.812 11:22:25 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@33 -- # '[' '' -eq 1 ']' 00:11:29.812 /home/vagrant/spdk_repo/spdk/test/nvmf/common.sh: line 33: [: : integer expression expected 00:11:29.812 11:22:25 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@37 -- # '[' -n '' ']' 00:11:29.812 11:22:25 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@39 -- # '[' 0 -eq 1 ']' 00:11:29.812 11:22:25 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@55 -- # have_pci_nics=0 00:11:29.812 11:22:25 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- target/nvmf_lvs_grow.sh@11 -- # rpc_py=/home/vagrant/spdk_repo/spdk/scripts/rpc.py 00:11:29.812 11:22:25 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- target/nvmf_lvs_grow.sh@12 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:11:29.812 11:22:25 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- target/nvmf_lvs_grow.sh@98 -- # nvmftestinit 00:11:29.812 11:22:25 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@467 -- # '[' -z tcp ']' 00:11:29.812 11:22:25 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@472 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:11:29.812 11:22:25 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@474 -- # prepare_net_devs 00:11:29.812 11:22:25 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@436 -- # local -g is_hw=no 00:11:29.812 11:22:25 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@438 -- # remove_spdk_ns 00:11:29.812 11:22:25 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@654 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:11:29.812 11:22:25 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 15> /dev/null' 00:11:29.812 11:22:25 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:11:29.812 11:22:25 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@440 -- # [[ virt != virt ]] 00:11:29.812 11:22:25 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@442 -- # [[ no == yes ]] 00:11:29.812 11:22:25 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@449 -- # [[ virt == phy ]] 00:11:29.812 11:22:25 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@452 -- # [[ virt == phy-fallback ]] 00:11:29.812 11:22:25 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@457 -- # [[ tcp == tcp ]] 00:11:29.812 11:22:25 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@458 -- # nvmf_veth_init 00:11:29.812 11:22:25 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@145 -- # NVMF_FIRST_INITIATOR_IP=10.0.0.1 00:11:29.812 11:22:25 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@146 -- # NVMF_SECOND_INITIATOR_IP=10.0.0.2 00:11:29.812 11:22:25 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@147 -- # NVMF_FIRST_TARGET_IP=10.0.0.3 00:11:29.812 11:22:25 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@148 -- # NVMF_SECOND_TARGET_IP=10.0.0.4 00:11:29.812 11:22:25 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@149 -- # NVMF_INITIATOR_IP=10.0.0.1 00:11:29.812 11:22:25 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@150 -- # NVMF_BRIDGE=nvmf_br 00:11:29.812 11:22:25 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@151 -- # NVMF_INITIATOR_INTERFACE=nvmf_init_if 00:11:29.812 11:22:25 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@152 -- # NVMF_INITIATOR_INTERFACE2=nvmf_init_if2 00:11:29.812 11:22:25 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@153 -- # NVMF_INITIATOR_BRIDGE=nvmf_init_br 00:11:29.812 11:22:25 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@154 -- # NVMF_INITIATOR_BRIDGE2=nvmf_init_br2 00:11:29.812 11:22:25 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@155 -- # NVMF_TARGET_NAMESPACE=nvmf_tgt_ns_spdk 00:11:29.812 11:22:25 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@156 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:11:29.812 11:22:25 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@157 -- # NVMF_TARGET_INTERFACE=nvmf_tgt_if 00:11:29.812 11:22:25 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@158 -- # NVMF_TARGET_INTERFACE2=nvmf_tgt_if2 00:11:29.812 11:22:25 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@159 -- # NVMF_TARGET_BRIDGE=nvmf_tgt_br 00:11:29.812 11:22:25 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@160 -- # NVMF_TARGET_BRIDGE2=nvmf_tgt_br2 00:11:29.812 11:22:25 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@162 -- # ip link set nvmf_init_br nomaster 00:11:29.812 Cannot find device "nvmf_init_br" 00:11:29.812 11:22:25 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@162 -- # true 00:11:29.812 11:22:25 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@163 -- # ip link set nvmf_init_br2 nomaster 00:11:29.812 Cannot find device "nvmf_init_br2" 00:11:29.812 11:22:25 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@163 -- # true 00:11:29.812 11:22:25 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@164 -- # ip link set nvmf_tgt_br nomaster 00:11:29.812 Cannot find device "nvmf_tgt_br" 00:11:29.812 11:22:25 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@164 -- # true 00:11:29.812 11:22:25 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@165 -- # ip link set nvmf_tgt_br2 nomaster 00:11:29.812 Cannot find device "nvmf_tgt_br2" 00:11:29.812 11:22:25 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@165 -- # true 00:11:29.812 11:22:25 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@166 -- # ip link set nvmf_init_br down 00:11:29.812 Cannot find device "nvmf_init_br" 00:11:29.812 11:22:25 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@166 -- # true 00:11:29.812 11:22:25 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@167 -- # ip link set nvmf_init_br2 down 00:11:29.812 Cannot find device "nvmf_init_br2" 00:11:29.813 11:22:25 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@167 -- # true 00:11:29.813 11:22:25 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@168 -- # ip link set nvmf_tgt_br down 00:11:29.813 Cannot find device "nvmf_tgt_br" 00:11:29.813 11:22:25 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@168 -- # true 00:11:29.813 11:22:25 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@169 -- # ip link set nvmf_tgt_br2 down 00:11:29.813 Cannot find device "nvmf_tgt_br2" 00:11:29.813 11:22:25 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@169 -- # true 00:11:29.813 11:22:25 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@170 -- # ip link delete nvmf_br type bridge 00:11:29.813 Cannot find device "nvmf_br" 00:11:29.813 11:22:25 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@170 -- # true 00:11:29.813 11:22:25 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@171 -- # ip link delete nvmf_init_if 00:11:29.813 Cannot find device "nvmf_init_if" 00:11:29.813 11:22:25 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@171 -- # true 00:11:29.813 11:22:25 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@172 -- # ip link delete nvmf_init_if2 00:11:29.813 Cannot find device "nvmf_init_if2" 00:11:29.813 11:22:25 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@172 -- # true 00:11:29.813 11:22:25 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@173 -- # ip netns exec nvmf_tgt_ns_spdk ip link delete nvmf_tgt_if 00:11:29.813 Cannot open network namespace "nvmf_tgt_ns_spdk": No such file or directory 00:11:29.813 11:22:25 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@173 -- # true 00:11:29.813 11:22:25 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@174 -- # ip netns exec nvmf_tgt_ns_spdk ip link delete nvmf_tgt_if2 00:11:29.813 Cannot open network namespace "nvmf_tgt_ns_spdk": No such file or directory 00:11:29.813 11:22:25 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@174 -- # true 00:11:29.813 11:22:25 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@177 -- # ip netns add nvmf_tgt_ns_spdk 00:11:29.813 11:22:25 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@180 -- # ip link add nvmf_init_if type veth peer name nvmf_init_br 00:11:29.813 11:22:25 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@181 -- # ip link add nvmf_init_if2 type veth peer name nvmf_init_br2 00:11:29.813 11:22:25 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@182 -- # ip link add nvmf_tgt_if type veth peer name nvmf_tgt_br 00:11:29.813 11:22:25 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@183 -- # ip link add nvmf_tgt_if2 type veth peer name nvmf_tgt_br2 00:11:29.813 11:22:25 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@186 -- # ip link set nvmf_tgt_if netns nvmf_tgt_ns_spdk 00:11:29.813 11:22:25 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@187 -- # ip link set nvmf_tgt_if2 netns nvmf_tgt_ns_spdk 00:11:30.073 11:22:25 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@190 -- # ip addr add 10.0.0.1/24 dev nvmf_init_if 00:11:30.073 11:22:25 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@191 -- # ip addr add 10.0.0.2/24 dev nvmf_init_if2 00:11:30.073 11:22:25 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@192 -- # ip netns exec nvmf_tgt_ns_spdk ip addr add 10.0.0.3/24 dev nvmf_tgt_if 00:11:30.073 11:22:25 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@193 -- # ip netns exec nvmf_tgt_ns_spdk ip addr add 10.0.0.4/24 dev nvmf_tgt_if2 00:11:30.073 11:22:25 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@196 -- # ip link set nvmf_init_if up 00:11:30.073 11:22:25 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@197 -- # ip link set nvmf_init_if2 up 00:11:30.073 11:22:25 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@198 -- # ip link set nvmf_init_br up 00:11:30.073 11:22:25 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@199 -- # ip link set nvmf_init_br2 up 00:11:30.073 11:22:25 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@200 -- # ip link set nvmf_tgt_br up 00:11:30.073 11:22:25 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@201 -- # ip link set nvmf_tgt_br2 up 00:11:30.073 11:22:25 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@202 -- # ip netns exec nvmf_tgt_ns_spdk ip link set nvmf_tgt_if up 00:11:30.073 11:22:25 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@203 -- # ip netns exec nvmf_tgt_ns_spdk ip link set nvmf_tgt_if2 up 00:11:30.073 11:22:25 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@204 -- # ip netns exec nvmf_tgt_ns_spdk ip link set lo up 00:11:30.073 11:22:25 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@207 -- # ip link add nvmf_br type bridge 00:11:30.073 11:22:25 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@208 -- # ip link set nvmf_br up 00:11:30.073 11:22:25 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@211 -- # ip link set nvmf_init_br master nvmf_br 00:11:30.073 11:22:25 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@212 -- # ip link set nvmf_init_br2 master nvmf_br 00:11:30.073 11:22:25 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@213 -- # ip link set nvmf_tgt_br master nvmf_br 00:11:30.073 11:22:25 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@214 -- # ip link set nvmf_tgt_br2 master nvmf_br 00:11:30.073 11:22:25 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@217 -- # ipts -I INPUT 1 -i nvmf_init_if -p tcp --dport 4420 -j ACCEPT 00:11:30.073 11:22:25 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@788 -- # iptables -I INPUT 1 -i nvmf_init_if -p tcp --dport 4420 -j ACCEPT -m comment --comment 'SPDK_NVMF:-I INPUT 1 -i nvmf_init_if -p tcp --dport 4420 -j ACCEPT' 00:11:30.073 11:22:25 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@218 -- # ipts -I INPUT 1 -i nvmf_init_if2 -p tcp --dport 4420 -j ACCEPT 00:11:30.073 11:22:25 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@788 -- # iptables -I INPUT 1 -i nvmf_init_if2 -p tcp --dport 4420 -j ACCEPT -m comment --comment 'SPDK_NVMF:-I INPUT 1 -i nvmf_init_if2 -p tcp --dport 4420 -j ACCEPT' 00:11:30.073 11:22:25 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@219 -- # ipts -A FORWARD -i nvmf_br -o nvmf_br -j ACCEPT 00:11:30.073 11:22:25 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@788 -- # iptables -A FORWARD -i nvmf_br -o nvmf_br -j ACCEPT -m comment --comment 'SPDK_NVMF:-A FORWARD -i nvmf_br -o nvmf_br -j ACCEPT' 00:11:30.073 11:22:25 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@222 -- # ping -c 1 10.0.0.3 00:11:30.073 PING 10.0.0.3 (10.0.0.3) 56(84) bytes of data. 00:11:30.073 64 bytes from 10.0.0.3: icmp_seq=1 ttl=64 time=0.059 ms 00:11:30.073 00:11:30.073 --- 10.0.0.3 ping statistics --- 00:11:30.073 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:11:30.073 rtt min/avg/max/mdev = 0.059/0.059/0.059/0.000 ms 00:11:30.073 11:22:25 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@223 -- # ping -c 1 10.0.0.4 00:11:30.073 PING 10.0.0.4 (10.0.0.4) 56(84) bytes of data. 00:11:30.073 64 bytes from 10.0.0.4: icmp_seq=1 ttl=64 time=0.071 ms 00:11:30.073 00:11:30.073 --- 10.0.0.4 ping statistics --- 00:11:30.073 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:11:30.073 rtt min/avg/max/mdev = 0.071/0.071/0.071/0.000 ms 00:11:30.073 11:22:25 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@224 -- # ip netns exec nvmf_tgt_ns_spdk ping -c 1 10.0.0.1 00:11:30.073 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:11:30.073 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.035 ms 00:11:30.073 00:11:30.073 --- 10.0.0.1 ping statistics --- 00:11:30.073 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:11:30.073 rtt min/avg/max/mdev = 0.035/0.035/0.035/0.000 ms 00:11:30.073 11:22:25 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@225 -- # ip netns exec nvmf_tgt_ns_spdk ping -c 1 10.0.0.2 00:11:30.073 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:11:30.073 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.046 ms 00:11:30.073 00:11:30.073 --- 10.0.0.2 ping statistics --- 00:11:30.073 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:11:30.073 rtt min/avg/max/mdev = 0.046/0.046/0.046/0.000 ms 00:11:30.073 11:22:25 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@227 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:11:30.073 11:22:25 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@459 -- # return 0 00:11:30.073 11:22:25 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@476 -- # '[' '' == iso ']' 00:11:30.073 11:22:25 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@480 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:11:30.073 11:22:25 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@481 -- # [[ tcp == \r\d\m\a ]] 00:11:30.073 11:22:25 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@490 -- # [[ tcp == \t\c\p ]] 00:11:30.073 11:22:25 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@491 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:11:30.073 11:22:25 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@494 -- # '[' tcp == tcp ']' 00:11:30.073 11:22:25 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@500 -- # modprobe nvme-tcp 00:11:30.073 11:22:25 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- target/nvmf_lvs_grow.sh@99 -- # nvmfappstart -m 0x1 00:11:30.073 11:22:25 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@505 -- # timing_enter start_nvmf_tgt 00:11:30.073 11:22:25 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- common/autotest_common.sh@724 -- # xtrace_disable 00:11:30.073 11:22:25 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- common/autotest_common.sh@10 -- # set +x 00:11:30.073 11:22:25 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@507 -- # nvmfpid=66514 00:11:30.073 11:22:25 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@508 -- # waitforlisten 66514 00:11:30.073 11:22:25 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@506 -- # ip netns exec nvmf_tgt_ns_spdk /home/vagrant/spdk_repo/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x1 00:11:30.073 11:22:25 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- common/autotest_common.sh@831 -- # '[' -z 66514 ']' 00:11:30.073 11:22:25 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- common/autotest_common.sh@835 -- # local rpc_addr=/var/tmp/spdk.sock 00:11:30.073 11:22:25 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- common/autotest_common.sh@836 -- # local max_retries=100 00:11:30.073 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:11:30.073 11:22:25 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- common/autotest_common.sh@838 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:11:30.073 11:22:25 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- common/autotest_common.sh@840 -- # xtrace_disable 00:11:30.073 11:22:25 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- common/autotest_common.sh@10 -- # set +x 00:11:30.073 [2024-10-07 11:22:25.592111] Starting SPDK v25.01-pre git sha1 2a4f56c54 / DPDK 24.03.0 initialization... 00:11:30.073 [2024-10-07 11:22:25.592408] [ DPDK EAL parameters: nvmf -c 0x1 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --iova-mode=pa --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:11:30.332 [2024-10-07 11:22:25.735846] app.c: 917:spdk_app_start: *NOTICE*: Total cores available: 1 00:11:30.590 [2024-10-07 11:22:25.857075] app.c: 610:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:11:30.590 [2024-10-07 11:22:25.857140] app.c: 611:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:11:30.590 [2024-10-07 11:22:25.857156] app.c: 616:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:11:30.590 [2024-10-07 11:22:25.857167] app.c: 617:app_setup_trace: *NOTICE*: SPDK application currently running. 00:11:30.590 [2024-10-07 11:22:25.857177] app.c: 618:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:11:30.590 [2024-10-07 11:22:25.857618] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 0 00:11:31.157 11:22:26 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- common/autotest_common.sh@860 -- # (( i == 0 )) 00:11:31.157 11:22:26 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- common/autotest_common.sh@864 -- # return 0 00:11:31.157 11:22:26 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@509 -- # timing_exit start_nvmf_tgt 00:11:31.157 11:22:26 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- common/autotest_common.sh@730 -- # xtrace_disable 00:11:31.157 11:22:26 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- common/autotest_common.sh@10 -- # set +x 00:11:31.157 11:22:26 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@510 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:11:31.157 11:22:26 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- target/nvmf_lvs_grow.sh@100 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_create_transport -t tcp -o -u 8192 00:11:31.724 [2024-10-07 11:22:27.006478] tcp.c: 738:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:11:31.724 11:22:27 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- target/nvmf_lvs_grow.sh@102 -- # run_test lvs_grow_clean lvs_grow 00:11:31.724 11:22:27 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- common/autotest_common.sh@1101 -- # '[' 2 -le 1 ']' 00:11:31.724 11:22:27 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- common/autotest_common.sh@1107 -- # xtrace_disable 00:11:31.724 11:22:27 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- common/autotest_common.sh@10 -- # set +x 00:11:31.724 ************************************ 00:11:31.724 START TEST lvs_grow_clean 00:11:31.724 ************************************ 00:11:31.724 11:22:27 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_clean -- common/autotest_common.sh@1125 -- # lvs_grow 00:11:31.724 11:22:27 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_clean -- target/nvmf_lvs_grow.sh@15 -- # local aio_bdev lvs lvol 00:11:31.724 11:22:27 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_clean -- target/nvmf_lvs_grow.sh@16 -- # local data_clusters free_clusters 00:11:31.724 11:22:27 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_clean -- target/nvmf_lvs_grow.sh@17 -- # local bdevperf_pid run_test_pid 00:11:31.724 11:22:27 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_clean -- target/nvmf_lvs_grow.sh@18 -- # local aio_init_size_mb=200 00:11:31.724 11:22:27 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_clean -- target/nvmf_lvs_grow.sh@19 -- # local aio_final_size_mb=400 00:11:31.724 11:22:27 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_clean -- target/nvmf_lvs_grow.sh@20 -- # local lvol_bdev_size_mb=150 00:11:31.724 11:22:27 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_clean -- target/nvmf_lvs_grow.sh@23 -- # rm -f /home/vagrant/spdk_repo/spdk/test/nvmf/target/aio_bdev 00:11:31.724 11:22:27 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_clean -- target/nvmf_lvs_grow.sh@24 -- # truncate -s 200M /home/vagrant/spdk_repo/spdk/test/nvmf/target/aio_bdev 00:11:31.724 11:22:27 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_clean -- target/nvmf_lvs_grow.sh@25 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py bdev_aio_create /home/vagrant/spdk_repo/spdk/test/nvmf/target/aio_bdev aio_bdev 4096 00:11:31.983 11:22:27 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_clean -- target/nvmf_lvs_grow.sh@25 -- # aio_bdev=aio_bdev 00:11:31.983 11:22:27 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_clean -- target/nvmf_lvs_grow.sh@28 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py bdev_lvol_create_lvstore --cluster-sz 4194304 --md-pages-per-cluster-ratio 300 aio_bdev lvs 00:11:32.240 11:22:27 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_clean -- target/nvmf_lvs_grow.sh@28 -- # lvs=0386044e-22ef-44cc-873d-be9ba37a8c03 00:11:32.240 11:22:27 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_clean -- target/nvmf_lvs_grow.sh@29 -- # jq -r '.[0].total_data_clusters' 00:11:32.240 11:22:27 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_clean -- target/nvmf_lvs_grow.sh@29 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 0386044e-22ef-44cc-873d-be9ba37a8c03 00:11:32.498 11:22:27 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_clean -- target/nvmf_lvs_grow.sh@29 -- # data_clusters=49 00:11:32.498 11:22:27 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_clean -- target/nvmf_lvs_grow.sh@30 -- # (( data_clusters == 49 )) 00:11:32.498 11:22:27 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_clean -- target/nvmf_lvs_grow.sh@33 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py bdev_lvol_create -u 0386044e-22ef-44cc-873d-be9ba37a8c03 lvol 150 00:11:32.756 11:22:28 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_clean -- target/nvmf_lvs_grow.sh@33 -- # lvol=b7c3e972-ed9e-49b4-8290-cc5bca40de86 00:11:32.756 11:22:28 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_clean -- target/nvmf_lvs_grow.sh@36 -- # truncate -s 400M /home/vagrant/spdk_repo/spdk/test/nvmf/target/aio_bdev 00:11:32.756 11:22:28 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_clean -- target/nvmf_lvs_grow.sh@37 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py bdev_aio_rescan aio_bdev 00:11:33.013 [2024-10-07 11:22:28.437760] bdev_aio.c:1044:bdev_aio_rescan: *NOTICE*: AIO device is resized: bdev name /home/vagrant/spdk_repo/spdk/test/nvmf/target/aio_bdev, old block count 51200, new block count 102400 00:11:33.013 [2024-10-07 11:22:28.437844] vbdev_lvol.c: 165:vbdev_lvs_base_bdev_event_cb: *NOTICE*: Unsupported bdev event: type 1 00:11:33.013 true 00:11:33.013 11:22:28 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_clean -- target/nvmf_lvs_grow.sh@38 -- # jq -r '.[0].total_data_clusters' 00:11:33.013 11:22:28 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_clean -- target/nvmf_lvs_grow.sh@38 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 0386044e-22ef-44cc-873d-be9ba37a8c03 00:11:33.271 11:22:28 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_clean -- target/nvmf_lvs_grow.sh@38 -- # (( data_clusters == 49 )) 00:11:33.271 11:22:28 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_clean -- target/nvmf_lvs_grow.sh@41 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 -a -s SPDK0 00:11:33.837 11:22:29 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_clean -- target/nvmf_lvs_grow.sh@42 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 b7c3e972-ed9e-49b4-8290-cc5bca40de86 00:11:33.837 11:22:29 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_clean -- target/nvmf_lvs_grow.sh@43 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.3 -s 4420 00:11:34.095 [2024-10-07 11:22:29.606639] tcp.c:1081:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.3 port 4420 *** 00:11:34.353 11:22:29 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_clean -- target/nvmf_lvs_grow.sh@44 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.3 -s 4420 00:11:34.612 11:22:29 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_clean -- target/nvmf_lvs_grow.sh@47 -- # /home/vagrant/spdk_repo/spdk/build/examples/bdevperf -r /var/tmp/bdevperf.sock -m 0x2 -o 4096 -q 128 -w randwrite -t 10 -S 1 -z 00:11:34.612 11:22:29 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_clean -- target/nvmf_lvs_grow.sh@48 -- # bdevperf_pid=66686 00:11:34.612 11:22:29 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_clean -- target/nvmf_lvs_grow.sh@49 -- # trap 'killprocess $bdevperf_pid; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:11:34.612 11:22:29 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_clean -- target/nvmf_lvs_grow.sh@50 -- # waitforlisten 66686 /var/tmp/bdevperf.sock 00:11:34.612 11:22:29 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_clean -- common/autotest_common.sh@831 -- # '[' -z 66686 ']' 00:11:34.612 11:22:29 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_clean -- common/autotest_common.sh@835 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:11:34.612 11:22:29 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_clean -- common/autotest_common.sh@836 -- # local max_retries=100 00:11:34.612 11:22:29 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_clean -- common/autotest_common.sh@838 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:11:34.612 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:11:34.612 11:22:29 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_clean -- common/autotest_common.sh@840 -- # xtrace_disable 00:11:34.612 11:22:29 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_clean -- common/autotest_common.sh@10 -- # set +x 00:11:34.612 [2024-10-07 11:22:30.000124] Starting SPDK v25.01-pre git sha1 2a4f56c54 / DPDK 24.03.0 initialization... 00:11:34.612 [2024-10-07 11:22:30.000216] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x2 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --iova-mode=pa --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid66686 ] 00:11:34.871 [2024-10-07 11:22:30.138266] app.c: 917:spdk_app_start: *NOTICE*: Total cores available: 1 00:11:34.871 [2024-10-07 11:22:30.266456] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 1 00:11:35.806 11:22:31 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_clean -- common/autotest_common.sh@860 -- # (( i == 0 )) 00:11:35.806 11:22:31 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_clean -- common/autotest_common.sh@864 -- # return 0 00:11:35.806 11:22:31 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_clean -- target/nvmf_lvs_grow.sh@52 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b Nvme0 -t tcp -a 10.0.0.3 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode0 00:11:36.064 Nvme0n1 00:11:36.064 11:22:31 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_clean -- target/nvmf_lvs_grow.sh@53 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_get_bdevs -b Nvme0n1 -t 3000 00:11:36.323 [ 00:11:36.323 { 00:11:36.323 "aliases": [ 00:11:36.323 "b7c3e972-ed9e-49b4-8290-cc5bca40de86" 00:11:36.323 ], 00:11:36.323 "assigned_rate_limits": { 00:11:36.323 "r_mbytes_per_sec": 0, 00:11:36.323 "rw_ios_per_sec": 0, 00:11:36.323 "rw_mbytes_per_sec": 0, 00:11:36.323 "w_mbytes_per_sec": 0 00:11:36.323 }, 00:11:36.323 "block_size": 4096, 00:11:36.323 "claimed": false, 00:11:36.323 "driver_specific": { 00:11:36.323 "mp_policy": "active_passive", 00:11:36.323 "nvme": [ 00:11:36.323 { 00:11:36.323 "ctrlr_data": { 00:11:36.323 "ana_reporting": false, 00:11:36.323 "cntlid": 1, 00:11:36.323 "firmware_revision": "25.01", 00:11:36.323 "model_number": "SPDK bdev Controller", 00:11:36.323 "multi_ctrlr": true, 00:11:36.323 "oacs": { 00:11:36.323 "firmware": 0, 00:11:36.323 "format": 0, 00:11:36.323 "ns_manage": 0, 00:11:36.323 "security": 0 00:11:36.323 }, 00:11:36.323 "serial_number": "SPDK0", 00:11:36.323 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:11:36.323 "vendor_id": "0x8086" 00:11:36.323 }, 00:11:36.323 "ns_data": { 00:11:36.323 "can_share": true, 00:11:36.323 "id": 1 00:11:36.323 }, 00:11:36.323 "trid": { 00:11:36.323 "adrfam": "IPv4", 00:11:36.323 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:11:36.323 "traddr": "10.0.0.3", 00:11:36.323 "trsvcid": "4420", 00:11:36.323 "trtype": "TCP" 00:11:36.323 }, 00:11:36.323 "vs": { 00:11:36.323 "nvme_version": "1.3" 00:11:36.323 } 00:11:36.323 } 00:11:36.323 ] 00:11:36.323 }, 00:11:36.323 "memory_domains": [ 00:11:36.323 { 00:11:36.323 "dma_device_id": "system", 00:11:36.323 "dma_device_type": 1 00:11:36.323 } 00:11:36.323 ], 00:11:36.323 "name": "Nvme0n1", 00:11:36.323 "num_blocks": 38912, 00:11:36.323 "numa_id": -1, 00:11:36.323 "product_name": "NVMe disk", 00:11:36.323 "supported_io_types": { 00:11:36.323 "abort": true, 00:11:36.323 "compare": true, 00:11:36.323 "compare_and_write": true, 00:11:36.323 "copy": true, 00:11:36.323 "flush": true, 00:11:36.323 "get_zone_info": false, 00:11:36.323 "nvme_admin": true, 00:11:36.323 "nvme_io": true, 00:11:36.323 "nvme_io_md": false, 00:11:36.323 "nvme_iov_md": false, 00:11:36.323 "read": true, 00:11:36.323 "reset": true, 00:11:36.323 "seek_data": false, 00:11:36.323 "seek_hole": false, 00:11:36.323 "unmap": true, 00:11:36.323 "write": true, 00:11:36.323 "write_zeroes": true, 00:11:36.323 "zcopy": false, 00:11:36.323 "zone_append": false, 00:11:36.323 "zone_management": false 00:11:36.323 }, 00:11:36.323 "uuid": "b7c3e972-ed9e-49b4-8290-cc5bca40de86", 00:11:36.323 "zoned": false 00:11:36.323 } 00:11:36.323 ] 00:11:36.323 11:22:31 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_clean -- target/nvmf_lvs_grow.sh@56 -- # run_test_pid=66734 00:11:36.323 11:22:31 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_clean -- target/nvmf_lvs_grow.sh@55 -- # /home/vagrant/spdk_repo/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bdevperf.sock perform_tests 00:11:36.323 11:22:31 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_clean -- target/nvmf_lvs_grow.sh@57 -- # sleep 2 00:11:36.323 Running I/O for 10 seconds... 00:11:37.259 Latency(us) 00:11:37.259 [2024-10-07T11:22:32.782Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:11:37.259 Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:11:37.259 Nvme0n1 : 1.00 8180.00 31.95 0.00 0.00 0.00 0.00 0.00 00:11:37.259 [2024-10-07T11:22:32.782Z] =================================================================================================================== 00:11:37.259 [2024-10-07T11:22:32.782Z] Total : 8180.00 31.95 0.00 0.00 0.00 0.00 0.00 00:11:37.259 00:11:38.195 11:22:33 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_clean -- target/nvmf_lvs_grow.sh@60 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py bdev_lvol_grow_lvstore -u 0386044e-22ef-44cc-873d-be9ba37a8c03 00:11:38.453 Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:11:38.453 Nvme0n1 : 2.00 8276.00 32.33 0.00 0.00 0.00 0.00 0.00 00:11:38.453 [2024-10-07T11:22:33.977Z] =================================================================================================================== 00:11:38.454 [2024-10-07T11:22:33.977Z] Total : 8276.00 32.33 0.00 0.00 0.00 0.00 0.00 00:11:38.454 00:11:38.712 true 00:11:38.712 11:22:34 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_clean -- target/nvmf_lvs_grow.sh@61 -- # jq -r '.[0].total_data_clusters' 00:11:38.712 11:22:34 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_clean -- target/nvmf_lvs_grow.sh@61 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 0386044e-22ef-44cc-873d-be9ba37a8c03 00:11:38.971 11:22:34 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_clean -- target/nvmf_lvs_grow.sh@61 -- # data_clusters=99 00:11:38.971 11:22:34 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_clean -- target/nvmf_lvs_grow.sh@62 -- # (( data_clusters == 99 )) 00:11:38.971 11:22:34 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_clean -- target/nvmf_lvs_grow.sh@65 -- # wait 66734 00:11:39.553 Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:11:39.553 Nvme0n1 : 3.00 8098.00 31.63 0.00 0.00 0.00 0.00 0.00 00:11:39.553 [2024-10-07T11:22:35.076Z] =================================================================================================================== 00:11:39.553 [2024-10-07T11:22:35.076Z] Total : 8098.00 31.63 0.00 0.00 0.00 0.00 0.00 00:11:39.553 00:11:40.486 Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:11:40.486 Nvme0n1 : 4.00 8071.75 31.53 0.00 0.00 0.00 0.00 0.00 00:11:40.486 [2024-10-07T11:22:36.009Z] =================================================================================================================== 00:11:40.486 [2024-10-07T11:22:36.009Z] Total : 8071.75 31.53 0.00 0.00 0.00 0.00 0.00 00:11:40.486 00:11:41.419 Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:11:41.419 Nvme0n1 : 5.00 8053.40 31.46 0.00 0.00 0.00 0.00 0.00 00:11:41.419 [2024-10-07T11:22:36.942Z] =================================================================================================================== 00:11:41.419 [2024-10-07T11:22:36.942Z] Total : 8053.40 31.46 0.00 0.00 0.00 0.00 0.00 00:11:41.419 00:11:42.373 Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:11:42.373 Nvme0n1 : 6.00 7967.17 31.12 0.00 0.00 0.00 0.00 0.00 00:11:42.373 [2024-10-07T11:22:37.896Z] =================================================================================================================== 00:11:42.373 [2024-10-07T11:22:37.896Z] Total : 7967.17 31.12 0.00 0.00 0.00 0.00 0.00 00:11:42.373 00:11:43.306 Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:11:43.306 Nvme0n1 : 7.00 7820.71 30.55 0.00 0.00 0.00 0.00 0.00 00:11:43.306 [2024-10-07T11:22:38.829Z] =================================================================================================================== 00:11:43.306 [2024-10-07T11:22:38.829Z] Total : 7820.71 30.55 0.00 0.00 0.00 0.00 0.00 00:11:43.306 00:11:44.679 Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:11:44.679 Nvme0n1 : 8.00 7658.25 29.92 0.00 0.00 0.00 0.00 0.00 00:11:44.679 [2024-10-07T11:22:40.202Z] =================================================================================================================== 00:11:44.679 [2024-10-07T11:22:40.202Z] Total : 7658.25 29.92 0.00 0.00 0.00 0.00 0.00 00:11:44.679 00:11:45.245 Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:11:45.245 Nvme0n1 : 9.00 7633.11 29.82 0.00 0.00 0.00 0.00 0.00 00:11:45.245 [2024-10-07T11:22:40.768Z] =================================================================================================================== 00:11:45.245 [2024-10-07T11:22:40.768Z] Total : 7633.11 29.82 0.00 0.00 0.00 0.00 0.00 00:11:45.245 00:11:46.618 Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:11:46.618 Nvme0n1 : 10.00 7624.90 29.78 0.00 0.00 0.00 0.00 0.00 00:11:46.618 [2024-10-07T11:22:42.142Z] =================================================================================================================== 00:11:46.619 [2024-10-07T11:22:42.142Z] Total : 7624.90 29.78 0.00 0.00 0.00 0.00 0.00 00:11:46.619 00:11:46.619 00:11:46.619 Latency(us) 00:11:46.619 [2024-10-07T11:22:42.142Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:11:46.619 Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:11:46.619 Nvme0n1 : 10.01 7630.41 29.81 0.00 0.00 16769.73 5302.46 80073.08 00:11:46.619 [2024-10-07T11:22:42.142Z] =================================================================================================================== 00:11:46.619 [2024-10-07T11:22:42.142Z] Total : 7630.41 29.81 0.00 0.00 16769.73 5302.46 80073.08 00:11:46.619 { 00:11:46.619 "results": [ 00:11:46.619 { 00:11:46.619 "job": "Nvme0n1", 00:11:46.619 "core_mask": "0x2", 00:11:46.619 "workload": "randwrite", 00:11:46.619 "status": "finished", 00:11:46.619 "queue_depth": 128, 00:11:46.619 "io_size": 4096, 00:11:46.619 "runtime": 10.009549, 00:11:46.619 "iops": 7630.413717940738, 00:11:46.619 "mibps": 29.806303585706008, 00:11:46.619 "io_failed": 0, 00:11:46.619 "io_timeout": 0, 00:11:46.619 "avg_latency_us": 16769.73161620526, 00:11:46.619 "min_latency_us": 5302.458181818181, 00:11:46.619 "max_latency_us": 80073.07636363637 00:11:46.619 } 00:11:46.619 ], 00:11:46.619 "core_count": 1 00:11:46.619 } 00:11:46.619 11:22:41 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_clean -- target/nvmf_lvs_grow.sh@66 -- # killprocess 66686 00:11:46.619 11:22:41 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_clean -- common/autotest_common.sh@950 -- # '[' -z 66686 ']' 00:11:46.619 11:22:41 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_clean -- common/autotest_common.sh@954 -- # kill -0 66686 00:11:46.619 11:22:41 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_clean -- common/autotest_common.sh@955 -- # uname 00:11:46.619 11:22:41 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_clean -- common/autotest_common.sh@955 -- # '[' Linux = Linux ']' 00:11:46.619 11:22:41 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_clean -- common/autotest_common.sh@956 -- # ps --no-headers -o comm= 66686 00:11:46.619 11:22:41 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_clean -- common/autotest_common.sh@956 -- # process_name=reactor_1 00:11:46.619 11:22:41 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_clean -- common/autotest_common.sh@960 -- # '[' reactor_1 = sudo ']' 00:11:46.619 killing process with pid 66686 00:11:46.619 11:22:41 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_clean -- common/autotest_common.sh@968 -- # echo 'killing process with pid 66686' 00:11:46.619 11:22:41 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_clean -- common/autotest_common.sh@969 -- # kill 66686 00:11:46.619 Received shutdown signal, test time was about 10.000000 seconds 00:11:46.619 00:11:46.619 Latency(us) 00:11:46.619 [2024-10-07T11:22:42.142Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:11:46.619 [2024-10-07T11:22:42.142Z] =================================================================================================================== 00:11:46.619 [2024-10-07T11:22:42.142Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:11:46.619 11:22:41 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_clean -- common/autotest_common.sh@974 -- # wait 66686 00:11:46.619 11:22:42 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_clean -- target/nvmf_lvs_grow.sh@68 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_remove_listener discovery -t tcp -a 10.0.0.3 -s 4420 00:11:46.878 11:22:42 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_clean -- target/nvmf_lvs_grow.sh@69 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode0 00:11:47.447 11:22:42 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_clean -- target/nvmf_lvs_grow.sh@70 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 0386044e-22ef-44cc-873d-be9ba37a8c03 00:11:47.447 11:22:42 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_clean -- target/nvmf_lvs_grow.sh@70 -- # jq -r '.[0].free_clusters' 00:11:47.447 11:22:42 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_clean -- target/nvmf_lvs_grow.sh@70 -- # free_clusters=61 00:11:47.447 11:22:42 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_clean -- target/nvmf_lvs_grow.sh@72 -- # [[ '' == \d\i\r\t\y ]] 00:11:47.447 11:22:42 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_clean -- target/nvmf_lvs_grow.sh@84 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py bdev_aio_delete aio_bdev 00:11:47.704 [2024-10-07 11:22:43.183407] vbdev_lvol.c: 150:vbdev_lvs_hotremove_cb: *NOTICE*: bdev aio_bdev being removed: closing lvstore lvs 00:11:47.962 11:22:43 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_clean -- target/nvmf_lvs_grow.sh@85 -- # NOT /home/vagrant/spdk_repo/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 0386044e-22ef-44cc-873d-be9ba37a8c03 00:11:47.963 11:22:43 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_clean -- common/autotest_common.sh@650 -- # local es=0 00:11:47.963 11:22:43 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_clean -- common/autotest_common.sh@652 -- # valid_exec_arg /home/vagrant/spdk_repo/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 0386044e-22ef-44cc-873d-be9ba37a8c03 00:11:47.963 11:22:43 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_clean -- common/autotest_common.sh@638 -- # local arg=/home/vagrant/spdk_repo/spdk/scripts/rpc.py 00:11:47.963 11:22:43 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_clean -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:11:47.963 11:22:43 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_clean -- common/autotest_common.sh@642 -- # type -t /home/vagrant/spdk_repo/spdk/scripts/rpc.py 00:11:47.963 11:22:43 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_clean -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:11:47.963 11:22:43 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_clean -- common/autotest_common.sh@644 -- # type -P /home/vagrant/spdk_repo/spdk/scripts/rpc.py 00:11:47.963 11:22:43 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_clean -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:11:47.963 11:22:43 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_clean -- common/autotest_common.sh@644 -- # arg=/home/vagrant/spdk_repo/spdk/scripts/rpc.py 00:11:47.963 11:22:43 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_clean -- common/autotest_common.sh@644 -- # [[ -x /home/vagrant/spdk_repo/spdk/scripts/rpc.py ]] 00:11:47.963 11:22:43 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_clean -- common/autotest_common.sh@653 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 0386044e-22ef-44cc-873d-be9ba37a8c03 00:11:48.221 2024/10/07 11:22:43 error on JSON-RPC call, method: bdev_lvol_get_lvstores, params: map[uuid:0386044e-22ef-44cc-873d-be9ba37a8c03], err: error received for bdev_lvol_get_lvstores method, err: Code=-19 Msg=No such device 00:11:48.221 request: 00:11:48.221 { 00:11:48.221 "method": "bdev_lvol_get_lvstores", 00:11:48.221 "params": { 00:11:48.221 "uuid": "0386044e-22ef-44cc-873d-be9ba37a8c03" 00:11:48.221 } 00:11:48.221 } 00:11:48.221 Got JSON-RPC error response 00:11:48.221 GoRPCClient: error on JSON-RPC call 00:11:48.221 11:22:43 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_clean -- common/autotest_common.sh@653 -- # es=1 00:11:48.221 11:22:43 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_clean -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:11:48.221 11:22:43 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_clean -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:11:48.221 11:22:43 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_clean -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:11:48.221 11:22:43 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_clean -- target/nvmf_lvs_grow.sh@86 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py bdev_aio_create /home/vagrant/spdk_repo/spdk/test/nvmf/target/aio_bdev aio_bdev 4096 00:11:48.479 aio_bdev 00:11:48.479 11:22:43 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_clean -- target/nvmf_lvs_grow.sh@87 -- # waitforbdev b7c3e972-ed9e-49b4-8290-cc5bca40de86 00:11:48.479 11:22:43 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_clean -- common/autotest_common.sh@899 -- # local bdev_name=b7c3e972-ed9e-49b4-8290-cc5bca40de86 00:11:48.479 11:22:43 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_clean -- common/autotest_common.sh@900 -- # local bdev_timeout= 00:11:48.479 11:22:43 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_clean -- common/autotest_common.sh@901 -- # local i 00:11:48.479 11:22:43 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_clean -- common/autotest_common.sh@902 -- # [[ -z '' ]] 00:11:48.479 11:22:43 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_clean -- common/autotest_common.sh@902 -- # bdev_timeout=2000 00:11:48.479 11:22:43 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_clean -- common/autotest_common.sh@904 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py bdev_wait_for_examine 00:11:48.738 11:22:44 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_clean -- common/autotest_common.sh@906 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py bdev_get_bdevs -b b7c3e972-ed9e-49b4-8290-cc5bca40de86 -t 2000 00:11:48.997 [ 00:11:48.997 { 00:11:48.997 "aliases": [ 00:11:48.997 "lvs/lvol" 00:11:48.997 ], 00:11:48.997 "assigned_rate_limits": { 00:11:48.997 "r_mbytes_per_sec": 0, 00:11:48.997 "rw_ios_per_sec": 0, 00:11:48.997 "rw_mbytes_per_sec": 0, 00:11:48.997 "w_mbytes_per_sec": 0 00:11:48.997 }, 00:11:48.997 "block_size": 4096, 00:11:48.997 "claimed": false, 00:11:48.997 "driver_specific": { 00:11:48.997 "lvol": { 00:11:48.997 "base_bdev": "aio_bdev", 00:11:48.997 "clone": false, 00:11:48.997 "esnap_clone": false, 00:11:48.997 "lvol_store_uuid": "0386044e-22ef-44cc-873d-be9ba37a8c03", 00:11:48.997 "num_allocated_clusters": 38, 00:11:48.997 "snapshot": false, 00:11:48.997 "thin_provision": false 00:11:48.997 } 00:11:48.997 }, 00:11:48.997 "name": "b7c3e972-ed9e-49b4-8290-cc5bca40de86", 00:11:48.997 "num_blocks": 38912, 00:11:48.997 "product_name": "Logical Volume", 00:11:48.997 "supported_io_types": { 00:11:48.997 "abort": false, 00:11:48.997 "compare": false, 00:11:48.997 "compare_and_write": false, 00:11:48.997 "copy": false, 00:11:48.997 "flush": false, 00:11:48.997 "get_zone_info": false, 00:11:48.997 "nvme_admin": false, 00:11:48.997 "nvme_io": false, 00:11:48.997 "nvme_io_md": false, 00:11:48.997 "nvme_iov_md": false, 00:11:48.997 "read": true, 00:11:48.997 "reset": true, 00:11:48.997 "seek_data": true, 00:11:48.997 "seek_hole": true, 00:11:48.997 "unmap": true, 00:11:48.997 "write": true, 00:11:48.997 "write_zeroes": true, 00:11:48.997 "zcopy": false, 00:11:48.997 "zone_append": false, 00:11:48.997 "zone_management": false 00:11:48.997 }, 00:11:48.997 "uuid": "b7c3e972-ed9e-49b4-8290-cc5bca40de86", 00:11:48.997 "zoned": false 00:11:48.997 } 00:11:48.997 ] 00:11:48.997 11:22:44 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_clean -- common/autotest_common.sh@907 -- # return 0 00:11:48.997 11:22:44 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_clean -- target/nvmf_lvs_grow.sh@88 -- # jq -r '.[0].free_clusters' 00:11:48.997 11:22:44 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_clean -- target/nvmf_lvs_grow.sh@88 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 0386044e-22ef-44cc-873d-be9ba37a8c03 00:11:49.255 11:22:44 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_clean -- target/nvmf_lvs_grow.sh@88 -- # (( free_clusters == 61 )) 00:11:49.255 11:22:44 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_clean -- target/nvmf_lvs_grow.sh@89 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 0386044e-22ef-44cc-873d-be9ba37a8c03 00:11:49.255 11:22:44 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_clean -- target/nvmf_lvs_grow.sh@89 -- # jq -r '.[0].total_data_clusters' 00:11:49.821 11:22:45 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_clean -- target/nvmf_lvs_grow.sh@89 -- # (( data_clusters == 99 )) 00:11:49.821 11:22:45 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_clean -- target/nvmf_lvs_grow.sh@92 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py bdev_lvol_delete b7c3e972-ed9e-49b4-8290-cc5bca40de86 00:11:50.104 11:22:45 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_clean -- target/nvmf_lvs_grow.sh@93 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py bdev_lvol_delete_lvstore -u 0386044e-22ef-44cc-873d-be9ba37a8c03 00:11:50.377 11:22:45 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_clean -- target/nvmf_lvs_grow.sh@94 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py bdev_aio_delete aio_bdev 00:11:50.634 11:22:45 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_clean -- target/nvmf_lvs_grow.sh@95 -- # rm -f /home/vagrant/spdk_repo/spdk/test/nvmf/target/aio_bdev 00:11:50.892 ************************************ 00:11:50.892 END TEST lvs_grow_clean 00:11:50.892 ************************************ 00:11:50.892 00:11:50.892 real 0m19.255s 00:11:50.892 user 0m18.682s 00:11:50.892 sys 0m2.278s 00:11:50.892 11:22:46 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_clean -- common/autotest_common.sh@1126 -- # xtrace_disable 00:11:50.892 11:22:46 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_clean -- common/autotest_common.sh@10 -- # set +x 00:11:50.892 11:22:46 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- target/nvmf_lvs_grow.sh@103 -- # run_test lvs_grow_dirty lvs_grow dirty 00:11:50.892 11:22:46 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- common/autotest_common.sh@1101 -- # '[' 3 -le 1 ']' 00:11:50.892 11:22:46 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- common/autotest_common.sh@1107 -- # xtrace_disable 00:11:50.892 11:22:46 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- common/autotest_common.sh@10 -- # set +x 00:11:50.892 ************************************ 00:11:50.892 START TEST lvs_grow_dirty 00:11:50.892 ************************************ 00:11:50.892 11:22:46 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_dirty -- common/autotest_common.sh@1125 -- # lvs_grow dirty 00:11:50.892 11:22:46 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_dirty -- target/nvmf_lvs_grow.sh@15 -- # local aio_bdev lvs lvol 00:11:50.892 11:22:46 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_dirty -- target/nvmf_lvs_grow.sh@16 -- # local data_clusters free_clusters 00:11:50.892 11:22:46 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_dirty -- target/nvmf_lvs_grow.sh@17 -- # local bdevperf_pid run_test_pid 00:11:50.892 11:22:46 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_dirty -- target/nvmf_lvs_grow.sh@18 -- # local aio_init_size_mb=200 00:11:50.892 11:22:46 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_dirty -- target/nvmf_lvs_grow.sh@19 -- # local aio_final_size_mb=400 00:11:50.892 11:22:46 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_dirty -- target/nvmf_lvs_grow.sh@20 -- # local lvol_bdev_size_mb=150 00:11:50.892 11:22:46 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_dirty -- target/nvmf_lvs_grow.sh@23 -- # rm -f /home/vagrant/spdk_repo/spdk/test/nvmf/target/aio_bdev 00:11:50.892 11:22:46 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_dirty -- target/nvmf_lvs_grow.sh@24 -- # truncate -s 200M /home/vagrant/spdk_repo/spdk/test/nvmf/target/aio_bdev 00:11:50.892 11:22:46 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_dirty -- target/nvmf_lvs_grow.sh@25 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py bdev_aio_create /home/vagrant/spdk_repo/spdk/test/nvmf/target/aio_bdev aio_bdev 4096 00:11:51.457 11:22:46 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_dirty -- target/nvmf_lvs_grow.sh@25 -- # aio_bdev=aio_bdev 00:11:51.457 11:22:46 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_dirty -- target/nvmf_lvs_grow.sh@28 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py bdev_lvol_create_lvstore --cluster-sz 4194304 --md-pages-per-cluster-ratio 300 aio_bdev lvs 00:11:51.714 11:22:46 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_dirty -- target/nvmf_lvs_grow.sh@28 -- # lvs=768cab8d-22c9-4e1b-9c66-e9b9c03371f0 00:11:51.714 11:22:46 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_dirty -- target/nvmf_lvs_grow.sh@29 -- # jq -r '.[0].total_data_clusters' 00:11:51.714 11:22:46 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_dirty -- target/nvmf_lvs_grow.sh@29 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 768cab8d-22c9-4e1b-9c66-e9b9c03371f0 00:11:51.971 11:22:47 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_dirty -- target/nvmf_lvs_grow.sh@29 -- # data_clusters=49 00:11:51.971 11:22:47 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_dirty -- target/nvmf_lvs_grow.sh@30 -- # (( data_clusters == 49 )) 00:11:51.971 11:22:47 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_dirty -- target/nvmf_lvs_grow.sh@33 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py bdev_lvol_create -u 768cab8d-22c9-4e1b-9c66-e9b9c03371f0 lvol 150 00:11:52.228 11:22:47 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_dirty -- target/nvmf_lvs_grow.sh@33 -- # lvol=c77a866c-c3f3-40e5-825a-bde386a08119 00:11:52.228 11:22:47 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_dirty -- target/nvmf_lvs_grow.sh@36 -- # truncate -s 400M /home/vagrant/spdk_repo/spdk/test/nvmf/target/aio_bdev 00:11:52.228 11:22:47 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_dirty -- target/nvmf_lvs_grow.sh@37 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py bdev_aio_rescan aio_bdev 00:11:52.485 [2024-10-07 11:22:47.881623] bdev_aio.c:1044:bdev_aio_rescan: *NOTICE*: AIO device is resized: bdev name /home/vagrant/spdk_repo/spdk/test/nvmf/target/aio_bdev, old block count 51200, new block count 102400 00:11:52.485 [2024-10-07 11:22:47.881720] vbdev_lvol.c: 165:vbdev_lvs_base_bdev_event_cb: *NOTICE*: Unsupported bdev event: type 1 00:11:52.485 true 00:11:52.485 11:22:47 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_dirty -- target/nvmf_lvs_grow.sh@38 -- # jq -r '.[0].total_data_clusters' 00:11:52.485 11:22:47 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_dirty -- target/nvmf_lvs_grow.sh@38 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 768cab8d-22c9-4e1b-9c66-e9b9c03371f0 00:11:52.743 11:22:48 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_dirty -- target/nvmf_lvs_grow.sh@38 -- # (( data_clusters == 49 )) 00:11:52.743 11:22:48 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_dirty -- target/nvmf_lvs_grow.sh@41 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 -a -s SPDK0 00:11:53.308 11:22:48 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_dirty -- target/nvmf_lvs_grow.sh@42 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 c77a866c-c3f3-40e5-825a-bde386a08119 00:11:53.565 11:22:48 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_dirty -- target/nvmf_lvs_grow.sh@43 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.3 -s 4420 00:11:53.823 [2024-10-07 11:22:49.154330] tcp.c:1081:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.3 port 4420 *** 00:11:53.823 11:22:49 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_dirty -- target/nvmf_lvs_grow.sh@44 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.3 -s 4420 00:11:54.082 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:11:54.082 11:22:49 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_dirty -- target/nvmf_lvs_grow.sh@48 -- # bdevperf_pid=67147 00:11:54.082 11:22:49 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_dirty -- target/nvmf_lvs_grow.sh@47 -- # /home/vagrant/spdk_repo/spdk/build/examples/bdevperf -r /var/tmp/bdevperf.sock -m 0x2 -o 4096 -q 128 -w randwrite -t 10 -S 1 -z 00:11:54.082 11:22:49 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_dirty -- target/nvmf_lvs_grow.sh@49 -- # trap 'killprocess $bdevperf_pid; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:11:54.082 11:22:49 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_dirty -- target/nvmf_lvs_grow.sh@50 -- # waitforlisten 67147 /var/tmp/bdevperf.sock 00:11:54.082 11:22:49 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_dirty -- common/autotest_common.sh@831 -- # '[' -z 67147 ']' 00:11:54.082 11:22:49 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_dirty -- common/autotest_common.sh@835 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:11:54.082 11:22:49 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_dirty -- common/autotest_common.sh@836 -- # local max_retries=100 00:11:54.082 11:22:49 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_dirty -- common/autotest_common.sh@838 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:11:54.082 11:22:49 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_dirty -- common/autotest_common.sh@840 -- # xtrace_disable 00:11:54.082 11:22:49 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_dirty -- common/autotest_common.sh@10 -- # set +x 00:11:54.082 [2024-10-07 11:22:49.539062] Starting SPDK v25.01-pre git sha1 2a4f56c54 / DPDK 24.03.0 initialization... 00:11:54.082 [2024-10-07 11:22:49.539167] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x2 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --iova-mode=pa --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid67147 ] 00:11:54.340 [2024-10-07 11:22:49.682214] app.c: 917:spdk_app_start: *NOTICE*: Total cores available: 1 00:11:54.340 [2024-10-07 11:22:49.810402] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 1 00:11:55.295 11:22:50 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_dirty -- common/autotest_common.sh@860 -- # (( i == 0 )) 00:11:55.295 11:22:50 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_dirty -- common/autotest_common.sh@864 -- # return 0 00:11:55.295 11:22:50 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_dirty -- target/nvmf_lvs_grow.sh@52 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b Nvme0 -t tcp -a 10.0.0.3 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode0 00:11:55.552 Nvme0n1 00:11:55.552 11:22:50 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_dirty -- target/nvmf_lvs_grow.sh@53 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_get_bdevs -b Nvme0n1 -t 3000 00:11:55.811 [ 00:11:55.811 { 00:11:55.811 "aliases": [ 00:11:55.811 "c77a866c-c3f3-40e5-825a-bde386a08119" 00:11:55.811 ], 00:11:55.811 "assigned_rate_limits": { 00:11:55.811 "r_mbytes_per_sec": 0, 00:11:55.811 "rw_ios_per_sec": 0, 00:11:55.811 "rw_mbytes_per_sec": 0, 00:11:55.811 "w_mbytes_per_sec": 0 00:11:55.811 }, 00:11:55.811 "block_size": 4096, 00:11:55.811 "claimed": false, 00:11:55.811 "driver_specific": { 00:11:55.811 "mp_policy": "active_passive", 00:11:55.811 "nvme": [ 00:11:55.811 { 00:11:55.811 "ctrlr_data": { 00:11:55.811 "ana_reporting": false, 00:11:55.811 "cntlid": 1, 00:11:55.811 "firmware_revision": "25.01", 00:11:55.811 "model_number": "SPDK bdev Controller", 00:11:55.811 "multi_ctrlr": true, 00:11:55.811 "oacs": { 00:11:55.811 "firmware": 0, 00:11:55.811 "format": 0, 00:11:55.811 "ns_manage": 0, 00:11:55.811 "security": 0 00:11:55.811 }, 00:11:55.811 "serial_number": "SPDK0", 00:11:55.811 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:11:55.811 "vendor_id": "0x8086" 00:11:55.811 }, 00:11:55.811 "ns_data": { 00:11:55.811 "can_share": true, 00:11:55.811 "id": 1 00:11:55.811 }, 00:11:55.811 "trid": { 00:11:55.811 "adrfam": "IPv4", 00:11:55.811 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:11:55.811 "traddr": "10.0.0.3", 00:11:55.811 "trsvcid": "4420", 00:11:55.811 "trtype": "TCP" 00:11:55.811 }, 00:11:55.811 "vs": { 00:11:55.811 "nvme_version": "1.3" 00:11:55.811 } 00:11:55.811 } 00:11:55.811 ] 00:11:55.811 }, 00:11:55.811 "memory_domains": [ 00:11:55.811 { 00:11:55.811 "dma_device_id": "system", 00:11:55.811 "dma_device_type": 1 00:11:55.811 } 00:11:55.811 ], 00:11:55.811 "name": "Nvme0n1", 00:11:55.811 "num_blocks": 38912, 00:11:55.811 "numa_id": -1, 00:11:55.811 "product_name": "NVMe disk", 00:11:55.811 "supported_io_types": { 00:11:55.811 "abort": true, 00:11:55.811 "compare": true, 00:11:55.811 "compare_and_write": true, 00:11:55.811 "copy": true, 00:11:55.811 "flush": true, 00:11:55.811 "get_zone_info": false, 00:11:55.811 "nvme_admin": true, 00:11:55.811 "nvme_io": true, 00:11:55.811 "nvme_io_md": false, 00:11:55.811 "nvme_iov_md": false, 00:11:55.811 "read": true, 00:11:55.811 "reset": true, 00:11:55.811 "seek_data": false, 00:11:55.811 "seek_hole": false, 00:11:55.811 "unmap": true, 00:11:55.811 "write": true, 00:11:55.811 "write_zeroes": true, 00:11:55.811 "zcopy": false, 00:11:55.811 "zone_append": false, 00:11:55.811 "zone_management": false 00:11:55.811 }, 00:11:55.811 "uuid": "c77a866c-c3f3-40e5-825a-bde386a08119", 00:11:55.811 "zoned": false 00:11:55.811 } 00:11:55.811 ] 00:11:55.811 11:22:51 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_dirty -- target/nvmf_lvs_grow.sh@56 -- # run_test_pid=67200 00:11:55.811 11:22:51 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_dirty -- target/nvmf_lvs_grow.sh@55 -- # /home/vagrant/spdk_repo/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bdevperf.sock perform_tests 00:11:55.811 11:22:51 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_dirty -- target/nvmf_lvs_grow.sh@57 -- # sleep 2 00:11:55.811 Running I/O for 10 seconds... 00:11:57.185 Latency(us) 00:11:57.185 [2024-10-07T11:22:52.708Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:11:57.185 Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:11:57.185 Nvme0n1 : 1.00 8350.00 32.62 0.00 0.00 0.00 0.00 0.00 00:11:57.185 [2024-10-07T11:22:52.708Z] =================================================================================================================== 00:11:57.185 [2024-10-07T11:22:52.708Z] Total : 8350.00 32.62 0.00 0.00 0.00 0.00 0.00 00:11:57.185 00:11:57.750 11:22:53 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_dirty -- target/nvmf_lvs_grow.sh@60 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py bdev_lvol_grow_lvstore -u 768cab8d-22c9-4e1b-9c66-e9b9c03371f0 00:11:58.008 Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:11:58.008 Nvme0n1 : 2.00 8323.00 32.51 0.00 0.00 0.00 0.00 0.00 00:11:58.008 [2024-10-07T11:22:53.531Z] =================================================================================================================== 00:11:58.008 [2024-10-07T11:22:53.531Z] Total : 8323.00 32.51 0.00 0.00 0.00 0.00 0.00 00:11:58.008 00:11:58.008 true 00:11:58.266 11:22:53 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_dirty -- target/nvmf_lvs_grow.sh@61 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 768cab8d-22c9-4e1b-9c66-e9b9c03371f0 00:11:58.266 11:22:53 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_dirty -- target/nvmf_lvs_grow.sh@61 -- # jq -r '.[0].total_data_clusters' 00:11:58.524 11:22:53 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_dirty -- target/nvmf_lvs_grow.sh@61 -- # data_clusters=99 00:11:58.524 11:22:53 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_dirty -- target/nvmf_lvs_grow.sh@62 -- # (( data_clusters == 99 )) 00:11:58.524 11:22:53 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_dirty -- target/nvmf_lvs_grow.sh@65 -- # wait 67200 00:11:58.782 Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:11:58.782 Nvme0n1 : 3.00 8274.33 32.32 0.00 0.00 0.00 0.00 0.00 00:11:58.782 [2024-10-07T11:22:54.305Z] =================================================================================================================== 00:11:58.782 [2024-10-07T11:22:54.305Z] Total : 8274.33 32.32 0.00 0.00 0.00 0.00 0.00 00:11:58.782 00:12:00.153 Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:12:00.153 Nvme0n1 : 4.00 7939.25 31.01 0.00 0.00 0.00 0.00 0.00 00:12:00.153 [2024-10-07T11:22:55.677Z] =================================================================================================================== 00:12:00.154 [2024-10-07T11:22:55.677Z] Total : 7939.25 31.01 0.00 0.00 0.00 0.00 0.00 00:12:00.154 00:12:01.085 Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:12:01.085 Nvme0n1 : 5.00 7926.00 30.96 0.00 0.00 0.00 0.00 0.00 00:12:01.085 [2024-10-07T11:22:56.608Z] =================================================================================================================== 00:12:01.085 [2024-10-07T11:22:56.608Z] Total : 7926.00 30.96 0.00 0.00 0.00 0.00 0.00 00:12:01.085 00:12:02.017 Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:12:02.017 Nvme0n1 : 6.00 7876.33 30.77 0.00 0.00 0.00 0.00 0.00 00:12:02.017 [2024-10-07T11:22:57.540Z] =================================================================================================================== 00:12:02.017 [2024-10-07T11:22:57.540Z] Total : 7876.33 30.77 0.00 0.00 0.00 0.00 0.00 00:12:02.017 00:12:02.968 Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:12:02.968 Nvme0n1 : 7.00 7810.57 30.51 0.00 0.00 0.00 0.00 0.00 00:12:02.968 [2024-10-07T11:22:58.491Z] =================================================================================================================== 00:12:02.968 [2024-10-07T11:22:58.491Z] Total : 7810.57 30.51 0.00 0.00 0.00 0.00 0.00 00:12:02.968 00:12:03.903 Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:12:03.903 Nvme0n1 : 8.00 7780.00 30.39 0.00 0.00 0.00 0.00 0.00 00:12:03.903 [2024-10-07T11:22:59.426Z] =================================================================================================================== 00:12:03.903 [2024-10-07T11:22:59.426Z] Total : 7780.00 30.39 0.00 0.00 0.00 0.00 0.00 00:12:03.903 00:12:04.837 Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:12:04.837 Nvme0n1 : 9.00 7769.78 30.35 0.00 0.00 0.00 0.00 0.00 00:12:04.837 [2024-10-07T11:23:00.360Z] =================================================================================================================== 00:12:04.837 [2024-10-07T11:23:00.360Z] Total : 7769.78 30.35 0.00 0.00 0.00 0.00 0.00 00:12:04.837 00:12:06.209 Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:12:06.209 Nvme0n1 : 10.00 7640.80 29.85 0.00 0.00 0.00 0.00 0.00 00:12:06.209 [2024-10-07T11:23:01.732Z] =================================================================================================================== 00:12:06.209 [2024-10-07T11:23:01.732Z] Total : 7640.80 29.85 0.00 0.00 0.00 0.00 0.00 00:12:06.209 00:12:06.209 00:12:06.209 Latency(us) 00:12:06.209 [2024-10-07T11:23:01.732Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:12:06.209 Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:12:06.209 Nvme0n1 : 10.01 7645.59 29.87 0.00 0.00 16736.37 7298.33 170631.91 00:12:06.209 [2024-10-07T11:23:01.732Z] =================================================================================================================== 00:12:06.209 [2024-10-07T11:23:01.732Z] Total : 7645.59 29.87 0.00 0.00 16736.37 7298.33 170631.91 00:12:06.209 { 00:12:06.209 "results": [ 00:12:06.209 { 00:12:06.209 "job": "Nvme0n1", 00:12:06.209 "core_mask": "0x2", 00:12:06.209 "workload": "randwrite", 00:12:06.209 "status": "finished", 00:12:06.209 "queue_depth": 128, 00:12:06.209 "io_size": 4096, 00:12:06.209 "runtime": 10.010481, 00:12:06.209 "iops": 7645.586660621003, 00:12:06.209 "mibps": 29.865572893050793, 00:12:06.209 "io_failed": 0, 00:12:06.209 "io_timeout": 0, 00:12:06.209 "avg_latency_us": 16736.368795005557, 00:12:06.209 "min_latency_us": 7298.327272727272, 00:12:06.209 "max_latency_us": 170631.91272727272 00:12:06.209 } 00:12:06.209 ], 00:12:06.209 "core_count": 1 00:12:06.209 } 00:12:06.209 11:23:01 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_dirty -- target/nvmf_lvs_grow.sh@66 -- # killprocess 67147 00:12:06.209 11:23:01 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_dirty -- common/autotest_common.sh@950 -- # '[' -z 67147 ']' 00:12:06.209 11:23:01 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_dirty -- common/autotest_common.sh@954 -- # kill -0 67147 00:12:06.209 11:23:01 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_dirty -- common/autotest_common.sh@955 -- # uname 00:12:06.209 11:23:01 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_dirty -- common/autotest_common.sh@955 -- # '[' Linux = Linux ']' 00:12:06.209 11:23:01 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_dirty -- common/autotest_common.sh@956 -- # ps --no-headers -o comm= 67147 00:12:06.209 killing process with pid 67147 00:12:06.209 Received shutdown signal, test time was about 10.000000 seconds 00:12:06.209 00:12:06.209 Latency(us) 00:12:06.209 [2024-10-07T11:23:01.732Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:12:06.209 [2024-10-07T11:23:01.732Z] =================================================================================================================== 00:12:06.209 [2024-10-07T11:23:01.732Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:12:06.209 11:23:01 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_dirty -- common/autotest_common.sh@956 -- # process_name=reactor_1 00:12:06.209 11:23:01 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_dirty -- common/autotest_common.sh@960 -- # '[' reactor_1 = sudo ']' 00:12:06.209 11:23:01 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_dirty -- common/autotest_common.sh@968 -- # echo 'killing process with pid 67147' 00:12:06.209 11:23:01 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_dirty -- common/autotest_common.sh@969 -- # kill 67147 00:12:06.209 11:23:01 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_dirty -- common/autotest_common.sh@974 -- # wait 67147 00:12:06.209 11:23:01 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_dirty -- target/nvmf_lvs_grow.sh@68 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_remove_listener discovery -t tcp -a 10.0.0.3 -s 4420 00:12:06.494 11:23:01 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_dirty -- target/nvmf_lvs_grow.sh@69 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode0 00:12:06.753 11:23:02 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_dirty -- target/nvmf_lvs_grow.sh@70 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 768cab8d-22c9-4e1b-9c66-e9b9c03371f0 00:12:06.753 11:23:02 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_dirty -- target/nvmf_lvs_grow.sh@70 -- # jq -r '.[0].free_clusters' 00:12:07.319 11:23:02 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_dirty -- target/nvmf_lvs_grow.sh@70 -- # free_clusters=61 00:12:07.319 11:23:02 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_dirty -- target/nvmf_lvs_grow.sh@72 -- # [[ dirty == \d\i\r\t\y ]] 00:12:07.319 11:23:02 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_dirty -- target/nvmf_lvs_grow.sh@74 -- # kill -9 66514 00:12:07.319 11:23:02 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_dirty -- target/nvmf_lvs_grow.sh@75 -- # wait 66514 00:12:07.319 /home/vagrant/spdk_repo/spdk/test/nvmf/target/nvmf_lvs_grow.sh: line 75: 66514 Killed "${NVMF_APP[@]}" "$@" 00:12:07.319 11:23:02 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_dirty -- target/nvmf_lvs_grow.sh@75 -- # true 00:12:07.319 11:23:02 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_dirty -- target/nvmf_lvs_grow.sh@76 -- # nvmfappstart -m 0x1 00:12:07.319 11:23:02 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_dirty -- nvmf/common.sh@505 -- # timing_enter start_nvmf_tgt 00:12:07.319 11:23:02 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_dirty -- common/autotest_common.sh@724 -- # xtrace_disable 00:12:07.319 11:23:02 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_dirty -- common/autotest_common.sh@10 -- # set +x 00:12:07.319 11:23:02 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_dirty -- nvmf/common.sh@507 -- # nvmfpid=67363 00:12:07.319 11:23:02 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_dirty -- nvmf/common.sh@506 -- # ip netns exec nvmf_tgt_ns_spdk /home/vagrant/spdk_repo/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x1 00:12:07.319 11:23:02 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_dirty -- nvmf/common.sh@508 -- # waitforlisten 67363 00:12:07.319 11:23:02 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_dirty -- common/autotest_common.sh@831 -- # '[' -z 67363 ']' 00:12:07.319 11:23:02 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_dirty -- common/autotest_common.sh@835 -- # local rpc_addr=/var/tmp/spdk.sock 00:12:07.319 11:23:02 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_dirty -- common/autotest_common.sh@836 -- # local max_retries=100 00:12:07.319 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:12:07.319 11:23:02 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_dirty -- common/autotest_common.sh@838 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:12:07.319 11:23:02 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_dirty -- common/autotest_common.sh@840 -- # xtrace_disable 00:12:07.319 11:23:02 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_dirty -- common/autotest_common.sh@10 -- # set +x 00:12:07.319 [2024-10-07 11:23:02.669491] Starting SPDK v25.01-pre git sha1 2a4f56c54 / DPDK 24.03.0 initialization... 00:12:07.319 [2024-10-07 11:23:02.669605] [ DPDK EAL parameters: nvmf -c 0x1 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --iova-mode=pa --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:12:07.319 [2024-10-07 11:23:02.814014] app.c: 917:spdk_app_start: *NOTICE*: Total cores available: 1 00:12:07.577 [2024-10-07 11:23:02.930145] app.c: 610:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:12:07.577 [2024-10-07 11:23:02.930202] app.c: 611:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:12:07.577 [2024-10-07 11:23:02.930229] app.c: 616:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:12:07.577 [2024-10-07 11:23:02.930237] app.c: 617:app_setup_trace: *NOTICE*: SPDK application currently running. 00:12:07.577 [2024-10-07 11:23:02.930244] app.c: 618:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:12:07.577 [2024-10-07 11:23:02.930659] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 0 00:12:08.512 11:23:03 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_dirty -- common/autotest_common.sh@860 -- # (( i == 0 )) 00:12:08.512 11:23:03 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_dirty -- common/autotest_common.sh@864 -- # return 0 00:12:08.512 11:23:03 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_dirty -- nvmf/common.sh@509 -- # timing_exit start_nvmf_tgt 00:12:08.512 11:23:03 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_dirty -- common/autotest_common.sh@730 -- # xtrace_disable 00:12:08.512 11:23:03 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_dirty -- common/autotest_common.sh@10 -- # set +x 00:12:08.513 11:23:03 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_dirty -- nvmf/common.sh@510 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:12:08.513 11:23:03 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_dirty -- target/nvmf_lvs_grow.sh@77 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py bdev_aio_create /home/vagrant/spdk_repo/spdk/test/nvmf/target/aio_bdev aio_bdev 4096 00:12:08.513 [2024-10-07 11:23:04.012644] blobstore.c:4875:bs_recover: *NOTICE*: Performing recovery on blobstore 00:12:08.513 [2024-10-07 11:23:04.012992] blobstore.c:4822:bs_load_replay_md_cpl: *NOTICE*: Recover: blob 0x0 00:12:08.513 [2024-10-07 11:23:04.013213] blobstore.c:4822:bs_load_replay_md_cpl: *NOTICE*: Recover: blob 0x1 00:12:08.772 11:23:04 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_dirty -- target/nvmf_lvs_grow.sh@77 -- # aio_bdev=aio_bdev 00:12:08.772 11:23:04 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_dirty -- target/nvmf_lvs_grow.sh@78 -- # waitforbdev c77a866c-c3f3-40e5-825a-bde386a08119 00:12:08.772 11:23:04 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_dirty -- common/autotest_common.sh@899 -- # local bdev_name=c77a866c-c3f3-40e5-825a-bde386a08119 00:12:08.772 11:23:04 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_dirty -- common/autotest_common.sh@900 -- # local bdev_timeout= 00:12:08.772 11:23:04 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_dirty -- common/autotest_common.sh@901 -- # local i 00:12:08.772 11:23:04 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_dirty -- common/autotest_common.sh@902 -- # [[ -z '' ]] 00:12:08.772 11:23:04 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_dirty -- common/autotest_common.sh@902 -- # bdev_timeout=2000 00:12:08.772 11:23:04 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_dirty -- common/autotest_common.sh@904 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py bdev_wait_for_examine 00:12:09.030 11:23:04 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_dirty -- common/autotest_common.sh@906 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py bdev_get_bdevs -b c77a866c-c3f3-40e5-825a-bde386a08119 -t 2000 00:12:09.288 [ 00:12:09.288 { 00:12:09.288 "aliases": [ 00:12:09.288 "lvs/lvol" 00:12:09.288 ], 00:12:09.288 "assigned_rate_limits": { 00:12:09.288 "r_mbytes_per_sec": 0, 00:12:09.288 "rw_ios_per_sec": 0, 00:12:09.288 "rw_mbytes_per_sec": 0, 00:12:09.288 "w_mbytes_per_sec": 0 00:12:09.288 }, 00:12:09.288 "block_size": 4096, 00:12:09.288 "claimed": false, 00:12:09.288 "driver_specific": { 00:12:09.288 "lvol": { 00:12:09.288 "base_bdev": "aio_bdev", 00:12:09.288 "clone": false, 00:12:09.288 "esnap_clone": false, 00:12:09.288 "lvol_store_uuid": "768cab8d-22c9-4e1b-9c66-e9b9c03371f0", 00:12:09.288 "num_allocated_clusters": 38, 00:12:09.288 "snapshot": false, 00:12:09.288 "thin_provision": false 00:12:09.288 } 00:12:09.288 }, 00:12:09.288 "name": "c77a866c-c3f3-40e5-825a-bde386a08119", 00:12:09.288 "num_blocks": 38912, 00:12:09.288 "product_name": "Logical Volume", 00:12:09.288 "supported_io_types": { 00:12:09.288 "abort": false, 00:12:09.288 "compare": false, 00:12:09.288 "compare_and_write": false, 00:12:09.288 "copy": false, 00:12:09.288 "flush": false, 00:12:09.288 "get_zone_info": false, 00:12:09.288 "nvme_admin": false, 00:12:09.288 "nvme_io": false, 00:12:09.288 "nvme_io_md": false, 00:12:09.288 "nvme_iov_md": false, 00:12:09.288 "read": true, 00:12:09.288 "reset": true, 00:12:09.288 "seek_data": true, 00:12:09.288 "seek_hole": true, 00:12:09.288 "unmap": true, 00:12:09.288 "write": true, 00:12:09.288 "write_zeroes": true, 00:12:09.288 "zcopy": false, 00:12:09.288 "zone_append": false, 00:12:09.288 "zone_management": false 00:12:09.288 }, 00:12:09.288 "uuid": "c77a866c-c3f3-40e5-825a-bde386a08119", 00:12:09.288 "zoned": false 00:12:09.288 } 00:12:09.288 ] 00:12:09.288 11:23:04 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_dirty -- common/autotest_common.sh@907 -- # return 0 00:12:09.288 11:23:04 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_dirty -- target/nvmf_lvs_grow.sh@79 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 768cab8d-22c9-4e1b-9c66-e9b9c03371f0 00:12:09.288 11:23:04 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_dirty -- target/nvmf_lvs_grow.sh@79 -- # jq -r '.[0].free_clusters' 00:12:09.546 11:23:04 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_dirty -- target/nvmf_lvs_grow.sh@79 -- # (( free_clusters == 61 )) 00:12:09.546 11:23:04 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_dirty -- target/nvmf_lvs_grow.sh@80 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 768cab8d-22c9-4e1b-9c66-e9b9c03371f0 00:12:09.546 11:23:04 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_dirty -- target/nvmf_lvs_grow.sh@80 -- # jq -r '.[0].total_data_clusters' 00:12:09.804 11:23:05 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_dirty -- target/nvmf_lvs_grow.sh@80 -- # (( data_clusters == 99 )) 00:12:09.804 11:23:05 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_dirty -- target/nvmf_lvs_grow.sh@84 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py bdev_aio_delete aio_bdev 00:12:10.074 [2024-10-07 11:23:05.554197] vbdev_lvol.c: 150:vbdev_lvs_hotremove_cb: *NOTICE*: bdev aio_bdev being removed: closing lvstore lvs 00:12:10.345 11:23:05 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_dirty -- target/nvmf_lvs_grow.sh@85 -- # NOT /home/vagrant/spdk_repo/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 768cab8d-22c9-4e1b-9c66-e9b9c03371f0 00:12:10.345 11:23:05 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_dirty -- common/autotest_common.sh@650 -- # local es=0 00:12:10.345 11:23:05 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_dirty -- common/autotest_common.sh@652 -- # valid_exec_arg /home/vagrant/spdk_repo/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 768cab8d-22c9-4e1b-9c66-e9b9c03371f0 00:12:10.345 11:23:05 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_dirty -- common/autotest_common.sh@638 -- # local arg=/home/vagrant/spdk_repo/spdk/scripts/rpc.py 00:12:10.345 11:23:05 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_dirty -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:12:10.345 11:23:05 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_dirty -- common/autotest_common.sh@642 -- # type -t /home/vagrant/spdk_repo/spdk/scripts/rpc.py 00:12:10.345 11:23:05 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_dirty -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:12:10.345 11:23:05 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_dirty -- common/autotest_common.sh@644 -- # type -P /home/vagrant/spdk_repo/spdk/scripts/rpc.py 00:12:10.345 11:23:05 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_dirty -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:12:10.345 11:23:05 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_dirty -- common/autotest_common.sh@644 -- # arg=/home/vagrant/spdk_repo/spdk/scripts/rpc.py 00:12:10.345 11:23:05 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_dirty -- common/autotest_common.sh@644 -- # [[ -x /home/vagrant/spdk_repo/spdk/scripts/rpc.py ]] 00:12:10.345 11:23:05 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_dirty -- common/autotest_common.sh@653 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 768cab8d-22c9-4e1b-9c66-e9b9c03371f0 00:12:10.602 2024/10/07 11:23:05 error on JSON-RPC call, method: bdev_lvol_get_lvstores, params: map[uuid:768cab8d-22c9-4e1b-9c66-e9b9c03371f0], err: error received for bdev_lvol_get_lvstores method, err: Code=-19 Msg=No such device 00:12:10.602 request: 00:12:10.602 { 00:12:10.602 "method": "bdev_lvol_get_lvstores", 00:12:10.602 "params": { 00:12:10.602 "uuid": "768cab8d-22c9-4e1b-9c66-e9b9c03371f0" 00:12:10.602 } 00:12:10.602 } 00:12:10.602 Got JSON-RPC error response 00:12:10.602 GoRPCClient: error on JSON-RPC call 00:12:10.602 11:23:05 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_dirty -- common/autotest_common.sh@653 -- # es=1 00:12:10.602 11:23:05 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_dirty -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:12:10.602 11:23:05 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_dirty -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:12:10.602 11:23:05 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_dirty -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:12:10.602 11:23:05 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_dirty -- target/nvmf_lvs_grow.sh@86 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py bdev_aio_create /home/vagrant/spdk_repo/spdk/test/nvmf/target/aio_bdev aio_bdev 4096 00:12:10.861 aio_bdev 00:12:10.861 11:23:06 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_dirty -- target/nvmf_lvs_grow.sh@87 -- # waitforbdev c77a866c-c3f3-40e5-825a-bde386a08119 00:12:10.861 11:23:06 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_dirty -- common/autotest_common.sh@899 -- # local bdev_name=c77a866c-c3f3-40e5-825a-bde386a08119 00:12:10.861 11:23:06 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_dirty -- common/autotest_common.sh@900 -- # local bdev_timeout= 00:12:10.861 11:23:06 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_dirty -- common/autotest_common.sh@901 -- # local i 00:12:10.861 11:23:06 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_dirty -- common/autotest_common.sh@902 -- # [[ -z '' ]] 00:12:10.861 11:23:06 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_dirty -- common/autotest_common.sh@902 -- # bdev_timeout=2000 00:12:10.861 11:23:06 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_dirty -- common/autotest_common.sh@904 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py bdev_wait_for_examine 00:12:11.118 11:23:06 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_dirty -- common/autotest_common.sh@906 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py bdev_get_bdevs -b c77a866c-c3f3-40e5-825a-bde386a08119 -t 2000 00:12:11.377 [ 00:12:11.377 { 00:12:11.377 "aliases": [ 00:12:11.377 "lvs/lvol" 00:12:11.377 ], 00:12:11.377 "assigned_rate_limits": { 00:12:11.377 "r_mbytes_per_sec": 0, 00:12:11.377 "rw_ios_per_sec": 0, 00:12:11.377 "rw_mbytes_per_sec": 0, 00:12:11.377 "w_mbytes_per_sec": 0 00:12:11.377 }, 00:12:11.377 "block_size": 4096, 00:12:11.377 "claimed": false, 00:12:11.377 "driver_specific": { 00:12:11.377 "lvol": { 00:12:11.377 "base_bdev": "aio_bdev", 00:12:11.377 "clone": false, 00:12:11.377 "esnap_clone": false, 00:12:11.377 "lvol_store_uuid": "768cab8d-22c9-4e1b-9c66-e9b9c03371f0", 00:12:11.377 "num_allocated_clusters": 38, 00:12:11.377 "snapshot": false, 00:12:11.377 "thin_provision": false 00:12:11.377 } 00:12:11.377 }, 00:12:11.377 "name": "c77a866c-c3f3-40e5-825a-bde386a08119", 00:12:11.377 "num_blocks": 38912, 00:12:11.377 "product_name": "Logical Volume", 00:12:11.377 "supported_io_types": { 00:12:11.377 "abort": false, 00:12:11.377 "compare": false, 00:12:11.377 "compare_and_write": false, 00:12:11.377 "copy": false, 00:12:11.377 "flush": false, 00:12:11.377 "get_zone_info": false, 00:12:11.377 "nvme_admin": false, 00:12:11.377 "nvme_io": false, 00:12:11.377 "nvme_io_md": false, 00:12:11.377 "nvme_iov_md": false, 00:12:11.377 "read": true, 00:12:11.377 "reset": true, 00:12:11.377 "seek_data": true, 00:12:11.377 "seek_hole": true, 00:12:11.377 "unmap": true, 00:12:11.377 "write": true, 00:12:11.377 "write_zeroes": true, 00:12:11.377 "zcopy": false, 00:12:11.377 "zone_append": false, 00:12:11.377 "zone_management": false 00:12:11.377 }, 00:12:11.377 "uuid": "c77a866c-c3f3-40e5-825a-bde386a08119", 00:12:11.377 "zoned": false 00:12:11.377 } 00:12:11.377 ] 00:12:11.377 11:23:06 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_dirty -- common/autotest_common.sh@907 -- # return 0 00:12:11.377 11:23:06 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_dirty -- target/nvmf_lvs_grow.sh@88 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 768cab8d-22c9-4e1b-9c66-e9b9c03371f0 00:12:11.377 11:23:06 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_dirty -- target/nvmf_lvs_grow.sh@88 -- # jq -r '.[0].free_clusters' 00:12:11.635 11:23:07 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_dirty -- target/nvmf_lvs_grow.sh@88 -- # (( free_clusters == 61 )) 00:12:11.635 11:23:07 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_dirty -- target/nvmf_lvs_grow.sh@89 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 768cab8d-22c9-4e1b-9c66-e9b9c03371f0 00:12:11.635 11:23:07 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_dirty -- target/nvmf_lvs_grow.sh@89 -- # jq -r '.[0].total_data_clusters' 00:12:11.892 11:23:07 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_dirty -- target/nvmf_lvs_grow.sh@89 -- # (( data_clusters == 99 )) 00:12:11.892 11:23:07 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_dirty -- target/nvmf_lvs_grow.sh@92 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py bdev_lvol_delete c77a866c-c3f3-40e5-825a-bde386a08119 00:12:12.150 11:23:07 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_dirty -- target/nvmf_lvs_grow.sh@93 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py bdev_lvol_delete_lvstore -u 768cab8d-22c9-4e1b-9c66-e9b9c03371f0 00:12:12.408 11:23:07 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_dirty -- target/nvmf_lvs_grow.sh@94 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py bdev_aio_delete aio_bdev 00:12:12.982 11:23:08 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_dirty -- target/nvmf_lvs_grow.sh@95 -- # rm -f /home/vagrant/spdk_repo/spdk/test/nvmf/target/aio_bdev 00:12:13.254 00:12:13.254 real 0m22.257s 00:12:13.254 user 0m46.555s 00:12:13.254 sys 0m7.772s 00:12:13.254 11:23:08 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_dirty -- common/autotest_common.sh@1126 -- # xtrace_disable 00:12:13.254 11:23:08 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_dirty -- common/autotest_common.sh@10 -- # set +x 00:12:13.254 ************************************ 00:12:13.254 END TEST lvs_grow_dirty 00:12:13.254 ************************************ 00:12:13.254 11:23:08 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- target/nvmf_lvs_grow.sh@1 -- # process_shm --id 0 00:12:13.254 11:23:08 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- common/autotest_common.sh@808 -- # type=--id 00:12:13.254 11:23:08 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- common/autotest_common.sh@809 -- # id=0 00:12:13.254 11:23:08 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- common/autotest_common.sh@810 -- # '[' --id = --pid ']' 00:12:13.254 11:23:08 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- common/autotest_common.sh@814 -- # find /dev/shm -name '*.0' -printf '%f\n' 00:12:13.254 11:23:08 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- common/autotest_common.sh@814 -- # shm_files=nvmf_trace.0 00:12:13.254 11:23:08 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- common/autotest_common.sh@816 -- # [[ -z nvmf_trace.0 ]] 00:12:13.254 11:23:08 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- common/autotest_common.sh@820 -- # for n in $shm_files 00:12:13.254 11:23:08 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- common/autotest_common.sh@821 -- # tar -C /dev/shm/ -cvzf /home/vagrant/spdk_repo/spdk/../output/nvmf_trace.0_shm.tar.gz nvmf_trace.0 00:12:13.254 nvmf_trace.0 00:12:13.254 11:23:08 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- common/autotest_common.sh@823 -- # return 0 00:12:13.254 11:23:08 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- target/nvmf_lvs_grow.sh@1 -- # nvmftestfini 00:12:13.254 11:23:08 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@514 -- # nvmfcleanup 00:12:13.254 11:23:08 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@121 -- # sync 00:12:13.821 11:23:09 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@123 -- # '[' tcp == tcp ']' 00:12:13.821 11:23:09 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@124 -- # set +e 00:12:13.821 11:23:09 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@125 -- # for i in {1..20} 00:12:13.821 11:23:09 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@126 -- # modprobe -v -r nvme-tcp 00:12:13.821 rmmod nvme_tcp 00:12:13.821 rmmod nvme_fabrics 00:12:13.821 rmmod nvme_keyring 00:12:13.821 11:23:09 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@127 -- # modprobe -v -r nvme-fabrics 00:12:13.821 11:23:09 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@128 -- # set -e 00:12:13.821 11:23:09 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@129 -- # return 0 00:12:13.821 11:23:09 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@515 -- # '[' -n 67363 ']' 00:12:13.821 11:23:09 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@516 -- # killprocess 67363 00:12:13.821 11:23:09 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- common/autotest_common.sh@950 -- # '[' -z 67363 ']' 00:12:13.821 11:23:09 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- common/autotest_common.sh@954 -- # kill -0 67363 00:12:13.821 11:23:09 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- common/autotest_common.sh@955 -- # uname 00:12:13.821 11:23:09 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- common/autotest_common.sh@955 -- # '[' Linux = Linux ']' 00:12:13.821 11:23:09 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- common/autotest_common.sh@956 -- # ps --no-headers -o comm= 67363 00:12:13.821 11:23:09 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- common/autotest_common.sh@956 -- # process_name=reactor_0 00:12:13.821 killing process with pid 67363 00:12:13.821 11:23:09 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- common/autotest_common.sh@960 -- # '[' reactor_0 = sudo ']' 00:12:13.821 11:23:09 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- common/autotest_common.sh@968 -- # echo 'killing process with pid 67363' 00:12:13.821 11:23:09 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- common/autotest_common.sh@969 -- # kill 67363 00:12:13.821 11:23:09 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- common/autotest_common.sh@974 -- # wait 67363 00:12:14.080 11:23:09 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@518 -- # '[' '' == iso ']' 00:12:14.080 11:23:09 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@521 -- # [[ tcp == \t\c\p ]] 00:12:14.080 11:23:09 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@522 -- # nvmf_tcp_fini 00:12:14.080 11:23:09 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@297 -- # iptr 00:12:14.080 11:23:09 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@789 -- # iptables-save 00:12:14.080 11:23:09 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@789 -- # grep -v SPDK_NVMF 00:12:14.080 11:23:09 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@789 -- # iptables-restore 00:12:14.080 11:23:09 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@298 -- # [[ nvmf_tgt_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s\_\s\p\d\k ]] 00:12:14.080 11:23:09 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@299 -- # nvmf_veth_fini 00:12:14.080 11:23:09 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@233 -- # ip link set nvmf_init_br nomaster 00:12:14.080 11:23:09 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@234 -- # ip link set nvmf_init_br2 nomaster 00:12:14.080 11:23:09 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@235 -- # ip link set nvmf_tgt_br nomaster 00:12:14.080 11:23:09 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@236 -- # ip link set nvmf_tgt_br2 nomaster 00:12:14.080 11:23:09 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@237 -- # ip link set nvmf_init_br down 00:12:14.080 11:23:09 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@238 -- # ip link set nvmf_init_br2 down 00:12:14.080 11:23:09 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@239 -- # ip link set nvmf_tgt_br down 00:12:14.080 11:23:09 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@240 -- # ip link set nvmf_tgt_br2 down 00:12:14.080 11:23:09 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@241 -- # ip link delete nvmf_br type bridge 00:12:14.080 11:23:09 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@242 -- # ip link delete nvmf_init_if 00:12:14.080 11:23:09 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@243 -- # ip link delete nvmf_init_if2 00:12:14.080 11:23:09 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@244 -- # ip netns exec nvmf_tgt_ns_spdk ip link delete nvmf_tgt_if 00:12:14.080 11:23:09 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@245 -- # ip netns exec nvmf_tgt_ns_spdk ip link delete nvmf_tgt_if2 00:12:14.080 11:23:09 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@246 -- # remove_spdk_ns 00:12:14.080 11:23:09 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@654 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:12:14.080 11:23:09 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 15> /dev/null' 00:12:14.080 11:23:09 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:12:14.339 11:23:09 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@300 -- # return 0 00:12:14.339 00:12:14.339 real 0m44.723s 00:12:14.339 user 1m12.828s 00:12:14.339 sys 0m11.146s 00:12:14.339 11:23:09 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- common/autotest_common.sh@1126 -- # xtrace_disable 00:12:14.339 11:23:09 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- common/autotest_common.sh@10 -- # set +x 00:12:14.339 ************************************ 00:12:14.339 END TEST nvmf_lvs_grow 00:12:14.339 ************************************ 00:12:14.339 11:23:09 nvmf_tcp.nvmf_target_core -- nvmf/nvmf_target_core.sh@29 -- # run_test nvmf_bdev_io_wait /home/vagrant/spdk_repo/spdk/test/nvmf/target/bdev_io_wait.sh --transport=tcp 00:12:14.339 11:23:09 nvmf_tcp.nvmf_target_core -- common/autotest_common.sh@1101 -- # '[' 3 -le 1 ']' 00:12:14.339 11:23:09 nvmf_tcp.nvmf_target_core -- common/autotest_common.sh@1107 -- # xtrace_disable 00:12:14.339 11:23:09 nvmf_tcp.nvmf_target_core -- common/autotest_common.sh@10 -- # set +x 00:12:14.339 ************************************ 00:12:14.339 START TEST nvmf_bdev_io_wait 00:12:14.339 ************************************ 00:12:14.339 11:23:09 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- common/autotest_common.sh@1125 -- # /home/vagrant/spdk_repo/spdk/test/nvmf/target/bdev_io_wait.sh --transport=tcp 00:12:14.339 * Looking for test storage... 00:12:14.339 * Found test storage at /home/vagrant/spdk_repo/spdk/test/nvmf/target 00:12:14.339 11:23:09 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- common/autotest_common.sh@1680 -- # [[ y == y ]] 00:12:14.339 11:23:09 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- common/autotest_common.sh@1681 -- # lcov --version 00:12:14.339 11:23:09 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- common/autotest_common.sh@1681 -- # awk '{print $NF}' 00:12:14.339 11:23:09 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- common/autotest_common.sh@1681 -- # lt 1.15 2 00:12:14.339 11:23:09 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- scripts/common.sh@373 -- # cmp_versions 1.15 '<' 2 00:12:14.339 11:23:09 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- scripts/common.sh@333 -- # local ver1 ver1_l 00:12:14.339 11:23:09 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- scripts/common.sh@334 -- # local ver2 ver2_l 00:12:14.599 11:23:09 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- scripts/common.sh@336 -- # IFS=.-: 00:12:14.599 11:23:09 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- scripts/common.sh@336 -- # read -ra ver1 00:12:14.599 11:23:09 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- scripts/common.sh@337 -- # IFS=.-: 00:12:14.599 11:23:09 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- scripts/common.sh@337 -- # read -ra ver2 00:12:14.599 11:23:09 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- scripts/common.sh@338 -- # local 'op=<' 00:12:14.599 11:23:09 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- scripts/common.sh@340 -- # ver1_l=2 00:12:14.599 11:23:09 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- scripts/common.sh@341 -- # ver2_l=1 00:12:14.599 11:23:09 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- scripts/common.sh@343 -- # local lt=0 gt=0 eq=0 v 00:12:14.599 11:23:09 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- scripts/common.sh@344 -- # case "$op" in 00:12:14.599 11:23:09 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- scripts/common.sh@345 -- # : 1 00:12:14.599 11:23:09 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- scripts/common.sh@364 -- # (( v = 0 )) 00:12:14.599 11:23:09 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- scripts/common.sh@364 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:12:14.599 11:23:09 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- scripts/common.sh@365 -- # decimal 1 00:12:14.599 11:23:09 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- scripts/common.sh@353 -- # local d=1 00:12:14.599 11:23:09 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- scripts/common.sh@354 -- # [[ 1 =~ ^[0-9]+$ ]] 00:12:14.599 11:23:09 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- scripts/common.sh@355 -- # echo 1 00:12:14.599 11:23:09 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- scripts/common.sh@365 -- # ver1[v]=1 00:12:14.599 11:23:09 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- scripts/common.sh@366 -- # decimal 2 00:12:14.599 11:23:09 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- scripts/common.sh@353 -- # local d=2 00:12:14.599 11:23:09 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- scripts/common.sh@354 -- # [[ 2 =~ ^[0-9]+$ ]] 00:12:14.599 11:23:09 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- scripts/common.sh@355 -- # echo 2 00:12:14.599 11:23:09 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- scripts/common.sh@366 -- # ver2[v]=2 00:12:14.599 11:23:09 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- scripts/common.sh@367 -- # (( ver1[v] > ver2[v] )) 00:12:14.599 11:23:09 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- scripts/common.sh@368 -- # (( ver1[v] < ver2[v] )) 00:12:14.599 11:23:09 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- scripts/common.sh@368 -- # return 0 00:12:14.599 11:23:09 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- common/autotest_common.sh@1682 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:12:14.599 11:23:09 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- common/autotest_common.sh@1694 -- # export 'LCOV_OPTS= 00:12:14.599 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:12:14.599 --rc genhtml_branch_coverage=1 00:12:14.599 --rc genhtml_function_coverage=1 00:12:14.599 --rc genhtml_legend=1 00:12:14.599 --rc geninfo_all_blocks=1 00:12:14.599 --rc geninfo_unexecuted_blocks=1 00:12:14.599 00:12:14.599 ' 00:12:14.599 11:23:09 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- common/autotest_common.sh@1694 -- # LCOV_OPTS=' 00:12:14.599 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:12:14.599 --rc genhtml_branch_coverage=1 00:12:14.599 --rc genhtml_function_coverage=1 00:12:14.599 --rc genhtml_legend=1 00:12:14.599 --rc geninfo_all_blocks=1 00:12:14.599 --rc geninfo_unexecuted_blocks=1 00:12:14.599 00:12:14.599 ' 00:12:14.599 11:23:09 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- common/autotest_common.sh@1695 -- # export 'LCOV=lcov 00:12:14.599 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:12:14.599 --rc genhtml_branch_coverage=1 00:12:14.599 --rc genhtml_function_coverage=1 00:12:14.599 --rc genhtml_legend=1 00:12:14.599 --rc geninfo_all_blocks=1 00:12:14.599 --rc geninfo_unexecuted_blocks=1 00:12:14.599 00:12:14.599 ' 00:12:14.599 11:23:09 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- common/autotest_common.sh@1695 -- # LCOV='lcov 00:12:14.599 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:12:14.599 --rc genhtml_branch_coverage=1 00:12:14.599 --rc genhtml_function_coverage=1 00:12:14.599 --rc genhtml_legend=1 00:12:14.599 --rc geninfo_all_blocks=1 00:12:14.599 --rc geninfo_unexecuted_blocks=1 00:12:14.599 00:12:14.599 ' 00:12:14.599 11:23:09 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- target/bdev_io_wait.sh@9 -- # source /home/vagrant/spdk_repo/spdk/test/nvmf/common.sh 00:12:14.599 11:23:09 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@7 -- # uname -s 00:12:14.599 11:23:09 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:12:14.599 11:23:09 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:12:14.599 11:23:09 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:12:14.599 11:23:09 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:12:14.599 11:23:09 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:12:14.599 11:23:09 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:12:14.599 11:23:09 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:12:14.599 11:23:09 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:12:14.599 11:23:09 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:12:14.599 11:23:09 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:12:14.599 11:23:09 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:c758a4ed-f09f-4c82-9afb-3d096f035464 00:12:14.599 11:23:09 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@18 -- # NVME_HOSTID=c758a4ed-f09f-4c82-9afb-3d096f035464 00:12:14.600 11:23:09 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:12:14.600 11:23:09 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:12:14.600 11:23:09 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@21 -- # NET_TYPE=virt 00:12:14.600 11:23:09 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:12:14.600 11:23:09 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@49 -- # source /home/vagrant/spdk_repo/spdk/scripts/common.sh 00:12:14.600 11:23:09 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- scripts/common.sh@15 -- # shopt -s extglob 00:12:14.600 11:23:09 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- scripts/common.sh@544 -- # [[ -e /bin/wpdk_common.sh ]] 00:12:14.600 11:23:09 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- scripts/common.sh@552 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:12:14.600 11:23:09 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- scripts/common.sh@553 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:12:14.600 11:23:09 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:12:14.600 11:23:09 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:12:14.600 11:23:09 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:12:14.600 11:23:09 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- paths/export.sh@5 -- # export PATH 00:12:14.600 11:23:09 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:12:14.600 11:23:09 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@51 -- # : 0 00:12:14.600 11:23:09 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@52 -- # export NVMF_APP_SHM_ID 00:12:14.600 11:23:09 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@53 -- # build_nvmf_app_args 00:12:14.600 11:23:09 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:12:14.600 11:23:09 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:12:14.600 11:23:09 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:12:14.600 11:23:09 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@33 -- # '[' '' -eq 1 ']' 00:12:14.600 /home/vagrant/spdk_repo/spdk/test/nvmf/common.sh: line 33: [: : integer expression expected 00:12:14.600 11:23:09 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@37 -- # '[' -n '' ']' 00:12:14.600 11:23:09 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@39 -- # '[' 0 -eq 1 ']' 00:12:14.600 11:23:09 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@55 -- # have_pci_nics=0 00:12:14.600 11:23:09 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- target/bdev_io_wait.sh@11 -- # MALLOC_BDEV_SIZE=64 00:12:14.600 11:23:09 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- target/bdev_io_wait.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:12:14.600 11:23:09 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- target/bdev_io_wait.sh@14 -- # nvmftestinit 00:12:14.600 11:23:09 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@467 -- # '[' -z tcp ']' 00:12:14.600 11:23:09 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@472 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:12:14.600 11:23:09 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@474 -- # prepare_net_devs 00:12:14.600 11:23:09 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@436 -- # local -g is_hw=no 00:12:14.600 11:23:09 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@438 -- # remove_spdk_ns 00:12:14.600 11:23:09 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@654 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:12:14.600 11:23:09 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 15> /dev/null' 00:12:14.600 11:23:09 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:12:14.600 11:23:09 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@440 -- # [[ virt != virt ]] 00:12:14.600 11:23:09 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@442 -- # [[ no == yes ]] 00:12:14.600 11:23:09 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@449 -- # [[ virt == phy ]] 00:12:14.600 11:23:09 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@452 -- # [[ virt == phy-fallback ]] 00:12:14.600 11:23:09 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@457 -- # [[ tcp == tcp ]] 00:12:14.600 11:23:09 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@458 -- # nvmf_veth_init 00:12:14.600 11:23:09 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@145 -- # NVMF_FIRST_INITIATOR_IP=10.0.0.1 00:12:14.600 11:23:09 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@146 -- # NVMF_SECOND_INITIATOR_IP=10.0.0.2 00:12:14.600 11:23:09 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@147 -- # NVMF_FIRST_TARGET_IP=10.0.0.3 00:12:14.600 11:23:09 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@148 -- # NVMF_SECOND_TARGET_IP=10.0.0.4 00:12:14.600 11:23:09 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@149 -- # NVMF_INITIATOR_IP=10.0.0.1 00:12:14.600 11:23:09 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@150 -- # NVMF_BRIDGE=nvmf_br 00:12:14.600 11:23:09 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@151 -- # NVMF_INITIATOR_INTERFACE=nvmf_init_if 00:12:14.600 11:23:09 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@152 -- # NVMF_INITIATOR_INTERFACE2=nvmf_init_if2 00:12:14.600 11:23:09 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@153 -- # NVMF_INITIATOR_BRIDGE=nvmf_init_br 00:12:14.600 11:23:09 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@154 -- # NVMF_INITIATOR_BRIDGE2=nvmf_init_br2 00:12:14.600 11:23:09 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@155 -- # NVMF_TARGET_NAMESPACE=nvmf_tgt_ns_spdk 00:12:14.600 11:23:09 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@156 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:12:14.600 11:23:09 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@157 -- # NVMF_TARGET_INTERFACE=nvmf_tgt_if 00:12:14.600 11:23:09 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@158 -- # NVMF_TARGET_INTERFACE2=nvmf_tgt_if2 00:12:14.600 11:23:09 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@159 -- # NVMF_TARGET_BRIDGE=nvmf_tgt_br 00:12:14.600 11:23:09 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@160 -- # NVMF_TARGET_BRIDGE2=nvmf_tgt_br2 00:12:14.600 11:23:09 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@162 -- # ip link set nvmf_init_br nomaster 00:12:14.600 Cannot find device "nvmf_init_br" 00:12:14.600 11:23:09 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@162 -- # true 00:12:14.600 11:23:09 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@163 -- # ip link set nvmf_init_br2 nomaster 00:12:14.600 Cannot find device "nvmf_init_br2" 00:12:14.600 11:23:09 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@163 -- # true 00:12:14.600 11:23:09 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@164 -- # ip link set nvmf_tgt_br nomaster 00:12:14.600 Cannot find device "nvmf_tgt_br" 00:12:14.600 11:23:09 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@164 -- # true 00:12:14.600 11:23:09 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@165 -- # ip link set nvmf_tgt_br2 nomaster 00:12:14.600 Cannot find device "nvmf_tgt_br2" 00:12:14.600 11:23:09 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@165 -- # true 00:12:14.600 11:23:09 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@166 -- # ip link set nvmf_init_br down 00:12:14.600 Cannot find device "nvmf_init_br" 00:12:14.600 11:23:09 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@166 -- # true 00:12:14.600 11:23:09 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@167 -- # ip link set nvmf_init_br2 down 00:12:14.600 Cannot find device "nvmf_init_br2" 00:12:14.600 11:23:09 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@167 -- # true 00:12:14.600 11:23:09 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@168 -- # ip link set nvmf_tgt_br down 00:12:14.600 Cannot find device "nvmf_tgt_br" 00:12:14.600 11:23:09 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@168 -- # true 00:12:14.600 11:23:09 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@169 -- # ip link set nvmf_tgt_br2 down 00:12:14.600 Cannot find device "nvmf_tgt_br2" 00:12:14.600 11:23:10 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@169 -- # true 00:12:14.600 11:23:10 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@170 -- # ip link delete nvmf_br type bridge 00:12:14.600 Cannot find device "nvmf_br" 00:12:14.600 11:23:10 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@170 -- # true 00:12:14.600 11:23:10 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@171 -- # ip link delete nvmf_init_if 00:12:14.600 Cannot find device "nvmf_init_if" 00:12:14.600 11:23:10 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@171 -- # true 00:12:14.600 11:23:10 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@172 -- # ip link delete nvmf_init_if2 00:12:14.600 Cannot find device "nvmf_init_if2" 00:12:14.600 11:23:10 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@172 -- # true 00:12:14.600 11:23:10 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@173 -- # ip netns exec nvmf_tgt_ns_spdk ip link delete nvmf_tgt_if 00:12:14.600 Cannot open network namespace "nvmf_tgt_ns_spdk": No such file or directory 00:12:14.600 11:23:10 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@173 -- # true 00:12:14.600 11:23:10 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@174 -- # ip netns exec nvmf_tgt_ns_spdk ip link delete nvmf_tgt_if2 00:12:14.600 Cannot open network namespace "nvmf_tgt_ns_spdk": No such file or directory 00:12:14.600 11:23:10 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@174 -- # true 00:12:14.600 11:23:10 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@177 -- # ip netns add nvmf_tgt_ns_spdk 00:12:14.600 11:23:10 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@180 -- # ip link add nvmf_init_if type veth peer name nvmf_init_br 00:12:14.600 11:23:10 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@181 -- # ip link add nvmf_init_if2 type veth peer name nvmf_init_br2 00:12:14.600 11:23:10 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@182 -- # ip link add nvmf_tgt_if type veth peer name nvmf_tgt_br 00:12:14.600 11:23:10 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@183 -- # ip link add nvmf_tgt_if2 type veth peer name nvmf_tgt_br2 00:12:14.600 11:23:10 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@186 -- # ip link set nvmf_tgt_if netns nvmf_tgt_ns_spdk 00:12:14.600 11:23:10 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@187 -- # ip link set nvmf_tgt_if2 netns nvmf_tgt_ns_spdk 00:12:14.859 11:23:10 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@190 -- # ip addr add 10.0.0.1/24 dev nvmf_init_if 00:12:14.859 11:23:10 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@191 -- # ip addr add 10.0.0.2/24 dev nvmf_init_if2 00:12:14.859 11:23:10 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@192 -- # ip netns exec nvmf_tgt_ns_spdk ip addr add 10.0.0.3/24 dev nvmf_tgt_if 00:12:14.859 11:23:10 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@193 -- # ip netns exec nvmf_tgt_ns_spdk ip addr add 10.0.0.4/24 dev nvmf_tgt_if2 00:12:14.859 11:23:10 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@196 -- # ip link set nvmf_init_if up 00:12:14.859 11:23:10 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@197 -- # ip link set nvmf_init_if2 up 00:12:14.859 11:23:10 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@198 -- # ip link set nvmf_init_br up 00:12:14.859 11:23:10 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@199 -- # ip link set nvmf_init_br2 up 00:12:14.859 11:23:10 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@200 -- # ip link set nvmf_tgt_br up 00:12:14.859 11:23:10 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@201 -- # ip link set nvmf_tgt_br2 up 00:12:14.859 11:23:10 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@202 -- # ip netns exec nvmf_tgt_ns_spdk ip link set nvmf_tgt_if up 00:12:14.859 11:23:10 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@203 -- # ip netns exec nvmf_tgt_ns_spdk ip link set nvmf_tgt_if2 up 00:12:14.859 11:23:10 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@204 -- # ip netns exec nvmf_tgt_ns_spdk ip link set lo up 00:12:14.859 11:23:10 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@207 -- # ip link add nvmf_br type bridge 00:12:14.859 11:23:10 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@208 -- # ip link set nvmf_br up 00:12:14.859 11:23:10 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@211 -- # ip link set nvmf_init_br master nvmf_br 00:12:14.859 11:23:10 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@212 -- # ip link set nvmf_init_br2 master nvmf_br 00:12:14.859 11:23:10 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@213 -- # ip link set nvmf_tgt_br master nvmf_br 00:12:14.859 11:23:10 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@214 -- # ip link set nvmf_tgt_br2 master nvmf_br 00:12:14.859 11:23:10 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@217 -- # ipts -I INPUT 1 -i nvmf_init_if -p tcp --dport 4420 -j ACCEPT 00:12:14.859 11:23:10 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@788 -- # iptables -I INPUT 1 -i nvmf_init_if -p tcp --dport 4420 -j ACCEPT -m comment --comment 'SPDK_NVMF:-I INPUT 1 -i nvmf_init_if -p tcp --dport 4420 -j ACCEPT' 00:12:14.859 11:23:10 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@218 -- # ipts -I INPUT 1 -i nvmf_init_if2 -p tcp --dport 4420 -j ACCEPT 00:12:14.859 11:23:10 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@788 -- # iptables -I INPUT 1 -i nvmf_init_if2 -p tcp --dport 4420 -j ACCEPT -m comment --comment 'SPDK_NVMF:-I INPUT 1 -i nvmf_init_if2 -p tcp --dport 4420 -j ACCEPT' 00:12:14.859 11:23:10 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@219 -- # ipts -A FORWARD -i nvmf_br -o nvmf_br -j ACCEPT 00:12:14.859 11:23:10 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@788 -- # iptables -A FORWARD -i nvmf_br -o nvmf_br -j ACCEPT -m comment --comment 'SPDK_NVMF:-A FORWARD -i nvmf_br -o nvmf_br -j ACCEPT' 00:12:14.859 11:23:10 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@222 -- # ping -c 1 10.0.0.3 00:12:14.859 PING 10.0.0.3 (10.0.0.3) 56(84) bytes of data. 00:12:14.859 64 bytes from 10.0.0.3: icmp_seq=1 ttl=64 time=0.069 ms 00:12:14.859 00:12:14.859 --- 10.0.0.3 ping statistics --- 00:12:14.859 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:12:14.859 rtt min/avg/max/mdev = 0.069/0.069/0.069/0.000 ms 00:12:14.859 11:23:10 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@223 -- # ping -c 1 10.0.0.4 00:12:14.859 PING 10.0.0.4 (10.0.0.4) 56(84) bytes of data. 00:12:14.859 64 bytes from 10.0.0.4: icmp_seq=1 ttl=64 time=0.072 ms 00:12:14.859 00:12:14.859 --- 10.0.0.4 ping statistics --- 00:12:14.859 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:12:14.859 rtt min/avg/max/mdev = 0.072/0.072/0.072/0.000 ms 00:12:14.859 11:23:10 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@224 -- # ip netns exec nvmf_tgt_ns_spdk ping -c 1 10.0.0.1 00:12:14.859 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:12:14.859 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.022 ms 00:12:14.859 00:12:14.859 --- 10.0.0.1 ping statistics --- 00:12:14.859 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:12:14.859 rtt min/avg/max/mdev = 0.022/0.022/0.022/0.000 ms 00:12:14.860 11:23:10 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@225 -- # ip netns exec nvmf_tgt_ns_spdk ping -c 1 10.0.0.2 00:12:14.860 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:12:14.860 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.065 ms 00:12:14.860 00:12:14.860 --- 10.0.0.2 ping statistics --- 00:12:14.860 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:12:14.860 rtt min/avg/max/mdev = 0.065/0.065/0.065/0.000 ms 00:12:14.860 11:23:10 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@227 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:12:14.860 11:23:10 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@459 -- # return 0 00:12:14.860 11:23:10 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@476 -- # '[' '' == iso ']' 00:12:14.860 11:23:10 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@480 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:12:14.860 11:23:10 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@481 -- # [[ tcp == \r\d\m\a ]] 00:12:14.860 11:23:10 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@490 -- # [[ tcp == \t\c\p ]] 00:12:14.860 11:23:10 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@491 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:12:14.860 11:23:10 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@494 -- # '[' tcp == tcp ']' 00:12:14.860 11:23:10 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@500 -- # modprobe nvme-tcp 00:12:14.860 11:23:10 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- target/bdev_io_wait.sh@15 -- # nvmfappstart -m 0xF --wait-for-rpc 00:12:14.860 11:23:10 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@505 -- # timing_enter start_nvmf_tgt 00:12:14.860 11:23:10 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- common/autotest_common.sh@724 -- # xtrace_disable 00:12:14.860 11:23:10 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- common/autotest_common.sh@10 -- # set +x 00:12:14.860 11:23:10 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@507 -- # nvmfpid=67852 00:12:14.860 11:23:10 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@508 -- # waitforlisten 67852 00:12:14.860 11:23:10 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@506 -- # ip netns exec nvmf_tgt_ns_spdk /home/vagrant/spdk_repo/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF --wait-for-rpc 00:12:14.860 11:23:10 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- common/autotest_common.sh@831 -- # '[' -z 67852 ']' 00:12:14.860 11:23:10 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- common/autotest_common.sh@835 -- # local rpc_addr=/var/tmp/spdk.sock 00:12:14.860 11:23:10 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- common/autotest_common.sh@836 -- # local max_retries=100 00:12:14.860 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:12:14.860 11:23:10 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- common/autotest_common.sh@838 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:12:14.860 11:23:10 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- common/autotest_common.sh@840 -- # xtrace_disable 00:12:14.860 11:23:10 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- common/autotest_common.sh@10 -- # set +x 00:12:14.860 [2024-10-07 11:23:10.371273] Starting SPDK v25.01-pre git sha1 2a4f56c54 / DPDK 24.03.0 initialization... 00:12:14.860 [2024-10-07 11:23:10.371422] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --iova-mode=pa --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:12:15.119 [2024-10-07 11:23:10.513036] app.c: 917:spdk_app_start: *NOTICE*: Total cores available: 4 00:12:15.379 [2024-10-07 11:23:10.645137] app.c: 610:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:12:15.379 [2024-10-07 11:23:10.645219] app.c: 611:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:12:15.379 [2024-10-07 11:23:10.645246] app.c: 616:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:12:15.379 [2024-10-07 11:23:10.645257] app.c: 617:app_setup_trace: *NOTICE*: SPDK application currently running. 00:12:15.379 [2024-10-07 11:23:10.645267] app.c: 618:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:12:15.379 [2024-10-07 11:23:10.646550] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 1 00:12:15.379 [2024-10-07 11:23:10.646713] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 2 00:12:15.379 [2024-10-07 11:23:10.646786] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 3 00:12:15.379 [2024-10-07 11:23:10.646786] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 0 00:12:15.945 11:23:11 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- common/autotest_common.sh@860 -- # (( i == 0 )) 00:12:15.945 11:23:11 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- common/autotest_common.sh@864 -- # return 0 00:12:15.945 11:23:11 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@509 -- # timing_exit start_nvmf_tgt 00:12:15.945 11:23:11 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- common/autotest_common.sh@730 -- # xtrace_disable 00:12:15.945 11:23:11 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- common/autotest_common.sh@10 -- # set +x 00:12:16.203 11:23:11 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@510 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:12:16.203 11:23:11 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- target/bdev_io_wait.sh@18 -- # rpc_cmd bdev_set_options -p 5 -c 1 00:12:16.203 11:23:11 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:16.203 11:23:11 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- common/autotest_common.sh@10 -- # set +x 00:12:16.203 11:23:11 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:16.203 11:23:11 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- target/bdev_io_wait.sh@19 -- # rpc_cmd framework_start_init 00:12:16.203 11:23:11 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:16.203 11:23:11 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- common/autotest_common.sh@10 -- # set +x 00:12:16.203 11:23:11 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:16.203 11:23:11 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- target/bdev_io_wait.sh@20 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:12:16.203 11:23:11 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:16.203 11:23:11 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- common/autotest_common.sh@10 -- # set +x 00:12:16.203 [2024-10-07 11:23:11.566097] tcp.c: 738:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:12:16.203 11:23:11 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:16.203 11:23:11 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- target/bdev_io_wait.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:12:16.203 11:23:11 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:16.203 11:23:11 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- common/autotest_common.sh@10 -- # set +x 00:12:16.203 Malloc0 00:12:16.203 11:23:11 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:16.203 11:23:11 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- target/bdev_io_wait.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:12:16.203 11:23:11 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:16.203 11:23:11 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- common/autotest_common.sh@10 -- # set +x 00:12:16.203 11:23:11 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:16.203 11:23:11 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- target/bdev_io_wait.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:12:16.203 11:23:11 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:16.203 11:23:11 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- common/autotest_common.sh@10 -- # set +x 00:12:16.203 11:23:11 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:16.203 11:23:11 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- target/bdev_io_wait.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.3 -s 4420 00:12:16.203 11:23:11 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:16.203 11:23:11 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- common/autotest_common.sh@10 -- # set +x 00:12:16.203 [2024-10-07 11:23:11.637991] tcp.c:1081:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.3 port 4420 *** 00:12:16.203 11:23:11 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:16.203 11:23:11 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- target/bdev_io_wait.sh@28 -- # WRITE_PID=67906 00:12:16.203 11:23:11 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- target/bdev_io_wait.sh@27 -- # /home/vagrant/spdk_repo/spdk/build/examples/bdevperf -m 0x10 -i 1 --json /dev/fd/63 -q 128 -o 4096 -w write -t 1 -s 256 00:12:16.203 11:23:11 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- target/bdev_io_wait.sh@27 -- # gen_nvmf_target_json 00:12:16.203 11:23:11 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@558 -- # config=() 00:12:16.203 11:23:11 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@558 -- # local subsystem config 00:12:16.203 11:23:11 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- target/bdev_io_wait.sh@30 -- # READ_PID=67908 00:12:16.203 11:23:11 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@560 -- # for subsystem in "${@:-1}" 00:12:16.203 11:23:11 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@580 -- # config+=("$(cat <<-EOF 00:12:16.203 { 00:12:16.203 "params": { 00:12:16.203 "name": "Nvme$subsystem", 00:12:16.203 "trtype": "$TEST_TRANSPORT", 00:12:16.203 "traddr": "$NVMF_FIRST_TARGET_IP", 00:12:16.203 "adrfam": "ipv4", 00:12:16.203 "trsvcid": "$NVMF_PORT", 00:12:16.203 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:12:16.203 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:12:16.203 "hdgst": ${hdgst:-false}, 00:12:16.204 "ddgst": ${ddgst:-false} 00:12:16.204 }, 00:12:16.204 "method": "bdev_nvme_attach_controller" 00:12:16.204 } 00:12:16.204 EOF 00:12:16.204 )") 00:12:16.204 11:23:11 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- target/bdev_io_wait.sh@29 -- # gen_nvmf_target_json 00:12:16.204 11:23:11 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- target/bdev_io_wait.sh@29 -- # /home/vagrant/spdk_repo/spdk/build/examples/bdevperf -m 0x20 -i 2 --json /dev/fd/63 -q 128 -o 4096 -w read -t 1 -s 256 00:12:16.204 11:23:11 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@558 -- # config=() 00:12:16.204 11:23:11 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- target/bdev_io_wait.sh@32 -- # FLUSH_PID=67910 00:12:16.204 11:23:11 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@558 -- # local subsystem config 00:12:16.204 11:23:11 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@560 -- # for subsystem in "${@:-1}" 00:12:16.204 11:23:11 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@580 -- # cat 00:12:16.204 11:23:11 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@580 -- # config+=("$(cat <<-EOF 00:12:16.204 { 00:12:16.204 "params": { 00:12:16.204 "name": "Nvme$subsystem", 00:12:16.204 "trtype": "$TEST_TRANSPORT", 00:12:16.204 "traddr": "$NVMF_FIRST_TARGET_IP", 00:12:16.204 "adrfam": "ipv4", 00:12:16.204 "trsvcid": "$NVMF_PORT", 00:12:16.204 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:12:16.204 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:12:16.204 "hdgst": ${hdgst:-false}, 00:12:16.204 "ddgst": ${ddgst:-false} 00:12:16.204 }, 00:12:16.204 "method": "bdev_nvme_attach_controller" 00:12:16.204 } 00:12:16.204 EOF 00:12:16.204 )") 00:12:16.204 11:23:11 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- target/bdev_io_wait.sh@34 -- # UNMAP_PID=67912 00:12:16.204 11:23:11 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- target/bdev_io_wait.sh@35 -- # sync 00:12:16.204 11:23:11 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@580 -- # cat 00:12:16.204 11:23:11 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- target/bdev_io_wait.sh@31 -- # /home/vagrant/spdk_repo/spdk/build/examples/bdevperf -m 0x40 -i 3 --json /dev/fd/63 -q 128 -o 4096 -w flush -t 1 -s 256 00:12:16.204 11:23:11 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- target/bdev_io_wait.sh@33 -- # gen_nvmf_target_json 00:12:16.204 11:23:11 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@558 -- # config=() 00:12:16.204 11:23:11 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@558 -- # local subsystem config 00:12:16.204 11:23:11 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@560 -- # for subsystem in "${@:-1}" 00:12:16.204 11:23:11 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@580 -- # config+=("$(cat <<-EOF 00:12:16.204 { 00:12:16.204 "params": { 00:12:16.204 "name": "Nvme$subsystem", 00:12:16.204 "trtype": "$TEST_TRANSPORT", 00:12:16.204 "traddr": "$NVMF_FIRST_TARGET_IP", 00:12:16.204 "adrfam": "ipv4", 00:12:16.204 "trsvcid": "$NVMF_PORT", 00:12:16.204 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:12:16.204 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:12:16.204 "hdgst": ${hdgst:-false}, 00:12:16.204 "ddgst": ${ddgst:-false} 00:12:16.204 }, 00:12:16.204 "method": "bdev_nvme_attach_controller" 00:12:16.204 } 00:12:16.204 EOF 00:12:16.204 )") 00:12:16.204 11:23:11 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- target/bdev_io_wait.sh@33 -- # /home/vagrant/spdk_repo/spdk/build/examples/bdevperf -m 0x80 -i 4 --json /dev/fd/63 -q 128 -o 4096 -w unmap -t 1 -s 256 00:12:16.204 11:23:11 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@582 -- # jq . 00:12:16.204 11:23:11 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@582 -- # jq . 00:12:16.204 11:23:11 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@580 -- # cat 00:12:16.204 11:23:11 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- target/bdev_io_wait.sh@31 -- # gen_nvmf_target_json 00:12:16.204 11:23:11 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@583 -- # IFS=, 00:12:16.204 11:23:11 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@584 -- # printf '%s\n' '{ 00:12:16.204 "params": { 00:12:16.204 "name": "Nvme1", 00:12:16.204 "trtype": "tcp", 00:12:16.204 "traddr": "10.0.0.3", 00:12:16.204 "adrfam": "ipv4", 00:12:16.204 "trsvcid": "4420", 00:12:16.204 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:12:16.204 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:12:16.204 "hdgst": false, 00:12:16.204 "ddgst": false 00:12:16.204 }, 00:12:16.204 "method": "bdev_nvme_attach_controller" 00:12:16.204 }' 00:12:16.204 11:23:11 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@558 -- # config=() 00:12:16.204 11:23:11 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@558 -- # local subsystem config 00:12:16.204 11:23:11 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@560 -- # for subsystem in "${@:-1}" 00:12:16.204 11:23:11 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@580 -- # config+=("$(cat <<-EOF 00:12:16.204 { 00:12:16.204 "params": { 00:12:16.204 "name": "Nvme$subsystem", 00:12:16.204 "trtype": "$TEST_TRANSPORT", 00:12:16.204 "traddr": "$NVMF_FIRST_TARGET_IP", 00:12:16.204 "adrfam": "ipv4", 00:12:16.204 "trsvcid": "$NVMF_PORT", 00:12:16.204 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:12:16.204 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:12:16.204 "hdgst": ${hdgst:-false}, 00:12:16.204 "ddgst": ${ddgst:-false} 00:12:16.204 }, 00:12:16.204 "method": "bdev_nvme_attach_controller" 00:12:16.204 } 00:12:16.204 EOF 00:12:16.204 )") 00:12:16.204 11:23:11 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@583 -- # IFS=, 00:12:16.204 11:23:11 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@584 -- # printf '%s\n' '{ 00:12:16.204 "params": { 00:12:16.204 "name": "Nvme1", 00:12:16.204 "trtype": "tcp", 00:12:16.204 "traddr": "10.0.0.3", 00:12:16.204 "adrfam": "ipv4", 00:12:16.204 "trsvcid": "4420", 00:12:16.204 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:12:16.204 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:12:16.204 "hdgst": false, 00:12:16.204 "ddgst": false 00:12:16.204 }, 00:12:16.204 "method": "bdev_nvme_attach_controller" 00:12:16.204 }' 00:12:16.204 11:23:11 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@580 -- # cat 00:12:16.204 11:23:11 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@582 -- # jq . 00:12:16.204 11:23:11 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@583 -- # IFS=, 00:12:16.204 11:23:11 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@584 -- # printf '%s\n' '{ 00:12:16.204 "params": { 00:12:16.204 "name": "Nvme1", 00:12:16.204 "trtype": "tcp", 00:12:16.204 "traddr": "10.0.0.3", 00:12:16.204 "adrfam": "ipv4", 00:12:16.204 "trsvcid": "4420", 00:12:16.204 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:12:16.204 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:12:16.204 "hdgst": false, 00:12:16.204 "ddgst": false 00:12:16.204 }, 00:12:16.204 "method": "bdev_nvme_attach_controller" 00:12:16.204 }' 00:12:16.204 11:23:11 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@582 -- # jq . 00:12:16.204 11:23:11 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@583 -- # IFS=, 00:12:16.204 11:23:11 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@584 -- # printf '%s\n' '{ 00:12:16.204 "params": { 00:12:16.204 "name": "Nvme1", 00:12:16.204 "trtype": "tcp", 00:12:16.204 "traddr": "10.0.0.3", 00:12:16.204 "adrfam": "ipv4", 00:12:16.204 "trsvcid": "4420", 00:12:16.204 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:12:16.204 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:12:16.204 "hdgst": false, 00:12:16.204 "ddgst": false 00:12:16.204 }, 00:12:16.204 "method": "bdev_nvme_attach_controller" 00:12:16.204 }' 00:12:16.204 [2024-10-07 11:23:11.700435] Starting SPDK v25.01-pre git sha1 2a4f56c54 / DPDK 24.03.0 initialization... 00:12:16.204 [2024-10-07 11:23:11.700515] [ DPDK EAL parameters: bdevperf -c 0x10 -m 256 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --iova-mode=pa --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk1 --proc-type=auto ] 00:12:16.204 11:23:11 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- target/bdev_io_wait.sh@37 -- # wait 67906 00:12:16.462 [2024-10-07 11:23:11.727706] Starting SPDK v25.01-pre git sha1 2a4f56c54 / DPDK 24.03.0 initialization... 00:12:16.462 [2024-10-07 11:23:11.727831] [ DPDK EAL parameters: bdevperf -c 0x80 -m 256 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --iova-mode=pa --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk4 --proc-type=auto ] 00:12:16.462 [2024-10-07 11:23:11.728452] Starting SPDK v25.01-pre git sha1 2a4f56c54 / DPDK 24.03.0 initialization... 00:12:16.462 [2024-10-07 11:23:11.728523] [ DPDK EAL parameters: bdevperf -c 0x20 -m 256 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --iova-mode=pa --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk2 --proc-type=auto ] 00:12:16.462 [2024-10-07 11:23:11.737759] Starting SPDK v25.01-pre git sha1 2a4f56c54 / DPDK 24.03.0 initialization... 00:12:16.462 [2024-10-07 11:23:11.737863] [ DPDK EAL parameters: bdevperf -c 0x40 -m 256 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --iova-mode=pa --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk3 --proc-type=auto ] 00:12:16.462 [2024-10-07 11:23:11.897573] app.c: 917:spdk_app_start: *NOTICE*: Total cores available: 1 00:12:16.462 [2024-10-07 11:23:11.967635] app.c: 917:spdk_app_start: *NOTICE*: Total cores available: 1 00:12:16.719 [2024-10-07 11:23:11.998878] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 4 00:12:16.719 [2024-10-07 11:23:12.041007] app.c: 917:spdk_app_start: *NOTICE*: Total cores available: 1 00:12:16.719 [2024-10-07 11:23:12.060529] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 7 00:12:16.719 [2024-10-07 11:23:12.119526] app.c: 917:spdk_app_start: *NOTICE*: Total cores available: 1 00:12:16.719 [2024-10-07 11:23:12.131582] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 5 00:12:16.719 Running I/O for 1 seconds... 00:12:16.719 [2024-10-07 11:23:12.222277] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 6 00:12:16.976 Running I/O for 1 seconds... 00:12:16.976 Running I/O for 1 seconds... 00:12:16.976 Running I/O for 1 seconds... 00:12:17.910 10171.00 IOPS, 39.73 MiB/s 00:12:17.910 Latency(us) 00:12:17.910 [2024-10-07T11:23:13.433Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:12:17.910 Job: Nvme1n1 (Core Mask 0x10, workload: write, depth: 128, IO size: 4096) 00:12:17.910 Nvme1n1 : 1.01 10228.97 39.96 0.00 0.00 12462.01 6583.39 18826.71 00:12:17.910 [2024-10-07T11:23:13.433Z] =================================================================================================================== 00:12:17.910 [2024-10-07T11:23:13.433Z] Total : 10228.97 39.96 0.00 0.00 12462.01 6583.39 18826.71 00:12:17.910 8588.00 IOPS, 33.55 MiB/s 00:12:17.910 Latency(us) 00:12:17.910 [2024-10-07T11:23:13.433Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:12:17.910 Job: Nvme1n1 (Core Mask 0x80, workload: unmap, depth: 128, IO size: 4096) 00:12:17.910 Nvme1n1 : 1.01 8660.50 33.83 0.00 0.00 14719.75 5987.61 24307.90 00:12:17.910 [2024-10-07T11:23:13.433Z] =================================================================================================================== 00:12:17.910 [2024-10-07T11:23:13.433Z] Total : 8660.50 33.83 0.00 0.00 14719.75 5987.61 24307.90 00:12:17.910 7769.00 IOPS, 30.35 MiB/s 00:12:17.910 Latency(us) 00:12:17.910 [2024-10-07T11:23:13.433Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:12:17.910 Job: Nvme1n1 (Core Mask 0x20, workload: read, depth: 128, IO size: 4096) 00:12:17.910 Nvme1n1 : 1.01 7830.87 30.59 0.00 0.00 16266.01 7357.91 26691.03 00:12:17.910 [2024-10-07T11:23:13.433Z] =================================================================================================================== 00:12:17.910 [2024-10-07T11:23:13.433Z] Total : 7830.87 30.59 0.00 0.00 16266.01 7357.91 26691.03 00:12:17.910 11:23:13 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- target/bdev_io_wait.sh@38 -- # wait 67908 00:12:17.910 192528.00 IOPS, 752.06 MiB/s 00:12:17.911 Latency(us) 00:12:17.911 [2024-10-07T11:23:13.434Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:12:17.911 Job: Nvme1n1 (Core Mask 0x40, workload: flush, depth: 128, IO size: 4096) 00:12:17.911 Nvme1n1 : 1.00 192150.35 750.59 0.00 0.00 662.49 325.82 1936.29 00:12:17.911 [2024-10-07T11:23:13.434Z] =================================================================================================================== 00:12:17.911 [2024-10-07T11:23:13.434Z] Total : 192150.35 750.59 0.00 0.00 662.49 325.82 1936.29 00:12:18.168 11:23:13 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- target/bdev_io_wait.sh@39 -- # wait 67910 00:12:18.168 11:23:13 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- target/bdev_io_wait.sh@40 -- # wait 67912 00:12:18.168 11:23:13 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- target/bdev_io_wait.sh@42 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:12:18.168 11:23:13 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:18.168 11:23:13 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- common/autotest_common.sh@10 -- # set +x 00:12:18.169 11:23:13 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:18.169 11:23:13 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- target/bdev_io_wait.sh@44 -- # trap - SIGINT SIGTERM EXIT 00:12:18.169 11:23:13 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- target/bdev_io_wait.sh@46 -- # nvmftestfini 00:12:18.169 11:23:13 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@514 -- # nvmfcleanup 00:12:18.169 11:23:13 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@121 -- # sync 00:12:18.169 11:23:13 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@123 -- # '[' tcp == tcp ']' 00:12:18.169 11:23:13 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@124 -- # set +e 00:12:18.169 11:23:13 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@125 -- # for i in {1..20} 00:12:18.169 11:23:13 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@126 -- # modprobe -v -r nvme-tcp 00:12:18.427 rmmod nvme_tcp 00:12:18.427 rmmod nvme_fabrics 00:12:18.427 rmmod nvme_keyring 00:12:18.427 11:23:13 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@127 -- # modprobe -v -r nvme-fabrics 00:12:18.427 11:23:13 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@128 -- # set -e 00:12:18.427 11:23:13 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@129 -- # return 0 00:12:18.427 11:23:13 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@515 -- # '[' -n 67852 ']' 00:12:18.427 11:23:13 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@516 -- # killprocess 67852 00:12:18.427 11:23:13 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- common/autotest_common.sh@950 -- # '[' -z 67852 ']' 00:12:18.427 11:23:13 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- common/autotest_common.sh@954 -- # kill -0 67852 00:12:18.427 11:23:13 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- common/autotest_common.sh@955 -- # uname 00:12:18.427 11:23:13 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- common/autotest_common.sh@955 -- # '[' Linux = Linux ']' 00:12:18.427 11:23:13 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- common/autotest_common.sh@956 -- # ps --no-headers -o comm= 67852 00:12:18.427 11:23:13 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- common/autotest_common.sh@956 -- # process_name=reactor_0 00:12:18.427 11:23:13 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- common/autotest_common.sh@960 -- # '[' reactor_0 = sudo ']' 00:12:18.427 11:23:13 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- common/autotest_common.sh@968 -- # echo 'killing process with pid 67852' 00:12:18.427 killing process with pid 67852 00:12:18.427 11:23:13 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- common/autotest_common.sh@969 -- # kill 67852 00:12:18.427 11:23:13 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- common/autotest_common.sh@974 -- # wait 67852 00:12:18.684 11:23:13 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@518 -- # '[' '' == iso ']' 00:12:18.684 11:23:13 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@521 -- # [[ tcp == \t\c\p ]] 00:12:18.684 11:23:13 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@522 -- # nvmf_tcp_fini 00:12:18.684 11:23:13 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@297 -- # iptr 00:12:18.684 11:23:13 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@789 -- # iptables-save 00:12:18.684 11:23:13 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@789 -- # iptables-restore 00:12:18.684 11:23:13 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@789 -- # grep -v SPDK_NVMF 00:12:18.684 11:23:13 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@298 -- # [[ nvmf_tgt_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s\_\s\p\d\k ]] 00:12:18.684 11:23:13 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@299 -- # nvmf_veth_fini 00:12:18.684 11:23:14 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@233 -- # ip link set nvmf_init_br nomaster 00:12:18.684 11:23:14 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@234 -- # ip link set nvmf_init_br2 nomaster 00:12:18.685 11:23:14 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@235 -- # ip link set nvmf_tgt_br nomaster 00:12:18.685 11:23:14 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@236 -- # ip link set nvmf_tgt_br2 nomaster 00:12:18.685 11:23:14 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@237 -- # ip link set nvmf_init_br down 00:12:18.685 11:23:14 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@238 -- # ip link set nvmf_init_br2 down 00:12:18.685 11:23:14 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@239 -- # ip link set nvmf_tgt_br down 00:12:18.685 11:23:14 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@240 -- # ip link set nvmf_tgt_br2 down 00:12:18.685 11:23:14 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@241 -- # ip link delete nvmf_br type bridge 00:12:18.685 11:23:14 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@242 -- # ip link delete nvmf_init_if 00:12:18.685 11:23:14 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@243 -- # ip link delete nvmf_init_if2 00:12:18.685 11:23:14 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@244 -- # ip netns exec nvmf_tgt_ns_spdk ip link delete nvmf_tgt_if 00:12:18.685 11:23:14 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@245 -- # ip netns exec nvmf_tgt_ns_spdk ip link delete nvmf_tgt_if2 00:12:18.685 11:23:14 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@246 -- # remove_spdk_ns 00:12:18.685 11:23:14 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@654 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:12:18.685 11:23:14 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 15> /dev/null' 00:12:18.685 11:23:14 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:12:18.943 11:23:14 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@300 -- # return 0 00:12:18.943 00:12:18.943 real 0m4.552s 00:12:18.943 user 0m18.416s 00:12:18.943 sys 0m2.298s 00:12:18.943 11:23:14 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- common/autotest_common.sh@1126 -- # xtrace_disable 00:12:18.943 11:23:14 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- common/autotest_common.sh@10 -- # set +x 00:12:18.943 ************************************ 00:12:18.943 END TEST nvmf_bdev_io_wait 00:12:18.943 ************************************ 00:12:18.943 11:23:14 nvmf_tcp.nvmf_target_core -- nvmf/nvmf_target_core.sh@30 -- # run_test nvmf_queue_depth /home/vagrant/spdk_repo/spdk/test/nvmf/target/queue_depth.sh --transport=tcp 00:12:18.943 11:23:14 nvmf_tcp.nvmf_target_core -- common/autotest_common.sh@1101 -- # '[' 3 -le 1 ']' 00:12:18.943 11:23:14 nvmf_tcp.nvmf_target_core -- common/autotest_common.sh@1107 -- # xtrace_disable 00:12:18.943 11:23:14 nvmf_tcp.nvmf_target_core -- common/autotest_common.sh@10 -- # set +x 00:12:18.943 ************************************ 00:12:18.943 START TEST nvmf_queue_depth 00:12:18.943 ************************************ 00:12:18.943 11:23:14 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- common/autotest_common.sh@1125 -- # /home/vagrant/spdk_repo/spdk/test/nvmf/target/queue_depth.sh --transport=tcp 00:12:18.943 * Looking for test storage... 00:12:18.943 * Found test storage at /home/vagrant/spdk_repo/spdk/test/nvmf/target 00:12:18.943 11:23:14 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- common/autotest_common.sh@1680 -- # [[ y == y ]] 00:12:18.943 11:23:14 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- common/autotest_common.sh@1681 -- # lcov --version 00:12:18.943 11:23:14 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- common/autotest_common.sh@1681 -- # awk '{print $NF}' 00:12:18.943 11:23:14 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- common/autotest_common.sh@1681 -- # lt 1.15 2 00:12:18.943 11:23:14 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- scripts/common.sh@373 -- # cmp_versions 1.15 '<' 2 00:12:19.201 11:23:14 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- scripts/common.sh@333 -- # local ver1 ver1_l 00:12:19.201 11:23:14 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- scripts/common.sh@334 -- # local ver2 ver2_l 00:12:19.201 11:23:14 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- scripts/common.sh@336 -- # IFS=.-: 00:12:19.201 11:23:14 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- scripts/common.sh@336 -- # read -ra ver1 00:12:19.201 11:23:14 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- scripts/common.sh@337 -- # IFS=.-: 00:12:19.201 11:23:14 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- scripts/common.sh@337 -- # read -ra ver2 00:12:19.201 11:23:14 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- scripts/common.sh@338 -- # local 'op=<' 00:12:19.202 11:23:14 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- scripts/common.sh@340 -- # ver1_l=2 00:12:19.202 11:23:14 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- scripts/common.sh@341 -- # ver2_l=1 00:12:19.202 11:23:14 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- scripts/common.sh@343 -- # local lt=0 gt=0 eq=0 v 00:12:19.202 11:23:14 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- scripts/common.sh@344 -- # case "$op" in 00:12:19.202 11:23:14 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- scripts/common.sh@345 -- # : 1 00:12:19.202 11:23:14 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- scripts/common.sh@364 -- # (( v = 0 )) 00:12:19.202 11:23:14 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- scripts/common.sh@364 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:12:19.202 11:23:14 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- scripts/common.sh@365 -- # decimal 1 00:12:19.202 11:23:14 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- scripts/common.sh@353 -- # local d=1 00:12:19.202 11:23:14 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- scripts/common.sh@354 -- # [[ 1 =~ ^[0-9]+$ ]] 00:12:19.202 11:23:14 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- scripts/common.sh@355 -- # echo 1 00:12:19.202 11:23:14 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- scripts/common.sh@365 -- # ver1[v]=1 00:12:19.202 11:23:14 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- scripts/common.sh@366 -- # decimal 2 00:12:19.202 11:23:14 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- scripts/common.sh@353 -- # local d=2 00:12:19.202 11:23:14 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- scripts/common.sh@354 -- # [[ 2 =~ ^[0-9]+$ ]] 00:12:19.202 11:23:14 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- scripts/common.sh@355 -- # echo 2 00:12:19.202 11:23:14 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- scripts/common.sh@366 -- # ver2[v]=2 00:12:19.202 11:23:14 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- scripts/common.sh@367 -- # (( ver1[v] > ver2[v] )) 00:12:19.202 11:23:14 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- scripts/common.sh@368 -- # (( ver1[v] < ver2[v] )) 00:12:19.202 11:23:14 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- scripts/common.sh@368 -- # return 0 00:12:19.202 11:23:14 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- common/autotest_common.sh@1682 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:12:19.202 11:23:14 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- common/autotest_common.sh@1694 -- # export 'LCOV_OPTS= 00:12:19.202 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:12:19.202 --rc genhtml_branch_coverage=1 00:12:19.202 --rc genhtml_function_coverage=1 00:12:19.202 --rc genhtml_legend=1 00:12:19.202 --rc geninfo_all_blocks=1 00:12:19.202 --rc geninfo_unexecuted_blocks=1 00:12:19.202 00:12:19.202 ' 00:12:19.202 11:23:14 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- common/autotest_common.sh@1694 -- # LCOV_OPTS=' 00:12:19.202 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:12:19.202 --rc genhtml_branch_coverage=1 00:12:19.202 --rc genhtml_function_coverage=1 00:12:19.202 --rc genhtml_legend=1 00:12:19.202 --rc geninfo_all_blocks=1 00:12:19.202 --rc geninfo_unexecuted_blocks=1 00:12:19.202 00:12:19.202 ' 00:12:19.202 11:23:14 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- common/autotest_common.sh@1695 -- # export 'LCOV=lcov 00:12:19.202 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:12:19.202 --rc genhtml_branch_coverage=1 00:12:19.202 --rc genhtml_function_coverage=1 00:12:19.202 --rc genhtml_legend=1 00:12:19.202 --rc geninfo_all_blocks=1 00:12:19.202 --rc geninfo_unexecuted_blocks=1 00:12:19.202 00:12:19.202 ' 00:12:19.202 11:23:14 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- common/autotest_common.sh@1695 -- # LCOV='lcov 00:12:19.202 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:12:19.202 --rc genhtml_branch_coverage=1 00:12:19.202 --rc genhtml_function_coverage=1 00:12:19.202 --rc genhtml_legend=1 00:12:19.202 --rc geninfo_all_blocks=1 00:12:19.202 --rc geninfo_unexecuted_blocks=1 00:12:19.202 00:12:19.202 ' 00:12:19.202 11:23:14 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- target/queue_depth.sh@12 -- # source /home/vagrant/spdk_repo/spdk/test/nvmf/common.sh 00:12:19.202 11:23:14 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@7 -- # uname -s 00:12:19.202 11:23:14 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:12:19.202 11:23:14 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:12:19.202 11:23:14 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:12:19.202 11:23:14 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:12:19.202 11:23:14 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:12:19.202 11:23:14 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:12:19.202 11:23:14 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:12:19.202 11:23:14 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:12:19.202 11:23:14 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:12:19.202 11:23:14 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:12:19.202 11:23:14 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:c758a4ed-f09f-4c82-9afb-3d096f035464 00:12:19.202 11:23:14 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@18 -- # NVME_HOSTID=c758a4ed-f09f-4c82-9afb-3d096f035464 00:12:19.202 11:23:14 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:12:19.202 11:23:14 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:12:19.202 11:23:14 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@21 -- # NET_TYPE=virt 00:12:19.202 11:23:14 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:12:19.202 11:23:14 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@49 -- # source /home/vagrant/spdk_repo/spdk/scripts/common.sh 00:12:19.202 11:23:14 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- scripts/common.sh@15 -- # shopt -s extglob 00:12:19.202 11:23:14 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- scripts/common.sh@544 -- # [[ -e /bin/wpdk_common.sh ]] 00:12:19.202 11:23:14 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- scripts/common.sh@552 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:12:19.202 11:23:14 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- scripts/common.sh@553 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:12:19.202 11:23:14 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:12:19.202 11:23:14 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:12:19.202 11:23:14 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:12:19.202 11:23:14 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- paths/export.sh@5 -- # export PATH 00:12:19.202 11:23:14 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:12:19.202 11:23:14 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@51 -- # : 0 00:12:19.202 11:23:14 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@52 -- # export NVMF_APP_SHM_ID 00:12:19.202 11:23:14 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@53 -- # build_nvmf_app_args 00:12:19.202 11:23:14 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:12:19.202 11:23:14 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:12:19.202 11:23:14 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:12:19.202 11:23:14 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@33 -- # '[' '' -eq 1 ']' 00:12:19.202 /home/vagrant/spdk_repo/spdk/test/nvmf/common.sh: line 33: [: : integer expression expected 00:12:19.202 11:23:14 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@37 -- # '[' -n '' ']' 00:12:19.202 11:23:14 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@39 -- # '[' 0 -eq 1 ']' 00:12:19.202 11:23:14 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@55 -- # have_pci_nics=0 00:12:19.202 11:23:14 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- target/queue_depth.sh@14 -- # MALLOC_BDEV_SIZE=64 00:12:19.202 11:23:14 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- target/queue_depth.sh@15 -- # MALLOC_BLOCK_SIZE=512 00:12:19.202 11:23:14 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- target/queue_depth.sh@17 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:12:19.202 11:23:14 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- target/queue_depth.sh@19 -- # nvmftestinit 00:12:19.202 11:23:14 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@467 -- # '[' -z tcp ']' 00:12:19.202 11:23:14 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@472 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:12:19.202 11:23:14 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@474 -- # prepare_net_devs 00:12:19.202 11:23:14 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@436 -- # local -g is_hw=no 00:12:19.202 11:23:14 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@438 -- # remove_spdk_ns 00:12:19.202 11:23:14 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@654 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:12:19.202 11:23:14 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 15> /dev/null' 00:12:19.202 11:23:14 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:12:19.202 11:23:14 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@440 -- # [[ virt != virt ]] 00:12:19.202 11:23:14 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@442 -- # [[ no == yes ]] 00:12:19.202 11:23:14 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@449 -- # [[ virt == phy ]] 00:12:19.202 11:23:14 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@452 -- # [[ virt == phy-fallback ]] 00:12:19.202 11:23:14 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@457 -- # [[ tcp == tcp ]] 00:12:19.202 11:23:14 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@458 -- # nvmf_veth_init 00:12:19.202 11:23:14 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@145 -- # NVMF_FIRST_INITIATOR_IP=10.0.0.1 00:12:19.203 11:23:14 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@146 -- # NVMF_SECOND_INITIATOR_IP=10.0.0.2 00:12:19.203 11:23:14 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@147 -- # NVMF_FIRST_TARGET_IP=10.0.0.3 00:12:19.203 11:23:14 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@148 -- # NVMF_SECOND_TARGET_IP=10.0.0.4 00:12:19.203 11:23:14 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@149 -- # NVMF_INITIATOR_IP=10.0.0.1 00:12:19.203 11:23:14 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@150 -- # NVMF_BRIDGE=nvmf_br 00:12:19.203 11:23:14 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@151 -- # NVMF_INITIATOR_INTERFACE=nvmf_init_if 00:12:19.203 11:23:14 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@152 -- # NVMF_INITIATOR_INTERFACE2=nvmf_init_if2 00:12:19.203 11:23:14 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@153 -- # NVMF_INITIATOR_BRIDGE=nvmf_init_br 00:12:19.203 11:23:14 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@154 -- # NVMF_INITIATOR_BRIDGE2=nvmf_init_br2 00:12:19.203 11:23:14 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@155 -- # NVMF_TARGET_NAMESPACE=nvmf_tgt_ns_spdk 00:12:19.203 11:23:14 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@156 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:12:19.203 11:23:14 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@157 -- # NVMF_TARGET_INTERFACE=nvmf_tgt_if 00:12:19.203 11:23:14 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@158 -- # NVMF_TARGET_INTERFACE2=nvmf_tgt_if2 00:12:19.203 11:23:14 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@159 -- # NVMF_TARGET_BRIDGE=nvmf_tgt_br 00:12:19.203 11:23:14 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@160 -- # NVMF_TARGET_BRIDGE2=nvmf_tgt_br2 00:12:19.203 11:23:14 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@162 -- # ip link set nvmf_init_br nomaster 00:12:19.203 Cannot find device "nvmf_init_br" 00:12:19.203 11:23:14 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@162 -- # true 00:12:19.203 11:23:14 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@163 -- # ip link set nvmf_init_br2 nomaster 00:12:19.203 Cannot find device "nvmf_init_br2" 00:12:19.203 11:23:14 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@163 -- # true 00:12:19.203 11:23:14 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@164 -- # ip link set nvmf_tgt_br nomaster 00:12:19.203 Cannot find device "nvmf_tgt_br" 00:12:19.203 11:23:14 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@164 -- # true 00:12:19.203 11:23:14 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@165 -- # ip link set nvmf_tgt_br2 nomaster 00:12:19.203 Cannot find device "nvmf_tgt_br2" 00:12:19.203 11:23:14 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@165 -- # true 00:12:19.203 11:23:14 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@166 -- # ip link set nvmf_init_br down 00:12:19.203 Cannot find device "nvmf_init_br" 00:12:19.203 11:23:14 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@166 -- # true 00:12:19.203 11:23:14 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@167 -- # ip link set nvmf_init_br2 down 00:12:19.203 Cannot find device "nvmf_init_br2" 00:12:19.203 11:23:14 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@167 -- # true 00:12:19.203 11:23:14 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@168 -- # ip link set nvmf_tgt_br down 00:12:19.203 Cannot find device "nvmf_tgt_br" 00:12:19.203 11:23:14 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@168 -- # true 00:12:19.203 11:23:14 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@169 -- # ip link set nvmf_tgt_br2 down 00:12:19.203 Cannot find device "nvmf_tgt_br2" 00:12:19.203 11:23:14 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@169 -- # true 00:12:19.203 11:23:14 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@170 -- # ip link delete nvmf_br type bridge 00:12:19.203 Cannot find device "nvmf_br" 00:12:19.203 11:23:14 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@170 -- # true 00:12:19.203 11:23:14 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@171 -- # ip link delete nvmf_init_if 00:12:19.203 Cannot find device "nvmf_init_if" 00:12:19.203 11:23:14 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@171 -- # true 00:12:19.203 11:23:14 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@172 -- # ip link delete nvmf_init_if2 00:12:19.203 Cannot find device "nvmf_init_if2" 00:12:19.203 11:23:14 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@172 -- # true 00:12:19.203 11:23:14 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@173 -- # ip netns exec nvmf_tgt_ns_spdk ip link delete nvmf_tgt_if 00:12:19.203 Cannot open network namespace "nvmf_tgt_ns_spdk": No such file or directory 00:12:19.203 11:23:14 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@173 -- # true 00:12:19.203 11:23:14 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@174 -- # ip netns exec nvmf_tgt_ns_spdk ip link delete nvmf_tgt_if2 00:12:19.203 Cannot open network namespace "nvmf_tgt_ns_spdk": No such file or directory 00:12:19.203 11:23:14 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@174 -- # true 00:12:19.203 11:23:14 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@177 -- # ip netns add nvmf_tgt_ns_spdk 00:12:19.203 11:23:14 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@180 -- # ip link add nvmf_init_if type veth peer name nvmf_init_br 00:12:19.203 11:23:14 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@181 -- # ip link add nvmf_init_if2 type veth peer name nvmf_init_br2 00:12:19.203 11:23:14 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@182 -- # ip link add nvmf_tgt_if type veth peer name nvmf_tgt_br 00:12:19.203 11:23:14 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@183 -- # ip link add nvmf_tgt_if2 type veth peer name nvmf_tgt_br2 00:12:19.203 11:23:14 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@186 -- # ip link set nvmf_tgt_if netns nvmf_tgt_ns_spdk 00:12:19.203 11:23:14 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@187 -- # ip link set nvmf_tgt_if2 netns nvmf_tgt_ns_spdk 00:12:19.203 11:23:14 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@190 -- # ip addr add 10.0.0.1/24 dev nvmf_init_if 00:12:19.203 11:23:14 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@191 -- # ip addr add 10.0.0.2/24 dev nvmf_init_if2 00:12:19.203 11:23:14 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@192 -- # ip netns exec nvmf_tgt_ns_spdk ip addr add 10.0.0.3/24 dev nvmf_tgt_if 00:12:19.462 11:23:14 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@193 -- # ip netns exec nvmf_tgt_ns_spdk ip addr add 10.0.0.4/24 dev nvmf_tgt_if2 00:12:19.462 11:23:14 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@196 -- # ip link set nvmf_init_if up 00:12:19.462 11:23:14 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@197 -- # ip link set nvmf_init_if2 up 00:12:19.462 11:23:14 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@198 -- # ip link set nvmf_init_br up 00:12:19.462 11:23:14 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@199 -- # ip link set nvmf_init_br2 up 00:12:19.462 11:23:14 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@200 -- # ip link set nvmf_tgt_br up 00:12:19.462 11:23:14 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@201 -- # ip link set nvmf_tgt_br2 up 00:12:19.462 11:23:14 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@202 -- # ip netns exec nvmf_tgt_ns_spdk ip link set nvmf_tgt_if up 00:12:19.462 11:23:14 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@203 -- # ip netns exec nvmf_tgt_ns_spdk ip link set nvmf_tgt_if2 up 00:12:19.462 11:23:14 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@204 -- # ip netns exec nvmf_tgt_ns_spdk ip link set lo up 00:12:19.462 11:23:14 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@207 -- # ip link add nvmf_br type bridge 00:12:19.462 11:23:14 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@208 -- # ip link set nvmf_br up 00:12:19.462 11:23:14 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@211 -- # ip link set nvmf_init_br master nvmf_br 00:12:19.462 11:23:14 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@212 -- # ip link set nvmf_init_br2 master nvmf_br 00:12:19.462 11:23:14 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@213 -- # ip link set nvmf_tgt_br master nvmf_br 00:12:19.462 11:23:14 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@214 -- # ip link set nvmf_tgt_br2 master nvmf_br 00:12:19.462 11:23:14 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@217 -- # ipts -I INPUT 1 -i nvmf_init_if -p tcp --dport 4420 -j ACCEPT 00:12:19.462 11:23:14 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@788 -- # iptables -I INPUT 1 -i nvmf_init_if -p tcp --dport 4420 -j ACCEPT -m comment --comment 'SPDK_NVMF:-I INPUT 1 -i nvmf_init_if -p tcp --dport 4420 -j ACCEPT' 00:12:19.462 11:23:14 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@218 -- # ipts -I INPUT 1 -i nvmf_init_if2 -p tcp --dport 4420 -j ACCEPT 00:12:19.462 11:23:14 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@788 -- # iptables -I INPUT 1 -i nvmf_init_if2 -p tcp --dport 4420 -j ACCEPT -m comment --comment 'SPDK_NVMF:-I INPUT 1 -i nvmf_init_if2 -p tcp --dport 4420 -j ACCEPT' 00:12:19.462 11:23:14 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@219 -- # ipts -A FORWARD -i nvmf_br -o nvmf_br -j ACCEPT 00:12:19.462 11:23:14 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@788 -- # iptables -A FORWARD -i nvmf_br -o nvmf_br -j ACCEPT -m comment --comment 'SPDK_NVMF:-A FORWARD -i nvmf_br -o nvmf_br -j ACCEPT' 00:12:19.462 11:23:14 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@222 -- # ping -c 1 10.0.0.3 00:12:19.462 PING 10.0.0.3 (10.0.0.3) 56(84) bytes of data. 00:12:19.462 64 bytes from 10.0.0.3: icmp_seq=1 ttl=64 time=0.072 ms 00:12:19.462 00:12:19.462 --- 10.0.0.3 ping statistics --- 00:12:19.462 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:12:19.462 rtt min/avg/max/mdev = 0.072/0.072/0.072/0.000 ms 00:12:19.462 11:23:14 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@223 -- # ping -c 1 10.0.0.4 00:12:19.462 PING 10.0.0.4 (10.0.0.4) 56(84) bytes of data. 00:12:19.462 64 bytes from 10.0.0.4: icmp_seq=1 ttl=64 time=0.045 ms 00:12:19.462 00:12:19.462 --- 10.0.0.4 ping statistics --- 00:12:19.462 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:12:19.462 rtt min/avg/max/mdev = 0.045/0.045/0.045/0.000 ms 00:12:19.462 11:23:14 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@224 -- # ip netns exec nvmf_tgt_ns_spdk ping -c 1 10.0.0.1 00:12:19.462 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:12:19.462 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.024 ms 00:12:19.462 00:12:19.462 --- 10.0.0.1 ping statistics --- 00:12:19.462 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:12:19.462 rtt min/avg/max/mdev = 0.024/0.024/0.024/0.000 ms 00:12:19.462 11:23:14 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@225 -- # ip netns exec nvmf_tgt_ns_spdk ping -c 1 10.0.0.2 00:12:19.462 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:12:19.462 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.049 ms 00:12:19.462 00:12:19.462 --- 10.0.0.2 ping statistics --- 00:12:19.462 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:12:19.462 rtt min/avg/max/mdev = 0.049/0.049/0.049/0.000 ms 00:12:19.462 11:23:14 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@227 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:12:19.462 11:23:14 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@459 -- # return 0 00:12:19.462 11:23:14 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@476 -- # '[' '' == iso ']' 00:12:19.462 11:23:14 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@480 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:12:19.462 11:23:14 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@481 -- # [[ tcp == \r\d\m\a ]] 00:12:19.462 11:23:14 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@490 -- # [[ tcp == \t\c\p ]] 00:12:19.462 11:23:14 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@491 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:12:19.462 11:23:14 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@494 -- # '[' tcp == tcp ']' 00:12:19.462 11:23:14 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@500 -- # modprobe nvme-tcp 00:12:19.462 11:23:14 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- target/queue_depth.sh@21 -- # nvmfappstart -m 0x2 00:12:19.462 11:23:14 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@505 -- # timing_enter start_nvmf_tgt 00:12:19.462 11:23:14 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- common/autotest_common.sh@724 -- # xtrace_disable 00:12:19.462 11:23:14 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- common/autotest_common.sh@10 -- # set +x 00:12:19.462 11:23:14 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@507 -- # nvmfpid=68200 00:12:19.462 11:23:14 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@506 -- # ip netns exec nvmf_tgt_ns_spdk /home/vagrant/spdk_repo/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x2 00:12:19.462 11:23:14 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@508 -- # waitforlisten 68200 00:12:19.462 11:23:14 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- common/autotest_common.sh@831 -- # '[' -z 68200 ']' 00:12:19.462 11:23:14 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- common/autotest_common.sh@835 -- # local rpc_addr=/var/tmp/spdk.sock 00:12:19.462 11:23:14 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- common/autotest_common.sh@836 -- # local max_retries=100 00:12:19.462 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:12:19.462 11:23:14 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- common/autotest_common.sh@838 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:12:19.462 11:23:14 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- common/autotest_common.sh@840 -- # xtrace_disable 00:12:19.462 11:23:14 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- common/autotest_common.sh@10 -- # set +x 00:12:19.462 [2024-10-07 11:23:14.952850] Starting SPDK v25.01-pre git sha1 2a4f56c54 / DPDK 24.03.0 initialization... 00:12:19.462 [2024-10-07 11:23:14.952991] [ DPDK EAL parameters: nvmf -c 0x2 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --iova-mode=pa --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:12:19.721 [2024-10-07 11:23:15.097464] app.c: 917:spdk_app_start: *NOTICE*: Total cores available: 1 00:12:19.721 [2024-10-07 11:23:15.205645] app.c: 610:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:12:19.721 [2024-10-07 11:23:15.205713] app.c: 611:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:12:19.721 [2024-10-07 11:23:15.205725] app.c: 616:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:12:19.721 [2024-10-07 11:23:15.205733] app.c: 617:app_setup_trace: *NOTICE*: SPDK application currently running. 00:12:19.721 [2024-10-07 11:23:15.205741] app.c: 618:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:12:19.721 [2024-10-07 11:23:15.206127] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 1 00:12:20.655 11:23:16 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- common/autotest_common.sh@860 -- # (( i == 0 )) 00:12:20.655 11:23:16 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- common/autotest_common.sh@864 -- # return 0 00:12:20.655 11:23:16 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@509 -- # timing_exit start_nvmf_tgt 00:12:20.656 11:23:16 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- common/autotest_common.sh@730 -- # xtrace_disable 00:12:20.656 11:23:16 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- common/autotest_common.sh@10 -- # set +x 00:12:20.656 11:23:16 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@510 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:12:20.656 11:23:16 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- target/queue_depth.sh@23 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:12:20.656 11:23:16 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:20.656 11:23:16 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- common/autotest_common.sh@10 -- # set +x 00:12:20.656 [2024-10-07 11:23:16.103698] tcp.c: 738:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:12:20.656 11:23:16 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:20.656 11:23:16 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- target/queue_depth.sh@24 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:12:20.656 11:23:16 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:20.656 11:23:16 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- common/autotest_common.sh@10 -- # set +x 00:12:20.656 Malloc0 00:12:20.656 11:23:16 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:20.656 11:23:16 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- target/queue_depth.sh@25 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:12:20.656 11:23:16 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:20.656 11:23:16 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- common/autotest_common.sh@10 -- # set +x 00:12:20.656 11:23:16 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:20.656 11:23:16 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- target/queue_depth.sh@26 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:12:20.656 11:23:16 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:20.656 11:23:16 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- common/autotest_common.sh@10 -- # set +x 00:12:20.656 11:23:16 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:20.656 11:23:16 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- target/queue_depth.sh@27 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.3 -s 4420 00:12:20.656 11:23:16 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:20.656 11:23:16 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- common/autotest_common.sh@10 -- # set +x 00:12:20.656 [2024-10-07 11:23:16.171114] tcp.c:1081:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.3 port 4420 *** 00:12:20.656 11:23:16 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:20.656 11:23:16 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- target/queue_depth.sh@30 -- # bdevperf_pid=68250 00:12:20.656 11:23:16 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- target/queue_depth.sh@29 -- # /home/vagrant/spdk_repo/spdk/build/examples/bdevperf -z -r /var/tmp/bdevperf.sock -q 1024 -o 4096 -w verify -t 10 00:12:20.656 11:23:16 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- target/queue_depth.sh@32 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; killprocess $bdevperf_pid; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:12:20.656 11:23:16 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- target/queue_depth.sh@33 -- # waitforlisten 68250 /var/tmp/bdevperf.sock 00:12:20.656 11:23:16 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- common/autotest_common.sh@831 -- # '[' -z 68250 ']' 00:12:20.656 11:23:16 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- common/autotest_common.sh@835 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:12:20.656 11:23:16 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- common/autotest_common.sh@836 -- # local max_retries=100 00:12:20.656 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:12:20.656 11:23:16 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- common/autotest_common.sh@838 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:12:20.656 11:23:16 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- common/autotest_common.sh@840 -- # xtrace_disable 00:12:20.656 11:23:16 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- common/autotest_common.sh@10 -- # set +x 00:12:20.914 [2024-10-07 11:23:16.235369] Starting SPDK v25.01-pre git sha1 2a4f56c54 / DPDK 24.03.0 initialization... 00:12:20.914 [2024-10-07 11:23:16.235466] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --iova-mode=pa --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid68250 ] 00:12:20.914 [2024-10-07 11:23:16.374347] app.c: 917:spdk_app_start: *NOTICE*: Total cores available: 1 00:12:21.173 [2024-10-07 11:23:16.497541] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 0 00:12:22.107 11:23:17 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- common/autotest_common.sh@860 -- # (( i == 0 )) 00:12:22.107 11:23:17 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- common/autotest_common.sh@864 -- # return 0 00:12:22.107 11:23:17 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- target/queue_depth.sh@34 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.3 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:12:22.107 11:23:17 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:22.107 11:23:17 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- common/autotest_common.sh@10 -- # set +x 00:12:22.107 NVMe0n1 00:12:22.107 11:23:17 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:22.107 11:23:17 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- target/queue_depth.sh@35 -- # /home/vagrant/spdk_repo/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bdevperf.sock perform_tests 00:12:22.107 Running I/O for 10 seconds... 00:12:24.419 8199.00 IOPS, 32.03 MiB/s [2024-10-07T11:23:20.876Z] 8448.00 IOPS, 33.00 MiB/s [2024-10-07T11:23:21.810Z] 8530.33 IOPS, 33.32 MiB/s [2024-10-07T11:23:22.760Z] 8574.50 IOPS, 33.49 MiB/s [2024-10-07T11:23:23.693Z] 8602.00 IOPS, 33.60 MiB/s [2024-10-07T11:23:24.627Z] 8640.00 IOPS, 33.75 MiB/s [2024-10-07T11:23:25.602Z] 8629.43 IOPS, 33.71 MiB/s [2024-10-07T11:23:26.536Z] 8648.75 IOPS, 33.78 MiB/s [2024-10-07T11:23:27.913Z] 8639.22 IOPS, 33.75 MiB/s [2024-10-07T11:23:27.913Z] 8592.80 IOPS, 33.57 MiB/s 00:12:32.390 Latency(us) 00:12:32.390 [2024-10-07T11:23:27.913Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:12:32.390 Job: NVMe0n1 (Core Mask 0x1, workload: verify, depth: 1024, IO size: 4096) 00:12:32.390 Verification LBA range: start 0x0 length 0x4000 00:12:32.390 NVMe0n1 : 10.10 8609.44 33.63 0.00 0.00 118410.68 27644.28 108670.60 00:12:32.390 [2024-10-07T11:23:27.913Z] =================================================================================================================== 00:12:32.390 [2024-10-07T11:23:27.913Z] Total : 8609.44 33.63 0.00 0.00 118410.68 27644.28 108670.60 00:12:32.390 { 00:12:32.390 "results": [ 00:12:32.390 { 00:12:32.390 "job": "NVMe0n1", 00:12:32.390 "core_mask": "0x1", 00:12:32.390 "workload": "verify", 00:12:32.390 "status": "finished", 00:12:32.390 "verify_range": { 00:12:32.390 "start": 0, 00:12:32.390 "length": 16384 00:12:32.390 }, 00:12:32.390 "queue_depth": 1024, 00:12:32.390 "io_size": 4096, 00:12:32.390 "runtime": 10.099495, 00:12:32.390 "iops": 8609.440373008749, 00:12:32.390 "mibps": 33.630626457065425, 00:12:32.390 "io_failed": 0, 00:12:32.390 "io_timeout": 0, 00:12:32.390 "avg_latency_us": 118410.67675139917, 00:12:32.390 "min_latency_us": 27644.276363636363, 00:12:32.390 "max_latency_us": 108670.60363636364 00:12:32.390 } 00:12:32.390 ], 00:12:32.390 "core_count": 1 00:12:32.390 } 00:12:32.390 11:23:27 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- target/queue_depth.sh@39 -- # killprocess 68250 00:12:32.390 11:23:27 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- common/autotest_common.sh@950 -- # '[' -z 68250 ']' 00:12:32.390 11:23:27 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- common/autotest_common.sh@954 -- # kill -0 68250 00:12:32.390 11:23:27 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- common/autotest_common.sh@955 -- # uname 00:12:32.390 11:23:27 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- common/autotest_common.sh@955 -- # '[' Linux = Linux ']' 00:12:32.390 11:23:27 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- common/autotest_common.sh@956 -- # ps --no-headers -o comm= 68250 00:12:32.390 killing process with pid 68250 00:12:32.390 Received shutdown signal, test time was about 10.000000 seconds 00:12:32.390 00:12:32.390 Latency(us) 00:12:32.390 [2024-10-07T11:23:27.913Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:12:32.390 [2024-10-07T11:23:27.913Z] =================================================================================================================== 00:12:32.390 [2024-10-07T11:23:27.913Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:12:32.390 11:23:27 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- common/autotest_common.sh@956 -- # process_name=reactor_0 00:12:32.390 11:23:27 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- common/autotest_common.sh@960 -- # '[' reactor_0 = sudo ']' 00:12:32.390 11:23:27 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- common/autotest_common.sh@968 -- # echo 'killing process with pid 68250' 00:12:32.390 11:23:27 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- common/autotest_common.sh@969 -- # kill 68250 00:12:32.390 11:23:27 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- common/autotest_common.sh@974 -- # wait 68250 00:12:32.670 11:23:27 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- target/queue_depth.sh@41 -- # trap - SIGINT SIGTERM EXIT 00:12:32.670 11:23:27 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- target/queue_depth.sh@43 -- # nvmftestfini 00:12:32.670 11:23:27 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@514 -- # nvmfcleanup 00:12:32.670 11:23:27 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@121 -- # sync 00:12:32.670 11:23:27 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@123 -- # '[' tcp == tcp ']' 00:12:32.670 11:23:27 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@124 -- # set +e 00:12:32.670 11:23:27 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@125 -- # for i in {1..20} 00:12:32.670 11:23:27 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@126 -- # modprobe -v -r nvme-tcp 00:12:32.670 rmmod nvme_tcp 00:12:32.670 rmmod nvme_fabrics 00:12:32.670 rmmod nvme_keyring 00:12:32.670 11:23:28 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@127 -- # modprobe -v -r nvme-fabrics 00:12:32.670 11:23:28 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@128 -- # set -e 00:12:32.670 11:23:28 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@129 -- # return 0 00:12:32.670 11:23:28 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@515 -- # '[' -n 68200 ']' 00:12:32.670 11:23:28 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@516 -- # killprocess 68200 00:12:32.670 11:23:28 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- common/autotest_common.sh@950 -- # '[' -z 68200 ']' 00:12:32.670 11:23:28 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- common/autotest_common.sh@954 -- # kill -0 68200 00:12:32.670 11:23:28 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- common/autotest_common.sh@955 -- # uname 00:12:32.670 11:23:28 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- common/autotest_common.sh@955 -- # '[' Linux = Linux ']' 00:12:32.670 11:23:28 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- common/autotest_common.sh@956 -- # ps --no-headers -o comm= 68200 00:12:32.670 11:23:28 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- common/autotest_common.sh@956 -- # process_name=reactor_1 00:12:32.670 killing process with pid 68200 00:12:32.670 11:23:28 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- common/autotest_common.sh@960 -- # '[' reactor_1 = sudo ']' 00:12:32.670 11:23:28 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- common/autotest_common.sh@968 -- # echo 'killing process with pid 68200' 00:12:32.670 11:23:28 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- common/autotest_common.sh@969 -- # kill 68200 00:12:32.670 11:23:28 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- common/autotest_common.sh@974 -- # wait 68200 00:12:32.928 11:23:28 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@518 -- # '[' '' == iso ']' 00:12:32.928 11:23:28 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@521 -- # [[ tcp == \t\c\p ]] 00:12:32.928 11:23:28 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@522 -- # nvmf_tcp_fini 00:12:32.928 11:23:28 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@297 -- # iptr 00:12:32.928 11:23:28 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@789 -- # iptables-save 00:12:32.928 11:23:28 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@789 -- # grep -v SPDK_NVMF 00:12:32.928 11:23:28 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@789 -- # iptables-restore 00:12:32.928 11:23:28 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@298 -- # [[ nvmf_tgt_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s\_\s\p\d\k ]] 00:12:32.928 11:23:28 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@299 -- # nvmf_veth_fini 00:12:32.928 11:23:28 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@233 -- # ip link set nvmf_init_br nomaster 00:12:32.928 11:23:28 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@234 -- # ip link set nvmf_init_br2 nomaster 00:12:32.928 11:23:28 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@235 -- # ip link set nvmf_tgt_br nomaster 00:12:32.928 11:23:28 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@236 -- # ip link set nvmf_tgt_br2 nomaster 00:12:32.928 11:23:28 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@237 -- # ip link set nvmf_init_br down 00:12:32.928 11:23:28 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@238 -- # ip link set nvmf_init_br2 down 00:12:32.928 11:23:28 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@239 -- # ip link set nvmf_tgt_br down 00:12:32.928 11:23:28 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@240 -- # ip link set nvmf_tgt_br2 down 00:12:32.928 11:23:28 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@241 -- # ip link delete nvmf_br type bridge 00:12:33.187 11:23:28 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@242 -- # ip link delete nvmf_init_if 00:12:33.187 11:23:28 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@243 -- # ip link delete nvmf_init_if2 00:12:33.187 11:23:28 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@244 -- # ip netns exec nvmf_tgt_ns_spdk ip link delete nvmf_tgt_if 00:12:33.187 11:23:28 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@245 -- # ip netns exec nvmf_tgt_ns_spdk ip link delete nvmf_tgt_if2 00:12:33.187 11:23:28 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@246 -- # remove_spdk_ns 00:12:33.187 11:23:28 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@654 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:12:33.187 11:23:28 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 15> /dev/null' 00:12:33.187 11:23:28 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:12:33.187 11:23:28 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@300 -- # return 0 00:12:33.187 ************************************ 00:12:33.187 END TEST nvmf_queue_depth 00:12:33.187 ************************************ 00:12:33.187 00:12:33.187 real 0m14.298s 00:12:33.187 user 0m24.477s 00:12:33.187 sys 0m2.148s 00:12:33.187 11:23:28 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- common/autotest_common.sh@1126 -- # xtrace_disable 00:12:33.187 11:23:28 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- common/autotest_common.sh@10 -- # set +x 00:12:33.187 11:23:28 nvmf_tcp.nvmf_target_core -- nvmf/nvmf_target_core.sh@31 -- # run_test nvmf_target_multipath /home/vagrant/spdk_repo/spdk/test/nvmf/target/multipath.sh --transport=tcp 00:12:33.187 11:23:28 nvmf_tcp.nvmf_target_core -- common/autotest_common.sh@1101 -- # '[' 3 -le 1 ']' 00:12:33.187 11:23:28 nvmf_tcp.nvmf_target_core -- common/autotest_common.sh@1107 -- # xtrace_disable 00:12:33.187 11:23:28 nvmf_tcp.nvmf_target_core -- common/autotest_common.sh@10 -- # set +x 00:12:33.187 ************************************ 00:12:33.187 START TEST nvmf_target_multipath 00:12:33.187 ************************************ 00:12:33.187 11:23:28 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- common/autotest_common.sh@1125 -- # /home/vagrant/spdk_repo/spdk/test/nvmf/target/multipath.sh --transport=tcp 00:12:33.446 * Looking for test storage... 00:12:33.446 * Found test storage at /home/vagrant/spdk_repo/spdk/test/nvmf/target 00:12:33.446 11:23:28 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- common/autotest_common.sh@1680 -- # [[ y == y ]] 00:12:33.446 11:23:28 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- common/autotest_common.sh@1681 -- # awk '{print $NF}' 00:12:33.446 11:23:28 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- common/autotest_common.sh@1681 -- # lcov --version 00:12:33.446 11:23:28 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- common/autotest_common.sh@1681 -- # lt 1.15 2 00:12:33.446 11:23:28 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- scripts/common.sh@373 -- # cmp_versions 1.15 '<' 2 00:12:33.446 11:23:28 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- scripts/common.sh@333 -- # local ver1 ver1_l 00:12:33.446 11:23:28 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- scripts/common.sh@334 -- # local ver2 ver2_l 00:12:33.446 11:23:28 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- scripts/common.sh@336 -- # IFS=.-: 00:12:33.446 11:23:28 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- scripts/common.sh@336 -- # read -ra ver1 00:12:33.446 11:23:28 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- scripts/common.sh@337 -- # IFS=.-: 00:12:33.446 11:23:28 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- scripts/common.sh@337 -- # read -ra ver2 00:12:33.446 11:23:28 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- scripts/common.sh@338 -- # local 'op=<' 00:12:33.446 11:23:28 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- scripts/common.sh@340 -- # ver1_l=2 00:12:33.446 11:23:28 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- scripts/common.sh@341 -- # ver2_l=1 00:12:33.446 11:23:28 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- scripts/common.sh@343 -- # local lt=0 gt=0 eq=0 v 00:12:33.446 11:23:28 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- scripts/common.sh@344 -- # case "$op" in 00:12:33.446 11:23:28 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- scripts/common.sh@345 -- # : 1 00:12:33.446 11:23:28 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- scripts/common.sh@364 -- # (( v = 0 )) 00:12:33.446 11:23:28 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- scripts/common.sh@364 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:12:33.446 11:23:28 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- scripts/common.sh@365 -- # decimal 1 00:12:33.447 11:23:28 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- scripts/common.sh@353 -- # local d=1 00:12:33.447 11:23:28 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- scripts/common.sh@354 -- # [[ 1 =~ ^[0-9]+$ ]] 00:12:33.447 11:23:28 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- scripts/common.sh@355 -- # echo 1 00:12:33.447 11:23:28 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- scripts/common.sh@365 -- # ver1[v]=1 00:12:33.447 11:23:28 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- scripts/common.sh@366 -- # decimal 2 00:12:33.447 11:23:28 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- scripts/common.sh@353 -- # local d=2 00:12:33.447 11:23:28 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- scripts/common.sh@354 -- # [[ 2 =~ ^[0-9]+$ ]] 00:12:33.447 11:23:28 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- scripts/common.sh@355 -- # echo 2 00:12:33.447 11:23:28 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- scripts/common.sh@366 -- # ver2[v]=2 00:12:33.447 11:23:28 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- scripts/common.sh@367 -- # (( ver1[v] > ver2[v] )) 00:12:33.447 11:23:28 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- scripts/common.sh@368 -- # (( ver1[v] < ver2[v] )) 00:12:33.447 11:23:28 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- scripts/common.sh@368 -- # return 0 00:12:33.447 11:23:28 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- common/autotest_common.sh@1682 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:12:33.447 11:23:28 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- common/autotest_common.sh@1694 -- # export 'LCOV_OPTS= 00:12:33.447 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:12:33.447 --rc genhtml_branch_coverage=1 00:12:33.447 --rc genhtml_function_coverage=1 00:12:33.447 --rc genhtml_legend=1 00:12:33.447 --rc geninfo_all_blocks=1 00:12:33.447 --rc geninfo_unexecuted_blocks=1 00:12:33.447 00:12:33.447 ' 00:12:33.447 11:23:28 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- common/autotest_common.sh@1694 -- # LCOV_OPTS=' 00:12:33.447 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:12:33.447 --rc genhtml_branch_coverage=1 00:12:33.447 --rc genhtml_function_coverage=1 00:12:33.447 --rc genhtml_legend=1 00:12:33.447 --rc geninfo_all_blocks=1 00:12:33.447 --rc geninfo_unexecuted_blocks=1 00:12:33.447 00:12:33.447 ' 00:12:33.447 11:23:28 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- common/autotest_common.sh@1695 -- # export 'LCOV=lcov 00:12:33.447 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:12:33.447 --rc genhtml_branch_coverage=1 00:12:33.447 --rc genhtml_function_coverage=1 00:12:33.447 --rc genhtml_legend=1 00:12:33.447 --rc geninfo_all_blocks=1 00:12:33.447 --rc geninfo_unexecuted_blocks=1 00:12:33.447 00:12:33.447 ' 00:12:33.447 11:23:28 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- common/autotest_common.sh@1695 -- # LCOV='lcov 00:12:33.447 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:12:33.447 --rc genhtml_branch_coverage=1 00:12:33.447 --rc genhtml_function_coverage=1 00:12:33.447 --rc genhtml_legend=1 00:12:33.447 --rc geninfo_all_blocks=1 00:12:33.447 --rc geninfo_unexecuted_blocks=1 00:12:33.447 00:12:33.447 ' 00:12:33.447 11:23:28 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- target/multipath.sh@9 -- # source /home/vagrant/spdk_repo/spdk/test/nvmf/common.sh 00:12:33.447 11:23:28 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@7 -- # uname -s 00:12:33.447 11:23:28 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:12:33.447 11:23:28 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:12:33.447 11:23:28 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:12:33.447 11:23:28 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:12:33.447 11:23:28 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:12:33.447 11:23:28 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:12:33.447 11:23:28 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:12:33.447 11:23:28 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:12:33.447 11:23:28 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:12:33.447 11:23:28 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:12:33.447 11:23:28 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:c758a4ed-f09f-4c82-9afb-3d096f035464 00:12:33.447 11:23:28 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@18 -- # NVME_HOSTID=c758a4ed-f09f-4c82-9afb-3d096f035464 00:12:33.447 11:23:28 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:12:33.447 11:23:28 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:12:33.447 11:23:28 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@21 -- # NET_TYPE=virt 00:12:33.447 11:23:28 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:12:33.447 11:23:28 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@49 -- # source /home/vagrant/spdk_repo/spdk/scripts/common.sh 00:12:33.447 11:23:28 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- scripts/common.sh@15 -- # shopt -s extglob 00:12:33.447 11:23:28 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- scripts/common.sh@544 -- # [[ -e /bin/wpdk_common.sh ]] 00:12:33.447 11:23:28 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- scripts/common.sh@552 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:12:33.447 11:23:28 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- scripts/common.sh@553 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:12:33.447 11:23:28 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:12:33.447 11:23:28 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:12:33.447 11:23:28 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:12:33.447 11:23:28 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- paths/export.sh@5 -- # export PATH 00:12:33.447 11:23:28 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:12:33.447 11:23:28 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@51 -- # : 0 00:12:33.447 11:23:28 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@52 -- # export NVMF_APP_SHM_ID 00:12:33.447 11:23:28 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@53 -- # build_nvmf_app_args 00:12:33.447 11:23:28 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:12:33.447 11:23:28 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:12:33.447 11:23:28 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:12:33.447 11:23:28 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@33 -- # '[' '' -eq 1 ']' 00:12:33.447 /home/vagrant/spdk_repo/spdk/test/nvmf/common.sh: line 33: [: : integer expression expected 00:12:33.447 11:23:28 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@37 -- # '[' -n '' ']' 00:12:33.447 11:23:28 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@39 -- # '[' 0 -eq 1 ']' 00:12:33.447 11:23:28 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@55 -- # have_pci_nics=0 00:12:33.447 11:23:28 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- target/multipath.sh@11 -- # MALLOC_BDEV_SIZE=64 00:12:33.447 11:23:28 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- target/multipath.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:12:33.447 11:23:28 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- target/multipath.sh@13 -- # nqn=nqn.2016-06.io.spdk:cnode1 00:12:33.447 11:23:28 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- target/multipath.sh@15 -- # rpc_py=/home/vagrant/spdk_repo/spdk/scripts/rpc.py 00:12:33.447 11:23:28 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- target/multipath.sh@43 -- # nvmftestinit 00:12:33.447 11:23:28 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@467 -- # '[' -z tcp ']' 00:12:33.447 11:23:28 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@472 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:12:33.447 11:23:28 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@474 -- # prepare_net_devs 00:12:33.447 11:23:28 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@436 -- # local -g is_hw=no 00:12:33.447 11:23:28 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@438 -- # remove_spdk_ns 00:12:33.447 11:23:28 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@654 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:12:33.447 11:23:28 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 15> /dev/null' 00:12:33.447 11:23:28 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:12:33.447 11:23:28 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@440 -- # [[ virt != virt ]] 00:12:33.447 11:23:28 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@442 -- # [[ no == yes ]] 00:12:33.447 11:23:28 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@449 -- # [[ virt == phy ]] 00:12:33.447 11:23:28 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@452 -- # [[ virt == phy-fallback ]] 00:12:33.447 11:23:28 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@457 -- # [[ tcp == tcp ]] 00:12:33.447 11:23:28 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@458 -- # nvmf_veth_init 00:12:33.447 11:23:28 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@145 -- # NVMF_FIRST_INITIATOR_IP=10.0.0.1 00:12:33.448 11:23:28 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@146 -- # NVMF_SECOND_INITIATOR_IP=10.0.0.2 00:12:33.448 11:23:28 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@147 -- # NVMF_FIRST_TARGET_IP=10.0.0.3 00:12:33.448 11:23:28 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@148 -- # NVMF_SECOND_TARGET_IP=10.0.0.4 00:12:33.448 11:23:28 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@149 -- # NVMF_INITIATOR_IP=10.0.0.1 00:12:33.448 11:23:28 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@150 -- # NVMF_BRIDGE=nvmf_br 00:12:33.448 11:23:28 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@151 -- # NVMF_INITIATOR_INTERFACE=nvmf_init_if 00:12:33.448 11:23:28 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@152 -- # NVMF_INITIATOR_INTERFACE2=nvmf_init_if2 00:12:33.448 11:23:28 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@153 -- # NVMF_INITIATOR_BRIDGE=nvmf_init_br 00:12:33.448 11:23:28 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@154 -- # NVMF_INITIATOR_BRIDGE2=nvmf_init_br2 00:12:33.448 11:23:28 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@155 -- # NVMF_TARGET_NAMESPACE=nvmf_tgt_ns_spdk 00:12:33.448 11:23:28 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@156 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:12:33.448 11:23:28 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@157 -- # NVMF_TARGET_INTERFACE=nvmf_tgt_if 00:12:33.448 11:23:28 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@158 -- # NVMF_TARGET_INTERFACE2=nvmf_tgt_if2 00:12:33.448 11:23:28 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@159 -- # NVMF_TARGET_BRIDGE=nvmf_tgt_br 00:12:33.448 11:23:28 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@160 -- # NVMF_TARGET_BRIDGE2=nvmf_tgt_br2 00:12:33.448 11:23:28 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@162 -- # ip link set nvmf_init_br nomaster 00:12:33.448 Cannot find device "nvmf_init_br" 00:12:33.448 11:23:28 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@162 -- # true 00:12:33.448 11:23:28 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@163 -- # ip link set nvmf_init_br2 nomaster 00:12:33.448 Cannot find device "nvmf_init_br2" 00:12:33.448 11:23:28 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@163 -- # true 00:12:33.448 11:23:28 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@164 -- # ip link set nvmf_tgt_br nomaster 00:12:33.448 Cannot find device "nvmf_tgt_br" 00:12:33.448 11:23:28 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@164 -- # true 00:12:33.448 11:23:28 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@165 -- # ip link set nvmf_tgt_br2 nomaster 00:12:33.448 Cannot find device "nvmf_tgt_br2" 00:12:33.448 11:23:28 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@165 -- # true 00:12:33.448 11:23:28 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@166 -- # ip link set nvmf_init_br down 00:12:33.448 Cannot find device "nvmf_init_br" 00:12:33.448 11:23:28 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@166 -- # true 00:12:33.448 11:23:28 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@167 -- # ip link set nvmf_init_br2 down 00:12:33.448 Cannot find device "nvmf_init_br2" 00:12:33.448 11:23:28 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@167 -- # true 00:12:33.448 11:23:28 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@168 -- # ip link set nvmf_tgt_br down 00:12:33.705 Cannot find device "nvmf_tgt_br" 00:12:33.705 11:23:28 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@168 -- # true 00:12:33.705 11:23:28 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@169 -- # ip link set nvmf_tgt_br2 down 00:12:33.705 Cannot find device "nvmf_tgt_br2" 00:12:33.705 11:23:28 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@169 -- # true 00:12:33.705 11:23:28 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@170 -- # ip link delete nvmf_br type bridge 00:12:33.705 Cannot find device "nvmf_br" 00:12:33.705 11:23:28 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@170 -- # true 00:12:33.705 11:23:28 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@171 -- # ip link delete nvmf_init_if 00:12:33.705 Cannot find device "nvmf_init_if" 00:12:33.705 11:23:29 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@171 -- # true 00:12:33.705 11:23:29 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@172 -- # ip link delete nvmf_init_if2 00:12:33.705 Cannot find device "nvmf_init_if2" 00:12:33.705 11:23:29 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@172 -- # true 00:12:33.705 11:23:29 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@173 -- # ip netns exec nvmf_tgt_ns_spdk ip link delete nvmf_tgt_if 00:12:33.705 Cannot open network namespace "nvmf_tgt_ns_spdk": No such file or directory 00:12:33.705 11:23:29 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@173 -- # true 00:12:33.705 11:23:29 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@174 -- # ip netns exec nvmf_tgt_ns_spdk ip link delete nvmf_tgt_if2 00:12:33.705 Cannot open network namespace "nvmf_tgt_ns_spdk": No such file or directory 00:12:33.705 11:23:29 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@174 -- # true 00:12:33.705 11:23:29 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@177 -- # ip netns add nvmf_tgt_ns_spdk 00:12:33.705 11:23:29 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@180 -- # ip link add nvmf_init_if type veth peer name nvmf_init_br 00:12:33.705 11:23:29 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@181 -- # ip link add nvmf_init_if2 type veth peer name nvmf_init_br2 00:12:33.705 11:23:29 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@182 -- # ip link add nvmf_tgt_if type veth peer name nvmf_tgt_br 00:12:33.705 11:23:29 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@183 -- # ip link add nvmf_tgt_if2 type veth peer name nvmf_tgt_br2 00:12:33.705 11:23:29 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@186 -- # ip link set nvmf_tgt_if netns nvmf_tgt_ns_spdk 00:12:33.705 11:23:29 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@187 -- # ip link set nvmf_tgt_if2 netns nvmf_tgt_ns_spdk 00:12:33.705 11:23:29 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@190 -- # ip addr add 10.0.0.1/24 dev nvmf_init_if 00:12:33.705 11:23:29 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@191 -- # ip addr add 10.0.0.2/24 dev nvmf_init_if2 00:12:33.705 11:23:29 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@192 -- # ip netns exec nvmf_tgt_ns_spdk ip addr add 10.0.0.3/24 dev nvmf_tgt_if 00:12:33.705 11:23:29 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@193 -- # ip netns exec nvmf_tgt_ns_spdk ip addr add 10.0.0.4/24 dev nvmf_tgt_if2 00:12:33.705 11:23:29 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@196 -- # ip link set nvmf_init_if up 00:12:33.705 11:23:29 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@197 -- # ip link set nvmf_init_if2 up 00:12:33.705 11:23:29 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@198 -- # ip link set nvmf_init_br up 00:12:33.706 11:23:29 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@199 -- # ip link set nvmf_init_br2 up 00:12:33.706 11:23:29 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@200 -- # ip link set nvmf_tgt_br up 00:12:33.706 11:23:29 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@201 -- # ip link set nvmf_tgt_br2 up 00:12:33.706 11:23:29 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@202 -- # ip netns exec nvmf_tgt_ns_spdk ip link set nvmf_tgt_if up 00:12:33.706 11:23:29 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@203 -- # ip netns exec nvmf_tgt_ns_spdk ip link set nvmf_tgt_if2 up 00:12:33.706 11:23:29 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@204 -- # ip netns exec nvmf_tgt_ns_spdk ip link set lo up 00:12:33.706 11:23:29 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@207 -- # ip link add nvmf_br type bridge 00:12:33.706 11:23:29 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@208 -- # ip link set nvmf_br up 00:12:33.706 11:23:29 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@211 -- # ip link set nvmf_init_br master nvmf_br 00:12:33.706 11:23:29 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@212 -- # ip link set nvmf_init_br2 master nvmf_br 00:12:33.706 11:23:29 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@213 -- # ip link set nvmf_tgt_br master nvmf_br 00:12:33.706 11:23:29 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@214 -- # ip link set nvmf_tgt_br2 master nvmf_br 00:12:33.964 11:23:29 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@217 -- # ipts -I INPUT 1 -i nvmf_init_if -p tcp --dport 4420 -j ACCEPT 00:12:33.964 11:23:29 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@788 -- # iptables -I INPUT 1 -i nvmf_init_if -p tcp --dport 4420 -j ACCEPT -m comment --comment 'SPDK_NVMF:-I INPUT 1 -i nvmf_init_if -p tcp --dport 4420 -j ACCEPT' 00:12:33.964 11:23:29 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@218 -- # ipts -I INPUT 1 -i nvmf_init_if2 -p tcp --dport 4420 -j ACCEPT 00:12:33.964 11:23:29 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@788 -- # iptables -I INPUT 1 -i nvmf_init_if2 -p tcp --dport 4420 -j ACCEPT -m comment --comment 'SPDK_NVMF:-I INPUT 1 -i nvmf_init_if2 -p tcp --dport 4420 -j ACCEPT' 00:12:33.964 11:23:29 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@219 -- # ipts -A FORWARD -i nvmf_br -o nvmf_br -j ACCEPT 00:12:33.964 11:23:29 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@788 -- # iptables -A FORWARD -i nvmf_br -o nvmf_br -j ACCEPT -m comment --comment 'SPDK_NVMF:-A FORWARD -i nvmf_br -o nvmf_br -j ACCEPT' 00:12:33.964 11:23:29 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@222 -- # ping -c 1 10.0.0.3 00:12:33.964 PING 10.0.0.3 (10.0.0.3) 56(84) bytes of data. 00:12:33.964 64 bytes from 10.0.0.3: icmp_seq=1 ttl=64 time=0.058 ms 00:12:33.964 00:12:33.964 --- 10.0.0.3 ping statistics --- 00:12:33.964 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:12:33.964 rtt min/avg/max/mdev = 0.058/0.058/0.058/0.000 ms 00:12:33.964 11:23:29 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@223 -- # ping -c 1 10.0.0.4 00:12:33.964 PING 10.0.0.4 (10.0.0.4) 56(84) bytes of data. 00:12:33.964 64 bytes from 10.0.0.4: icmp_seq=1 ttl=64 time=0.065 ms 00:12:33.964 00:12:33.964 --- 10.0.0.4 ping statistics --- 00:12:33.964 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:12:33.964 rtt min/avg/max/mdev = 0.065/0.065/0.065/0.000 ms 00:12:33.964 11:23:29 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@224 -- # ip netns exec nvmf_tgt_ns_spdk ping -c 1 10.0.0.1 00:12:33.964 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:12:33.964 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.028 ms 00:12:33.964 00:12:33.964 --- 10.0.0.1 ping statistics --- 00:12:33.964 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:12:33.964 rtt min/avg/max/mdev = 0.028/0.028/0.028/0.000 ms 00:12:33.964 11:23:29 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@225 -- # ip netns exec nvmf_tgt_ns_spdk ping -c 1 10.0.0.2 00:12:33.964 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:12:33.964 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.049 ms 00:12:33.964 00:12:33.964 --- 10.0.0.2 ping statistics --- 00:12:33.964 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:12:33.964 rtt min/avg/max/mdev = 0.049/0.049/0.049/0.000 ms 00:12:33.964 11:23:29 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@227 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:12:33.964 11:23:29 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@459 -- # return 0 00:12:33.964 11:23:29 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@476 -- # '[' '' == iso ']' 00:12:33.964 11:23:29 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@480 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:12:33.964 11:23:29 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@481 -- # [[ tcp == \r\d\m\a ]] 00:12:33.964 11:23:29 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@490 -- # [[ tcp == \t\c\p ]] 00:12:33.964 11:23:29 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@491 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:12:33.964 11:23:29 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@494 -- # '[' tcp == tcp ']' 00:12:33.964 11:23:29 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@500 -- # modprobe nvme-tcp 00:12:33.964 11:23:29 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- target/multipath.sh@45 -- # '[' -z 10.0.0.4 ']' 00:12:33.964 11:23:29 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- target/multipath.sh@51 -- # '[' tcp '!=' tcp ']' 00:12:33.964 11:23:29 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- target/multipath.sh@57 -- # nvmfappstart -m 0xF 00:12:33.964 11:23:29 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@505 -- # timing_enter start_nvmf_tgt 00:12:33.964 11:23:29 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- common/autotest_common.sh@724 -- # xtrace_disable 00:12:33.964 11:23:29 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- common/autotest_common.sh@10 -- # set +x 00:12:33.964 11:23:29 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@507 -- # nvmfpid=68649 00:12:33.964 11:23:29 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@506 -- # ip netns exec nvmf_tgt_ns_spdk /home/vagrant/spdk_repo/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:12:33.964 11:23:29 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@508 -- # waitforlisten 68649 00:12:33.964 11:23:29 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- common/autotest_common.sh@831 -- # '[' -z 68649 ']' 00:12:33.964 11:23:29 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- common/autotest_common.sh@835 -- # local rpc_addr=/var/tmp/spdk.sock 00:12:33.964 11:23:29 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- common/autotest_common.sh@836 -- # local max_retries=100 00:12:33.964 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:12:33.964 11:23:29 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- common/autotest_common.sh@838 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:12:33.964 11:23:29 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- common/autotest_common.sh@840 -- # xtrace_disable 00:12:33.964 11:23:29 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- common/autotest_common.sh@10 -- # set +x 00:12:33.964 [2024-10-07 11:23:29.360849] Starting SPDK v25.01-pre git sha1 2a4f56c54 / DPDK 24.03.0 initialization... 00:12:33.964 [2024-10-07 11:23:29.360947] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --iova-mode=pa --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:12:34.222 [2024-10-07 11:23:29.504251] app.c: 917:spdk_app_start: *NOTICE*: Total cores available: 4 00:12:34.222 [2024-10-07 11:23:29.635600] app.c: 610:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:12:34.222 [2024-10-07 11:23:29.635665] app.c: 611:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:12:34.222 [2024-10-07 11:23:29.635681] app.c: 616:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:12:34.222 [2024-10-07 11:23:29.635692] app.c: 617:app_setup_trace: *NOTICE*: SPDK application currently running. 00:12:34.223 [2024-10-07 11:23:29.635701] app.c: 618:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:12:34.223 [2024-10-07 11:23:29.636991] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 1 00:12:34.223 [2024-10-07 11:23:29.637097] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 2 00:12:34.223 [2024-10-07 11:23:29.637197] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 3 00:12:34.223 [2024-10-07 11:23:29.637199] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 0 00:12:35.166 11:23:30 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- common/autotest_common.sh@860 -- # (( i == 0 )) 00:12:35.166 11:23:30 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- common/autotest_common.sh@864 -- # return 0 00:12:35.166 11:23:30 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@509 -- # timing_exit start_nvmf_tgt 00:12:35.166 11:23:30 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- common/autotest_common.sh@730 -- # xtrace_disable 00:12:35.166 11:23:30 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- common/autotest_common.sh@10 -- # set +x 00:12:35.166 11:23:30 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@510 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:12:35.166 11:23:30 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- target/multipath.sh@59 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_create_transport -t tcp -o -u 8192 00:12:35.431 [2024-10-07 11:23:30.839995] tcp.c: 738:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:12:35.431 11:23:30 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- target/multipath.sh@61 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py bdev_malloc_create 64 512 -b Malloc0 00:12:35.689 Malloc0 00:12:35.689 11:23:31 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- target/multipath.sh@62 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDKISFASTANDAWESOME -r 00:12:36.254 11:23:31 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- target/multipath.sh@63 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:12:36.512 11:23:31 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- target/multipath.sh@64 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.3 -s 4420 00:12:36.769 [2024-10-07 11:23:32.148856] tcp.c:1081:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.3 port 4420 *** 00:12:36.769 11:23:32 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- target/multipath.sh@65 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.4 -s 4420 00:12:37.027 [2024-10-07 11:23:32.417052] tcp.c:1081:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.4 port 4420 *** 00:12:37.027 11:23:32 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- target/multipath.sh@67 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:c758a4ed-f09f-4c82-9afb-3d096f035464 --hostid=c758a4ed-f09f-4c82-9afb-3d096f035464 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.3 -s 4420 -g -G 00:12:37.284 11:23:32 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- target/multipath.sh@68 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:c758a4ed-f09f-4c82-9afb-3d096f035464 --hostid=c758a4ed-f09f-4c82-9afb-3d096f035464 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.4 -s 4420 -g -G 00:12:37.542 11:23:32 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- target/multipath.sh@69 -- # waitforserial SPDKISFASTANDAWESOME 00:12:37.542 11:23:32 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- common/autotest_common.sh@1198 -- # local i=0 00:12:37.542 11:23:32 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- common/autotest_common.sh@1199 -- # local nvme_device_counter=1 nvme_devices=0 00:12:37.542 11:23:32 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- common/autotest_common.sh@1200 -- # [[ -n '' ]] 00:12:37.542 11:23:32 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- common/autotest_common.sh@1205 -- # sleep 2 00:12:39.459 11:23:34 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- common/autotest_common.sh@1206 -- # (( i++ <= 15 )) 00:12:39.459 11:23:34 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- common/autotest_common.sh@1207 -- # lsblk -l -o NAME,SERIAL 00:12:39.459 11:23:34 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- common/autotest_common.sh@1207 -- # grep -c SPDKISFASTANDAWESOME 00:12:39.459 11:23:34 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- common/autotest_common.sh@1207 -- # nvme_devices=1 00:12:39.459 11:23:34 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- common/autotest_common.sh@1208 -- # (( nvme_devices == nvme_device_counter )) 00:12:39.459 11:23:34 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- common/autotest_common.sh@1208 -- # return 0 00:12:39.459 11:23:34 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- target/multipath.sh@72 -- # get_subsystem nqn.2016-06.io.spdk:cnode1 SPDKISFASTANDAWESOME 00:12:39.459 11:23:34 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- target/multipath.sh@34 -- # local nqn=nqn.2016-06.io.spdk:cnode1 serial=SPDKISFASTANDAWESOME s 00:12:39.459 11:23:34 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- target/multipath.sh@36 -- # for s in /sys/class/nvme-subsystem/* 00:12:39.459 11:23:34 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- target/multipath.sh@37 -- # [[ nqn.2016-06.io.spdk:cnode1 == \n\q\n\.\2\0\1\6\-\0\6\.\i\o\.\s\p\d\k\:\c\n\o\d\e\1 ]] 00:12:39.459 11:23:34 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- target/multipath.sh@37 -- # [[ SPDKISFASTANDAWESOME == \S\P\D\K\I\S\F\A\S\T\A\N\D\A\W\E\S\O\M\E ]] 00:12:39.459 11:23:34 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- target/multipath.sh@38 -- # echo nvme-subsys0 00:12:39.459 11:23:34 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- target/multipath.sh@38 -- # return 0 00:12:39.459 11:23:34 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- target/multipath.sh@72 -- # subsystem=nvme-subsys0 00:12:39.459 11:23:34 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- target/multipath.sh@73 -- # paths=(/sys/class/nvme-subsystem/$subsystem/nvme*/nvme*c*) 00:12:39.459 11:23:34 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- target/multipath.sh@74 -- # paths=("${paths[@]##*/}") 00:12:39.459 11:23:34 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- target/multipath.sh@76 -- # (( 2 == 2 )) 00:12:39.459 11:23:34 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- target/multipath.sh@78 -- # p0=nvme0c0n1 00:12:39.459 11:23:34 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- target/multipath.sh@79 -- # p1=nvme0c1n1 00:12:39.459 11:23:34 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- target/multipath.sh@81 -- # check_ana_state nvme0c0n1 optimized 00:12:39.459 11:23:34 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- target/multipath.sh@18 -- # local path=nvme0c0n1 ana_state=optimized 00:12:39.459 11:23:34 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- target/multipath.sh@22 -- # local timeout=20 00:12:39.459 11:23:34 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- target/multipath.sh@23 -- # local ana_state_f=/sys/block/nvme0c0n1/ana_state 00:12:39.459 11:23:34 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- target/multipath.sh@25 -- # [[ ! -e /sys/block/nvme0c0n1/ana_state ]] 00:12:39.459 11:23:34 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- target/multipath.sh@25 -- # [[ optimized != \o\p\t\i\m\i\z\e\d ]] 00:12:39.459 11:23:34 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- target/multipath.sh@82 -- # check_ana_state nvme0c1n1 optimized 00:12:39.459 11:23:34 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- target/multipath.sh@18 -- # local path=nvme0c1n1 ana_state=optimized 00:12:39.459 11:23:34 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- target/multipath.sh@22 -- # local timeout=20 00:12:39.459 11:23:34 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- target/multipath.sh@23 -- # local ana_state_f=/sys/block/nvme0c1n1/ana_state 00:12:39.459 11:23:34 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- target/multipath.sh@25 -- # [[ ! -e /sys/block/nvme0c1n1/ana_state ]] 00:12:39.459 11:23:34 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- target/multipath.sh@25 -- # [[ optimized != \o\p\t\i\m\i\z\e\d ]] 00:12:39.459 11:23:34 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- target/multipath.sh@85 -- # echo numa 00:12:39.459 11:23:34 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- target/multipath.sh@88 -- # fio_pid=68802 00:12:39.459 11:23:34 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- target/multipath.sh@87 -- # /home/vagrant/spdk_repo/spdk/scripts/fio-wrapper -p nvmf -i 4096 -d 128 -t randrw -r 6 -v 00:12:39.459 11:23:34 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- target/multipath.sh@90 -- # sleep 1 00:12:39.459 [global] 00:12:39.459 thread=1 00:12:39.459 invalidate=1 00:12:39.459 rw=randrw 00:12:39.459 time_based=1 00:12:39.459 runtime=6 00:12:39.459 ioengine=libaio 00:12:39.459 direct=1 00:12:39.459 bs=4096 00:12:39.459 iodepth=128 00:12:39.459 norandommap=0 00:12:39.459 numjobs=1 00:12:39.459 00:12:39.459 verify_dump=1 00:12:39.459 verify_backlog=512 00:12:39.459 verify_state_save=0 00:12:39.459 do_verify=1 00:12:39.459 verify=crc32c-intel 00:12:39.459 [job0] 00:12:39.459 filename=/dev/nvme0n1 00:12:39.459 Could not set queue depth (nvme0n1) 00:12:39.717 job0: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=128 00:12:39.717 fio-3.35 00:12:39.717 Starting 1 thread 00:12:40.650 11:23:35 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- target/multipath.sh@92 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_listener_set_ana_state nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.3 -s 4420 -n inaccessible 00:12:40.911 11:23:36 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- target/multipath.sh@93 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_listener_set_ana_state nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.4 -s 4420 -n non_optimized 00:12:41.169 11:23:36 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- target/multipath.sh@95 -- # check_ana_state nvme0c0n1 inaccessible 00:12:41.169 11:23:36 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- target/multipath.sh@18 -- # local path=nvme0c0n1 ana_state=inaccessible 00:12:41.169 11:23:36 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- target/multipath.sh@22 -- # local timeout=20 00:12:41.169 11:23:36 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- target/multipath.sh@23 -- # local ana_state_f=/sys/block/nvme0c0n1/ana_state 00:12:41.169 11:23:36 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- target/multipath.sh@25 -- # [[ ! -e /sys/block/nvme0c0n1/ana_state ]] 00:12:41.169 11:23:36 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- target/multipath.sh@25 -- # [[ inaccessible != \i\n\a\c\c\e\s\s\i\b\l\e ]] 00:12:41.169 11:23:36 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- target/multipath.sh@96 -- # check_ana_state nvme0c1n1 non-optimized 00:12:41.169 11:23:36 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- target/multipath.sh@18 -- # local path=nvme0c1n1 ana_state=non-optimized 00:12:41.169 11:23:36 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- target/multipath.sh@22 -- # local timeout=20 00:12:41.169 11:23:36 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- target/multipath.sh@23 -- # local ana_state_f=/sys/block/nvme0c1n1/ana_state 00:12:41.169 11:23:36 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- target/multipath.sh@25 -- # [[ ! -e /sys/block/nvme0c1n1/ana_state ]] 00:12:41.169 11:23:36 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- target/multipath.sh@25 -- # [[ optimized != \n\o\n\-\o\p\t\i\m\i\z\e\d ]] 00:12:41.169 11:23:36 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- target/multipath.sh@25 -- # sleep 1s 00:12:42.541 11:23:37 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- target/multipath.sh@26 -- # (( timeout-- == 0 )) 00:12:42.541 11:23:37 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- target/multipath.sh@25 -- # [[ ! -e /sys/block/nvme0c1n1/ana_state ]] 00:12:42.541 11:23:37 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- target/multipath.sh@25 -- # [[ non-optimized != \n\o\n\-\o\p\t\i\m\i\z\e\d ]] 00:12:42.541 11:23:37 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- target/multipath.sh@98 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_listener_set_ana_state nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.3 -s 4420 -n non_optimized 00:12:42.541 11:23:37 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- target/multipath.sh@99 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_listener_set_ana_state nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.4 -s 4420 -n inaccessible 00:12:42.798 11:23:38 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- target/multipath.sh@101 -- # check_ana_state nvme0c0n1 non-optimized 00:12:42.798 11:23:38 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- target/multipath.sh@18 -- # local path=nvme0c0n1 ana_state=non-optimized 00:12:42.798 11:23:38 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- target/multipath.sh@22 -- # local timeout=20 00:12:42.798 11:23:38 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- target/multipath.sh@23 -- # local ana_state_f=/sys/block/nvme0c0n1/ana_state 00:12:42.798 11:23:38 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- target/multipath.sh@25 -- # [[ ! -e /sys/block/nvme0c0n1/ana_state ]] 00:12:42.798 11:23:38 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- target/multipath.sh@25 -- # [[ non-optimized != \n\o\n\-\o\p\t\i\m\i\z\e\d ]] 00:12:42.798 11:23:38 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- target/multipath.sh@102 -- # check_ana_state nvme0c1n1 inaccessible 00:12:42.798 11:23:38 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- target/multipath.sh@18 -- # local path=nvme0c1n1 ana_state=inaccessible 00:12:42.798 11:23:38 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- target/multipath.sh@22 -- # local timeout=20 00:12:42.798 11:23:38 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- target/multipath.sh@23 -- # local ana_state_f=/sys/block/nvme0c1n1/ana_state 00:12:42.798 11:23:38 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- target/multipath.sh@25 -- # [[ ! -e /sys/block/nvme0c1n1/ana_state ]] 00:12:42.798 11:23:38 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- target/multipath.sh@25 -- # [[ non-optimized != \i\n\a\c\c\e\s\s\i\b\l\e ]] 00:12:42.798 11:23:38 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- target/multipath.sh@25 -- # sleep 1s 00:12:43.778 11:23:39 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- target/multipath.sh@26 -- # (( timeout-- == 0 )) 00:12:43.778 11:23:39 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- target/multipath.sh@25 -- # [[ ! -e /sys/block/nvme0c1n1/ana_state ]] 00:12:43.778 11:23:39 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- target/multipath.sh@25 -- # [[ inaccessible != \i\n\a\c\c\e\s\s\i\b\l\e ]] 00:12:43.778 11:23:39 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- target/multipath.sh@104 -- # wait 68802 00:12:46.305 00:12:46.305 job0: (groupid=0, jobs=1): err= 0: pid=68828: Mon Oct 7 11:23:41 2024 00:12:46.305 read: IOPS=10.7k, BW=41.8MiB/s (43.8MB/s)(251MiB/6007msec) 00:12:46.305 slat (usec): min=3, max=7120, avg=53.05, stdev=238.33 00:12:46.305 clat (usec): min=800, max=16287, avg=8118.31, stdev=1290.30 00:12:46.305 lat (usec): min=849, max=16297, avg=8171.36, stdev=1299.48 00:12:46.305 clat percentiles (usec): 00:12:46.305 | 1.00th=[ 4817], 5.00th=[ 6259], 10.00th=[ 6915], 20.00th=[ 7308], 00:12:46.305 | 30.00th=[ 7504], 40.00th=[ 7701], 50.00th=[ 7898], 60.00th=[ 8225], 00:12:46.305 | 70.00th=[ 8586], 80.00th=[ 8979], 90.00th=[ 9503], 95.00th=[10552], 00:12:46.305 | 99.00th=[11994], 99.50th=[12518], 99.90th=[13566], 99.95th=[14353], 00:12:46.305 | 99.99th=[15926] 00:12:46.305 bw ( KiB/s): min= 7744, max=28480, per=53.21%, avg=22754.91, stdev=6319.73, samples=11 00:12:46.305 iops : min= 1936, max= 7120, avg=5688.73, stdev=1579.93, samples=11 00:12:46.305 write: IOPS=6382, BW=24.9MiB/s (26.1MB/s)(134MiB/5367msec); 0 zone resets 00:12:46.305 slat (usec): min=11, max=3380, avg=65.29, stdev=164.12 00:12:46.305 clat (usec): min=457, max=15316, avg=7024.86, stdev=1091.19 00:12:46.305 lat (usec): min=572, max=15341, avg=7090.15, stdev=1094.85 00:12:46.305 clat percentiles (usec): 00:12:46.305 | 1.00th=[ 3851], 5.00th=[ 5145], 10.00th=[ 5932], 20.00th=[ 6390], 00:12:46.305 | 30.00th=[ 6652], 40.00th=[ 6849], 50.00th=[ 7046], 60.00th=[ 7242], 00:12:46.305 | 70.00th=[ 7439], 80.00th=[ 7635], 90.00th=[ 8029], 95.00th=[ 8586], 00:12:46.305 | 99.00th=[10290], 99.50th=[11076], 99.90th=[12780], 99.95th=[13435], 00:12:46.305 | 99.99th=[13960] 00:12:46.305 bw ( KiB/s): min= 8248, max=28496, per=89.30%, avg=22799.27, stdev=6169.76, samples=11 00:12:46.305 iops : min= 2062, max= 7124, avg=5699.82, stdev=1542.44, samples=11 00:12:46.305 lat (usec) : 500=0.01%, 750=0.01%, 1000=0.01% 00:12:46.305 lat (msec) : 2=0.03%, 4=0.59%, 10=94.22%, 20=5.16% 00:12:46.305 cpu : usr=5.94%, sys=23.48%, ctx=6408, majf=0, minf=90 00:12:46.305 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.1%, 32=0.2%, >=64=99.7% 00:12:46.305 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:12:46.305 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:12:46.305 issued rwts: total=64213,34257,0,0 short=0,0,0,0 dropped=0,0,0,0 00:12:46.305 latency : target=0, window=0, percentile=100.00%, depth=128 00:12:46.305 00:12:46.305 Run status group 0 (all jobs): 00:12:46.305 READ: bw=41.8MiB/s (43.8MB/s), 41.8MiB/s-41.8MiB/s (43.8MB/s-43.8MB/s), io=251MiB (263MB), run=6007-6007msec 00:12:46.305 WRITE: bw=24.9MiB/s (26.1MB/s), 24.9MiB/s-24.9MiB/s (26.1MB/s-26.1MB/s), io=134MiB (140MB), run=5367-5367msec 00:12:46.305 00:12:46.305 Disk stats (read/write): 00:12:46.305 nvme0n1: ios=63233/33606, merge=0/0, ticks=481524/220327, in_queue=701851, util=98.63% 00:12:46.305 11:23:41 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- target/multipath.sh@106 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_listener_set_ana_state nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.3 -s 4420 -n optimized 00:12:46.305 11:23:41 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- target/multipath.sh@107 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_listener_set_ana_state nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.4 -s 4420 -n optimized 00:12:46.562 11:23:41 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- target/multipath.sh@109 -- # check_ana_state nvme0c0n1 optimized 00:12:46.562 11:23:41 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- target/multipath.sh@18 -- # local path=nvme0c0n1 ana_state=optimized 00:12:46.562 11:23:41 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- target/multipath.sh@22 -- # local timeout=20 00:12:46.562 11:23:41 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- target/multipath.sh@23 -- # local ana_state_f=/sys/block/nvme0c0n1/ana_state 00:12:46.562 11:23:41 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- target/multipath.sh@25 -- # [[ ! -e /sys/block/nvme0c0n1/ana_state ]] 00:12:46.562 11:23:41 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- target/multipath.sh@25 -- # [[ optimized != \o\p\t\i\m\i\z\e\d ]] 00:12:46.562 11:23:41 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- target/multipath.sh@110 -- # check_ana_state nvme0c1n1 optimized 00:12:46.562 11:23:41 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- target/multipath.sh@18 -- # local path=nvme0c1n1 ana_state=optimized 00:12:46.562 11:23:41 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- target/multipath.sh@22 -- # local timeout=20 00:12:46.562 11:23:41 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- target/multipath.sh@23 -- # local ana_state_f=/sys/block/nvme0c1n1/ana_state 00:12:46.562 11:23:41 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- target/multipath.sh@25 -- # [[ ! -e /sys/block/nvme0c1n1/ana_state ]] 00:12:46.562 11:23:41 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- target/multipath.sh@25 -- # [[ inaccessible != \o\p\t\i\m\i\z\e\d ]] 00:12:46.562 11:23:41 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- target/multipath.sh@25 -- # sleep 1s 00:12:47.496 11:23:42 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- target/multipath.sh@26 -- # (( timeout-- == 0 )) 00:12:47.496 11:23:42 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- target/multipath.sh@25 -- # [[ ! -e /sys/block/nvme0c1n1/ana_state ]] 00:12:47.496 11:23:42 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- target/multipath.sh@25 -- # [[ optimized != \o\p\t\i\m\i\z\e\d ]] 00:12:47.496 11:23:42 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- target/multipath.sh@113 -- # echo round-robin 00:12:47.496 11:23:42 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- target/multipath.sh@116 -- # fio_pid=68963 00:12:47.496 11:23:42 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- target/multipath.sh@115 -- # /home/vagrant/spdk_repo/spdk/scripts/fio-wrapper -p nvmf -i 4096 -d 128 -t randrw -r 6 -v 00:12:47.496 11:23:42 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- target/multipath.sh@118 -- # sleep 1 00:12:47.496 [global] 00:12:47.496 thread=1 00:12:47.496 invalidate=1 00:12:47.496 rw=randrw 00:12:47.496 time_based=1 00:12:47.496 runtime=6 00:12:47.496 ioengine=libaio 00:12:47.496 direct=1 00:12:47.496 bs=4096 00:12:47.496 iodepth=128 00:12:47.496 norandommap=0 00:12:47.496 numjobs=1 00:12:47.496 00:12:47.496 verify_dump=1 00:12:47.496 verify_backlog=512 00:12:47.496 verify_state_save=0 00:12:47.496 do_verify=1 00:12:47.496 verify=crc32c-intel 00:12:47.496 [job0] 00:12:47.496 filename=/dev/nvme0n1 00:12:47.496 Could not set queue depth (nvme0n1) 00:12:47.754 job0: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=128 00:12:47.754 fio-3.35 00:12:47.754 Starting 1 thread 00:12:48.685 11:23:43 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- target/multipath.sh@120 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_listener_set_ana_state nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.3 -s 4420 -n inaccessible 00:12:48.685 11:23:44 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- target/multipath.sh@121 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_listener_set_ana_state nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.4 -s 4420 -n non_optimized 00:12:49.249 11:23:44 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- target/multipath.sh@123 -- # check_ana_state nvme0c0n1 inaccessible 00:12:49.249 11:23:44 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- target/multipath.sh@18 -- # local path=nvme0c0n1 ana_state=inaccessible 00:12:49.249 11:23:44 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- target/multipath.sh@22 -- # local timeout=20 00:12:49.249 11:23:44 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- target/multipath.sh@23 -- # local ana_state_f=/sys/block/nvme0c0n1/ana_state 00:12:49.249 11:23:44 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- target/multipath.sh@25 -- # [[ ! -e /sys/block/nvme0c0n1/ana_state ]] 00:12:49.249 11:23:44 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- target/multipath.sh@25 -- # [[ inaccessible != \i\n\a\c\c\e\s\s\i\b\l\e ]] 00:12:49.249 11:23:44 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- target/multipath.sh@124 -- # check_ana_state nvme0c1n1 non-optimized 00:12:49.249 11:23:44 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- target/multipath.sh@18 -- # local path=nvme0c1n1 ana_state=non-optimized 00:12:49.249 11:23:44 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- target/multipath.sh@22 -- # local timeout=20 00:12:49.249 11:23:44 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- target/multipath.sh@23 -- # local ana_state_f=/sys/block/nvme0c1n1/ana_state 00:12:49.249 11:23:44 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- target/multipath.sh@25 -- # [[ ! -e /sys/block/nvme0c1n1/ana_state ]] 00:12:49.249 11:23:44 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- target/multipath.sh@25 -- # [[ optimized != \n\o\n\-\o\p\t\i\m\i\z\e\d ]] 00:12:49.249 11:23:44 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- target/multipath.sh@25 -- # sleep 1s 00:12:50.182 11:23:45 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- target/multipath.sh@26 -- # (( timeout-- == 0 )) 00:12:50.182 11:23:45 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- target/multipath.sh@25 -- # [[ ! -e /sys/block/nvme0c1n1/ana_state ]] 00:12:50.182 11:23:45 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- target/multipath.sh@25 -- # [[ non-optimized != \n\o\n\-\o\p\t\i\m\i\z\e\d ]] 00:12:50.182 11:23:45 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- target/multipath.sh@126 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_listener_set_ana_state nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.3 -s 4420 -n non_optimized 00:12:50.440 11:23:45 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- target/multipath.sh@127 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_listener_set_ana_state nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.4 -s 4420 -n inaccessible 00:12:50.698 11:23:46 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- target/multipath.sh@129 -- # check_ana_state nvme0c0n1 non-optimized 00:12:50.698 11:23:46 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- target/multipath.sh@18 -- # local path=nvme0c0n1 ana_state=non-optimized 00:12:50.698 11:23:46 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- target/multipath.sh@22 -- # local timeout=20 00:12:50.698 11:23:46 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- target/multipath.sh@23 -- # local ana_state_f=/sys/block/nvme0c0n1/ana_state 00:12:50.698 11:23:46 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- target/multipath.sh@25 -- # [[ ! -e /sys/block/nvme0c0n1/ana_state ]] 00:12:50.698 11:23:46 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- target/multipath.sh@25 -- # [[ non-optimized != \n\o\n\-\o\p\t\i\m\i\z\e\d ]] 00:12:50.698 11:23:46 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- target/multipath.sh@130 -- # check_ana_state nvme0c1n1 inaccessible 00:12:50.698 11:23:46 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- target/multipath.sh@18 -- # local path=nvme0c1n1 ana_state=inaccessible 00:12:50.698 11:23:46 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- target/multipath.sh@22 -- # local timeout=20 00:12:50.698 11:23:46 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- target/multipath.sh@23 -- # local ana_state_f=/sys/block/nvme0c1n1/ana_state 00:12:50.698 11:23:46 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- target/multipath.sh@25 -- # [[ ! -e /sys/block/nvme0c1n1/ana_state ]] 00:12:50.698 11:23:46 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- target/multipath.sh@25 -- # [[ non-optimized != \i\n\a\c\c\e\s\s\i\b\l\e ]] 00:12:50.698 11:23:46 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- target/multipath.sh@25 -- # sleep 1s 00:12:51.631 11:23:47 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- target/multipath.sh@26 -- # (( timeout-- == 0 )) 00:12:51.631 11:23:47 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- target/multipath.sh@25 -- # [[ ! -e /sys/block/nvme0c1n1/ana_state ]] 00:12:51.631 11:23:47 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- target/multipath.sh@25 -- # [[ inaccessible != \i\n\a\c\c\e\s\s\i\b\l\e ]] 00:12:51.631 11:23:47 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- target/multipath.sh@132 -- # wait 68963 00:12:54.170 00:12:54.170 job0: (groupid=0, jobs=1): err= 0: pid=68984: Mon Oct 7 11:23:49 2024 00:12:54.170 read: IOPS=11.7k, BW=45.8MiB/s (48.1MB/s)(275MiB/6006msec) 00:12:54.170 slat (usec): min=4, max=6729, avg=43.64, stdev=215.17 00:12:54.170 clat (usec): min=252, max=17167, avg=7555.57, stdev=1743.71 00:12:54.170 lat (usec): min=287, max=17182, avg=7599.22, stdev=1761.92 00:12:54.170 clat percentiles (usec): 00:12:54.170 | 1.00th=[ 3097], 5.00th=[ 4555], 10.00th=[ 5145], 20.00th=[ 6128], 00:12:54.170 | 30.00th=[ 7046], 40.00th=[ 7504], 50.00th=[ 7701], 60.00th=[ 7963], 00:12:54.170 | 70.00th=[ 8356], 80.00th=[ 8848], 90.00th=[ 9503], 95.00th=[10159], 00:12:54.170 | 99.00th=[12125], 99.50th=[12518], 99.90th=[13960], 99.95th=[14353], 00:12:54.170 | 99.99th=[16581] 00:12:54.170 bw ( KiB/s): min=10424, max=41648, per=53.15%, avg=24951.27, stdev=9509.42, samples=11 00:12:54.170 iops : min= 2606, max=10412, avg=6237.82, stdev=2377.35, samples=11 00:12:54.170 write: IOPS=7005, BW=27.4MiB/s (28.7MB/s)(145MiB/5307msec); 0 zone resets 00:12:54.170 slat (usec): min=7, max=2587, avg=54.61, stdev=142.21 00:12:54.170 clat (usec): min=202, max=16972, avg=6175.04, stdev=1757.31 00:12:54.170 lat (usec): min=273, max=16996, avg=6229.66, stdev=1770.56 00:12:54.170 clat percentiles (usec): 00:12:54.170 | 1.00th=[ 1598], 5.00th=[ 3228], 10.00th=[ 3720], 20.00th=[ 4359], 00:12:54.170 | 30.00th=[ 5145], 40.00th=[ 6194], 50.00th=[ 6652], 60.00th=[ 6980], 00:12:54.170 | 70.00th=[ 7242], 80.00th=[ 7504], 90.00th=[ 7963], 95.00th=[ 8356], 00:12:54.170 | 99.00th=[10159], 99.50th=[10683], 99.90th=[12911], 99.95th=[15270], 00:12:54.170 | 99.99th=[16909] 00:12:54.171 bw ( KiB/s): min=10960, max=40632, per=89.04%, avg=24948.36, stdev=9151.57, samples=11 00:12:54.171 iops : min= 2740, max=10158, avg=6237.09, stdev=2287.89, samples=11 00:12:54.171 lat (usec) : 250=0.01%, 500=0.02%, 750=0.07%, 1000=0.14% 00:12:54.171 lat (msec) : 2=0.52%, 4=5.74%, 10=89.44%, 20=4.07% 00:12:54.171 cpu : usr=6.11%, sys=24.06%, ctx=7212, majf=0, minf=102 00:12:54.171 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.1%, 32=0.1%, >=64=99.7% 00:12:54.171 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:12:54.171 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:12:54.171 issued rwts: total=70492,37176,0,0 short=0,0,0,0 dropped=0,0,0,0 00:12:54.171 latency : target=0, window=0, percentile=100.00%, depth=128 00:12:54.171 00:12:54.171 Run status group 0 (all jobs): 00:12:54.171 READ: bw=45.8MiB/s (48.1MB/s), 45.8MiB/s-45.8MiB/s (48.1MB/s-48.1MB/s), io=275MiB (289MB), run=6006-6006msec 00:12:54.171 WRITE: bw=27.4MiB/s (28.7MB/s), 27.4MiB/s-27.4MiB/s (28.7MB/s-28.7MB/s), io=145MiB (152MB), run=5307-5307msec 00:12:54.171 00:12:54.171 Disk stats (read/write): 00:12:54.171 nvme0n1: ios=69646/36575, merge=0/0, ticks=489238/207013, in_queue=696251, util=98.68% 00:12:54.171 11:23:49 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- target/multipath.sh@134 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:12:54.171 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 2 controller(s) 00:12:54.171 11:23:49 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- target/multipath.sh@135 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:12:54.171 11:23:49 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- common/autotest_common.sh@1219 -- # local i=0 00:12:54.171 11:23:49 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- common/autotest_common.sh@1220 -- # lsblk -o NAME,SERIAL 00:12:54.171 11:23:49 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- common/autotest_common.sh@1220 -- # grep -q -w SPDKISFASTANDAWESOME 00:12:54.171 11:23:49 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- common/autotest_common.sh@1227 -- # lsblk -l -o NAME,SERIAL 00:12:54.171 11:23:49 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- common/autotest_common.sh@1227 -- # grep -q -w SPDKISFASTANDAWESOME 00:12:54.171 11:23:49 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- common/autotest_common.sh@1231 -- # return 0 00:12:54.171 11:23:49 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- target/multipath.sh@137 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:12:54.171 11:23:49 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- target/multipath.sh@139 -- # rm -f ./local-job0-0-verify.state 00:12:54.171 11:23:49 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- target/multipath.sh@140 -- # rm -f ./local-job1-1-verify.state 00:12:54.171 11:23:49 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- target/multipath.sh@142 -- # trap - SIGINT SIGTERM EXIT 00:12:54.171 11:23:49 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- target/multipath.sh@144 -- # nvmftestfini 00:12:54.171 11:23:49 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@514 -- # nvmfcleanup 00:12:54.171 11:23:49 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@121 -- # sync 00:12:54.429 11:23:49 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@123 -- # '[' tcp == tcp ']' 00:12:54.429 11:23:49 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@124 -- # set +e 00:12:54.429 11:23:49 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@125 -- # for i in {1..20} 00:12:54.429 11:23:49 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@126 -- # modprobe -v -r nvme-tcp 00:12:54.429 rmmod nvme_tcp 00:12:54.429 rmmod nvme_fabrics 00:12:54.429 rmmod nvme_keyring 00:12:54.429 11:23:49 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@127 -- # modprobe -v -r nvme-fabrics 00:12:54.429 11:23:49 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@128 -- # set -e 00:12:54.429 11:23:49 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@129 -- # return 0 00:12:54.429 11:23:49 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@515 -- # '[' -n 68649 ']' 00:12:54.429 11:23:49 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@516 -- # killprocess 68649 00:12:54.429 11:23:49 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- common/autotest_common.sh@950 -- # '[' -z 68649 ']' 00:12:54.429 11:23:49 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- common/autotest_common.sh@954 -- # kill -0 68649 00:12:54.429 11:23:49 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- common/autotest_common.sh@955 -- # uname 00:12:54.429 11:23:49 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- common/autotest_common.sh@955 -- # '[' Linux = Linux ']' 00:12:54.429 11:23:49 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- common/autotest_common.sh@956 -- # ps --no-headers -o comm= 68649 00:12:54.429 killing process with pid 68649 00:12:54.429 11:23:49 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- common/autotest_common.sh@956 -- # process_name=reactor_0 00:12:54.429 11:23:49 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- common/autotest_common.sh@960 -- # '[' reactor_0 = sudo ']' 00:12:54.429 11:23:49 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- common/autotest_common.sh@968 -- # echo 'killing process with pid 68649' 00:12:54.429 11:23:49 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- common/autotest_common.sh@969 -- # kill 68649 00:12:54.429 11:23:49 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- common/autotest_common.sh@974 -- # wait 68649 00:12:54.686 11:23:50 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@518 -- # '[' '' == iso ']' 00:12:54.686 11:23:50 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@521 -- # [[ tcp == \t\c\p ]] 00:12:54.686 11:23:50 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@522 -- # nvmf_tcp_fini 00:12:54.686 11:23:50 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@297 -- # iptr 00:12:54.686 11:23:50 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@789 -- # iptables-save 00:12:54.686 11:23:50 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@789 -- # grep -v SPDK_NVMF 00:12:54.686 11:23:50 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@789 -- # iptables-restore 00:12:54.686 11:23:50 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@298 -- # [[ nvmf_tgt_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s\_\s\p\d\k ]] 00:12:54.686 11:23:50 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@299 -- # nvmf_veth_fini 00:12:54.686 11:23:50 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@233 -- # ip link set nvmf_init_br nomaster 00:12:54.686 11:23:50 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@234 -- # ip link set nvmf_init_br2 nomaster 00:12:54.686 11:23:50 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@235 -- # ip link set nvmf_tgt_br nomaster 00:12:54.686 11:23:50 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@236 -- # ip link set nvmf_tgt_br2 nomaster 00:12:54.686 11:23:50 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@237 -- # ip link set nvmf_init_br down 00:12:54.686 11:23:50 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@238 -- # ip link set nvmf_init_br2 down 00:12:54.686 11:23:50 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@239 -- # ip link set nvmf_tgt_br down 00:12:54.686 11:23:50 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@240 -- # ip link set nvmf_tgt_br2 down 00:12:54.686 11:23:50 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@241 -- # ip link delete nvmf_br type bridge 00:12:54.686 11:23:50 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@242 -- # ip link delete nvmf_init_if 00:12:54.950 11:23:50 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@243 -- # ip link delete nvmf_init_if2 00:12:54.950 11:23:50 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@244 -- # ip netns exec nvmf_tgt_ns_spdk ip link delete nvmf_tgt_if 00:12:54.950 11:23:50 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@245 -- # ip netns exec nvmf_tgt_ns_spdk ip link delete nvmf_tgt_if2 00:12:54.950 11:23:50 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@246 -- # remove_spdk_ns 00:12:54.951 11:23:50 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@654 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:12:54.951 11:23:50 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 15> /dev/null' 00:12:54.951 11:23:50 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:12:54.951 11:23:50 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@300 -- # return 0 00:12:54.951 00:12:54.951 real 0m21.666s 00:12:54.951 user 1m24.454s 00:12:54.951 sys 0m6.758s 00:12:54.951 11:23:50 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- common/autotest_common.sh@1126 -- # xtrace_disable 00:12:54.951 11:23:50 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- common/autotest_common.sh@10 -- # set +x 00:12:54.951 ************************************ 00:12:54.951 END TEST nvmf_target_multipath 00:12:54.951 ************************************ 00:12:54.951 11:23:50 nvmf_tcp.nvmf_target_core -- nvmf/nvmf_target_core.sh@32 -- # run_test nvmf_zcopy /home/vagrant/spdk_repo/spdk/test/nvmf/target/zcopy.sh --transport=tcp 00:12:54.951 11:23:50 nvmf_tcp.nvmf_target_core -- common/autotest_common.sh@1101 -- # '[' 3 -le 1 ']' 00:12:54.951 11:23:50 nvmf_tcp.nvmf_target_core -- common/autotest_common.sh@1107 -- # xtrace_disable 00:12:54.951 11:23:50 nvmf_tcp.nvmf_target_core -- common/autotest_common.sh@10 -- # set +x 00:12:54.951 ************************************ 00:12:54.951 START TEST nvmf_zcopy 00:12:54.951 ************************************ 00:12:54.951 11:23:50 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- common/autotest_common.sh@1125 -- # /home/vagrant/spdk_repo/spdk/test/nvmf/target/zcopy.sh --transport=tcp 00:12:54.951 * Looking for test storage... 00:12:54.951 * Found test storage at /home/vagrant/spdk_repo/spdk/test/nvmf/target 00:12:54.951 11:23:50 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- common/autotest_common.sh@1680 -- # [[ y == y ]] 00:12:54.951 11:23:50 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- common/autotest_common.sh@1681 -- # lcov --version 00:12:54.951 11:23:50 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- common/autotest_common.sh@1681 -- # awk '{print $NF}' 00:12:55.209 11:23:50 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- common/autotest_common.sh@1681 -- # lt 1.15 2 00:12:55.209 11:23:50 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- scripts/common.sh@373 -- # cmp_versions 1.15 '<' 2 00:12:55.209 11:23:50 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- scripts/common.sh@333 -- # local ver1 ver1_l 00:12:55.209 11:23:50 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- scripts/common.sh@334 -- # local ver2 ver2_l 00:12:55.209 11:23:50 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- scripts/common.sh@336 -- # IFS=.-: 00:12:55.209 11:23:50 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- scripts/common.sh@336 -- # read -ra ver1 00:12:55.209 11:23:50 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- scripts/common.sh@337 -- # IFS=.-: 00:12:55.209 11:23:50 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- scripts/common.sh@337 -- # read -ra ver2 00:12:55.209 11:23:50 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- scripts/common.sh@338 -- # local 'op=<' 00:12:55.209 11:23:50 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- scripts/common.sh@340 -- # ver1_l=2 00:12:55.209 11:23:50 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- scripts/common.sh@341 -- # ver2_l=1 00:12:55.209 11:23:50 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- scripts/common.sh@343 -- # local lt=0 gt=0 eq=0 v 00:12:55.209 11:23:50 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- scripts/common.sh@344 -- # case "$op" in 00:12:55.209 11:23:50 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- scripts/common.sh@345 -- # : 1 00:12:55.209 11:23:50 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- scripts/common.sh@364 -- # (( v = 0 )) 00:12:55.209 11:23:50 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- scripts/common.sh@364 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:12:55.209 11:23:50 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- scripts/common.sh@365 -- # decimal 1 00:12:55.209 11:23:50 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- scripts/common.sh@353 -- # local d=1 00:12:55.209 11:23:50 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- scripts/common.sh@354 -- # [[ 1 =~ ^[0-9]+$ ]] 00:12:55.209 11:23:50 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- scripts/common.sh@355 -- # echo 1 00:12:55.209 11:23:50 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- scripts/common.sh@365 -- # ver1[v]=1 00:12:55.209 11:23:50 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- scripts/common.sh@366 -- # decimal 2 00:12:55.209 11:23:50 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- scripts/common.sh@353 -- # local d=2 00:12:55.209 11:23:50 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- scripts/common.sh@354 -- # [[ 2 =~ ^[0-9]+$ ]] 00:12:55.209 11:23:50 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- scripts/common.sh@355 -- # echo 2 00:12:55.209 11:23:50 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- scripts/common.sh@366 -- # ver2[v]=2 00:12:55.209 11:23:50 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- scripts/common.sh@367 -- # (( ver1[v] > ver2[v] )) 00:12:55.209 11:23:50 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- scripts/common.sh@368 -- # (( ver1[v] < ver2[v] )) 00:12:55.209 11:23:50 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- scripts/common.sh@368 -- # return 0 00:12:55.209 11:23:50 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- common/autotest_common.sh@1682 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:12:55.209 11:23:50 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- common/autotest_common.sh@1694 -- # export 'LCOV_OPTS= 00:12:55.209 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:12:55.209 --rc genhtml_branch_coverage=1 00:12:55.209 --rc genhtml_function_coverage=1 00:12:55.209 --rc genhtml_legend=1 00:12:55.209 --rc geninfo_all_blocks=1 00:12:55.209 --rc geninfo_unexecuted_blocks=1 00:12:55.209 00:12:55.209 ' 00:12:55.209 11:23:50 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- common/autotest_common.sh@1694 -- # LCOV_OPTS=' 00:12:55.209 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:12:55.209 --rc genhtml_branch_coverage=1 00:12:55.209 --rc genhtml_function_coverage=1 00:12:55.209 --rc genhtml_legend=1 00:12:55.209 --rc geninfo_all_blocks=1 00:12:55.209 --rc geninfo_unexecuted_blocks=1 00:12:55.209 00:12:55.209 ' 00:12:55.209 11:23:50 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- common/autotest_common.sh@1695 -- # export 'LCOV=lcov 00:12:55.209 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:12:55.209 --rc genhtml_branch_coverage=1 00:12:55.209 --rc genhtml_function_coverage=1 00:12:55.209 --rc genhtml_legend=1 00:12:55.209 --rc geninfo_all_blocks=1 00:12:55.209 --rc geninfo_unexecuted_blocks=1 00:12:55.209 00:12:55.209 ' 00:12:55.209 11:23:50 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- common/autotest_common.sh@1695 -- # LCOV='lcov 00:12:55.209 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:12:55.209 --rc genhtml_branch_coverage=1 00:12:55.209 --rc genhtml_function_coverage=1 00:12:55.209 --rc genhtml_legend=1 00:12:55.209 --rc geninfo_all_blocks=1 00:12:55.209 --rc geninfo_unexecuted_blocks=1 00:12:55.209 00:12:55.209 ' 00:12:55.209 11:23:50 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- target/zcopy.sh@10 -- # source /home/vagrant/spdk_repo/spdk/test/nvmf/common.sh 00:12:55.209 11:23:50 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@7 -- # uname -s 00:12:55.209 11:23:50 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:12:55.209 11:23:50 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:12:55.209 11:23:50 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:12:55.209 11:23:50 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:12:55.210 11:23:50 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:12:55.210 11:23:50 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:12:55.210 11:23:50 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:12:55.210 11:23:50 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:12:55.210 11:23:50 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:12:55.210 11:23:50 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:12:55.210 11:23:50 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:c758a4ed-f09f-4c82-9afb-3d096f035464 00:12:55.210 11:23:50 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@18 -- # NVME_HOSTID=c758a4ed-f09f-4c82-9afb-3d096f035464 00:12:55.210 11:23:50 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:12:55.210 11:23:50 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:12:55.210 11:23:50 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@21 -- # NET_TYPE=virt 00:12:55.210 11:23:50 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:12:55.210 11:23:50 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@49 -- # source /home/vagrant/spdk_repo/spdk/scripts/common.sh 00:12:55.210 11:23:50 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- scripts/common.sh@15 -- # shopt -s extglob 00:12:55.210 11:23:50 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- scripts/common.sh@544 -- # [[ -e /bin/wpdk_common.sh ]] 00:12:55.210 11:23:50 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- scripts/common.sh@552 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:12:55.210 11:23:50 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- scripts/common.sh@553 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:12:55.210 11:23:50 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:12:55.210 11:23:50 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:12:55.210 11:23:50 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:12:55.210 11:23:50 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- paths/export.sh@5 -- # export PATH 00:12:55.210 11:23:50 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:12:55.210 11:23:50 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@51 -- # : 0 00:12:55.210 11:23:50 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@52 -- # export NVMF_APP_SHM_ID 00:12:55.210 11:23:50 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@53 -- # build_nvmf_app_args 00:12:55.210 11:23:50 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:12:55.210 11:23:50 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:12:55.210 11:23:50 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:12:55.210 11:23:50 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@33 -- # '[' '' -eq 1 ']' 00:12:55.210 /home/vagrant/spdk_repo/spdk/test/nvmf/common.sh: line 33: [: : integer expression expected 00:12:55.210 11:23:50 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@37 -- # '[' -n '' ']' 00:12:55.210 11:23:50 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@39 -- # '[' 0 -eq 1 ']' 00:12:55.210 11:23:50 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@55 -- # have_pci_nics=0 00:12:55.210 11:23:50 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- target/zcopy.sh@12 -- # nvmftestinit 00:12:55.210 11:23:50 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@467 -- # '[' -z tcp ']' 00:12:55.210 11:23:50 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@472 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:12:55.210 11:23:50 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@474 -- # prepare_net_devs 00:12:55.210 11:23:50 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@436 -- # local -g is_hw=no 00:12:55.210 11:23:50 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@438 -- # remove_spdk_ns 00:12:55.210 11:23:50 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@654 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:12:55.210 11:23:50 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 15> /dev/null' 00:12:55.210 11:23:50 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:12:55.210 11:23:50 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@440 -- # [[ virt != virt ]] 00:12:55.210 11:23:50 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@442 -- # [[ no == yes ]] 00:12:55.210 11:23:50 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@449 -- # [[ virt == phy ]] 00:12:55.210 11:23:50 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@452 -- # [[ virt == phy-fallback ]] 00:12:55.210 11:23:50 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@457 -- # [[ tcp == tcp ]] 00:12:55.210 11:23:50 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@458 -- # nvmf_veth_init 00:12:55.210 11:23:50 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@145 -- # NVMF_FIRST_INITIATOR_IP=10.0.0.1 00:12:55.210 11:23:50 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@146 -- # NVMF_SECOND_INITIATOR_IP=10.0.0.2 00:12:55.210 11:23:50 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@147 -- # NVMF_FIRST_TARGET_IP=10.0.0.3 00:12:55.210 11:23:50 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@148 -- # NVMF_SECOND_TARGET_IP=10.0.0.4 00:12:55.210 11:23:50 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@149 -- # NVMF_INITIATOR_IP=10.0.0.1 00:12:55.210 11:23:50 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@150 -- # NVMF_BRIDGE=nvmf_br 00:12:55.210 11:23:50 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@151 -- # NVMF_INITIATOR_INTERFACE=nvmf_init_if 00:12:55.210 11:23:50 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@152 -- # NVMF_INITIATOR_INTERFACE2=nvmf_init_if2 00:12:55.210 11:23:50 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@153 -- # NVMF_INITIATOR_BRIDGE=nvmf_init_br 00:12:55.210 11:23:50 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@154 -- # NVMF_INITIATOR_BRIDGE2=nvmf_init_br2 00:12:55.210 11:23:50 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@155 -- # NVMF_TARGET_NAMESPACE=nvmf_tgt_ns_spdk 00:12:55.210 11:23:50 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@156 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:12:55.210 11:23:50 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@157 -- # NVMF_TARGET_INTERFACE=nvmf_tgt_if 00:12:55.210 11:23:50 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@158 -- # NVMF_TARGET_INTERFACE2=nvmf_tgt_if2 00:12:55.210 11:23:50 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@159 -- # NVMF_TARGET_BRIDGE=nvmf_tgt_br 00:12:55.210 11:23:50 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@160 -- # NVMF_TARGET_BRIDGE2=nvmf_tgt_br2 00:12:55.210 11:23:50 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@162 -- # ip link set nvmf_init_br nomaster 00:12:55.210 Cannot find device "nvmf_init_br" 00:12:55.210 11:23:50 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@162 -- # true 00:12:55.210 11:23:50 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@163 -- # ip link set nvmf_init_br2 nomaster 00:12:55.210 Cannot find device "nvmf_init_br2" 00:12:55.210 11:23:50 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@163 -- # true 00:12:55.210 11:23:50 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@164 -- # ip link set nvmf_tgt_br nomaster 00:12:55.210 Cannot find device "nvmf_tgt_br" 00:12:55.210 11:23:50 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@164 -- # true 00:12:55.210 11:23:50 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@165 -- # ip link set nvmf_tgt_br2 nomaster 00:12:55.210 Cannot find device "nvmf_tgt_br2" 00:12:55.210 11:23:50 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@165 -- # true 00:12:55.210 11:23:50 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@166 -- # ip link set nvmf_init_br down 00:12:55.210 Cannot find device "nvmf_init_br" 00:12:55.210 11:23:50 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@166 -- # true 00:12:55.210 11:23:50 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@167 -- # ip link set nvmf_init_br2 down 00:12:55.210 Cannot find device "nvmf_init_br2" 00:12:55.210 11:23:50 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@167 -- # true 00:12:55.210 11:23:50 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@168 -- # ip link set nvmf_tgt_br down 00:12:55.210 Cannot find device "nvmf_tgt_br" 00:12:55.210 11:23:50 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@168 -- # true 00:12:55.210 11:23:50 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@169 -- # ip link set nvmf_tgt_br2 down 00:12:55.210 Cannot find device "nvmf_tgt_br2" 00:12:55.210 11:23:50 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@169 -- # true 00:12:55.210 11:23:50 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@170 -- # ip link delete nvmf_br type bridge 00:12:55.210 Cannot find device "nvmf_br" 00:12:55.210 11:23:50 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@170 -- # true 00:12:55.210 11:23:50 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@171 -- # ip link delete nvmf_init_if 00:12:55.210 Cannot find device "nvmf_init_if" 00:12:55.210 11:23:50 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@171 -- # true 00:12:55.210 11:23:50 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@172 -- # ip link delete nvmf_init_if2 00:12:55.468 Cannot find device "nvmf_init_if2" 00:12:55.468 11:23:50 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@172 -- # true 00:12:55.468 11:23:50 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@173 -- # ip netns exec nvmf_tgt_ns_spdk ip link delete nvmf_tgt_if 00:12:55.468 Cannot open network namespace "nvmf_tgt_ns_spdk": No such file or directory 00:12:55.468 11:23:50 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@173 -- # true 00:12:55.468 11:23:50 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@174 -- # ip netns exec nvmf_tgt_ns_spdk ip link delete nvmf_tgt_if2 00:12:55.468 Cannot open network namespace "nvmf_tgt_ns_spdk": No such file or directory 00:12:55.468 11:23:50 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@174 -- # true 00:12:55.468 11:23:50 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@177 -- # ip netns add nvmf_tgt_ns_spdk 00:12:55.468 11:23:50 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@180 -- # ip link add nvmf_init_if type veth peer name nvmf_init_br 00:12:55.468 11:23:50 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@181 -- # ip link add nvmf_init_if2 type veth peer name nvmf_init_br2 00:12:55.468 11:23:50 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@182 -- # ip link add nvmf_tgt_if type veth peer name nvmf_tgt_br 00:12:55.468 11:23:50 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@183 -- # ip link add nvmf_tgt_if2 type veth peer name nvmf_tgt_br2 00:12:55.468 11:23:50 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@186 -- # ip link set nvmf_tgt_if netns nvmf_tgt_ns_spdk 00:12:55.468 11:23:50 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@187 -- # ip link set nvmf_tgt_if2 netns nvmf_tgt_ns_spdk 00:12:55.468 11:23:50 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@190 -- # ip addr add 10.0.0.1/24 dev nvmf_init_if 00:12:55.468 11:23:50 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@191 -- # ip addr add 10.0.0.2/24 dev nvmf_init_if2 00:12:55.469 11:23:50 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@192 -- # ip netns exec nvmf_tgt_ns_spdk ip addr add 10.0.0.3/24 dev nvmf_tgt_if 00:12:55.469 11:23:50 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@193 -- # ip netns exec nvmf_tgt_ns_spdk ip addr add 10.0.0.4/24 dev nvmf_tgt_if2 00:12:55.469 11:23:50 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@196 -- # ip link set nvmf_init_if up 00:12:55.469 11:23:50 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@197 -- # ip link set nvmf_init_if2 up 00:12:55.469 11:23:50 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@198 -- # ip link set nvmf_init_br up 00:12:55.469 11:23:50 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@199 -- # ip link set nvmf_init_br2 up 00:12:55.469 11:23:50 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@200 -- # ip link set nvmf_tgt_br up 00:12:55.469 11:23:50 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@201 -- # ip link set nvmf_tgt_br2 up 00:12:55.469 11:23:50 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@202 -- # ip netns exec nvmf_tgt_ns_spdk ip link set nvmf_tgt_if up 00:12:55.469 11:23:50 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@203 -- # ip netns exec nvmf_tgt_ns_spdk ip link set nvmf_tgt_if2 up 00:12:55.469 11:23:50 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@204 -- # ip netns exec nvmf_tgt_ns_spdk ip link set lo up 00:12:55.469 11:23:50 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@207 -- # ip link add nvmf_br type bridge 00:12:55.469 11:23:50 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@208 -- # ip link set nvmf_br up 00:12:55.469 11:23:50 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@211 -- # ip link set nvmf_init_br master nvmf_br 00:12:55.469 11:23:50 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@212 -- # ip link set nvmf_init_br2 master nvmf_br 00:12:55.469 11:23:50 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@213 -- # ip link set nvmf_tgt_br master nvmf_br 00:12:55.469 11:23:50 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@214 -- # ip link set nvmf_tgt_br2 master nvmf_br 00:12:55.469 11:23:50 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@217 -- # ipts -I INPUT 1 -i nvmf_init_if -p tcp --dport 4420 -j ACCEPT 00:12:55.469 11:23:50 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@788 -- # iptables -I INPUT 1 -i nvmf_init_if -p tcp --dport 4420 -j ACCEPT -m comment --comment 'SPDK_NVMF:-I INPUT 1 -i nvmf_init_if -p tcp --dport 4420 -j ACCEPT' 00:12:55.469 11:23:50 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@218 -- # ipts -I INPUT 1 -i nvmf_init_if2 -p tcp --dport 4420 -j ACCEPT 00:12:55.469 11:23:50 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@788 -- # iptables -I INPUT 1 -i nvmf_init_if2 -p tcp --dport 4420 -j ACCEPT -m comment --comment 'SPDK_NVMF:-I INPUT 1 -i nvmf_init_if2 -p tcp --dport 4420 -j ACCEPT' 00:12:55.469 11:23:50 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@219 -- # ipts -A FORWARD -i nvmf_br -o nvmf_br -j ACCEPT 00:12:55.469 11:23:50 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@788 -- # iptables -A FORWARD -i nvmf_br -o nvmf_br -j ACCEPT -m comment --comment 'SPDK_NVMF:-A FORWARD -i nvmf_br -o nvmf_br -j ACCEPT' 00:12:55.469 11:23:50 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@222 -- # ping -c 1 10.0.0.3 00:12:55.727 PING 10.0.0.3 (10.0.0.3) 56(84) bytes of data. 00:12:55.727 64 bytes from 10.0.0.3: icmp_seq=1 ttl=64 time=0.088 ms 00:12:55.727 00:12:55.727 --- 10.0.0.3 ping statistics --- 00:12:55.727 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:12:55.727 rtt min/avg/max/mdev = 0.088/0.088/0.088/0.000 ms 00:12:55.727 11:23:50 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@223 -- # ping -c 1 10.0.0.4 00:12:55.727 PING 10.0.0.4 (10.0.0.4) 56(84) bytes of data. 00:12:55.727 64 bytes from 10.0.0.4: icmp_seq=1 ttl=64 time=0.047 ms 00:12:55.727 00:12:55.727 --- 10.0.0.4 ping statistics --- 00:12:55.727 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:12:55.727 rtt min/avg/max/mdev = 0.047/0.047/0.047/0.000 ms 00:12:55.727 11:23:50 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@224 -- # ip netns exec nvmf_tgt_ns_spdk ping -c 1 10.0.0.1 00:12:55.727 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:12:55.727 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.028 ms 00:12:55.727 00:12:55.727 --- 10.0.0.1 ping statistics --- 00:12:55.727 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:12:55.727 rtt min/avg/max/mdev = 0.028/0.028/0.028/0.000 ms 00:12:55.727 11:23:51 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@225 -- # ip netns exec nvmf_tgt_ns_spdk ping -c 1 10.0.0.2 00:12:55.727 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:12:55.727 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.055 ms 00:12:55.727 00:12:55.727 --- 10.0.0.2 ping statistics --- 00:12:55.727 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:12:55.727 rtt min/avg/max/mdev = 0.055/0.055/0.055/0.000 ms 00:12:55.727 11:23:51 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@227 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:12:55.727 11:23:51 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@459 -- # return 0 00:12:55.727 11:23:51 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@476 -- # '[' '' == iso ']' 00:12:55.727 11:23:51 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@480 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:12:55.727 11:23:51 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@481 -- # [[ tcp == \r\d\m\a ]] 00:12:55.727 11:23:51 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@490 -- # [[ tcp == \t\c\p ]] 00:12:55.727 11:23:51 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@491 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:12:55.727 11:23:51 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@494 -- # '[' tcp == tcp ']' 00:12:55.727 11:23:51 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@500 -- # modprobe nvme-tcp 00:12:55.727 11:23:51 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- target/zcopy.sh@13 -- # nvmfappstart -m 0x2 00:12:55.727 11:23:51 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@505 -- # timing_enter start_nvmf_tgt 00:12:55.727 11:23:51 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- common/autotest_common.sh@724 -- # xtrace_disable 00:12:55.727 11:23:51 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- common/autotest_common.sh@10 -- # set +x 00:12:55.727 11:23:51 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@507 -- # nvmfpid=69339 00:12:55.727 11:23:51 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@508 -- # waitforlisten 69339 00:12:55.727 11:23:51 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@506 -- # ip netns exec nvmf_tgt_ns_spdk /home/vagrant/spdk_repo/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x2 00:12:55.727 11:23:51 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- common/autotest_common.sh@831 -- # '[' -z 69339 ']' 00:12:55.727 11:23:51 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- common/autotest_common.sh@835 -- # local rpc_addr=/var/tmp/spdk.sock 00:12:55.727 11:23:51 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- common/autotest_common.sh@836 -- # local max_retries=100 00:12:55.727 11:23:51 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- common/autotest_common.sh@838 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:12:55.727 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:12:55.727 11:23:51 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- common/autotest_common.sh@840 -- # xtrace_disable 00:12:55.727 11:23:51 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- common/autotest_common.sh@10 -- # set +x 00:12:55.727 [2024-10-07 11:23:51.102485] Starting SPDK v25.01-pre git sha1 2a4f56c54 / DPDK 24.03.0 initialization... 00:12:55.727 [2024-10-07 11:23:51.102604] [ DPDK EAL parameters: nvmf -c 0x2 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --iova-mode=pa --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:12:55.727 [2024-10-07 11:23:51.242586] app.c: 917:spdk_app_start: *NOTICE*: Total cores available: 1 00:12:55.984 [2024-10-07 11:23:51.388719] app.c: 610:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:12:55.984 [2024-10-07 11:23:51.388807] app.c: 611:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:12:55.984 [2024-10-07 11:23:51.388822] app.c: 616:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:12:55.984 [2024-10-07 11:23:51.388833] app.c: 617:app_setup_trace: *NOTICE*: SPDK application currently running. 00:12:55.984 [2024-10-07 11:23:51.388843] app.c: 618:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:12:55.984 [2024-10-07 11:23:51.389369] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 1 00:12:56.937 11:23:52 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- common/autotest_common.sh@860 -- # (( i == 0 )) 00:12:56.937 11:23:52 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- common/autotest_common.sh@864 -- # return 0 00:12:56.937 11:23:52 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@509 -- # timing_exit start_nvmf_tgt 00:12:56.937 11:23:52 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- common/autotest_common.sh@730 -- # xtrace_disable 00:12:56.937 11:23:52 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- common/autotest_common.sh@10 -- # set +x 00:12:56.937 11:23:52 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@510 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:12:56.937 11:23:52 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- target/zcopy.sh@15 -- # '[' tcp '!=' tcp ']' 00:12:56.937 11:23:52 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- target/zcopy.sh@22 -- # rpc_cmd nvmf_create_transport -t tcp -o -c 0 --zcopy 00:12:56.937 11:23:52 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:56.937 11:23:52 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- common/autotest_common.sh@10 -- # set +x 00:12:56.937 [2024-10-07 11:23:52.245975] tcp.c: 738:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:12:56.937 11:23:52 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:56.937 11:23:52 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- target/zcopy.sh@24 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 -m 10 00:12:56.937 11:23:52 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:56.937 11:23:52 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- common/autotest_common.sh@10 -- # set +x 00:12:56.937 11:23:52 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:56.937 11:23:52 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- target/zcopy.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.3 -s 4420 00:12:56.937 11:23:52 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:56.937 11:23:52 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- common/autotest_common.sh@10 -- # set +x 00:12:56.937 [2024-10-07 11:23:52.266119] tcp.c:1081:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.3 port 4420 *** 00:12:56.937 11:23:52 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:56.937 11:23:52 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- target/zcopy.sh@27 -- # rpc_cmd nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.3 -s 4420 00:12:56.937 11:23:52 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:56.937 11:23:52 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- common/autotest_common.sh@10 -- # set +x 00:12:56.937 11:23:52 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:56.937 11:23:52 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- target/zcopy.sh@29 -- # rpc_cmd bdev_malloc_create 32 4096 -b malloc0 00:12:56.937 11:23:52 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:56.937 11:23:52 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- common/autotest_common.sh@10 -- # set +x 00:12:56.937 malloc0 00:12:56.937 11:23:52 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:56.937 11:23:52 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- target/zcopy.sh@30 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 malloc0 -n 1 00:12:56.937 11:23:52 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:56.937 11:23:52 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- common/autotest_common.sh@10 -- # set +x 00:12:56.937 11:23:52 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:56.937 11:23:52 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- target/zcopy.sh@33 -- # /home/vagrant/spdk_repo/spdk/build/examples/bdevperf --json /dev/fd/62 -t 10 -q 128 -w verify -o 8192 00:12:56.937 11:23:52 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- target/zcopy.sh@33 -- # gen_nvmf_target_json 00:12:56.937 11:23:52 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@558 -- # config=() 00:12:56.937 11:23:52 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@558 -- # local subsystem config 00:12:56.937 11:23:52 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@560 -- # for subsystem in "${@:-1}" 00:12:56.937 11:23:52 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@580 -- # config+=("$(cat <<-EOF 00:12:56.937 { 00:12:56.937 "params": { 00:12:56.937 "name": "Nvme$subsystem", 00:12:56.937 "trtype": "$TEST_TRANSPORT", 00:12:56.937 "traddr": "$NVMF_FIRST_TARGET_IP", 00:12:56.937 "adrfam": "ipv4", 00:12:56.937 "trsvcid": "$NVMF_PORT", 00:12:56.937 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:12:56.937 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:12:56.937 "hdgst": ${hdgst:-false}, 00:12:56.937 "ddgst": ${ddgst:-false} 00:12:56.937 }, 00:12:56.937 "method": "bdev_nvme_attach_controller" 00:12:56.937 } 00:12:56.937 EOF 00:12:56.937 )") 00:12:56.937 11:23:52 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@580 -- # cat 00:12:56.937 11:23:52 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@582 -- # jq . 00:12:56.937 11:23:52 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@583 -- # IFS=, 00:12:56.937 11:23:52 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@584 -- # printf '%s\n' '{ 00:12:56.937 "params": { 00:12:56.937 "name": "Nvme1", 00:12:56.937 "trtype": "tcp", 00:12:56.937 "traddr": "10.0.0.3", 00:12:56.937 "adrfam": "ipv4", 00:12:56.937 "trsvcid": "4420", 00:12:56.937 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:12:56.937 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:12:56.937 "hdgst": false, 00:12:56.937 "ddgst": false 00:12:56.937 }, 00:12:56.937 "method": "bdev_nvme_attach_controller" 00:12:56.937 }' 00:12:56.937 [2024-10-07 11:23:52.388981] Starting SPDK v25.01-pre git sha1 2a4f56c54 / DPDK 24.03.0 initialization... 00:12:56.937 [2024-10-07 11:23:52.389111] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --iova-mode=pa --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid69394 ] 00:12:57.195 [2024-10-07 11:23:52.532037] app.c: 917:spdk_app_start: *NOTICE*: Total cores available: 1 00:12:57.195 [2024-10-07 11:23:52.666392] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 0 00:12:57.489 Running I/O for 10 seconds... 00:12:59.359 5695.00 IOPS, 44.49 MiB/s [2024-10-07T11:23:56.255Z] 5756.50 IOPS, 44.97 MiB/s [2024-10-07T11:23:57.189Z] 5792.67 IOPS, 45.26 MiB/s [2024-10-07T11:23:58.123Z] 5833.50 IOPS, 45.57 MiB/s [2024-10-07T11:23:59.058Z] 5881.00 IOPS, 45.95 MiB/s [2024-10-07T11:23:59.992Z] 5915.67 IOPS, 46.22 MiB/s [2024-10-07T11:24:00.926Z] 5945.14 IOPS, 46.45 MiB/s [2024-10-07T11:24:02.299Z] 5968.12 IOPS, 46.63 MiB/s [2024-10-07T11:24:03.230Z] 5986.33 IOPS, 46.77 MiB/s [2024-10-07T11:24:03.230Z] 5995.10 IOPS, 46.84 MiB/s 00:13:07.707 Latency(us) 00:13:07.707 [2024-10-07T11:24:03.230Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:13:07.707 Job: Nvme1n1 (Core Mask 0x1, workload: verify, depth: 128, IO size: 8192) 00:13:07.707 Verification LBA range: start 0x0 length 0x1000 00:13:07.707 Nvme1n1 : 10.02 5997.65 46.86 0.00 0.00 21273.78 2785.28 29312.47 00:13:07.707 [2024-10-07T11:24:03.230Z] =================================================================================================================== 00:13:07.707 [2024-10-07T11:24:03.230Z] Total : 5997.65 46.86 0.00 0.00 21273.78 2785.28 29312.47 00:13:07.707 11:24:03 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- target/zcopy.sh@39 -- # perfpid=69512 00:13:07.707 11:24:03 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- target/zcopy.sh@41 -- # xtrace_disable 00:13:07.707 11:24:03 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- common/autotest_common.sh@10 -- # set +x 00:13:07.707 11:24:03 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- target/zcopy.sh@37 -- # gen_nvmf_target_json 00:13:07.707 11:24:03 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- target/zcopy.sh@37 -- # /home/vagrant/spdk_repo/spdk/build/examples/bdevperf --json /dev/fd/63 -t 5 -q 128 -w randrw -M 50 -o 8192 00:13:07.707 11:24:03 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@558 -- # config=() 00:13:07.707 11:24:03 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@558 -- # local subsystem config 00:13:07.707 11:24:03 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@560 -- # for subsystem in "${@:-1}" 00:13:07.707 11:24:03 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@580 -- # config+=("$(cat <<-EOF 00:13:07.707 { 00:13:07.707 "params": { 00:13:07.707 "name": "Nvme$subsystem", 00:13:07.707 "trtype": "$TEST_TRANSPORT", 00:13:07.707 "traddr": "$NVMF_FIRST_TARGET_IP", 00:13:07.707 "adrfam": "ipv4", 00:13:07.707 "trsvcid": "$NVMF_PORT", 00:13:07.707 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:13:07.707 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:13:07.707 "hdgst": ${hdgst:-false}, 00:13:07.707 "ddgst": ${ddgst:-false} 00:13:07.707 }, 00:13:07.707 "method": "bdev_nvme_attach_controller" 00:13:07.707 } 00:13:07.707 EOF 00:13:07.707 )") 00:13:07.707 11:24:03 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@580 -- # cat 00:13:07.707 [2024-10-07 11:24:03.212586] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:07.708 [2024-10-07 11:24:03.212645] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:07.708 11:24:03 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@582 -- # jq . 00:13:07.708 2024/10/07 11:24:03 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:13:07.708 11:24:03 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@583 -- # IFS=, 00:13:07.708 11:24:03 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@584 -- # printf '%s\n' '{ 00:13:07.708 "params": { 00:13:07.708 "name": "Nvme1", 00:13:07.708 "trtype": "tcp", 00:13:07.708 "traddr": "10.0.0.3", 00:13:07.708 "adrfam": "ipv4", 00:13:07.708 "trsvcid": "4420", 00:13:07.708 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:13:07.708 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:13:07.708 "hdgst": false, 00:13:07.708 "ddgst": false 00:13:07.708 }, 00:13:07.708 "method": "bdev_nvme_attach_controller" 00:13:07.708 }' 00:13:07.708 [2024-10-07 11:24:03.224526] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:07.708 [2024-10-07 11:24:03.224565] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:07.708 2024/10/07 11:24:03 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:13:07.966 [2024-10-07 11:24:03.236544] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:07.966 [2024-10-07 11:24:03.236571] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:07.966 2024/10/07 11:24:03 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:13:07.966 [2024-10-07 11:24:03.248556] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:07.966 [2024-10-07 11:24:03.248599] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:07.966 2024/10/07 11:24:03 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:13:07.966 [2024-10-07 11:24:03.260547] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:07.966 [2024-10-07 11:24:03.260577] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:07.966 2024/10/07 11:24:03 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:13:07.966 [2024-10-07 11:24:03.272526] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:07.966 [2024-10-07 11:24:03.272553] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:07.966 2024/10/07 11:24:03 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:13:07.966 [2024-10-07 11:24:03.277203] Starting SPDK v25.01-pre git sha1 2a4f56c54 / DPDK 24.03.0 initialization... 00:13:07.966 [2024-10-07 11:24:03.277340] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --iova-mode=pa --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid69512 ] 00:13:07.966 [2024-10-07 11:24:03.284529] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:07.966 [2024-10-07 11:24:03.284552] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:07.966 2024/10/07 11:24:03 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:13:07.966 [2024-10-07 11:24:03.296536] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:07.966 [2024-10-07 11:24:03.296565] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:07.966 2024/10/07 11:24:03 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:13:07.966 [2024-10-07 11:24:03.308541] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:07.966 [2024-10-07 11:24:03.308573] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:07.966 2024/10/07 11:24:03 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:13:07.966 [2024-10-07 11:24:03.320539] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:07.966 [2024-10-07 11:24:03.320566] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:07.966 2024/10/07 11:24:03 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:13:07.966 [2024-10-07 11:24:03.332582] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:07.966 [2024-10-07 11:24:03.332630] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:07.966 2024/10/07 11:24:03 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:13:07.966 [2024-10-07 11:24:03.344556] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:07.966 [2024-10-07 11:24:03.344584] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:07.966 2024/10/07 11:24:03 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:13:07.966 [2024-10-07 11:24:03.356560] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:07.966 [2024-10-07 11:24:03.356587] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:07.966 2024/10/07 11:24:03 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:13:07.966 [2024-10-07 11:24:03.368551] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:07.966 [2024-10-07 11:24:03.368576] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:07.966 2024/10/07 11:24:03 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:13:07.966 [2024-10-07 11:24:03.380565] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:07.966 [2024-10-07 11:24:03.380597] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:07.966 2024/10/07 11:24:03 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:13:07.966 [2024-10-07 11:24:03.392564] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:07.966 [2024-10-07 11:24:03.392593] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:07.966 2024/10/07 11:24:03 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:13:07.966 [2024-10-07 11:24:03.404567] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:07.966 [2024-10-07 11:24:03.404591] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:07.967 2024/10/07 11:24:03 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:13:07.967 [2024-10-07 11:24:03.416615] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:07.967 [2024-10-07 11:24:03.416675] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:07.967 [2024-10-07 11:24:03.419356] app.c: 917:spdk_app_start: *NOTICE*: Total cores available: 1 00:13:07.967 2024/10/07 11:24:03 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:13:07.967 [2024-10-07 11:24:03.428579] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:07.967 [2024-10-07 11:24:03.428605] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:07.967 2024/10/07 11:24:03 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:13:07.967 [2024-10-07 11:24:03.440596] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:07.967 [2024-10-07 11:24:03.440628] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:07.967 2024/10/07 11:24:03 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:13:07.967 [2024-10-07 11:24:03.452583] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:07.967 [2024-10-07 11:24:03.452614] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:07.967 2024/10/07 11:24:03 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:13:07.967 [2024-10-07 11:24:03.464626] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:07.967 [2024-10-07 11:24:03.464687] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:07.967 2024/10/07 11:24:03 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:13:07.967 [2024-10-07 11:24:03.476586] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:07.967 [2024-10-07 11:24:03.476610] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:07.967 2024/10/07 11:24:03 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:13:07.967 [2024-10-07 11:24:03.488589] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:07.967 [2024-10-07 11:24:03.488612] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:08.226 2024/10/07 11:24:03 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:13:08.226 [2024-10-07 11:24:03.500594] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:08.226 [2024-10-07 11:24:03.500618] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:08.226 2024/10/07 11:24:03 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:13:08.226 [2024-10-07 11:24:03.512615] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:08.226 [2024-10-07 11:24:03.512661] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:08.226 2024/10/07 11:24:03 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:13:08.226 [2024-10-07 11:24:03.524607] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:08.226 [2024-10-07 11:24:03.524631] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:08.226 2024/10/07 11:24:03 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:13:08.226 [2024-10-07 11:24:03.536606] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:08.226 [2024-10-07 11:24:03.536629] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:08.226 2024/10/07 11:24:03 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:13:08.226 [2024-10-07 11:24:03.548672] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:08.226 [2024-10-07 11:24:03.548707] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:08.226 2024/10/07 11:24:03 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:13:08.226 [2024-10-07 11:24:03.560618] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:08.226 [2024-10-07 11:24:03.560644] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:08.226 2024/10/07 11:24:03 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:13:08.226 [2024-10-07 11:24:03.572618] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:08.226 [2024-10-07 11:24:03.572646] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:08.226 2024/10/07 11:24:03 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:13:08.226 [2024-10-07 11:24:03.580312] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 0 00:13:08.226 [2024-10-07 11:24:03.584642] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:08.226 [2024-10-07 11:24:03.584682] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:08.226 2024/10/07 11:24:03 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:13:08.226 [2024-10-07 11:24:03.596627] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:08.226 [2024-10-07 11:24:03.596663] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:08.226 2024/10/07 11:24:03 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:13:08.226 [2024-10-07 11:24:03.608646] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:08.226 [2024-10-07 11:24:03.608689] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:08.226 2024/10/07 11:24:03 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:13:08.226 [2024-10-07 11:24:03.620669] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:08.226 [2024-10-07 11:24:03.620708] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:08.226 2024/10/07 11:24:03 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:13:08.226 [2024-10-07 11:24:03.632688] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:08.226 [2024-10-07 11:24:03.632738] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:08.226 2024/10/07 11:24:03 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:13:08.226 [2024-10-07 11:24:03.644687] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:08.226 [2024-10-07 11:24:03.644726] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:08.226 2024/10/07 11:24:03 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:13:08.226 [2024-10-07 11:24:03.656684] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:08.226 [2024-10-07 11:24:03.656722] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:08.226 2024/10/07 11:24:03 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:13:08.226 [2024-10-07 11:24:03.668685] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:08.226 [2024-10-07 11:24:03.668724] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:08.226 2024/10/07 11:24:03 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:13:08.226 [2024-10-07 11:24:03.680796] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:08.226 [2024-10-07 11:24:03.680861] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:08.226 2024/10/07 11:24:03 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:13:08.226 [2024-10-07 11:24:03.692746] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:08.226 [2024-10-07 11:24:03.692800] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:08.226 2024/10/07 11:24:03 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:13:08.226 [2024-10-07 11:24:03.704761] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:08.226 [2024-10-07 11:24:03.704818] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:08.226 2024/10/07 11:24:03 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:13:08.226 [2024-10-07 11:24:03.716764] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:08.226 [2024-10-07 11:24:03.716820] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:08.226 2024/10/07 11:24:03 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:13:08.226 [2024-10-07 11:24:03.728772] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:08.226 [2024-10-07 11:24:03.728830] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:08.226 2024/10/07 11:24:03 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:13:08.226 [2024-10-07 11:24:03.740795] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:08.226 [2024-10-07 11:24:03.740857] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:08.227 2024/10/07 11:24:03 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:13:08.485 [2024-10-07 11:24:03.752783] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:08.485 [2024-10-07 11:24:03.752840] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:08.485 2024/10/07 11:24:03 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:13:08.485 [2024-10-07 11:24:03.764794] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:08.485 [2024-10-07 11:24:03.764851] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:08.485 2024/10/07 11:24:03 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:13:08.485 [2024-10-07 11:24:03.776815] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:08.485 [2024-10-07 11:24:03.776877] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:08.485 2024/10/07 11:24:03 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:13:08.485 [2024-10-07 11:24:03.788835] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:08.485 [2024-10-07 11:24:03.788900] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:08.485 2024/10/07 11:24:03 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:13:08.485 Running I/O for 5 seconds... 00:13:08.485 [2024-10-07 11:24:03.800750] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:08.485 [2024-10-07 11:24:03.800798] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:08.485 2024/10/07 11:24:03 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:13:08.485 [2024-10-07 11:24:03.817722] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:08.485 [2024-10-07 11:24:03.817773] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:08.485 2024/10/07 11:24:03 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:13:08.485 [2024-10-07 11:24:03.834996] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:08.485 [2024-10-07 11:24:03.835042] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:08.485 2024/10/07 11:24:03 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:13:08.485 [2024-10-07 11:24:03.850850] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:08.485 [2024-10-07 11:24:03.850896] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:08.485 2024/10/07 11:24:03 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:13:08.485 [2024-10-07 11:24:03.861515] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:08.485 [2024-10-07 11:24:03.861562] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:08.485 2024/10/07 11:24:03 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:13:08.485 [2024-10-07 11:24:03.876460] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:08.485 [2024-10-07 11:24:03.876508] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:08.485 2024/10/07 11:24:03 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:13:08.485 [2024-10-07 11:24:03.894232] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:08.485 [2024-10-07 11:24:03.894279] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:08.485 2024/10/07 11:24:03 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:13:08.485 [2024-10-07 11:24:03.909449] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:08.485 [2024-10-07 11:24:03.909496] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:08.485 2024/10/07 11:24:03 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:13:08.485 [2024-10-07 11:24:03.922094] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:08.485 [2024-10-07 11:24:03.922140] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:08.485 2024/10/07 11:24:03 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:13:08.485 [2024-10-07 11:24:03.939241] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:08.485 [2024-10-07 11:24:03.939292] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:08.486 2024/10/07 11:24:03 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:13:08.486 [2024-10-07 11:24:03.954099] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:08.486 [2024-10-07 11:24:03.954147] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:08.486 2024/10/07 11:24:03 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:13:08.486 [2024-10-07 11:24:03.971857] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:08.486 [2024-10-07 11:24:03.971915] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:08.486 2024/10/07 11:24:03 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:13:08.486 [2024-10-07 11:24:03.987620] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:08.486 [2024-10-07 11:24:03.987684] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:08.486 2024/10/07 11:24:03 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:13:08.486 [2024-10-07 11:24:04.004311] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:08.486 [2024-10-07 11:24:04.004361] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:08.486 2024/10/07 11:24:04 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:13:08.743 [2024-10-07 11:24:04.019850] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:08.743 [2024-10-07 11:24:04.019907] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:08.743 2024/10/07 11:24:04 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:13:08.743 [2024-10-07 11:24:04.030781] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:08.743 [2024-10-07 11:24:04.030833] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:08.743 2024/10/07 11:24:04 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:13:08.743 [2024-10-07 11:24:04.045592] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:08.743 [2024-10-07 11:24:04.045642] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:08.743 2024/10/07 11:24:04 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:13:08.743 [2024-10-07 11:24:04.056001] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:08.743 [2024-10-07 11:24:04.056043] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:08.743 2024/10/07 11:24:04 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:13:08.743 [2024-10-07 11:24:04.070563] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:08.743 [2024-10-07 11:24:04.070608] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:08.743 2024/10/07 11:24:04 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:13:08.743 [2024-10-07 11:24:04.081165] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:08.743 [2024-10-07 11:24:04.081211] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:08.743 2024/10/07 11:24:04 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:13:08.743 [2024-10-07 11:24:04.096177] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:08.743 [2024-10-07 11:24:04.096224] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:08.744 2024/10/07 11:24:04 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:13:08.744 [2024-10-07 11:24:04.106379] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:08.744 [2024-10-07 11:24:04.106420] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:08.744 2024/10/07 11:24:04 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:13:08.744 [2024-10-07 11:24:04.121859] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:08.744 [2024-10-07 11:24:04.121907] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:08.744 2024/10/07 11:24:04 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:13:08.744 [2024-10-07 11:24:04.140777] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:08.744 [2024-10-07 11:24:04.140829] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:08.744 2024/10/07 11:24:04 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:13:08.744 [2024-10-07 11:24:04.155324] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:08.744 [2024-10-07 11:24:04.155370] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:08.744 2024/10/07 11:24:04 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:13:08.744 [2024-10-07 11:24:04.172513] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:08.744 [2024-10-07 11:24:04.172570] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:08.744 2024/10/07 11:24:04 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:13:08.744 [2024-10-07 11:24:04.188517] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:08.744 [2024-10-07 11:24:04.188562] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:08.744 2024/10/07 11:24:04 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:13:08.744 [2024-10-07 11:24:04.207529] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:08.744 [2024-10-07 11:24:04.207574] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:08.744 2024/10/07 11:24:04 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:13:08.744 [2024-10-07 11:24:04.223201] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:08.744 [2024-10-07 11:24:04.223255] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:08.744 2024/10/07 11:24:04 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:13:08.744 [2024-10-07 11:24:04.233984] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:08.744 [2024-10-07 11:24:04.234028] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:08.744 2024/10/07 11:24:04 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:13:08.744 [2024-10-07 11:24:04.249077] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:08.744 [2024-10-07 11:24:04.249126] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:08.744 2024/10/07 11:24:04 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:13:08.744 [2024-10-07 11:24:04.266158] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:08.744 [2024-10-07 11:24:04.266211] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:09.001 2024/10/07 11:24:04 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:13:09.001 [2024-10-07 11:24:04.282378] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:09.001 [2024-10-07 11:24:04.282432] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:09.001 2024/10/07 11:24:04 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:13:09.001 [2024-10-07 11:24:04.298280] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:09.001 [2024-10-07 11:24:04.298325] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:09.001 2024/10/07 11:24:04 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:13:09.001 [2024-10-07 11:24:04.315351] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:09.001 [2024-10-07 11:24:04.315395] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:09.001 2024/10/07 11:24:04 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:13:09.001 [2024-10-07 11:24:04.330908] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:09.001 [2024-10-07 11:24:04.330960] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:09.001 2024/10/07 11:24:04 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:13:09.001 [2024-10-07 11:24:04.341388] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:09.001 [2024-10-07 11:24:04.341439] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:09.001 2024/10/07 11:24:04 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:13:09.001 [2024-10-07 11:24:04.352045] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:09.001 [2024-10-07 11:24:04.352087] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:09.001 2024/10/07 11:24:04 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:13:09.001 [2024-10-07 11:24:04.363432] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:09.001 [2024-10-07 11:24:04.363472] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:09.001 2024/10/07 11:24:04 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:13:09.001 [2024-10-07 11:24:04.374507] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:09.001 [2024-10-07 11:24:04.374552] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:09.001 2024/10/07 11:24:04 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:13:09.001 [2024-10-07 11:24:04.387632] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:09.001 [2024-10-07 11:24:04.387686] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:09.001 2024/10/07 11:24:04 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:13:09.001 [2024-10-07 11:24:04.403418] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:09.001 [2024-10-07 11:24:04.403462] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:09.001 2024/10/07 11:24:04 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:13:09.001 [2024-10-07 11:24:04.419027] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:09.002 [2024-10-07 11:24:04.419072] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:09.002 2024/10/07 11:24:04 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:13:09.002 [2024-10-07 11:24:04.435973] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:09.002 [2024-10-07 11:24:04.436017] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:09.002 2024/10/07 11:24:04 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:13:09.002 [2024-10-07 11:24:04.451397] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:09.002 [2024-10-07 11:24:04.451441] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:09.002 2024/10/07 11:24:04 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:13:09.002 [2024-10-07 11:24:04.463946] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:09.002 [2024-10-07 11:24:04.463992] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:09.002 2024/10/07 11:24:04 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:13:09.002 [2024-10-07 11:24:04.473235] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:09.002 [2024-10-07 11:24:04.473269] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:09.002 2024/10/07 11:24:04 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:13:09.002 [2024-10-07 11:24:04.488464] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:09.002 [2024-10-07 11:24:04.488520] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:09.002 2024/10/07 11:24:04 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:13:09.002 [2024-10-07 11:24:04.505220] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:09.002 [2024-10-07 11:24:04.505267] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:09.002 2024/10/07 11:24:04 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:13:09.002 [2024-10-07 11:24:04.520843] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:09.002 [2024-10-07 11:24:04.520882] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:09.002 2024/10/07 11:24:04 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:13:09.259 [2024-10-07 11:24:04.531151] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:09.259 [2024-10-07 11:24:04.531188] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:09.259 2024/10/07 11:24:04 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:13:09.259 [2024-10-07 11:24:04.546532] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:09.259 [2024-10-07 11:24:04.546579] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:09.259 2024/10/07 11:24:04 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:13:09.259 [2024-10-07 11:24:04.564929] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:09.259 [2024-10-07 11:24:04.564976] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:09.259 2024/10/07 11:24:04 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:13:09.259 [2024-10-07 11:24:04.579703] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:09.259 [2024-10-07 11:24:04.579748] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:09.259 2024/10/07 11:24:04 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:13:09.259 [2024-10-07 11:24:04.597054] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:09.259 [2024-10-07 11:24:04.597109] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:09.259 2024/10/07 11:24:04 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:13:09.259 [2024-10-07 11:24:04.612372] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:09.259 [2024-10-07 11:24:04.612425] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:09.259 2024/10/07 11:24:04 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:13:09.259 [2024-10-07 11:24:04.622033] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:09.259 [2024-10-07 11:24:04.622077] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:09.259 2024/10/07 11:24:04 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:13:09.259 [2024-10-07 11:24:04.638287] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:09.259 [2024-10-07 11:24:04.638339] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:09.259 2024/10/07 11:24:04 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:13:09.259 [2024-10-07 11:24:04.655050] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:09.259 [2024-10-07 11:24:04.656137] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:09.259 2024/10/07 11:24:04 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:13:09.259 [2024-10-07 11:24:04.673006] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:09.259 [2024-10-07 11:24:04.673061] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:09.260 2024/10/07 11:24:04 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:13:09.260 [2024-10-07 11:24:04.689840] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:09.260 [2024-10-07 11:24:04.689891] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:09.260 2024/10/07 11:24:04 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:13:09.260 [2024-10-07 11:24:04.705043] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:09.260 [2024-10-07 11:24:04.705095] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:09.260 2024/10/07 11:24:04 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:13:09.260 [2024-10-07 11:24:04.720710] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:09.260 [2024-10-07 11:24:04.720956] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:09.260 2024/10/07 11:24:04 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:13:09.260 [2024-10-07 11:24:04.731836] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:09.260 [2024-10-07 11:24:04.732050] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:09.260 2024/10/07 11:24:04 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:13:09.260 [2024-10-07 11:24:04.747230] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:09.260 [2024-10-07 11:24:04.747512] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:09.260 2024/10/07 11:24:04 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:13:09.260 [2024-10-07 11:24:04.758416] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:09.260 [2024-10-07 11:24:04.758621] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:09.260 2024/10/07 11:24:04 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:13:09.260 [2024-10-07 11:24:04.773440] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:09.260 [2024-10-07 11:24:04.773680] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:09.260 2024/10/07 11:24:04 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:13:09.260 [2024-10-07 11:24:04.783287] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:09.260 [2024-10-07 11:24:04.783482] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:09.517 2024/10/07 11:24:04 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:13:09.517 [2024-10-07 11:24:04.795296] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:09.517 [2024-10-07 11:24:04.795498] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:09.517 2024/10/07 11:24:04 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:13:09.517 11390.00 IOPS, 88.98 MiB/s [2024-10-07T11:24:05.040Z] [2024-10-07 11:24:04.810020] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:09.517 [2024-10-07 11:24:04.810082] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:09.517 2024/10/07 11:24:04 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:13:09.517 [2024-10-07 11:24:04.827998] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:09.518 [2024-10-07 11:24:04.828271] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:09.518 2024/10/07 11:24:04 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:13:09.518 [2024-10-07 11:24:04.843302] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:09.518 [2024-10-07 11:24:04.843576] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:09.518 2024/10/07 11:24:04 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:13:09.518 [2024-10-07 11:24:04.853944] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:09.518 [2024-10-07 11:24:04.854121] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:09.518 2024/10/07 11:24:04 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:13:09.518 [2024-10-07 11:24:04.865174] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:09.518 [2024-10-07 11:24:04.865346] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:09.518 2024/10/07 11:24:04 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:13:09.518 [2024-10-07 11:24:04.881089] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:09.518 [2024-10-07 11:24:04.881279] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:09.518 2024/10/07 11:24:04 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:13:09.518 [2024-10-07 11:24:04.897240] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:09.518 [2024-10-07 11:24:04.897436] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:09.518 2024/10/07 11:24:04 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:13:09.518 [2024-10-07 11:24:04.914533] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:09.518 [2024-10-07 11:24:04.914764] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:09.518 2024/10/07 11:24:04 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:13:09.518 [2024-10-07 11:24:04.929819] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:09.518 [2024-10-07 11:24:04.929864] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:09.518 2024/10/07 11:24:04 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:13:09.518 [2024-10-07 11:24:04.945292] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:09.518 [2024-10-07 11:24:04.945483] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:09.518 2024/10/07 11:24:04 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:13:09.518 [2024-10-07 11:24:04.961532] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:09.518 [2024-10-07 11:24:04.961789] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:09.518 2024/10/07 11:24:04 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:13:09.518 [2024-10-07 11:24:04.979196] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:09.518 [2024-10-07 11:24:04.979463] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:09.518 2024/10/07 11:24:04 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:13:09.518 [2024-10-07 11:24:04.995067] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:09.518 [2024-10-07 11:24:04.995286] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:09.518 2024/10/07 11:24:04 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:13:09.518 [2024-10-07 11:24:05.014549] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:09.518 [2024-10-07 11:24:05.014794] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:09.518 2024/10/07 11:24:05 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:13:09.518 [2024-10-07 11:24:05.029565] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:09.518 [2024-10-07 11:24:05.029858] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:09.518 2024/10/07 11:24:05 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:13:09.775 [2024-10-07 11:24:05.047371] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:09.775 [2024-10-07 11:24:05.047630] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:09.775 2024/10/07 11:24:05 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:13:09.775 [2024-10-07 11:24:05.063269] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:09.776 [2024-10-07 11:24:05.063330] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:09.776 2024/10/07 11:24:05 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:13:09.776 [2024-10-07 11:24:05.074055] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:09.776 [2024-10-07 11:24:05.074099] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:09.776 2024/10/07 11:24:05 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:13:09.776 [2024-10-07 11:24:05.085038] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:09.776 [2024-10-07 11:24:05.085083] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:09.776 2024/10/07 11:24:05 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:13:09.776 [2024-10-07 11:24:05.102989] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:09.776 [2024-10-07 11:24:05.103046] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:09.776 2024/10/07 11:24:05 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:13:09.776 [2024-10-07 11:24:05.118044] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:09.776 [2024-10-07 11:24:05.118109] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:09.776 2024/10/07 11:24:05 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:13:09.776 [2024-10-07 11:24:05.134669] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:09.776 [2024-10-07 11:24:05.134920] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:09.776 2024/10/07 11:24:05 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:13:09.776 [2024-10-07 11:24:05.152952] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:09.776 [2024-10-07 11:24:05.153190] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:09.776 2024/10/07 11:24:05 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:13:09.776 [2024-10-07 11:24:05.168519] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:09.776 [2024-10-07 11:24:05.168773] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:09.776 2024/10/07 11:24:05 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:13:09.776 [2024-10-07 11:24:05.185140] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:09.776 [2024-10-07 11:24:05.185356] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:09.776 2024/10/07 11:24:05 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:13:09.776 [2024-10-07 11:24:05.201086] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:09.776 [2024-10-07 11:24:05.201340] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:09.776 2024/10/07 11:24:05 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:13:09.776 [2024-10-07 11:24:05.211924] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:09.776 [2024-10-07 11:24:05.212126] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:09.776 2024/10/07 11:24:05 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:13:09.776 [2024-10-07 11:24:05.226830] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:09.776 [2024-10-07 11:24:05.227059] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:09.776 2024/10/07 11:24:05 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:13:09.776 [2024-10-07 11:24:05.243452] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:09.776 [2024-10-07 11:24:05.243689] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:09.776 2024/10/07 11:24:05 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:13:09.776 [2024-10-07 11:24:05.263051] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:09.776 [2024-10-07 11:24:05.263164] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:09.776 2024/10/07 11:24:05 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:13:09.776 [2024-10-07 11:24:05.278153] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:09.776 [2024-10-07 11:24:05.278354] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:09.776 2024/10/07 11:24:05 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:13:09.776 [2024-10-07 11:24:05.296129] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:09.776 [2024-10-07 11:24:05.296318] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:10.035 2024/10/07 11:24:05 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:13:10.035 [2024-10-07 11:24:05.312339] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:10.035 [2024-10-07 11:24:05.312539] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:10.035 2024/10/07 11:24:05 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:13:10.035 [2024-10-07 11:24:05.329542] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:10.035 [2024-10-07 11:24:05.329736] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:10.035 2024/10/07 11:24:05 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:13:10.035 [2024-10-07 11:24:05.345547] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:10.035 [2024-10-07 11:24:05.345748] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:10.035 2024/10/07 11:24:05 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:13:10.035 [2024-10-07 11:24:05.356153] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:10.035 [2024-10-07 11:24:05.356201] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:10.035 2024/10/07 11:24:05 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:13:10.035 [2024-10-07 11:24:05.366977] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:10.035 [2024-10-07 11:24:05.367023] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:10.035 2024/10/07 11:24:05 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:13:10.035 [2024-10-07 11:24:05.377968] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:10.035 [2024-10-07 11:24:05.378025] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:10.035 2024/10/07 11:24:05 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:13:10.035 [2024-10-07 11:24:05.392936] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:10.035 [2024-10-07 11:24:05.393153] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:10.035 2024/10/07 11:24:05 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:13:10.035 [2024-10-07 11:24:05.410818] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:10.035 [2024-10-07 11:24:05.411066] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:10.035 2024/10/07 11:24:05 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:13:10.035 [2024-10-07 11:24:05.427296] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:10.035 [2024-10-07 11:24:05.427542] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:10.035 2024/10/07 11:24:05 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:13:10.035 [2024-10-07 11:24:05.442847] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:10.035 [2024-10-07 11:24:05.443061] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:10.035 2024/10/07 11:24:05 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:13:10.035 [2024-10-07 11:24:05.452840] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:10.035 [2024-10-07 11:24:05.452882] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:10.036 2024/10/07 11:24:05 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:13:10.036 [2024-10-07 11:24:05.467687] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:10.036 [2024-10-07 11:24:05.467730] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:10.036 2024/10/07 11:24:05 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:13:10.036 [2024-10-07 11:24:05.483818] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:10.036 [2024-10-07 11:24:05.483871] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:10.036 2024/10/07 11:24:05 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:13:10.036 [2024-10-07 11:24:05.499779] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:10.036 [2024-10-07 11:24:05.500042] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:10.036 2024/10/07 11:24:05 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:13:10.036 [2024-10-07 11:24:05.517397] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:10.036 [2024-10-07 11:24:05.517612] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:10.036 2024/10/07 11:24:05 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:13:10.036 [2024-10-07 11:24:05.533379] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:10.036 [2024-10-07 11:24:05.533561] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:10.036 2024/10/07 11:24:05 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:13:10.036 [2024-10-07 11:24:05.544185] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:10.036 [2024-10-07 11:24:05.544352] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:10.036 2024/10/07 11:24:05 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:13:10.036 [2024-10-07 11:24:05.558466] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:10.036 [2024-10-07 11:24:05.558659] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:10.294 2024/10/07 11:24:05 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:13:10.294 [2024-10-07 11:24:05.574180] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:10.294 [2024-10-07 11:24:05.574384] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:10.294 2024/10/07 11:24:05 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:13:10.295 [2024-10-07 11:24:05.584200] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:10.295 [2024-10-07 11:24:05.584377] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:10.295 2024/10/07 11:24:05 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:13:10.295 [2024-10-07 11:24:05.598719] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:10.295 [2024-10-07 11:24:05.598931] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:10.295 2024/10/07 11:24:05 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:13:10.295 [2024-10-07 11:24:05.609406] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:10.295 [2024-10-07 11:24:05.609449] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:10.295 2024/10/07 11:24:05 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:13:10.295 [2024-10-07 11:24:05.624403] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:10.295 [2024-10-07 11:24:05.624451] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:10.295 2024/10/07 11:24:05 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:13:10.295 [2024-10-07 11:24:05.642591] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:10.295 [2024-10-07 11:24:05.642849] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:10.295 2024/10/07 11:24:05 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:13:10.295 [2024-10-07 11:24:05.658371] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:10.295 [2024-10-07 11:24:05.658568] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:10.295 2024/10/07 11:24:05 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:13:10.295 [2024-10-07 11:24:05.675637] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:10.295 [2024-10-07 11:24:05.675706] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:10.295 2024/10/07 11:24:05 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:13:10.295 [2024-10-07 11:24:05.690971] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:10.295 [2024-10-07 11:24:05.691018] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:10.295 2024/10/07 11:24:05 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:13:10.295 [2024-10-07 11:24:05.708535] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:10.295 [2024-10-07 11:24:05.708597] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:10.295 2024/10/07 11:24:05 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:13:10.295 [2024-10-07 11:24:05.724412] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:10.295 [2024-10-07 11:24:05.724625] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:10.295 2024/10/07 11:24:05 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:13:10.295 [2024-10-07 11:24:05.741137] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:10.295 [2024-10-07 11:24:05.741380] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:10.295 2024/10/07 11:24:05 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:13:10.295 [2024-10-07 11:24:05.756786] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:10.295 [2024-10-07 11:24:05.756992] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:10.295 2024/10/07 11:24:05 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:13:10.295 [2024-10-07 11:24:05.767751] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:10.295 [2024-10-07 11:24:05.767943] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:10.295 2024/10/07 11:24:05 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:13:10.295 [2024-10-07 11:24:05.782521] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:10.295 [2024-10-07 11:24:05.782729] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:10.295 2024/10/07 11:24:05 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:13:10.295 [2024-10-07 11:24:05.793257] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:10.295 [2024-10-07 11:24:05.793453] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:10.295 2024/10/07 11:24:05 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:13:10.295 11396.50 IOPS, 89.04 MiB/s [2024-10-07T11:24:05.818Z] [2024-10-07 11:24:05.803976] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:10.295 [2024-10-07 11:24:05.804022] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:10.295 2024/10/07 11:24:05 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:13:10.295 [2024-10-07 11:24:05.814688] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:10.295 [2024-10-07 11:24:05.814730] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:10.295 2024/10/07 11:24:05 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:13:10.554 [2024-10-07 11:24:05.827471] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:10.554 [2024-10-07 11:24:05.827528] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:10.554 2024/10/07 11:24:05 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:13:10.554 [2024-10-07 11:24:05.845411] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:10.554 [2024-10-07 11:24:05.845687] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:10.554 2024/10/07 11:24:05 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:13:10.554 [2024-10-07 11:24:05.861344] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:10.554 [2024-10-07 11:24:05.861571] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:10.554 2024/10/07 11:24:05 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:13:10.554 [2024-10-07 11:24:05.879877] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:10.554 [2024-10-07 11:24:05.880108] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:10.554 2024/10/07 11:24:05 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:13:10.554 [2024-10-07 11:24:05.895488] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:10.554 [2024-10-07 11:24:05.895727] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:10.554 2024/10/07 11:24:05 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:13:10.554 [2024-10-07 11:24:05.912502] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:10.554 [2024-10-07 11:24:05.912565] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:10.554 2024/10/07 11:24:05 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:13:10.554 [2024-10-07 11:24:05.928197] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:10.554 [2024-10-07 11:24:05.928253] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:10.554 2024/10/07 11:24:05 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:13:10.554 [2024-10-07 11:24:05.938885] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:10.554 [2024-10-07 11:24:05.938933] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:10.554 2024/10/07 11:24:05 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:13:10.554 [2024-10-07 11:24:05.954158] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:10.554 [2024-10-07 11:24:05.954380] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:10.554 2024/10/07 11:24:05 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:13:10.554 [2024-10-07 11:24:05.971408] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:10.554 [2024-10-07 11:24:05.971667] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:10.554 2024/10/07 11:24:05 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:13:10.555 [2024-10-07 11:24:05.987511] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:10.555 [2024-10-07 11:24:05.987768] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:10.555 2024/10/07 11:24:05 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:13:10.555 [2024-10-07 11:24:05.998129] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:10.555 [2024-10-07 11:24:05.998323] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:10.555 2024/10/07 11:24:06 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:13:10.555 [2024-10-07 11:24:06.013577] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:10.555 [2024-10-07 11:24:06.013814] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:10.555 2024/10/07 11:24:06 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:13:10.555 [2024-10-07 11:24:06.030783] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:10.555 [2024-10-07 11:24:06.030831] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:10.555 2024/10/07 11:24:06 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:13:10.555 [2024-10-07 11:24:06.046327] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:10.555 [2024-10-07 11:24:06.046377] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:10.555 2024/10/07 11:24:06 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:13:10.555 [2024-10-07 11:24:06.057710] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:10.555 [2024-10-07 11:24:06.057760] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:10.555 2024/10/07 11:24:06 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:13:10.555 [2024-10-07 11:24:06.072839] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:10.555 [2024-10-07 11:24:06.072886] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:10.812 2024/10/07 11:24:06 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:13:10.812 [2024-10-07 11:24:06.090274] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:10.812 [2024-10-07 11:24:06.090324] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:10.812 2024/10/07 11:24:06 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:13:10.812 [2024-10-07 11:24:06.105835] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:10.812 [2024-10-07 11:24:06.106029] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:10.812 2024/10/07 11:24:06 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:13:10.812 [2024-10-07 11:24:06.122719] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:10.812 [2024-10-07 11:24:06.122915] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:10.812 2024/10/07 11:24:06 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:13:10.812 [2024-10-07 11:24:06.139489] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:10.812 [2024-10-07 11:24:06.139691] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:10.812 2024/10/07 11:24:06 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:13:10.812 [2024-10-07 11:24:06.155297] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:10.812 [2024-10-07 11:24:06.155535] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:10.812 2024/10/07 11:24:06 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:13:10.812 [2024-10-07 11:24:06.165012] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:10.812 [2024-10-07 11:24:06.165179] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:10.812 2024/10/07 11:24:06 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:13:10.812 [2024-10-07 11:24:06.180295] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:10.812 [2024-10-07 11:24:06.180512] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:10.812 2024/10/07 11:24:06 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:13:10.812 [2024-10-07 11:24:06.190847] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:10.812 [2024-10-07 11:24:06.191049] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:10.812 2024/10/07 11:24:06 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:13:10.812 [2024-10-07 11:24:06.207166] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:10.812 [2024-10-07 11:24:06.207228] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:10.812 2024/10/07 11:24:06 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:13:10.813 [2024-10-07 11:24:06.223214] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:10.813 [2024-10-07 11:24:06.223439] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:10.813 2024/10/07 11:24:06 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:13:10.813 [2024-10-07 11:24:06.239416] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:10.813 [2024-10-07 11:24:06.239610] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:10.813 2024/10/07 11:24:06 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:13:10.813 [2024-10-07 11:24:06.255873] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:10.813 [2024-10-07 11:24:06.256080] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:10.813 2024/10/07 11:24:06 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:13:10.813 [2024-10-07 11:24:06.273336] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:10.813 [2024-10-07 11:24:06.273550] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:10.813 2024/10/07 11:24:06 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:13:10.813 [2024-10-07 11:24:06.284147] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:10.813 [2024-10-07 11:24:06.284195] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:10.813 2024/10/07 11:24:06 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:13:10.813 [2024-10-07 11:24:06.299059] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:10.813 [2024-10-07 11:24:06.299118] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:10.813 2024/10/07 11:24:06 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:13:10.813 [2024-10-07 11:24:06.316190] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:10.813 [2024-10-07 11:24:06.316419] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:10.813 2024/10/07 11:24:06 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:13:10.813 [2024-10-07 11:24:06.333986] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:10.813 [2024-10-07 11:24:06.334220] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:11.070 2024/10/07 11:24:06 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:13:11.070 [2024-10-07 11:24:06.349805] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:11.070 [2024-10-07 11:24:06.350024] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:11.070 2024/10/07 11:24:06 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:13:11.070 [2024-10-07 11:24:06.367131] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:11.070 [2024-10-07 11:24:06.367379] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:11.070 2024/10/07 11:24:06 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:13:11.070 [2024-10-07 11:24:06.378446] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:11.070 [2024-10-07 11:24:06.378628] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:11.070 2024/10/07 11:24:06 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:13:11.070 [2024-10-07 11:24:06.393506] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:11.070 [2024-10-07 11:24:06.393699] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:11.070 2024/10/07 11:24:06 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:13:11.070 [2024-10-07 11:24:06.411456] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:11.070 [2024-10-07 11:24:06.411518] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:11.070 2024/10/07 11:24:06 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:13:11.070 [2024-10-07 11:24:06.426949] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:11.070 [2024-10-07 11:24:06.426998] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:11.070 2024/10/07 11:24:06 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:13:11.070 [2024-10-07 11:24:06.436409] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:11.070 [2024-10-07 11:24:06.436454] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:11.070 2024/10/07 11:24:06 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:13:11.070 [2024-10-07 11:24:06.451369] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:11.070 [2024-10-07 11:24:06.451572] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:11.070 2024/10/07 11:24:06 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:13:11.070 [2024-10-07 11:24:06.461296] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:11.070 [2024-10-07 11:24:06.461473] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:11.070 2024/10/07 11:24:06 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:13:11.070 [2024-10-07 11:24:06.477190] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:11.070 [2024-10-07 11:24:06.477407] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:11.071 2024/10/07 11:24:06 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:13:11.071 [2024-10-07 11:24:06.493352] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:11.071 [2024-10-07 11:24:06.493550] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:11.071 2024/10/07 11:24:06 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:13:11.071 [2024-10-07 11:24:06.509641] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:11.071 [2024-10-07 11:24:06.509698] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:11.071 2024/10/07 11:24:06 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:13:11.071 [2024-10-07 11:24:06.526252] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:11.071 [2024-10-07 11:24:06.526437] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:11.071 2024/10/07 11:24:06 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:13:11.071 [2024-10-07 11:24:06.542291] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:11.071 [2024-10-07 11:24:06.542503] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:11.071 2024/10/07 11:24:06 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:13:11.071 [2024-10-07 11:24:06.552081] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:11.071 [2024-10-07 11:24:06.552270] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:11.071 2024/10/07 11:24:06 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:13:11.071 [2024-10-07 11:24:06.567627] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:11.071 [2024-10-07 11:24:06.567892] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:11.071 2024/10/07 11:24:06 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:13:11.071 [2024-10-07 11:24:06.584154] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:11.071 [2024-10-07 11:24:06.584420] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:11.071 2024/10/07 11:24:06 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:13:11.328 [2024-10-07 11:24:06.601389] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:11.328 [2024-10-07 11:24:06.601623] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:11.328 2024/10/07 11:24:06 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:13:11.328 [2024-10-07 11:24:06.617895] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:11.328 [2024-10-07 11:24:06.617950] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:11.328 2024/10/07 11:24:06 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:13:11.328 [2024-10-07 11:24:06.628575] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:11.328 [2024-10-07 11:24:06.628632] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:11.328 2024/10/07 11:24:06 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:13:11.328 [2024-10-07 11:24:06.644062] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:11.328 [2024-10-07 11:24:06.644112] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:11.328 2024/10/07 11:24:06 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:13:11.328 [2024-10-07 11:24:06.654567] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:11.328 [2024-10-07 11:24:06.654750] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:11.328 2024/10/07 11:24:06 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:13:11.328 [2024-10-07 11:24:06.669773] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:11.328 [2024-10-07 11:24:06.669973] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:11.328 2024/10/07 11:24:06 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:13:11.328 [2024-10-07 11:24:06.680814] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:11.328 [2024-10-07 11:24:06.681013] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:11.328 2024/10/07 11:24:06 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:13:11.328 [2024-10-07 11:24:06.695512] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:11.328 [2024-10-07 11:24:06.695563] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:11.328 2024/10/07 11:24:06 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:13:11.328 [2024-10-07 11:24:06.707621] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:11.328 [2024-10-07 11:24:06.707685] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:11.328 2024/10/07 11:24:06 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:13:11.328 [2024-10-07 11:24:06.725305] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:11.328 [2024-10-07 11:24:06.725507] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:11.328 2024/10/07 11:24:06 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:13:11.328 [2024-10-07 11:24:06.740617] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:11.328 [2024-10-07 11:24:06.740819] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:11.328 2024/10/07 11:24:06 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:13:11.328 [2024-10-07 11:24:06.755394] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:11.328 [2024-10-07 11:24:06.755597] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:11.328 2024/10/07 11:24:06 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:13:11.329 [2024-10-07 11:24:06.772026] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:11.329 [2024-10-07 11:24:06.772242] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:11.329 2024/10/07 11:24:06 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:13:11.329 [2024-10-07 11:24:06.787846] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:11.329 [2024-10-07 11:24:06.788087] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:11.329 2024/10/07 11:24:06 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:13:11.329 [2024-10-07 11:24:06.798665] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:11.329 11401.67 IOPS, 89.08 MiB/s [2024-10-07T11:24:06.852Z] [2024-10-07 11:24:06.798870] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:11.329 2024/10/07 11:24:06 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:13:11.329 [2024-10-07 11:24:06.813063] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:11.329 [2024-10-07 11:24:06.813113] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:11.329 2024/10/07 11:24:06 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:13:11.329 [2024-10-07 11:24:06.828170] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:11.329 [2024-10-07 11:24:06.828361] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:11.329 2024/10/07 11:24:06 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:13:11.329 [2024-10-07 11:24:06.838744] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:11.329 [2024-10-07 11:24:06.838931] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:11.329 2024/10/07 11:24:06 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:13:11.587 [2024-10-07 11:24:06.854246] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:11.587 [2024-10-07 11:24:06.854427] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:11.587 2024/10/07 11:24:06 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:13:11.587 [2024-10-07 11:24:06.870615] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:11.587 [2024-10-07 11:24:06.870828] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:11.587 2024/10/07 11:24:06 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:13:11.587 [2024-10-07 11:24:06.881074] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:11.587 [2024-10-07 11:24:06.881252] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:11.587 2024/10/07 11:24:06 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:13:11.587 [2024-10-07 11:24:06.895551] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:11.587 [2024-10-07 11:24:06.895771] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:11.587 2024/10/07 11:24:06 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:13:11.587 [2024-10-07 11:24:06.911121] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:11.587 [2024-10-07 11:24:06.911305] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:11.587 2024/10/07 11:24:06 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:13:11.587 [2024-10-07 11:24:06.928536] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:11.587 [2024-10-07 11:24:06.928762] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:11.587 2024/10/07 11:24:06 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:13:11.587 [2024-10-07 11:24:06.939547] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:11.587 [2024-10-07 11:24:06.939747] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:11.587 2024/10/07 11:24:06 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:13:11.587 [2024-10-07 11:24:06.955355] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:11.587 [2024-10-07 11:24:06.955560] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:11.587 2024/10/07 11:24:06 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:13:11.587 [2024-10-07 11:24:06.966585] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:11.587 [2024-10-07 11:24:06.966803] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:11.587 2024/10/07 11:24:06 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:13:11.587 [2024-10-07 11:24:06.981729] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:11.587 [2024-10-07 11:24:06.981779] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:11.587 2024/10/07 11:24:06 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:13:11.587 [2024-10-07 11:24:06.998456] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:11.587 [2024-10-07 11:24:06.998506] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:11.587 2024/10/07 11:24:07 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:13:11.587 [2024-10-07 11:24:07.014623] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:11.587 [2024-10-07 11:24:07.014845] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:11.587 2024/10/07 11:24:07 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:13:11.587 [2024-10-07 11:24:07.031552] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:11.587 [2024-10-07 11:24:07.031772] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:11.587 2024/10/07 11:24:07 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:13:11.587 [2024-10-07 11:24:07.048820] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:11.587 [2024-10-07 11:24:07.049079] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:11.587 2024/10/07 11:24:07 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:13:11.587 [2024-10-07 11:24:07.065963] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:11.587 [2024-10-07 11:24:07.066204] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:11.587 2024/10/07 11:24:07 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:13:11.587 [2024-10-07 11:24:07.082114] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:11.587 [2024-10-07 11:24:07.082291] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:11.587 2024/10/07 11:24:07 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:13:11.587 [2024-10-07 11:24:07.098869] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:11.587 [2024-10-07 11:24:07.098919] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:11.587 2024/10/07 11:24:07 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:13:11.845 [2024-10-07 11:24:07.116107] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:11.845 [2024-10-07 11:24:07.116160] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:11.845 2024/10/07 11:24:07 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:13:11.845 [2024-10-07 11:24:07.131526] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:11.845 [2024-10-07 11:24:07.131731] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:11.845 2024/10/07 11:24:07 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:13:11.845 [2024-10-07 11:24:07.141905] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:11.845 [2024-10-07 11:24:07.141942] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:11.845 2024/10/07 11:24:07 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:13:11.845 [2024-10-07 11:24:07.156006] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:11.845 [2024-10-07 11:24:07.156046] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:11.845 2024/10/07 11:24:07 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:13:11.845 [2024-10-07 11:24:07.172070] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:11.845 [2024-10-07 11:24:07.172115] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:11.845 2024/10/07 11:24:07 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:13:11.845 [2024-10-07 11:24:07.189175] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:11.845 [2024-10-07 11:24:07.189223] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:11.845 2024/10/07 11:24:07 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:13:11.845 [2024-10-07 11:24:07.204958] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:11.845 [2024-10-07 11:24:07.205003] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:11.845 2024/10/07 11:24:07 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:13:11.846 [2024-10-07 11:24:07.214739] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:11.846 [2024-10-07 11:24:07.214775] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:11.846 2024/10/07 11:24:07 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:13:11.846 [2024-10-07 11:24:07.230195] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:11.846 [2024-10-07 11:24:07.230237] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:11.846 2024/10/07 11:24:07 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:13:11.846 [2024-10-07 11:24:07.239829] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:11.846 [2024-10-07 11:24:07.239865] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:11.846 2024/10/07 11:24:07 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:13:11.846 [2024-10-07 11:24:07.256119] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:11.846 [2024-10-07 11:24:07.256169] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:11.846 2024/10/07 11:24:07 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:13:11.846 [2024-10-07 11:24:07.272040] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:11.846 [2024-10-07 11:24:07.272095] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:11.846 2024/10/07 11:24:07 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:13:11.846 [2024-10-07 11:24:07.289350] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:11.846 [2024-10-07 11:24:07.289405] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:11.846 2024/10/07 11:24:07 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:13:11.846 [2024-10-07 11:24:07.303927] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:11.846 [2024-10-07 11:24:07.303975] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:11.846 2024/10/07 11:24:07 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:13:11.846 [2024-10-07 11:24:07.320468] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:11.846 [2024-10-07 11:24:07.320520] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:11.846 2024/10/07 11:24:07 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:13:11.846 [2024-10-07 11:24:07.335393] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:11.846 [2024-10-07 11:24:07.335453] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:11.846 2024/10/07 11:24:07 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:13:11.846 [2024-10-07 11:24:07.350664] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:11.846 [2024-10-07 11:24:07.350714] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:11.846 2024/10/07 11:24:07 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:13:11.846 [2024-10-07 11:24:07.360345] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:11.846 [2024-10-07 11:24:07.360388] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:11.846 2024/10/07 11:24:07 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:13:12.104 [2024-10-07 11:24:07.374801] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:12.104 [2024-10-07 11:24:07.374847] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:12.104 2024/10/07 11:24:07 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:13:12.104 [2024-10-07 11:24:07.385411] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:12.104 [2024-10-07 11:24:07.385459] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:12.104 2024/10/07 11:24:07 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:13:12.104 [2024-10-07 11:24:07.400348] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:12.104 [2024-10-07 11:24:07.400399] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:12.104 2024/10/07 11:24:07 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:13:12.104 [2024-10-07 11:24:07.411037] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:12.104 [2024-10-07 11:24:07.411077] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:12.104 2024/10/07 11:24:07 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:13:12.104 [2024-10-07 11:24:07.425636] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:12.104 [2024-10-07 11:24:07.425703] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:12.104 2024/10/07 11:24:07 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:13:12.104 [2024-10-07 11:24:07.443502] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:12.104 [2024-10-07 11:24:07.443551] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:12.104 2024/10/07 11:24:07 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:13:12.104 [2024-10-07 11:24:07.454253] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:12.104 [2024-10-07 11:24:07.454299] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:12.104 2024/10/07 11:24:07 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:13:12.104 [2024-10-07 11:24:07.465154] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:12.104 [2024-10-07 11:24:07.465198] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:12.104 2024/10/07 11:24:07 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:13:12.104 [2024-10-07 11:24:07.481725] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:12.104 [2024-10-07 11:24:07.481775] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:12.104 2024/10/07 11:24:07 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:13:12.104 [2024-10-07 11:24:07.491415] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:12.104 [2024-10-07 11:24:07.491457] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:12.105 2024/10/07 11:24:07 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:13:12.105 [2024-10-07 11:24:07.507562] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:12.105 [2024-10-07 11:24:07.507623] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:12.105 2024/10/07 11:24:07 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:13:12.105 [2024-10-07 11:24:07.518178] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:12.105 [2024-10-07 11:24:07.518225] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:12.105 2024/10/07 11:24:07 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:13:12.105 [2024-10-07 11:24:07.533393] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:12.105 [2024-10-07 11:24:07.533447] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:12.105 2024/10/07 11:24:07 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:13:12.105 [2024-10-07 11:24:07.550565] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:12.105 [2024-10-07 11:24:07.550619] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:12.105 2024/10/07 11:24:07 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:13:12.105 [2024-10-07 11:24:07.566099] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:12.105 [2024-10-07 11:24:07.566151] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:12.105 2024/10/07 11:24:07 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:13:12.105 [2024-10-07 11:24:07.576878] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:12.105 [2024-10-07 11:24:07.576924] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:12.105 2024/10/07 11:24:07 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:13:12.105 [2024-10-07 11:24:07.591785] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:12.105 [2024-10-07 11:24:07.591838] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:12.105 2024/10/07 11:24:07 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:13:12.105 [2024-10-07 11:24:07.607586] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:12.105 [2024-10-07 11:24:07.607634] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:12.105 2024/10/07 11:24:07 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:13:12.105 [2024-10-07 11:24:07.624498] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:12.105 [2024-10-07 11:24:07.624551] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:12.363 2024/10/07 11:24:07 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:13:12.363 [2024-10-07 11:24:07.640234] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:12.363 [2024-10-07 11:24:07.640284] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:12.363 2024/10/07 11:24:07 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:13:12.363 [2024-10-07 11:24:07.650873] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:12.363 [2024-10-07 11:24:07.650918] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:12.363 2024/10/07 11:24:07 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:13:12.363 [2024-10-07 11:24:07.665975] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:12.363 [2024-10-07 11:24:07.666024] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:12.363 2024/10/07 11:24:07 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:13:12.363 [2024-10-07 11:24:07.684625] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:12.363 [2024-10-07 11:24:07.684687] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:12.363 2024/10/07 11:24:07 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:13:12.363 [2024-10-07 11:24:07.699101] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:12.363 [2024-10-07 11:24:07.699152] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:12.363 2024/10/07 11:24:07 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:13:12.363 [2024-10-07 11:24:07.714287] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:12.363 [2024-10-07 11:24:07.714337] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:12.363 2024/10/07 11:24:07 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:13:12.363 [2024-10-07 11:24:07.730137] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:12.363 [2024-10-07 11:24:07.730186] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:12.363 2024/10/07 11:24:07 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:13:12.363 [2024-10-07 11:24:07.746482] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:12.363 [2024-10-07 11:24:07.746535] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:12.363 2024/10/07 11:24:07 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:13:12.363 [2024-10-07 11:24:07.763639] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:12.363 [2024-10-07 11:24:07.763703] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:12.363 2024/10/07 11:24:07 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:13:12.363 [2024-10-07 11:24:07.778895] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:12.363 [2024-10-07 11:24:07.778944] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:12.363 2024/10/07 11:24:07 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:13:12.363 [2024-10-07 11:24:07.794424] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:12.363 [2024-10-07 11:24:07.794478] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:12.363 2024/10/07 11:24:07 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:13:12.363 11423.00 IOPS, 89.24 MiB/s [2024-10-07T11:24:07.886Z] [2024-10-07 11:24:07.804255] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:12.363 [2024-10-07 11:24:07.804296] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:12.363 2024/10/07 11:24:07 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:13:12.364 [2024-10-07 11:24:07.818875] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:12.364 [2024-10-07 11:24:07.818919] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:12.364 2024/10/07 11:24:07 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:13:12.364 [2024-10-07 11:24:07.829056] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:12.364 [2024-10-07 11:24:07.829108] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:12.364 2024/10/07 11:24:07 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:13:12.364 [2024-10-07 11:24:07.843797] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:12.364 [2024-10-07 11:24:07.843840] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:12.364 2024/10/07 11:24:07 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:13:12.364 [2024-10-07 11:24:07.854532] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:12.364 [2024-10-07 11:24:07.854584] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:12.364 2024/10/07 11:24:07 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:13:12.364 [2024-10-07 11:24:07.869143] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:12.364 [2024-10-07 11:24:07.869187] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:12.364 2024/10/07 11:24:07 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:13:12.364 [2024-10-07 11:24:07.884342] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:12.364 [2024-10-07 11:24:07.884383] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:12.622 2024/10/07 11:24:07 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:13:12.622 [2024-10-07 11:24:07.899336] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:12.622 [2024-10-07 11:24:07.899382] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:12.622 2024/10/07 11:24:07 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:13:12.622 [2024-10-07 11:24:07.909805] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:12.622 [2024-10-07 11:24:07.909847] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:12.622 2024/10/07 11:24:07 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:13:12.622 [2024-10-07 11:24:07.920555] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:12.622 [2024-10-07 11:24:07.920600] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:12.622 2024/10/07 11:24:07 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:13:12.622 [2024-10-07 11:24:07.931321] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:12.622 [2024-10-07 11:24:07.931362] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:12.622 2024/10/07 11:24:07 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:13:12.622 [2024-10-07 11:24:07.942256] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:12.622 [2024-10-07 11:24:07.942297] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:12.622 2024/10/07 11:24:07 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:13:12.622 [2024-10-07 11:24:07.955522] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:12.622 [2024-10-07 11:24:07.955562] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:12.622 2024/10/07 11:24:07 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:13:12.622 [2024-10-07 11:24:07.970941] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:12.622 [2024-10-07 11:24:07.970983] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:12.622 2024/10/07 11:24:07 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:13:12.622 [2024-10-07 11:24:07.980474] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:12.622 [2024-10-07 11:24:07.980518] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:12.622 2024/10/07 11:24:07 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:13:12.622 [2024-10-07 11:24:07.996376] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:12.622 [2024-10-07 11:24:07.996426] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:12.622 2024/10/07 11:24:07 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:13:12.622 [2024-10-07 11:24:08.006748] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:12.622 [2024-10-07 11:24:08.006788] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:12.622 2024/10/07 11:24:08 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:13:12.622 [2024-10-07 11:24:08.021252] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:12.622 [2024-10-07 11:24:08.021297] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:12.622 2024/10/07 11:24:08 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:13:12.622 [2024-10-07 11:24:08.037077] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:12.622 [2024-10-07 11:24:08.037131] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:12.622 2024/10/07 11:24:08 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:13:12.622 [2024-10-07 11:24:08.046239] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:12.622 [2024-10-07 11:24:08.046282] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:12.622 2024/10/07 11:24:08 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:13:12.622 [2024-10-07 11:24:08.062097] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:12.622 [2024-10-07 11:24:08.062145] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:12.622 2024/10/07 11:24:08 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:13:12.622 [2024-10-07 11:24:08.077772] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:12.622 [2024-10-07 11:24:08.077821] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:12.622 2024/10/07 11:24:08 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:13:12.622 [2024-10-07 11:24:08.088139] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:12.623 [2024-10-07 11:24:08.088184] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:12.623 2024/10/07 11:24:08 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:13:12.623 [2024-10-07 11:24:08.099467] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:12.623 [2024-10-07 11:24:08.099512] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:12.623 2024/10/07 11:24:08 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:13:12.623 [2024-10-07 11:24:08.117824] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:12.623 [2024-10-07 11:24:08.117879] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:12.623 2024/10/07 11:24:08 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:13:12.623 [2024-10-07 11:24:08.133152] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:12.623 [2024-10-07 11:24:08.133204] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:12.623 2024/10/07 11:24:08 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:13:12.623 [2024-10-07 11:24:08.143595] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:12.623 [2024-10-07 11:24:08.143638] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:12.880 2024/10/07 11:24:08 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:13:12.880 [2024-10-07 11:24:08.158250] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:12.880 [2024-10-07 11:24:08.158300] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:12.880 2024/10/07 11:24:08 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:13:12.880 [2024-10-07 11:24:08.174070] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:12.880 [2024-10-07 11:24:08.174123] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:12.880 2024/10/07 11:24:08 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:13:12.880 [2024-10-07 11:24:08.184680] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:12.880 [2024-10-07 11:24:08.184726] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:12.881 2024/10/07 11:24:08 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:13:12.881 [2024-10-07 11:24:08.199432] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:12.881 [2024-10-07 11:24:08.199486] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:12.881 2024/10/07 11:24:08 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:13:12.881 [2024-10-07 11:24:08.216482] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:12.881 [2024-10-07 11:24:08.216535] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:12.881 2024/10/07 11:24:08 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:13:12.881 [2024-10-07 11:24:08.232505] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:12.881 [2024-10-07 11:24:08.232561] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:12.881 2024/10/07 11:24:08 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:13:12.881 [2024-10-07 11:24:08.249427] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:12.881 [2024-10-07 11:24:08.249478] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:12.881 2024/10/07 11:24:08 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:13:12.881 [2024-10-07 11:24:08.264957] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:12.881 [2024-10-07 11:24:08.265009] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:12.881 2024/10/07 11:24:08 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:13:12.881 [2024-10-07 11:24:08.275143] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:12.881 [2024-10-07 11:24:08.275198] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:12.881 2024/10/07 11:24:08 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:13:12.881 [2024-10-07 11:24:08.289563] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:12.881 [2024-10-07 11:24:08.289619] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:12.881 2024/10/07 11:24:08 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:13:12.881 [2024-10-07 11:24:08.299525] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:12.881 [2024-10-07 11:24:08.299565] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:12.881 2024/10/07 11:24:08 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:13:12.881 [2024-10-07 11:24:08.311153] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:12.881 [2024-10-07 11:24:08.311195] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:12.881 2024/10/07 11:24:08 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:13:12.881 [2024-10-07 11:24:08.326384] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:12.881 [2024-10-07 11:24:08.326430] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:12.881 2024/10/07 11:24:08 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:13:12.881 [2024-10-07 11:24:08.342843] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:12.881 [2024-10-07 11:24:08.342904] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:12.881 2024/10/07 11:24:08 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:13:12.881 [2024-10-07 11:24:08.359919] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:12.881 [2024-10-07 11:24:08.359977] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:12.881 2024/10/07 11:24:08 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:13:12.881 [2024-10-07 11:24:08.370557] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:12.881 [2024-10-07 11:24:08.370600] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:12.881 2024/10/07 11:24:08 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:13:12.881 [2024-10-07 11:24:08.385608] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:12.881 [2024-10-07 11:24:08.385666] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:12.881 2024/10/07 11:24:08 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:13:12.881 [2024-10-07 11:24:08.401241] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:12.881 [2024-10-07 11:24:08.401291] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:13.139 2024/10/07 11:24:08 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:13:13.139 [2024-10-07 11:24:08.416831] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:13.139 [2024-10-07 11:24:08.416878] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:13.139 2024/10/07 11:24:08 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:13:13.139 [2024-10-07 11:24:08.427501] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:13.139 [2024-10-07 11:24:08.427545] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:13.139 2024/10/07 11:24:08 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:13:13.139 [2024-10-07 11:24:08.442180] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:13.139 [2024-10-07 11:24:08.442235] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:13.139 2024/10/07 11:24:08 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:13:13.139 [2024-10-07 11:24:08.452662] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:13.139 [2024-10-07 11:24:08.452721] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:13.139 2024/10/07 11:24:08 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:13:13.139 [2024-10-07 11:24:08.468098] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:13.139 [2024-10-07 11:24:08.468155] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:13.139 2024/10/07 11:24:08 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:13:13.139 [2024-10-07 11:24:08.484145] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:13.139 [2024-10-07 11:24:08.484198] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:13.139 2024/10/07 11:24:08 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:13:13.139 [2024-10-07 11:24:08.500516] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:13.139 [2024-10-07 11:24:08.500570] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:13.139 2024/10/07 11:24:08 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:13:13.139 [2024-10-07 11:24:08.518232] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:13.139 [2024-10-07 11:24:08.518282] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:13.139 2024/10/07 11:24:08 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:13:13.139 [2024-10-07 11:24:08.533471] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:13.139 [2024-10-07 11:24:08.533521] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:13.139 2024/10/07 11:24:08 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:13:13.139 [2024-10-07 11:24:08.543754] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:13.139 [2024-10-07 11:24:08.543796] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:13.139 2024/10/07 11:24:08 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:13:13.139 [2024-10-07 11:24:08.555134] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:13.139 [2024-10-07 11:24:08.555188] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:13.139 2024/10/07 11:24:08 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:13:13.139 [2024-10-07 11:24:08.570369] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:13.139 [2024-10-07 11:24:08.570420] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:13.139 2024/10/07 11:24:08 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:13:13.139 [2024-10-07 11:24:08.587568] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:13.139 [2024-10-07 11:24:08.587619] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:13.139 2024/10/07 11:24:08 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:13:13.139 [2024-10-07 11:24:08.602976] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:13.139 [2024-10-07 11:24:08.603027] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:13.139 2024/10/07 11:24:08 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:13:13.139 [2024-10-07 11:24:08.612521] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:13.139 [2024-10-07 11:24:08.612565] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:13.139 2024/10/07 11:24:08 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:13:13.139 [2024-10-07 11:24:08.624365] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:13.139 [2024-10-07 11:24:08.624411] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:13.139 2024/10/07 11:24:08 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:13:13.139 [2024-10-07 11:24:08.635581] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:13.139 [2024-10-07 11:24:08.635634] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:13.139 2024/10/07 11:24:08 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:13:13.139 [2024-10-07 11:24:08.648731] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:13.139 [2024-10-07 11:24:08.648790] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:13.139 2024/10/07 11:24:08 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:13:13.139 [2024-10-07 11:24:08.659566] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:13.139 [2024-10-07 11:24:08.659609] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:13.139 2024/10/07 11:24:08 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:13:13.396 [2024-10-07 11:24:08.674487] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:13.396 [2024-10-07 11:24:08.674537] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:13.396 2024/10/07 11:24:08 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:13:13.396 [2024-10-07 11:24:08.692753] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:13.396 [2024-10-07 11:24:08.692805] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:13.396 2024/10/07 11:24:08 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:13:13.396 [2024-10-07 11:24:08.708188] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:13.396 [2024-10-07 11:24:08.708258] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:13.396 2024/10/07 11:24:08 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:13:13.396 [2024-10-07 11:24:08.724131] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:13.396 [2024-10-07 11:24:08.724204] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:13.396 2024/10/07 11:24:08 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:13:13.396 [2024-10-07 11:24:08.739964] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:13.397 [2024-10-07 11:24:08.740019] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:13.397 2024/10/07 11:24:08 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:13:13.397 [2024-10-07 11:24:08.757360] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:13.397 [2024-10-07 11:24:08.757415] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:13.397 2024/10/07 11:24:08 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:13:13.397 [2024-10-07 11:24:08.772620] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:13.397 [2024-10-07 11:24:08.772679] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:13.397 2024/10/07 11:24:08 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:13:13.397 [2024-10-07 11:24:08.782467] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:13.397 [2024-10-07 11:24:08.782506] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:13.397 2024/10/07 11:24:08 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:13:13.397 [2024-10-07 11:24:08.793952] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:13.397 [2024-10-07 11:24:08.793995] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:13.397 2024/10/07 11:24:08 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:13:13.397 11452.20 IOPS, 89.47 MiB/s [2024-10-07T11:24:08.920Z] [2024-10-07 11:24:08.806510] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:13.397 [2024-10-07 11:24:08.806555] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:13.397 00:13:13.397 Latency(us) 00:13:13.397 [2024-10-07T11:24:08.920Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:13:13.397 Job: Nvme1n1 (Core Mask 0x1, workload: randrw, percentage: 50, depth: 128, IO size: 8192) 00:13:13.397 Nvme1n1 : 5.01 11456.24 89.50 0.00 0.00 11158.99 5034.36 17873.45 00:13:13.397 [2024-10-07T11:24:08.920Z] =================================================================================================================== 00:13:13.397 [2024-10-07T11:24:08.920Z] Total : 11456.24 89.50 0.00 0.00 11158.99 5034.36 17873.45 00:13:13.397 2024/10/07 11:24:08 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:13:13.397 [2024-10-07 11:24:08.817480] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:13.397 [2024-10-07 11:24:08.817518] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:13.397 2024/10/07 11:24:08 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:13:13.397 [2024-10-07 11:24:08.829490] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:13.397 [2024-10-07 11:24:08.829529] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:13.397 2024/10/07 11:24:08 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:13:13.397 [2024-10-07 11:24:08.841497] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:13.397 [2024-10-07 11:24:08.841539] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:13.397 2024/10/07 11:24:08 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:13:13.397 [2024-10-07 11:24:08.853503] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:13.397 [2024-10-07 11:24:08.853546] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:13.397 2024/10/07 11:24:08 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:13:13.397 [2024-10-07 11:24:08.865498] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:13.397 [2024-10-07 11:24:08.865537] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:13.397 2024/10/07 11:24:08 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:13:13.397 [2024-10-07 11:24:08.877490] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:13.397 [2024-10-07 11:24:08.877526] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:13.397 2024/10/07 11:24:08 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:13:13.397 [2024-10-07 11:24:08.889495] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:13.397 [2024-10-07 11:24:08.889532] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:13.397 2024/10/07 11:24:08 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:13:13.397 [2024-10-07 11:24:08.901517] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:13.397 [2024-10-07 11:24:08.901557] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:13.397 2024/10/07 11:24:08 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:13:13.397 [2024-10-07 11:24:08.913523] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:13.397 [2024-10-07 11:24:08.913582] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:13.397 2024/10/07 11:24:08 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:13:13.655 [2024-10-07 11:24:08.925528] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:13.655 [2024-10-07 11:24:08.925571] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:13.655 2024/10/07 11:24:08 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:13:13.655 [2024-10-07 11:24:08.937527] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:13.655 [2024-10-07 11:24:08.937567] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:13.655 2024/10/07 11:24:08 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:13:13.655 [2024-10-07 11:24:08.949508] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:13.655 [2024-10-07 11:24:08.949544] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:13.655 2024/10/07 11:24:08 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:13:13.655 [2024-10-07 11:24:08.957496] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:13.655 [2024-10-07 11:24:08.957526] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:13.655 2024/10/07 11:24:08 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:13:13.655 [2024-10-07 11:24:08.965505] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:13.655 [2024-10-07 11:24:08.965533] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:13.655 2024/10/07 11:24:08 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:13:13.655 [2024-10-07 11:24:08.973501] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:13.655 [2024-10-07 11:24:08.973534] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:13.655 2024/10/07 11:24:08 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:13:13.655 [2024-10-07 11:24:08.985514] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:13.655 [2024-10-07 11:24:08.985546] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:13.655 2024/10/07 11:24:08 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:13:13.655 [2024-10-07 11:24:08.997529] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:13.655 [2024-10-07 11:24:08.997563] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:13.655 2024/10/07 11:24:09 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:13:13.655 [2024-10-07 11:24:09.009538] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:13.655 [2024-10-07 11:24:09.009577] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:13.655 2024/10/07 11:24:09 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:13:13.655 [2024-10-07 11:24:09.021529] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:13.655 [2024-10-07 11:24:09.021565] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:13.655 2024/10/07 11:24:09 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:13:13.655 [2024-10-07 11:24:09.033558] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:13.655 [2024-10-07 11:24:09.033599] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:13.655 2024/10/07 11:24:09 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:13:13.655 [2024-10-07 11:24:09.045563] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:13.655 [2024-10-07 11:24:09.045607] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:13.655 2024/10/07 11:24:09 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:13:13.655 [2024-10-07 11:24:09.057557] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:13.655 [2024-10-07 11:24:09.057596] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:13.655 2024/10/07 11:24:09 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:13:13.655 [2024-10-07 11:24:09.069562] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:13.655 [2024-10-07 11:24:09.069606] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:13.655 2024/10/07 11:24:09 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:13:13.655 [2024-10-07 11:24:09.081552] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:13.655 [2024-10-07 11:24:09.081588] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:13.655 2024/10/07 11:24:09 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:13:13.655 [2024-10-07 11:24:09.093552] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:13.655 [2024-10-07 11:24:09.093588] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:13.655 2024/10/07 11:24:09 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:13:13.655 [2024-10-07 11:24:09.101536] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:13.655 [2024-10-07 11:24:09.101566] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:13.655 2024/10/07 11:24:09 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:13:13.655 [2024-10-07 11:24:09.109538] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:13.655 [2024-10-07 11:24:09.109566] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:13.655 2024/10/07 11:24:09 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:13:13.655 [2024-10-07 11:24:09.117541] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:13:13.655 [2024-10-07 11:24:09.117572] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:13.655 2024/10/07 11:24:09 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:13:13.656 /home/vagrant/spdk_repo/spdk/test/nvmf/target/zcopy.sh: line 42: kill: (69512) - No such process 00:13:13.656 11:24:09 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- target/zcopy.sh@49 -- # wait 69512 00:13:13.656 11:24:09 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- target/zcopy.sh@52 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:13.656 11:24:09 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:13.656 11:24:09 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- common/autotest_common.sh@10 -- # set +x 00:13:13.656 11:24:09 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:13.656 11:24:09 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- target/zcopy.sh@53 -- # rpc_cmd bdev_delay_create -b malloc0 -d delay0 -r 1000000 -t 1000000 -w 1000000 -n 1000000 00:13:13.656 11:24:09 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:13.656 11:24:09 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- common/autotest_common.sh@10 -- # set +x 00:13:13.656 delay0 00:13:13.656 11:24:09 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:13.656 11:24:09 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- target/zcopy.sh@54 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 delay0 -n 1 00:13:13.656 11:24:09 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:13.656 11:24:09 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- common/autotest_common.sh@10 -- # set +x 00:13:13.656 11:24:09 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:13.656 11:24:09 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- target/zcopy.sh@56 -- # /home/vagrant/spdk_repo/spdk/build/examples/abort -c 0x1 -t 5 -q 64 -w randrw -M 50 -l warning -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.3 trsvcid:4420 ns:1' 00:13:13.913 [2024-10-07 11:24:09.322768] nvme_fabric.c: 295:nvme_fabric_discover_probe: *WARNING*: Skipping unsupported current discovery service or discovery service referral 00:13:20.471 Initializing NVMe Controllers 00:13:20.471 Attached to NVMe over Fabrics controller at 10.0.0.3:4420: nqn.2016-06.io.spdk:cnode1 00:13:20.471 Associating TCP (addr:10.0.0.3 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:13:20.471 Initialization complete. Launching workers. 00:13:20.471 NS: TCP (addr:10.0.0.3 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 I/O completed: 320, failed: 355 00:13:20.471 CTRLR: TCP (addr:10.0.0.3 subnqn:nqn.2016-06.io.spdk:cnode1) abort submitted 642, failed to submit 33 00:13:20.471 success 444, unsuccessful 198, failed 0 00:13:20.471 11:24:15 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- target/zcopy.sh@59 -- # trap - SIGINT SIGTERM EXIT 00:13:20.471 11:24:15 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- target/zcopy.sh@60 -- # nvmftestfini 00:13:20.471 11:24:15 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@514 -- # nvmfcleanup 00:13:20.471 11:24:15 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@121 -- # sync 00:13:20.471 11:24:15 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@123 -- # '[' tcp == tcp ']' 00:13:20.471 11:24:15 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@124 -- # set +e 00:13:20.471 11:24:15 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@125 -- # for i in {1..20} 00:13:20.471 11:24:15 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@126 -- # modprobe -v -r nvme-tcp 00:13:20.471 rmmod nvme_tcp 00:13:20.471 rmmod nvme_fabrics 00:13:20.471 rmmod nvme_keyring 00:13:20.471 11:24:15 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@127 -- # modprobe -v -r nvme-fabrics 00:13:20.471 11:24:15 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@128 -- # set -e 00:13:20.471 11:24:15 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@129 -- # return 0 00:13:20.471 11:24:15 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@515 -- # '[' -n 69339 ']' 00:13:20.471 11:24:15 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@516 -- # killprocess 69339 00:13:20.471 11:24:15 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- common/autotest_common.sh@950 -- # '[' -z 69339 ']' 00:13:20.471 11:24:15 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- common/autotest_common.sh@954 -- # kill -0 69339 00:13:20.471 11:24:15 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- common/autotest_common.sh@955 -- # uname 00:13:20.471 11:24:15 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- common/autotest_common.sh@955 -- # '[' Linux = Linux ']' 00:13:20.471 11:24:15 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- common/autotest_common.sh@956 -- # ps --no-headers -o comm= 69339 00:13:20.471 11:24:15 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- common/autotest_common.sh@956 -- # process_name=reactor_1 00:13:20.471 killing process with pid 69339 00:13:20.471 11:24:15 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- common/autotest_common.sh@960 -- # '[' reactor_1 = sudo ']' 00:13:20.471 11:24:15 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- common/autotest_common.sh@968 -- # echo 'killing process with pid 69339' 00:13:20.471 11:24:15 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- common/autotest_common.sh@969 -- # kill 69339 00:13:20.471 11:24:15 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- common/autotest_common.sh@974 -- # wait 69339 00:13:20.471 11:24:15 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@518 -- # '[' '' == iso ']' 00:13:20.471 11:24:15 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@521 -- # [[ tcp == \t\c\p ]] 00:13:20.471 11:24:15 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@522 -- # nvmf_tcp_fini 00:13:20.471 11:24:15 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@297 -- # iptr 00:13:20.471 11:24:15 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@789 -- # iptables-save 00:13:20.471 11:24:15 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@789 -- # grep -v SPDK_NVMF 00:13:20.471 11:24:15 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@789 -- # iptables-restore 00:13:20.471 11:24:15 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@298 -- # [[ nvmf_tgt_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s\_\s\p\d\k ]] 00:13:20.471 11:24:15 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@299 -- # nvmf_veth_fini 00:13:20.471 11:24:15 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@233 -- # ip link set nvmf_init_br nomaster 00:13:20.471 11:24:15 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@234 -- # ip link set nvmf_init_br2 nomaster 00:13:20.471 11:24:15 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@235 -- # ip link set nvmf_tgt_br nomaster 00:13:20.471 11:24:15 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@236 -- # ip link set nvmf_tgt_br2 nomaster 00:13:20.471 11:24:15 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@237 -- # ip link set nvmf_init_br down 00:13:20.471 11:24:15 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@238 -- # ip link set nvmf_init_br2 down 00:13:20.471 11:24:15 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@239 -- # ip link set nvmf_tgt_br down 00:13:20.471 11:24:15 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@240 -- # ip link set nvmf_tgt_br2 down 00:13:20.471 11:24:15 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@241 -- # ip link delete nvmf_br type bridge 00:13:20.471 11:24:15 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@242 -- # ip link delete nvmf_init_if 00:13:20.471 11:24:15 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@243 -- # ip link delete nvmf_init_if2 00:13:20.471 11:24:15 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@244 -- # ip netns exec nvmf_tgt_ns_spdk ip link delete nvmf_tgt_if 00:13:20.729 11:24:16 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@245 -- # ip netns exec nvmf_tgt_ns_spdk ip link delete nvmf_tgt_if2 00:13:20.729 11:24:16 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@246 -- # remove_spdk_ns 00:13:20.729 11:24:16 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@654 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:13:20.729 11:24:16 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 15> /dev/null' 00:13:20.729 11:24:16 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:13:20.729 11:24:16 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@300 -- # return 0 00:13:20.729 00:13:20.729 real 0m25.702s 00:13:20.729 user 0m41.117s 00:13:20.729 sys 0m6.836s 00:13:20.729 11:24:16 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- common/autotest_common.sh@1126 -- # xtrace_disable 00:13:20.729 ************************************ 00:13:20.729 END TEST nvmf_zcopy 00:13:20.729 ************************************ 00:13:20.729 11:24:16 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- common/autotest_common.sh@10 -- # set +x 00:13:20.729 11:24:16 nvmf_tcp.nvmf_target_core -- nvmf/nvmf_target_core.sh@33 -- # run_test nvmf_nmic /home/vagrant/spdk_repo/spdk/test/nvmf/target/nmic.sh --transport=tcp 00:13:20.729 11:24:16 nvmf_tcp.nvmf_target_core -- common/autotest_common.sh@1101 -- # '[' 3 -le 1 ']' 00:13:20.729 11:24:16 nvmf_tcp.nvmf_target_core -- common/autotest_common.sh@1107 -- # xtrace_disable 00:13:20.729 11:24:16 nvmf_tcp.nvmf_target_core -- common/autotest_common.sh@10 -- # set +x 00:13:20.729 ************************************ 00:13:20.729 START TEST nvmf_nmic 00:13:20.729 ************************************ 00:13:20.729 11:24:16 nvmf_tcp.nvmf_target_core.nvmf_nmic -- common/autotest_common.sh@1125 -- # /home/vagrant/spdk_repo/spdk/test/nvmf/target/nmic.sh --transport=tcp 00:13:20.729 * Looking for test storage... 00:13:20.729 * Found test storage at /home/vagrant/spdk_repo/spdk/test/nvmf/target 00:13:20.729 11:24:16 nvmf_tcp.nvmf_target_core.nvmf_nmic -- common/autotest_common.sh@1680 -- # [[ y == y ]] 00:13:20.729 11:24:16 nvmf_tcp.nvmf_target_core.nvmf_nmic -- common/autotest_common.sh@1681 -- # lcov --version 00:13:20.729 11:24:16 nvmf_tcp.nvmf_target_core.nvmf_nmic -- common/autotest_common.sh@1681 -- # awk '{print $NF}' 00:13:20.987 11:24:16 nvmf_tcp.nvmf_target_core.nvmf_nmic -- common/autotest_common.sh@1681 -- # lt 1.15 2 00:13:20.987 11:24:16 nvmf_tcp.nvmf_target_core.nvmf_nmic -- scripts/common.sh@373 -- # cmp_versions 1.15 '<' 2 00:13:20.987 11:24:16 nvmf_tcp.nvmf_target_core.nvmf_nmic -- scripts/common.sh@333 -- # local ver1 ver1_l 00:13:20.987 11:24:16 nvmf_tcp.nvmf_target_core.nvmf_nmic -- scripts/common.sh@334 -- # local ver2 ver2_l 00:13:20.988 11:24:16 nvmf_tcp.nvmf_target_core.nvmf_nmic -- scripts/common.sh@336 -- # IFS=.-: 00:13:20.988 11:24:16 nvmf_tcp.nvmf_target_core.nvmf_nmic -- scripts/common.sh@336 -- # read -ra ver1 00:13:20.988 11:24:16 nvmf_tcp.nvmf_target_core.nvmf_nmic -- scripts/common.sh@337 -- # IFS=.-: 00:13:20.988 11:24:16 nvmf_tcp.nvmf_target_core.nvmf_nmic -- scripts/common.sh@337 -- # read -ra ver2 00:13:20.988 11:24:16 nvmf_tcp.nvmf_target_core.nvmf_nmic -- scripts/common.sh@338 -- # local 'op=<' 00:13:20.988 11:24:16 nvmf_tcp.nvmf_target_core.nvmf_nmic -- scripts/common.sh@340 -- # ver1_l=2 00:13:20.988 11:24:16 nvmf_tcp.nvmf_target_core.nvmf_nmic -- scripts/common.sh@341 -- # ver2_l=1 00:13:20.988 11:24:16 nvmf_tcp.nvmf_target_core.nvmf_nmic -- scripts/common.sh@343 -- # local lt=0 gt=0 eq=0 v 00:13:20.988 11:24:16 nvmf_tcp.nvmf_target_core.nvmf_nmic -- scripts/common.sh@344 -- # case "$op" in 00:13:20.988 11:24:16 nvmf_tcp.nvmf_target_core.nvmf_nmic -- scripts/common.sh@345 -- # : 1 00:13:20.988 11:24:16 nvmf_tcp.nvmf_target_core.nvmf_nmic -- scripts/common.sh@364 -- # (( v = 0 )) 00:13:20.988 11:24:16 nvmf_tcp.nvmf_target_core.nvmf_nmic -- scripts/common.sh@364 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:13:20.988 11:24:16 nvmf_tcp.nvmf_target_core.nvmf_nmic -- scripts/common.sh@365 -- # decimal 1 00:13:20.988 11:24:16 nvmf_tcp.nvmf_target_core.nvmf_nmic -- scripts/common.sh@353 -- # local d=1 00:13:20.988 11:24:16 nvmf_tcp.nvmf_target_core.nvmf_nmic -- scripts/common.sh@354 -- # [[ 1 =~ ^[0-9]+$ ]] 00:13:20.988 11:24:16 nvmf_tcp.nvmf_target_core.nvmf_nmic -- scripts/common.sh@355 -- # echo 1 00:13:20.988 11:24:16 nvmf_tcp.nvmf_target_core.nvmf_nmic -- scripts/common.sh@365 -- # ver1[v]=1 00:13:20.988 11:24:16 nvmf_tcp.nvmf_target_core.nvmf_nmic -- scripts/common.sh@366 -- # decimal 2 00:13:20.988 11:24:16 nvmf_tcp.nvmf_target_core.nvmf_nmic -- scripts/common.sh@353 -- # local d=2 00:13:20.988 11:24:16 nvmf_tcp.nvmf_target_core.nvmf_nmic -- scripts/common.sh@354 -- # [[ 2 =~ ^[0-9]+$ ]] 00:13:20.988 11:24:16 nvmf_tcp.nvmf_target_core.nvmf_nmic -- scripts/common.sh@355 -- # echo 2 00:13:20.988 11:24:16 nvmf_tcp.nvmf_target_core.nvmf_nmic -- scripts/common.sh@366 -- # ver2[v]=2 00:13:20.988 11:24:16 nvmf_tcp.nvmf_target_core.nvmf_nmic -- scripts/common.sh@367 -- # (( ver1[v] > ver2[v] )) 00:13:20.988 11:24:16 nvmf_tcp.nvmf_target_core.nvmf_nmic -- scripts/common.sh@368 -- # (( ver1[v] < ver2[v] )) 00:13:20.988 11:24:16 nvmf_tcp.nvmf_target_core.nvmf_nmic -- scripts/common.sh@368 -- # return 0 00:13:20.988 11:24:16 nvmf_tcp.nvmf_target_core.nvmf_nmic -- common/autotest_common.sh@1682 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:13:20.988 11:24:16 nvmf_tcp.nvmf_target_core.nvmf_nmic -- common/autotest_common.sh@1694 -- # export 'LCOV_OPTS= 00:13:20.988 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:13:20.988 --rc genhtml_branch_coverage=1 00:13:20.988 --rc genhtml_function_coverage=1 00:13:20.988 --rc genhtml_legend=1 00:13:20.988 --rc geninfo_all_blocks=1 00:13:20.988 --rc geninfo_unexecuted_blocks=1 00:13:20.988 00:13:20.988 ' 00:13:20.988 11:24:16 nvmf_tcp.nvmf_target_core.nvmf_nmic -- common/autotest_common.sh@1694 -- # LCOV_OPTS=' 00:13:20.988 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:13:20.988 --rc genhtml_branch_coverage=1 00:13:20.988 --rc genhtml_function_coverage=1 00:13:20.988 --rc genhtml_legend=1 00:13:20.988 --rc geninfo_all_blocks=1 00:13:20.988 --rc geninfo_unexecuted_blocks=1 00:13:20.988 00:13:20.988 ' 00:13:20.988 11:24:16 nvmf_tcp.nvmf_target_core.nvmf_nmic -- common/autotest_common.sh@1695 -- # export 'LCOV=lcov 00:13:20.988 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:13:20.988 --rc genhtml_branch_coverage=1 00:13:20.988 --rc genhtml_function_coverage=1 00:13:20.988 --rc genhtml_legend=1 00:13:20.988 --rc geninfo_all_blocks=1 00:13:20.988 --rc geninfo_unexecuted_blocks=1 00:13:20.988 00:13:20.988 ' 00:13:20.988 11:24:16 nvmf_tcp.nvmf_target_core.nvmf_nmic -- common/autotest_common.sh@1695 -- # LCOV='lcov 00:13:20.988 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:13:20.988 --rc genhtml_branch_coverage=1 00:13:20.988 --rc genhtml_function_coverage=1 00:13:20.988 --rc genhtml_legend=1 00:13:20.988 --rc geninfo_all_blocks=1 00:13:20.988 --rc geninfo_unexecuted_blocks=1 00:13:20.988 00:13:20.988 ' 00:13:20.988 11:24:16 nvmf_tcp.nvmf_target_core.nvmf_nmic -- target/nmic.sh@9 -- # source /home/vagrant/spdk_repo/spdk/test/nvmf/common.sh 00:13:20.988 11:24:16 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@7 -- # uname -s 00:13:20.988 11:24:16 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:13:20.988 11:24:16 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:13:20.988 11:24:16 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:13:20.988 11:24:16 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:13:20.988 11:24:16 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:13:20.988 11:24:16 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:13:20.988 11:24:16 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:13:20.988 11:24:16 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:13:20.988 11:24:16 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:13:20.988 11:24:16 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:13:20.988 11:24:16 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:c758a4ed-f09f-4c82-9afb-3d096f035464 00:13:20.988 11:24:16 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@18 -- # NVME_HOSTID=c758a4ed-f09f-4c82-9afb-3d096f035464 00:13:20.988 11:24:16 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:13:20.988 11:24:16 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:13:20.988 11:24:16 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@21 -- # NET_TYPE=virt 00:13:20.988 11:24:16 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:13:20.988 11:24:16 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@49 -- # source /home/vagrant/spdk_repo/spdk/scripts/common.sh 00:13:20.988 11:24:16 nvmf_tcp.nvmf_target_core.nvmf_nmic -- scripts/common.sh@15 -- # shopt -s extglob 00:13:20.988 11:24:16 nvmf_tcp.nvmf_target_core.nvmf_nmic -- scripts/common.sh@544 -- # [[ -e /bin/wpdk_common.sh ]] 00:13:20.988 11:24:16 nvmf_tcp.nvmf_target_core.nvmf_nmic -- scripts/common.sh@552 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:13:20.988 11:24:16 nvmf_tcp.nvmf_target_core.nvmf_nmic -- scripts/common.sh@553 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:13:20.988 11:24:16 nvmf_tcp.nvmf_target_core.nvmf_nmic -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:20.988 11:24:16 nvmf_tcp.nvmf_target_core.nvmf_nmic -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:20.988 11:24:16 nvmf_tcp.nvmf_target_core.nvmf_nmic -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:20.988 11:24:16 nvmf_tcp.nvmf_target_core.nvmf_nmic -- paths/export.sh@5 -- # export PATH 00:13:20.988 11:24:16 nvmf_tcp.nvmf_target_core.nvmf_nmic -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:20.988 11:24:16 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@51 -- # : 0 00:13:20.988 11:24:16 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@52 -- # export NVMF_APP_SHM_ID 00:13:20.988 11:24:16 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@53 -- # build_nvmf_app_args 00:13:20.988 11:24:16 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:13:20.988 11:24:16 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:13:20.988 11:24:16 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:13:20.988 11:24:16 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@33 -- # '[' '' -eq 1 ']' 00:13:20.988 /home/vagrant/spdk_repo/spdk/test/nvmf/common.sh: line 33: [: : integer expression expected 00:13:20.988 11:24:16 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@37 -- # '[' -n '' ']' 00:13:20.988 11:24:16 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@39 -- # '[' 0 -eq 1 ']' 00:13:20.988 11:24:16 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@55 -- # have_pci_nics=0 00:13:20.988 11:24:16 nvmf_tcp.nvmf_target_core.nvmf_nmic -- target/nmic.sh@11 -- # MALLOC_BDEV_SIZE=64 00:13:20.988 11:24:16 nvmf_tcp.nvmf_target_core.nvmf_nmic -- target/nmic.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:13:20.988 11:24:16 nvmf_tcp.nvmf_target_core.nvmf_nmic -- target/nmic.sh@14 -- # nvmftestinit 00:13:20.988 11:24:16 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@467 -- # '[' -z tcp ']' 00:13:20.988 11:24:16 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@472 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:13:20.988 11:24:16 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@474 -- # prepare_net_devs 00:13:20.988 11:24:16 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@436 -- # local -g is_hw=no 00:13:20.988 11:24:16 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@438 -- # remove_spdk_ns 00:13:20.988 11:24:16 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@654 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:13:20.988 11:24:16 nvmf_tcp.nvmf_target_core.nvmf_nmic -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 15> /dev/null' 00:13:20.988 11:24:16 nvmf_tcp.nvmf_target_core.nvmf_nmic -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:13:20.988 11:24:16 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@440 -- # [[ virt != virt ]] 00:13:20.988 11:24:16 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@442 -- # [[ no == yes ]] 00:13:20.989 11:24:16 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@449 -- # [[ virt == phy ]] 00:13:20.989 11:24:16 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@452 -- # [[ virt == phy-fallback ]] 00:13:20.989 11:24:16 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@457 -- # [[ tcp == tcp ]] 00:13:20.989 11:24:16 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@458 -- # nvmf_veth_init 00:13:20.989 11:24:16 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@145 -- # NVMF_FIRST_INITIATOR_IP=10.0.0.1 00:13:20.989 11:24:16 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@146 -- # NVMF_SECOND_INITIATOR_IP=10.0.0.2 00:13:20.989 11:24:16 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@147 -- # NVMF_FIRST_TARGET_IP=10.0.0.3 00:13:20.989 11:24:16 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@148 -- # NVMF_SECOND_TARGET_IP=10.0.0.4 00:13:20.989 11:24:16 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@149 -- # NVMF_INITIATOR_IP=10.0.0.1 00:13:20.989 11:24:16 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@150 -- # NVMF_BRIDGE=nvmf_br 00:13:20.989 11:24:16 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@151 -- # NVMF_INITIATOR_INTERFACE=nvmf_init_if 00:13:20.989 11:24:16 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@152 -- # NVMF_INITIATOR_INTERFACE2=nvmf_init_if2 00:13:20.989 11:24:16 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@153 -- # NVMF_INITIATOR_BRIDGE=nvmf_init_br 00:13:20.989 11:24:16 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@154 -- # NVMF_INITIATOR_BRIDGE2=nvmf_init_br2 00:13:20.989 11:24:16 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@155 -- # NVMF_TARGET_NAMESPACE=nvmf_tgt_ns_spdk 00:13:20.989 11:24:16 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@156 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:13:20.989 11:24:16 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@157 -- # NVMF_TARGET_INTERFACE=nvmf_tgt_if 00:13:20.989 11:24:16 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@158 -- # NVMF_TARGET_INTERFACE2=nvmf_tgt_if2 00:13:20.989 11:24:16 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@159 -- # NVMF_TARGET_BRIDGE=nvmf_tgt_br 00:13:20.989 11:24:16 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@160 -- # NVMF_TARGET_BRIDGE2=nvmf_tgt_br2 00:13:20.989 11:24:16 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@162 -- # ip link set nvmf_init_br nomaster 00:13:20.989 Cannot find device "nvmf_init_br" 00:13:20.989 11:24:16 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@162 -- # true 00:13:20.989 11:24:16 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@163 -- # ip link set nvmf_init_br2 nomaster 00:13:20.989 Cannot find device "nvmf_init_br2" 00:13:20.989 11:24:16 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@163 -- # true 00:13:20.989 11:24:16 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@164 -- # ip link set nvmf_tgt_br nomaster 00:13:20.989 Cannot find device "nvmf_tgt_br" 00:13:20.989 11:24:16 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@164 -- # true 00:13:20.989 11:24:16 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@165 -- # ip link set nvmf_tgt_br2 nomaster 00:13:20.989 Cannot find device "nvmf_tgt_br2" 00:13:20.989 11:24:16 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@165 -- # true 00:13:20.989 11:24:16 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@166 -- # ip link set nvmf_init_br down 00:13:20.989 Cannot find device "nvmf_init_br" 00:13:20.989 11:24:16 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@166 -- # true 00:13:20.989 11:24:16 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@167 -- # ip link set nvmf_init_br2 down 00:13:20.989 Cannot find device "nvmf_init_br2" 00:13:20.989 11:24:16 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@167 -- # true 00:13:20.989 11:24:16 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@168 -- # ip link set nvmf_tgt_br down 00:13:20.989 Cannot find device "nvmf_tgt_br" 00:13:20.989 11:24:16 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@168 -- # true 00:13:20.989 11:24:16 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@169 -- # ip link set nvmf_tgt_br2 down 00:13:20.989 Cannot find device "nvmf_tgt_br2" 00:13:20.989 11:24:16 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@169 -- # true 00:13:20.989 11:24:16 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@170 -- # ip link delete nvmf_br type bridge 00:13:20.989 Cannot find device "nvmf_br" 00:13:20.989 11:24:16 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@170 -- # true 00:13:20.989 11:24:16 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@171 -- # ip link delete nvmf_init_if 00:13:20.989 Cannot find device "nvmf_init_if" 00:13:20.989 11:24:16 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@171 -- # true 00:13:20.989 11:24:16 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@172 -- # ip link delete nvmf_init_if2 00:13:20.989 Cannot find device "nvmf_init_if2" 00:13:20.989 11:24:16 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@172 -- # true 00:13:20.989 11:24:16 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@173 -- # ip netns exec nvmf_tgt_ns_spdk ip link delete nvmf_tgt_if 00:13:20.989 Cannot open network namespace "nvmf_tgt_ns_spdk": No such file or directory 00:13:20.989 11:24:16 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@173 -- # true 00:13:20.989 11:24:16 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@174 -- # ip netns exec nvmf_tgt_ns_spdk ip link delete nvmf_tgt_if2 00:13:20.989 Cannot open network namespace "nvmf_tgt_ns_spdk": No such file or directory 00:13:20.989 11:24:16 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@174 -- # true 00:13:20.989 11:24:16 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@177 -- # ip netns add nvmf_tgt_ns_spdk 00:13:20.989 11:24:16 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@180 -- # ip link add nvmf_init_if type veth peer name nvmf_init_br 00:13:20.989 11:24:16 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@181 -- # ip link add nvmf_init_if2 type veth peer name nvmf_init_br2 00:13:20.989 11:24:16 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@182 -- # ip link add nvmf_tgt_if type veth peer name nvmf_tgt_br 00:13:20.989 11:24:16 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@183 -- # ip link add nvmf_tgt_if2 type veth peer name nvmf_tgt_br2 00:13:20.989 11:24:16 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@186 -- # ip link set nvmf_tgt_if netns nvmf_tgt_ns_spdk 00:13:20.989 11:24:16 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@187 -- # ip link set nvmf_tgt_if2 netns nvmf_tgt_ns_spdk 00:13:21.247 11:24:16 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@190 -- # ip addr add 10.0.0.1/24 dev nvmf_init_if 00:13:21.247 11:24:16 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@191 -- # ip addr add 10.0.0.2/24 dev nvmf_init_if2 00:13:21.247 11:24:16 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@192 -- # ip netns exec nvmf_tgt_ns_spdk ip addr add 10.0.0.3/24 dev nvmf_tgt_if 00:13:21.247 11:24:16 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@193 -- # ip netns exec nvmf_tgt_ns_spdk ip addr add 10.0.0.4/24 dev nvmf_tgt_if2 00:13:21.247 11:24:16 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@196 -- # ip link set nvmf_init_if up 00:13:21.247 11:24:16 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@197 -- # ip link set nvmf_init_if2 up 00:13:21.247 11:24:16 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@198 -- # ip link set nvmf_init_br up 00:13:21.247 11:24:16 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@199 -- # ip link set nvmf_init_br2 up 00:13:21.247 11:24:16 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@200 -- # ip link set nvmf_tgt_br up 00:13:21.247 11:24:16 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@201 -- # ip link set nvmf_tgt_br2 up 00:13:21.247 11:24:16 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@202 -- # ip netns exec nvmf_tgt_ns_spdk ip link set nvmf_tgt_if up 00:13:21.247 11:24:16 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@203 -- # ip netns exec nvmf_tgt_ns_spdk ip link set nvmf_tgt_if2 up 00:13:21.247 11:24:16 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@204 -- # ip netns exec nvmf_tgt_ns_spdk ip link set lo up 00:13:21.247 11:24:16 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@207 -- # ip link add nvmf_br type bridge 00:13:21.247 11:24:16 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@208 -- # ip link set nvmf_br up 00:13:21.247 11:24:16 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@211 -- # ip link set nvmf_init_br master nvmf_br 00:13:21.247 11:24:16 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@212 -- # ip link set nvmf_init_br2 master nvmf_br 00:13:21.247 11:24:16 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@213 -- # ip link set nvmf_tgt_br master nvmf_br 00:13:21.247 11:24:16 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@214 -- # ip link set nvmf_tgt_br2 master nvmf_br 00:13:21.247 11:24:16 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@217 -- # ipts -I INPUT 1 -i nvmf_init_if -p tcp --dport 4420 -j ACCEPT 00:13:21.247 11:24:16 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@788 -- # iptables -I INPUT 1 -i nvmf_init_if -p tcp --dport 4420 -j ACCEPT -m comment --comment 'SPDK_NVMF:-I INPUT 1 -i nvmf_init_if -p tcp --dport 4420 -j ACCEPT' 00:13:21.247 11:24:16 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@218 -- # ipts -I INPUT 1 -i nvmf_init_if2 -p tcp --dport 4420 -j ACCEPT 00:13:21.248 11:24:16 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@788 -- # iptables -I INPUT 1 -i nvmf_init_if2 -p tcp --dport 4420 -j ACCEPT -m comment --comment 'SPDK_NVMF:-I INPUT 1 -i nvmf_init_if2 -p tcp --dport 4420 -j ACCEPT' 00:13:21.248 11:24:16 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@219 -- # ipts -A FORWARD -i nvmf_br -o nvmf_br -j ACCEPT 00:13:21.248 11:24:16 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@788 -- # iptables -A FORWARD -i nvmf_br -o nvmf_br -j ACCEPT -m comment --comment 'SPDK_NVMF:-A FORWARD -i nvmf_br -o nvmf_br -j ACCEPT' 00:13:21.248 11:24:16 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@222 -- # ping -c 1 10.0.0.3 00:13:21.248 PING 10.0.0.3 (10.0.0.3) 56(84) bytes of data. 00:13:21.248 64 bytes from 10.0.0.3: icmp_seq=1 ttl=64 time=0.079 ms 00:13:21.248 00:13:21.248 --- 10.0.0.3 ping statistics --- 00:13:21.248 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:13:21.248 rtt min/avg/max/mdev = 0.079/0.079/0.079/0.000 ms 00:13:21.248 11:24:16 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@223 -- # ping -c 1 10.0.0.4 00:13:21.248 PING 10.0.0.4 (10.0.0.4) 56(84) bytes of data. 00:13:21.248 64 bytes from 10.0.0.4: icmp_seq=1 ttl=64 time=0.063 ms 00:13:21.248 00:13:21.248 --- 10.0.0.4 ping statistics --- 00:13:21.248 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:13:21.248 rtt min/avg/max/mdev = 0.063/0.063/0.063/0.000 ms 00:13:21.248 11:24:16 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@224 -- # ip netns exec nvmf_tgt_ns_spdk ping -c 1 10.0.0.1 00:13:21.248 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:13:21.248 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.019 ms 00:13:21.248 00:13:21.248 --- 10.0.0.1 ping statistics --- 00:13:21.248 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:13:21.248 rtt min/avg/max/mdev = 0.019/0.019/0.019/0.000 ms 00:13:21.248 11:24:16 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@225 -- # ip netns exec nvmf_tgt_ns_spdk ping -c 1 10.0.0.2 00:13:21.248 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:13:21.248 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.059 ms 00:13:21.248 00:13:21.248 --- 10.0.0.2 ping statistics --- 00:13:21.248 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:13:21.248 rtt min/avg/max/mdev = 0.059/0.059/0.059/0.000 ms 00:13:21.248 11:24:16 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@227 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:13:21.248 11:24:16 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@459 -- # return 0 00:13:21.248 11:24:16 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@476 -- # '[' '' == iso ']' 00:13:21.248 11:24:16 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@480 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:13:21.248 11:24:16 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@481 -- # [[ tcp == \r\d\m\a ]] 00:13:21.248 11:24:16 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@490 -- # [[ tcp == \t\c\p ]] 00:13:21.248 11:24:16 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@491 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:13:21.248 11:24:16 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@494 -- # '[' tcp == tcp ']' 00:13:21.248 11:24:16 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@500 -- # modprobe nvme-tcp 00:13:21.248 11:24:16 nvmf_tcp.nvmf_target_core.nvmf_nmic -- target/nmic.sh@15 -- # nvmfappstart -m 0xF 00:13:21.248 11:24:16 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@505 -- # timing_enter start_nvmf_tgt 00:13:21.248 11:24:16 nvmf_tcp.nvmf_target_core.nvmf_nmic -- common/autotest_common.sh@724 -- # xtrace_disable 00:13:21.248 11:24:16 nvmf_tcp.nvmf_target_core.nvmf_nmic -- common/autotest_common.sh@10 -- # set +x 00:13:21.248 11:24:16 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@507 -- # nvmfpid=69900 00:13:21.248 11:24:16 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@506 -- # ip netns exec nvmf_tgt_ns_spdk /home/vagrant/spdk_repo/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:13:21.248 11:24:16 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@508 -- # waitforlisten 69900 00:13:21.248 11:24:16 nvmf_tcp.nvmf_target_core.nvmf_nmic -- common/autotest_common.sh@831 -- # '[' -z 69900 ']' 00:13:21.248 11:24:16 nvmf_tcp.nvmf_target_core.nvmf_nmic -- common/autotest_common.sh@835 -- # local rpc_addr=/var/tmp/spdk.sock 00:13:21.248 11:24:16 nvmf_tcp.nvmf_target_core.nvmf_nmic -- common/autotest_common.sh@836 -- # local max_retries=100 00:13:21.248 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:13:21.248 11:24:16 nvmf_tcp.nvmf_target_core.nvmf_nmic -- common/autotest_common.sh@838 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:13:21.248 11:24:16 nvmf_tcp.nvmf_target_core.nvmf_nmic -- common/autotest_common.sh@840 -- # xtrace_disable 00:13:21.248 11:24:16 nvmf_tcp.nvmf_target_core.nvmf_nmic -- common/autotest_common.sh@10 -- # set +x 00:13:21.524 [2024-10-07 11:24:16.775030] Starting SPDK v25.01-pre git sha1 2a4f56c54 / DPDK 24.03.0 initialization... 00:13:21.524 [2024-10-07 11:24:16.775121] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --iova-mode=pa --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:13:21.524 [2024-10-07 11:24:16.912184] app.c: 917:spdk_app_start: *NOTICE*: Total cores available: 4 00:13:21.524 [2024-10-07 11:24:17.027555] app.c: 610:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:13:21.524 [2024-10-07 11:24:17.027609] app.c: 611:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:13:21.524 [2024-10-07 11:24:17.027620] app.c: 616:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:13:21.524 [2024-10-07 11:24:17.027629] app.c: 617:app_setup_trace: *NOTICE*: SPDK application currently running. 00:13:21.524 [2024-10-07 11:24:17.027637] app.c: 618:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:13:21.524 [2024-10-07 11:24:17.028860] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 1 00:13:21.524 [2024-10-07 11:24:17.028899] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 2 00:13:21.524 [2024-10-07 11:24:17.028978] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 3 00:13:21.524 [2024-10-07 11:24:17.028982] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 0 00:13:22.455 11:24:17 nvmf_tcp.nvmf_target_core.nvmf_nmic -- common/autotest_common.sh@860 -- # (( i == 0 )) 00:13:22.455 11:24:17 nvmf_tcp.nvmf_target_core.nvmf_nmic -- common/autotest_common.sh@864 -- # return 0 00:13:22.455 11:24:17 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@509 -- # timing_exit start_nvmf_tgt 00:13:22.455 11:24:17 nvmf_tcp.nvmf_target_core.nvmf_nmic -- common/autotest_common.sh@730 -- # xtrace_disable 00:13:22.455 11:24:17 nvmf_tcp.nvmf_target_core.nvmf_nmic -- common/autotest_common.sh@10 -- # set +x 00:13:22.455 11:24:17 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@510 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:13:22.455 11:24:17 nvmf_tcp.nvmf_target_core.nvmf_nmic -- target/nmic.sh@17 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:13:22.455 11:24:17 nvmf_tcp.nvmf_target_core.nvmf_nmic -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:22.455 11:24:17 nvmf_tcp.nvmf_target_core.nvmf_nmic -- common/autotest_common.sh@10 -- # set +x 00:13:22.455 [2024-10-07 11:24:17.911106] tcp.c: 738:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:13:22.455 11:24:17 nvmf_tcp.nvmf_target_core.nvmf_nmic -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:22.455 11:24:17 nvmf_tcp.nvmf_target_core.nvmf_nmic -- target/nmic.sh@20 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:13:22.455 11:24:17 nvmf_tcp.nvmf_target_core.nvmf_nmic -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:22.455 11:24:17 nvmf_tcp.nvmf_target_core.nvmf_nmic -- common/autotest_common.sh@10 -- # set +x 00:13:22.455 Malloc0 00:13:22.455 11:24:17 nvmf_tcp.nvmf_target_core.nvmf_nmic -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:22.455 11:24:17 nvmf_tcp.nvmf_target_core.nvmf_nmic -- target/nmic.sh@21 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDKISFASTANDAWESOME 00:13:22.455 11:24:17 nvmf_tcp.nvmf_target_core.nvmf_nmic -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:22.455 11:24:17 nvmf_tcp.nvmf_target_core.nvmf_nmic -- common/autotest_common.sh@10 -- # set +x 00:13:22.455 11:24:17 nvmf_tcp.nvmf_target_core.nvmf_nmic -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:22.455 11:24:17 nvmf_tcp.nvmf_target_core.nvmf_nmic -- target/nmic.sh@22 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:13:22.455 11:24:17 nvmf_tcp.nvmf_target_core.nvmf_nmic -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:22.455 11:24:17 nvmf_tcp.nvmf_target_core.nvmf_nmic -- common/autotest_common.sh@10 -- # set +x 00:13:22.455 11:24:17 nvmf_tcp.nvmf_target_core.nvmf_nmic -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:22.455 11:24:17 nvmf_tcp.nvmf_target_core.nvmf_nmic -- target/nmic.sh@23 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.3 -s 4420 00:13:22.455 11:24:17 nvmf_tcp.nvmf_target_core.nvmf_nmic -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:22.455 11:24:17 nvmf_tcp.nvmf_target_core.nvmf_nmic -- common/autotest_common.sh@10 -- # set +x 00:13:22.455 [2024-10-07 11:24:17.961867] tcp.c:1081:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.3 port 4420 *** 00:13:22.455 test case1: single bdev can't be used in multiple subsystems 00:13:22.455 11:24:17 nvmf_tcp.nvmf_target_core.nvmf_nmic -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:22.455 11:24:17 nvmf_tcp.nvmf_target_core.nvmf_nmic -- target/nmic.sh@25 -- # echo 'test case1: single bdev can'\''t be used in multiple subsystems' 00:13:22.455 11:24:17 nvmf_tcp.nvmf_target_core.nvmf_nmic -- target/nmic.sh@26 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode2 -a -s SPDK2 00:13:22.455 11:24:17 nvmf_tcp.nvmf_target_core.nvmf_nmic -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:22.455 11:24:17 nvmf_tcp.nvmf_target_core.nvmf_nmic -- common/autotest_common.sh@10 -- # set +x 00:13:22.455 11:24:17 nvmf_tcp.nvmf_target_core.nvmf_nmic -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:22.455 11:24:17 nvmf_tcp.nvmf_target_core.nvmf_nmic -- target/nmic.sh@27 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode2 -t tcp -a 10.0.0.3 -s 4420 00:13:22.455 11:24:17 nvmf_tcp.nvmf_target_core.nvmf_nmic -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:22.455 11:24:17 nvmf_tcp.nvmf_target_core.nvmf_nmic -- common/autotest_common.sh@10 -- # set +x 00:13:22.712 11:24:17 nvmf_tcp.nvmf_target_core.nvmf_nmic -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:22.712 11:24:17 nvmf_tcp.nvmf_target_core.nvmf_nmic -- target/nmic.sh@28 -- # nmic_status=0 00:13:22.712 11:24:17 nvmf_tcp.nvmf_target_core.nvmf_nmic -- target/nmic.sh@29 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode2 Malloc0 00:13:22.712 11:24:17 nvmf_tcp.nvmf_target_core.nvmf_nmic -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:22.712 11:24:17 nvmf_tcp.nvmf_target_core.nvmf_nmic -- common/autotest_common.sh@10 -- # set +x 00:13:22.712 [2024-10-07 11:24:17.985688] bdev.c:8202:bdev_open: *ERROR*: bdev Malloc0 already claimed: type exclusive_write by module NVMe-oF Target 00:13:22.712 [2024-10-07 11:24:17.985734] subsystem.c:2157:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Subsystem nqn.2016-06.io.spdk:cnode2: bdev Malloc0 cannot be opened, error=-1 00:13:22.712 [2024-10-07 11:24:17.985754] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:22.712 2024/10/07 11:24:17 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:Malloc0 no_auto_visible:%!s(bool=false)] nqn:nqn.2016-06.io.spdk:cnode2], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:13:22.712 request: 00:13:22.712 { 00:13:22.712 "method": "nvmf_subsystem_add_ns", 00:13:22.712 "params": { 00:13:22.712 "nqn": "nqn.2016-06.io.spdk:cnode2", 00:13:22.712 "namespace": { 00:13:22.712 "bdev_name": "Malloc0", 00:13:22.712 "no_auto_visible": false 00:13:22.712 } 00:13:22.712 } 00:13:22.712 } 00:13:22.712 Got JSON-RPC error response 00:13:22.712 GoRPCClient: error on JSON-RPC call 00:13:22.712 Adding namespace failed - expected result. 00:13:22.712 test case2: host connect to nvmf target in multiple paths 00:13:22.712 11:24:17 nvmf_tcp.nvmf_target_core.nvmf_nmic -- common/autotest_common.sh@589 -- # [[ 1 == 0 ]] 00:13:22.712 11:24:17 nvmf_tcp.nvmf_target_core.nvmf_nmic -- target/nmic.sh@29 -- # nmic_status=1 00:13:22.712 11:24:17 nvmf_tcp.nvmf_target_core.nvmf_nmic -- target/nmic.sh@31 -- # '[' 1 -eq 0 ']' 00:13:22.712 11:24:17 nvmf_tcp.nvmf_target_core.nvmf_nmic -- target/nmic.sh@36 -- # echo ' Adding namespace failed - expected result.' 00:13:22.712 11:24:17 nvmf_tcp.nvmf_target_core.nvmf_nmic -- target/nmic.sh@39 -- # echo 'test case2: host connect to nvmf target in multiple paths' 00:13:22.712 11:24:17 nvmf_tcp.nvmf_target_core.nvmf_nmic -- target/nmic.sh@40 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.3 -s 4421 00:13:22.712 11:24:17 nvmf_tcp.nvmf_target_core.nvmf_nmic -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:22.712 11:24:17 nvmf_tcp.nvmf_target_core.nvmf_nmic -- common/autotest_common.sh@10 -- # set +x 00:13:22.713 [2024-10-07 11:24:17.997865] tcp.c:1081:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.3 port 4421 *** 00:13:22.713 11:24:18 nvmf_tcp.nvmf_target_core.nvmf_nmic -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:22.713 11:24:18 nvmf_tcp.nvmf_target_core.nvmf_nmic -- target/nmic.sh@41 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:c758a4ed-f09f-4c82-9afb-3d096f035464 --hostid=c758a4ed-f09f-4c82-9afb-3d096f035464 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.3 -s 4420 00:13:22.713 11:24:18 nvmf_tcp.nvmf_target_core.nvmf_nmic -- target/nmic.sh@42 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:c758a4ed-f09f-4c82-9afb-3d096f035464 --hostid=c758a4ed-f09f-4c82-9afb-3d096f035464 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.3 -s 4421 00:13:22.969 11:24:18 nvmf_tcp.nvmf_target_core.nvmf_nmic -- target/nmic.sh@44 -- # waitforserial SPDKISFASTANDAWESOME 00:13:22.969 11:24:18 nvmf_tcp.nvmf_target_core.nvmf_nmic -- common/autotest_common.sh@1198 -- # local i=0 00:13:22.969 11:24:18 nvmf_tcp.nvmf_target_core.nvmf_nmic -- common/autotest_common.sh@1199 -- # local nvme_device_counter=1 nvme_devices=0 00:13:22.969 11:24:18 nvmf_tcp.nvmf_target_core.nvmf_nmic -- common/autotest_common.sh@1200 -- # [[ -n '' ]] 00:13:22.969 11:24:18 nvmf_tcp.nvmf_target_core.nvmf_nmic -- common/autotest_common.sh@1205 -- # sleep 2 00:13:24.881 11:24:20 nvmf_tcp.nvmf_target_core.nvmf_nmic -- common/autotest_common.sh@1206 -- # (( i++ <= 15 )) 00:13:24.881 11:24:20 nvmf_tcp.nvmf_target_core.nvmf_nmic -- common/autotest_common.sh@1207 -- # lsblk -l -o NAME,SERIAL 00:13:24.881 11:24:20 nvmf_tcp.nvmf_target_core.nvmf_nmic -- common/autotest_common.sh@1207 -- # grep -c SPDKISFASTANDAWESOME 00:13:24.881 11:24:20 nvmf_tcp.nvmf_target_core.nvmf_nmic -- common/autotest_common.sh@1207 -- # nvme_devices=1 00:13:24.881 11:24:20 nvmf_tcp.nvmf_target_core.nvmf_nmic -- common/autotest_common.sh@1208 -- # (( nvme_devices == nvme_device_counter )) 00:13:24.881 11:24:20 nvmf_tcp.nvmf_target_core.nvmf_nmic -- common/autotest_common.sh@1208 -- # return 0 00:13:24.881 11:24:20 nvmf_tcp.nvmf_target_core.nvmf_nmic -- target/nmic.sh@46 -- # /home/vagrant/spdk_repo/spdk/scripts/fio-wrapper -p nvmf -i 4096 -d 1 -t write -r 1 -v 00:13:24.881 [global] 00:13:24.881 thread=1 00:13:24.881 invalidate=1 00:13:24.881 rw=write 00:13:24.881 time_based=1 00:13:24.881 runtime=1 00:13:24.881 ioengine=libaio 00:13:24.881 direct=1 00:13:24.881 bs=4096 00:13:24.881 iodepth=1 00:13:24.881 norandommap=0 00:13:24.881 numjobs=1 00:13:24.881 00:13:24.881 verify_dump=1 00:13:24.881 verify_backlog=512 00:13:24.881 verify_state_save=0 00:13:24.881 do_verify=1 00:13:24.881 verify=crc32c-intel 00:13:24.881 [job0] 00:13:24.881 filename=/dev/nvme0n1 00:13:24.881 Could not set queue depth (nvme0n1) 00:13:25.139 job0: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:13:25.139 fio-3.35 00:13:25.139 Starting 1 thread 00:13:26.512 00:13:26.512 job0: (groupid=0, jobs=1): err= 0: pid=70009: Mon Oct 7 11:24:21 2024 00:13:26.512 read: IOPS=3322, BW=13.0MiB/s (13.6MB/s)(13.0MiB/1001msec) 00:13:26.513 slat (nsec): min=12241, max=57698, avg=15012.47, stdev=4378.90 00:13:26.513 clat (usec): min=128, max=517, avg=143.63, stdev=13.12 00:13:26.513 lat (usec): min=141, max=531, avg=158.64, stdev=14.54 00:13:26.513 clat percentiles (usec): 00:13:26.513 | 1.00th=[ 131], 5.00th=[ 135], 10.00th=[ 135], 20.00th=[ 137], 00:13:26.513 | 30.00th=[ 139], 40.00th=[ 141], 50.00th=[ 143], 60.00th=[ 145], 00:13:26.513 | 70.00th=[ 147], 80.00th=[ 149], 90.00th=[ 153], 95.00th=[ 157], 00:13:26.513 | 99.00th=[ 165], 99.50th=[ 180], 99.90th=[ 351], 99.95th=[ 371], 00:13:26.513 | 99.99th=[ 519] 00:13:26.513 write: IOPS=3580, BW=14.0MiB/s (14.7MB/s)(14.0MiB/1001msec); 0 zone resets 00:13:26.513 slat (usec): min=16, max=166, avg=22.80, stdev= 8.51 00:13:26.513 clat (usec): min=91, max=396, avg=105.76, stdev=11.78 00:13:26.513 lat (usec): min=110, max=432, avg=128.57, stdev=16.62 00:13:26.513 clat percentiles (usec): 00:13:26.513 | 1.00th=[ 94], 5.00th=[ 97], 10.00th=[ 98], 20.00th=[ 100], 00:13:26.513 | 30.00th=[ 101], 40.00th=[ 102], 50.00th=[ 104], 60.00th=[ 105], 00:13:26.513 | 70.00th=[ 108], 80.00th=[ 111], 90.00th=[ 116], 95.00th=[ 120], 00:13:26.513 | 99.00th=[ 133], 99.50th=[ 143], 99.90th=[ 273], 99.95th=[ 293], 00:13:26.513 | 99.99th=[ 396] 00:13:26.513 bw ( KiB/s): min=14816, max=14816, per=100.00%, avg=14816.00, stdev= 0.00, samples=1 00:13:26.513 iops : min= 3704, max= 3704, avg=3704.00, stdev= 0.00, samples=1 00:13:26.513 lat (usec) : 100=12.10%, 250=87.73%, 500=0.16%, 750=0.01% 00:13:26.513 cpu : usr=2.60%, sys=9.90%, ctx=6910, majf=0, minf=5 00:13:26.513 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:13:26.513 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:13:26.513 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:13:26.513 issued rwts: total=3326,3584,0,0 short=0,0,0,0 dropped=0,0,0,0 00:13:26.513 latency : target=0, window=0, percentile=100.00%, depth=1 00:13:26.513 00:13:26.513 Run status group 0 (all jobs): 00:13:26.513 READ: bw=13.0MiB/s (13.6MB/s), 13.0MiB/s-13.0MiB/s (13.6MB/s-13.6MB/s), io=13.0MiB (13.6MB), run=1001-1001msec 00:13:26.513 WRITE: bw=14.0MiB/s (14.7MB/s), 14.0MiB/s-14.0MiB/s (14.7MB/s-14.7MB/s), io=14.0MiB (14.7MB), run=1001-1001msec 00:13:26.513 00:13:26.513 Disk stats (read/write): 00:13:26.513 nvme0n1: ios=3122/3094, merge=0/0, ticks=479/362, in_queue=841, util=91.48% 00:13:26.513 11:24:21 nvmf_tcp.nvmf_target_core.nvmf_nmic -- target/nmic.sh@48 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:13:26.513 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 2 controller(s) 00:13:26.513 11:24:21 nvmf_tcp.nvmf_target_core.nvmf_nmic -- target/nmic.sh@49 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:13:26.513 11:24:21 nvmf_tcp.nvmf_target_core.nvmf_nmic -- common/autotest_common.sh@1219 -- # local i=0 00:13:26.513 11:24:21 nvmf_tcp.nvmf_target_core.nvmf_nmic -- common/autotest_common.sh@1220 -- # lsblk -o NAME,SERIAL 00:13:26.513 11:24:21 nvmf_tcp.nvmf_target_core.nvmf_nmic -- common/autotest_common.sh@1220 -- # grep -q -w SPDKISFASTANDAWESOME 00:13:26.513 11:24:21 nvmf_tcp.nvmf_target_core.nvmf_nmic -- common/autotest_common.sh@1227 -- # lsblk -l -o NAME,SERIAL 00:13:26.513 11:24:21 nvmf_tcp.nvmf_target_core.nvmf_nmic -- common/autotest_common.sh@1227 -- # grep -q -w SPDKISFASTANDAWESOME 00:13:26.513 11:24:21 nvmf_tcp.nvmf_target_core.nvmf_nmic -- common/autotest_common.sh@1231 -- # return 0 00:13:26.513 11:24:21 nvmf_tcp.nvmf_target_core.nvmf_nmic -- target/nmic.sh@51 -- # trap - SIGINT SIGTERM EXIT 00:13:26.513 11:24:21 nvmf_tcp.nvmf_target_core.nvmf_nmic -- target/nmic.sh@53 -- # nvmftestfini 00:13:26.513 11:24:21 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@514 -- # nvmfcleanup 00:13:26.513 11:24:21 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@121 -- # sync 00:13:26.513 11:24:21 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@123 -- # '[' tcp == tcp ']' 00:13:26.513 11:24:21 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@124 -- # set +e 00:13:26.513 11:24:21 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@125 -- # for i in {1..20} 00:13:26.513 11:24:21 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@126 -- # modprobe -v -r nvme-tcp 00:13:26.513 rmmod nvme_tcp 00:13:26.513 rmmod nvme_fabrics 00:13:26.513 rmmod nvme_keyring 00:13:26.513 11:24:21 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@127 -- # modprobe -v -r nvme-fabrics 00:13:26.513 11:24:21 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@128 -- # set -e 00:13:26.513 11:24:21 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@129 -- # return 0 00:13:26.513 11:24:21 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@515 -- # '[' -n 69900 ']' 00:13:26.513 11:24:21 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@516 -- # killprocess 69900 00:13:26.513 11:24:21 nvmf_tcp.nvmf_target_core.nvmf_nmic -- common/autotest_common.sh@950 -- # '[' -z 69900 ']' 00:13:26.513 11:24:21 nvmf_tcp.nvmf_target_core.nvmf_nmic -- common/autotest_common.sh@954 -- # kill -0 69900 00:13:26.513 11:24:21 nvmf_tcp.nvmf_target_core.nvmf_nmic -- common/autotest_common.sh@955 -- # uname 00:13:26.513 11:24:21 nvmf_tcp.nvmf_target_core.nvmf_nmic -- common/autotest_common.sh@955 -- # '[' Linux = Linux ']' 00:13:26.513 11:24:21 nvmf_tcp.nvmf_target_core.nvmf_nmic -- common/autotest_common.sh@956 -- # ps --no-headers -o comm= 69900 00:13:26.513 killing process with pid 69900 00:13:26.513 11:24:21 nvmf_tcp.nvmf_target_core.nvmf_nmic -- common/autotest_common.sh@956 -- # process_name=reactor_0 00:13:26.513 11:24:21 nvmf_tcp.nvmf_target_core.nvmf_nmic -- common/autotest_common.sh@960 -- # '[' reactor_0 = sudo ']' 00:13:26.513 11:24:21 nvmf_tcp.nvmf_target_core.nvmf_nmic -- common/autotest_common.sh@968 -- # echo 'killing process with pid 69900' 00:13:26.513 11:24:21 nvmf_tcp.nvmf_target_core.nvmf_nmic -- common/autotest_common.sh@969 -- # kill 69900 00:13:26.513 11:24:21 nvmf_tcp.nvmf_target_core.nvmf_nmic -- common/autotest_common.sh@974 -- # wait 69900 00:13:26.772 11:24:22 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@518 -- # '[' '' == iso ']' 00:13:26.772 11:24:22 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@521 -- # [[ tcp == \t\c\p ]] 00:13:26.772 11:24:22 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@522 -- # nvmf_tcp_fini 00:13:26.772 11:24:22 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@297 -- # iptr 00:13:26.772 11:24:22 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@789 -- # iptables-restore 00:13:26.772 11:24:22 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@789 -- # grep -v SPDK_NVMF 00:13:26.772 11:24:22 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@789 -- # iptables-save 00:13:26.772 11:24:22 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@298 -- # [[ nvmf_tgt_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s\_\s\p\d\k ]] 00:13:26.772 11:24:22 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@299 -- # nvmf_veth_fini 00:13:26.772 11:24:22 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@233 -- # ip link set nvmf_init_br nomaster 00:13:26.772 11:24:22 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@234 -- # ip link set nvmf_init_br2 nomaster 00:13:26.772 11:24:22 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@235 -- # ip link set nvmf_tgt_br nomaster 00:13:26.772 11:24:22 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@236 -- # ip link set nvmf_tgt_br2 nomaster 00:13:26.772 11:24:22 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@237 -- # ip link set nvmf_init_br down 00:13:26.772 11:24:22 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@238 -- # ip link set nvmf_init_br2 down 00:13:26.772 11:24:22 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@239 -- # ip link set nvmf_tgt_br down 00:13:26.772 11:24:22 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@240 -- # ip link set nvmf_tgt_br2 down 00:13:26.772 11:24:22 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@241 -- # ip link delete nvmf_br type bridge 00:13:26.772 11:24:22 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@242 -- # ip link delete nvmf_init_if 00:13:26.772 11:24:22 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@243 -- # ip link delete nvmf_init_if2 00:13:27.030 11:24:22 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@244 -- # ip netns exec nvmf_tgt_ns_spdk ip link delete nvmf_tgt_if 00:13:27.030 11:24:22 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@245 -- # ip netns exec nvmf_tgt_ns_spdk ip link delete nvmf_tgt_if2 00:13:27.030 11:24:22 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@246 -- # remove_spdk_ns 00:13:27.030 11:24:22 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@654 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:13:27.030 11:24:22 nvmf_tcp.nvmf_target_core.nvmf_nmic -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 15> /dev/null' 00:13:27.030 11:24:22 nvmf_tcp.nvmf_target_core.nvmf_nmic -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:13:27.030 11:24:22 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@300 -- # return 0 00:13:27.030 00:13:27.030 real 0m6.295s 00:13:27.030 user 0m20.111s 00:13:27.030 sys 0m1.505s 00:13:27.030 11:24:22 nvmf_tcp.nvmf_target_core.nvmf_nmic -- common/autotest_common.sh@1126 -- # xtrace_disable 00:13:27.030 ************************************ 00:13:27.030 END TEST nvmf_nmic 00:13:27.030 11:24:22 nvmf_tcp.nvmf_target_core.nvmf_nmic -- common/autotest_common.sh@10 -- # set +x 00:13:27.030 ************************************ 00:13:27.030 11:24:22 nvmf_tcp.nvmf_target_core -- nvmf/nvmf_target_core.sh@34 -- # run_test nvmf_fio_target /home/vagrant/spdk_repo/spdk/test/nvmf/target/fio.sh --transport=tcp 00:13:27.030 11:24:22 nvmf_tcp.nvmf_target_core -- common/autotest_common.sh@1101 -- # '[' 3 -le 1 ']' 00:13:27.030 11:24:22 nvmf_tcp.nvmf_target_core -- common/autotest_common.sh@1107 -- # xtrace_disable 00:13:27.030 11:24:22 nvmf_tcp.nvmf_target_core -- common/autotest_common.sh@10 -- # set +x 00:13:27.030 ************************************ 00:13:27.030 START TEST nvmf_fio_target 00:13:27.030 ************************************ 00:13:27.030 11:24:22 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- common/autotest_common.sh@1125 -- # /home/vagrant/spdk_repo/spdk/test/nvmf/target/fio.sh --transport=tcp 00:13:27.030 * Looking for test storage... 00:13:27.030 * Found test storage at /home/vagrant/spdk_repo/spdk/test/nvmf/target 00:13:27.030 11:24:22 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- common/autotest_common.sh@1680 -- # [[ y == y ]] 00:13:27.030 11:24:22 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- common/autotest_common.sh@1681 -- # lcov --version 00:13:27.030 11:24:22 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- common/autotest_common.sh@1681 -- # awk '{print $NF}' 00:13:27.288 11:24:22 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- common/autotest_common.sh@1681 -- # lt 1.15 2 00:13:27.289 11:24:22 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- scripts/common.sh@373 -- # cmp_versions 1.15 '<' 2 00:13:27.289 11:24:22 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- scripts/common.sh@333 -- # local ver1 ver1_l 00:13:27.289 11:24:22 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- scripts/common.sh@334 -- # local ver2 ver2_l 00:13:27.289 11:24:22 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- scripts/common.sh@336 -- # IFS=.-: 00:13:27.289 11:24:22 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- scripts/common.sh@336 -- # read -ra ver1 00:13:27.289 11:24:22 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- scripts/common.sh@337 -- # IFS=.-: 00:13:27.289 11:24:22 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- scripts/common.sh@337 -- # read -ra ver2 00:13:27.289 11:24:22 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- scripts/common.sh@338 -- # local 'op=<' 00:13:27.289 11:24:22 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- scripts/common.sh@340 -- # ver1_l=2 00:13:27.289 11:24:22 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- scripts/common.sh@341 -- # ver2_l=1 00:13:27.289 11:24:22 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- scripts/common.sh@343 -- # local lt=0 gt=0 eq=0 v 00:13:27.289 11:24:22 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- scripts/common.sh@344 -- # case "$op" in 00:13:27.289 11:24:22 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- scripts/common.sh@345 -- # : 1 00:13:27.289 11:24:22 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- scripts/common.sh@364 -- # (( v = 0 )) 00:13:27.289 11:24:22 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- scripts/common.sh@364 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:13:27.289 11:24:22 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- scripts/common.sh@365 -- # decimal 1 00:13:27.289 11:24:22 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- scripts/common.sh@353 -- # local d=1 00:13:27.289 11:24:22 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- scripts/common.sh@354 -- # [[ 1 =~ ^[0-9]+$ ]] 00:13:27.289 11:24:22 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- scripts/common.sh@355 -- # echo 1 00:13:27.289 11:24:22 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- scripts/common.sh@365 -- # ver1[v]=1 00:13:27.289 11:24:22 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- scripts/common.sh@366 -- # decimal 2 00:13:27.289 11:24:22 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- scripts/common.sh@353 -- # local d=2 00:13:27.289 11:24:22 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- scripts/common.sh@354 -- # [[ 2 =~ ^[0-9]+$ ]] 00:13:27.289 11:24:22 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- scripts/common.sh@355 -- # echo 2 00:13:27.289 11:24:22 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- scripts/common.sh@366 -- # ver2[v]=2 00:13:27.289 11:24:22 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- scripts/common.sh@367 -- # (( ver1[v] > ver2[v] )) 00:13:27.289 11:24:22 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- scripts/common.sh@368 -- # (( ver1[v] < ver2[v] )) 00:13:27.289 11:24:22 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- scripts/common.sh@368 -- # return 0 00:13:27.289 11:24:22 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- common/autotest_common.sh@1682 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:13:27.289 11:24:22 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- common/autotest_common.sh@1694 -- # export 'LCOV_OPTS= 00:13:27.289 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:13:27.289 --rc genhtml_branch_coverage=1 00:13:27.289 --rc genhtml_function_coverage=1 00:13:27.289 --rc genhtml_legend=1 00:13:27.289 --rc geninfo_all_blocks=1 00:13:27.289 --rc geninfo_unexecuted_blocks=1 00:13:27.289 00:13:27.289 ' 00:13:27.289 11:24:22 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- common/autotest_common.sh@1694 -- # LCOV_OPTS=' 00:13:27.289 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:13:27.289 --rc genhtml_branch_coverage=1 00:13:27.289 --rc genhtml_function_coverage=1 00:13:27.289 --rc genhtml_legend=1 00:13:27.289 --rc geninfo_all_blocks=1 00:13:27.289 --rc geninfo_unexecuted_blocks=1 00:13:27.289 00:13:27.289 ' 00:13:27.289 11:24:22 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- common/autotest_common.sh@1695 -- # export 'LCOV=lcov 00:13:27.289 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:13:27.289 --rc genhtml_branch_coverage=1 00:13:27.289 --rc genhtml_function_coverage=1 00:13:27.289 --rc genhtml_legend=1 00:13:27.289 --rc geninfo_all_blocks=1 00:13:27.289 --rc geninfo_unexecuted_blocks=1 00:13:27.289 00:13:27.289 ' 00:13:27.289 11:24:22 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- common/autotest_common.sh@1695 -- # LCOV='lcov 00:13:27.289 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:13:27.289 --rc genhtml_branch_coverage=1 00:13:27.289 --rc genhtml_function_coverage=1 00:13:27.289 --rc genhtml_legend=1 00:13:27.289 --rc geninfo_all_blocks=1 00:13:27.289 --rc geninfo_unexecuted_blocks=1 00:13:27.289 00:13:27.289 ' 00:13:27.289 11:24:22 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- target/fio.sh@9 -- # source /home/vagrant/spdk_repo/spdk/test/nvmf/common.sh 00:13:27.289 11:24:22 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@7 -- # uname -s 00:13:27.289 11:24:22 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:13:27.289 11:24:22 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:13:27.289 11:24:22 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:13:27.289 11:24:22 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:13:27.289 11:24:22 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:13:27.289 11:24:22 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:13:27.289 11:24:22 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:13:27.289 11:24:22 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:13:27.289 11:24:22 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:13:27.289 11:24:22 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:13:27.289 11:24:22 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:c758a4ed-f09f-4c82-9afb-3d096f035464 00:13:27.289 11:24:22 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@18 -- # NVME_HOSTID=c758a4ed-f09f-4c82-9afb-3d096f035464 00:13:27.289 11:24:22 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:13:27.289 11:24:22 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:13:27.289 11:24:22 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@21 -- # NET_TYPE=virt 00:13:27.289 11:24:22 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:13:27.289 11:24:22 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@49 -- # source /home/vagrant/spdk_repo/spdk/scripts/common.sh 00:13:27.289 11:24:22 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- scripts/common.sh@15 -- # shopt -s extglob 00:13:27.289 11:24:22 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- scripts/common.sh@544 -- # [[ -e /bin/wpdk_common.sh ]] 00:13:27.289 11:24:22 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- scripts/common.sh@552 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:13:27.289 11:24:22 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- scripts/common.sh@553 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:13:27.289 11:24:22 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:27.289 11:24:22 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:27.289 11:24:22 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:27.289 11:24:22 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- paths/export.sh@5 -- # export PATH 00:13:27.289 11:24:22 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:27.289 11:24:22 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@51 -- # : 0 00:13:27.289 11:24:22 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@52 -- # export NVMF_APP_SHM_ID 00:13:27.289 11:24:22 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@53 -- # build_nvmf_app_args 00:13:27.289 11:24:22 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:13:27.289 11:24:22 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:13:27.289 11:24:22 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:13:27.289 11:24:22 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@33 -- # '[' '' -eq 1 ']' 00:13:27.289 /home/vagrant/spdk_repo/spdk/test/nvmf/common.sh: line 33: [: : integer expression expected 00:13:27.289 11:24:22 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@37 -- # '[' -n '' ']' 00:13:27.289 11:24:22 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@39 -- # '[' 0 -eq 1 ']' 00:13:27.289 11:24:22 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@55 -- # have_pci_nics=0 00:13:27.289 11:24:22 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- target/fio.sh@11 -- # MALLOC_BDEV_SIZE=64 00:13:27.289 11:24:22 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- target/fio.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:13:27.289 11:24:22 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- target/fio.sh@14 -- # rpc_py=/home/vagrant/spdk_repo/spdk/scripts/rpc.py 00:13:27.289 11:24:22 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- target/fio.sh@16 -- # nvmftestinit 00:13:27.289 11:24:22 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@467 -- # '[' -z tcp ']' 00:13:27.289 11:24:22 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@472 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:13:27.290 11:24:22 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@474 -- # prepare_net_devs 00:13:27.290 11:24:22 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@436 -- # local -g is_hw=no 00:13:27.290 11:24:22 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@438 -- # remove_spdk_ns 00:13:27.290 11:24:22 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@654 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:13:27.290 11:24:22 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 15> /dev/null' 00:13:27.290 11:24:22 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:13:27.290 11:24:22 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@440 -- # [[ virt != virt ]] 00:13:27.290 11:24:22 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@442 -- # [[ no == yes ]] 00:13:27.290 11:24:22 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@449 -- # [[ virt == phy ]] 00:13:27.290 11:24:22 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@452 -- # [[ virt == phy-fallback ]] 00:13:27.290 11:24:22 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@457 -- # [[ tcp == tcp ]] 00:13:27.290 11:24:22 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@458 -- # nvmf_veth_init 00:13:27.290 11:24:22 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@145 -- # NVMF_FIRST_INITIATOR_IP=10.0.0.1 00:13:27.290 11:24:22 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@146 -- # NVMF_SECOND_INITIATOR_IP=10.0.0.2 00:13:27.290 11:24:22 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@147 -- # NVMF_FIRST_TARGET_IP=10.0.0.3 00:13:27.290 11:24:22 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@148 -- # NVMF_SECOND_TARGET_IP=10.0.0.4 00:13:27.290 11:24:22 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@149 -- # NVMF_INITIATOR_IP=10.0.0.1 00:13:27.290 11:24:22 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@150 -- # NVMF_BRIDGE=nvmf_br 00:13:27.290 11:24:22 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@151 -- # NVMF_INITIATOR_INTERFACE=nvmf_init_if 00:13:27.290 11:24:22 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@152 -- # NVMF_INITIATOR_INTERFACE2=nvmf_init_if2 00:13:27.290 11:24:22 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@153 -- # NVMF_INITIATOR_BRIDGE=nvmf_init_br 00:13:27.290 11:24:22 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@154 -- # NVMF_INITIATOR_BRIDGE2=nvmf_init_br2 00:13:27.290 11:24:22 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@155 -- # NVMF_TARGET_NAMESPACE=nvmf_tgt_ns_spdk 00:13:27.290 11:24:22 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@156 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:13:27.290 11:24:22 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@157 -- # NVMF_TARGET_INTERFACE=nvmf_tgt_if 00:13:27.290 11:24:22 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@158 -- # NVMF_TARGET_INTERFACE2=nvmf_tgt_if2 00:13:27.290 11:24:22 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@159 -- # NVMF_TARGET_BRIDGE=nvmf_tgt_br 00:13:27.290 11:24:22 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@160 -- # NVMF_TARGET_BRIDGE2=nvmf_tgt_br2 00:13:27.290 11:24:22 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@162 -- # ip link set nvmf_init_br nomaster 00:13:27.290 Cannot find device "nvmf_init_br" 00:13:27.290 11:24:22 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@162 -- # true 00:13:27.290 11:24:22 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@163 -- # ip link set nvmf_init_br2 nomaster 00:13:27.290 Cannot find device "nvmf_init_br2" 00:13:27.290 11:24:22 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@163 -- # true 00:13:27.290 11:24:22 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@164 -- # ip link set nvmf_tgt_br nomaster 00:13:27.290 Cannot find device "nvmf_tgt_br" 00:13:27.290 11:24:22 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@164 -- # true 00:13:27.290 11:24:22 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@165 -- # ip link set nvmf_tgt_br2 nomaster 00:13:27.290 Cannot find device "nvmf_tgt_br2" 00:13:27.290 11:24:22 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@165 -- # true 00:13:27.290 11:24:22 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@166 -- # ip link set nvmf_init_br down 00:13:27.290 Cannot find device "nvmf_init_br" 00:13:27.290 11:24:22 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@166 -- # true 00:13:27.290 11:24:22 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@167 -- # ip link set nvmf_init_br2 down 00:13:27.290 Cannot find device "nvmf_init_br2" 00:13:27.290 11:24:22 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@167 -- # true 00:13:27.290 11:24:22 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@168 -- # ip link set nvmf_tgt_br down 00:13:27.290 Cannot find device "nvmf_tgt_br" 00:13:27.290 11:24:22 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@168 -- # true 00:13:27.290 11:24:22 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@169 -- # ip link set nvmf_tgt_br2 down 00:13:27.290 Cannot find device "nvmf_tgt_br2" 00:13:27.290 11:24:22 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@169 -- # true 00:13:27.290 11:24:22 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@170 -- # ip link delete nvmf_br type bridge 00:13:27.290 Cannot find device "nvmf_br" 00:13:27.290 11:24:22 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@170 -- # true 00:13:27.290 11:24:22 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@171 -- # ip link delete nvmf_init_if 00:13:27.290 Cannot find device "nvmf_init_if" 00:13:27.290 11:24:22 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@171 -- # true 00:13:27.290 11:24:22 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@172 -- # ip link delete nvmf_init_if2 00:13:27.290 Cannot find device "nvmf_init_if2" 00:13:27.290 11:24:22 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@172 -- # true 00:13:27.290 11:24:22 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@173 -- # ip netns exec nvmf_tgt_ns_spdk ip link delete nvmf_tgt_if 00:13:27.290 Cannot open network namespace "nvmf_tgt_ns_spdk": No such file or directory 00:13:27.290 11:24:22 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@173 -- # true 00:13:27.290 11:24:22 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@174 -- # ip netns exec nvmf_tgt_ns_spdk ip link delete nvmf_tgt_if2 00:13:27.290 Cannot open network namespace "nvmf_tgt_ns_spdk": No such file or directory 00:13:27.290 11:24:22 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@174 -- # true 00:13:27.290 11:24:22 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@177 -- # ip netns add nvmf_tgt_ns_spdk 00:13:27.548 11:24:22 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@180 -- # ip link add nvmf_init_if type veth peer name nvmf_init_br 00:13:27.548 11:24:22 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@181 -- # ip link add nvmf_init_if2 type veth peer name nvmf_init_br2 00:13:27.548 11:24:22 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@182 -- # ip link add nvmf_tgt_if type veth peer name nvmf_tgt_br 00:13:27.548 11:24:22 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@183 -- # ip link add nvmf_tgt_if2 type veth peer name nvmf_tgt_br2 00:13:27.548 11:24:22 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@186 -- # ip link set nvmf_tgt_if netns nvmf_tgt_ns_spdk 00:13:27.548 11:24:22 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@187 -- # ip link set nvmf_tgt_if2 netns nvmf_tgt_ns_spdk 00:13:27.548 11:24:22 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@190 -- # ip addr add 10.0.0.1/24 dev nvmf_init_if 00:13:27.548 11:24:22 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@191 -- # ip addr add 10.0.0.2/24 dev nvmf_init_if2 00:13:27.548 11:24:22 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@192 -- # ip netns exec nvmf_tgt_ns_spdk ip addr add 10.0.0.3/24 dev nvmf_tgt_if 00:13:27.548 11:24:22 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@193 -- # ip netns exec nvmf_tgt_ns_spdk ip addr add 10.0.0.4/24 dev nvmf_tgt_if2 00:13:27.548 11:24:22 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@196 -- # ip link set nvmf_init_if up 00:13:27.548 11:24:22 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@197 -- # ip link set nvmf_init_if2 up 00:13:27.548 11:24:22 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@198 -- # ip link set nvmf_init_br up 00:13:27.548 11:24:22 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@199 -- # ip link set nvmf_init_br2 up 00:13:27.548 11:24:22 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@200 -- # ip link set nvmf_tgt_br up 00:13:27.548 11:24:22 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@201 -- # ip link set nvmf_tgt_br2 up 00:13:27.548 11:24:22 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@202 -- # ip netns exec nvmf_tgt_ns_spdk ip link set nvmf_tgt_if up 00:13:27.548 11:24:22 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@203 -- # ip netns exec nvmf_tgt_ns_spdk ip link set nvmf_tgt_if2 up 00:13:27.548 11:24:22 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@204 -- # ip netns exec nvmf_tgt_ns_spdk ip link set lo up 00:13:27.548 11:24:22 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@207 -- # ip link add nvmf_br type bridge 00:13:27.548 11:24:22 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@208 -- # ip link set nvmf_br up 00:13:27.548 11:24:22 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@211 -- # ip link set nvmf_init_br master nvmf_br 00:13:27.548 11:24:22 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@212 -- # ip link set nvmf_init_br2 master nvmf_br 00:13:27.548 11:24:22 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@213 -- # ip link set nvmf_tgt_br master nvmf_br 00:13:27.548 11:24:22 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@214 -- # ip link set nvmf_tgt_br2 master nvmf_br 00:13:27.548 11:24:22 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@217 -- # ipts -I INPUT 1 -i nvmf_init_if -p tcp --dport 4420 -j ACCEPT 00:13:27.548 11:24:22 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@788 -- # iptables -I INPUT 1 -i nvmf_init_if -p tcp --dport 4420 -j ACCEPT -m comment --comment 'SPDK_NVMF:-I INPUT 1 -i nvmf_init_if -p tcp --dport 4420 -j ACCEPT' 00:13:27.548 11:24:23 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@218 -- # ipts -I INPUT 1 -i nvmf_init_if2 -p tcp --dport 4420 -j ACCEPT 00:13:27.548 11:24:23 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@788 -- # iptables -I INPUT 1 -i nvmf_init_if2 -p tcp --dport 4420 -j ACCEPT -m comment --comment 'SPDK_NVMF:-I INPUT 1 -i nvmf_init_if2 -p tcp --dport 4420 -j ACCEPT' 00:13:27.548 11:24:23 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@219 -- # ipts -A FORWARD -i nvmf_br -o nvmf_br -j ACCEPT 00:13:27.548 11:24:23 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@788 -- # iptables -A FORWARD -i nvmf_br -o nvmf_br -j ACCEPT -m comment --comment 'SPDK_NVMF:-A FORWARD -i nvmf_br -o nvmf_br -j ACCEPT' 00:13:27.548 11:24:23 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@222 -- # ping -c 1 10.0.0.3 00:13:27.548 PING 10.0.0.3 (10.0.0.3) 56(84) bytes of data. 00:13:27.548 64 bytes from 10.0.0.3: icmp_seq=1 ttl=64 time=0.085 ms 00:13:27.548 00:13:27.548 --- 10.0.0.3 ping statistics --- 00:13:27.548 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:13:27.548 rtt min/avg/max/mdev = 0.085/0.085/0.085/0.000 ms 00:13:27.548 11:24:23 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@223 -- # ping -c 1 10.0.0.4 00:13:27.548 PING 10.0.0.4 (10.0.0.4) 56(84) bytes of data. 00:13:27.548 64 bytes from 10.0.0.4: icmp_seq=1 ttl=64 time=0.054 ms 00:13:27.548 00:13:27.548 --- 10.0.0.4 ping statistics --- 00:13:27.548 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:13:27.548 rtt min/avg/max/mdev = 0.054/0.054/0.054/0.000 ms 00:13:27.548 11:24:23 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@224 -- # ip netns exec nvmf_tgt_ns_spdk ping -c 1 10.0.0.1 00:13:27.548 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:13:27.548 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.023 ms 00:13:27.548 00:13:27.548 --- 10.0.0.1 ping statistics --- 00:13:27.548 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:13:27.548 rtt min/avg/max/mdev = 0.023/0.023/0.023/0.000 ms 00:13:27.548 11:24:23 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@225 -- # ip netns exec nvmf_tgt_ns_spdk ping -c 1 10.0.0.2 00:13:27.548 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:13:27.548 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.052 ms 00:13:27.548 00:13:27.548 --- 10.0.0.2 ping statistics --- 00:13:27.548 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:13:27.548 rtt min/avg/max/mdev = 0.052/0.052/0.052/0.000 ms 00:13:27.548 11:24:23 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@227 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:13:27.548 11:24:23 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@459 -- # return 0 00:13:27.548 11:24:23 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@476 -- # '[' '' == iso ']' 00:13:27.548 11:24:23 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@480 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:13:27.549 11:24:23 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@481 -- # [[ tcp == \r\d\m\a ]] 00:13:27.549 11:24:23 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@490 -- # [[ tcp == \t\c\p ]] 00:13:27.549 11:24:23 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@491 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:13:27.549 11:24:23 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@494 -- # '[' tcp == tcp ']' 00:13:27.549 11:24:23 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@500 -- # modprobe nvme-tcp 00:13:27.549 11:24:23 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- target/fio.sh@17 -- # nvmfappstart -m 0xF 00:13:27.549 11:24:23 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@505 -- # timing_enter start_nvmf_tgt 00:13:27.549 11:24:23 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- common/autotest_common.sh@724 -- # xtrace_disable 00:13:27.549 11:24:23 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- common/autotest_common.sh@10 -- # set +x 00:13:27.549 11:24:23 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@507 -- # nvmfpid=70249 00:13:27.549 11:24:23 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@506 -- # ip netns exec nvmf_tgt_ns_spdk /home/vagrant/spdk_repo/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:13:27.549 11:24:23 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@508 -- # waitforlisten 70249 00:13:27.549 11:24:23 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- common/autotest_common.sh@831 -- # '[' -z 70249 ']' 00:13:27.549 11:24:23 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- common/autotest_common.sh@835 -- # local rpc_addr=/var/tmp/spdk.sock 00:13:27.549 11:24:23 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- common/autotest_common.sh@836 -- # local max_retries=100 00:13:27.549 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:13:27.549 11:24:23 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- common/autotest_common.sh@838 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:13:27.549 11:24:23 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- common/autotest_common.sh@840 -- # xtrace_disable 00:13:27.549 11:24:23 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- common/autotest_common.sh@10 -- # set +x 00:13:27.807 [2024-10-07 11:24:23.129931] Starting SPDK v25.01-pre git sha1 2a4f56c54 / DPDK 24.03.0 initialization... 00:13:27.807 [2024-10-07 11:24:23.130043] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --iova-mode=pa --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:13:27.807 [2024-10-07 11:24:23.271883] app.c: 917:spdk_app_start: *NOTICE*: Total cores available: 4 00:13:28.064 [2024-10-07 11:24:23.387005] app.c: 610:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:13:28.064 [2024-10-07 11:24:23.387071] app.c: 611:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:13:28.064 [2024-10-07 11:24:23.387083] app.c: 616:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:13:28.064 [2024-10-07 11:24:23.387092] app.c: 617:app_setup_trace: *NOTICE*: SPDK application currently running. 00:13:28.064 [2024-10-07 11:24:23.387099] app.c: 618:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:13:28.064 [2024-10-07 11:24:23.388309] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 1 00:13:28.064 [2024-10-07 11:24:23.388423] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 2 00:13:28.064 [2024-10-07 11:24:23.388554] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 3 00:13:28.064 [2024-10-07 11:24:23.388557] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 0 00:13:28.722 11:24:24 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- common/autotest_common.sh@860 -- # (( i == 0 )) 00:13:28.722 11:24:24 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- common/autotest_common.sh@864 -- # return 0 00:13:28.722 11:24:24 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@509 -- # timing_exit start_nvmf_tgt 00:13:28.722 11:24:24 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- common/autotest_common.sh@730 -- # xtrace_disable 00:13:28.722 11:24:24 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- common/autotest_common.sh@10 -- # set +x 00:13:28.722 11:24:24 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@510 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:13:28.722 11:24:24 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- target/fio.sh@19 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_create_transport -t tcp -o -u 8192 00:13:28.981 [2024-10-07 11:24:24.481158] tcp.c: 738:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:13:29.238 11:24:24 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- target/fio.sh@21 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py bdev_malloc_create 64 512 00:13:29.495 11:24:24 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- target/fio.sh@21 -- # malloc_bdevs='Malloc0 ' 00:13:29.495 11:24:24 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- target/fio.sh@22 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py bdev_malloc_create 64 512 00:13:29.753 11:24:25 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- target/fio.sh@22 -- # malloc_bdevs+=Malloc1 00:13:29.753 11:24:25 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- target/fio.sh@24 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py bdev_malloc_create 64 512 00:13:30.011 11:24:25 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- target/fio.sh@24 -- # raid_malloc_bdevs='Malloc2 ' 00:13:30.011 11:24:25 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- target/fio.sh@25 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py bdev_malloc_create 64 512 00:13:30.576 11:24:25 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- target/fio.sh@25 -- # raid_malloc_bdevs+=Malloc3 00:13:30.576 11:24:25 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- target/fio.sh@26 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py bdev_raid_create -n raid0 -z 64 -r 0 -b 'Malloc2 Malloc3' 00:13:30.834 11:24:26 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- target/fio.sh@29 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py bdev_malloc_create 64 512 00:13:31.092 11:24:26 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- target/fio.sh@29 -- # concat_malloc_bdevs='Malloc4 ' 00:13:31.092 11:24:26 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- target/fio.sh@30 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py bdev_malloc_create 64 512 00:13:31.349 11:24:26 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- target/fio.sh@30 -- # concat_malloc_bdevs+='Malloc5 ' 00:13:31.349 11:24:26 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- target/fio.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py bdev_malloc_create 64 512 00:13:31.606 11:24:26 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- target/fio.sh@31 -- # concat_malloc_bdevs+=Malloc6 00:13:31.606 11:24:26 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- target/fio.sh@32 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py bdev_raid_create -n concat0 -r concat -z 64 -b 'Malloc4 Malloc5 Malloc6' 00:13:31.865 11:24:27 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- target/fio.sh@34 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDKISFASTANDAWESOME 00:13:32.122 11:24:27 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- target/fio.sh@35 -- # for malloc_bdev in $malloc_bdevs 00:13:32.122 11:24:27 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- target/fio.sh@36 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:13:32.380 11:24:27 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- target/fio.sh@35 -- # for malloc_bdev in $malloc_bdevs 00:13:32.380 11:24:27 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- target/fio.sh@36 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:13:32.638 11:24:28 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- target/fio.sh@38 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.3 -s 4420 00:13:32.927 [2024-10-07 11:24:28.336173] tcp.c:1081:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.3 port 4420 *** 00:13:32.927 11:24:28 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- target/fio.sh@41 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 raid0 00:13:33.185 11:24:28 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- target/fio.sh@44 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 concat0 00:13:33.752 11:24:28 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- target/fio.sh@46 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:c758a4ed-f09f-4c82-9afb-3d096f035464 --hostid=c758a4ed-f09f-4c82-9afb-3d096f035464 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.3 -s 4420 00:13:33.752 11:24:29 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- target/fio.sh@48 -- # waitforserial SPDKISFASTANDAWESOME 4 00:13:33.752 11:24:29 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- common/autotest_common.sh@1198 -- # local i=0 00:13:33.752 11:24:29 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- common/autotest_common.sh@1199 -- # local nvme_device_counter=1 nvme_devices=0 00:13:33.752 11:24:29 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- common/autotest_common.sh@1200 -- # [[ -n 4 ]] 00:13:33.752 11:24:29 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- common/autotest_common.sh@1201 -- # nvme_device_counter=4 00:13:33.752 11:24:29 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- common/autotest_common.sh@1205 -- # sleep 2 00:13:35.649 11:24:31 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- common/autotest_common.sh@1206 -- # (( i++ <= 15 )) 00:13:35.649 11:24:31 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- common/autotest_common.sh@1207 -- # lsblk -l -o NAME,SERIAL 00:13:35.649 11:24:31 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- common/autotest_common.sh@1207 -- # grep -c SPDKISFASTANDAWESOME 00:13:35.649 11:24:31 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- common/autotest_common.sh@1207 -- # nvme_devices=4 00:13:35.649 11:24:31 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- common/autotest_common.sh@1208 -- # (( nvme_devices == nvme_device_counter )) 00:13:35.650 11:24:31 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- common/autotest_common.sh@1208 -- # return 0 00:13:35.650 11:24:31 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- target/fio.sh@50 -- # /home/vagrant/spdk_repo/spdk/scripts/fio-wrapper -p nvmf -i 4096 -d 1 -t write -r 1 -v 00:13:35.907 [global] 00:13:35.907 thread=1 00:13:35.907 invalidate=1 00:13:35.907 rw=write 00:13:35.907 time_based=1 00:13:35.907 runtime=1 00:13:35.907 ioengine=libaio 00:13:35.907 direct=1 00:13:35.907 bs=4096 00:13:35.907 iodepth=1 00:13:35.907 norandommap=0 00:13:35.907 numjobs=1 00:13:35.907 00:13:35.907 verify_dump=1 00:13:35.907 verify_backlog=512 00:13:35.907 verify_state_save=0 00:13:35.907 do_verify=1 00:13:35.907 verify=crc32c-intel 00:13:35.907 [job0] 00:13:35.907 filename=/dev/nvme0n1 00:13:35.907 [job1] 00:13:35.907 filename=/dev/nvme0n2 00:13:35.907 [job2] 00:13:35.907 filename=/dev/nvme0n3 00:13:35.907 [job3] 00:13:35.907 filename=/dev/nvme0n4 00:13:35.907 Could not set queue depth (nvme0n1) 00:13:35.907 Could not set queue depth (nvme0n2) 00:13:35.907 Could not set queue depth (nvme0n3) 00:13:35.907 Could not set queue depth (nvme0n4) 00:13:35.907 job0: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:13:35.907 job1: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:13:35.907 job2: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:13:35.907 job3: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:13:35.907 fio-3.35 00:13:35.907 Starting 4 threads 00:13:37.317 00:13:37.317 job0: (groupid=0, jobs=1): err= 0: pid=70552: Mon Oct 7 11:24:32 2024 00:13:37.317 read: IOPS=1361, BW=5447KiB/s (5577kB/s)(5452KiB/1001msec) 00:13:37.317 slat (usec): min=15, max=161, avg=28.06, stdev=10.94 00:13:37.317 clat (usec): min=195, max=511, avg=356.50, stdev=41.78 00:13:37.317 lat (usec): min=214, max=534, avg=384.57, stdev=41.53 00:13:37.317 clat percentiles (usec): 00:13:37.317 | 1.00th=[ 237], 5.00th=[ 297], 10.00th=[ 310], 20.00th=[ 326], 00:13:37.317 | 30.00th=[ 334], 40.00th=[ 347], 50.00th=[ 355], 60.00th=[ 363], 00:13:37.317 | 70.00th=[ 375], 80.00th=[ 392], 90.00th=[ 408], 95.00th=[ 429], 00:13:37.317 | 99.00th=[ 461], 99.50th=[ 465], 99.90th=[ 494], 99.95th=[ 510], 00:13:37.317 | 99.99th=[ 510] 00:13:37.317 write: IOPS=1534, BW=6138KiB/s (6285kB/s)(6144KiB/1001msec); 0 zone resets 00:13:37.317 slat (usec): min=20, max=163, avg=34.89, stdev=10.20 00:13:37.317 clat (usec): min=134, max=737, avg=269.29, stdev=47.29 00:13:37.317 lat (usec): min=163, max=771, avg=304.18, stdev=46.96 00:13:37.317 clat percentiles (usec): 00:13:37.317 | 1.00th=[ 190], 5.00th=[ 210], 10.00th=[ 219], 20.00th=[ 235], 00:13:37.317 | 30.00th=[ 245], 40.00th=[ 253], 50.00th=[ 265], 60.00th=[ 273], 00:13:37.317 | 70.00th=[ 281], 80.00th=[ 297], 90.00th=[ 330], 95.00th=[ 363], 00:13:37.317 | 99.00th=[ 412], 99.50th=[ 429], 99.90th=[ 644], 99.95th=[ 742], 00:13:37.317 | 99.99th=[ 742] 00:13:37.317 bw ( KiB/s): min= 7680, max= 7680, per=25.03%, avg=7680.00, stdev= 0.00, samples=1 00:13:37.317 iops : min= 1920, max= 1920, avg=1920.00, stdev= 0.00, samples=1 00:13:37.317 lat (usec) : 250=19.49%, 500=80.37%, 750=0.14% 00:13:37.317 cpu : usr=2.10%, sys=6.80%, ctx=2908, majf=0, minf=11 00:13:37.317 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:13:37.317 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:13:37.317 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:13:37.317 issued rwts: total=1363,1536,0,0 short=0,0,0,0 dropped=0,0,0,0 00:13:37.317 latency : target=0, window=0, percentile=100.00%, depth=1 00:13:37.317 job1: (groupid=0, jobs=1): err= 0: pid=70553: Mon Oct 7 11:24:32 2024 00:13:37.317 read: IOPS=1633, BW=6533KiB/s (6690kB/s)(6540KiB/1001msec) 00:13:37.317 slat (nsec): min=13709, max=50502, avg=19781.28, stdev=6358.43 00:13:37.317 clat (usec): min=218, max=6565, avg=285.72, stdev=294.46 00:13:37.317 lat (usec): min=236, max=6580, avg=305.51, stdev=294.96 00:13:37.317 clat percentiles (usec): 00:13:37.317 | 1.00th=[ 229], 5.00th=[ 241], 10.00th=[ 245], 20.00th=[ 251], 00:13:37.317 | 30.00th=[ 258], 40.00th=[ 262], 50.00th=[ 265], 60.00th=[ 269], 00:13:37.317 | 70.00th=[ 273], 80.00th=[ 281], 90.00th=[ 293], 95.00th=[ 306], 00:13:37.317 | 99.00th=[ 330], 99.50th=[ 1037], 99.90th=[ 6194], 99.95th=[ 6587], 00:13:37.317 | 99.99th=[ 6587] 00:13:37.317 write: IOPS=2045, BW=8184KiB/s (8380kB/s)(8192KiB/1001msec); 0 zone resets 00:13:37.317 slat (usec): min=19, max=142, avg=27.19, stdev= 8.04 00:13:37.317 clat (usec): min=156, max=591, avg=213.57, stdev=23.89 00:13:37.317 lat (usec): min=181, max=623, avg=240.76, stdev=27.21 00:13:37.317 clat percentiles (usec): 00:13:37.317 | 1.00th=[ 174], 5.00th=[ 182], 10.00th=[ 188], 20.00th=[ 194], 00:13:37.317 | 30.00th=[ 200], 40.00th=[ 206], 50.00th=[ 212], 60.00th=[ 217], 00:13:37.317 | 70.00th=[ 223], 80.00th=[ 233], 90.00th=[ 243], 95.00th=[ 253], 00:13:37.318 | 99.00th=[ 269], 99.50th=[ 277], 99.90th=[ 293], 99.95th=[ 482], 00:13:37.318 | 99.99th=[ 594] 00:13:37.318 bw ( KiB/s): min= 8192, max= 8192, per=26.69%, avg=8192.00, stdev= 0.00, samples=1 00:13:37.318 iops : min= 2048, max= 2048, avg=2048.00, stdev= 0.00, samples=1 00:13:37.318 lat (usec) : 250=60.30%, 500=39.40%, 750=0.05% 00:13:37.318 lat (msec) : 2=0.05%, 4=0.08%, 10=0.11% 00:13:37.318 cpu : usr=1.50%, sys=6.70%, ctx=3684, majf=0, minf=5 00:13:37.318 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:13:37.318 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:13:37.318 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:13:37.318 issued rwts: total=1635,2048,0,0 short=0,0,0,0 dropped=0,0,0,0 00:13:37.318 latency : target=0, window=0, percentile=100.00%, depth=1 00:13:37.318 job2: (groupid=0, jobs=1): err= 0: pid=70554: Mon Oct 7 11:24:32 2024 00:13:37.318 read: IOPS=1349, BW=5399KiB/s (5528kB/s)(5404KiB/1001msec) 00:13:37.318 slat (nsec): min=15515, max=77052, avg=21991.88, stdev=7640.20 00:13:37.318 clat (usec): min=175, max=545, avg=367.85, stdev=39.19 00:13:37.318 lat (usec): min=193, max=590, avg=389.84, stdev=40.29 00:13:37.318 clat percentiles (usec): 00:13:37.318 | 1.00th=[ 302], 5.00th=[ 314], 10.00th=[ 322], 20.00th=[ 334], 00:13:37.318 | 30.00th=[ 347], 40.00th=[ 355], 50.00th=[ 367], 60.00th=[ 375], 00:13:37.318 | 70.00th=[ 388], 80.00th=[ 400], 90.00th=[ 416], 95.00th=[ 437], 00:13:37.318 | 99.00th=[ 478], 99.50th=[ 494], 99.90th=[ 519], 99.95th=[ 545], 00:13:37.318 | 99.99th=[ 545] 00:13:37.318 write: IOPS=1534, BW=6138KiB/s (6285kB/s)(6144KiB/1001msec); 0 zone resets 00:13:37.318 slat (usec): min=22, max=108, avg=38.90, stdev=11.70 00:13:37.318 clat (usec): min=149, max=670, avg=264.04, stdev=45.45 00:13:37.318 lat (usec): min=184, max=699, avg=302.94, stdev=45.06 00:13:37.318 clat percentiles (usec): 00:13:37.318 | 1.00th=[ 182], 5.00th=[ 204], 10.00th=[ 215], 20.00th=[ 229], 00:13:37.318 | 30.00th=[ 241], 40.00th=[ 249], 50.00th=[ 260], 60.00th=[ 269], 00:13:37.318 | 70.00th=[ 277], 80.00th=[ 293], 90.00th=[ 322], 95.00th=[ 355], 00:13:37.318 | 99.00th=[ 404], 99.50th=[ 416], 99.90th=[ 457], 99.95th=[ 668], 00:13:37.318 | 99.99th=[ 668] 00:13:37.318 bw ( KiB/s): min= 7688, max= 7688, per=25.05%, avg=7688.00, stdev= 0.00, samples=1 00:13:37.318 iops : min= 1922, max= 1922, avg=1922.00, stdev= 0.00, samples=1 00:13:37.318 lat (usec) : 250=21.65%, 500=78.14%, 750=0.21% 00:13:37.318 cpu : usr=2.10%, sys=6.60%, ctx=2888, majf=0, minf=13 00:13:37.318 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:13:37.318 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:13:37.318 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:13:37.318 issued rwts: total=1351,1536,0,0 short=0,0,0,0 dropped=0,0,0,0 00:13:37.318 latency : target=0, window=0, percentile=100.00%, depth=1 00:13:37.318 job3: (groupid=0, jobs=1): err= 0: pid=70555: Mon Oct 7 11:24:32 2024 00:13:37.318 read: IOPS=2213, BW=8855KiB/s (9068kB/s)(8864KiB/1001msec) 00:13:37.318 slat (nsec): min=12088, max=72658, avg=16556.90, stdev=5593.17 00:13:37.318 clat (usec): min=141, max=1796, avg=207.83, stdev=48.87 00:13:37.318 lat (usec): min=171, max=1813, avg=224.38, stdev=49.65 00:13:37.318 clat percentiles (usec): 00:13:37.318 | 1.00th=[ 165], 5.00th=[ 172], 10.00th=[ 176], 20.00th=[ 182], 00:13:37.318 | 30.00th=[ 188], 40.00th=[ 194], 50.00th=[ 200], 60.00th=[ 208], 00:13:37.318 | 70.00th=[ 219], 80.00th=[ 229], 90.00th=[ 247], 95.00th=[ 265], 00:13:37.318 | 99.00th=[ 310], 99.50th=[ 363], 99.90th=[ 537], 99.95th=[ 873], 00:13:37.318 | 99.99th=[ 1795] 00:13:37.318 write: IOPS=2557, BW=9.99MiB/s (10.5MB/s)(10.0MiB/1001msec); 0 zone resets 00:13:37.318 slat (usec): min=16, max=123, avg=24.14, stdev= 9.15 00:13:37.318 clat (usec): min=114, max=367, avg=168.80, stdev=27.33 00:13:37.318 lat (usec): min=132, max=390, avg=192.94, stdev=30.05 00:13:37.318 clat percentiles (usec): 00:13:37.318 | 1.00th=[ 126], 5.00th=[ 133], 10.00th=[ 137], 20.00th=[ 145], 00:13:37.318 | 30.00th=[ 151], 40.00th=[ 159], 50.00th=[ 165], 60.00th=[ 174], 00:13:37.318 | 70.00th=[ 182], 80.00th=[ 192], 90.00th=[ 206], 95.00th=[ 217], 00:13:37.318 | 99.00th=[ 245], 99.50th=[ 265], 99.90th=[ 285], 99.95th=[ 285], 00:13:37.318 | 99.99th=[ 367] 00:13:37.318 bw ( KiB/s): min=10704, max=10704, per=34.88%, avg=10704.00, stdev= 0.00, samples=1 00:13:37.318 iops : min= 2676, max= 2676, avg=2676.00, stdev= 0.00, samples=1 00:13:37.318 lat (usec) : 250=95.60%, 500=4.33%, 750=0.02%, 1000=0.02% 00:13:37.318 lat (msec) : 2=0.02% 00:13:37.318 cpu : usr=1.60%, sys=7.80%, ctx=4777, majf=0, minf=9 00:13:37.318 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:13:37.318 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:13:37.318 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:13:37.318 issued rwts: total=2216,2560,0,0 short=0,0,0,0 dropped=0,0,0,0 00:13:37.318 latency : target=0, window=0, percentile=100.00%, depth=1 00:13:37.318 00:13:37.318 Run status group 0 (all jobs): 00:13:37.318 READ: bw=25.6MiB/s (26.9MB/s), 5399KiB/s-8855KiB/s (5528kB/s-9068kB/s), io=25.6MiB (26.9MB), run=1001-1001msec 00:13:37.318 WRITE: bw=30.0MiB/s (31.4MB/s), 6138KiB/s-9.99MiB/s (6285kB/s-10.5MB/s), io=30.0MiB (31.5MB), run=1001-1001msec 00:13:37.318 00:13:37.318 Disk stats (read/write): 00:13:37.318 nvme0n1: ios=1074/1507, merge=0/0, ticks=399/415, in_queue=814, util=87.88% 00:13:37.318 nvme0n2: ios=1576/1586, merge=0/0, ticks=445/344, in_queue=789, util=87.61% 00:13:37.318 nvme0n3: ios=1057/1497, merge=0/0, ticks=451/419, in_queue=870, util=92.84% 00:13:37.318 nvme0n4: ios=2059/2048, merge=0/0, ticks=546/355, in_queue=901, util=92.07% 00:13:37.318 11:24:32 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- target/fio.sh@51 -- # /home/vagrant/spdk_repo/spdk/scripts/fio-wrapper -p nvmf -i 4096 -d 1 -t randwrite -r 1 -v 00:13:37.318 [global] 00:13:37.318 thread=1 00:13:37.318 invalidate=1 00:13:37.318 rw=randwrite 00:13:37.318 time_based=1 00:13:37.318 runtime=1 00:13:37.318 ioengine=libaio 00:13:37.318 direct=1 00:13:37.318 bs=4096 00:13:37.318 iodepth=1 00:13:37.318 norandommap=0 00:13:37.318 numjobs=1 00:13:37.318 00:13:37.318 verify_dump=1 00:13:37.318 verify_backlog=512 00:13:37.318 verify_state_save=0 00:13:37.318 do_verify=1 00:13:37.318 verify=crc32c-intel 00:13:37.318 [job0] 00:13:37.318 filename=/dev/nvme0n1 00:13:37.318 [job1] 00:13:37.318 filename=/dev/nvme0n2 00:13:37.318 [job2] 00:13:37.318 filename=/dev/nvme0n3 00:13:37.318 [job3] 00:13:37.318 filename=/dev/nvme0n4 00:13:37.318 Could not set queue depth (nvme0n1) 00:13:37.318 Could not set queue depth (nvme0n2) 00:13:37.318 Could not set queue depth (nvme0n3) 00:13:37.318 Could not set queue depth (nvme0n4) 00:13:37.318 job0: (g=0): rw=randwrite, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:13:37.318 job1: (g=0): rw=randwrite, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:13:37.318 job2: (g=0): rw=randwrite, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:13:37.318 job3: (g=0): rw=randwrite, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:13:37.318 fio-3.35 00:13:37.318 Starting 4 threads 00:13:38.699 00:13:38.699 job0: (groupid=0, jobs=1): err= 0: pid=70608: Mon Oct 7 11:24:33 2024 00:13:38.699 read: IOPS=2557, BW=9.99MiB/s (10.5MB/s)(10.0MiB/1001msec) 00:13:38.699 slat (nsec): min=12248, max=57350, avg=15649.78, stdev=3655.01 00:13:38.699 clat (usec): min=139, max=562, avg=181.07, stdev=24.87 00:13:38.699 lat (usec): min=152, max=576, avg=196.72, stdev=25.34 00:13:38.699 clat percentiles (usec): 00:13:38.699 | 1.00th=[ 149], 5.00th=[ 155], 10.00th=[ 159], 20.00th=[ 163], 00:13:38.699 | 30.00th=[ 167], 40.00th=[ 172], 50.00th=[ 176], 60.00th=[ 182], 00:13:38.699 | 70.00th=[ 188], 80.00th=[ 196], 90.00th=[ 210], 95.00th=[ 223], 00:13:38.699 | 99.00th=[ 260], 99.50th=[ 289], 99.90th=[ 363], 99.95th=[ 367], 00:13:38.699 | 99.99th=[ 562] 00:13:38.699 write: IOPS=2891, BW=11.3MiB/s (11.8MB/s)(11.3MiB/1001msec); 0 zone resets 00:13:38.699 slat (usec): min=17, max=142, avg=24.02, stdev= 7.46 00:13:38.699 clat (usec): min=101, max=2495, avg=144.14, stdev=52.99 00:13:38.699 lat (usec): min=120, max=2521, avg=168.15, stdev=53.68 00:13:38.699 clat percentiles (usec): 00:13:38.699 | 1.00th=[ 110], 5.00th=[ 116], 10.00th=[ 119], 20.00th=[ 124], 00:13:38.699 | 30.00th=[ 128], 40.00th=[ 133], 50.00th=[ 137], 60.00th=[ 143], 00:13:38.699 | 70.00th=[ 151], 80.00th=[ 161], 90.00th=[ 174], 95.00th=[ 188], 00:13:38.699 | 99.00th=[ 229], 99.50th=[ 249], 99.90th=[ 570], 99.95th=[ 840], 00:13:38.699 | 99.99th=[ 2507] 00:13:38.699 bw ( KiB/s): min=12239, max=12239, per=40.83%, avg=12239.00, stdev= 0.00, samples=1 00:13:38.699 iops : min= 3059, max= 3059, avg=3059.00, stdev= 0.00, samples=1 00:13:38.699 lat (usec) : 250=99.05%, 500=0.86%, 750=0.06%, 1000=0.02% 00:13:38.699 lat (msec) : 4=0.02% 00:13:38.699 cpu : usr=2.10%, sys=8.30%, ctx=5455, majf=0, minf=13 00:13:38.699 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:13:38.699 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:13:38.699 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:13:38.699 issued rwts: total=2560,2894,0,0 short=0,0,0,0 dropped=0,0,0,0 00:13:38.699 latency : target=0, window=0, percentile=100.00%, depth=1 00:13:38.699 job1: (groupid=0, jobs=1): err= 0: pid=70609: Mon Oct 7 11:24:33 2024 00:13:38.699 read: IOPS=1292, BW=5171KiB/s (5295kB/s)(5176KiB/1001msec) 00:13:38.699 slat (nsec): min=6765, max=58865, avg=13714.59, stdev=6955.48 00:13:38.699 clat (usec): min=176, max=40632, avg=392.89, stdev=1120.29 00:13:38.699 lat (usec): min=188, max=40640, avg=406.60, stdev=1120.14 00:13:38.699 clat percentiles (usec): 00:13:38.699 | 1.00th=[ 281], 5.00th=[ 297], 10.00th=[ 310], 20.00th=[ 326], 00:13:38.699 | 30.00th=[ 343], 40.00th=[ 351], 50.00th=[ 359], 60.00th=[ 371], 00:13:38.699 | 70.00th=[ 383], 80.00th=[ 392], 90.00th=[ 412], 95.00th=[ 437], 00:13:38.699 | 99.00th=[ 486], 99.50th=[ 494], 99.90th=[ 537], 99.95th=[40633], 00:13:38.699 | 99.99th=[40633] 00:13:38.699 write: IOPS=1534, BW=6138KiB/s (6285kB/s)(6144KiB/1001msec); 0 zone resets 00:13:38.699 slat (usec): min=10, max=141, avg=20.98, stdev= 6.35 00:13:38.699 clat (usec): min=118, max=1923, avg=284.41, stdev=62.57 00:13:38.699 lat (usec): min=146, max=1946, avg=305.38, stdev=62.03 00:13:38.699 clat percentiles (usec): 00:13:38.699 | 1.00th=[ 167], 5.00th=[ 215], 10.00th=[ 237], 20.00th=[ 253], 00:13:38.699 | 30.00th=[ 265], 40.00th=[ 277], 50.00th=[ 281], 60.00th=[ 289], 00:13:38.699 | 70.00th=[ 302], 80.00th=[ 310], 90.00th=[ 326], 95.00th=[ 355], 00:13:38.699 | 99.00th=[ 429], 99.50th=[ 449], 99.90th=[ 865], 99.95th=[ 1926], 00:13:38.699 | 99.99th=[ 1926] 00:13:38.699 bw ( KiB/s): min= 8159, max= 8159, per=27.22%, avg=8159.00, stdev= 0.00, samples=1 00:13:38.699 iops : min= 2039, max= 2039, avg=2039.00, stdev= 0.00, samples=1 00:13:38.699 lat (usec) : 250=9.26%, 500=90.49%, 750=0.14%, 1000=0.04% 00:13:38.699 lat (msec) : 2=0.04%, 50=0.04% 00:13:38.699 cpu : usr=1.10%, sys=4.00%, ctx=2942, majf=0, minf=9 00:13:38.699 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:13:38.699 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:13:38.699 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:13:38.699 issued rwts: total=1294,1536,0,0 short=0,0,0,0 dropped=0,0,0,0 00:13:38.699 latency : target=0, window=0, percentile=100.00%, depth=1 00:13:38.699 job2: (groupid=0, jobs=1): err= 0: pid=70610: Mon Oct 7 11:24:33 2024 00:13:38.699 read: IOPS=1378, BW=5514KiB/s (5647kB/s)(5520KiB/1001msec) 00:13:38.699 slat (usec): min=6, max=167, avg=22.27, stdev=11.40 00:13:38.699 clat (usec): min=226, max=40677, avg=381.11, stdev=1134.81 00:13:38.699 lat (usec): min=256, max=40686, avg=403.39, stdev=1134.65 00:13:38.699 clat percentiles (usec): 00:13:38.699 | 1.00th=[ 247], 5.00th=[ 260], 10.00th=[ 269], 20.00th=[ 277], 00:13:38.699 | 30.00th=[ 285], 40.00th=[ 302], 50.00th=[ 318], 60.00th=[ 351], 00:13:38.699 | 70.00th=[ 367], 80.00th=[ 383], 90.00th=[ 404], 95.00th=[ 449], 00:13:38.699 | 99.00th=[ 545], 99.50th=[ 2999], 99.90th=[ 7504], 99.95th=[40633], 00:13:38.699 | 99.99th=[40633] 00:13:38.699 write: IOPS=1534, BW=6138KiB/s (6285kB/s)(6144KiB/1001msec); 0 zone resets 00:13:38.699 slat (usec): min=10, max=151, avg=27.88, stdev= 9.93 00:13:38.699 clat (usec): min=133, max=778, avg=256.40, stdev=48.05 00:13:38.699 lat (usec): min=157, max=833, avg=284.27, stdev=46.25 00:13:38.699 clat percentiles (usec): 00:13:38.699 | 1.00th=[ 145], 5.00th=[ 198], 10.00th=[ 212], 20.00th=[ 225], 00:13:38.699 | 30.00th=[ 233], 40.00th=[ 239], 50.00th=[ 247], 60.00th=[ 260], 00:13:38.699 | 70.00th=[ 273], 80.00th=[ 293], 90.00th=[ 314], 95.00th=[ 334], 00:13:38.699 | 99.00th=[ 388], 99.50th=[ 424], 99.90th=[ 594], 99.95th=[ 783], 00:13:38.699 | 99.99th=[ 783] 00:13:38.699 bw ( KiB/s): min= 8159, max= 8159, per=27.22%, avg=8159.00, stdev= 0.00, samples=1 00:13:38.699 iops : min= 2039, max= 2039, avg=2039.00, stdev= 0.00, samples=1 00:13:38.699 lat (usec) : 250=28.74%, 500=70.06%, 750=0.86%, 1000=0.03% 00:13:38.699 lat (msec) : 2=0.07%, 4=0.10%, 10=0.10%, 50=0.03% 00:13:38.699 cpu : usr=1.00%, sys=6.00%, ctx=3099, majf=0, minf=19 00:13:38.699 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:13:38.699 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:13:38.699 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:13:38.699 issued rwts: total=1380,1536,0,0 short=0,0,0,0 dropped=0,0,0,0 00:13:38.699 latency : target=0, window=0, percentile=100.00%, depth=1 00:13:38.699 job3: (groupid=0, jobs=1): err= 0: pid=70611: Mon Oct 7 11:24:33 2024 00:13:38.699 read: IOPS=1293, BW=5175KiB/s (5299kB/s)(5180KiB/1001msec) 00:13:38.699 slat (nsec): min=7039, max=58561, avg=14772.33, stdev=5888.60 00:13:38.699 clat (usec): min=162, max=40601, avg=391.91, stdev=1119.02 00:13:38.699 lat (usec): min=186, max=40616, avg=406.69, stdev=1119.02 00:13:38.699 clat percentiles (usec): 00:13:38.699 | 1.00th=[ 277], 5.00th=[ 297], 10.00th=[ 310], 20.00th=[ 326], 00:13:38.699 | 30.00th=[ 338], 40.00th=[ 351], 50.00th=[ 359], 60.00th=[ 371], 00:13:38.699 | 70.00th=[ 379], 80.00th=[ 396], 90.00th=[ 416], 95.00th=[ 433], 00:13:38.699 | 99.00th=[ 478], 99.50th=[ 490], 99.90th=[ 510], 99.95th=[40633], 00:13:38.699 | 99.99th=[40633] 00:13:38.699 write: IOPS=1534, BW=6138KiB/s (6285kB/s)(6144KiB/1001msec); 0 zone resets 00:13:38.699 slat (nsec): min=10510, max=68412, avg=20954.27, stdev=5683.47 00:13:38.700 clat (usec): min=137, max=2027, avg=284.07, stdev=64.65 00:13:38.700 lat (usec): min=159, max=2061, avg=305.03, stdev=64.35 00:13:38.700 clat percentiles (usec): 00:13:38.700 | 1.00th=[ 167], 5.00th=[ 208], 10.00th=[ 233], 20.00th=[ 253], 00:13:38.700 | 30.00th=[ 265], 40.00th=[ 273], 50.00th=[ 281], 60.00th=[ 289], 00:13:38.700 | 70.00th=[ 297], 80.00th=[ 314], 90.00th=[ 334], 95.00th=[ 363], 00:13:38.700 | 99.00th=[ 416], 99.50th=[ 449], 99.90th=[ 799], 99.95th=[ 2024], 00:13:38.700 | 99.99th=[ 2024] 00:13:38.700 bw ( KiB/s): min= 8175, max= 8175, per=27.27%, avg=8175.00, stdev= 0.00, samples=1 00:13:38.700 iops : min= 2043, max= 2043, avg=2043.00, stdev= 0.00, samples=1 00:13:38.700 lat (usec) : 250=9.96%, 500=89.79%, 750=0.14%, 1000=0.04% 00:13:38.700 lat (msec) : 4=0.04%, 50=0.04% 00:13:38.700 cpu : usr=1.20%, sys=4.00%, ctx=2903, majf=0, minf=7 00:13:38.700 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:13:38.700 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:13:38.700 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:13:38.700 issued rwts: total=1295,1536,0,0 short=0,0,0,0 dropped=0,0,0,0 00:13:38.700 latency : target=0, window=0, percentile=100.00%, depth=1 00:13:38.700 00:13:38.700 Run status group 0 (all jobs): 00:13:38.700 READ: bw=25.5MiB/s (26.7MB/s), 5171KiB/s-9.99MiB/s (5295kB/s-10.5MB/s), io=25.5MiB (26.7MB), run=1001-1001msec 00:13:38.700 WRITE: bw=29.3MiB/s (30.7MB/s), 6138KiB/s-11.3MiB/s (6285kB/s-11.8MB/s), io=29.3MiB (30.7MB), run=1001-1001msec 00:13:38.700 00:13:38.700 Disk stats (read/write): 00:13:38.700 nvme0n1: ios=2112/2560, merge=0/0, ticks=422/414, in_queue=836, util=87.58% 00:13:38.700 nvme0n2: ios=1058/1415, merge=0/0, ticks=445/417, in_queue=862, util=88.65% 00:13:38.700 nvme0n3: ios=1037/1536, merge=0/0, ticks=375/417, in_queue=792, util=87.75% 00:13:38.700 nvme0n4: ios=1024/1415, merge=0/0, ticks=410/409, in_queue=819, util=89.66% 00:13:38.700 11:24:33 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- target/fio.sh@52 -- # /home/vagrant/spdk_repo/spdk/scripts/fio-wrapper -p nvmf -i 4096 -d 128 -t write -r 1 -v 00:13:38.700 [global] 00:13:38.700 thread=1 00:13:38.700 invalidate=1 00:13:38.700 rw=write 00:13:38.700 time_based=1 00:13:38.700 runtime=1 00:13:38.700 ioengine=libaio 00:13:38.700 direct=1 00:13:38.700 bs=4096 00:13:38.700 iodepth=128 00:13:38.700 norandommap=0 00:13:38.700 numjobs=1 00:13:38.700 00:13:38.700 verify_dump=1 00:13:38.700 verify_backlog=512 00:13:38.700 verify_state_save=0 00:13:38.700 do_verify=1 00:13:38.700 verify=crc32c-intel 00:13:38.700 [job0] 00:13:38.700 filename=/dev/nvme0n1 00:13:38.700 [job1] 00:13:38.700 filename=/dev/nvme0n2 00:13:38.700 [job2] 00:13:38.700 filename=/dev/nvme0n3 00:13:38.700 [job3] 00:13:38.700 filename=/dev/nvme0n4 00:13:38.700 Could not set queue depth (nvme0n1) 00:13:38.700 Could not set queue depth (nvme0n2) 00:13:38.700 Could not set queue depth (nvme0n3) 00:13:38.700 Could not set queue depth (nvme0n4) 00:13:38.700 job0: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=128 00:13:38.700 job1: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=128 00:13:38.700 job2: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=128 00:13:38.700 job3: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=128 00:13:38.700 fio-3.35 00:13:38.700 Starting 4 threads 00:13:40.077 00:13:40.077 job0: (groupid=0, jobs=1): err= 0: pid=70672: Mon Oct 7 11:24:35 2024 00:13:40.077 read: IOPS=2721, BW=10.6MiB/s (11.1MB/s)(10.7MiB/1004msec) 00:13:40.077 slat (usec): min=3, max=8472, avg=184.41, stdev=823.70 00:13:40.077 clat (usec): min=382, max=35415, avg=22929.34, stdev=4896.16 00:13:40.077 lat (usec): min=6635, max=35459, avg=23113.74, stdev=4877.10 00:13:40.077 clat percentiles (usec): 00:13:40.077 | 1.00th=[ 7177], 5.00th=[16712], 10.00th=[17171], 20.00th=[17695], 00:13:40.077 | 30.00th=[19530], 40.00th=[22414], 50.00th=[23987], 60.00th=[25035], 00:13:40.077 | 70.00th=[26084], 80.00th=[27132], 90.00th=[28443], 95.00th=[30016], 00:13:40.077 | 99.00th=[32900], 99.50th=[33817], 99.90th=[33817], 99.95th=[35390], 00:13:40.077 | 99.99th=[35390] 00:13:40.077 write: IOPS=3059, BW=12.0MiB/s (12.5MB/s)(12.0MiB/1004msec); 0 zone resets 00:13:40.077 slat (usec): min=6, max=6070, avg=154.33, stdev=618.24 00:13:40.077 clat (usec): min=12633, max=31897, avg=20786.20, stdev=3716.65 00:13:40.077 lat (usec): min=12655, max=31918, avg=20940.53, stdev=3712.70 00:13:40.077 clat percentiles (usec): 00:13:40.077 | 1.00th=[13829], 5.00th=[15008], 10.00th=[16057], 20.00th=[17433], 00:13:40.077 | 30.00th=[18482], 40.00th=[19792], 50.00th=[20579], 60.00th=[21627], 00:13:40.077 | 70.00th=[22414], 80.00th=[23725], 90.00th=[25560], 95.00th=[27395], 00:13:40.077 | 99.00th=[30540], 99.50th=[31327], 99.90th=[31851], 99.95th=[31851], 00:13:40.077 | 99.99th=[31851] 00:13:40.077 bw ( KiB/s): min=12288, max=12288, per=20.92%, avg=12288.00, stdev= 0.00, samples=2 00:13:40.077 iops : min= 3072, max= 3072, avg=3072.00, stdev= 0.00, samples=2 00:13:40.077 lat (usec) : 500=0.02% 00:13:40.077 lat (msec) : 10=0.55%, 20=37.18%, 50=62.25% 00:13:40.077 cpu : usr=3.49%, sys=7.98%, ctx=745, majf=0, minf=11 00:13:40.077 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.3%, 32=0.6%, >=64=98.9% 00:13:40.077 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:13:40.077 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:13:40.077 issued rwts: total=2732,3072,0,0 short=0,0,0,0 dropped=0,0,0,0 00:13:40.077 latency : target=0, window=0, percentile=100.00%, depth=128 00:13:40.077 job1: (groupid=0, jobs=1): err= 0: pid=70673: Mon Oct 7 11:24:35 2024 00:13:40.077 read: IOPS=2552, BW=9.97MiB/s (10.5MB/s)(10.0MiB/1003msec) 00:13:40.077 slat (usec): min=3, max=8243, avg=191.56, stdev=837.76 00:13:40.077 clat (usec): min=13242, max=36532, avg=24694.58, stdev=3599.99 00:13:40.077 lat (usec): min=13263, max=36545, avg=24886.14, stdev=3583.77 00:13:40.077 clat percentiles (usec): 00:13:40.077 | 1.00th=[14484], 5.00th=[19530], 10.00th=[20579], 20.00th=[21365], 00:13:40.077 | 30.00th=[23200], 40.00th=[23987], 50.00th=[24773], 60.00th=[25297], 00:13:40.077 | 70.00th=[26346], 80.00th=[27657], 90.00th=[29230], 95.00th=[30278], 00:13:40.077 | 99.00th=[33817], 99.50th=[35390], 99.90th=[36439], 99.95th=[36439], 00:13:40.077 | 99.99th=[36439] 00:13:40.077 write: IOPS=2920, BW=11.4MiB/s (12.0MB/s)(11.4MiB/1003msec); 0 zone resets 00:13:40.077 slat (usec): min=10, max=9371, avg=166.44, stdev=698.32 00:13:40.077 clat (usec): min=2594, max=30847, avg=21657.74, stdev=3112.12 00:13:40.077 lat (usec): min=5063, max=30894, avg=21824.17, stdev=3133.02 00:13:40.077 clat percentiles (usec): 00:13:40.077 | 1.00th=[ 7832], 5.00th=[17433], 10.00th=[18744], 20.00th=[20055], 00:13:40.077 | 30.00th=[20579], 40.00th=[21103], 50.00th=[21627], 60.00th=[22414], 00:13:40.077 | 70.00th=[23200], 80.00th=[23987], 90.00th=[25035], 95.00th=[25560], 00:13:40.077 | 99.00th=[27657], 99.50th=[28443], 99.90th=[30016], 99.95th=[30278], 00:13:40.077 | 99.99th=[30802] 00:13:40.077 bw ( KiB/s): min=10128, max=12288, per=19.08%, avg=11208.00, stdev=1527.35, samples=2 00:13:40.077 iops : min= 2532, max= 3072, avg=2802.00, stdev=381.84, samples=2 00:13:40.077 lat (msec) : 4=0.02%, 10=0.56%, 20=12.04%, 50=87.37% 00:13:40.077 cpu : usr=2.69%, sys=7.98%, ctx=798, majf=0, minf=6 00:13:40.077 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.3%, 32=0.6%, >=64=98.9% 00:13:40.077 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:13:40.077 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:13:40.077 issued rwts: total=2560,2929,0,0 short=0,0,0,0 dropped=0,0,0,0 00:13:40.077 latency : target=0, window=0, percentile=100.00%, depth=128 00:13:40.077 job2: (groupid=0, jobs=1): err= 0: pid=70674: Mon Oct 7 11:24:35 2024 00:13:40.077 read: IOPS=4079, BW=15.9MiB/s (16.7MB/s)(16.0MiB/1004msec) 00:13:40.077 slat (usec): min=6, max=4917, avg=114.85, stdev=553.41 00:13:40.077 clat (usec): min=10712, max=21044, avg=15095.50, stdev=2045.89 00:13:40.077 lat (usec): min=11598, max=21217, avg=15210.35, stdev=1997.66 00:13:40.077 clat percentiles (usec): 00:13:40.077 | 1.00th=[11469], 5.00th=[12518], 10.00th=[13566], 20.00th=[13960], 00:13:40.077 | 30.00th=[14222], 40.00th=[14484], 50.00th=[14615], 60.00th=[14746], 00:13:40.077 | 70.00th=[15008], 80.00th=[15533], 90.00th=[19268], 95.00th=[20055], 00:13:40.077 | 99.00th=[20841], 99.50th=[21103], 99.90th=[21103], 99.95th=[21103], 00:13:40.077 | 99.99th=[21103] 00:13:40.077 write: IOPS=4334, BW=16.9MiB/s (17.8MB/s)(17.0MiB/1004msec); 0 zone resets 00:13:40.077 slat (usec): min=10, max=5215, avg=114.36, stdev=509.04 00:13:40.077 clat (usec): min=312, max=23924, avg=14862.10, stdev=3004.54 00:13:40.077 lat (usec): min=3231, max=23949, avg=14976.46, stdev=3013.18 00:13:40.077 clat percentiles (usec): 00:13:40.077 | 1.00th=[ 7046], 5.00th=[11731], 10.00th=[11863], 20.00th=[12387], 00:13:40.077 | 30.00th=[12911], 40.00th=[14353], 50.00th=[14615], 60.00th=[15008], 00:13:40.077 | 70.00th=[15533], 80.00th=[16581], 90.00th=[20055], 95.00th=[20841], 00:13:40.077 | 99.00th=[22676], 99.50th=[22938], 99.90th=[23725], 99.95th=[23987], 00:13:40.077 | 99.99th=[23987] 00:13:40.077 bw ( KiB/s): min=16384, max=17408, per=28.77%, avg=16896.00, stdev=724.08, samples=2 00:13:40.077 iops : min= 4096, max= 4352, avg=4224.00, stdev=181.02, samples=2 00:13:40.077 lat (usec) : 500=0.01% 00:13:40.077 lat (msec) : 4=0.38%, 10=0.43%, 20=91.65%, 50=7.53% 00:13:40.077 cpu : usr=3.49%, sys=12.76%, ctx=424, majf=0, minf=11 00:13:40.077 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.4%, >=64=99.3% 00:13:40.077 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:13:40.077 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:13:40.077 issued rwts: total=4096,4352,0,0 short=0,0,0,0 dropped=0,0,0,0 00:13:40.077 latency : target=0, window=0, percentile=100.00%, depth=128 00:13:40.077 job3: (groupid=0, jobs=1): err= 0: pid=70675: Mon Oct 7 11:24:35 2024 00:13:40.077 read: IOPS=4083, BW=16.0MiB/s (16.7MB/s)(16.0MiB/1003msec) 00:13:40.077 slat (usec): min=7, max=4763, avg=115.11, stdev=554.25 00:13:40.077 clat (usec): min=10456, max=21035, avg=15040.11, stdev=2015.10 00:13:40.077 lat (usec): min=11009, max=21234, avg=15155.21, stdev=1965.96 00:13:40.077 clat percentiles (usec): 00:13:40.077 | 1.00th=[11338], 5.00th=[12780], 10.00th=[13566], 20.00th=[13829], 00:13:40.078 | 30.00th=[14091], 40.00th=[14353], 50.00th=[14484], 60.00th=[14615], 00:13:40.078 | 70.00th=[14877], 80.00th=[15664], 90.00th=[18744], 95.00th=[19792], 00:13:40.078 | 99.00th=[20579], 99.50th=[20579], 99.90th=[21103], 99.95th=[21103], 00:13:40.078 | 99.99th=[21103] 00:13:40.078 write: IOPS=4374, BW=17.1MiB/s (17.9MB/s)(17.1MiB/1003msec); 0 zone resets 00:13:40.078 slat (usec): min=11, max=4917, avg=113.05, stdev=509.31 00:13:40.078 clat (usec): min=228, max=21729, avg=14766.45, stdev=2910.42 00:13:40.078 lat (usec): min=3361, max=21758, avg=14879.50, stdev=2916.38 00:13:40.078 clat percentiles (usec): 00:13:40.078 | 1.00th=[ 7373], 5.00th=[11469], 10.00th=[11994], 20.00th=[12518], 00:13:40.078 | 30.00th=[12780], 40.00th=[14091], 50.00th=[14353], 60.00th=[15139], 00:13:40.078 | 70.00th=[15664], 80.00th=[16188], 90.00th=[20055], 95.00th=[20579], 00:13:40.078 | 99.00th=[21365], 99.50th=[21627], 99.90th=[21627], 99.95th=[21627], 00:13:40.078 | 99.99th=[21627] 00:13:40.078 bw ( KiB/s): min=16384, max=17696, per=29.01%, avg=17040.00, stdev=927.72, samples=2 00:13:40.078 iops : min= 4096, max= 4424, avg=4260.00, stdev=231.93, samples=2 00:13:40.078 lat (usec) : 250=0.01% 00:13:40.078 lat (msec) : 4=0.29%, 10=0.59%, 20=92.04%, 50=7.06% 00:13:40.078 cpu : usr=4.29%, sys=11.78%, ctx=435, majf=0, minf=9 00:13:40.078 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.4%, >=64=99.3% 00:13:40.078 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:13:40.078 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:13:40.078 issued rwts: total=4096,4388,0,0 short=0,0,0,0 dropped=0,0,0,0 00:13:40.078 latency : target=0, window=0, percentile=100.00%, depth=128 00:13:40.078 00:13:40.078 Run status group 0 (all jobs): 00:13:40.078 READ: bw=52.5MiB/s (55.0MB/s), 9.97MiB/s-16.0MiB/s (10.5MB/s-16.7MB/s), io=52.7MiB (55.2MB), run=1003-1004msec 00:13:40.078 WRITE: bw=57.4MiB/s (60.1MB/s), 11.4MiB/s-17.1MiB/s (12.0MB/s-17.9MB/s), io=57.6MiB (60.4MB), run=1003-1004msec 00:13:40.078 00:13:40.078 Disk stats (read/write): 00:13:40.078 nvme0n1: ios=2471/2560, merge=0/0, ticks=13444/11584, in_queue=25028, util=88.47% 00:13:40.078 nvme0n2: ios=2225/2560, merge=0/0, ticks=15362/17588, in_queue=32950, util=88.88% 00:13:40.078 nvme0n3: ios=3543/3584, merge=0/0, ticks=12569/12396, in_queue=24965, util=88.67% 00:13:40.078 nvme0n4: ios=3563/3584, merge=0/0, ticks=12782/12217, in_queue=24999, util=89.58% 00:13:40.078 11:24:35 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- target/fio.sh@53 -- # /home/vagrant/spdk_repo/spdk/scripts/fio-wrapper -p nvmf -i 4096 -d 128 -t randwrite -r 1 -v 00:13:40.078 [global] 00:13:40.078 thread=1 00:13:40.078 invalidate=1 00:13:40.078 rw=randwrite 00:13:40.078 time_based=1 00:13:40.078 runtime=1 00:13:40.078 ioengine=libaio 00:13:40.078 direct=1 00:13:40.078 bs=4096 00:13:40.078 iodepth=128 00:13:40.078 norandommap=0 00:13:40.078 numjobs=1 00:13:40.078 00:13:40.078 verify_dump=1 00:13:40.078 verify_backlog=512 00:13:40.078 verify_state_save=0 00:13:40.078 do_verify=1 00:13:40.078 verify=crc32c-intel 00:13:40.078 [job0] 00:13:40.078 filename=/dev/nvme0n1 00:13:40.078 [job1] 00:13:40.078 filename=/dev/nvme0n2 00:13:40.078 [job2] 00:13:40.078 filename=/dev/nvme0n3 00:13:40.078 [job3] 00:13:40.078 filename=/dev/nvme0n4 00:13:40.078 Could not set queue depth (nvme0n1) 00:13:40.078 Could not set queue depth (nvme0n2) 00:13:40.078 Could not set queue depth (nvme0n3) 00:13:40.078 Could not set queue depth (nvme0n4) 00:13:40.078 job0: (g=0): rw=randwrite, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=128 00:13:40.078 job1: (g=0): rw=randwrite, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=128 00:13:40.078 job2: (g=0): rw=randwrite, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=128 00:13:40.078 job3: (g=0): rw=randwrite, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=128 00:13:40.078 fio-3.35 00:13:40.078 Starting 4 threads 00:13:41.451 00:13:41.451 job0: (groupid=0, jobs=1): err= 0: pid=70728: Mon Oct 7 11:24:36 2024 00:13:41.451 read: IOPS=2549, BW=9.96MiB/s (10.4MB/s)(10.0MiB/1004msec) 00:13:41.451 slat (usec): min=6, max=9227, avg=193.18, stdev=907.23 00:13:41.451 clat (usec): min=15878, max=31878, avg=24299.58, stdev=2149.67 00:13:41.451 lat (usec): min=17213, max=31893, avg=24492.76, stdev=2005.25 00:13:41.451 clat percentiles (usec): 00:13:41.451 | 1.00th=[17433], 5.00th=[20317], 10.00th=[21103], 20.00th=[22152], 00:13:41.451 | 30.00th=[24249], 40.00th=[24511], 50.00th=[24773], 60.00th=[24773], 00:13:41.451 | 70.00th=[25035], 80.00th=[25560], 90.00th=[26084], 95.00th=[27395], 00:13:41.451 | 99.00th=[29492], 99.50th=[30278], 99.90th=[31851], 99.95th=[31851], 00:13:41.451 | 99.99th=[31851] 00:13:41.451 write: IOPS=2781, BW=10.9MiB/s (11.4MB/s)(10.9MiB/1004msec); 0 zone resets 00:13:41.451 slat (usec): min=13, max=6377, avg=173.43, stdev=834.79 00:13:41.451 clat (usec): min=1292, max=32037, avg=23031.28, stdev=3383.02 00:13:41.451 lat (usec): min=5998, max=32061, avg=23204.71, stdev=3288.52 00:13:41.451 clat percentiles (usec): 00:13:41.451 | 1.00th=[ 6652], 5.00th=[17171], 10.00th=[19530], 20.00th=[21103], 00:13:41.451 | 30.00th=[22676], 40.00th=[23462], 50.00th=[23462], 60.00th=[23725], 00:13:41.451 | 70.00th=[23987], 80.00th=[24249], 90.00th=[26870], 95.00th=[27919], 00:13:41.451 | 99.00th=[29754], 99.50th=[31851], 99.90th=[32113], 99.95th=[32113], 00:13:41.451 | 99.99th=[32113] 00:13:41.451 bw ( KiB/s): min= 9013, max=12288, per=16.63%, avg=10650.50, stdev=2315.77, samples=2 00:13:41.451 iops : min= 2253, max= 3072, avg=2662.50, stdev=579.12, samples=2 00:13:41.451 lat (msec) : 2=0.02%, 10=0.60%, 20=6.33%, 50=93.05% 00:13:41.451 cpu : usr=2.89%, sys=7.68%, ctx=217, majf=0, minf=7 00:13:41.451 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.3%, 32=0.6%, >=64=98.8% 00:13:41.451 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:13:41.451 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:13:41.451 issued rwts: total=2560,2793,0,0 short=0,0,0,0 dropped=0,0,0,0 00:13:41.451 latency : target=0, window=0, percentile=100.00%, depth=128 00:13:41.451 job1: (groupid=0, jobs=1): err= 0: pid=70729: Mon Oct 7 11:24:36 2024 00:13:41.451 read: IOPS=5294, BW=20.7MiB/s (21.7MB/s)(20.7MiB/1002msec) 00:13:41.451 slat (usec): min=8, max=3093, avg=89.89, stdev=419.31 00:13:41.451 clat (usec): min=482, max=13951, avg=11800.27, stdev=1071.86 00:13:41.451 lat (usec): min=2700, max=14541, avg=11890.16, stdev=1003.15 00:13:41.451 clat percentiles (usec): 00:13:41.451 | 1.00th=[ 5866], 5.00th=[10159], 10.00th=[11338], 20.00th=[11600], 00:13:41.451 | 30.00th=[11731], 40.00th=[11863], 50.00th=[11863], 60.00th=[11994], 00:13:41.451 | 70.00th=[12125], 80.00th=[12256], 90.00th=[12518], 95.00th=[12649], 00:13:41.451 | 99.00th=[13566], 99.50th=[13566], 99.90th=[13960], 99.95th=[13960], 00:13:41.451 | 99.99th=[13960] 00:13:41.451 write: IOPS=5620, BW=22.0MiB/s (23.0MB/s)(22.0MiB/1002msec); 0 zone resets 00:13:41.451 slat (usec): min=11, max=2886, avg=85.95, stdev=380.95 00:13:41.451 clat (usec): min=8858, max=13832, avg=11363.15, stdev=1183.43 00:13:41.451 lat (usec): min=8879, max=13853, avg=11449.10, stdev=1182.27 00:13:41.451 clat percentiles (usec): 00:13:41.451 | 1.00th=[ 9372], 5.00th=[ 9765], 10.00th=[ 9896], 20.00th=[10159], 00:13:41.451 | 30.00th=[10290], 40.00th=[10683], 50.00th=[11338], 60.00th=[11994], 00:13:41.451 | 70.00th=[12256], 80.00th=[12518], 90.00th=[12911], 95.00th=[13173], 00:13:41.451 | 99.00th=[13698], 99.50th=[13698], 99.90th=[13829], 99.95th=[13829], 00:13:41.451 | 99.99th=[13829] 00:13:41.451 bw ( KiB/s): min=22472, max=22538, per=35.14%, avg=22505.00, stdev=46.67, samples=2 00:13:41.451 iops : min= 5618, max= 5634, avg=5626.00, stdev=11.31, samples=2 00:13:41.451 lat (usec) : 500=0.01% 00:13:41.451 lat (msec) : 4=0.29%, 10=8.00%, 20=91.70% 00:13:41.451 cpu : usr=4.40%, sys=14.19%, ctx=522, majf=0, minf=2 00:13:41.451 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.1%, 32=0.3%, >=64=99.4% 00:13:41.451 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:13:41.451 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:13:41.452 issued rwts: total=5305,5632,0,0 short=0,0,0,0 dropped=0,0,0,0 00:13:41.452 latency : target=0, window=0, percentile=100.00%, depth=128 00:13:41.452 job2: (groupid=0, jobs=1): err= 0: pid=70730: Mon Oct 7 11:24:36 2024 00:13:41.452 read: IOPS=4603, BW=18.0MiB/s (18.9MB/s)(18.0MiB/1001msec) 00:13:41.452 slat (usec): min=6, max=3225, avg=101.47, stdev=470.50 00:13:41.452 clat (usec): min=10309, max=15870, avg=13553.52, stdev=799.27 00:13:41.452 lat (usec): min=10487, max=17996, avg=13655.00, stdev=680.87 00:13:41.452 clat percentiles (usec): 00:13:41.452 | 1.00th=[10683], 5.00th=[11731], 10.00th=[12780], 20.00th=[13173], 00:13:41.452 | 30.00th=[13304], 40.00th=[13435], 50.00th=[13698], 60.00th=[13829], 00:13:41.452 | 70.00th=[13960], 80.00th=[14091], 90.00th=[14353], 95.00th=[14746], 00:13:41.452 | 99.00th=[15401], 99.50th=[15533], 99.90th=[15795], 99.95th=[15926], 00:13:41.452 | 99.99th=[15926] 00:13:41.452 write: IOPS=4970, BW=19.4MiB/s (20.4MB/s)(19.4MiB/1001msec); 0 zone resets 00:13:41.452 slat (usec): min=11, max=3268, avg=99.35, stdev=446.57 00:13:41.452 clat (usec): min=308, max=15768, avg=12851.41, stdev=1690.67 00:13:41.452 lat (usec): min=2745, max=15874, avg=12950.75, stdev=1691.53 00:13:41.452 clat percentiles (usec): 00:13:41.452 | 1.00th=[ 6849], 5.00th=[11076], 10.00th=[11338], 20.00th=[11600], 00:13:41.452 | 30.00th=[11731], 40.00th=[11994], 50.00th=[12387], 60.00th=[13829], 00:13:41.452 | 70.00th=[14222], 80.00th=[14353], 90.00th=[14746], 95.00th=[15139], 00:13:41.452 | 99.00th=[15401], 99.50th=[15664], 99.90th=[15795], 99.95th=[15795], 00:13:41.452 | 99.99th=[15795] 00:13:41.452 bw ( KiB/s): min=20480, max=20480, per=31.98%, avg=20480.00, stdev= 0.00, samples=1 00:13:41.452 iops : min= 5120, max= 5120, avg=5120.00, stdev= 0.00, samples=1 00:13:41.452 lat (usec) : 500=0.01% 00:13:41.452 lat (msec) : 4=0.37%, 10=0.40%, 20=99.23% 00:13:41.452 cpu : usr=4.20%, sys=13.80%, ctx=508, majf=0, minf=4 00:13:41.452 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.3%, >=64=99.3% 00:13:41.452 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:13:41.452 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:13:41.452 issued rwts: total=4608,4975,0,0 short=0,0,0,0 dropped=0,0,0,0 00:13:41.452 latency : target=0, window=0, percentile=100.00%, depth=128 00:13:41.452 job3: (groupid=0, jobs=1): err= 0: pid=70731: Mon Oct 7 11:24:36 2024 00:13:41.452 read: IOPS=2549, BW=9.96MiB/s (10.4MB/s)(10.0MiB/1004msec) 00:13:41.452 slat (usec): min=9, max=8563, avg=190.35, stdev=957.92 00:13:41.452 clat (usec): min=17779, max=30329, avg=25121.38, stdev=1510.97 00:13:41.452 lat (usec): min=22498, max=30343, avg=25311.73, stdev=1179.30 00:13:41.452 clat percentiles (usec): 00:13:41.452 | 1.00th=[19268], 5.00th=[23462], 10.00th=[24249], 20.00th=[24511], 00:13:41.452 | 30.00th=[24773], 40.00th=[24773], 50.00th=[25035], 60.00th=[25035], 00:13:41.452 | 70.00th=[25297], 80.00th=[25822], 90.00th=[26870], 95.00th=[27919], 00:13:41.452 | 99.00th=[29492], 99.50th=[30016], 99.90th=[30278], 99.95th=[30278], 00:13:41.452 | 99.99th=[30278] 00:13:41.452 write: IOPS=2664, BW=10.4MiB/s (10.9MB/s)(10.4MiB/1004msec); 0 zone resets 00:13:41.452 slat (usec): min=14, max=8173, avg=183.06, stdev=887.27 00:13:41.452 clat (usec): min=2996, max=26652, avg=23130.62, stdev=2752.07 00:13:41.452 lat (usec): min=3018, max=29371, avg=23313.68, stdev=2621.00 00:13:41.452 clat percentiles (usec): 00:13:41.452 | 1.00th=[ 8979], 5.00th=[18744], 10.00th=[22676], 20.00th=[22938], 00:13:41.452 | 30.00th=[23200], 40.00th=[23462], 50.00th=[23725], 60.00th=[23725], 00:13:41.452 | 70.00th=[23987], 80.00th=[24249], 90.00th=[24773], 95.00th=[25297], 00:13:41.452 | 99.00th=[26346], 99.50th=[26608], 99.90th=[26608], 99.95th=[26608], 00:13:41.452 | 99.99th=[26608] 00:13:41.452 bw ( KiB/s): min= 8423, max=12040, per=15.97%, avg=10231.50, stdev=2557.61, samples=2 00:13:41.452 iops : min= 2105, max= 3010, avg=2557.50, stdev=639.93, samples=2 00:13:41.452 lat (msec) : 4=0.36%, 10=0.61%, 20=3.23%, 50=95.80% 00:13:41.452 cpu : usr=2.39%, sys=8.18%, ctx=188, majf=0, minf=7 00:13:41.452 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.2%, 16=0.3%, 32=0.6%, >=64=98.8% 00:13:41.452 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:13:41.452 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:13:41.452 issued rwts: total=2560,2675,0,0 short=0,0,0,0 dropped=0,0,0,0 00:13:41.452 latency : target=0, window=0, percentile=100.00%, depth=128 00:13:41.452 00:13:41.452 Run status group 0 (all jobs): 00:13:41.452 READ: bw=58.5MiB/s (61.3MB/s), 9.96MiB/s-20.7MiB/s (10.4MB/s-21.7MB/s), io=58.7MiB (61.6MB), run=1001-1004msec 00:13:41.452 WRITE: bw=62.5MiB/s (65.6MB/s), 10.4MiB/s-22.0MiB/s (10.9MB/s-23.0MB/s), io=62.8MiB (65.8MB), run=1001-1004msec 00:13:41.452 00:13:41.452 Disk stats (read/write): 00:13:41.452 nvme0n1: ios=2098/2547, merge=0/0, ticks=12442/13012, in_queue=25454, util=88.77% 00:13:41.452 nvme0n2: ios=4657/4834, merge=0/0, ticks=12634/11762, in_queue=24396, util=89.59% 00:13:41.452 nvme0n3: ios=4117/4212, merge=0/0, ticks=12958/11889, in_queue=24847, util=89.92% 00:13:41.452 nvme0n4: ios=2048/2496, merge=0/0, ticks=12086/13379, in_queue=25465, util=89.86% 00:13:41.452 11:24:36 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- target/fio.sh@55 -- # sync 00:13:41.452 11:24:36 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- target/fio.sh@59 -- # fio_pid=70748 00:13:41.452 11:24:36 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- target/fio.sh@58 -- # /home/vagrant/spdk_repo/spdk/scripts/fio-wrapper -p nvmf -i 4096 -d 1 -t read -r 10 00:13:41.452 11:24:36 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- target/fio.sh@61 -- # sleep 3 00:13:41.452 [global] 00:13:41.452 thread=1 00:13:41.452 invalidate=1 00:13:41.452 rw=read 00:13:41.452 time_based=1 00:13:41.452 runtime=10 00:13:41.452 ioengine=libaio 00:13:41.452 direct=1 00:13:41.452 bs=4096 00:13:41.452 iodepth=1 00:13:41.452 norandommap=1 00:13:41.452 numjobs=1 00:13:41.452 00:13:41.452 [job0] 00:13:41.452 filename=/dev/nvme0n1 00:13:41.452 [job1] 00:13:41.452 filename=/dev/nvme0n2 00:13:41.452 [job2] 00:13:41.452 filename=/dev/nvme0n3 00:13:41.452 [job3] 00:13:41.452 filename=/dev/nvme0n4 00:13:41.452 Could not set queue depth (nvme0n1) 00:13:41.452 Could not set queue depth (nvme0n2) 00:13:41.452 Could not set queue depth (nvme0n3) 00:13:41.452 Could not set queue depth (nvme0n4) 00:13:41.452 job0: (g=0): rw=read, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:13:41.452 job1: (g=0): rw=read, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:13:41.452 job2: (g=0): rw=read, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:13:41.452 job3: (g=0): rw=read, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:13:41.452 fio-3.35 00:13:41.452 Starting 4 threads 00:13:44.743 11:24:39 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- target/fio.sh@63 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py bdev_raid_delete concat0 00:13:44.743 fio: io_u error on file /dev/nvme0n4: Operation not supported: read offset=66457600, buflen=4096 00:13:44.743 fio: pid=70792, err=95/file:io_u.c:1889, func=io_u error, error=Operation not supported 00:13:44.743 11:24:40 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- target/fio.sh@64 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py bdev_raid_delete raid0 00:13:45.001 fio: io_u error on file /dev/nvme0n3: Operation not supported: read offset=34394112, buflen=4096 00:13:45.001 fio: pid=70791, err=95/file:io_u.c:1889, func=io_u error, error=Operation not supported 00:13:45.001 11:24:40 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- target/fio.sh@65 -- # for malloc_bdev in $malloc_bdevs $raid_malloc_bdevs $concat_malloc_bdevs 00:13:45.001 11:24:40 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- target/fio.sh@66 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py bdev_malloc_delete Malloc0 00:13:45.259 fio: pid=70789, err=95/file:io_u.c:1889, func=io_u error, error=Operation not supported 00:13:45.259 fio: io_u error on file /dev/nvme0n1: Operation not supported: read offset=29544448, buflen=4096 00:13:45.259 11:24:40 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- target/fio.sh@65 -- # for malloc_bdev in $malloc_bdevs $raid_malloc_bdevs $concat_malloc_bdevs 00:13:45.259 11:24:40 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- target/fio.sh@66 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py bdev_malloc_delete Malloc1 00:13:45.517 fio: pid=70790, err=95/file:io_u.c:1889, func=io_u error, error=Operation not supported 00:13:45.517 fio: io_u error on file /dev/nvme0n2: Operation not supported: read offset=61739008, buflen=4096 00:13:45.517 00:13:45.517 job0: (groupid=0, jobs=1): err=95 (file:io_u.c:1889, func=io_u error, error=Operation not supported): pid=70789: Mon Oct 7 11:24:40 2024 00:13:45.517 read: IOPS=2075, BW=8300KiB/s (8500kB/s)(28.2MiB/3476msec) 00:13:45.517 slat (usec): min=9, max=10748, avg=27.30, stdev=233.36 00:13:45.517 clat (usec): min=141, max=4693, avg=452.12, stdev=99.32 00:13:45.517 lat (usec): min=156, max=11075, avg=479.42, stdev=251.50 00:13:45.517 clat percentiles (usec): 00:13:45.517 | 1.00th=[ 153], 5.00th=[ 355], 10.00th=[ 379], 20.00th=[ 420], 00:13:45.517 | 30.00th=[ 433], 40.00th=[ 453], 50.00th=[ 465], 60.00th=[ 478], 00:13:45.517 | 70.00th=[ 486], 80.00th=[ 498], 90.00th=[ 510], 95.00th=[ 519], 00:13:45.517 | 99.00th=[ 545], 99.50th=[ 562], 99.90th=[ 922], 99.95th=[ 2474], 00:13:45.517 | 99.99th=[ 4686] 00:13:45.517 bw ( KiB/s): min= 7728, max= 8760, per=16.34%, avg=8092.00, stdev=452.15, samples=6 00:13:45.517 iops : min= 1932, max= 2190, avg=2023.00, stdev=113.04, samples=6 00:13:45.517 lat (usec) : 250=2.58%, 500=80.45%, 750=16.84%, 1000=0.01% 00:13:45.517 lat (msec) : 2=0.03%, 4=0.06%, 10=0.01% 00:13:45.517 cpu : usr=1.01%, sys=4.14%, ctx=7219, majf=0, minf=1 00:13:45.517 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:13:45.517 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:13:45.517 complete : 0=0.1%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:13:45.517 issued rwts: total=7214,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:13:45.517 latency : target=0, window=0, percentile=100.00%, depth=1 00:13:45.517 job1: (groupid=0, jobs=1): err=95 (file:io_u.c:1889, func=io_u error, error=Operation not supported): pid=70790: Mon Oct 7 11:24:40 2024 00:13:45.517 read: IOPS=3978, BW=15.5MiB/s (16.3MB/s)(58.9MiB/3789msec) 00:13:45.517 slat (usec): min=9, max=8383, avg=17.17, stdev=151.88 00:13:45.517 clat (usec): min=134, max=102288, avg=232.96, stdev=840.26 00:13:45.517 lat (usec): min=147, max=102304, avg=250.14, stdev=853.94 00:13:45.517 clat percentiles (usec): 00:13:45.518 | 1.00th=[ 143], 5.00th=[ 151], 10.00th=[ 155], 20.00th=[ 165], 00:13:45.518 | 30.00th=[ 174], 40.00th=[ 180], 50.00th=[ 192], 60.00th=[ 241], 00:13:45.518 | 70.00th=[ 277], 80.00th=[ 302], 90.00th=[ 318], 95.00th=[ 326], 00:13:45.518 | 99.00th=[ 351], 99.50th=[ 371], 99.90th=[ 644], 99.95th=[ 1598], 00:13:45.518 | 99.99th=[11469] 00:13:45.518 bw ( KiB/s): min=15208, max=18352, per=32.69%, avg=16188.57, stdev=1201.79, samples=7 00:13:45.518 iops : min= 3802, max= 4588, avg=4047.14, stdev=300.45, samples=7 00:13:45.518 lat (usec) : 250=63.21%, 500=36.65%, 750=0.04%, 1000=0.02% 00:13:45.518 lat (msec) : 2=0.04%, 4=0.01%, 10=0.01%, 20=0.01%, 250=0.01% 00:13:45.518 cpu : usr=0.82%, sys=4.83%, ctx=15092, majf=0, minf=2 00:13:45.518 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:13:45.518 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:13:45.518 complete : 0=0.1%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:13:45.518 issued rwts: total=15074,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:13:45.518 latency : target=0, window=0, percentile=100.00%, depth=1 00:13:45.518 job2: (groupid=0, jobs=1): err=95 (file:io_u.c:1889, func=io_u error, error=Operation not supported): pid=70791: Mon Oct 7 11:24:40 2024 00:13:45.518 read: IOPS=2608, BW=10.2MiB/s (10.7MB/s)(32.8MiB/3220msec) 00:13:45.518 slat (usec): min=10, max=15403, avg=21.55, stdev=182.51 00:13:45.518 clat (usec): min=160, max=7715, avg=359.82, stdev=198.44 00:13:45.518 lat (usec): min=176, max=15827, avg=381.37, stdev=269.53 00:13:45.518 clat percentiles (usec): 00:13:45.518 | 1.00th=[ 169], 5.00th=[ 176], 10.00th=[ 180], 20.00th=[ 186], 00:13:45.518 | 30.00th=[ 194], 40.00th=[ 210], 50.00th=[ 445], 60.00th=[ 474], 00:13:45.518 | 70.00th=[ 486], 80.00th=[ 498], 90.00th=[ 515], 95.00th=[ 523], 00:13:45.518 | 99.00th=[ 545], 99.50th=[ 562], 99.90th=[ 2040], 99.95th=[ 3589], 00:13:45.518 | 99.99th=[ 7701] 00:13:45.518 bw ( KiB/s): min= 7800, max=18768, per=21.47%, avg=10634.67, stdev=4585.32, samples=6 00:13:45.518 iops : min= 1950, max= 4692, avg=2658.67, stdev=1146.33, samples=6 00:13:45.518 lat (usec) : 250=42.66%, 500=38.32%, 750=18.87%, 1000=0.02% 00:13:45.518 lat (msec) : 4=0.07%, 10=0.04% 00:13:45.518 cpu : usr=0.90%, sys=4.44%, ctx=8405, majf=0, minf=2 00:13:45.518 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:13:45.518 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:13:45.518 complete : 0=0.1%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:13:45.518 issued rwts: total=8398,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:13:45.518 latency : target=0, window=0, percentile=100.00%, depth=1 00:13:45.518 job3: (groupid=0, jobs=1): err=95 (file:io_u.c:1889, func=io_u error, error=Operation not supported): pid=70792: Mon Oct 7 11:24:40 2024 00:13:45.518 read: IOPS=5476, BW=21.4MiB/s (22.4MB/s)(63.4MiB/2963msec) 00:13:45.518 slat (nsec): min=11423, max=68452, avg=13870.03, stdev=2670.39 00:13:45.518 clat (usec): min=140, max=1320, avg=167.47, stdev=18.77 00:13:45.518 lat (usec): min=154, max=1333, avg=181.34, stdev=19.15 00:13:45.518 clat percentiles (usec): 00:13:45.518 | 1.00th=[ 151], 5.00th=[ 153], 10.00th=[ 155], 20.00th=[ 159], 00:13:45.518 | 30.00th=[ 161], 40.00th=[ 163], 50.00th=[ 165], 60.00th=[ 169], 00:13:45.518 | 70.00th=[ 172], 80.00th=[ 176], 90.00th=[ 180], 95.00th=[ 186], 00:13:45.518 | 99.00th=[ 200], 99.50th=[ 221], 99.90th=[ 420], 99.95th=[ 457], 00:13:45.518 | 99.99th=[ 586] 00:13:45.518 bw ( KiB/s): min=21208, max=22432, per=44.31%, avg=21942.40, stdev=475.69, samples=5 00:13:45.518 iops : min= 5302, max= 5608, avg=5485.60, stdev=118.92, samples=5 00:13:45.518 lat (usec) : 250=99.61%, 500=0.35%, 750=0.04% 00:13:45.518 lat (msec) : 2=0.01% 00:13:45.518 cpu : usr=1.32%, sys=6.25%, ctx=16229, majf=0, minf=2 00:13:45.518 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:13:45.518 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:13:45.518 complete : 0=0.1%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:13:45.518 issued rwts: total=16226,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:13:45.518 latency : target=0, window=0, percentile=100.00%, depth=1 00:13:45.518 00:13:45.518 Run status group 0 (all jobs): 00:13:45.518 READ: bw=48.4MiB/s (50.7MB/s), 8300KiB/s-21.4MiB/s (8500kB/s-22.4MB/s), io=183MiB (192MB), run=2963-3789msec 00:13:45.518 00:13:45.518 Disk stats (read/write): 00:13:45.518 nvme0n1: ios=6907/0, merge=0/0, ticks=3108/0, in_queue=3108, util=95.19% 00:13:45.518 nvme0n2: ios=14679/0, merge=0/0, ticks=3395/0, in_queue=3395, util=95.69% 00:13:45.518 nvme0n3: ios=8181/0, merge=0/0, ticks=2820/0, in_queue=2820, util=95.84% 00:13:45.518 nvme0n4: ios=15727/0, merge=0/0, ticks=2702/0, in_queue=2702, util=96.79% 00:13:45.518 11:24:40 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- target/fio.sh@65 -- # for malloc_bdev in $malloc_bdevs $raid_malloc_bdevs $concat_malloc_bdevs 00:13:45.518 11:24:40 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- target/fio.sh@66 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py bdev_malloc_delete Malloc2 00:13:45.776 11:24:41 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- target/fio.sh@65 -- # for malloc_bdev in $malloc_bdevs $raid_malloc_bdevs $concat_malloc_bdevs 00:13:45.776 11:24:41 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- target/fio.sh@66 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py bdev_malloc_delete Malloc3 00:13:46.034 11:24:41 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- target/fio.sh@65 -- # for malloc_bdev in $malloc_bdevs $raid_malloc_bdevs $concat_malloc_bdevs 00:13:46.034 11:24:41 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- target/fio.sh@66 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py bdev_malloc_delete Malloc4 00:13:46.292 11:24:41 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- target/fio.sh@65 -- # for malloc_bdev in $malloc_bdevs $raid_malloc_bdevs $concat_malloc_bdevs 00:13:46.292 11:24:41 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- target/fio.sh@66 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py bdev_malloc_delete Malloc5 00:13:46.857 11:24:42 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- target/fio.sh@65 -- # for malloc_bdev in $malloc_bdevs $raid_malloc_bdevs $concat_malloc_bdevs 00:13:46.857 11:24:42 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- target/fio.sh@66 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py bdev_malloc_delete Malloc6 00:13:47.115 11:24:42 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- target/fio.sh@69 -- # fio_status=0 00:13:47.115 11:24:42 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- target/fio.sh@70 -- # wait 70748 00:13:47.115 11:24:42 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- target/fio.sh@70 -- # fio_status=4 00:13:47.115 11:24:42 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- target/fio.sh@72 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:13:47.115 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:13:47.115 11:24:42 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- target/fio.sh@73 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:13:47.115 11:24:42 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- common/autotest_common.sh@1219 -- # local i=0 00:13:47.115 11:24:42 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- common/autotest_common.sh@1220 -- # lsblk -o NAME,SERIAL 00:13:47.115 11:24:42 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- common/autotest_common.sh@1220 -- # grep -q -w SPDKISFASTANDAWESOME 00:13:47.115 11:24:42 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- common/autotest_common.sh@1227 -- # grep -q -w SPDKISFASTANDAWESOME 00:13:47.115 11:24:42 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- common/autotest_common.sh@1227 -- # lsblk -l -o NAME,SERIAL 00:13:47.115 nvmf hotplug test: fio failed as expected 00:13:47.115 11:24:42 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- common/autotest_common.sh@1231 -- # return 0 00:13:47.115 11:24:42 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- target/fio.sh@75 -- # '[' 4 -eq 0 ']' 00:13:47.115 11:24:42 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- target/fio.sh@80 -- # echo 'nvmf hotplug test: fio failed as expected' 00:13:47.115 11:24:42 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- target/fio.sh@83 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:13:47.375 11:24:42 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- target/fio.sh@85 -- # rm -f ./local-job0-0-verify.state 00:13:47.375 11:24:42 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- target/fio.sh@86 -- # rm -f ./local-job1-1-verify.state 00:13:47.375 11:24:42 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- target/fio.sh@87 -- # rm -f ./local-job2-2-verify.state 00:13:47.375 11:24:42 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- target/fio.sh@89 -- # trap - SIGINT SIGTERM EXIT 00:13:47.375 11:24:42 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- target/fio.sh@91 -- # nvmftestfini 00:13:47.375 11:24:42 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@514 -- # nvmfcleanup 00:13:47.375 11:24:42 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@121 -- # sync 00:13:47.375 11:24:42 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@123 -- # '[' tcp == tcp ']' 00:13:47.375 11:24:42 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@124 -- # set +e 00:13:47.375 11:24:42 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@125 -- # for i in {1..20} 00:13:47.375 11:24:42 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@126 -- # modprobe -v -r nvme-tcp 00:13:47.375 rmmod nvme_tcp 00:13:47.375 rmmod nvme_fabrics 00:13:47.375 rmmod nvme_keyring 00:13:47.375 11:24:42 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@127 -- # modprobe -v -r nvme-fabrics 00:13:47.375 11:24:42 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@128 -- # set -e 00:13:47.375 11:24:42 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@129 -- # return 0 00:13:47.375 11:24:42 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@515 -- # '[' -n 70249 ']' 00:13:47.375 11:24:42 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@516 -- # killprocess 70249 00:13:47.375 11:24:42 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- common/autotest_common.sh@950 -- # '[' -z 70249 ']' 00:13:47.375 11:24:42 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- common/autotest_common.sh@954 -- # kill -0 70249 00:13:47.375 11:24:42 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- common/autotest_common.sh@955 -- # uname 00:13:47.375 11:24:42 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- common/autotest_common.sh@955 -- # '[' Linux = Linux ']' 00:13:47.375 11:24:42 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- common/autotest_common.sh@956 -- # ps --no-headers -o comm= 70249 00:13:47.375 killing process with pid 70249 00:13:47.375 11:24:42 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- common/autotest_common.sh@956 -- # process_name=reactor_0 00:13:47.375 11:24:42 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- common/autotest_common.sh@960 -- # '[' reactor_0 = sudo ']' 00:13:47.375 11:24:42 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- common/autotest_common.sh@968 -- # echo 'killing process with pid 70249' 00:13:47.375 11:24:42 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- common/autotest_common.sh@969 -- # kill 70249 00:13:47.375 11:24:42 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- common/autotest_common.sh@974 -- # wait 70249 00:13:47.633 11:24:43 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@518 -- # '[' '' == iso ']' 00:13:47.633 11:24:43 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@521 -- # [[ tcp == \t\c\p ]] 00:13:47.633 11:24:43 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@522 -- # nvmf_tcp_fini 00:13:47.633 11:24:43 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@297 -- # iptr 00:13:47.633 11:24:43 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@789 -- # grep -v SPDK_NVMF 00:13:47.633 11:24:43 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@789 -- # iptables-save 00:13:47.633 11:24:43 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@789 -- # iptables-restore 00:13:47.633 11:24:43 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@298 -- # [[ nvmf_tgt_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s\_\s\p\d\k ]] 00:13:47.633 11:24:43 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@299 -- # nvmf_veth_fini 00:13:47.633 11:24:43 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@233 -- # ip link set nvmf_init_br nomaster 00:13:47.633 11:24:43 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@234 -- # ip link set nvmf_init_br2 nomaster 00:13:47.633 11:24:43 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@235 -- # ip link set nvmf_tgt_br nomaster 00:13:47.633 11:24:43 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@236 -- # ip link set nvmf_tgt_br2 nomaster 00:13:47.633 11:24:43 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@237 -- # ip link set nvmf_init_br down 00:13:47.633 11:24:43 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@238 -- # ip link set nvmf_init_br2 down 00:13:47.633 11:24:43 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@239 -- # ip link set nvmf_tgt_br down 00:13:47.633 11:24:43 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@240 -- # ip link set nvmf_tgt_br2 down 00:13:47.633 11:24:43 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@241 -- # ip link delete nvmf_br type bridge 00:13:47.891 11:24:43 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@242 -- # ip link delete nvmf_init_if 00:13:47.891 11:24:43 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@243 -- # ip link delete nvmf_init_if2 00:13:47.891 11:24:43 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@244 -- # ip netns exec nvmf_tgt_ns_spdk ip link delete nvmf_tgt_if 00:13:47.891 11:24:43 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@245 -- # ip netns exec nvmf_tgt_ns_spdk ip link delete nvmf_tgt_if2 00:13:47.891 11:24:43 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@246 -- # remove_spdk_ns 00:13:47.891 11:24:43 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@654 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:13:47.891 11:24:43 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 15> /dev/null' 00:13:47.891 11:24:43 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:13:47.891 11:24:43 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@300 -- # return 0 00:13:47.891 00:13:47.891 real 0m20.850s 00:13:47.891 user 1m20.414s 00:13:47.891 sys 0m8.293s 00:13:47.891 11:24:43 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- common/autotest_common.sh@1126 -- # xtrace_disable 00:13:47.891 11:24:43 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- common/autotest_common.sh@10 -- # set +x 00:13:47.891 ************************************ 00:13:47.891 END TEST nvmf_fio_target 00:13:47.891 ************************************ 00:13:47.891 11:24:43 nvmf_tcp.nvmf_target_core -- nvmf/nvmf_target_core.sh@35 -- # run_test nvmf_bdevio /home/vagrant/spdk_repo/spdk/test/nvmf/target/bdevio.sh --transport=tcp 00:13:47.891 11:24:43 nvmf_tcp.nvmf_target_core -- common/autotest_common.sh@1101 -- # '[' 3 -le 1 ']' 00:13:47.891 11:24:43 nvmf_tcp.nvmf_target_core -- common/autotest_common.sh@1107 -- # xtrace_disable 00:13:47.891 11:24:43 nvmf_tcp.nvmf_target_core -- common/autotest_common.sh@10 -- # set +x 00:13:47.891 ************************************ 00:13:47.891 START TEST nvmf_bdevio 00:13:47.891 ************************************ 00:13:47.891 11:24:43 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- common/autotest_common.sh@1125 -- # /home/vagrant/spdk_repo/spdk/test/nvmf/target/bdevio.sh --transport=tcp 00:13:48.151 * Looking for test storage... 00:13:48.151 * Found test storage at /home/vagrant/spdk_repo/spdk/test/nvmf/target 00:13:48.151 11:24:43 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- common/autotest_common.sh@1680 -- # [[ y == y ]] 00:13:48.151 11:24:43 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- common/autotest_common.sh@1681 -- # lcov --version 00:13:48.151 11:24:43 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- common/autotest_common.sh@1681 -- # awk '{print $NF}' 00:13:48.151 11:24:43 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- common/autotest_common.sh@1681 -- # lt 1.15 2 00:13:48.151 11:24:43 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- scripts/common.sh@373 -- # cmp_versions 1.15 '<' 2 00:13:48.151 11:24:43 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- scripts/common.sh@333 -- # local ver1 ver1_l 00:13:48.151 11:24:43 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- scripts/common.sh@334 -- # local ver2 ver2_l 00:13:48.151 11:24:43 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- scripts/common.sh@336 -- # IFS=.-: 00:13:48.151 11:24:43 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- scripts/common.sh@336 -- # read -ra ver1 00:13:48.151 11:24:43 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- scripts/common.sh@337 -- # IFS=.-: 00:13:48.151 11:24:43 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- scripts/common.sh@337 -- # read -ra ver2 00:13:48.151 11:24:43 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- scripts/common.sh@338 -- # local 'op=<' 00:13:48.151 11:24:43 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- scripts/common.sh@340 -- # ver1_l=2 00:13:48.151 11:24:43 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- scripts/common.sh@341 -- # ver2_l=1 00:13:48.151 11:24:43 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- scripts/common.sh@343 -- # local lt=0 gt=0 eq=0 v 00:13:48.151 11:24:43 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- scripts/common.sh@344 -- # case "$op" in 00:13:48.151 11:24:43 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- scripts/common.sh@345 -- # : 1 00:13:48.151 11:24:43 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- scripts/common.sh@364 -- # (( v = 0 )) 00:13:48.151 11:24:43 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- scripts/common.sh@364 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:13:48.151 11:24:43 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- scripts/common.sh@365 -- # decimal 1 00:13:48.151 11:24:43 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- scripts/common.sh@353 -- # local d=1 00:13:48.151 11:24:43 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- scripts/common.sh@354 -- # [[ 1 =~ ^[0-9]+$ ]] 00:13:48.151 11:24:43 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- scripts/common.sh@355 -- # echo 1 00:13:48.151 11:24:43 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- scripts/common.sh@365 -- # ver1[v]=1 00:13:48.151 11:24:43 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- scripts/common.sh@366 -- # decimal 2 00:13:48.151 11:24:43 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- scripts/common.sh@353 -- # local d=2 00:13:48.151 11:24:43 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- scripts/common.sh@354 -- # [[ 2 =~ ^[0-9]+$ ]] 00:13:48.151 11:24:43 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- scripts/common.sh@355 -- # echo 2 00:13:48.151 11:24:43 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- scripts/common.sh@366 -- # ver2[v]=2 00:13:48.151 11:24:43 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- scripts/common.sh@367 -- # (( ver1[v] > ver2[v] )) 00:13:48.151 11:24:43 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- scripts/common.sh@368 -- # (( ver1[v] < ver2[v] )) 00:13:48.151 11:24:43 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- scripts/common.sh@368 -- # return 0 00:13:48.151 11:24:43 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- common/autotest_common.sh@1682 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:13:48.151 11:24:43 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- common/autotest_common.sh@1694 -- # export 'LCOV_OPTS= 00:13:48.151 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:13:48.151 --rc genhtml_branch_coverage=1 00:13:48.151 --rc genhtml_function_coverage=1 00:13:48.151 --rc genhtml_legend=1 00:13:48.151 --rc geninfo_all_blocks=1 00:13:48.151 --rc geninfo_unexecuted_blocks=1 00:13:48.151 00:13:48.151 ' 00:13:48.151 11:24:43 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- common/autotest_common.sh@1694 -- # LCOV_OPTS=' 00:13:48.151 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:13:48.151 --rc genhtml_branch_coverage=1 00:13:48.151 --rc genhtml_function_coverage=1 00:13:48.151 --rc genhtml_legend=1 00:13:48.151 --rc geninfo_all_blocks=1 00:13:48.151 --rc geninfo_unexecuted_blocks=1 00:13:48.151 00:13:48.151 ' 00:13:48.151 11:24:43 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- common/autotest_common.sh@1695 -- # export 'LCOV=lcov 00:13:48.151 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:13:48.151 --rc genhtml_branch_coverage=1 00:13:48.151 --rc genhtml_function_coverage=1 00:13:48.151 --rc genhtml_legend=1 00:13:48.151 --rc geninfo_all_blocks=1 00:13:48.151 --rc geninfo_unexecuted_blocks=1 00:13:48.151 00:13:48.151 ' 00:13:48.151 11:24:43 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- common/autotest_common.sh@1695 -- # LCOV='lcov 00:13:48.151 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:13:48.151 --rc genhtml_branch_coverage=1 00:13:48.151 --rc genhtml_function_coverage=1 00:13:48.151 --rc genhtml_legend=1 00:13:48.151 --rc geninfo_all_blocks=1 00:13:48.151 --rc geninfo_unexecuted_blocks=1 00:13:48.151 00:13:48.151 ' 00:13:48.151 11:24:43 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- target/bdevio.sh@9 -- # source /home/vagrant/spdk_repo/spdk/test/nvmf/common.sh 00:13:48.151 11:24:43 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@7 -- # uname -s 00:13:48.151 11:24:43 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:13:48.151 11:24:43 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:13:48.151 11:24:43 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:13:48.151 11:24:43 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:13:48.151 11:24:43 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:13:48.151 11:24:43 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:13:48.151 11:24:43 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:13:48.151 11:24:43 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:13:48.151 11:24:43 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:13:48.151 11:24:43 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:13:48.151 11:24:43 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:c758a4ed-f09f-4c82-9afb-3d096f035464 00:13:48.151 11:24:43 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@18 -- # NVME_HOSTID=c758a4ed-f09f-4c82-9afb-3d096f035464 00:13:48.151 11:24:43 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:13:48.151 11:24:43 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:13:48.151 11:24:43 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@21 -- # NET_TYPE=virt 00:13:48.151 11:24:43 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:13:48.151 11:24:43 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@49 -- # source /home/vagrant/spdk_repo/spdk/scripts/common.sh 00:13:48.151 11:24:43 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- scripts/common.sh@15 -- # shopt -s extglob 00:13:48.151 11:24:43 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- scripts/common.sh@544 -- # [[ -e /bin/wpdk_common.sh ]] 00:13:48.151 11:24:43 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- scripts/common.sh@552 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:13:48.151 11:24:43 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- scripts/common.sh@553 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:13:48.151 11:24:43 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:48.151 11:24:43 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:48.151 11:24:43 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:48.151 11:24:43 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- paths/export.sh@5 -- # export PATH 00:13:48.151 11:24:43 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:48.151 11:24:43 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@51 -- # : 0 00:13:48.151 11:24:43 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@52 -- # export NVMF_APP_SHM_ID 00:13:48.151 11:24:43 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@53 -- # build_nvmf_app_args 00:13:48.151 11:24:43 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:13:48.151 11:24:43 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:13:48.151 11:24:43 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:13:48.151 11:24:43 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@33 -- # '[' '' -eq 1 ']' 00:13:48.151 /home/vagrant/spdk_repo/spdk/test/nvmf/common.sh: line 33: [: : integer expression expected 00:13:48.151 11:24:43 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@37 -- # '[' -n '' ']' 00:13:48.151 11:24:43 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@39 -- # '[' 0 -eq 1 ']' 00:13:48.151 11:24:43 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@55 -- # have_pci_nics=0 00:13:48.152 11:24:43 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- target/bdevio.sh@11 -- # MALLOC_BDEV_SIZE=64 00:13:48.152 11:24:43 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- target/bdevio.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:13:48.152 11:24:43 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- target/bdevio.sh@14 -- # nvmftestinit 00:13:48.152 11:24:43 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@467 -- # '[' -z tcp ']' 00:13:48.152 11:24:43 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@472 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:13:48.152 11:24:43 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@474 -- # prepare_net_devs 00:13:48.152 11:24:43 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@436 -- # local -g is_hw=no 00:13:48.152 11:24:43 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@438 -- # remove_spdk_ns 00:13:48.152 11:24:43 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@654 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:13:48.152 11:24:43 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 15> /dev/null' 00:13:48.152 11:24:43 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:13:48.152 11:24:43 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@440 -- # [[ virt != virt ]] 00:13:48.152 11:24:43 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@442 -- # [[ no == yes ]] 00:13:48.152 11:24:43 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@449 -- # [[ virt == phy ]] 00:13:48.152 11:24:43 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@452 -- # [[ virt == phy-fallback ]] 00:13:48.152 11:24:43 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@457 -- # [[ tcp == tcp ]] 00:13:48.152 11:24:43 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@458 -- # nvmf_veth_init 00:13:48.152 11:24:43 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@145 -- # NVMF_FIRST_INITIATOR_IP=10.0.0.1 00:13:48.152 11:24:43 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@146 -- # NVMF_SECOND_INITIATOR_IP=10.0.0.2 00:13:48.152 11:24:43 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@147 -- # NVMF_FIRST_TARGET_IP=10.0.0.3 00:13:48.152 11:24:43 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@148 -- # NVMF_SECOND_TARGET_IP=10.0.0.4 00:13:48.152 11:24:43 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@149 -- # NVMF_INITIATOR_IP=10.0.0.1 00:13:48.152 11:24:43 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@150 -- # NVMF_BRIDGE=nvmf_br 00:13:48.152 11:24:43 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@151 -- # NVMF_INITIATOR_INTERFACE=nvmf_init_if 00:13:48.152 11:24:43 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@152 -- # NVMF_INITIATOR_INTERFACE2=nvmf_init_if2 00:13:48.152 11:24:43 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@153 -- # NVMF_INITIATOR_BRIDGE=nvmf_init_br 00:13:48.152 11:24:43 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@154 -- # NVMF_INITIATOR_BRIDGE2=nvmf_init_br2 00:13:48.152 11:24:43 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@155 -- # NVMF_TARGET_NAMESPACE=nvmf_tgt_ns_spdk 00:13:48.152 11:24:43 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@156 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:13:48.152 11:24:43 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@157 -- # NVMF_TARGET_INTERFACE=nvmf_tgt_if 00:13:48.152 11:24:43 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@158 -- # NVMF_TARGET_INTERFACE2=nvmf_tgt_if2 00:13:48.152 11:24:43 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@159 -- # NVMF_TARGET_BRIDGE=nvmf_tgt_br 00:13:48.152 11:24:43 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@160 -- # NVMF_TARGET_BRIDGE2=nvmf_tgt_br2 00:13:48.152 11:24:43 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@162 -- # ip link set nvmf_init_br nomaster 00:13:48.152 Cannot find device "nvmf_init_br" 00:13:48.152 11:24:43 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@162 -- # true 00:13:48.152 11:24:43 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@163 -- # ip link set nvmf_init_br2 nomaster 00:13:48.152 Cannot find device "nvmf_init_br2" 00:13:48.152 11:24:43 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@163 -- # true 00:13:48.152 11:24:43 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@164 -- # ip link set nvmf_tgt_br nomaster 00:13:48.152 Cannot find device "nvmf_tgt_br" 00:13:48.152 11:24:43 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@164 -- # true 00:13:48.152 11:24:43 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@165 -- # ip link set nvmf_tgt_br2 nomaster 00:13:48.152 Cannot find device "nvmf_tgt_br2" 00:13:48.152 11:24:43 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@165 -- # true 00:13:48.152 11:24:43 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@166 -- # ip link set nvmf_init_br down 00:13:48.152 Cannot find device "nvmf_init_br" 00:13:48.152 11:24:43 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@166 -- # true 00:13:48.152 11:24:43 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@167 -- # ip link set nvmf_init_br2 down 00:13:48.152 Cannot find device "nvmf_init_br2" 00:13:48.152 11:24:43 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@167 -- # true 00:13:48.152 11:24:43 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@168 -- # ip link set nvmf_tgt_br down 00:13:48.152 Cannot find device "nvmf_tgt_br" 00:13:48.152 11:24:43 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@168 -- # true 00:13:48.152 11:24:43 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@169 -- # ip link set nvmf_tgt_br2 down 00:13:48.410 Cannot find device "nvmf_tgt_br2" 00:13:48.410 11:24:43 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@169 -- # true 00:13:48.410 11:24:43 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@170 -- # ip link delete nvmf_br type bridge 00:13:48.410 Cannot find device "nvmf_br" 00:13:48.410 11:24:43 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@170 -- # true 00:13:48.410 11:24:43 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@171 -- # ip link delete nvmf_init_if 00:13:48.410 Cannot find device "nvmf_init_if" 00:13:48.410 11:24:43 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@171 -- # true 00:13:48.410 11:24:43 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@172 -- # ip link delete nvmf_init_if2 00:13:48.410 Cannot find device "nvmf_init_if2" 00:13:48.410 11:24:43 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@172 -- # true 00:13:48.410 11:24:43 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@173 -- # ip netns exec nvmf_tgt_ns_spdk ip link delete nvmf_tgt_if 00:13:48.410 Cannot open network namespace "nvmf_tgt_ns_spdk": No such file or directory 00:13:48.410 11:24:43 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@173 -- # true 00:13:48.410 11:24:43 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@174 -- # ip netns exec nvmf_tgt_ns_spdk ip link delete nvmf_tgt_if2 00:13:48.410 Cannot open network namespace "nvmf_tgt_ns_spdk": No such file or directory 00:13:48.410 11:24:43 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@174 -- # true 00:13:48.410 11:24:43 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@177 -- # ip netns add nvmf_tgt_ns_spdk 00:13:48.410 11:24:43 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@180 -- # ip link add nvmf_init_if type veth peer name nvmf_init_br 00:13:48.410 11:24:43 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@181 -- # ip link add nvmf_init_if2 type veth peer name nvmf_init_br2 00:13:48.410 11:24:43 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@182 -- # ip link add nvmf_tgt_if type veth peer name nvmf_tgt_br 00:13:48.410 11:24:43 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@183 -- # ip link add nvmf_tgt_if2 type veth peer name nvmf_tgt_br2 00:13:48.410 11:24:43 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@186 -- # ip link set nvmf_tgt_if netns nvmf_tgt_ns_spdk 00:13:48.410 11:24:43 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@187 -- # ip link set nvmf_tgt_if2 netns nvmf_tgt_ns_spdk 00:13:48.410 11:24:43 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@190 -- # ip addr add 10.0.0.1/24 dev nvmf_init_if 00:13:48.410 11:24:43 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@191 -- # ip addr add 10.0.0.2/24 dev nvmf_init_if2 00:13:48.410 11:24:43 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@192 -- # ip netns exec nvmf_tgt_ns_spdk ip addr add 10.0.0.3/24 dev nvmf_tgt_if 00:13:48.410 11:24:43 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@193 -- # ip netns exec nvmf_tgt_ns_spdk ip addr add 10.0.0.4/24 dev nvmf_tgt_if2 00:13:48.410 11:24:43 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@196 -- # ip link set nvmf_init_if up 00:13:48.410 11:24:43 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@197 -- # ip link set nvmf_init_if2 up 00:13:48.410 11:24:43 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@198 -- # ip link set nvmf_init_br up 00:13:48.410 11:24:43 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@199 -- # ip link set nvmf_init_br2 up 00:13:48.410 11:24:43 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@200 -- # ip link set nvmf_tgt_br up 00:13:48.410 11:24:43 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@201 -- # ip link set nvmf_tgt_br2 up 00:13:48.410 11:24:43 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@202 -- # ip netns exec nvmf_tgt_ns_spdk ip link set nvmf_tgt_if up 00:13:48.410 11:24:43 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@203 -- # ip netns exec nvmf_tgt_ns_spdk ip link set nvmf_tgt_if2 up 00:13:48.410 11:24:43 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@204 -- # ip netns exec nvmf_tgt_ns_spdk ip link set lo up 00:13:48.410 11:24:43 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@207 -- # ip link add nvmf_br type bridge 00:13:48.410 11:24:43 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@208 -- # ip link set nvmf_br up 00:13:48.410 11:24:43 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@211 -- # ip link set nvmf_init_br master nvmf_br 00:13:48.410 11:24:43 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@212 -- # ip link set nvmf_init_br2 master nvmf_br 00:13:48.410 11:24:43 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@213 -- # ip link set nvmf_tgt_br master nvmf_br 00:13:48.410 11:24:43 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@214 -- # ip link set nvmf_tgt_br2 master nvmf_br 00:13:48.410 11:24:43 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@217 -- # ipts -I INPUT 1 -i nvmf_init_if -p tcp --dport 4420 -j ACCEPT 00:13:48.410 11:24:43 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@788 -- # iptables -I INPUT 1 -i nvmf_init_if -p tcp --dport 4420 -j ACCEPT -m comment --comment 'SPDK_NVMF:-I INPUT 1 -i nvmf_init_if -p tcp --dport 4420 -j ACCEPT' 00:13:48.410 11:24:43 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@218 -- # ipts -I INPUT 1 -i nvmf_init_if2 -p tcp --dport 4420 -j ACCEPT 00:13:48.410 11:24:43 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@788 -- # iptables -I INPUT 1 -i nvmf_init_if2 -p tcp --dport 4420 -j ACCEPT -m comment --comment 'SPDK_NVMF:-I INPUT 1 -i nvmf_init_if2 -p tcp --dport 4420 -j ACCEPT' 00:13:48.410 11:24:43 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@219 -- # ipts -A FORWARD -i nvmf_br -o nvmf_br -j ACCEPT 00:13:48.410 11:24:43 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@788 -- # iptables -A FORWARD -i nvmf_br -o nvmf_br -j ACCEPT -m comment --comment 'SPDK_NVMF:-A FORWARD -i nvmf_br -o nvmf_br -j ACCEPT' 00:13:48.410 11:24:43 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@222 -- # ping -c 1 10.0.0.3 00:13:48.410 PING 10.0.0.3 (10.0.0.3) 56(84) bytes of data. 00:13:48.410 64 bytes from 10.0.0.3: icmp_seq=1 ttl=64 time=0.122 ms 00:13:48.410 00:13:48.410 --- 10.0.0.3 ping statistics --- 00:13:48.410 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:13:48.410 rtt min/avg/max/mdev = 0.122/0.122/0.122/0.000 ms 00:13:48.410 11:24:43 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@223 -- # ping -c 1 10.0.0.4 00:13:48.410 PING 10.0.0.4 (10.0.0.4) 56(84) bytes of data. 00:13:48.410 64 bytes from 10.0.0.4: icmp_seq=1 ttl=64 time=0.058 ms 00:13:48.410 00:13:48.411 --- 10.0.0.4 ping statistics --- 00:13:48.411 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:13:48.411 rtt min/avg/max/mdev = 0.058/0.058/0.058/0.000 ms 00:13:48.411 11:24:43 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@224 -- # ip netns exec nvmf_tgt_ns_spdk ping -c 1 10.0.0.1 00:13:48.411 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:13:48.411 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.035 ms 00:13:48.411 00:13:48.411 --- 10.0.0.1 ping statistics --- 00:13:48.411 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:13:48.411 rtt min/avg/max/mdev = 0.035/0.035/0.035/0.000 ms 00:13:48.669 11:24:43 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@225 -- # ip netns exec nvmf_tgt_ns_spdk ping -c 1 10.0.0.2 00:13:48.669 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:13:48.669 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.057 ms 00:13:48.669 00:13:48.669 --- 10.0.0.2 ping statistics --- 00:13:48.669 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:13:48.669 rtt min/avg/max/mdev = 0.057/0.057/0.057/0.000 ms 00:13:48.669 11:24:43 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@227 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:13:48.669 11:24:43 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@459 -- # return 0 00:13:48.669 11:24:43 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@476 -- # '[' '' == iso ']' 00:13:48.669 11:24:43 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@480 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:13:48.669 11:24:43 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@481 -- # [[ tcp == \r\d\m\a ]] 00:13:48.669 11:24:43 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@490 -- # [[ tcp == \t\c\p ]] 00:13:48.669 11:24:43 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@491 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:13:48.669 11:24:43 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@494 -- # '[' tcp == tcp ']' 00:13:48.669 11:24:43 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@500 -- # modprobe nvme-tcp 00:13:48.669 11:24:43 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- target/bdevio.sh@16 -- # nvmfappstart -m 0x78 00:13:48.669 11:24:43 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@505 -- # timing_enter start_nvmf_tgt 00:13:48.669 11:24:43 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- common/autotest_common.sh@724 -- # xtrace_disable 00:13:48.669 11:24:43 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- common/autotest_common.sh@10 -- # set +x 00:13:48.669 11:24:43 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@507 -- # nvmfpid=71176 00:13:48.669 11:24:43 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@506 -- # ip netns exec nvmf_tgt_ns_spdk /home/vagrant/spdk_repo/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x78 00:13:48.669 11:24:43 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@508 -- # waitforlisten 71176 00:13:48.669 11:24:43 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- common/autotest_common.sh@831 -- # '[' -z 71176 ']' 00:13:48.669 11:24:43 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- common/autotest_common.sh@835 -- # local rpc_addr=/var/tmp/spdk.sock 00:13:48.669 11:24:43 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- common/autotest_common.sh@836 -- # local max_retries=100 00:13:48.669 11:24:43 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- common/autotest_common.sh@838 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:13:48.669 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:13:48.669 11:24:43 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- common/autotest_common.sh@840 -- # xtrace_disable 00:13:48.669 11:24:43 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- common/autotest_common.sh@10 -- # set +x 00:13:48.669 [2024-10-07 11:24:44.026060] Starting SPDK v25.01-pre git sha1 2a4f56c54 / DPDK 24.03.0 initialization... 00:13:48.670 [2024-10-07 11:24:44.026147] [ DPDK EAL parameters: nvmf -c 0x78 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --iova-mode=pa --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:13:48.670 [2024-10-07 11:24:44.167183] app.c: 917:spdk_app_start: *NOTICE*: Total cores available: 4 00:13:48.928 [2024-10-07 11:24:44.302348] app.c: 610:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:13:48.928 [2024-10-07 11:24:44.302416] app.c: 611:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:13:48.928 [2024-10-07 11:24:44.302431] app.c: 616:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:13:48.928 [2024-10-07 11:24:44.302443] app.c: 617:app_setup_trace: *NOTICE*: SPDK application currently running. 00:13:48.928 [2024-10-07 11:24:44.302453] app.c: 618:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:13:48.928 [2024-10-07 11:24:44.304038] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 4 00:13:48.928 [2024-10-07 11:24:44.304239] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 5 00:13:48.928 [2024-10-07 11:24:44.307677] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 6 00:13:48.928 [2024-10-07 11:24:44.307707] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 3 00:13:49.862 11:24:45 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- common/autotest_common.sh@860 -- # (( i == 0 )) 00:13:49.862 11:24:45 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- common/autotest_common.sh@864 -- # return 0 00:13:49.862 11:24:45 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@509 -- # timing_exit start_nvmf_tgt 00:13:49.862 11:24:45 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- common/autotest_common.sh@730 -- # xtrace_disable 00:13:49.862 11:24:45 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- common/autotest_common.sh@10 -- # set +x 00:13:49.862 11:24:45 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@510 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:13:49.862 11:24:45 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- target/bdevio.sh@18 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:13:49.862 11:24:45 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:49.862 11:24:45 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- common/autotest_common.sh@10 -- # set +x 00:13:49.862 [2024-10-07 11:24:45.103500] tcp.c: 738:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:13:49.862 11:24:45 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:49.862 11:24:45 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- target/bdevio.sh@19 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:13:49.862 11:24:45 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:49.862 11:24:45 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- common/autotest_common.sh@10 -- # set +x 00:13:49.862 Malloc0 00:13:49.862 11:24:45 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:49.862 11:24:45 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- target/bdevio.sh@20 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:13:49.862 11:24:45 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:49.862 11:24:45 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- common/autotest_common.sh@10 -- # set +x 00:13:49.863 11:24:45 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:49.863 11:24:45 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- target/bdevio.sh@21 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:13:49.863 11:24:45 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:49.863 11:24:45 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- common/autotest_common.sh@10 -- # set +x 00:13:49.863 11:24:45 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:49.863 11:24:45 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- target/bdevio.sh@22 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.3 -s 4420 00:13:49.863 11:24:45 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:49.863 11:24:45 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- common/autotest_common.sh@10 -- # set +x 00:13:49.863 [2024-10-07 11:24:45.169794] tcp.c:1081:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.3 port 4420 *** 00:13:49.863 11:24:45 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:49.863 11:24:45 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- target/bdevio.sh@24 -- # /home/vagrant/spdk_repo/spdk/test/bdev/bdevio/bdevio --json /dev/fd/62 00:13:49.863 11:24:45 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- target/bdevio.sh@24 -- # gen_nvmf_target_json 00:13:49.863 11:24:45 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@558 -- # config=() 00:13:49.863 11:24:45 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@558 -- # local subsystem config 00:13:49.863 11:24:45 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@560 -- # for subsystem in "${@:-1}" 00:13:49.863 11:24:45 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@580 -- # config+=("$(cat <<-EOF 00:13:49.863 { 00:13:49.863 "params": { 00:13:49.863 "name": "Nvme$subsystem", 00:13:49.863 "trtype": "$TEST_TRANSPORT", 00:13:49.863 "traddr": "$NVMF_FIRST_TARGET_IP", 00:13:49.863 "adrfam": "ipv4", 00:13:49.863 "trsvcid": "$NVMF_PORT", 00:13:49.863 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:13:49.863 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:13:49.863 "hdgst": ${hdgst:-false}, 00:13:49.863 "ddgst": ${ddgst:-false} 00:13:49.863 }, 00:13:49.863 "method": "bdev_nvme_attach_controller" 00:13:49.863 } 00:13:49.863 EOF 00:13:49.863 )") 00:13:49.863 11:24:45 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@580 -- # cat 00:13:49.863 11:24:45 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@582 -- # jq . 00:13:49.863 11:24:45 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@583 -- # IFS=, 00:13:49.863 11:24:45 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@584 -- # printf '%s\n' '{ 00:13:49.863 "params": { 00:13:49.863 "name": "Nvme1", 00:13:49.863 "trtype": "tcp", 00:13:49.863 "traddr": "10.0.0.3", 00:13:49.863 "adrfam": "ipv4", 00:13:49.863 "trsvcid": "4420", 00:13:49.863 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:13:49.863 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:13:49.863 "hdgst": false, 00:13:49.863 "ddgst": false 00:13:49.863 }, 00:13:49.863 "method": "bdev_nvme_attach_controller" 00:13:49.863 }' 00:13:49.863 [2024-10-07 11:24:45.239693] Starting SPDK v25.01-pre git sha1 2a4f56c54 / DPDK 24.03.0 initialization... 00:13:49.863 [2024-10-07 11:24:45.239829] [ DPDK EAL parameters: bdevio --no-shconf -c 0x7 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --iova-mode=pa --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid71230 ] 00:13:49.863 [2024-10-07 11:24:45.374083] app.c: 917:spdk_app_start: *NOTICE*: Total cores available: 3 00:13:50.120 [2024-10-07 11:24:45.494757] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 1 00:13:50.120 [2024-10-07 11:24:45.494888] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 2 00:13:50.120 [2024-10-07 11:24:45.494893] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 0 00:13:50.398 I/O targets: 00:13:50.398 Nvme1n1: 131072 blocks of 512 bytes (64 MiB) 00:13:50.398 00:13:50.398 00:13:50.398 CUnit - A unit testing framework for C - Version 2.1-3 00:13:50.398 http://cunit.sourceforge.net/ 00:13:50.398 00:13:50.398 00:13:50.398 Suite: bdevio tests on: Nvme1n1 00:13:50.398 Test: blockdev write read block ...passed 00:13:50.399 Test: blockdev write zeroes read block ...passed 00:13:50.399 Test: blockdev write zeroes read no split ...passed 00:13:50.399 Test: blockdev write zeroes read split ...passed 00:13:50.399 Test: blockdev write zeroes read split partial ...passed 00:13:50.399 Test: blockdev reset ...[2024-10-07 11:24:45.793409] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:13:50.399 [2024-10-07 11:24:45.793528] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x2186b80 (9): Bad file descriptor 00:13:50.399 passed 00:13:50.399 Test: blockdev write read 8 blocks ...[2024-10-07 11:24:45.806116] bdev_nvme.c:2183:_bdev_nvme_reset_ctrlr_complete: *NOTICE*: Resetting controller successful. 00:13:50.399 passed 00:13:50.399 Test: blockdev write read size > 128k ...passed 00:13:50.399 Test: blockdev write read invalid size ...passed 00:13:50.399 Test: blockdev write read offset + nbytes == size of blockdev ...passed 00:13:50.399 Test: blockdev write read offset + nbytes > size of blockdev ...passed 00:13:50.399 Test: blockdev write read max offset ...passed 00:13:50.675 Test: blockdev write read 2 blocks on overlapped address offset ...passed 00:13:50.675 Test: blockdev writev readv 8 blocks ...passed 00:13:50.675 Test: blockdev writev readv 30 x 1block ...passed 00:13:50.675 Test: blockdev writev readv block ...passed 00:13:50.675 Test: blockdev writev readv size > 128k ...passed 00:13:50.675 Test: blockdev writev readv size > 128k in two iovs ...passed 00:13:50.675 Test: blockdev comparev and writev ...[2024-10-07 11:24:45.978285] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: COMPARE sqid:1 cid:0 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:13:50.675 [2024-10-07 11:24:45.978347] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMPARE FAILURE (02/85) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:13:50.675 [2024-10-07 11:24:45.978369] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:13:50.675 [2024-10-07 11:24:45.978380] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - FAILED FUSED (00/09) qid:1 cid:1 cdw0:0 sqhd:0022 p:0 m:0 dnr:0 00:13:50.675 [2024-10-07 11:24:45.978733] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: COMPARE sqid:1 cid:1 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:13:50.675 [2024-10-07 11:24:45.978757] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMPARE FAILURE (02/85) qid:1 cid:1 cdw0:0 sqhd:0023 p:0 m:0 dnr:0 00:13:50.675 [2024-10-07 11:24:45.978774] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:13:50.675 [2024-10-07 11:24:45.978806] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - FAILED FUSED (00/09) qid:1 cid:0 cdw0:0 sqhd:0024 p:0 m:0 dnr:0 00:13:50.675 [2024-10-07 11:24:45.979099] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: COMPARE sqid:1 cid:0 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:13:50.675 [2024-10-07 11:24:45.979117] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMPARE FAILURE (02/85) qid:1 cid:0 cdw0:0 sqhd:0025 p:0 m:0 dnr:0 00:13:50.675 [2024-10-07 11:24:45.979133] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:13:50.675 [2024-10-07 11:24:45.979143] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - FAILED FUSED (00/09) qid:1 cid:1 cdw0:0 sqhd:0026 p:0 m:0 dnr:0 00:13:50.675 [2024-10-07 11:24:45.979419] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: COMPARE sqid:1 cid:1 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:13:50.675 [2024-10-07 11:24:45.979436] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMPARE FAILURE (02/85) qid:1 cid:1 cdw0:0 sqhd:0027 p:0 m:0 dnr:0 00:13:50.675 [2024-10-07 11:24:45.979454] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:13:50.675 [2024-10-07 11:24:45.979463] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - FAILED FUSED (00/09) qid:1 cid:0 cdw0:0 sqhd:0028 p:0 m:0 dnr:0 00:13:50.675 passed 00:13:50.675 Test: blockdev nvme passthru rw ...passed 00:13:50.675 Test: blockdev nvme passthru vendor specific ...[2024-10-07 11:24:46.062116] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC CONNECT qid:1 cid:0 SGL DATA BLOCK OFFSET 0x0 len:0x0 00:13:50.675 [2024-10-07 11:24:46.062167] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: INVALID OPCODE (00/01) qid:1 cid:0 cdw0:0 sqhd:002c p:0 m:0 dnr:0 00:13:50.675 [2024-10-07 11:24:46.062305] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC CONNECT qid:1 cid:0 SGL DATA BLOCK OFFSET 0x0 len:0x0 00:13:50.675 [2024-10-07 11:24:46.062322] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: INVALID OPCODE (00/01) qid:1 cid:0 cdw0:0 sqhd:002d p:0 m:0 dnr:0 00:13:50.675 passed 00:13:50.675 Test: blockdev nvme admin passthru ...[2024-10-07 11:24:46.062431] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC CONNECT qid:1 cid:0 SGL DATA BLOCK OFFSET 0x0 len:0x0 00:13:50.675 [2024-10-07 11:24:46.062452] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: INVALID OPCODE (00/01) qid:1 cid:0 cdw0:0 sqhd:002e p:0 m:0 dnr:0 00:13:50.675 [2024-10-07 11:24:46.062562] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC CONNECT qid:1 cid:0 SGL DATA BLOCK OFFSET 0x0 len:0x0 00:13:50.675 [2024-10-07 11:24:46.062578] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: INVALID OPCODE (00/01) qid:1 cid:0 cdw0:0 sqhd:002f p:0 m:0 dnr:0 00:13:50.675 passed 00:13:50.675 Test: blockdev copy ...passed 00:13:50.675 00:13:50.675 Run Summary: Type Total Ran Passed Failed Inactive 00:13:50.675 suites 1 1 n/a 0 0 00:13:50.675 tests 23 23 23 0 0 00:13:50.675 asserts 152 152 152 0 n/a 00:13:50.675 00:13:50.675 Elapsed time = 0.876 seconds 00:13:50.933 11:24:46 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- target/bdevio.sh@26 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:13:50.933 11:24:46 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:50.933 11:24:46 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- common/autotest_common.sh@10 -- # set +x 00:13:50.934 11:24:46 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:50.934 11:24:46 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- target/bdevio.sh@28 -- # trap - SIGINT SIGTERM EXIT 00:13:50.934 11:24:46 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- target/bdevio.sh@30 -- # nvmftestfini 00:13:50.934 11:24:46 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@514 -- # nvmfcleanup 00:13:50.934 11:24:46 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@121 -- # sync 00:13:50.934 11:24:46 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@123 -- # '[' tcp == tcp ']' 00:13:50.934 11:24:46 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@124 -- # set +e 00:13:50.934 11:24:46 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@125 -- # for i in {1..20} 00:13:50.934 11:24:46 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@126 -- # modprobe -v -r nvme-tcp 00:13:50.934 rmmod nvme_tcp 00:13:50.934 rmmod nvme_fabrics 00:13:50.934 rmmod nvme_keyring 00:13:50.934 11:24:46 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@127 -- # modprobe -v -r nvme-fabrics 00:13:50.934 11:24:46 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@128 -- # set -e 00:13:50.934 11:24:46 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@129 -- # return 0 00:13:50.934 11:24:46 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@515 -- # '[' -n 71176 ']' 00:13:50.934 11:24:46 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@516 -- # killprocess 71176 00:13:50.934 11:24:46 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- common/autotest_common.sh@950 -- # '[' -z 71176 ']' 00:13:50.934 11:24:46 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- common/autotest_common.sh@954 -- # kill -0 71176 00:13:50.934 11:24:46 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- common/autotest_common.sh@955 -- # uname 00:13:50.934 11:24:46 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- common/autotest_common.sh@955 -- # '[' Linux = Linux ']' 00:13:50.934 11:24:46 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- common/autotest_common.sh@956 -- # ps --no-headers -o comm= 71176 00:13:51.192 11:24:46 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- common/autotest_common.sh@956 -- # process_name=reactor_3 00:13:51.192 11:24:46 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- common/autotest_common.sh@960 -- # '[' reactor_3 = sudo ']' 00:13:51.192 killing process with pid 71176 00:13:51.192 11:24:46 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- common/autotest_common.sh@968 -- # echo 'killing process with pid 71176' 00:13:51.192 11:24:46 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- common/autotest_common.sh@969 -- # kill 71176 00:13:51.192 11:24:46 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- common/autotest_common.sh@974 -- # wait 71176 00:13:51.450 11:24:46 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@518 -- # '[' '' == iso ']' 00:13:51.450 11:24:46 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@521 -- # [[ tcp == \t\c\p ]] 00:13:51.450 11:24:46 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@522 -- # nvmf_tcp_fini 00:13:51.450 11:24:46 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@297 -- # iptr 00:13:51.450 11:24:46 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@789 -- # iptables-save 00:13:51.450 11:24:46 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@789 -- # grep -v SPDK_NVMF 00:13:51.450 11:24:46 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@789 -- # iptables-restore 00:13:51.450 11:24:46 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@298 -- # [[ nvmf_tgt_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s\_\s\p\d\k ]] 00:13:51.450 11:24:46 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@299 -- # nvmf_veth_fini 00:13:51.450 11:24:46 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@233 -- # ip link set nvmf_init_br nomaster 00:13:51.450 11:24:46 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@234 -- # ip link set nvmf_init_br2 nomaster 00:13:51.450 11:24:46 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@235 -- # ip link set nvmf_tgt_br nomaster 00:13:51.450 11:24:46 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@236 -- # ip link set nvmf_tgt_br2 nomaster 00:13:51.450 11:24:46 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@237 -- # ip link set nvmf_init_br down 00:13:51.450 11:24:46 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@238 -- # ip link set nvmf_init_br2 down 00:13:51.450 11:24:46 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@239 -- # ip link set nvmf_tgt_br down 00:13:51.450 11:24:46 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@240 -- # ip link set nvmf_tgt_br2 down 00:13:51.450 11:24:46 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@241 -- # ip link delete nvmf_br type bridge 00:13:51.450 11:24:46 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@242 -- # ip link delete nvmf_init_if 00:13:51.450 11:24:46 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@243 -- # ip link delete nvmf_init_if2 00:13:51.450 11:24:46 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@244 -- # ip netns exec nvmf_tgt_ns_spdk ip link delete nvmf_tgt_if 00:13:51.450 11:24:46 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@245 -- # ip netns exec nvmf_tgt_ns_spdk ip link delete nvmf_tgt_if2 00:13:51.450 11:24:46 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@246 -- # remove_spdk_ns 00:13:51.450 11:24:46 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@654 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:13:51.450 11:24:46 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 15> /dev/null' 00:13:51.450 11:24:46 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:13:51.450 11:24:46 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@300 -- # return 0 00:13:51.450 00:13:51.450 real 0m3.606s 00:13:51.450 user 0m11.894s 00:13:51.450 sys 0m0.929s 00:13:51.450 11:24:46 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- common/autotest_common.sh@1126 -- # xtrace_disable 00:13:51.450 ************************************ 00:13:51.450 END TEST nvmf_bdevio 00:13:51.450 ************************************ 00:13:51.450 11:24:46 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- common/autotest_common.sh@10 -- # set +x 00:13:51.708 11:24:47 nvmf_tcp.nvmf_target_core -- nvmf/nvmf_target_core.sh@37 -- # trap - SIGINT SIGTERM EXIT 00:13:51.708 00:13:51.708 real 3m46.098s 00:13:51.708 user 11m49.345s 00:13:51.708 sys 1m1.841s 00:13:51.708 11:24:47 nvmf_tcp.nvmf_target_core -- common/autotest_common.sh@1126 -- # xtrace_disable 00:13:51.708 11:24:47 nvmf_tcp.nvmf_target_core -- common/autotest_common.sh@10 -- # set +x 00:13:51.708 ************************************ 00:13:51.708 END TEST nvmf_target_core 00:13:51.708 ************************************ 00:13:51.708 11:24:47 nvmf_tcp -- nvmf/nvmf.sh@15 -- # run_test nvmf_target_extra /home/vagrant/spdk_repo/spdk/test/nvmf/nvmf_target_extra.sh --transport=tcp 00:13:51.708 11:24:47 nvmf_tcp -- common/autotest_common.sh@1101 -- # '[' 3 -le 1 ']' 00:13:51.708 11:24:47 nvmf_tcp -- common/autotest_common.sh@1107 -- # xtrace_disable 00:13:51.708 11:24:47 nvmf_tcp -- common/autotest_common.sh@10 -- # set +x 00:13:51.708 ************************************ 00:13:51.708 START TEST nvmf_target_extra 00:13:51.708 ************************************ 00:13:51.708 11:24:47 nvmf_tcp.nvmf_target_extra -- common/autotest_common.sh@1125 -- # /home/vagrant/spdk_repo/spdk/test/nvmf/nvmf_target_extra.sh --transport=tcp 00:13:51.708 * Looking for test storage... 00:13:51.708 * Found test storage at /home/vagrant/spdk_repo/spdk/test/nvmf 00:13:51.708 11:24:47 nvmf_tcp.nvmf_target_extra -- common/autotest_common.sh@1680 -- # [[ y == y ]] 00:13:51.708 11:24:47 nvmf_tcp.nvmf_target_extra -- common/autotest_common.sh@1681 -- # lcov --version 00:13:51.708 11:24:47 nvmf_tcp.nvmf_target_extra -- common/autotest_common.sh@1681 -- # awk '{print $NF}' 00:13:51.969 11:24:47 nvmf_tcp.nvmf_target_extra -- common/autotest_common.sh@1681 -- # lt 1.15 2 00:13:51.969 11:24:47 nvmf_tcp.nvmf_target_extra -- scripts/common.sh@373 -- # cmp_versions 1.15 '<' 2 00:13:51.969 11:24:47 nvmf_tcp.nvmf_target_extra -- scripts/common.sh@333 -- # local ver1 ver1_l 00:13:51.969 11:24:47 nvmf_tcp.nvmf_target_extra -- scripts/common.sh@334 -- # local ver2 ver2_l 00:13:51.969 11:24:47 nvmf_tcp.nvmf_target_extra -- scripts/common.sh@336 -- # IFS=.-: 00:13:51.969 11:24:47 nvmf_tcp.nvmf_target_extra -- scripts/common.sh@336 -- # read -ra ver1 00:13:51.969 11:24:47 nvmf_tcp.nvmf_target_extra -- scripts/common.sh@337 -- # IFS=.-: 00:13:51.969 11:24:47 nvmf_tcp.nvmf_target_extra -- scripts/common.sh@337 -- # read -ra ver2 00:13:51.969 11:24:47 nvmf_tcp.nvmf_target_extra -- scripts/common.sh@338 -- # local 'op=<' 00:13:51.969 11:24:47 nvmf_tcp.nvmf_target_extra -- scripts/common.sh@340 -- # ver1_l=2 00:13:51.969 11:24:47 nvmf_tcp.nvmf_target_extra -- scripts/common.sh@341 -- # ver2_l=1 00:13:51.969 11:24:47 nvmf_tcp.nvmf_target_extra -- scripts/common.sh@343 -- # local lt=0 gt=0 eq=0 v 00:13:51.969 11:24:47 nvmf_tcp.nvmf_target_extra -- scripts/common.sh@344 -- # case "$op" in 00:13:51.969 11:24:47 nvmf_tcp.nvmf_target_extra -- scripts/common.sh@345 -- # : 1 00:13:51.969 11:24:47 nvmf_tcp.nvmf_target_extra -- scripts/common.sh@364 -- # (( v = 0 )) 00:13:51.969 11:24:47 nvmf_tcp.nvmf_target_extra -- scripts/common.sh@364 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:13:51.969 11:24:47 nvmf_tcp.nvmf_target_extra -- scripts/common.sh@365 -- # decimal 1 00:13:51.969 11:24:47 nvmf_tcp.nvmf_target_extra -- scripts/common.sh@353 -- # local d=1 00:13:51.969 11:24:47 nvmf_tcp.nvmf_target_extra -- scripts/common.sh@354 -- # [[ 1 =~ ^[0-9]+$ ]] 00:13:51.969 11:24:47 nvmf_tcp.nvmf_target_extra -- scripts/common.sh@355 -- # echo 1 00:13:51.969 11:24:47 nvmf_tcp.nvmf_target_extra -- scripts/common.sh@365 -- # ver1[v]=1 00:13:51.969 11:24:47 nvmf_tcp.nvmf_target_extra -- scripts/common.sh@366 -- # decimal 2 00:13:51.969 11:24:47 nvmf_tcp.nvmf_target_extra -- scripts/common.sh@353 -- # local d=2 00:13:51.969 11:24:47 nvmf_tcp.nvmf_target_extra -- scripts/common.sh@354 -- # [[ 2 =~ ^[0-9]+$ ]] 00:13:51.969 11:24:47 nvmf_tcp.nvmf_target_extra -- scripts/common.sh@355 -- # echo 2 00:13:51.969 11:24:47 nvmf_tcp.nvmf_target_extra -- scripts/common.sh@366 -- # ver2[v]=2 00:13:51.969 11:24:47 nvmf_tcp.nvmf_target_extra -- scripts/common.sh@367 -- # (( ver1[v] > ver2[v] )) 00:13:51.969 11:24:47 nvmf_tcp.nvmf_target_extra -- scripts/common.sh@368 -- # (( ver1[v] < ver2[v] )) 00:13:51.969 11:24:47 nvmf_tcp.nvmf_target_extra -- scripts/common.sh@368 -- # return 0 00:13:51.969 11:24:47 nvmf_tcp.nvmf_target_extra -- common/autotest_common.sh@1682 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:13:51.969 11:24:47 nvmf_tcp.nvmf_target_extra -- common/autotest_common.sh@1694 -- # export 'LCOV_OPTS= 00:13:51.969 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:13:51.969 --rc genhtml_branch_coverage=1 00:13:51.969 --rc genhtml_function_coverage=1 00:13:51.969 --rc genhtml_legend=1 00:13:51.969 --rc geninfo_all_blocks=1 00:13:51.969 --rc geninfo_unexecuted_blocks=1 00:13:51.969 00:13:51.969 ' 00:13:51.969 11:24:47 nvmf_tcp.nvmf_target_extra -- common/autotest_common.sh@1694 -- # LCOV_OPTS=' 00:13:51.969 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:13:51.969 --rc genhtml_branch_coverage=1 00:13:51.969 --rc genhtml_function_coverage=1 00:13:51.969 --rc genhtml_legend=1 00:13:51.969 --rc geninfo_all_blocks=1 00:13:51.969 --rc geninfo_unexecuted_blocks=1 00:13:51.969 00:13:51.969 ' 00:13:51.969 11:24:47 nvmf_tcp.nvmf_target_extra -- common/autotest_common.sh@1695 -- # export 'LCOV=lcov 00:13:51.969 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:13:51.969 --rc genhtml_branch_coverage=1 00:13:51.969 --rc genhtml_function_coverage=1 00:13:51.969 --rc genhtml_legend=1 00:13:51.969 --rc geninfo_all_blocks=1 00:13:51.969 --rc geninfo_unexecuted_blocks=1 00:13:51.969 00:13:51.969 ' 00:13:51.969 11:24:47 nvmf_tcp.nvmf_target_extra -- common/autotest_common.sh@1695 -- # LCOV='lcov 00:13:51.969 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:13:51.969 --rc genhtml_branch_coverage=1 00:13:51.969 --rc genhtml_function_coverage=1 00:13:51.969 --rc genhtml_legend=1 00:13:51.969 --rc geninfo_all_blocks=1 00:13:51.969 --rc geninfo_unexecuted_blocks=1 00:13:51.969 00:13:51.969 ' 00:13:51.969 11:24:47 nvmf_tcp.nvmf_target_extra -- nvmf/nvmf_target_extra.sh@9 -- # source /home/vagrant/spdk_repo/spdk/test/nvmf/common.sh 00:13:51.969 11:24:47 nvmf_tcp.nvmf_target_extra -- nvmf/common.sh@7 -- # uname -s 00:13:51.969 11:24:47 nvmf_tcp.nvmf_target_extra -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:13:51.969 11:24:47 nvmf_tcp.nvmf_target_extra -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:13:51.969 11:24:47 nvmf_tcp.nvmf_target_extra -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:13:51.970 11:24:47 nvmf_tcp.nvmf_target_extra -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:13:51.970 11:24:47 nvmf_tcp.nvmf_target_extra -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:13:51.970 11:24:47 nvmf_tcp.nvmf_target_extra -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:13:51.970 11:24:47 nvmf_tcp.nvmf_target_extra -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:13:51.970 11:24:47 nvmf_tcp.nvmf_target_extra -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:13:51.970 11:24:47 nvmf_tcp.nvmf_target_extra -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:13:51.970 11:24:47 nvmf_tcp.nvmf_target_extra -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:13:51.970 11:24:47 nvmf_tcp.nvmf_target_extra -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:c758a4ed-f09f-4c82-9afb-3d096f035464 00:13:51.970 11:24:47 nvmf_tcp.nvmf_target_extra -- nvmf/common.sh@18 -- # NVME_HOSTID=c758a4ed-f09f-4c82-9afb-3d096f035464 00:13:51.970 11:24:47 nvmf_tcp.nvmf_target_extra -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:13:51.970 11:24:47 nvmf_tcp.nvmf_target_extra -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:13:51.970 11:24:47 nvmf_tcp.nvmf_target_extra -- nvmf/common.sh@21 -- # NET_TYPE=virt 00:13:51.970 11:24:47 nvmf_tcp.nvmf_target_extra -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:13:51.970 11:24:47 nvmf_tcp.nvmf_target_extra -- nvmf/common.sh@49 -- # source /home/vagrant/spdk_repo/spdk/scripts/common.sh 00:13:51.970 11:24:47 nvmf_tcp.nvmf_target_extra -- scripts/common.sh@15 -- # shopt -s extglob 00:13:51.970 11:24:47 nvmf_tcp.nvmf_target_extra -- scripts/common.sh@544 -- # [[ -e /bin/wpdk_common.sh ]] 00:13:51.970 11:24:47 nvmf_tcp.nvmf_target_extra -- scripts/common.sh@552 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:13:51.970 11:24:47 nvmf_tcp.nvmf_target_extra -- scripts/common.sh@553 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:13:51.970 11:24:47 nvmf_tcp.nvmf_target_extra -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:51.970 11:24:47 nvmf_tcp.nvmf_target_extra -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:51.970 11:24:47 nvmf_tcp.nvmf_target_extra -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:51.970 11:24:47 nvmf_tcp.nvmf_target_extra -- paths/export.sh@5 -- # export PATH 00:13:51.970 11:24:47 nvmf_tcp.nvmf_target_extra -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:51.970 11:24:47 nvmf_tcp.nvmf_target_extra -- nvmf/common.sh@51 -- # : 0 00:13:51.970 11:24:47 nvmf_tcp.nvmf_target_extra -- nvmf/common.sh@52 -- # export NVMF_APP_SHM_ID 00:13:51.970 11:24:47 nvmf_tcp.nvmf_target_extra -- nvmf/common.sh@53 -- # build_nvmf_app_args 00:13:51.970 11:24:47 nvmf_tcp.nvmf_target_extra -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:13:51.970 11:24:47 nvmf_tcp.nvmf_target_extra -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:13:51.970 11:24:47 nvmf_tcp.nvmf_target_extra -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:13:51.970 11:24:47 nvmf_tcp.nvmf_target_extra -- nvmf/common.sh@33 -- # '[' '' -eq 1 ']' 00:13:51.970 /home/vagrant/spdk_repo/spdk/test/nvmf/common.sh: line 33: [: : integer expression expected 00:13:51.970 11:24:47 nvmf_tcp.nvmf_target_extra -- nvmf/common.sh@37 -- # '[' -n '' ']' 00:13:51.970 11:24:47 nvmf_tcp.nvmf_target_extra -- nvmf/common.sh@39 -- # '[' 0 -eq 1 ']' 00:13:51.970 11:24:47 nvmf_tcp.nvmf_target_extra -- nvmf/common.sh@55 -- # have_pci_nics=0 00:13:51.970 11:24:47 nvmf_tcp.nvmf_target_extra -- nvmf/nvmf_target_extra.sh@11 -- # trap 'exit 1' SIGINT SIGTERM EXIT 00:13:51.970 11:24:47 nvmf_tcp.nvmf_target_extra -- nvmf/nvmf_target_extra.sh@13 -- # TEST_ARGS=("$@") 00:13:51.970 11:24:47 nvmf_tcp.nvmf_target_extra -- nvmf/nvmf_target_extra.sh@15 -- # [[ 0 -eq 0 ]] 00:13:51.970 11:24:47 nvmf_tcp.nvmf_target_extra -- nvmf/nvmf_target_extra.sh@16 -- # run_test nvmf_example /home/vagrant/spdk_repo/spdk/test/nvmf/target/nvmf_example.sh --transport=tcp 00:13:51.970 11:24:47 nvmf_tcp.nvmf_target_extra -- common/autotest_common.sh@1101 -- # '[' 3 -le 1 ']' 00:13:51.970 11:24:47 nvmf_tcp.nvmf_target_extra -- common/autotest_common.sh@1107 -- # xtrace_disable 00:13:51.970 11:24:47 nvmf_tcp.nvmf_target_extra -- common/autotest_common.sh@10 -- # set +x 00:13:51.970 ************************************ 00:13:51.970 START TEST nvmf_example 00:13:51.970 ************************************ 00:13:51.970 11:24:47 nvmf_tcp.nvmf_target_extra.nvmf_example -- common/autotest_common.sh@1125 -- # /home/vagrant/spdk_repo/spdk/test/nvmf/target/nvmf_example.sh --transport=tcp 00:13:51.970 * Looking for test storage... 00:13:51.970 * Found test storage at /home/vagrant/spdk_repo/spdk/test/nvmf/target 00:13:51.970 11:24:47 nvmf_tcp.nvmf_target_extra.nvmf_example -- common/autotest_common.sh@1680 -- # [[ y == y ]] 00:13:51.970 11:24:47 nvmf_tcp.nvmf_target_extra.nvmf_example -- common/autotest_common.sh@1681 -- # lcov --version 00:13:51.970 11:24:47 nvmf_tcp.nvmf_target_extra.nvmf_example -- common/autotest_common.sh@1681 -- # awk '{print $NF}' 00:13:51.970 11:24:47 nvmf_tcp.nvmf_target_extra.nvmf_example -- common/autotest_common.sh@1681 -- # lt 1.15 2 00:13:51.970 11:24:47 nvmf_tcp.nvmf_target_extra.nvmf_example -- scripts/common.sh@373 -- # cmp_versions 1.15 '<' 2 00:13:51.970 11:24:47 nvmf_tcp.nvmf_target_extra.nvmf_example -- scripts/common.sh@333 -- # local ver1 ver1_l 00:13:51.970 11:24:47 nvmf_tcp.nvmf_target_extra.nvmf_example -- scripts/common.sh@334 -- # local ver2 ver2_l 00:13:51.970 11:24:47 nvmf_tcp.nvmf_target_extra.nvmf_example -- scripts/common.sh@336 -- # IFS=.-: 00:13:51.970 11:24:47 nvmf_tcp.nvmf_target_extra.nvmf_example -- scripts/common.sh@336 -- # read -ra ver1 00:13:51.970 11:24:47 nvmf_tcp.nvmf_target_extra.nvmf_example -- scripts/common.sh@337 -- # IFS=.-: 00:13:51.970 11:24:47 nvmf_tcp.nvmf_target_extra.nvmf_example -- scripts/common.sh@337 -- # read -ra ver2 00:13:51.970 11:24:47 nvmf_tcp.nvmf_target_extra.nvmf_example -- scripts/common.sh@338 -- # local 'op=<' 00:13:51.970 11:24:47 nvmf_tcp.nvmf_target_extra.nvmf_example -- scripts/common.sh@340 -- # ver1_l=2 00:13:51.970 11:24:47 nvmf_tcp.nvmf_target_extra.nvmf_example -- scripts/common.sh@341 -- # ver2_l=1 00:13:51.970 11:24:47 nvmf_tcp.nvmf_target_extra.nvmf_example -- scripts/common.sh@343 -- # local lt=0 gt=0 eq=0 v 00:13:51.970 11:24:47 nvmf_tcp.nvmf_target_extra.nvmf_example -- scripts/common.sh@344 -- # case "$op" in 00:13:51.970 11:24:47 nvmf_tcp.nvmf_target_extra.nvmf_example -- scripts/common.sh@345 -- # : 1 00:13:51.970 11:24:47 nvmf_tcp.nvmf_target_extra.nvmf_example -- scripts/common.sh@364 -- # (( v = 0 )) 00:13:51.970 11:24:47 nvmf_tcp.nvmf_target_extra.nvmf_example -- scripts/common.sh@364 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:13:51.970 11:24:47 nvmf_tcp.nvmf_target_extra.nvmf_example -- scripts/common.sh@365 -- # decimal 1 00:13:51.970 11:24:47 nvmf_tcp.nvmf_target_extra.nvmf_example -- scripts/common.sh@353 -- # local d=1 00:13:51.970 11:24:47 nvmf_tcp.nvmf_target_extra.nvmf_example -- scripts/common.sh@354 -- # [[ 1 =~ ^[0-9]+$ ]] 00:13:51.970 11:24:47 nvmf_tcp.nvmf_target_extra.nvmf_example -- scripts/common.sh@355 -- # echo 1 00:13:51.970 11:24:47 nvmf_tcp.nvmf_target_extra.nvmf_example -- scripts/common.sh@365 -- # ver1[v]=1 00:13:51.970 11:24:47 nvmf_tcp.nvmf_target_extra.nvmf_example -- scripts/common.sh@366 -- # decimal 2 00:13:51.970 11:24:47 nvmf_tcp.nvmf_target_extra.nvmf_example -- scripts/common.sh@353 -- # local d=2 00:13:51.970 11:24:47 nvmf_tcp.nvmf_target_extra.nvmf_example -- scripts/common.sh@354 -- # [[ 2 =~ ^[0-9]+$ ]] 00:13:51.970 11:24:47 nvmf_tcp.nvmf_target_extra.nvmf_example -- scripts/common.sh@355 -- # echo 2 00:13:51.970 11:24:47 nvmf_tcp.nvmf_target_extra.nvmf_example -- scripts/common.sh@366 -- # ver2[v]=2 00:13:51.970 11:24:47 nvmf_tcp.nvmf_target_extra.nvmf_example -- scripts/common.sh@367 -- # (( ver1[v] > ver2[v] )) 00:13:51.970 11:24:47 nvmf_tcp.nvmf_target_extra.nvmf_example -- scripts/common.sh@368 -- # (( ver1[v] < ver2[v] )) 00:13:51.970 11:24:47 nvmf_tcp.nvmf_target_extra.nvmf_example -- scripts/common.sh@368 -- # return 0 00:13:51.970 11:24:47 nvmf_tcp.nvmf_target_extra.nvmf_example -- common/autotest_common.sh@1682 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:13:51.970 11:24:47 nvmf_tcp.nvmf_target_extra.nvmf_example -- common/autotest_common.sh@1694 -- # export 'LCOV_OPTS= 00:13:51.970 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:13:51.970 --rc genhtml_branch_coverage=1 00:13:51.970 --rc genhtml_function_coverage=1 00:13:51.970 --rc genhtml_legend=1 00:13:51.970 --rc geninfo_all_blocks=1 00:13:51.970 --rc geninfo_unexecuted_blocks=1 00:13:51.970 00:13:51.970 ' 00:13:51.970 11:24:47 nvmf_tcp.nvmf_target_extra.nvmf_example -- common/autotest_common.sh@1694 -- # LCOV_OPTS=' 00:13:51.970 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:13:51.970 --rc genhtml_branch_coverage=1 00:13:51.970 --rc genhtml_function_coverage=1 00:13:51.970 --rc genhtml_legend=1 00:13:51.970 --rc geninfo_all_blocks=1 00:13:51.970 --rc geninfo_unexecuted_blocks=1 00:13:51.970 00:13:51.970 ' 00:13:51.970 11:24:47 nvmf_tcp.nvmf_target_extra.nvmf_example -- common/autotest_common.sh@1695 -- # export 'LCOV=lcov 00:13:51.970 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:13:51.970 --rc genhtml_branch_coverage=1 00:13:51.970 --rc genhtml_function_coverage=1 00:13:51.970 --rc genhtml_legend=1 00:13:51.970 --rc geninfo_all_blocks=1 00:13:51.970 --rc geninfo_unexecuted_blocks=1 00:13:51.970 00:13:51.970 ' 00:13:51.970 11:24:47 nvmf_tcp.nvmf_target_extra.nvmf_example -- common/autotest_common.sh@1695 -- # LCOV='lcov 00:13:51.970 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:13:51.970 --rc genhtml_branch_coverage=1 00:13:51.970 --rc genhtml_function_coverage=1 00:13:51.970 --rc genhtml_legend=1 00:13:51.970 --rc geninfo_all_blocks=1 00:13:51.970 --rc geninfo_unexecuted_blocks=1 00:13:51.970 00:13:51.970 ' 00:13:51.970 11:24:47 nvmf_tcp.nvmf_target_extra.nvmf_example -- target/nvmf_example.sh@9 -- # source /home/vagrant/spdk_repo/spdk/test/nvmf/common.sh 00:13:51.970 11:24:47 nvmf_tcp.nvmf_target_extra.nvmf_example -- nvmf/common.sh@7 -- # uname -s 00:13:51.970 11:24:47 nvmf_tcp.nvmf_target_extra.nvmf_example -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:13:51.970 11:24:47 nvmf_tcp.nvmf_target_extra.nvmf_example -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:13:51.970 11:24:47 nvmf_tcp.nvmf_target_extra.nvmf_example -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:13:51.970 11:24:47 nvmf_tcp.nvmf_target_extra.nvmf_example -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:13:51.970 11:24:47 nvmf_tcp.nvmf_target_extra.nvmf_example -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:13:51.970 11:24:47 nvmf_tcp.nvmf_target_extra.nvmf_example -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:13:51.970 11:24:47 nvmf_tcp.nvmf_target_extra.nvmf_example -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:13:51.970 11:24:47 nvmf_tcp.nvmf_target_extra.nvmf_example -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:13:51.970 11:24:47 nvmf_tcp.nvmf_target_extra.nvmf_example -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:13:51.970 11:24:47 nvmf_tcp.nvmf_target_extra.nvmf_example -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:13:51.971 11:24:47 nvmf_tcp.nvmf_target_extra.nvmf_example -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:c758a4ed-f09f-4c82-9afb-3d096f035464 00:13:51.971 11:24:47 nvmf_tcp.nvmf_target_extra.nvmf_example -- nvmf/common.sh@18 -- # NVME_HOSTID=c758a4ed-f09f-4c82-9afb-3d096f035464 00:13:51.971 11:24:47 nvmf_tcp.nvmf_target_extra.nvmf_example -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:13:51.971 11:24:47 nvmf_tcp.nvmf_target_extra.nvmf_example -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:13:51.971 11:24:47 nvmf_tcp.nvmf_target_extra.nvmf_example -- nvmf/common.sh@21 -- # NET_TYPE=virt 00:13:51.971 11:24:47 nvmf_tcp.nvmf_target_extra.nvmf_example -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:13:51.971 11:24:47 nvmf_tcp.nvmf_target_extra.nvmf_example -- nvmf/common.sh@49 -- # source /home/vagrant/spdk_repo/spdk/scripts/common.sh 00:13:51.971 11:24:47 nvmf_tcp.nvmf_target_extra.nvmf_example -- scripts/common.sh@15 -- # shopt -s extglob 00:13:51.971 11:24:47 nvmf_tcp.nvmf_target_extra.nvmf_example -- scripts/common.sh@544 -- # [[ -e /bin/wpdk_common.sh ]] 00:13:51.971 11:24:47 nvmf_tcp.nvmf_target_extra.nvmf_example -- scripts/common.sh@552 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:13:51.971 11:24:47 nvmf_tcp.nvmf_target_extra.nvmf_example -- scripts/common.sh@553 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:13:51.971 11:24:47 nvmf_tcp.nvmf_target_extra.nvmf_example -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:51.971 11:24:47 nvmf_tcp.nvmf_target_extra.nvmf_example -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:51.971 11:24:47 nvmf_tcp.nvmf_target_extra.nvmf_example -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:51.971 11:24:47 nvmf_tcp.nvmf_target_extra.nvmf_example -- paths/export.sh@5 -- # export PATH 00:13:51.971 11:24:47 nvmf_tcp.nvmf_target_extra.nvmf_example -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:51.971 11:24:47 nvmf_tcp.nvmf_target_extra.nvmf_example -- nvmf/common.sh@51 -- # : 0 00:13:51.971 11:24:47 nvmf_tcp.nvmf_target_extra.nvmf_example -- nvmf/common.sh@52 -- # export NVMF_APP_SHM_ID 00:13:51.971 11:24:47 nvmf_tcp.nvmf_target_extra.nvmf_example -- nvmf/common.sh@53 -- # build_nvmf_app_args 00:13:51.971 11:24:47 nvmf_tcp.nvmf_target_extra.nvmf_example -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:13:51.971 11:24:47 nvmf_tcp.nvmf_target_extra.nvmf_example -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:13:51.971 11:24:47 nvmf_tcp.nvmf_target_extra.nvmf_example -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:13:51.971 11:24:47 nvmf_tcp.nvmf_target_extra.nvmf_example -- nvmf/common.sh@33 -- # '[' '' -eq 1 ']' 00:13:51.971 /home/vagrant/spdk_repo/spdk/test/nvmf/common.sh: line 33: [: : integer expression expected 00:13:51.971 11:24:47 nvmf_tcp.nvmf_target_extra.nvmf_example -- nvmf/common.sh@37 -- # '[' -n '' ']' 00:13:51.971 11:24:47 nvmf_tcp.nvmf_target_extra.nvmf_example -- nvmf/common.sh@39 -- # '[' 0 -eq 1 ']' 00:13:51.971 11:24:47 nvmf_tcp.nvmf_target_extra.nvmf_example -- nvmf/common.sh@55 -- # have_pci_nics=0 00:13:51.971 11:24:47 nvmf_tcp.nvmf_target_extra.nvmf_example -- target/nvmf_example.sh@11 -- # NVMF_EXAMPLE=("$SPDK_EXAMPLE_DIR/nvmf") 00:13:51.971 11:24:47 nvmf_tcp.nvmf_target_extra.nvmf_example -- target/nvmf_example.sh@13 -- # MALLOC_BDEV_SIZE=64 00:13:51.971 11:24:47 nvmf_tcp.nvmf_target_extra.nvmf_example -- target/nvmf_example.sh@14 -- # MALLOC_BLOCK_SIZE=512 00:13:51.971 11:24:47 nvmf_tcp.nvmf_target_extra.nvmf_example -- target/nvmf_example.sh@24 -- # build_nvmf_example_args 00:13:51.971 11:24:47 nvmf_tcp.nvmf_target_extra.nvmf_example -- target/nvmf_example.sh@17 -- # '[' 0 -eq 1 ']' 00:13:51.971 11:24:47 nvmf_tcp.nvmf_target_extra.nvmf_example -- target/nvmf_example.sh@20 -- # NVMF_EXAMPLE+=(-i "$NVMF_APP_SHM_ID" -g 10000) 00:13:51.971 11:24:47 nvmf_tcp.nvmf_target_extra.nvmf_example -- target/nvmf_example.sh@21 -- # NVMF_EXAMPLE+=("${NO_HUGE[@]}") 00:13:51.971 11:24:47 nvmf_tcp.nvmf_target_extra.nvmf_example -- target/nvmf_example.sh@40 -- # timing_enter nvmf_example_test 00:13:51.971 11:24:47 nvmf_tcp.nvmf_target_extra.nvmf_example -- common/autotest_common.sh@724 -- # xtrace_disable 00:13:51.971 11:24:47 nvmf_tcp.nvmf_target_extra.nvmf_example -- common/autotest_common.sh@10 -- # set +x 00:13:52.230 11:24:47 nvmf_tcp.nvmf_target_extra.nvmf_example -- target/nvmf_example.sh@41 -- # nvmftestinit 00:13:52.230 11:24:47 nvmf_tcp.nvmf_target_extra.nvmf_example -- nvmf/common.sh@467 -- # '[' -z tcp ']' 00:13:52.230 11:24:47 nvmf_tcp.nvmf_target_extra.nvmf_example -- nvmf/common.sh@472 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:13:52.230 11:24:47 nvmf_tcp.nvmf_target_extra.nvmf_example -- nvmf/common.sh@474 -- # prepare_net_devs 00:13:52.230 11:24:47 nvmf_tcp.nvmf_target_extra.nvmf_example -- nvmf/common.sh@436 -- # local -g is_hw=no 00:13:52.230 11:24:47 nvmf_tcp.nvmf_target_extra.nvmf_example -- nvmf/common.sh@438 -- # remove_spdk_ns 00:13:52.230 11:24:47 nvmf_tcp.nvmf_target_extra.nvmf_example -- nvmf/common.sh@654 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:13:52.230 11:24:47 nvmf_tcp.nvmf_target_extra.nvmf_example -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 15> /dev/null' 00:13:52.230 11:24:47 nvmf_tcp.nvmf_target_extra.nvmf_example -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:13:52.230 11:24:47 nvmf_tcp.nvmf_target_extra.nvmf_example -- nvmf/common.sh@440 -- # [[ virt != virt ]] 00:13:52.230 11:24:47 nvmf_tcp.nvmf_target_extra.nvmf_example -- nvmf/common.sh@442 -- # [[ no == yes ]] 00:13:52.230 11:24:47 nvmf_tcp.nvmf_target_extra.nvmf_example -- nvmf/common.sh@449 -- # [[ virt == phy ]] 00:13:52.230 11:24:47 nvmf_tcp.nvmf_target_extra.nvmf_example -- nvmf/common.sh@452 -- # [[ virt == phy-fallback ]] 00:13:52.230 11:24:47 nvmf_tcp.nvmf_target_extra.nvmf_example -- nvmf/common.sh@457 -- # [[ tcp == tcp ]] 00:13:52.230 11:24:47 nvmf_tcp.nvmf_target_extra.nvmf_example -- nvmf/common.sh@458 -- # nvmf_veth_init 00:13:52.230 11:24:47 nvmf_tcp.nvmf_target_extra.nvmf_example -- nvmf/common.sh@145 -- # NVMF_FIRST_INITIATOR_IP=10.0.0.1 00:13:52.230 11:24:47 nvmf_tcp.nvmf_target_extra.nvmf_example -- nvmf/common.sh@146 -- # NVMF_SECOND_INITIATOR_IP=10.0.0.2 00:13:52.230 11:24:47 nvmf_tcp.nvmf_target_extra.nvmf_example -- nvmf/common.sh@147 -- # NVMF_FIRST_TARGET_IP=10.0.0.3 00:13:52.230 11:24:47 nvmf_tcp.nvmf_target_extra.nvmf_example -- nvmf/common.sh@148 -- # NVMF_SECOND_TARGET_IP=10.0.0.4 00:13:52.230 11:24:47 nvmf_tcp.nvmf_target_extra.nvmf_example -- nvmf/common.sh@149 -- # NVMF_INITIATOR_IP=10.0.0.1 00:13:52.230 11:24:47 nvmf_tcp.nvmf_target_extra.nvmf_example -- nvmf/common.sh@150 -- # NVMF_BRIDGE=nvmf_br 00:13:52.230 11:24:47 nvmf_tcp.nvmf_target_extra.nvmf_example -- nvmf/common.sh@151 -- # NVMF_INITIATOR_INTERFACE=nvmf_init_if 00:13:52.230 11:24:47 nvmf_tcp.nvmf_target_extra.nvmf_example -- nvmf/common.sh@152 -- # NVMF_INITIATOR_INTERFACE2=nvmf_init_if2 00:13:52.230 11:24:47 nvmf_tcp.nvmf_target_extra.nvmf_example -- nvmf/common.sh@153 -- # NVMF_INITIATOR_BRIDGE=nvmf_init_br 00:13:52.230 11:24:47 nvmf_tcp.nvmf_target_extra.nvmf_example -- nvmf/common.sh@154 -- # NVMF_INITIATOR_BRIDGE2=nvmf_init_br2 00:13:52.230 11:24:47 nvmf_tcp.nvmf_target_extra.nvmf_example -- nvmf/common.sh@155 -- # NVMF_TARGET_NAMESPACE=nvmf_tgt_ns_spdk 00:13:52.230 11:24:47 nvmf_tcp.nvmf_target_extra.nvmf_example -- nvmf/common.sh@156 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:13:52.230 11:24:47 nvmf_tcp.nvmf_target_extra.nvmf_example -- nvmf/common.sh@157 -- # NVMF_TARGET_INTERFACE=nvmf_tgt_if 00:13:52.230 11:24:47 nvmf_tcp.nvmf_target_extra.nvmf_example -- nvmf/common.sh@158 -- # NVMF_TARGET_INTERFACE2=nvmf_tgt_if2 00:13:52.230 11:24:47 nvmf_tcp.nvmf_target_extra.nvmf_example -- nvmf/common.sh@159 -- # NVMF_TARGET_BRIDGE=nvmf_tgt_br 00:13:52.230 11:24:47 nvmf_tcp.nvmf_target_extra.nvmf_example -- nvmf/common.sh@160 -- # NVMF_TARGET_BRIDGE2=nvmf_tgt_br2 00:13:52.230 11:24:47 nvmf_tcp.nvmf_target_extra.nvmf_example -- nvmf/common.sh@162 -- # ip link set nvmf_init_br nomaster 00:13:52.230 Cannot find device "nvmf_init_br" 00:13:52.230 11:24:47 nvmf_tcp.nvmf_target_extra.nvmf_example -- nvmf/common.sh@162 -- # true 00:13:52.230 11:24:47 nvmf_tcp.nvmf_target_extra.nvmf_example -- nvmf/common.sh@163 -- # ip link set nvmf_init_br2 nomaster 00:13:52.230 Cannot find device "nvmf_init_br2" 00:13:52.230 11:24:47 nvmf_tcp.nvmf_target_extra.nvmf_example -- nvmf/common.sh@163 -- # true 00:13:52.230 11:24:47 nvmf_tcp.nvmf_target_extra.nvmf_example -- nvmf/common.sh@164 -- # ip link set nvmf_tgt_br nomaster 00:13:52.230 Cannot find device "nvmf_tgt_br" 00:13:52.230 11:24:47 nvmf_tcp.nvmf_target_extra.nvmf_example -- nvmf/common.sh@164 -- # true 00:13:52.230 11:24:47 nvmf_tcp.nvmf_target_extra.nvmf_example -- nvmf/common.sh@165 -- # ip link set nvmf_tgt_br2 nomaster 00:13:52.230 Cannot find device "nvmf_tgt_br2" 00:13:52.230 11:24:47 nvmf_tcp.nvmf_target_extra.nvmf_example -- nvmf/common.sh@165 -- # true 00:13:52.230 11:24:47 nvmf_tcp.nvmf_target_extra.nvmf_example -- nvmf/common.sh@166 -- # ip link set nvmf_init_br down 00:13:52.230 Cannot find device "nvmf_init_br" 00:13:52.230 11:24:47 nvmf_tcp.nvmf_target_extra.nvmf_example -- nvmf/common.sh@166 -- # true 00:13:52.230 11:24:47 nvmf_tcp.nvmf_target_extra.nvmf_example -- nvmf/common.sh@167 -- # ip link set nvmf_init_br2 down 00:13:52.230 Cannot find device "nvmf_init_br2" 00:13:52.230 11:24:47 nvmf_tcp.nvmf_target_extra.nvmf_example -- nvmf/common.sh@167 -- # true 00:13:52.230 11:24:47 nvmf_tcp.nvmf_target_extra.nvmf_example -- nvmf/common.sh@168 -- # ip link set nvmf_tgt_br down 00:13:52.230 Cannot find device "nvmf_tgt_br" 00:13:52.230 11:24:47 nvmf_tcp.nvmf_target_extra.nvmf_example -- nvmf/common.sh@168 -- # true 00:13:52.230 11:24:47 nvmf_tcp.nvmf_target_extra.nvmf_example -- nvmf/common.sh@169 -- # ip link set nvmf_tgt_br2 down 00:13:52.230 Cannot find device "nvmf_tgt_br2" 00:13:52.230 11:24:47 nvmf_tcp.nvmf_target_extra.nvmf_example -- nvmf/common.sh@169 -- # true 00:13:52.230 11:24:47 nvmf_tcp.nvmf_target_extra.nvmf_example -- nvmf/common.sh@170 -- # ip link delete nvmf_br type bridge 00:13:52.230 Cannot find device "nvmf_br" 00:13:52.230 11:24:47 nvmf_tcp.nvmf_target_extra.nvmf_example -- nvmf/common.sh@170 -- # true 00:13:52.230 11:24:47 nvmf_tcp.nvmf_target_extra.nvmf_example -- nvmf/common.sh@171 -- # ip link delete nvmf_init_if 00:13:52.230 Cannot find device "nvmf_init_if" 00:13:52.230 11:24:47 nvmf_tcp.nvmf_target_extra.nvmf_example -- nvmf/common.sh@171 -- # true 00:13:52.230 11:24:47 nvmf_tcp.nvmf_target_extra.nvmf_example -- nvmf/common.sh@172 -- # ip link delete nvmf_init_if2 00:13:52.230 Cannot find device "nvmf_init_if2" 00:13:52.230 11:24:47 nvmf_tcp.nvmf_target_extra.nvmf_example -- nvmf/common.sh@172 -- # true 00:13:52.230 11:24:47 nvmf_tcp.nvmf_target_extra.nvmf_example -- nvmf/common.sh@173 -- # ip netns exec nvmf_tgt_ns_spdk ip link delete nvmf_tgt_if 00:13:52.230 Cannot open network namespace "nvmf_tgt_ns_spdk": No such file or directory 00:13:52.230 11:24:47 nvmf_tcp.nvmf_target_extra.nvmf_example -- nvmf/common.sh@173 -- # true 00:13:52.230 11:24:47 nvmf_tcp.nvmf_target_extra.nvmf_example -- nvmf/common.sh@174 -- # ip netns exec nvmf_tgt_ns_spdk ip link delete nvmf_tgt_if2 00:13:52.230 Cannot open network namespace "nvmf_tgt_ns_spdk": No such file or directory 00:13:52.230 11:24:47 nvmf_tcp.nvmf_target_extra.nvmf_example -- nvmf/common.sh@174 -- # true 00:13:52.230 11:24:47 nvmf_tcp.nvmf_target_extra.nvmf_example -- nvmf/common.sh@177 -- # ip netns add nvmf_tgt_ns_spdk 00:13:52.230 11:24:47 nvmf_tcp.nvmf_target_extra.nvmf_example -- nvmf/common.sh@180 -- # ip link add nvmf_init_if type veth peer name nvmf_init_br 00:13:52.230 11:24:47 nvmf_tcp.nvmf_target_extra.nvmf_example -- nvmf/common.sh@181 -- # ip link add nvmf_init_if2 type veth peer name nvmf_init_br2 00:13:52.230 11:24:47 nvmf_tcp.nvmf_target_extra.nvmf_example -- nvmf/common.sh@182 -- # ip link add nvmf_tgt_if type veth peer name nvmf_tgt_br 00:13:52.230 11:24:47 nvmf_tcp.nvmf_target_extra.nvmf_example -- nvmf/common.sh@183 -- # ip link add nvmf_tgt_if2 type veth peer name nvmf_tgt_br2 00:13:52.230 11:24:47 nvmf_tcp.nvmf_target_extra.nvmf_example -- nvmf/common.sh@186 -- # ip link set nvmf_tgt_if netns nvmf_tgt_ns_spdk 00:13:52.230 11:24:47 nvmf_tcp.nvmf_target_extra.nvmf_example -- nvmf/common.sh@187 -- # ip link set nvmf_tgt_if2 netns nvmf_tgt_ns_spdk 00:13:52.489 11:24:47 nvmf_tcp.nvmf_target_extra.nvmf_example -- nvmf/common.sh@190 -- # ip addr add 10.0.0.1/24 dev nvmf_init_if 00:13:52.489 11:24:47 nvmf_tcp.nvmf_target_extra.nvmf_example -- nvmf/common.sh@191 -- # ip addr add 10.0.0.2/24 dev nvmf_init_if2 00:13:52.489 11:24:47 nvmf_tcp.nvmf_target_extra.nvmf_example -- nvmf/common.sh@192 -- # ip netns exec nvmf_tgt_ns_spdk ip addr add 10.0.0.3/24 dev nvmf_tgt_if 00:13:52.489 11:24:47 nvmf_tcp.nvmf_target_extra.nvmf_example -- nvmf/common.sh@193 -- # ip netns exec nvmf_tgt_ns_spdk ip addr add 10.0.0.4/24 dev nvmf_tgt_if2 00:13:52.489 11:24:47 nvmf_tcp.nvmf_target_extra.nvmf_example -- nvmf/common.sh@196 -- # ip link set nvmf_init_if up 00:13:52.489 11:24:47 nvmf_tcp.nvmf_target_extra.nvmf_example -- nvmf/common.sh@197 -- # ip link set nvmf_init_if2 up 00:13:52.489 11:24:47 nvmf_tcp.nvmf_target_extra.nvmf_example -- nvmf/common.sh@198 -- # ip link set nvmf_init_br up 00:13:52.489 11:24:47 nvmf_tcp.nvmf_target_extra.nvmf_example -- nvmf/common.sh@199 -- # ip link set nvmf_init_br2 up 00:13:52.489 11:24:47 nvmf_tcp.nvmf_target_extra.nvmf_example -- nvmf/common.sh@200 -- # ip link set nvmf_tgt_br up 00:13:52.489 11:24:47 nvmf_tcp.nvmf_target_extra.nvmf_example -- nvmf/common.sh@201 -- # ip link set nvmf_tgt_br2 up 00:13:52.489 11:24:47 nvmf_tcp.nvmf_target_extra.nvmf_example -- nvmf/common.sh@202 -- # ip netns exec nvmf_tgt_ns_spdk ip link set nvmf_tgt_if up 00:13:52.489 11:24:47 nvmf_tcp.nvmf_target_extra.nvmf_example -- nvmf/common.sh@203 -- # ip netns exec nvmf_tgt_ns_spdk ip link set nvmf_tgt_if2 up 00:13:52.489 11:24:47 nvmf_tcp.nvmf_target_extra.nvmf_example -- nvmf/common.sh@204 -- # ip netns exec nvmf_tgt_ns_spdk ip link set lo up 00:13:52.489 11:24:47 nvmf_tcp.nvmf_target_extra.nvmf_example -- nvmf/common.sh@207 -- # ip link add nvmf_br type bridge 00:13:52.489 11:24:47 nvmf_tcp.nvmf_target_extra.nvmf_example -- nvmf/common.sh@208 -- # ip link set nvmf_br up 00:13:52.489 11:24:47 nvmf_tcp.nvmf_target_extra.nvmf_example -- nvmf/common.sh@211 -- # ip link set nvmf_init_br master nvmf_br 00:13:52.489 11:24:47 nvmf_tcp.nvmf_target_extra.nvmf_example -- nvmf/common.sh@212 -- # ip link set nvmf_init_br2 master nvmf_br 00:13:52.489 11:24:47 nvmf_tcp.nvmf_target_extra.nvmf_example -- nvmf/common.sh@213 -- # ip link set nvmf_tgt_br master nvmf_br 00:13:52.489 11:24:47 nvmf_tcp.nvmf_target_extra.nvmf_example -- nvmf/common.sh@214 -- # ip link set nvmf_tgt_br2 master nvmf_br 00:13:52.489 11:24:47 nvmf_tcp.nvmf_target_extra.nvmf_example -- nvmf/common.sh@217 -- # ipts -I INPUT 1 -i nvmf_init_if -p tcp --dport 4420 -j ACCEPT 00:13:52.489 11:24:47 nvmf_tcp.nvmf_target_extra.nvmf_example -- nvmf/common.sh@788 -- # iptables -I INPUT 1 -i nvmf_init_if -p tcp --dport 4420 -j ACCEPT -m comment --comment 'SPDK_NVMF:-I INPUT 1 -i nvmf_init_if -p tcp --dport 4420 -j ACCEPT' 00:13:52.489 11:24:47 nvmf_tcp.nvmf_target_extra.nvmf_example -- nvmf/common.sh@218 -- # ipts -I INPUT 1 -i nvmf_init_if2 -p tcp --dport 4420 -j ACCEPT 00:13:52.489 11:24:47 nvmf_tcp.nvmf_target_extra.nvmf_example -- nvmf/common.sh@788 -- # iptables -I INPUT 1 -i nvmf_init_if2 -p tcp --dport 4420 -j ACCEPT -m comment --comment 'SPDK_NVMF:-I INPUT 1 -i nvmf_init_if2 -p tcp --dport 4420 -j ACCEPT' 00:13:52.489 11:24:47 nvmf_tcp.nvmf_target_extra.nvmf_example -- nvmf/common.sh@219 -- # ipts -A FORWARD -i nvmf_br -o nvmf_br -j ACCEPT 00:13:52.489 11:24:47 nvmf_tcp.nvmf_target_extra.nvmf_example -- nvmf/common.sh@788 -- # iptables -A FORWARD -i nvmf_br -o nvmf_br -j ACCEPT -m comment --comment 'SPDK_NVMF:-A FORWARD -i nvmf_br -o nvmf_br -j ACCEPT' 00:13:52.489 11:24:47 nvmf_tcp.nvmf_target_extra.nvmf_example -- nvmf/common.sh@222 -- # ping -c 1 10.0.0.3 00:13:52.489 PING 10.0.0.3 (10.0.0.3) 56(84) bytes of data. 00:13:52.489 64 bytes from 10.0.0.3: icmp_seq=1 ttl=64 time=0.083 ms 00:13:52.489 00:13:52.489 --- 10.0.0.3 ping statistics --- 00:13:52.489 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:13:52.489 rtt min/avg/max/mdev = 0.083/0.083/0.083/0.000 ms 00:13:52.489 11:24:47 nvmf_tcp.nvmf_target_extra.nvmf_example -- nvmf/common.sh@223 -- # ping -c 1 10.0.0.4 00:13:52.489 PING 10.0.0.4 (10.0.0.4) 56(84) bytes of data. 00:13:52.489 64 bytes from 10.0.0.4: icmp_seq=1 ttl=64 time=0.080 ms 00:13:52.489 00:13:52.489 --- 10.0.0.4 ping statistics --- 00:13:52.489 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:13:52.489 rtt min/avg/max/mdev = 0.080/0.080/0.080/0.000 ms 00:13:52.490 11:24:47 nvmf_tcp.nvmf_target_extra.nvmf_example -- nvmf/common.sh@224 -- # ip netns exec nvmf_tgt_ns_spdk ping -c 1 10.0.0.1 00:13:52.490 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:13:52.490 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.047 ms 00:13:52.490 00:13:52.490 --- 10.0.0.1 ping statistics --- 00:13:52.490 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:13:52.490 rtt min/avg/max/mdev = 0.047/0.047/0.047/0.000 ms 00:13:52.490 11:24:47 nvmf_tcp.nvmf_target_extra.nvmf_example -- nvmf/common.sh@225 -- # ip netns exec nvmf_tgt_ns_spdk ping -c 1 10.0.0.2 00:13:52.490 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:13:52.490 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.052 ms 00:13:52.490 00:13:52.490 --- 10.0.0.2 ping statistics --- 00:13:52.490 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:13:52.490 rtt min/avg/max/mdev = 0.052/0.052/0.052/0.000 ms 00:13:52.490 11:24:47 nvmf_tcp.nvmf_target_extra.nvmf_example -- nvmf/common.sh@227 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:13:52.490 11:24:47 nvmf_tcp.nvmf_target_extra.nvmf_example -- nvmf/common.sh@459 -- # return 0 00:13:52.490 11:24:47 nvmf_tcp.nvmf_target_extra.nvmf_example -- nvmf/common.sh@476 -- # '[' '' == iso ']' 00:13:52.490 11:24:47 nvmf_tcp.nvmf_target_extra.nvmf_example -- nvmf/common.sh@480 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:13:52.490 11:24:47 nvmf_tcp.nvmf_target_extra.nvmf_example -- nvmf/common.sh@481 -- # [[ tcp == \r\d\m\a ]] 00:13:52.490 11:24:47 nvmf_tcp.nvmf_target_extra.nvmf_example -- nvmf/common.sh@490 -- # [[ tcp == \t\c\p ]] 00:13:52.490 11:24:47 nvmf_tcp.nvmf_target_extra.nvmf_example -- nvmf/common.sh@491 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:13:52.490 11:24:47 nvmf_tcp.nvmf_target_extra.nvmf_example -- nvmf/common.sh@494 -- # '[' tcp == tcp ']' 00:13:52.490 11:24:47 nvmf_tcp.nvmf_target_extra.nvmf_example -- nvmf/common.sh@500 -- # modprobe nvme-tcp 00:13:52.490 11:24:47 nvmf_tcp.nvmf_target_extra.nvmf_example -- target/nvmf_example.sh@42 -- # nvmfexamplestart '-m 0xF' 00:13:52.490 11:24:47 nvmf_tcp.nvmf_target_extra.nvmf_example -- target/nvmf_example.sh@27 -- # timing_enter start_nvmf_example 00:13:52.490 11:24:47 nvmf_tcp.nvmf_target_extra.nvmf_example -- common/autotest_common.sh@724 -- # xtrace_disable 00:13:52.490 11:24:47 nvmf_tcp.nvmf_target_extra.nvmf_example -- common/autotest_common.sh@10 -- # set +x 00:13:52.490 11:24:47 nvmf_tcp.nvmf_target_extra.nvmf_example -- target/nvmf_example.sh@29 -- # '[' tcp == tcp ']' 00:13:52.490 11:24:47 nvmf_tcp.nvmf_target_extra.nvmf_example -- target/nvmf_example.sh@30 -- # NVMF_EXAMPLE=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_EXAMPLE[@]}") 00:13:52.490 11:24:47 nvmf_tcp.nvmf_target_extra.nvmf_example -- target/nvmf_example.sh@34 -- # nvmfpid=71529 00:13:52.490 11:24:47 nvmf_tcp.nvmf_target_extra.nvmf_example -- target/nvmf_example.sh@33 -- # ip netns exec nvmf_tgt_ns_spdk /home/vagrant/spdk_repo/spdk/build/examples/nvmf -i 0 -g 10000 -m 0xF 00:13:52.490 11:24:47 nvmf_tcp.nvmf_target_extra.nvmf_example -- target/nvmf_example.sh@35 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:13:52.490 11:24:47 nvmf_tcp.nvmf_target_extra.nvmf_example -- target/nvmf_example.sh@36 -- # waitforlisten 71529 00:13:52.490 11:24:47 nvmf_tcp.nvmf_target_extra.nvmf_example -- common/autotest_common.sh@831 -- # '[' -z 71529 ']' 00:13:52.490 11:24:47 nvmf_tcp.nvmf_target_extra.nvmf_example -- common/autotest_common.sh@835 -- # local rpc_addr=/var/tmp/spdk.sock 00:13:52.490 11:24:47 nvmf_tcp.nvmf_target_extra.nvmf_example -- common/autotest_common.sh@836 -- # local max_retries=100 00:13:52.490 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:13:52.490 11:24:47 nvmf_tcp.nvmf_target_extra.nvmf_example -- common/autotest_common.sh@838 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:13:52.490 11:24:47 nvmf_tcp.nvmf_target_extra.nvmf_example -- common/autotest_common.sh@840 -- # xtrace_disable 00:13:52.490 11:24:47 nvmf_tcp.nvmf_target_extra.nvmf_example -- common/autotest_common.sh@10 -- # set +x 00:13:53.863 11:24:49 nvmf_tcp.nvmf_target_extra.nvmf_example -- common/autotest_common.sh@860 -- # (( i == 0 )) 00:13:53.863 11:24:49 nvmf_tcp.nvmf_target_extra.nvmf_example -- common/autotest_common.sh@864 -- # return 0 00:13:53.863 11:24:49 nvmf_tcp.nvmf_target_extra.nvmf_example -- target/nvmf_example.sh@37 -- # timing_exit start_nvmf_example 00:13:53.863 11:24:49 nvmf_tcp.nvmf_target_extra.nvmf_example -- common/autotest_common.sh@730 -- # xtrace_disable 00:13:53.863 11:24:49 nvmf_tcp.nvmf_target_extra.nvmf_example -- common/autotest_common.sh@10 -- # set +x 00:13:53.863 11:24:49 nvmf_tcp.nvmf_target_extra.nvmf_example -- target/nvmf_example.sh@45 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:13:53.863 11:24:49 nvmf_tcp.nvmf_target_extra.nvmf_example -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:53.863 11:24:49 nvmf_tcp.nvmf_target_extra.nvmf_example -- common/autotest_common.sh@10 -- # set +x 00:13:53.863 11:24:49 nvmf_tcp.nvmf_target_extra.nvmf_example -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:53.863 11:24:49 nvmf_tcp.nvmf_target_extra.nvmf_example -- target/nvmf_example.sh@47 -- # rpc_cmd bdev_malloc_create 64 512 00:13:53.864 11:24:49 nvmf_tcp.nvmf_target_extra.nvmf_example -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:53.864 11:24:49 nvmf_tcp.nvmf_target_extra.nvmf_example -- common/autotest_common.sh@10 -- # set +x 00:13:53.864 11:24:49 nvmf_tcp.nvmf_target_extra.nvmf_example -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:53.864 11:24:49 nvmf_tcp.nvmf_target_extra.nvmf_example -- target/nvmf_example.sh@47 -- # malloc_bdevs='Malloc0 ' 00:13:53.864 11:24:49 nvmf_tcp.nvmf_target_extra.nvmf_example -- target/nvmf_example.sh@49 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:13:53.864 11:24:49 nvmf_tcp.nvmf_target_extra.nvmf_example -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:53.864 11:24:49 nvmf_tcp.nvmf_target_extra.nvmf_example -- common/autotest_common.sh@10 -- # set +x 00:13:53.864 11:24:49 nvmf_tcp.nvmf_target_extra.nvmf_example -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:53.864 11:24:49 nvmf_tcp.nvmf_target_extra.nvmf_example -- target/nvmf_example.sh@52 -- # for malloc_bdev in $malloc_bdevs 00:13:53.864 11:24:49 nvmf_tcp.nvmf_target_extra.nvmf_example -- target/nvmf_example.sh@53 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:13:53.864 11:24:49 nvmf_tcp.nvmf_target_extra.nvmf_example -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:53.864 11:24:49 nvmf_tcp.nvmf_target_extra.nvmf_example -- common/autotest_common.sh@10 -- # set +x 00:13:53.864 11:24:49 nvmf_tcp.nvmf_target_extra.nvmf_example -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:53.864 11:24:49 nvmf_tcp.nvmf_target_extra.nvmf_example -- target/nvmf_example.sh@57 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.3 -s 4420 00:13:53.864 11:24:49 nvmf_tcp.nvmf_target_extra.nvmf_example -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:53.864 11:24:49 nvmf_tcp.nvmf_target_extra.nvmf_example -- common/autotest_common.sh@10 -- # set +x 00:13:53.864 11:24:49 nvmf_tcp.nvmf_target_extra.nvmf_example -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:53.864 11:24:49 nvmf_tcp.nvmf_target_extra.nvmf_example -- target/nvmf_example.sh@59 -- # perf=/home/vagrant/spdk_repo/spdk/build/bin/spdk_nvme_perf 00:13:53.864 11:24:49 nvmf_tcp.nvmf_target_extra.nvmf_example -- target/nvmf_example.sh@61 -- # /home/vagrant/spdk_repo/spdk/build/bin/spdk_nvme_perf -q 64 -o 4096 -w randrw -M 30 -t 10 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.3 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1' 00:14:06.092 Initializing NVMe Controllers 00:14:06.092 Attached to NVMe over Fabrics controller at 10.0.0.3:4420: nqn.2016-06.io.spdk:cnode1 00:14:06.092 Associating TCP (addr:10.0.0.3 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:14:06.092 Initialization complete. Launching workers. 00:14:06.092 ======================================================== 00:14:06.092 Latency(us) 00:14:06.092 Device Information : IOPS MiB/s Average min max 00:14:06.092 TCP (addr:10.0.0.3 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 14613.60 57.08 4381.33 757.67 22209.79 00:14:06.092 ======================================================== 00:14:06.092 Total : 14613.60 57.08 4381.33 757.67 22209.79 00:14:06.092 00:14:06.092 11:24:59 nvmf_tcp.nvmf_target_extra.nvmf_example -- target/nvmf_example.sh@65 -- # trap - SIGINT SIGTERM EXIT 00:14:06.092 11:24:59 nvmf_tcp.nvmf_target_extra.nvmf_example -- target/nvmf_example.sh@66 -- # nvmftestfini 00:14:06.092 11:24:59 nvmf_tcp.nvmf_target_extra.nvmf_example -- nvmf/common.sh@514 -- # nvmfcleanup 00:14:06.092 11:24:59 nvmf_tcp.nvmf_target_extra.nvmf_example -- nvmf/common.sh@121 -- # sync 00:14:06.092 11:24:59 nvmf_tcp.nvmf_target_extra.nvmf_example -- nvmf/common.sh@123 -- # '[' tcp == tcp ']' 00:14:06.092 11:24:59 nvmf_tcp.nvmf_target_extra.nvmf_example -- nvmf/common.sh@124 -- # set +e 00:14:06.092 11:24:59 nvmf_tcp.nvmf_target_extra.nvmf_example -- nvmf/common.sh@125 -- # for i in {1..20} 00:14:06.092 11:24:59 nvmf_tcp.nvmf_target_extra.nvmf_example -- nvmf/common.sh@126 -- # modprobe -v -r nvme-tcp 00:14:06.092 rmmod nvme_tcp 00:14:06.092 rmmod nvme_fabrics 00:14:06.092 rmmod nvme_keyring 00:14:06.092 11:24:59 nvmf_tcp.nvmf_target_extra.nvmf_example -- nvmf/common.sh@127 -- # modprobe -v -r nvme-fabrics 00:14:06.092 11:24:59 nvmf_tcp.nvmf_target_extra.nvmf_example -- nvmf/common.sh@128 -- # set -e 00:14:06.092 11:24:59 nvmf_tcp.nvmf_target_extra.nvmf_example -- nvmf/common.sh@129 -- # return 0 00:14:06.092 11:24:59 nvmf_tcp.nvmf_target_extra.nvmf_example -- nvmf/common.sh@515 -- # '[' -n 71529 ']' 00:14:06.092 11:24:59 nvmf_tcp.nvmf_target_extra.nvmf_example -- nvmf/common.sh@516 -- # killprocess 71529 00:14:06.092 11:24:59 nvmf_tcp.nvmf_target_extra.nvmf_example -- common/autotest_common.sh@950 -- # '[' -z 71529 ']' 00:14:06.092 11:24:59 nvmf_tcp.nvmf_target_extra.nvmf_example -- common/autotest_common.sh@954 -- # kill -0 71529 00:14:06.092 11:24:59 nvmf_tcp.nvmf_target_extra.nvmf_example -- common/autotest_common.sh@955 -- # uname 00:14:06.092 11:24:59 nvmf_tcp.nvmf_target_extra.nvmf_example -- common/autotest_common.sh@955 -- # '[' Linux = Linux ']' 00:14:06.092 11:24:59 nvmf_tcp.nvmf_target_extra.nvmf_example -- common/autotest_common.sh@956 -- # ps --no-headers -o comm= 71529 00:14:06.092 11:24:59 nvmf_tcp.nvmf_target_extra.nvmf_example -- common/autotest_common.sh@956 -- # process_name=nvmf 00:14:06.092 11:24:59 nvmf_tcp.nvmf_target_extra.nvmf_example -- common/autotest_common.sh@960 -- # '[' nvmf = sudo ']' 00:14:06.092 killing process with pid 71529 00:14:06.092 11:24:59 nvmf_tcp.nvmf_target_extra.nvmf_example -- common/autotest_common.sh@968 -- # echo 'killing process with pid 71529' 00:14:06.092 11:24:59 nvmf_tcp.nvmf_target_extra.nvmf_example -- common/autotest_common.sh@969 -- # kill 71529 00:14:06.092 11:24:59 nvmf_tcp.nvmf_target_extra.nvmf_example -- common/autotest_common.sh@974 -- # wait 71529 00:14:06.092 nvmf threads initialize successfully 00:14:06.092 bdev subsystem init successfully 00:14:06.092 created a nvmf target service 00:14:06.092 create targets's poll groups done 00:14:06.092 all subsystems of target started 00:14:06.092 nvmf target is running 00:14:06.092 all subsystems of target stopped 00:14:06.092 destroy targets's poll groups done 00:14:06.092 destroyed the nvmf target service 00:14:06.092 bdev subsystem finish successfully 00:14:06.092 nvmf threads destroy successfully 00:14:06.092 11:24:59 nvmf_tcp.nvmf_target_extra.nvmf_example -- nvmf/common.sh@518 -- # '[' '' == iso ']' 00:14:06.092 11:24:59 nvmf_tcp.nvmf_target_extra.nvmf_example -- nvmf/common.sh@521 -- # [[ tcp == \t\c\p ]] 00:14:06.092 11:24:59 nvmf_tcp.nvmf_target_extra.nvmf_example -- nvmf/common.sh@522 -- # nvmf_tcp_fini 00:14:06.092 11:24:59 nvmf_tcp.nvmf_target_extra.nvmf_example -- nvmf/common.sh@297 -- # iptr 00:14:06.092 11:24:59 nvmf_tcp.nvmf_target_extra.nvmf_example -- nvmf/common.sh@789 -- # iptables-save 00:14:06.092 11:24:59 nvmf_tcp.nvmf_target_extra.nvmf_example -- nvmf/common.sh@789 -- # iptables-restore 00:14:06.092 11:24:59 nvmf_tcp.nvmf_target_extra.nvmf_example -- nvmf/common.sh@789 -- # grep -v SPDK_NVMF 00:14:06.092 11:24:59 nvmf_tcp.nvmf_target_extra.nvmf_example -- nvmf/common.sh@298 -- # [[ nvmf_tgt_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s\_\s\p\d\k ]] 00:14:06.092 11:24:59 nvmf_tcp.nvmf_target_extra.nvmf_example -- nvmf/common.sh@299 -- # nvmf_veth_fini 00:14:06.092 11:24:59 nvmf_tcp.nvmf_target_extra.nvmf_example -- nvmf/common.sh@233 -- # ip link set nvmf_init_br nomaster 00:14:06.092 11:24:59 nvmf_tcp.nvmf_target_extra.nvmf_example -- nvmf/common.sh@234 -- # ip link set nvmf_init_br2 nomaster 00:14:06.092 11:24:59 nvmf_tcp.nvmf_target_extra.nvmf_example -- nvmf/common.sh@235 -- # ip link set nvmf_tgt_br nomaster 00:14:06.092 11:24:59 nvmf_tcp.nvmf_target_extra.nvmf_example -- nvmf/common.sh@236 -- # ip link set nvmf_tgt_br2 nomaster 00:14:06.092 11:24:59 nvmf_tcp.nvmf_target_extra.nvmf_example -- nvmf/common.sh@237 -- # ip link set nvmf_init_br down 00:14:06.092 11:24:59 nvmf_tcp.nvmf_target_extra.nvmf_example -- nvmf/common.sh@238 -- # ip link set nvmf_init_br2 down 00:14:06.092 11:24:59 nvmf_tcp.nvmf_target_extra.nvmf_example -- nvmf/common.sh@239 -- # ip link set nvmf_tgt_br down 00:14:06.092 11:24:59 nvmf_tcp.nvmf_target_extra.nvmf_example -- nvmf/common.sh@240 -- # ip link set nvmf_tgt_br2 down 00:14:06.092 11:24:59 nvmf_tcp.nvmf_target_extra.nvmf_example -- nvmf/common.sh@241 -- # ip link delete nvmf_br type bridge 00:14:06.092 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_example -- nvmf/common.sh@242 -- # ip link delete nvmf_init_if 00:14:06.092 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_example -- nvmf/common.sh@243 -- # ip link delete nvmf_init_if2 00:14:06.092 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_example -- nvmf/common.sh@244 -- # ip netns exec nvmf_tgt_ns_spdk ip link delete nvmf_tgt_if 00:14:06.092 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_example -- nvmf/common.sh@245 -- # ip netns exec nvmf_tgt_ns_spdk ip link delete nvmf_tgt_if2 00:14:06.092 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_example -- nvmf/common.sh@246 -- # remove_spdk_ns 00:14:06.092 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_example -- nvmf/common.sh@654 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:14:06.092 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_example -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 15> /dev/null' 00:14:06.092 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_example -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:14:06.092 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_example -- nvmf/common.sh@300 -- # return 0 00:14:06.092 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_example -- target/nvmf_example.sh@67 -- # timing_exit nvmf_example_test 00:14:06.092 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_example -- common/autotest_common.sh@730 -- # xtrace_disable 00:14:06.092 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_example -- common/autotest_common.sh@10 -- # set +x 00:14:06.092 00:14:06.092 real 0m12.905s 00:14:06.092 user 0m45.182s 00:14:06.092 sys 0m2.133s 00:14:06.092 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_example -- common/autotest_common.sh@1126 -- # xtrace_disable 00:14:06.092 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_example -- common/autotest_common.sh@10 -- # set +x 00:14:06.092 ************************************ 00:14:06.092 END TEST nvmf_example 00:14:06.092 ************************************ 00:14:06.092 11:25:00 nvmf_tcp.nvmf_target_extra -- nvmf/nvmf_target_extra.sh@17 -- # run_test nvmf_filesystem /home/vagrant/spdk_repo/spdk/test/nvmf/target/filesystem.sh --transport=tcp 00:14:06.092 11:25:00 nvmf_tcp.nvmf_target_extra -- common/autotest_common.sh@1101 -- # '[' 3 -le 1 ']' 00:14:06.092 11:25:00 nvmf_tcp.nvmf_target_extra -- common/autotest_common.sh@1107 -- # xtrace_disable 00:14:06.092 11:25:00 nvmf_tcp.nvmf_target_extra -- common/autotest_common.sh@10 -- # set +x 00:14:06.092 ************************************ 00:14:06.092 START TEST nvmf_filesystem 00:14:06.092 ************************************ 00:14:06.092 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@1125 -- # /home/vagrant/spdk_repo/spdk/test/nvmf/target/filesystem.sh --transport=tcp 00:14:06.092 * Looking for test storage... 00:14:06.092 * Found test storage at /home/vagrant/spdk_repo/spdk/test/nvmf/target 00:14:06.092 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@1680 -- # [[ y == y ]] 00:14:06.092 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@1681 -- # lcov --version 00:14:06.092 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@1681 -- # awk '{print $NF}' 00:14:06.092 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@1681 -- # lt 1.15 2 00:14:06.092 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- scripts/common.sh@373 -- # cmp_versions 1.15 '<' 2 00:14:06.092 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- scripts/common.sh@333 -- # local ver1 ver1_l 00:14:06.092 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- scripts/common.sh@334 -- # local ver2 ver2_l 00:14:06.092 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- scripts/common.sh@336 -- # IFS=.-: 00:14:06.092 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- scripts/common.sh@336 -- # read -ra ver1 00:14:06.092 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- scripts/common.sh@337 -- # IFS=.-: 00:14:06.093 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- scripts/common.sh@337 -- # read -ra ver2 00:14:06.093 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- scripts/common.sh@338 -- # local 'op=<' 00:14:06.093 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- scripts/common.sh@340 -- # ver1_l=2 00:14:06.093 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- scripts/common.sh@341 -- # ver2_l=1 00:14:06.093 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- scripts/common.sh@343 -- # local lt=0 gt=0 eq=0 v 00:14:06.093 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- scripts/common.sh@344 -- # case "$op" in 00:14:06.093 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- scripts/common.sh@345 -- # : 1 00:14:06.093 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- scripts/common.sh@364 -- # (( v = 0 )) 00:14:06.093 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- scripts/common.sh@364 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:14:06.093 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- scripts/common.sh@365 -- # decimal 1 00:14:06.093 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- scripts/common.sh@353 -- # local d=1 00:14:06.093 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- scripts/common.sh@354 -- # [[ 1 =~ ^[0-9]+$ ]] 00:14:06.093 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- scripts/common.sh@355 -- # echo 1 00:14:06.093 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- scripts/common.sh@365 -- # ver1[v]=1 00:14:06.093 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- scripts/common.sh@366 -- # decimal 2 00:14:06.093 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- scripts/common.sh@353 -- # local d=2 00:14:06.093 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- scripts/common.sh@354 -- # [[ 2 =~ ^[0-9]+$ ]] 00:14:06.093 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- scripts/common.sh@355 -- # echo 2 00:14:06.093 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- scripts/common.sh@366 -- # ver2[v]=2 00:14:06.093 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- scripts/common.sh@367 -- # (( ver1[v] > ver2[v] )) 00:14:06.093 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- scripts/common.sh@368 -- # (( ver1[v] < ver2[v] )) 00:14:06.093 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- scripts/common.sh@368 -- # return 0 00:14:06.093 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@1682 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:14:06.093 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@1694 -- # export 'LCOV_OPTS= 00:14:06.093 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:14:06.093 --rc genhtml_branch_coverage=1 00:14:06.093 --rc genhtml_function_coverage=1 00:14:06.093 --rc genhtml_legend=1 00:14:06.093 --rc geninfo_all_blocks=1 00:14:06.093 --rc geninfo_unexecuted_blocks=1 00:14:06.093 00:14:06.093 ' 00:14:06.093 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@1694 -- # LCOV_OPTS=' 00:14:06.093 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:14:06.093 --rc genhtml_branch_coverage=1 00:14:06.093 --rc genhtml_function_coverage=1 00:14:06.093 --rc genhtml_legend=1 00:14:06.093 --rc geninfo_all_blocks=1 00:14:06.093 --rc geninfo_unexecuted_blocks=1 00:14:06.093 00:14:06.093 ' 00:14:06.093 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@1695 -- # export 'LCOV=lcov 00:14:06.093 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:14:06.093 --rc genhtml_branch_coverage=1 00:14:06.093 --rc genhtml_function_coverage=1 00:14:06.093 --rc genhtml_legend=1 00:14:06.093 --rc geninfo_all_blocks=1 00:14:06.093 --rc geninfo_unexecuted_blocks=1 00:14:06.093 00:14:06.093 ' 00:14:06.093 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@1695 -- # LCOV='lcov 00:14:06.093 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:14:06.093 --rc genhtml_branch_coverage=1 00:14:06.093 --rc genhtml_function_coverage=1 00:14:06.093 --rc genhtml_legend=1 00:14:06.093 --rc geninfo_all_blocks=1 00:14:06.093 --rc geninfo_unexecuted_blocks=1 00:14:06.093 00:14:06.093 ' 00:14:06.093 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- target/filesystem.sh@9 -- # source /home/vagrant/spdk_repo/spdk/test/common/autotest_common.sh 00:14:06.093 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@7 -- # rpc_py=rpc_cmd 00:14:06.093 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@34 -- # set -e 00:14:06.093 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@35 -- # shopt -s nullglob 00:14:06.093 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@36 -- # shopt -s extglob 00:14:06.093 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@37 -- # shopt -s inherit_errexit 00:14:06.093 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@39 -- # '[' -z /home/vagrant/spdk_repo/spdk/../output ']' 00:14:06.093 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@44 -- # [[ -e /home/vagrant/spdk_repo/spdk/test/common/build_config.sh ]] 00:14:06.093 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@45 -- # source /home/vagrant/spdk_repo/spdk/test/common/build_config.sh 00:14:06.093 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/build_config.sh@1 -- # CONFIG_WPDK_DIR= 00:14:06.093 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/build_config.sh@2 -- # CONFIG_ASAN=n 00:14:06.093 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/build_config.sh@3 -- # CONFIG_VBDEV_COMPRESS=n 00:14:06.093 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/build_config.sh@4 -- # CONFIG_HAVE_EXECINFO_H=y 00:14:06.093 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/build_config.sh@5 -- # CONFIG_USDT=y 00:14:06.093 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/build_config.sh@6 -- # CONFIG_CUSTOMOCF=n 00:14:06.093 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/build_config.sh@7 -- # CONFIG_PREFIX=/usr/local 00:14:06.093 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/build_config.sh@8 -- # CONFIG_RBD=n 00:14:06.093 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/build_config.sh@9 -- # CONFIG_LIBDIR= 00:14:06.093 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/build_config.sh@10 -- # CONFIG_IDXD=y 00:14:06.093 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/build_config.sh@11 -- # CONFIG_NVME_CUSE=y 00:14:06.093 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/build_config.sh@12 -- # CONFIG_SMA=n 00:14:06.093 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/build_config.sh@13 -- # CONFIG_VTUNE=n 00:14:06.093 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/build_config.sh@14 -- # CONFIG_TSAN=n 00:14:06.093 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/build_config.sh@15 -- # CONFIG_RDMA_SEND_WITH_INVAL=y 00:14:06.093 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/build_config.sh@16 -- # CONFIG_VFIO_USER_DIR= 00:14:06.093 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/build_config.sh@17 -- # CONFIG_PGO_CAPTURE=n 00:14:06.093 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/build_config.sh@18 -- # CONFIG_HAVE_UUID_GENERATE_SHA1=y 00:14:06.093 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/build_config.sh@19 -- # CONFIG_ENV=/home/vagrant/spdk_repo/spdk/lib/env_dpdk 00:14:06.093 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/build_config.sh@20 -- # CONFIG_LTO=n 00:14:06.093 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/build_config.sh@21 -- # CONFIG_ISCSI_INITIATOR=y 00:14:06.093 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/build_config.sh@22 -- # CONFIG_CET=n 00:14:06.093 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/build_config.sh@23 -- # CONFIG_VBDEV_COMPRESS_MLX5=n 00:14:06.093 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/build_config.sh@24 -- # CONFIG_OCF_PATH= 00:14:06.093 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/build_config.sh@25 -- # CONFIG_RDMA_SET_TOS=y 00:14:06.093 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/build_config.sh@26 -- # CONFIG_AIO_FSDEV=y 00:14:06.093 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/build_config.sh@27 -- # CONFIG_HAVE_ARC4RANDOM=y 00:14:06.093 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/build_config.sh@28 -- # CONFIG_HAVE_LIBARCHIVE=n 00:14:06.093 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/build_config.sh@29 -- # CONFIG_UBLK=y 00:14:06.093 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/build_config.sh@30 -- # CONFIG_ISAL_CRYPTO=y 00:14:06.093 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/build_config.sh@31 -- # CONFIG_OPENSSL_PATH= 00:14:06.093 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/build_config.sh@32 -- # CONFIG_OCF=n 00:14:06.093 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/build_config.sh@33 -- # CONFIG_FUSE=n 00:14:06.093 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/build_config.sh@34 -- # CONFIG_VTUNE_DIR= 00:14:06.093 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/build_config.sh@35 -- # CONFIG_FUZZER_LIB= 00:14:06.093 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/build_config.sh@36 -- # CONFIG_FUZZER=n 00:14:06.093 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/build_config.sh@37 -- # CONFIG_FSDEV=y 00:14:06.093 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/build_config.sh@38 -- # CONFIG_DPDK_DIR=/home/vagrant/spdk_repo/spdk/dpdk/build 00:14:06.093 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/build_config.sh@39 -- # CONFIG_CRYPTO=n 00:14:06.093 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/build_config.sh@40 -- # CONFIG_PGO_USE=n 00:14:06.093 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/build_config.sh@41 -- # CONFIG_VHOST=y 00:14:06.093 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/build_config.sh@42 -- # CONFIG_DAOS=n 00:14:06.093 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/build_config.sh@43 -- # CONFIG_DPDK_INC_DIR= 00:14:06.093 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/build_config.sh@44 -- # CONFIG_DAOS_DIR= 00:14:06.093 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/build_config.sh@45 -- # CONFIG_UNIT_TESTS=n 00:14:06.093 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/build_config.sh@46 -- # CONFIG_RDMA_SET_ACK_TIMEOUT=y 00:14:06.093 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/build_config.sh@47 -- # CONFIG_VIRTIO=y 00:14:06.093 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/build_config.sh@48 -- # CONFIG_DPDK_UADK=n 00:14:06.093 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/build_config.sh@49 -- # CONFIG_COVERAGE=y 00:14:06.093 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/build_config.sh@50 -- # CONFIG_RDMA=y 00:14:06.093 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/build_config.sh@51 -- # CONFIG_HAVE_STRUCT_STAT_ST_ATIM=y 00:14:06.093 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/build_config.sh@52 -- # CONFIG_HAVE_LZ4=n 00:14:06.093 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/build_config.sh@53 -- # CONFIG_FIO_SOURCE_DIR=/usr/src/fio 00:14:06.093 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/build_config.sh@54 -- # CONFIG_URING_PATH= 00:14:06.093 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/build_config.sh@55 -- # CONFIG_XNVME=n 00:14:06.093 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/build_config.sh@56 -- # CONFIG_VFIO_USER=n 00:14:06.093 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/build_config.sh@57 -- # CONFIG_ARCH=native 00:14:06.093 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/build_config.sh@58 -- # CONFIG_HAVE_EVP_MAC=y 00:14:06.093 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/build_config.sh@59 -- # CONFIG_URING_ZNS=n 00:14:06.093 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/build_config.sh@60 -- # CONFIG_WERROR=y 00:14:06.093 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/build_config.sh@61 -- # CONFIG_HAVE_LIBBSD=n 00:14:06.093 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/build_config.sh@62 -- # CONFIG_UBSAN=y 00:14:06.094 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/build_config.sh@63 -- # CONFIG_HAVE_STRUCT_STAT_ST_ATIMESPEC=n 00:14:06.094 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/build_config.sh@64 -- # CONFIG_IPSEC_MB_DIR= 00:14:06.094 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/build_config.sh@65 -- # CONFIG_GOLANG=y 00:14:06.094 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/build_config.sh@66 -- # CONFIG_ISAL=y 00:14:06.094 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/build_config.sh@67 -- # CONFIG_IDXD_KERNEL=y 00:14:06.094 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/build_config.sh@68 -- # CONFIG_DPDK_LIB_DIR= 00:14:06.094 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/build_config.sh@69 -- # CONFIG_RDMA_PROV=verbs 00:14:06.094 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/build_config.sh@70 -- # CONFIG_APPS=y 00:14:06.094 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/build_config.sh@71 -- # CONFIG_SHARED=y 00:14:06.094 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/build_config.sh@72 -- # CONFIG_HAVE_KEYUTILS=y 00:14:06.094 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/build_config.sh@73 -- # CONFIG_FC_PATH= 00:14:06.094 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/build_config.sh@74 -- # CONFIG_DPDK_PKG_CONFIG=n 00:14:06.094 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/build_config.sh@75 -- # CONFIG_FC=n 00:14:06.094 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/build_config.sh@76 -- # CONFIG_AVAHI=y 00:14:06.094 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/build_config.sh@77 -- # CONFIG_FIO_PLUGIN=y 00:14:06.094 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/build_config.sh@78 -- # CONFIG_RAID5F=n 00:14:06.094 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/build_config.sh@79 -- # CONFIG_EXAMPLES=y 00:14:06.094 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/build_config.sh@80 -- # CONFIG_TESTS=y 00:14:06.094 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/build_config.sh@81 -- # CONFIG_CRYPTO_MLX5=n 00:14:06.094 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/build_config.sh@82 -- # CONFIG_MAX_LCORES=128 00:14:06.094 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/build_config.sh@83 -- # CONFIG_IPSEC_MB=n 00:14:06.094 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/build_config.sh@84 -- # CONFIG_PGO_DIR= 00:14:06.094 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/build_config.sh@85 -- # CONFIG_DEBUG=y 00:14:06.094 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/build_config.sh@86 -- # CONFIG_DPDK_COMPRESSDEV=n 00:14:06.094 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/build_config.sh@87 -- # CONFIG_CROSS_PREFIX= 00:14:06.094 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/build_config.sh@88 -- # CONFIG_COPY_FILE_RANGE=y 00:14:06.094 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/build_config.sh@89 -- # CONFIG_URING=n 00:14:06.094 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@54 -- # source /home/vagrant/spdk_repo/spdk/test/common/applications.sh 00:14:06.094 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/applications.sh@8 -- # dirname /home/vagrant/spdk_repo/spdk/test/common/applications.sh 00:14:06.094 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/applications.sh@8 -- # readlink -f /home/vagrant/spdk_repo/spdk/test/common 00:14:06.094 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/applications.sh@8 -- # _root=/home/vagrant/spdk_repo/spdk/test/common 00:14:06.094 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/applications.sh@9 -- # _root=/home/vagrant/spdk_repo/spdk 00:14:06.094 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/applications.sh@10 -- # _app_dir=/home/vagrant/spdk_repo/spdk/build/bin 00:14:06.094 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/applications.sh@11 -- # _test_app_dir=/home/vagrant/spdk_repo/spdk/test/app 00:14:06.094 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/applications.sh@12 -- # _examples_dir=/home/vagrant/spdk_repo/spdk/build/examples 00:14:06.094 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/applications.sh@14 -- # VHOST_FUZZ_APP=("$_test_app_dir/fuzz/vhost_fuzz/vhost_fuzz") 00:14:06.094 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/applications.sh@15 -- # ISCSI_APP=("$_app_dir/iscsi_tgt") 00:14:06.094 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/applications.sh@16 -- # NVMF_APP=("$_app_dir/nvmf_tgt") 00:14:06.094 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/applications.sh@17 -- # VHOST_APP=("$_app_dir/vhost") 00:14:06.094 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/applications.sh@18 -- # DD_APP=("$_app_dir/spdk_dd") 00:14:06.094 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/applications.sh@19 -- # SPDK_APP=("$_app_dir/spdk_tgt") 00:14:06.094 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/applications.sh@22 -- # [[ -e /home/vagrant/spdk_repo/spdk/include/spdk/config.h ]] 00:14:06.094 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/applications.sh@23 -- # [[ #ifndef SPDK_CONFIG_H 00:14:06.094 #define SPDK_CONFIG_H 00:14:06.094 #define SPDK_CONFIG_AIO_FSDEV 1 00:14:06.094 #define SPDK_CONFIG_APPS 1 00:14:06.094 #define SPDK_CONFIG_ARCH native 00:14:06.094 #undef SPDK_CONFIG_ASAN 00:14:06.094 #define SPDK_CONFIG_AVAHI 1 00:14:06.094 #undef SPDK_CONFIG_CET 00:14:06.094 #define SPDK_CONFIG_COPY_FILE_RANGE 1 00:14:06.094 #define SPDK_CONFIG_COVERAGE 1 00:14:06.094 #define SPDK_CONFIG_CROSS_PREFIX 00:14:06.094 #undef SPDK_CONFIG_CRYPTO 00:14:06.094 #undef SPDK_CONFIG_CRYPTO_MLX5 00:14:06.094 #undef SPDK_CONFIG_CUSTOMOCF 00:14:06.094 #undef SPDK_CONFIG_DAOS 00:14:06.094 #define SPDK_CONFIG_DAOS_DIR 00:14:06.094 #define SPDK_CONFIG_DEBUG 1 00:14:06.094 #undef SPDK_CONFIG_DPDK_COMPRESSDEV 00:14:06.094 #define SPDK_CONFIG_DPDK_DIR /home/vagrant/spdk_repo/spdk/dpdk/build 00:14:06.094 #define SPDK_CONFIG_DPDK_INC_DIR 00:14:06.094 #define SPDK_CONFIG_DPDK_LIB_DIR 00:14:06.094 #undef SPDK_CONFIG_DPDK_PKG_CONFIG 00:14:06.094 #undef SPDK_CONFIG_DPDK_UADK 00:14:06.094 #define SPDK_CONFIG_ENV /home/vagrant/spdk_repo/spdk/lib/env_dpdk 00:14:06.094 #define SPDK_CONFIG_EXAMPLES 1 00:14:06.094 #undef SPDK_CONFIG_FC 00:14:06.094 #define SPDK_CONFIG_FC_PATH 00:14:06.094 #define SPDK_CONFIG_FIO_PLUGIN 1 00:14:06.094 #define SPDK_CONFIG_FIO_SOURCE_DIR /usr/src/fio 00:14:06.094 #define SPDK_CONFIG_FSDEV 1 00:14:06.094 #undef SPDK_CONFIG_FUSE 00:14:06.094 #undef SPDK_CONFIG_FUZZER 00:14:06.094 #define SPDK_CONFIG_FUZZER_LIB 00:14:06.094 #define SPDK_CONFIG_GOLANG 1 00:14:06.094 #define SPDK_CONFIG_HAVE_ARC4RANDOM 1 00:14:06.094 #define SPDK_CONFIG_HAVE_EVP_MAC 1 00:14:06.094 #define SPDK_CONFIG_HAVE_EXECINFO_H 1 00:14:06.094 #define SPDK_CONFIG_HAVE_KEYUTILS 1 00:14:06.094 #undef SPDK_CONFIG_HAVE_LIBARCHIVE 00:14:06.094 #undef SPDK_CONFIG_HAVE_LIBBSD 00:14:06.094 #undef SPDK_CONFIG_HAVE_LZ4 00:14:06.094 #define SPDK_CONFIG_HAVE_STRUCT_STAT_ST_ATIM 1 00:14:06.094 #undef SPDK_CONFIG_HAVE_STRUCT_STAT_ST_ATIMESPEC 00:14:06.094 #define SPDK_CONFIG_HAVE_UUID_GENERATE_SHA1 1 00:14:06.094 #define SPDK_CONFIG_IDXD 1 00:14:06.094 #define SPDK_CONFIG_IDXD_KERNEL 1 00:14:06.094 #undef SPDK_CONFIG_IPSEC_MB 00:14:06.094 #define SPDK_CONFIG_IPSEC_MB_DIR 00:14:06.094 #define SPDK_CONFIG_ISAL 1 00:14:06.094 #define SPDK_CONFIG_ISAL_CRYPTO 1 00:14:06.094 #define SPDK_CONFIG_ISCSI_INITIATOR 1 00:14:06.094 #define SPDK_CONFIG_LIBDIR 00:14:06.094 #undef SPDK_CONFIG_LTO 00:14:06.094 #define SPDK_CONFIG_MAX_LCORES 128 00:14:06.094 #define SPDK_CONFIG_NVME_CUSE 1 00:14:06.094 #undef SPDK_CONFIG_OCF 00:14:06.094 #define SPDK_CONFIG_OCF_PATH 00:14:06.094 #define SPDK_CONFIG_OPENSSL_PATH 00:14:06.094 #undef SPDK_CONFIG_PGO_CAPTURE 00:14:06.094 #define SPDK_CONFIG_PGO_DIR 00:14:06.094 #undef SPDK_CONFIG_PGO_USE 00:14:06.094 #define SPDK_CONFIG_PREFIX /usr/local 00:14:06.094 #undef SPDK_CONFIG_RAID5F 00:14:06.094 #undef SPDK_CONFIG_RBD 00:14:06.094 #define SPDK_CONFIG_RDMA 1 00:14:06.094 #define SPDK_CONFIG_RDMA_PROV verbs 00:14:06.094 #define SPDK_CONFIG_RDMA_SEND_WITH_INVAL 1 00:14:06.094 #define SPDK_CONFIG_RDMA_SET_ACK_TIMEOUT 1 00:14:06.094 #define SPDK_CONFIG_RDMA_SET_TOS 1 00:14:06.094 #define SPDK_CONFIG_SHARED 1 00:14:06.094 #undef SPDK_CONFIG_SMA 00:14:06.094 #define SPDK_CONFIG_TESTS 1 00:14:06.094 #undef SPDK_CONFIG_TSAN 00:14:06.094 #define SPDK_CONFIG_UBLK 1 00:14:06.094 #define SPDK_CONFIG_UBSAN 1 00:14:06.094 #undef SPDK_CONFIG_UNIT_TESTS 00:14:06.094 #undef SPDK_CONFIG_URING 00:14:06.094 #define SPDK_CONFIG_URING_PATH 00:14:06.094 #undef SPDK_CONFIG_URING_ZNS 00:14:06.094 #define SPDK_CONFIG_USDT 1 00:14:06.094 #undef SPDK_CONFIG_VBDEV_COMPRESS 00:14:06.094 #undef SPDK_CONFIG_VBDEV_COMPRESS_MLX5 00:14:06.094 #undef SPDK_CONFIG_VFIO_USER 00:14:06.094 #define SPDK_CONFIG_VFIO_USER_DIR 00:14:06.094 #define SPDK_CONFIG_VHOST 1 00:14:06.094 #define SPDK_CONFIG_VIRTIO 1 00:14:06.094 #undef SPDK_CONFIG_VTUNE 00:14:06.094 #define SPDK_CONFIG_VTUNE_DIR 00:14:06.094 #define SPDK_CONFIG_WERROR 1 00:14:06.094 #define SPDK_CONFIG_WPDK_DIR 00:14:06.094 #undef SPDK_CONFIG_XNVME 00:14:06.094 #endif /* SPDK_CONFIG_H */ == *\#\d\e\f\i\n\e\ \S\P\D\K\_\C\O\N\F\I\G\_\D\E\B\U\G* ]] 00:14:06.094 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/applications.sh@24 -- # (( SPDK_AUTOTEST_DEBUG_APPS )) 00:14:06.094 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@55 -- # source /home/vagrant/spdk_repo/spdk/scripts/common.sh 00:14:06.094 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- scripts/common.sh@15 -- # shopt -s extglob 00:14:06.094 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- scripts/common.sh@544 -- # [[ -e /bin/wpdk_common.sh ]] 00:14:06.094 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- scripts/common.sh@552 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:14:06.094 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- scripts/common.sh@553 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:14:06.094 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:06.094 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:06.094 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:06.094 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- paths/export.sh@5 -- # export PATH 00:14:06.094 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:06.094 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@56 -- # source /home/vagrant/spdk_repo/spdk/scripts/perf/pm/common 00:14:06.094 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- pm/common@6 -- # dirname /home/vagrant/spdk_repo/spdk/scripts/perf/pm/common 00:14:06.094 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- pm/common@6 -- # readlink -f /home/vagrant/spdk_repo/spdk/scripts/perf/pm 00:14:06.094 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- pm/common@6 -- # _pmdir=/home/vagrant/spdk_repo/spdk/scripts/perf/pm 00:14:06.094 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- pm/common@7 -- # readlink -f /home/vagrant/spdk_repo/spdk/scripts/perf/pm/../../../ 00:14:06.094 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- pm/common@7 -- # _pmrootdir=/home/vagrant/spdk_repo/spdk 00:14:06.094 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- pm/common@64 -- # TEST_TAG=N/A 00:14:06.094 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- pm/common@65 -- # TEST_TAG_FILE=/home/vagrant/spdk_repo/spdk/.run_test_name 00:14:06.094 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- pm/common@67 -- # PM_OUTPUTDIR=/home/vagrant/spdk_repo/spdk/../output/power 00:14:06.094 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- pm/common@68 -- # uname -s 00:14:06.094 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- pm/common@68 -- # PM_OS=Linux 00:14:06.094 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- pm/common@70 -- # MONITOR_RESOURCES_SUDO=() 00:14:06.094 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- pm/common@70 -- # declare -A MONITOR_RESOURCES_SUDO 00:14:06.094 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- pm/common@71 -- # MONITOR_RESOURCES_SUDO["collect-bmc-pm"]=1 00:14:06.094 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- pm/common@72 -- # MONITOR_RESOURCES_SUDO["collect-cpu-load"]=0 00:14:06.094 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- pm/common@73 -- # MONITOR_RESOURCES_SUDO["collect-cpu-temp"]=0 00:14:06.094 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- pm/common@74 -- # MONITOR_RESOURCES_SUDO["collect-vmstat"]=0 00:14:06.094 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- pm/common@76 -- # SUDO[0]= 00:14:06.094 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- pm/common@76 -- # SUDO[1]='sudo -E' 00:14:06.094 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- pm/common@78 -- # MONITOR_RESOURCES=(collect-cpu-load collect-vmstat) 00:14:06.094 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- pm/common@79 -- # [[ Linux == FreeBSD ]] 00:14:06.094 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- pm/common@81 -- # [[ Linux == Linux ]] 00:14:06.094 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- pm/common@81 -- # [[ QEMU != QEMU ]] 00:14:06.094 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- pm/common@88 -- # [[ ! -d /home/vagrant/spdk_repo/spdk/../output/power ]] 00:14:06.094 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@58 -- # : 0 00:14:06.094 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@59 -- # export RUN_NIGHTLY 00:14:06.094 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@62 -- # : 0 00:14:06.094 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@63 -- # export SPDK_AUTOTEST_DEBUG_APPS 00:14:06.094 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@64 -- # : 0 00:14:06.094 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@65 -- # export SPDK_RUN_VALGRIND 00:14:06.094 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@66 -- # : 1 00:14:06.094 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@67 -- # export SPDK_RUN_FUNCTIONAL_TEST 00:14:06.094 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@68 -- # : 0 00:14:06.094 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@69 -- # export SPDK_TEST_UNITTEST 00:14:06.094 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@70 -- # : 00:14:06.094 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@71 -- # export SPDK_TEST_AUTOBUILD 00:14:06.094 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@72 -- # : 0 00:14:06.094 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@73 -- # export SPDK_TEST_RELEASE_BUILD 00:14:06.094 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@74 -- # : 0 00:14:06.094 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@75 -- # export SPDK_TEST_ISAL 00:14:06.094 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@76 -- # : 0 00:14:06.094 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@77 -- # export SPDK_TEST_ISCSI 00:14:06.095 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@78 -- # : 0 00:14:06.095 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@79 -- # export SPDK_TEST_ISCSI_INITIATOR 00:14:06.095 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@80 -- # : 0 00:14:06.095 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@81 -- # export SPDK_TEST_NVME 00:14:06.095 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@82 -- # : 0 00:14:06.095 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@83 -- # export SPDK_TEST_NVME_PMR 00:14:06.095 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@84 -- # : 0 00:14:06.095 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@85 -- # export SPDK_TEST_NVME_BP 00:14:06.095 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@86 -- # : 0 00:14:06.095 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@87 -- # export SPDK_TEST_NVME_CLI 00:14:06.095 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@88 -- # : 0 00:14:06.095 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@89 -- # export SPDK_TEST_NVME_CUSE 00:14:06.095 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@90 -- # : 0 00:14:06.095 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@91 -- # export SPDK_TEST_NVME_FDP 00:14:06.095 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@92 -- # : 1 00:14:06.095 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@93 -- # export SPDK_TEST_NVMF 00:14:06.095 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@94 -- # : 0 00:14:06.095 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@95 -- # export SPDK_TEST_VFIOUSER 00:14:06.095 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@96 -- # : 0 00:14:06.095 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@97 -- # export SPDK_TEST_VFIOUSER_QEMU 00:14:06.095 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@98 -- # : 0 00:14:06.095 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@99 -- # export SPDK_TEST_FUZZER 00:14:06.095 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@100 -- # : 0 00:14:06.095 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@101 -- # export SPDK_TEST_FUZZER_SHORT 00:14:06.095 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@102 -- # : tcp 00:14:06.095 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@103 -- # export SPDK_TEST_NVMF_TRANSPORT 00:14:06.095 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@104 -- # : 0 00:14:06.095 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@105 -- # export SPDK_TEST_RBD 00:14:06.095 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@106 -- # : 0 00:14:06.095 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@107 -- # export SPDK_TEST_VHOST 00:14:06.095 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@108 -- # : 0 00:14:06.095 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@109 -- # export SPDK_TEST_BLOCKDEV 00:14:06.095 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@110 -- # : 0 00:14:06.095 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@111 -- # export SPDK_TEST_RAID 00:14:06.095 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@112 -- # : 0 00:14:06.095 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@113 -- # export SPDK_TEST_IOAT 00:14:06.095 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@114 -- # : 0 00:14:06.095 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@115 -- # export SPDK_TEST_BLOBFS 00:14:06.095 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@116 -- # : 0 00:14:06.095 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@117 -- # export SPDK_TEST_VHOST_INIT 00:14:06.095 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@118 -- # : 0 00:14:06.095 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@119 -- # export SPDK_TEST_LVOL 00:14:06.095 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@120 -- # : 0 00:14:06.095 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@121 -- # export SPDK_TEST_VBDEV_COMPRESS 00:14:06.095 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@122 -- # : 0 00:14:06.095 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@123 -- # export SPDK_RUN_ASAN 00:14:06.095 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@124 -- # : 1 00:14:06.095 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@125 -- # export SPDK_RUN_UBSAN 00:14:06.095 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@126 -- # : 00:14:06.095 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@127 -- # export SPDK_RUN_EXTERNAL_DPDK 00:14:06.095 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@128 -- # : 0 00:14:06.095 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@129 -- # export SPDK_RUN_NON_ROOT 00:14:06.095 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@130 -- # : 0 00:14:06.095 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@131 -- # export SPDK_TEST_CRYPTO 00:14:06.095 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@132 -- # : 0 00:14:06.095 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@133 -- # export SPDK_TEST_FTL 00:14:06.095 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@134 -- # : 0 00:14:06.095 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@135 -- # export SPDK_TEST_OCF 00:14:06.095 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@136 -- # : 0 00:14:06.095 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@137 -- # export SPDK_TEST_VMD 00:14:06.095 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@138 -- # : 0 00:14:06.095 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@139 -- # export SPDK_TEST_OPAL 00:14:06.095 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@140 -- # : 00:14:06.095 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@141 -- # export SPDK_TEST_NATIVE_DPDK 00:14:06.095 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@142 -- # : true 00:14:06.095 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@143 -- # export SPDK_AUTOTEST_X 00:14:06.095 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@144 -- # : 0 00:14:06.095 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@145 -- # export SPDK_TEST_URING 00:14:06.095 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@146 -- # : 1 00:14:06.095 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@147 -- # export SPDK_TEST_USDT 00:14:06.095 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@148 -- # : 0 00:14:06.095 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@149 -- # export SPDK_TEST_USE_IGB_UIO 00:14:06.095 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@150 -- # : 0 00:14:06.095 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@151 -- # export SPDK_TEST_SCHEDULER 00:14:06.095 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@152 -- # : 0 00:14:06.095 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@153 -- # export SPDK_TEST_SCANBUILD 00:14:06.095 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@154 -- # : 00:14:06.095 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@155 -- # export SPDK_TEST_NVMF_NICS 00:14:06.095 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@156 -- # : 0 00:14:06.095 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@157 -- # export SPDK_TEST_SMA 00:14:06.095 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@158 -- # : 0 00:14:06.095 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@159 -- # export SPDK_TEST_DAOS 00:14:06.095 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@160 -- # : 0 00:14:06.095 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@161 -- # export SPDK_TEST_XNVME 00:14:06.095 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@162 -- # : 0 00:14:06.095 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@163 -- # export SPDK_TEST_ACCEL 00:14:06.095 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@164 -- # : 0 00:14:06.095 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@165 -- # export SPDK_TEST_ACCEL_DSA 00:14:06.095 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@166 -- # : 0 00:14:06.095 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@167 -- # export SPDK_TEST_ACCEL_IAA 00:14:06.095 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@169 -- # : 00:14:06.095 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@170 -- # export SPDK_TEST_FUZZER_TARGET 00:14:06.095 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@171 -- # : 1 00:14:06.095 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@172 -- # export SPDK_TEST_NVMF_MDNS 00:14:06.095 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@173 -- # : 1 00:14:06.095 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@174 -- # export SPDK_JSONRPC_GO_CLIENT 00:14:06.095 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@175 -- # : 0 00:14:06.095 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@176 -- # export SPDK_TEST_SETUP 00:14:06.095 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@179 -- # export SPDK_LIB_DIR=/home/vagrant/spdk_repo/spdk/build/lib 00:14:06.095 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@179 -- # SPDK_LIB_DIR=/home/vagrant/spdk_repo/spdk/build/lib 00:14:06.095 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@180 -- # export DPDK_LIB_DIR=/home/vagrant/spdk_repo/spdk/dpdk/build/lib 00:14:06.095 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@180 -- # DPDK_LIB_DIR=/home/vagrant/spdk_repo/spdk/dpdk/build/lib 00:14:06.095 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@181 -- # export VFIO_LIB_DIR=/home/vagrant/spdk_repo/spdk/build/libvfio-user/usr/local/lib 00:14:06.095 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@181 -- # VFIO_LIB_DIR=/home/vagrant/spdk_repo/spdk/build/libvfio-user/usr/local/lib 00:14:06.095 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@182 -- # export LD_LIBRARY_PATH=:/home/vagrant/spdk_repo/spdk/build/lib:/home/vagrant/spdk_repo/spdk/dpdk/build/lib:/home/vagrant/spdk_repo/spdk/build/libvfio-user/usr/local/lib:/home/vagrant/spdk_repo/spdk/build/lib:/home/vagrant/spdk_repo/spdk/dpdk/build/lib:/home/vagrant/spdk_repo/spdk/build/libvfio-user/usr/local/lib:/home/vagrant/spdk_repo/spdk/build/lib:/home/vagrant/spdk_repo/spdk/dpdk/build/lib:/home/vagrant/spdk_repo/spdk/build/libvfio-user/usr/local/lib:/home/vagrant/spdk_repo/spdk/build/lib:/home/vagrant/spdk_repo/spdk/dpdk/build/lib:/home/vagrant/spdk_repo/spdk/build/libvfio-user/usr/local/lib:/home/vagrant/spdk_repo/spdk/build/lib:/home/vagrant/spdk_repo/spdk/dpdk/build/lib:/home/vagrant/spdk_repo/spdk/build/libvfio-user/usr/local/lib 00:14:06.095 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@182 -- # LD_LIBRARY_PATH=:/home/vagrant/spdk_repo/spdk/build/lib:/home/vagrant/spdk_repo/spdk/dpdk/build/lib:/home/vagrant/spdk_repo/spdk/build/libvfio-user/usr/local/lib:/home/vagrant/spdk_repo/spdk/build/lib:/home/vagrant/spdk_repo/spdk/dpdk/build/lib:/home/vagrant/spdk_repo/spdk/build/libvfio-user/usr/local/lib:/home/vagrant/spdk_repo/spdk/build/lib:/home/vagrant/spdk_repo/spdk/dpdk/build/lib:/home/vagrant/spdk_repo/spdk/build/libvfio-user/usr/local/lib:/home/vagrant/spdk_repo/spdk/build/lib:/home/vagrant/spdk_repo/spdk/dpdk/build/lib:/home/vagrant/spdk_repo/spdk/build/libvfio-user/usr/local/lib:/home/vagrant/spdk_repo/spdk/build/lib:/home/vagrant/spdk_repo/spdk/dpdk/build/lib:/home/vagrant/spdk_repo/spdk/build/libvfio-user/usr/local/lib 00:14:06.095 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@185 -- # export PCI_BLOCK_SYNC_ON_RESET=yes 00:14:06.095 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@185 -- # PCI_BLOCK_SYNC_ON_RESET=yes 00:14:06.095 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@189 -- # export PYTHONPATH=:/home/vagrant/spdk_repo/spdk/python:/home/vagrant/spdk_repo/spdk/test/rpc_plugins:/home/vagrant/spdk_repo/spdk/python:/home/vagrant/spdk_repo/spdk/test/rpc_plugins:/home/vagrant/spdk_repo/spdk/python:/home/vagrant/spdk_repo/spdk/test/rpc_plugins:/home/vagrant/spdk_repo/spdk/python:/home/vagrant/spdk_repo/spdk/test/rpc_plugins:/home/vagrant/spdk_repo/spdk/python 00:14:06.095 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@189 -- # PYTHONPATH=:/home/vagrant/spdk_repo/spdk/python:/home/vagrant/spdk_repo/spdk/test/rpc_plugins:/home/vagrant/spdk_repo/spdk/python:/home/vagrant/spdk_repo/spdk/test/rpc_plugins:/home/vagrant/spdk_repo/spdk/python:/home/vagrant/spdk_repo/spdk/test/rpc_plugins:/home/vagrant/spdk_repo/spdk/python:/home/vagrant/spdk_repo/spdk/test/rpc_plugins:/home/vagrant/spdk_repo/spdk/python 00:14:06.095 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@193 -- # export PYTHONDONTWRITEBYTECODE=1 00:14:06.095 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@193 -- # PYTHONDONTWRITEBYTECODE=1 00:14:06.095 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@197 -- # export ASAN_OPTIONS=new_delete_type_mismatch=0:disable_coredump=0:abort_on_error=1:use_sigaltstack=0 00:14:06.095 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@197 -- # ASAN_OPTIONS=new_delete_type_mismatch=0:disable_coredump=0:abort_on_error=1:use_sigaltstack=0 00:14:06.095 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@198 -- # export UBSAN_OPTIONS=halt_on_error=1:print_stacktrace=1:abort_on_error=1:disable_coredump=0:exitcode=134 00:14:06.095 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@198 -- # UBSAN_OPTIONS=halt_on_error=1:print_stacktrace=1:abort_on_error=1:disable_coredump=0:exitcode=134 00:14:06.095 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@202 -- # asan_suppression_file=/var/tmp/asan_suppression_file 00:14:06.095 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@203 -- # rm -rf /var/tmp/asan_suppression_file 00:14:06.095 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@204 -- # cat 00:14:06.095 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@240 -- # echo leak:libfuse3.so 00:14:06.095 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@242 -- # export LSAN_OPTIONS=suppressions=/var/tmp/asan_suppression_file 00:14:06.095 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@242 -- # LSAN_OPTIONS=suppressions=/var/tmp/asan_suppression_file 00:14:06.095 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@244 -- # export DEFAULT_RPC_ADDR=/var/tmp/spdk.sock 00:14:06.095 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@244 -- # DEFAULT_RPC_ADDR=/var/tmp/spdk.sock 00:14:06.095 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@246 -- # '[' -z /var/spdk/dependencies ']' 00:14:06.095 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@249 -- # export DEPENDENCY_DIR 00:14:06.095 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@253 -- # export SPDK_BIN_DIR=/home/vagrant/spdk_repo/spdk/build/bin 00:14:06.095 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@253 -- # SPDK_BIN_DIR=/home/vagrant/spdk_repo/spdk/build/bin 00:14:06.095 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@254 -- # export SPDK_EXAMPLE_DIR=/home/vagrant/spdk_repo/spdk/build/examples 00:14:06.095 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@254 -- # SPDK_EXAMPLE_DIR=/home/vagrant/spdk_repo/spdk/build/examples 00:14:06.095 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@257 -- # export QEMU_BIN=/usr/local/qemu/vanilla-latest/bin/qemu-system-x86_64 00:14:06.095 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@257 -- # QEMU_BIN=/usr/local/qemu/vanilla-latest/bin/qemu-system-x86_64 00:14:06.095 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@258 -- # export VFIO_QEMU_BIN=/usr/local/qemu/vfio-user-latest/bin/qemu-system-x86_64 00:14:06.095 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@258 -- # VFIO_QEMU_BIN=/usr/local/qemu/vfio-user-latest/bin/qemu-system-x86_64 00:14:06.095 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@260 -- # export AR_TOOL=/home/vagrant/spdk_repo/spdk/scripts/ar-xnvme-fixer 00:14:06.095 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@260 -- # AR_TOOL=/home/vagrant/spdk_repo/spdk/scripts/ar-xnvme-fixer 00:14:06.095 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@263 -- # export UNBIND_ENTIRE_IOMMU_GROUP=yes 00:14:06.095 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@263 -- # UNBIND_ENTIRE_IOMMU_GROUP=yes 00:14:06.095 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@265 -- # _LCOV_MAIN=0 00:14:06.095 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@266 -- # _LCOV_LLVM=1 00:14:06.095 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@267 -- # _LCOV= 00:14:06.095 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@268 -- # [[ '' == *clang* ]] 00:14:06.095 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@268 -- # [[ 0 -eq 1 ]] 00:14:06.095 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@270 -- # _lcov_opt[_LCOV_LLVM]='--gcov-tool /home/vagrant/spdk_repo/spdk/test/fuzz/llvm/llvm-gcov.sh' 00:14:06.095 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@271 -- # _lcov_opt[_LCOV_MAIN]= 00:14:06.095 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@273 -- # lcov_opt= 00:14:06.095 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@276 -- # '[' 0 -eq 0 ']' 00:14:06.095 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@277 -- # export valgrind= 00:14:06.095 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@277 -- # valgrind= 00:14:06.095 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@283 -- # uname -s 00:14:06.095 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@283 -- # '[' Linux = Linux ']' 00:14:06.095 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@284 -- # HUGEMEM=4096 00:14:06.095 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@285 -- # export CLEAR_HUGE=yes 00:14:06.095 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@285 -- # CLEAR_HUGE=yes 00:14:06.095 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@287 -- # MAKE=make 00:14:06.095 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@288 -- # MAKEFLAGS=-j10 00:14:06.095 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@304 -- # export HUGEMEM=4096 00:14:06.095 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@304 -- # HUGEMEM=4096 00:14:06.096 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@306 -- # NO_HUGE=() 00:14:06.096 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@307 -- # TEST_MODE= 00:14:06.096 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@308 -- # for i in "$@" 00:14:06.096 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@309 -- # case "$i" in 00:14:06.096 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@314 -- # TEST_TRANSPORT=tcp 00:14:06.096 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@329 -- # [[ -z 71803 ]] 00:14:06.096 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@329 -- # kill -0 71803 00:14:06.096 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@1666 -- # set_test_storage 2147483648 00:14:06.096 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@339 -- # [[ -v testdir ]] 00:14:06.096 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@341 -- # local requested_size=2147483648 00:14:06.096 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@342 -- # local mount target_dir 00:14:06.096 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@344 -- # local -A mounts fss sizes avails uses 00:14:06.096 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@345 -- # local source fs size avail mount use 00:14:06.096 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@347 -- # local storage_fallback storage_candidates 00:14:06.096 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@349 -- # mktemp -udt spdk.XXXXXX 00:14:06.096 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@349 -- # storage_fallback=/tmp/spdk.8tTGVL 00:14:06.096 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@354 -- # storage_candidates=("$testdir" "$storage_fallback/tests/${testdir##*/}" "$storage_fallback") 00:14:06.096 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@356 -- # [[ -n '' ]] 00:14:06.096 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@361 -- # [[ -n '' ]] 00:14:06.096 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@366 -- # mkdir -p /home/vagrant/spdk_repo/spdk/test/nvmf/target /tmp/spdk.8tTGVL/tests/target /tmp/spdk.8tTGVL 00:14:06.096 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@369 -- # requested_size=2214592512 00:14:06.096 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@371 -- # read -r source fs size use avail _ mount 00:14:06.096 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@338 -- # df -T 00:14:06.096 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@338 -- # grep -v Filesystem 00:14:06.096 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@372 -- # mounts["$mount"]=/dev/vda5 00:14:06.096 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@372 -- # fss["$mount"]=btrfs 00:14:06.096 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@373 -- # avails["$mount"]=13987868672 00:14:06.096 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@373 -- # sizes["$mount"]=20314062848 00:14:06.096 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@374 -- # uses["$mount"]=5580738560 00:14:06.096 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@371 -- # read -r source fs size use avail _ mount 00:14:06.096 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@372 -- # mounts["$mount"]=devtmpfs 00:14:06.096 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@372 -- # fss["$mount"]=devtmpfs 00:14:06.096 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@373 -- # avails["$mount"]=4194304 00:14:06.096 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@373 -- # sizes["$mount"]=4194304 00:14:06.096 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@374 -- # uses["$mount"]=0 00:14:06.096 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@371 -- # read -r source fs size use avail _ mount 00:14:06.096 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@372 -- # mounts["$mount"]=tmpfs 00:14:06.096 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@372 -- # fss["$mount"]=tmpfs 00:14:06.096 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@373 -- # avails["$mount"]=6256398336 00:14:06.096 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@373 -- # sizes["$mount"]=6266429440 00:14:06.096 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@374 -- # uses["$mount"]=10031104 00:14:06.096 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@371 -- # read -r source fs size use avail _ mount 00:14:06.096 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@372 -- # mounts["$mount"]=tmpfs 00:14:06.096 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@372 -- # fss["$mount"]=tmpfs 00:14:06.096 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@373 -- # avails["$mount"]=2486431744 00:14:06.096 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@373 -- # sizes["$mount"]=2506571776 00:14:06.096 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@374 -- # uses["$mount"]=20140032 00:14:06.096 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@371 -- # read -r source fs size use avail _ mount 00:14:06.096 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@372 -- # mounts["$mount"]=/dev/vda5 00:14:06.096 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@372 -- # fss["$mount"]=btrfs 00:14:06.096 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@373 -- # avails["$mount"]=13987868672 00:14:06.096 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@373 -- # sizes["$mount"]=20314062848 00:14:06.096 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@374 -- # uses["$mount"]=5580738560 00:14:06.096 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@371 -- # read -r source fs size use avail _ mount 00:14:06.096 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@372 -- # mounts["$mount"]=/dev/vda2 00:14:06.096 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@372 -- # fss["$mount"]=ext4 00:14:06.096 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@373 -- # avails["$mount"]=840085504 00:14:06.096 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@373 -- # sizes["$mount"]=1012768768 00:14:06.096 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@374 -- # uses["$mount"]=103477248 00:14:06.096 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@371 -- # read -r source fs size use avail _ mount 00:14:06.096 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@372 -- # mounts["$mount"]=tmpfs 00:14:06.096 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@372 -- # fss["$mount"]=tmpfs 00:14:06.096 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@373 -- # avails["$mount"]=6266281984 00:14:06.096 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@373 -- # sizes["$mount"]=6266429440 00:14:06.096 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@374 -- # uses["$mount"]=147456 00:14:06.096 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@371 -- # read -r source fs size use avail _ mount 00:14:06.096 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@372 -- # mounts["$mount"]=/dev/vda3 00:14:06.096 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@372 -- # fss["$mount"]=vfat 00:14:06.096 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@373 -- # avails["$mount"]=91617280 00:14:06.096 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@373 -- # sizes["$mount"]=104607744 00:14:06.096 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@374 -- # uses["$mount"]=12990464 00:14:06.096 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@371 -- # read -r source fs size use avail _ mount 00:14:06.096 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@372 -- # mounts["$mount"]=tmpfs 00:14:06.096 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@372 -- # fss["$mount"]=tmpfs 00:14:06.096 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@373 -- # avails["$mount"]=1253273600 00:14:06.096 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@373 -- # sizes["$mount"]=1253285888 00:14:06.096 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@374 -- # uses["$mount"]=12288 00:14:06.096 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@371 -- # read -r source fs size use avail _ mount 00:14:06.096 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@372 -- # mounts["$mount"]=:/mnt/jenkins_nvme/jenkins/workspace/nvmf-tcp-vg-autotest_4/fedora39-libvirt/output 00:14:06.096 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@372 -- # fss["$mount"]=fuse.sshfs 00:14:06.096 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@373 -- # avails["$mount"]=93117296640 00:14:06.096 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@373 -- # sizes["$mount"]=105088212992 00:14:06.096 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@374 -- # uses["$mount"]=6585483264 00:14:06.096 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@371 -- # read -r source fs size use avail _ mount 00:14:06.096 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@377 -- # printf '* Looking for test storage...\n' 00:14:06.096 * Looking for test storage... 00:14:06.096 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@379 -- # local target_space new_size 00:14:06.096 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@380 -- # for target_dir in "${storage_candidates[@]}" 00:14:06.096 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@383 -- # awk '$1 !~ /Filesystem/{print $6}' 00:14:06.096 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@383 -- # df /home/vagrant/spdk_repo/spdk/test/nvmf/target 00:14:06.096 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@383 -- # mount=/home 00:14:06.096 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@385 -- # target_space=13987868672 00:14:06.096 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@386 -- # (( target_space == 0 || target_space < requested_size )) 00:14:06.096 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@389 -- # (( target_space >= requested_size )) 00:14:06.096 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@391 -- # [[ btrfs == tmpfs ]] 00:14:06.096 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@391 -- # [[ btrfs == ramfs ]] 00:14:06.096 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@391 -- # [[ /home == / ]] 00:14:06.096 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@398 -- # export SPDK_TEST_STORAGE=/home/vagrant/spdk_repo/spdk/test/nvmf/target 00:14:06.096 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@398 -- # SPDK_TEST_STORAGE=/home/vagrant/spdk_repo/spdk/test/nvmf/target 00:14:06.096 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@399 -- # printf '* Found test storage at %s\n' /home/vagrant/spdk_repo/spdk/test/nvmf/target 00:14:06.096 * Found test storage at /home/vagrant/spdk_repo/spdk/test/nvmf/target 00:14:06.096 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@400 -- # return 0 00:14:06.096 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@1668 -- # set -o errtrace 00:14:06.096 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@1669 -- # shopt -s extdebug 00:14:06.096 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@1670 -- # trap 'trap - ERR; print_backtrace >&2' ERR 00:14:06.096 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@1672 -- # PS4=' \t ${test_domain:-} -- ${BASH_SOURCE#${BASH_SOURCE%/*/*}/}@${LINENO} -- \$ ' 00:14:06.096 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@1673 -- # true 00:14:06.096 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@1675 -- # xtrace_fd 00:14:06.096 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@25 -- # [[ -n 15 ]] 00:14:06.096 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@25 -- # [[ -e /proc/self/fd/15 ]] 00:14:06.096 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@27 -- # exec 00:14:06.096 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@29 -- # exec 00:14:06.096 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@31 -- # xtrace_restore 00:14:06.096 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@16 -- # unset -v 'X_STACK[0 - 1 < 0 ? 0 : 0 - 1]' 00:14:06.096 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@17 -- # (( 0 == 0 )) 00:14:06.096 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@18 -- # set -x 00:14:06.096 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@1680 -- # [[ y == y ]] 00:14:06.096 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@1681 -- # lcov --version 00:14:06.096 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@1681 -- # awk '{print $NF}' 00:14:06.096 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@1681 -- # lt 1.15 2 00:14:06.096 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- scripts/common.sh@373 -- # cmp_versions 1.15 '<' 2 00:14:06.096 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- scripts/common.sh@333 -- # local ver1 ver1_l 00:14:06.096 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- scripts/common.sh@334 -- # local ver2 ver2_l 00:14:06.096 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- scripts/common.sh@336 -- # IFS=.-: 00:14:06.096 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- scripts/common.sh@336 -- # read -ra ver1 00:14:06.096 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- scripts/common.sh@337 -- # IFS=.-: 00:14:06.096 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- scripts/common.sh@337 -- # read -ra ver2 00:14:06.096 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- scripts/common.sh@338 -- # local 'op=<' 00:14:06.096 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- scripts/common.sh@340 -- # ver1_l=2 00:14:06.096 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- scripts/common.sh@341 -- # ver2_l=1 00:14:06.096 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- scripts/common.sh@343 -- # local lt=0 gt=0 eq=0 v 00:14:06.096 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- scripts/common.sh@344 -- # case "$op" in 00:14:06.096 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- scripts/common.sh@345 -- # : 1 00:14:06.096 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- scripts/common.sh@364 -- # (( v = 0 )) 00:14:06.096 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- scripts/common.sh@364 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:14:06.096 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- scripts/common.sh@365 -- # decimal 1 00:14:06.096 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- scripts/common.sh@353 -- # local d=1 00:14:06.096 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- scripts/common.sh@354 -- # [[ 1 =~ ^[0-9]+$ ]] 00:14:06.096 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- scripts/common.sh@355 -- # echo 1 00:14:06.096 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- scripts/common.sh@365 -- # ver1[v]=1 00:14:06.096 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- scripts/common.sh@366 -- # decimal 2 00:14:06.096 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- scripts/common.sh@353 -- # local d=2 00:14:06.096 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- scripts/common.sh@354 -- # [[ 2 =~ ^[0-9]+$ ]] 00:14:06.096 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- scripts/common.sh@355 -- # echo 2 00:14:06.096 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- scripts/common.sh@366 -- # ver2[v]=2 00:14:06.096 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- scripts/common.sh@367 -- # (( ver1[v] > ver2[v] )) 00:14:06.096 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- scripts/common.sh@368 -- # (( ver1[v] < ver2[v] )) 00:14:06.096 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- scripts/common.sh@368 -- # return 0 00:14:06.096 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@1682 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:14:06.096 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@1694 -- # export 'LCOV_OPTS= 00:14:06.096 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:14:06.096 --rc genhtml_branch_coverage=1 00:14:06.096 --rc genhtml_function_coverage=1 00:14:06.096 --rc genhtml_legend=1 00:14:06.096 --rc geninfo_all_blocks=1 00:14:06.096 --rc geninfo_unexecuted_blocks=1 00:14:06.096 00:14:06.096 ' 00:14:06.096 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@1694 -- # LCOV_OPTS=' 00:14:06.096 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:14:06.096 --rc genhtml_branch_coverage=1 00:14:06.096 --rc genhtml_function_coverage=1 00:14:06.096 --rc genhtml_legend=1 00:14:06.096 --rc geninfo_all_blocks=1 00:14:06.096 --rc geninfo_unexecuted_blocks=1 00:14:06.096 00:14:06.096 ' 00:14:06.096 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@1695 -- # export 'LCOV=lcov 00:14:06.096 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:14:06.096 --rc genhtml_branch_coverage=1 00:14:06.096 --rc genhtml_function_coverage=1 00:14:06.096 --rc genhtml_legend=1 00:14:06.096 --rc geninfo_all_blocks=1 00:14:06.096 --rc geninfo_unexecuted_blocks=1 00:14:06.096 00:14:06.096 ' 00:14:06.096 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@1695 -- # LCOV='lcov 00:14:06.096 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:14:06.096 --rc genhtml_branch_coverage=1 00:14:06.096 --rc genhtml_function_coverage=1 00:14:06.096 --rc genhtml_legend=1 00:14:06.096 --rc geninfo_all_blocks=1 00:14:06.096 --rc geninfo_unexecuted_blocks=1 00:14:06.096 00:14:06.096 ' 00:14:06.096 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- target/filesystem.sh@10 -- # source /home/vagrant/spdk_repo/spdk/test/nvmf/common.sh 00:14:06.096 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- nvmf/common.sh@7 -- # uname -s 00:14:06.096 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:14:06.096 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:14:06.096 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:14:06.096 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:14:06.096 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:14:06.096 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:14:06.096 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:14:06.096 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:14:06.096 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:14:06.096 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:14:06.096 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:c758a4ed-f09f-4c82-9afb-3d096f035464 00:14:06.096 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- nvmf/common.sh@18 -- # NVME_HOSTID=c758a4ed-f09f-4c82-9afb-3d096f035464 00:14:06.096 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:14:06.096 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:14:06.096 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- nvmf/common.sh@21 -- # NET_TYPE=virt 00:14:06.096 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:14:06.096 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- nvmf/common.sh@49 -- # source /home/vagrant/spdk_repo/spdk/scripts/common.sh 00:14:06.096 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- scripts/common.sh@15 -- # shopt -s extglob 00:14:06.096 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- scripts/common.sh@544 -- # [[ -e /bin/wpdk_common.sh ]] 00:14:06.096 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- scripts/common.sh@552 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:14:06.096 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- scripts/common.sh@553 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:14:06.096 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:06.096 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:06.096 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:06.096 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- paths/export.sh@5 -- # export PATH 00:14:06.097 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:06.097 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- nvmf/common.sh@51 -- # : 0 00:14:06.097 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- nvmf/common.sh@52 -- # export NVMF_APP_SHM_ID 00:14:06.097 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- nvmf/common.sh@53 -- # build_nvmf_app_args 00:14:06.097 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:14:06.097 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:14:06.097 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:14:06.097 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- nvmf/common.sh@33 -- # '[' '' -eq 1 ']' 00:14:06.097 /home/vagrant/spdk_repo/spdk/test/nvmf/common.sh: line 33: [: : integer expression expected 00:14:06.097 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- nvmf/common.sh@37 -- # '[' -n '' ']' 00:14:06.097 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- nvmf/common.sh@39 -- # '[' 0 -eq 1 ']' 00:14:06.097 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- nvmf/common.sh@55 -- # have_pci_nics=0 00:14:06.097 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- target/filesystem.sh@12 -- # MALLOC_BDEV_SIZE=512 00:14:06.097 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- target/filesystem.sh@13 -- # MALLOC_BLOCK_SIZE=512 00:14:06.097 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- target/filesystem.sh@15 -- # nvmftestinit 00:14:06.097 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- nvmf/common.sh@467 -- # '[' -z tcp ']' 00:14:06.097 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- nvmf/common.sh@472 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:14:06.097 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- nvmf/common.sh@474 -- # prepare_net_devs 00:14:06.097 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- nvmf/common.sh@436 -- # local -g is_hw=no 00:14:06.097 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- nvmf/common.sh@438 -- # remove_spdk_ns 00:14:06.097 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- nvmf/common.sh@654 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:14:06.097 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 15> /dev/null' 00:14:06.097 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:14:06.097 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- nvmf/common.sh@440 -- # [[ virt != virt ]] 00:14:06.097 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- nvmf/common.sh@442 -- # [[ no == yes ]] 00:14:06.097 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- nvmf/common.sh@449 -- # [[ virt == phy ]] 00:14:06.097 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- nvmf/common.sh@452 -- # [[ virt == phy-fallback ]] 00:14:06.097 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- nvmf/common.sh@457 -- # [[ tcp == tcp ]] 00:14:06.097 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- nvmf/common.sh@458 -- # nvmf_veth_init 00:14:06.097 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- nvmf/common.sh@145 -- # NVMF_FIRST_INITIATOR_IP=10.0.0.1 00:14:06.097 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- nvmf/common.sh@146 -- # NVMF_SECOND_INITIATOR_IP=10.0.0.2 00:14:06.097 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- nvmf/common.sh@147 -- # NVMF_FIRST_TARGET_IP=10.0.0.3 00:14:06.097 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- nvmf/common.sh@148 -- # NVMF_SECOND_TARGET_IP=10.0.0.4 00:14:06.097 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- nvmf/common.sh@149 -- # NVMF_INITIATOR_IP=10.0.0.1 00:14:06.097 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- nvmf/common.sh@150 -- # NVMF_BRIDGE=nvmf_br 00:14:06.097 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- nvmf/common.sh@151 -- # NVMF_INITIATOR_INTERFACE=nvmf_init_if 00:14:06.097 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- nvmf/common.sh@152 -- # NVMF_INITIATOR_INTERFACE2=nvmf_init_if2 00:14:06.097 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- nvmf/common.sh@153 -- # NVMF_INITIATOR_BRIDGE=nvmf_init_br 00:14:06.097 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- nvmf/common.sh@154 -- # NVMF_INITIATOR_BRIDGE2=nvmf_init_br2 00:14:06.097 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- nvmf/common.sh@155 -- # NVMF_TARGET_NAMESPACE=nvmf_tgt_ns_spdk 00:14:06.097 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- nvmf/common.sh@156 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:14:06.097 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- nvmf/common.sh@157 -- # NVMF_TARGET_INTERFACE=nvmf_tgt_if 00:14:06.097 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- nvmf/common.sh@158 -- # NVMF_TARGET_INTERFACE2=nvmf_tgt_if2 00:14:06.097 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- nvmf/common.sh@159 -- # NVMF_TARGET_BRIDGE=nvmf_tgt_br 00:14:06.097 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- nvmf/common.sh@160 -- # NVMF_TARGET_BRIDGE2=nvmf_tgt_br2 00:14:06.097 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- nvmf/common.sh@162 -- # ip link set nvmf_init_br nomaster 00:14:06.097 Cannot find device "nvmf_init_br" 00:14:06.097 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- nvmf/common.sh@162 -- # true 00:14:06.097 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- nvmf/common.sh@163 -- # ip link set nvmf_init_br2 nomaster 00:14:06.097 Cannot find device "nvmf_init_br2" 00:14:06.097 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- nvmf/common.sh@163 -- # true 00:14:06.097 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- nvmf/common.sh@164 -- # ip link set nvmf_tgt_br nomaster 00:14:06.097 Cannot find device "nvmf_tgt_br" 00:14:06.097 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- nvmf/common.sh@164 -- # true 00:14:06.097 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- nvmf/common.sh@165 -- # ip link set nvmf_tgt_br2 nomaster 00:14:06.097 Cannot find device "nvmf_tgt_br2" 00:14:06.097 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- nvmf/common.sh@165 -- # true 00:14:06.097 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- nvmf/common.sh@166 -- # ip link set nvmf_init_br down 00:14:06.097 Cannot find device "nvmf_init_br" 00:14:06.097 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- nvmf/common.sh@166 -- # true 00:14:06.097 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- nvmf/common.sh@167 -- # ip link set nvmf_init_br2 down 00:14:06.097 Cannot find device "nvmf_init_br2" 00:14:06.097 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- nvmf/common.sh@167 -- # true 00:14:06.097 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- nvmf/common.sh@168 -- # ip link set nvmf_tgt_br down 00:14:06.097 Cannot find device "nvmf_tgt_br" 00:14:06.097 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- nvmf/common.sh@168 -- # true 00:14:06.097 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- nvmf/common.sh@169 -- # ip link set nvmf_tgt_br2 down 00:14:06.097 Cannot find device "nvmf_tgt_br2" 00:14:06.097 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- nvmf/common.sh@169 -- # true 00:14:06.097 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- nvmf/common.sh@170 -- # ip link delete nvmf_br type bridge 00:14:06.097 Cannot find device "nvmf_br" 00:14:06.097 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- nvmf/common.sh@170 -- # true 00:14:06.097 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- nvmf/common.sh@171 -- # ip link delete nvmf_init_if 00:14:06.097 Cannot find device "nvmf_init_if" 00:14:06.097 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- nvmf/common.sh@171 -- # true 00:14:06.097 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- nvmf/common.sh@172 -- # ip link delete nvmf_init_if2 00:14:06.097 Cannot find device "nvmf_init_if2" 00:14:06.097 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- nvmf/common.sh@172 -- # true 00:14:06.097 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- nvmf/common.sh@173 -- # ip netns exec nvmf_tgt_ns_spdk ip link delete nvmf_tgt_if 00:14:06.097 Cannot open network namespace "nvmf_tgt_ns_spdk": No such file or directory 00:14:06.097 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- nvmf/common.sh@173 -- # true 00:14:06.097 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- nvmf/common.sh@174 -- # ip netns exec nvmf_tgt_ns_spdk ip link delete nvmf_tgt_if2 00:14:06.097 Cannot open network namespace "nvmf_tgt_ns_spdk": No such file or directory 00:14:06.097 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- nvmf/common.sh@174 -- # true 00:14:06.097 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- nvmf/common.sh@177 -- # ip netns add nvmf_tgt_ns_spdk 00:14:06.097 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- nvmf/common.sh@180 -- # ip link add nvmf_init_if type veth peer name nvmf_init_br 00:14:06.097 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- nvmf/common.sh@181 -- # ip link add nvmf_init_if2 type veth peer name nvmf_init_br2 00:14:06.097 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- nvmf/common.sh@182 -- # ip link add nvmf_tgt_if type veth peer name nvmf_tgt_br 00:14:06.097 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- nvmf/common.sh@183 -- # ip link add nvmf_tgt_if2 type veth peer name nvmf_tgt_br2 00:14:06.097 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- nvmf/common.sh@186 -- # ip link set nvmf_tgt_if netns nvmf_tgt_ns_spdk 00:14:06.097 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- nvmf/common.sh@187 -- # ip link set nvmf_tgt_if2 netns nvmf_tgt_ns_spdk 00:14:06.097 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- nvmf/common.sh@190 -- # ip addr add 10.0.0.1/24 dev nvmf_init_if 00:14:06.097 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- nvmf/common.sh@191 -- # ip addr add 10.0.0.2/24 dev nvmf_init_if2 00:14:06.097 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- nvmf/common.sh@192 -- # ip netns exec nvmf_tgt_ns_spdk ip addr add 10.0.0.3/24 dev nvmf_tgt_if 00:14:06.097 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- nvmf/common.sh@193 -- # ip netns exec nvmf_tgt_ns_spdk ip addr add 10.0.0.4/24 dev nvmf_tgt_if2 00:14:06.097 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- nvmf/common.sh@196 -- # ip link set nvmf_init_if up 00:14:06.097 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- nvmf/common.sh@197 -- # ip link set nvmf_init_if2 up 00:14:06.097 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- nvmf/common.sh@198 -- # ip link set nvmf_init_br up 00:14:06.097 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- nvmf/common.sh@199 -- # ip link set nvmf_init_br2 up 00:14:06.097 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- nvmf/common.sh@200 -- # ip link set nvmf_tgt_br up 00:14:06.097 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- nvmf/common.sh@201 -- # ip link set nvmf_tgt_br2 up 00:14:06.097 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- nvmf/common.sh@202 -- # ip netns exec nvmf_tgt_ns_spdk ip link set nvmf_tgt_if up 00:14:06.097 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- nvmf/common.sh@203 -- # ip netns exec nvmf_tgt_ns_spdk ip link set nvmf_tgt_if2 up 00:14:06.097 11:25:01 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- nvmf/common.sh@204 -- # ip netns exec nvmf_tgt_ns_spdk ip link set lo up 00:14:06.097 11:25:01 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- nvmf/common.sh@207 -- # ip link add nvmf_br type bridge 00:14:06.097 11:25:01 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- nvmf/common.sh@208 -- # ip link set nvmf_br up 00:14:06.097 11:25:01 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- nvmf/common.sh@211 -- # ip link set nvmf_init_br master nvmf_br 00:14:06.097 11:25:01 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- nvmf/common.sh@212 -- # ip link set nvmf_init_br2 master nvmf_br 00:14:06.097 11:25:01 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- nvmf/common.sh@213 -- # ip link set nvmf_tgt_br master nvmf_br 00:14:06.097 11:25:01 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- nvmf/common.sh@214 -- # ip link set nvmf_tgt_br2 master nvmf_br 00:14:06.097 11:25:01 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- nvmf/common.sh@217 -- # ipts -I INPUT 1 -i nvmf_init_if -p tcp --dport 4420 -j ACCEPT 00:14:06.097 11:25:01 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- nvmf/common.sh@788 -- # iptables -I INPUT 1 -i nvmf_init_if -p tcp --dport 4420 -j ACCEPT -m comment --comment 'SPDK_NVMF:-I INPUT 1 -i nvmf_init_if -p tcp --dport 4420 -j ACCEPT' 00:14:06.097 11:25:01 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- nvmf/common.sh@218 -- # ipts -I INPUT 1 -i nvmf_init_if2 -p tcp --dport 4420 -j ACCEPT 00:14:06.097 11:25:01 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- nvmf/common.sh@788 -- # iptables -I INPUT 1 -i nvmf_init_if2 -p tcp --dport 4420 -j ACCEPT -m comment --comment 'SPDK_NVMF:-I INPUT 1 -i nvmf_init_if2 -p tcp --dport 4420 -j ACCEPT' 00:14:06.097 11:25:01 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- nvmf/common.sh@219 -- # ipts -A FORWARD -i nvmf_br -o nvmf_br -j ACCEPT 00:14:06.097 11:25:01 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- nvmf/common.sh@788 -- # iptables -A FORWARD -i nvmf_br -o nvmf_br -j ACCEPT -m comment --comment 'SPDK_NVMF:-A FORWARD -i nvmf_br -o nvmf_br -j ACCEPT' 00:14:06.097 11:25:01 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- nvmf/common.sh@222 -- # ping -c 1 10.0.0.3 00:14:06.097 PING 10.0.0.3 (10.0.0.3) 56(84) bytes of data. 00:14:06.097 64 bytes from 10.0.0.3: icmp_seq=1 ttl=64 time=0.082 ms 00:14:06.097 00:14:06.097 --- 10.0.0.3 ping statistics --- 00:14:06.097 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:14:06.097 rtt min/avg/max/mdev = 0.082/0.082/0.082/0.000 ms 00:14:06.097 11:25:01 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- nvmf/common.sh@223 -- # ping -c 1 10.0.0.4 00:14:06.097 PING 10.0.0.4 (10.0.0.4) 56(84) bytes of data. 00:14:06.097 64 bytes from 10.0.0.4: icmp_seq=1 ttl=64 time=0.041 ms 00:14:06.097 00:14:06.097 --- 10.0.0.4 ping statistics --- 00:14:06.097 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:14:06.097 rtt min/avg/max/mdev = 0.041/0.041/0.041/0.000 ms 00:14:06.097 11:25:01 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- nvmf/common.sh@224 -- # ip netns exec nvmf_tgt_ns_spdk ping -c 1 10.0.0.1 00:14:06.097 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:14:06.097 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.023 ms 00:14:06.097 00:14:06.097 --- 10.0.0.1 ping statistics --- 00:14:06.097 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:14:06.097 rtt min/avg/max/mdev = 0.023/0.023/0.023/0.000 ms 00:14:06.097 11:25:01 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- nvmf/common.sh@225 -- # ip netns exec nvmf_tgt_ns_spdk ping -c 1 10.0.0.2 00:14:06.097 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:14:06.097 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.069 ms 00:14:06.097 00:14:06.097 --- 10.0.0.2 ping statistics --- 00:14:06.097 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:14:06.097 rtt min/avg/max/mdev = 0.069/0.069/0.069/0.000 ms 00:14:06.097 11:25:01 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- nvmf/common.sh@227 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:14:06.097 11:25:01 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- nvmf/common.sh@459 -- # return 0 00:14:06.097 11:25:01 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- nvmf/common.sh@476 -- # '[' '' == iso ']' 00:14:06.097 11:25:01 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- nvmf/common.sh@480 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:14:06.097 11:25:01 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- nvmf/common.sh@481 -- # [[ tcp == \r\d\m\a ]] 00:14:06.097 11:25:01 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- nvmf/common.sh@490 -- # [[ tcp == \t\c\p ]] 00:14:06.097 11:25:01 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- nvmf/common.sh@491 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:14:06.097 11:25:01 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- nvmf/common.sh@494 -- # '[' tcp == tcp ']' 00:14:06.097 11:25:01 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- nvmf/common.sh@500 -- # modprobe nvme-tcp 00:14:06.097 11:25:01 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- target/filesystem.sh@105 -- # run_test nvmf_filesystem_no_in_capsule nvmf_filesystem_part 0 00:14:06.097 11:25:01 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@1101 -- # '[' 3 -le 1 ']' 00:14:06.097 11:25:01 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@1107 -- # xtrace_disable 00:14:06.097 11:25:01 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@10 -- # set +x 00:14:06.097 ************************************ 00:14:06.097 START TEST nvmf_filesystem_no_in_capsule 00:14:06.097 ************************************ 00:14:06.097 11:25:01 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_no_in_capsule -- common/autotest_common.sh@1125 -- # nvmf_filesystem_part 0 00:14:06.097 11:25:01 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_no_in_capsule -- target/filesystem.sh@47 -- # in_capsule=0 00:14:06.097 11:25:01 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_no_in_capsule -- target/filesystem.sh@49 -- # nvmfappstart -m 0xF 00:14:06.097 11:25:01 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_no_in_capsule -- nvmf/common.sh@505 -- # timing_enter start_nvmf_tgt 00:14:06.097 11:25:01 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_no_in_capsule -- common/autotest_common.sh@724 -- # xtrace_disable 00:14:06.097 11:25:01 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_no_in_capsule -- common/autotest_common.sh@10 -- # set +x 00:14:06.097 11:25:01 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_no_in_capsule -- nvmf/common.sh@507 -- # nvmfpid=71996 00:14:06.097 11:25:01 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_no_in_capsule -- nvmf/common.sh@508 -- # waitforlisten 71996 00:14:06.097 11:25:01 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_no_in_capsule -- nvmf/common.sh@506 -- # ip netns exec nvmf_tgt_ns_spdk /home/vagrant/spdk_repo/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:14:06.097 11:25:01 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_no_in_capsule -- common/autotest_common.sh@831 -- # '[' -z 71996 ']' 00:14:06.097 11:25:01 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_no_in_capsule -- common/autotest_common.sh@835 -- # local rpc_addr=/var/tmp/spdk.sock 00:14:06.097 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:14:06.097 11:25:01 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_no_in_capsule -- common/autotest_common.sh@836 -- # local max_retries=100 00:14:06.097 11:25:01 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_no_in_capsule -- common/autotest_common.sh@838 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:14:06.097 11:25:01 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_no_in_capsule -- common/autotest_common.sh@840 -- # xtrace_disable 00:14:06.097 11:25:01 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_no_in_capsule -- common/autotest_common.sh@10 -- # set +x 00:14:06.097 [2024-10-07 11:25:01.220873] Starting SPDK v25.01-pre git sha1 2a4f56c54 / DPDK 24.03.0 initialization... 00:14:06.097 [2024-10-07 11:25:01.221001] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --iova-mode=pa --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:14:06.097 [2024-10-07 11:25:01.364533] app.c: 917:spdk_app_start: *NOTICE*: Total cores available: 4 00:14:06.097 [2024-10-07 11:25:01.522080] app.c: 610:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:14:06.097 [2024-10-07 11:25:01.522379] app.c: 611:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:14:06.097 [2024-10-07 11:25:01.522536] app.c: 616:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:14:06.097 [2024-10-07 11:25:01.522604] app.c: 617:app_setup_trace: *NOTICE*: SPDK application currently running. 00:14:06.097 [2024-10-07 11:25:01.522736] app.c: 618:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:14:06.097 [2024-10-07 11:25:01.524139] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 1 00:14:06.097 [2024-10-07 11:25:01.524234] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 2 00:14:06.097 [2024-10-07 11:25:01.527707] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 3 00:14:06.097 [2024-10-07 11:25:01.527725] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 0 00:14:07.031 11:25:02 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_no_in_capsule -- common/autotest_common.sh@860 -- # (( i == 0 )) 00:14:07.031 11:25:02 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_no_in_capsule -- common/autotest_common.sh@864 -- # return 0 00:14:07.032 11:25:02 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_no_in_capsule -- nvmf/common.sh@509 -- # timing_exit start_nvmf_tgt 00:14:07.032 11:25:02 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_no_in_capsule -- common/autotest_common.sh@730 -- # xtrace_disable 00:14:07.032 11:25:02 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_no_in_capsule -- common/autotest_common.sh@10 -- # set +x 00:14:07.032 11:25:02 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_no_in_capsule -- nvmf/common.sh@510 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:14:07.032 11:25:02 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_no_in_capsule -- target/filesystem.sh@50 -- # malloc_name=Malloc1 00:14:07.032 11:25:02 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_no_in_capsule -- target/filesystem.sh@52 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 -c 0 00:14:07.032 11:25:02 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_no_in_capsule -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:07.032 11:25:02 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_no_in_capsule -- common/autotest_common.sh@10 -- # set +x 00:14:07.032 [2024-10-07 11:25:02.357469] tcp.c: 738:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:14:07.032 11:25:02 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_no_in_capsule -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:07.032 11:25:02 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_no_in_capsule -- target/filesystem.sh@53 -- # rpc_cmd bdev_malloc_create 512 512 -b Malloc1 00:14:07.032 11:25:02 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_no_in_capsule -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:07.032 11:25:02 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_no_in_capsule -- common/autotest_common.sh@10 -- # set +x 00:14:07.032 Malloc1 00:14:07.032 11:25:02 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_no_in_capsule -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:07.032 11:25:02 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_no_in_capsule -- target/filesystem.sh@54 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDKISFASTANDAWESOME 00:14:07.032 11:25:02 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_no_in_capsule -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:07.032 11:25:02 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_no_in_capsule -- common/autotest_common.sh@10 -- # set +x 00:14:07.032 11:25:02 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_no_in_capsule -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:07.032 11:25:02 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_no_in_capsule -- target/filesystem.sh@55 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:14:07.032 11:25:02 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_no_in_capsule -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:07.032 11:25:02 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_no_in_capsule -- common/autotest_common.sh@10 -- # set +x 00:14:07.032 11:25:02 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_no_in_capsule -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:07.032 11:25:02 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_no_in_capsule -- target/filesystem.sh@56 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.3 -s 4420 00:14:07.032 11:25:02 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_no_in_capsule -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:07.032 11:25:02 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_no_in_capsule -- common/autotest_common.sh@10 -- # set +x 00:14:07.032 [2024-10-07 11:25:02.532806] tcp.c:1081:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.3 port 4420 *** 00:14:07.032 11:25:02 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_no_in_capsule -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:07.032 11:25:02 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_no_in_capsule -- target/filesystem.sh@58 -- # get_bdev_size Malloc1 00:14:07.032 11:25:02 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_no_in_capsule -- common/autotest_common.sh@1378 -- # local bdev_name=Malloc1 00:14:07.032 11:25:02 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_no_in_capsule -- common/autotest_common.sh@1379 -- # local bdev_info 00:14:07.032 11:25:02 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_no_in_capsule -- common/autotest_common.sh@1380 -- # local bs 00:14:07.032 11:25:02 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_no_in_capsule -- common/autotest_common.sh@1381 -- # local nb 00:14:07.032 11:25:02 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_no_in_capsule -- common/autotest_common.sh@1382 -- # rpc_cmd bdev_get_bdevs -b Malloc1 00:14:07.032 11:25:02 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_no_in_capsule -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:07.032 11:25:02 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_no_in_capsule -- common/autotest_common.sh@10 -- # set +x 00:14:07.290 11:25:02 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_no_in_capsule -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:07.290 11:25:02 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_no_in_capsule -- common/autotest_common.sh@1382 -- # bdev_info='[ 00:14:07.290 { 00:14:07.290 "aliases": [ 00:14:07.290 "504f4d10-8b70-4444-b98a-8157b354c34e" 00:14:07.290 ], 00:14:07.290 "assigned_rate_limits": { 00:14:07.290 "r_mbytes_per_sec": 0, 00:14:07.290 "rw_ios_per_sec": 0, 00:14:07.290 "rw_mbytes_per_sec": 0, 00:14:07.290 "w_mbytes_per_sec": 0 00:14:07.290 }, 00:14:07.290 "block_size": 512, 00:14:07.290 "claim_type": "exclusive_write", 00:14:07.290 "claimed": true, 00:14:07.290 "driver_specific": {}, 00:14:07.290 "memory_domains": [ 00:14:07.290 { 00:14:07.290 "dma_device_id": "system", 00:14:07.290 "dma_device_type": 1 00:14:07.290 }, 00:14:07.290 { 00:14:07.290 "dma_device_id": "SPDK_ACCEL_DMA_DEVICE", 00:14:07.290 "dma_device_type": 2 00:14:07.290 } 00:14:07.290 ], 00:14:07.290 "name": "Malloc1", 00:14:07.290 "num_blocks": 1048576, 00:14:07.290 "product_name": "Malloc disk", 00:14:07.290 "supported_io_types": { 00:14:07.290 "abort": true, 00:14:07.290 "compare": false, 00:14:07.290 "compare_and_write": false, 00:14:07.290 "copy": true, 00:14:07.290 "flush": true, 00:14:07.290 "get_zone_info": false, 00:14:07.290 "nvme_admin": false, 00:14:07.290 "nvme_io": false, 00:14:07.290 "nvme_io_md": false, 00:14:07.290 "nvme_iov_md": false, 00:14:07.290 "read": true, 00:14:07.290 "reset": true, 00:14:07.290 "seek_data": false, 00:14:07.290 "seek_hole": false, 00:14:07.290 "unmap": true, 00:14:07.290 "write": true, 00:14:07.290 "write_zeroes": true, 00:14:07.290 "zcopy": true, 00:14:07.290 "zone_append": false, 00:14:07.290 "zone_management": false 00:14:07.290 }, 00:14:07.290 "uuid": "504f4d10-8b70-4444-b98a-8157b354c34e", 00:14:07.290 "zoned": false 00:14:07.290 } 00:14:07.290 ]' 00:14:07.290 11:25:02 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_no_in_capsule -- common/autotest_common.sh@1383 -- # jq '.[] .block_size' 00:14:07.290 11:25:02 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_no_in_capsule -- common/autotest_common.sh@1383 -- # bs=512 00:14:07.290 11:25:02 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_no_in_capsule -- common/autotest_common.sh@1384 -- # jq '.[] .num_blocks' 00:14:07.290 11:25:02 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_no_in_capsule -- common/autotest_common.sh@1384 -- # nb=1048576 00:14:07.290 11:25:02 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_no_in_capsule -- common/autotest_common.sh@1387 -- # bdev_size=512 00:14:07.290 11:25:02 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_no_in_capsule -- common/autotest_common.sh@1388 -- # echo 512 00:14:07.290 11:25:02 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_no_in_capsule -- target/filesystem.sh@58 -- # malloc_size=536870912 00:14:07.290 11:25:02 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_no_in_capsule -- target/filesystem.sh@60 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:c758a4ed-f09f-4c82-9afb-3d096f035464 --hostid=c758a4ed-f09f-4c82-9afb-3d096f035464 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.3 -s 4420 00:14:07.548 11:25:02 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_no_in_capsule -- target/filesystem.sh@62 -- # waitforserial SPDKISFASTANDAWESOME 00:14:07.548 11:25:02 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_no_in_capsule -- common/autotest_common.sh@1198 -- # local i=0 00:14:07.548 11:25:02 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_no_in_capsule -- common/autotest_common.sh@1199 -- # local nvme_device_counter=1 nvme_devices=0 00:14:07.548 11:25:02 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_no_in_capsule -- common/autotest_common.sh@1200 -- # [[ -n '' ]] 00:14:07.548 11:25:02 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_no_in_capsule -- common/autotest_common.sh@1205 -- # sleep 2 00:14:09.490 11:25:04 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_no_in_capsule -- common/autotest_common.sh@1206 -- # (( i++ <= 15 )) 00:14:09.490 11:25:04 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_no_in_capsule -- common/autotest_common.sh@1207 -- # grep -c SPDKISFASTANDAWESOME 00:14:09.490 11:25:04 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_no_in_capsule -- common/autotest_common.sh@1207 -- # lsblk -l -o NAME,SERIAL 00:14:09.490 11:25:04 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_no_in_capsule -- common/autotest_common.sh@1207 -- # nvme_devices=1 00:14:09.490 11:25:04 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_no_in_capsule -- common/autotest_common.sh@1208 -- # (( nvme_devices == nvme_device_counter )) 00:14:09.490 11:25:04 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_no_in_capsule -- common/autotest_common.sh@1208 -- # return 0 00:14:09.490 11:25:04 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_no_in_capsule -- target/filesystem.sh@63 -- # lsblk -l -o NAME,SERIAL 00:14:09.490 11:25:04 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_no_in_capsule -- target/filesystem.sh@63 -- # grep -oP '([\w]*)(?=\s+SPDKISFASTANDAWESOME)' 00:14:09.490 11:25:04 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_no_in_capsule -- target/filesystem.sh@63 -- # nvme_name=nvme0n1 00:14:09.490 11:25:04 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_no_in_capsule -- target/filesystem.sh@64 -- # sec_size_to_bytes nvme0n1 00:14:09.490 11:25:04 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_no_in_capsule -- setup/common.sh@76 -- # local dev=nvme0n1 00:14:09.490 11:25:04 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_no_in_capsule -- setup/common.sh@78 -- # [[ -e /sys/block/nvme0n1 ]] 00:14:09.490 11:25:04 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_no_in_capsule -- setup/common.sh@80 -- # echo 536870912 00:14:09.490 11:25:04 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_no_in_capsule -- target/filesystem.sh@64 -- # nvme_size=536870912 00:14:09.490 11:25:04 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_no_in_capsule -- target/filesystem.sh@66 -- # mkdir -p /mnt/device 00:14:09.490 11:25:04 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_no_in_capsule -- target/filesystem.sh@67 -- # (( nvme_size == malloc_size )) 00:14:09.490 11:25:04 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_no_in_capsule -- target/filesystem.sh@68 -- # parted -s /dev/nvme0n1 mklabel gpt mkpart SPDK_TEST 0% 100% 00:14:09.490 11:25:04 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_no_in_capsule -- target/filesystem.sh@69 -- # partprobe 00:14:09.490 11:25:04 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_no_in_capsule -- target/filesystem.sh@70 -- # sleep 1 00:14:10.863 11:25:05 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_no_in_capsule -- target/filesystem.sh@76 -- # '[' 0 -eq 0 ']' 00:14:10.863 11:25:05 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_no_in_capsule -- target/filesystem.sh@77 -- # run_test filesystem_ext4 nvmf_filesystem_create ext4 nvme0n1 00:14:10.863 11:25:05 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_no_in_capsule -- common/autotest_common.sh@1101 -- # '[' 4 -le 1 ']' 00:14:10.863 11:25:05 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_no_in_capsule -- common/autotest_common.sh@1107 -- # xtrace_disable 00:14:10.863 11:25:05 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_no_in_capsule -- common/autotest_common.sh@10 -- # set +x 00:14:10.863 ************************************ 00:14:10.863 START TEST filesystem_ext4 00:14:10.863 ************************************ 00:14:10.863 11:25:06 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_no_in_capsule.filesystem_ext4 -- common/autotest_common.sh@1125 -- # nvmf_filesystem_create ext4 nvme0n1 00:14:10.863 11:25:06 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_no_in_capsule.filesystem_ext4 -- target/filesystem.sh@18 -- # fstype=ext4 00:14:10.863 11:25:06 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_no_in_capsule.filesystem_ext4 -- target/filesystem.sh@19 -- # nvme_name=nvme0n1 00:14:10.863 11:25:06 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_no_in_capsule.filesystem_ext4 -- target/filesystem.sh@21 -- # make_filesystem ext4 /dev/nvme0n1p1 00:14:10.863 11:25:06 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_no_in_capsule.filesystem_ext4 -- common/autotest_common.sh@926 -- # local fstype=ext4 00:14:10.863 11:25:06 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_no_in_capsule.filesystem_ext4 -- common/autotest_common.sh@927 -- # local dev_name=/dev/nvme0n1p1 00:14:10.863 11:25:06 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_no_in_capsule.filesystem_ext4 -- common/autotest_common.sh@928 -- # local i=0 00:14:10.863 11:25:06 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_no_in_capsule.filesystem_ext4 -- common/autotest_common.sh@929 -- # local force 00:14:10.863 11:25:06 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_no_in_capsule.filesystem_ext4 -- common/autotest_common.sh@931 -- # '[' ext4 = ext4 ']' 00:14:10.863 11:25:06 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_no_in_capsule.filesystem_ext4 -- common/autotest_common.sh@932 -- # force=-F 00:14:10.863 11:25:06 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_no_in_capsule.filesystem_ext4 -- common/autotest_common.sh@937 -- # mkfs.ext4 -F /dev/nvme0n1p1 00:14:10.863 mke2fs 1.47.0 (5-Feb-2023) 00:14:10.863 Discarding device blocks: 0/522240 done 00:14:10.863 Creating filesystem with 522240 1k blocks and 130560 inodes 00:14:10.863 Filesystem UUID: 16439872-0406-48f1-a403-760ccf90813d 00:14:10.863 Superblock backups stored on blocks: 00:14:10.863 8193, 24577, 40961, 57345, 73729, 204801, 221185, 401409 00:14:10.863 00:14:10.863 Allocating group tables: 0/64 done 00:14:10.863 Writing inode tables: 0/64 done 00:14:10.863 Creating journal (8192 blocks): done 00:14:10.863 Writing superblocks and filesystem accounting information: 0/64 done 00:14:10.863 00:14:10.863 11:25:06 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_no_in_capsule.filesystem_ext4 -- common/autotest_common.sh@945 -- # return 0 00:14:10.863 11:25:06 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_no_in_capsule.filesystem_ext4 -- target/filesystem.sh@23 -- # mount /dev/nvme0n1p1 /mnt/device 00:14:16.122 11:25:11 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_no_in_capsule.filesystem_ext4 -- target/filesystem.sh@24 -- # touch /mnt/device/aaa 00:14:16.122 11:25:11 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_no_in_capsule.filesystem_ext4 -- target/filesystem.sh@25 -- # sync 00:14:16.122 11:25:11 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_no_in_capsule.filesystem_ext4 -- target/filesystem.sh@26 -- # rm /mnt/device/aaa 00:14:16.122 11:25:11 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_no_in_capsule.filesystem_ext4 -- target/filesystem.sh@27 -- # sync 00:14:16.122 11:25:11 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_no_in_capsule.filesystem_ext4 -- target/filesystem.sh@29 -- # i=0 00:14:16.122 11:25:11 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_no_in_capsule.filesystem_ext4 -- target/filesystem.sh@30 -- # umount /mnt/device 00:14:16.122 11:25:11 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_no_in_capsule.filesystem_ext4 -- target/filesystem.sh@37 -- # kill -0 71996 00:14:16.122 11:25:11 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_no_in_capsule.filesystem_ext4 -- target/filesystem.sh@40 -- # lsblk -l -o NAME 00:14:16.122 11:25:11 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_no_in_capsule.filesystem_ext4 -- target/filesystem.sh@40 -- # grep -q -w nvme0n1 00:14:16.122 11:25:11 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_no_in_capsule.filesystem_ext4 -- target/filesystem.sh@43 -- # lsblk -l -o NAME 00:14:16.122 11:25:11 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_no_in_capsule.filesystem_ext4 -- target/filesystem.sh@43 -- # grep -q -w nvme0n1p1 00:14:16.122 00:14:16.122 real 0m5.616s 00:14:16.122 user 0m0.028s 00:14:16.122 sys 0m0.058s 00:14:16.122 11:25:11 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_no_in_capsule.filesystem_ext4 -- common/autotest_common.sh@1126 -- # xtrace_disable 00:14:16.122 ************************************ 00:14:16.122 END TEST filesystem_ext4 00:14:16.122 ************************************ 00:14:16.122 11:25:11 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_no_in_capsule.filesystem_ext4 -- common/autotest_common.sh@10 -- # set +x 00:14:16.381 11:25:11 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_no_in_capsule -- target/filesystem.sh@78 -- # run_test filesystem_btrfs nvmf_filesystem_create btrfs nvme0n1 00:14:16.381 11:25:11 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_no_in_capsule -- common/autotest_common.sh@1101 -- # '[' 4 -le 1 ']' 00:14:16.381 11:25:11 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_no_in_capsule -- common/autotest_common.sh@1107 -- # xtrace_disable 00:14:16.381 11:25:11 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_no_in_capsule -- common/autotest_common.sh@10 -- # set +x 00:14:16.381 ************************************ 00:14:16.381 START TEST filesystem_btrfs 00:14:16.381 ************************************ 00:14:16.381 11:25:11 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_no_in_capsule.filesystem_btrfs -- common/autotest_common.sh@1125 -- # nvmf_filesystem_create btrfs nvme0n1 00:14:16.381 11:25:11 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_no_in_capsule.filesystem_btrfs -- target/filesystem.sh@18 -- # fstype=btrfs 00:14:16.381 11:25:11 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_no_in_capsule.filesystem_btrfs -- target/filesystem.sh@19 -- # nvme_name=nvme0n1 00:14:16.381 11:25:11 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_no_in_capsule.filesystem_btrfs -- target/filesystem.sh@21 -- # make_filesystem btrfs /dev/nvme0n1p1 00:14:16.381 11:25:11 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_no_in_capsule.filesystem_btrfs -- common/autotest_common.sh@926 -- # local fstype=btrfs 00:14:16.381 11:25:11 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_no_in_capsule.filesystem_btrfs -- common/autotest_common.sh@927 -- # local dev_name=/dev/nvme0n1p1 00:14:16.381 11:25:11 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_no_in_capsule.filesystem_btrfs -- common/autotest_common.sh@928 -- # local i=0 00:14:16.381 11:25:11 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_no_in_capsule.filesystem_btrfs -- common/autotest_common.sh@929 -- # local force 00:14:16.381 11:25:11 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_no_in_capsule.filesystem_btrfs -- common/autotest_common.sh@931 -- # '[' btrfs = ext4 ']' 00:14:16.381 11:25:11 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_no_in_capsule.filesystem_btrfs -- common/autotest_common.sh@934 -- # force=-f 00:14:16.381 11:25:11 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_no_in_capsule.filesystem_btrfs -- common/autotest_common.sh@937 -- # mkfs.btrfs -f /dev/nvme0n1p1 00:14:16.381 btrfs-progs v6.8.1 00:14:16.381 See https://btrfs.readthedocs.io for more information. 00:14:16.381 00:14:16.381 Performing full device TRIM /dev/nvme0n1p1 (510.00MiB) ... 00:14:16.381 NOTE: several default settings have changed in version 5.15, please make sure 00:14:16.381 this does not affect your deployments: 00:14:16.381 - DUP for metadata (-m dup) 00:14:16.381 - enabled no-holes (-O no-holes) 00:14:16.381 - enabled free-space-tree (-R free-space-tree) 00:14:16.381 00:14:16.381 Label: (null) 00:14:16.381 UUID: 9cf22440-42e3-4abf-80b0-5dfc3203c705 00:14:16.381 Node size: 16384 00:14:16.381 Sector size: 4096 (CPU page size: 4096) 00:14:16.381 Filesystem size: 510.00MiB 00:14:16.381 Block group profiles: 00:14:16.381 Data: single 8.00MiB 00:14:16.381 Metadata: DUP 32.00MiB 00:14:16.381 System: DUP 8.00MiB 00:14:16.381 SSD detected: yes 00:14:16.381 Zoned device: no 00:14:16.381 Features: extref, skinny-metadata, no-holes, free-space-tree 00:14:16.381 Checksum: crc32c 00:14:16.381 Number of devices: 1 00:14:16.381 Devices: 00:14:16.381 ID SIZE PATH 00:14:16.381 1 510.00MiB /dev/nvme0n1p1 00:14:16.381 00:14:16.381 11:25:11 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_no_in_capsule.filesystem_btrfs -- common/autotest_common.sh@945 -- # return 0 00:14:16.381 11:25:11 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_no_in_capsule.filesystem_btrfs -- target/filesystem.sh@23 -- # mount /dev/nvme0n1p1 /mnt/device 00:14:16.381 11:25:11 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_no_in_capsule.filesystem_btrfs -- target/filesystem.sh@24 -- # touch /mnt/device/aaa 00:14:16.381 11:25:11 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_no_in_capsule.filesystem_btrfs -- target/filesystem.sh@25 -- # sync 00:14:16.381 11:25:11 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_no_in_capsule.filesystem_btrfs -- target/filesystem.sh@26 -- # rm /mnt/device/aaa 00:14:16.381 11:25:11 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_no_in_capsule.filesystem_btrfs -- target/filesystem.sh@27 -- # sync 00:14:16.381 11:25:11 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_no_in_capsule.filesystem_btrfs -- target/filesystem.sh@29 -- # i=0 00:14:16.381 11:25:11 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_no_in_capsule.filesystem_btrfs -- target/filesystem.sh@30 -- # umount /mnt/device 00:14:16.381 11:25:11 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_no_in_capsule.filesystem_btrfs -- target/filesystem.sh@37 -- # kill -0 71996 00:14:16.381 11:25:11 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_no_in_capsule.filesystem_btrfs -- target/filesystem.sh@40 -- # lsblk -l -o NAME 00:14:16.381 11:25:11 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_no_in_capsule.filesystem_btrfs -- target/filesystem.sh@40 -- # grep -q -w nvme0n1 00:14:16.381 11:25:11 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_no_in_capsule.filesystem_btrfs -- target/filesystem.sh@43 -- # lsblk -l -o NAME 00:14:16.381 11:25:11 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_no_in_capsule.filesystem_btrfs -- target/filesystem.sh@43 -- # grep -q -w nvme0n1p1 00:14:16.381 ************************************ 00:14:16.381 END TEST filesystem_btrfs 00:14:16.381 ************************************ 00:14:16.381 00:14:16.381 real 0m0.214s 00:14:16.381 user 0m0.017s 00:14:16.381 sys 0m0.056s 00:14:16.381 11:25:11 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_no_in_capsule.filesystem_btrfs -- common/autotest_common.sh@1126 -- # xtrace_disable 00:14:16.381 11:25:11 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_no_in_capsule.filesystem_btrfs -- common/autotest_common.sh@10 -- # set +x 00:14:16.640 11:25:11 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_no_in_capsule -- target/filesystem.sh@79 -- # run_test filesystem_xfs nvmf_filesystem_create xfs nvme0n1 00:14:16.640 11:25:11 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_no_in_capsule -- common/autotest_common.sh@1101 -- # '[' 4 -le 1 ']' 00:14:16.640 11:25:11 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_no_in_capsule -- common/autotest_common.sh@1107 -- # xtrace_disable 00:14:16.640 11:25:11 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_no_in_capsule -- common/autotest_common.sh@10 -- # set +x 00:14:16.640 ************************************ 00:14:16.640 START TEST filesystem_xfs 00:14:16.640 ************************************ 00:14:16.640 11:25:11 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_no_in_capsule.filesystem_xfs -- common/autotest_common.sh@1125 -- # nvmf_filesystem_create xfs nvme0n1 00:14:16.640 11:25:11 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_no_in_capsule.filesystem_xfs -- target/filesystem.sh@18 -- # fstype=xfs 00:14:16.640 11:25:11 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_no_in_capsule.filesystem_xfs -- target/filesystem.sh@19 -- # nvme_name=nvme0n1 00:14:16.640 11:25:11 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_no_in_capsule.filesystem_xfs -- target/filesystem.sh@21 -- # make_filesystem xfs /dev/nvme0n1p1 00:14:16.640 11:25:11 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_no_in_capsule.filesystem_xfs -- common/autotest_common.sh@926 -- # local fstype=xfs 00:14:16.640 11:25:11 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_no_in_capsule.filesystem_xfs -- common/autotest_common.sh@927 -- # local dev_name=/dev/nvme0n1p1 00:14:16.640 11:25:11 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_no_in_capsule.filesystem_xfs -- common/autotest_common.sh@928 -- # local i=0 00:14:16.640 11:25:11 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_no_in_capsule.filesystem_xfs -- common/autotest_common.sh@929 -- # local force 00:14:16.640 11:25:11 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_no_in_capsule.filesystem_xfs -- common/autotest_common.sh@931 -- # '[' xfs = ext4 ']' 00:14:16.640 11:25:11 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_no_in_capsule.filesystem_xfs -- common/autotest_common.sh@934 -- # force=-f 00:14:16.640 11:25:11 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_no_in_capsule.filesystem_xfs -- common/autotest_common.sh@937 -- # mkfs.xfs -f /dev/nvme0n1p1 00:14:16.640 meta-data=/dev/nvme0n1p1 isize=512 agcount=4, agsize=32640 blks 00:14:16.640 = sectsz=512 attr=2, projid32bit=1 00:14:16.640 = crc=1 finobt=1, sparse=1, rmapbt=0 00:14:16.640 = reflink=1 bigtime=1 inobtcount=1 nrext64=0 00:14:16.640 data = bsize=4096 blocks=130560, imaxpct=25 00:14:16.640 = sunit=0 swidth=0 blks 00:14:16.640 naming =version 2 bsize=4096 ascii-ci=0, ftype=1 00:14:16.640 log =internal log bsize=4096 blocks=16384, version=2 00:14:16.640 = sectsz=512 sunit=0 blks, lazy-count=1 00:14:16.640 realtime =none extsz=4096 blocks=0, rtextents=0 00:14:17.205 Discarding blocks...Done. 00:14:17.205 11:25:12 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_no_in_capsule.filesystem_xfs -- common/autotest_common.sh@945 -- # return 0 00:14:17.205 11:25:12 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_no_in_capsule.filesystem_xfs -- target/filesystem.sh@23 -- # mount /dev/nvme0n1p1 /mnt/device 00:14:19.771 11:25:14 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_no_in_capsule.filesystem_xfs -- target/filesystem.sh@24 -- # touch /mnt/device/aaa 00:14:19.771 11:25:14 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_no_in_capsule.filesystem_xfs -- target/filesystem.sh@25 -- # sync 00:14:19.771 11:25:15 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_no_in_capsule.filesystem_xfs -- target/filesystem.sh@26 -- # rm /mnt/device/aaa 00:14:19.771 11:25:15 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_no_in_capsule.filesystem_xfs -- target/filesystem.sh@27 -- # sync 00:14:19.771 11:25:15 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_no_in_capsule.filesystem_xfs -- target/filesystem.sh@29 -- # i=0 00:14:19.771 11:25:15 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_no_in_capsule.filesystem_xfs -- target/filesystem.sh@30 -- # umount /mnt/device 00:14:19.771 11:25:15 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_no_in_capsule.filesystem_xfs -- target/filesystem.sh@37 -- # kill -0 71996 00:14:19.771 11:25:15 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_no_in_capsule.filesystem_xfs -- target/filesystem.sh@40 -- # lsblk -l -o NAME 00:14:19.771 11:25:15 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_no_in_capsule.filesystem_xfs -- target/filesystem.sh@40 -- # grep -q -w nvme0n1 00:14:19.771 11:25:15 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_no_in_capsule.filesystem_xfs -- target/filesystem.sh@43 -- # lsblk -l -o NAME 00:14:19.771 11:25:15 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_no_in_capsule.filesystem_xfs -- target/filesystem.sh@43 -- # grep -q -w nvme0n1p1 00:14:19.771 ************************************ 00:14:19.771 END TEST filesystem_xfs 00:14:19.771 ************************************ 00:14:19.771 00:14:19.771 real 0m3.122s 00:14:19.771 user 0m0.031s 00:14:19.771 sys 0m0.046s 00:14:19.771 11:25:15 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_no_in_capsule.filesystem_xfs -- common/autotest_common.sh@1126 -- # xtrace_disable 00:14:19.771 11:25:15 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_no_in_capsule.filesystem_xfs -- common/autotest_common.sh@10 -- # set +x 00:14:19.771 11:25:15 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_no_in_capsule -- target/filesystem.sh@91 -- # flock /dev/nvme0n1 parted -s /dev/nvme0n1 rm 1 00:14:19.771 11:25:15 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_no_in_capsule -- target/filesystem.sh@93 -- # sync 00:14:19.771 11:25:15 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_no_in_capsule -- target/filesystem.sh@94 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:14:19.771 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:14:19.771 11:25:15 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_no_in_capsule -- target/filesystem.sh@95 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:14:19.771 11:25:15 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_no_in_capsule -- common/autotest_common.sh@1219 -- # local i=0 00:14:19.771 11:25:15 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_no_in_capsule -- common/autotest_common.sh@1220 -- # lsblk -o NAME,SERIAL 00:14:19.771 11:25:15 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_no_in_capsule -- common/autotest_common.sh@1220 -- # grep -q -w SPDKISFASTANDAWESOME 00:14:19.771 11:25:15 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_no_in_capsule -- common/autotest_common.sh@1227 -- # lsblk -l -o NAME,SERIAL 00:14:19.771 11:25:15 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_no_in_capsule -- common/autotest_common.sh@1227 -- # grep -q -w SPDKISFASTANDAWESOME 00:14:19.771 11:25:15 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_no_in_capsule -- common/autotest_common.sh@1231 -- # return 0 00:14:19.771 11:25:15 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_no_in_capsule -- target/filesystem.sh@97 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:14:19.771 11:25:15 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_no_in_capsule -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:19.771 11:25:15 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_no_in_capsule -- common/autotest_common.sh@10 -- # set +x 00:14:19.771 11:25:15 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_no_in_capsule -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:19.771 11:25:15 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_no_in_capsule -- target/filesystem.sh@99 -- # trap - SIGINT SIGTERM EXIT 00:14:19.771 11:25:15 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_no_in_capsule -- target/filesystem.sh@101 -- # killprocess 71996 00:14:19.771 11:25:15 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_no_in_capsule -- common/autotest_common.sh@950 -- # '[' -z 71996 ']' 00:14:19.771 11:25:15 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_no_in_capsule -- common/autotest_common.sh@954 -- # kill -0 71996 00:14:19.771 11:25:15 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_no_in_capsule -- common/autotest_common.sh@955 -- # uname 00:14:19.771 11:25:15 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_no_in_capsule -- common/autotest_common.sh@955 -- # '[' Linux = Linux ']' 00:14:19.771 11:25:15 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_no_in_capsule -- common/autotest_common.sh@956 -- # ps --no-headers -o comm= 71996 00:14:19.771 killing process with pid 71996 00:14:19.771 11:25:15 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_no_in_capsule -- common/autotest_common.sh@956 -- # process_name=reactor_0 00:14:19.771 11:25:15 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_no_in_capsule -- common/autotest_common.sh@960 -- # '[' reactor_0 = sudo ']' 00:14:19.771 11:25:15 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_no_in_capsule -- common/autotest_common.sh@968 -- # echo 'killing process with pid 71996' 00:14:19.771 11:25:15 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_no_in_capsule -- common/autotest_common.sh@969 -- # kill 71996 00:14:19.772 11:25:15 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_no_in_capsule -- common/autotest_common.sh@974 -- # wait 71996 00:14:20.337 ************************************ 00:14:20.337 END TEST nvmf_filesystem_no_in_capsule 00:14:20.337 ************************************ 00:14:20.337 11:25:15 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_no_in_capsule -- target/filesystem.sh@102 -- # nvmfpid= 00:14:20.337 00:14:20.337 real 0m14.490s 00:14:20.337 user 0m55.192s 00:14:20.337 sys 0m2.019s 00:14:20.337 11:25:15 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_no_in_capsule -- common/autotest_common.sh@1126 -- # xtrace_disable 00:14:20.337 11:25:15 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_no_in_capsule -- common/autotest_common.sh@10 -- # set +x 00:14:20.337 11:25:15 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- target/filesystem.sh@106 -- # run_test nvmf_filesystem_in_capsule nvmf_filesystem_part 4096 00:14:20.337 11:25:15 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@1101 -- # '[' 3 -le 1 ']' 00:14:20.337 11:25:15 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@1107 -- # xtrace_disable 00:14:20.337 11:25:15 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@10 -- # set +x 00:14:20.337 ************************************ 00:14:20.337 START TEST nvmf_filesystem_in_capsule 00:14:20.337 ************************************ 00:14:20.337 11:25:15 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_in_capsule -- common/autotest_common.sh@1125 -- # nvmf_filesystem_part 4096 00:14:20.337 11:25:15 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_in_capsule -- target/filesystem.sh@47 -- # in_capsule=4096 00:14:20.337 11:25:15 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_in_capsule -- target/filesystem.sh@49 -- # nvmfappstart -m 0xF 00:14:20.337 11:25:15 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_in_capsule -- nvmf/common.sh@505 -- # timing_enter start_nvmf_tgt 00:14:20.337 11:25:15 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_in_capsule -- common/autotest_common.sh@724 -- # xtrace_disable 00:14:20.337 11:25:15 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_in_capsule -- common/autotest_common.sh@10 -- # set +x 00:14:20.337 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:14:20.337 11:25:15 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_in_capsule -- nvmf/common.sh@507 -- # nvmfpid=72363 00:14:20.337 11:25:15 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_in_capsule -- nvmf/common.sh@506 -- # ip netns exec nvmf_tgt_ns_spdk /home/vagrant/spdk_repo/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:14:20.337 11:25:15 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_in_capsule -- nvmf/common.sh@508 -- # waitforlisten 72363 00:14:20.337 11:25:15 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_in_capsule -- common/autotest_common.sh@831 -- # '[' -z 72363 ']' 00:14:20.337 11:25:15 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_in_capsule -- common/autotest_common.sh@835 -- # local rpc_addr=/var/tmp/spdk.sock 00:14:20.337 11:25:15 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_in_capsule -- common/autotest_common.sh@836 -- # local max_retries=100 00:14:20.337 11:25:15 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_in_capsule -- common/autotest_common.sh@838 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:14:20.337 11:25:15 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_in_capsule -- common/autotest_common.sh@840 -- # xtrace_disable 00:14:20.338 11:25:15 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_in_capsule -- common/autotest_common.sh@10 -- # set +x 00:14:20.338 [2024-10-07 11:25:15.770061] Starting SPDK v25.01-pre git sha1 2a4f56c54 / DPDK 24.03.0 initialization... 00:14:20.338 [2024-10-07 11:25:15.770745] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --iova-mode=pa --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:14:20.595 [2024-10-07 11:25:15.919144] app.c: 917:spdk_app_start: *NOTICE*: Total cores available: 4 00:14:20.595 [2024-10-07 11:25:16.030702] app.c: 610:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:14:20.595 [2024-10-07 11:25:16.031022] app.c: 611:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:14:20.595 [2024-10-07 11:25:16.031162] app.c: 616:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:14:20.595 [2024-10-07 11:25:16.031216] app.c: 617:app_setup_trace: *NOTICE*: SPDK application currently running. 00:14:20.595 [2024-10-07 11:25:16.031246] app.c: 618:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:14:20.595 [2024-10-07 11:25:16.032555] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 1 00:14:20.595 [2024-10-07 11:25:16.032721] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 2 00:14:20.595 [2024-10-07 11:25:16.032867] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 0 00:14:20.595 [2024-10-07 11:25:16.032792] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 3 00:14:21.528 11:25:16 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_in_capsule -- common/autotest_common.sh@860 -- # (( i == 0 )) 00:14:21.528 11:25:16 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_in_capsule -- common/autotest_common.sh@864 -- # return 0 00:14:21.528 11:25:16 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_in_capsule -- nvmf/common.sh@509 -- # timing_exit start_nvmf_tgt 00:14:21.528 11:25:16 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_in_capsule -- common/autotest_common.sh@730 -- # xtrace_disable 00:14:21.528 11:25:16 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_in_capsule -- common/autotest_common.sh@10 -- # set +x 00:14:21.528 11:25:16 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_in_capsule -- nvmf/common.sh@510 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:14:21.528 11:25:16 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_in_capsule -- target/filesystem.sh@50 -- # malloc_name=Malloc1 00:14:21.528 11:25:16 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_in_capsule -- target/filesystem.sh@52 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 -c 4096 00:14:21.528 11:25:16 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_in_capsule -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:21.528 11:25:16 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_in_capsule -- common/autotest_common.sh@10 -- # set +x 00:14:21.528 [2024-10-07 11:25:16.895094] tcp.c: 738:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:14:21.528 11:25:16 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_in_capsule -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:21.528 11:25:16 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_in_capsule -- target/filesystem.sh@53 -- # rpc_cmd bdev_malloc_create 512 512 -b Malloc1 00:14:21.528 11:25:16 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_in_capsule -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:21.528 11:25:16 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_in_capsule -- common/autotest_common.sh@10 -- # set +x 00:14:21.528 Malloc1 00:14:21.528 11:25:17 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_in_capsule -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:21.528 11:25:17 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_in_capsule -- target/filesystem.sh@54 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDKISFASTANDAWESOME 00:14:21.528 11:25:17 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_in_capsule -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:21.528 11:25:17 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_in_capsule -- common/autotest_common.sh@10 -- # set +x 00:14:21.786 11:25:17 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_in_capsule -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:21.786 11:25:17 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_in_capsule -- target/filesystem.sh@55 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:14:21.786 11:25:17 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_in_capsule -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:21.786 11:25:17 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_in_capsule -- common/autotest_common.sh@10 -- # set +x 00:14:21.786 11:25:17 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_in_capsule -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:21.786 11:25:17 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_in_capsule -- target/filesystem.sh@56 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.3 -s 4420 00:14:21.786 11:25:17 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_in_capsule -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:21.786 11:25:17 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_in_capsule -- common/autotest_common.sh@10 -- # set +x 00:14:21.786 [2024-10-07 11:25:17.076115] tcp.c:1081:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.3 port 4420 *** 00:14:21.786 11:25:17 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_in_capsule -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:21.786 11:25:17 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_in_capsule -- target/filesystem.sh@58 -- # get_bdev_size Malloc1 00:14:21.786 11:25:17 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_in_capsule -- common/autotest_common.sh@1378 -- # local bdev_name=Malloc1 00:14:21.786 11:25:17 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_in_capsule -- common/autotest_common.sh@1379 -- # local bdev_info 00:14:21.786 11:25:17 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_in_capsule -- common/autotest_common.sh@1380 -- # local bs 00:14:21.786 11:25:17 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_in_capsule -- common/autotest_common.sh@1381 -- # local nb 00:14:21.786 11:25:17 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_in_capsule -- common/autotest_common.sh@1382 -- # rpc_cmd bdev_get_bdevs -b Malloc1 00:14:21.786 11:25:17 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_in_capsule -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:21.786 11:25:17 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_in_capsule -- common/autotest_common.sh@10 -- # set +x 00:14:21.786 11:25:17 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_in_capsule -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:21.786 11:25:17 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_in_capsule -- common/autotest_common.sh@1382 -- # bdev_info='[ 00:14:21.786 { 00:14:21.786 "aliases": [ 00:14:21.786 "e0dd5415-c6be-49c0-928f-f71fd142e3eb" 00:14:21.786 ], 00:14:21.786 "assigned_rate_limits": { 00:14:21.786 "r_mbytes_per_sec": 0, 00:14:21.786 "rw_ios_per_sec": 0, 00:14:21.786 "rw_mbytes_per_sec": 0, 00:14:21.786 "w_mbytes_per_sec": 0 00:14:21.786 }, 00:14:21.786 "block_size": 512, 00:14:21.786 "claim_type": "exclusive_write", 00:14:21.786 "claimed": true, 00:14:21.786 "driver_specific": {}, 00:14:21.786 "memory_domains": [ 00:14:21.786 { 00:14:21.786 "dma_device_id": "system", 00:14:21.786 "dma_device_type": 1 00:14:21.786 }, 00:14:21.786 { 00:14:21.786 "dma_device_id": "SPDK_ACCEL_DMA_DEVICE", 00:14:21.786 "dma_device_type": 2 00:14:21.786 } 00:14:21.786 ], 00:14:21.786 "name": "Malloc1", 00:14:21.786 "num_blocks": 1048576, 00:14:21.786 "product_name": "Malloc disk", 00:14:21.786 "supported_io_types": { 00:14:21.786 "abort": true, 00:14:21.786 "compare": false, 00:14:21.786 "compare_and_write": false, 00:14:21.786 "copy": true, 00:14:21.786 "flush": true, 00:14:21.786 "get_zone_info": false, 00:14:21.786 "nvme_admin": false, 00:14:21.786 "nvme_io": false, 00:14:21.786 "nvme_io_md": false, 00:14:21.786 "nvme_iov_md": false, 00:14:21.786 "read": true, 00:14:21.786 "reset": true, 00:14:21.786 "seek_data": false, 00:14:21.786 "seek_hole": false, 00:14:21.786 "unmap": true, 00:14:21.786 "write": true, 00:14:21.786 "write_zeroes": true, 00:14:21.786 "zcopy": true, 00:14:21.786 "zone_append": false, 00:14:21.786 "zone_management": false 00:14:21.786 }, 00:14:21.786 "uuid": "e0dd5415-c6be-49c0-928f-f71fd142e3eb", 00:14:21.786 "zoned": false 00:14:21.786 } 00:14:21.786 ]' 00:14:21.786 11:25:17 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_in_capsule -- common/autotest_common.sh@1383 -- # jq '.[] .block_size' 00:14:21.786 11:25:17 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_in_capsule -- common/autotest_common.sh@1383 -- # bs=512 00:14:21.786 11:25:17 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_in_capsule -- common/autotest_common.sh@1384 -- # jq '.[] .num_blocks' 00:14:21.786 11:25:17 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_in_capsule -- common/autotest_common.sh@1384 -- # nb=1048576 00:14:21.786 11:25:17 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_in_capsule -- common/autotest_common.sh@1387 -- # bdev_size=512 00:14:21.786 11:25:17 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_in_capsule -- common/autotest_common.sh@1388 -- # echo 512 00:14:21.786 11:25:17 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_in_capsule -- target/filesystem.sh@58 -- # malloc_size=536870912 00:14:21.786 11:25:17 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_in_capsule -- target/filesystem.sh@60 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:c758a4ed-f09f-4c82-9afb-3d096f035464 --hostid=c758a4ed-f09f-4c82-9afb-3d096f035464 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.3 -s 4420 00:14:22.044 11:25:17 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_in_capsule -- target/filesystem.sh@62 -- # waitforserial SPDKISFASTANDAWESOME 00:14:22.044 11:25:17 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_in_capsule -- common/autotest_common.sh@1198 -- # local i=0 00:14:22.044 11:25:17 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_in_capsule -- common/autotest_common.sh@1199 -- # local nvme_device_counter=1 nvme_devices=0 00:14:22.044 11:25:17 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_in_capsule -- common/autotest_common.sh@1200 -- # [[ -n '' ]] 00:14:22.044 11:25:17 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_in_capsule -- common/autotest_common.sh@1205 -- # sleep 2 00:14:24.013 11:25:19 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_in_capsule -- common/autotest_common.sh@1206 -- # (( i++ <= 15 )) 00:14:24.013 11:25:19 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_in_capsule -- common/autotest_common.sh@1207 -- # lsblk -l -o NAME,SERIAL 00:14:24.013 11:25:19 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_in_capsule -- common/autotest_common.sh@1207 -- # grep -c SPDKISFASTANDAWESOME 00:14:24.013 11:25:19 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_in_capsule -- common/autotest_common.sh@1207 -- # nvme_devices=1 00:14:24.013 11:25:19 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_in_capsule -- common/autotest_common.sh@1208 -- # (( nvme_devices == nvme_device_counter )) 00:14:24.013 11:25:19 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_in_capsule -- common/autotest_common.sh@1208 -- # return 0 00:14:24.013 11:25:19 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_in_capsule -- target/filesystem.sh@63 -- # lsblk -l -o NAME,SERIAL 00:14:24.013 11:25:19 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_in_capsule -- target/filesystem.sh@63 -- # grep -oP '([\w]*)(?=\s+SPDKISFASTANDAWESOME)' 00:14:24.013 11:25:19 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_in_capsule -- target/filesystem.sh@63 -- # nvme_name=nvme0n1 00:14:24.013 11:25:19 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_in_capsule -- target/filesystem.sh@64 -- # sec_size_to_bytes nvme0n1 00:14:24.013 11:25:19 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_in_capsule -- setup/common.sh@76 -- # local dev=nvme0n1 00:14:24.013 11:25:19 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_in_capsule -- setup/common.sh@78 -- # [[ -e /sys/block/nvme0n1 ]] 00:14:24.013 11:25:19 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_in_capsule -- setup/common.sh@80 -- # echo 536870912 00:14:24.013 11:25:19 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_in_capsule -- target/filesystem.sh@64 -- # nvme_size=536870912 00:14:24.013 11:25:19 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_in_capsule -- target/filesystem.sh@66 -- # mkdir -p /mnt/device 00:14:24.013 11:25:19 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_in_capsule -- target/filesystem.sh@67 -- # (( nvme_size == malloc_size )) 00:14:24.013 11:25:19 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_in_capsule -- target/filesystem.sh@68 -- # parted -s /dev/nvme0n1 mklabel gpt mkpart SPDK_TEST 0% 100% 00:14:24.013 11:25:19 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_in_capsule -- target/filesystem.sh@69 -- # partprobe 00:14:24.013 11:25:19 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_in_capsule -- target/filesystem.sh@70 -- # sleep 1 00:14:25.385 11:25:20 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_in_capsule -- target/filesystem.sh@76 -- # '[' 4096 -eq 0 ']' 00:14:25.385 11:25:20 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_in_capsule -- target/filesystem.sh@81 -- # run_test filesystem_in_capsule_ext4 nvmf_filesystem_create ext4 nvme0n1 00:14:25.385 11:25:20 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_in_capsule -- common/autotest_common.sh@1101 -- # '[' 4 -le 1 ']' 00:14:25.385 11:25:20 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_in_capsule -- common/autotest_common.sh@1107 -- # xtrace_disable 00:14:25.385 11:25:20 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_in_capsule -- common/autotest_common.sh@10 -- # set +x 00:14:25.385 ************************************ 00:14:25.385 START TEST filesystem_in_capsule_ext4 00:14:25.385 ************************************ 00:14:25.386 11:25:20 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_in_capsule.filesystem_in_capsule_ext4 -- common/autotest_common.sh@1125 -- # nvmf_filesystem_create ext4 nvme0n1 00:14:25.386 11:25:20 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_in_capsule.filesystem_in_capsule_ext4 -- target/filesystem.sh@18 -- # fstype=ext4 00:14:25.386 11:25:20 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_in_capsule.filesystem_in_capsule_ext4 -- target/filesystem.sh@19 -- # nvme_name=nvme0n1 00:14:25.386 11:25:20 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_in_capsule.filesystem_in_capsule_ext4 -- target/filesystem.sh@21 -- # make_filesystem ext4 /dev/nvme0n1p1 00:14:25.386 11:25:20 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_in_capsule.filesystem_in_capsule_ext4 -- common/autotest_common.sh@926 -- # local fstype=ext4 00:14:25.386 11:25:20 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_in_capsule.filesystem_in_capsule_ext4 -- common/autotest_common.sh@927 -- # local dev_name=/dev/nvme0n1p1 00:14:25.386 11:25:20 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_in_capsule.filesystem_in_capsule_ext4 -- common/autotest_common.sh@928 -- # local i=0 00:14:25.386 11:25:20 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_in_capsule.filesystem_in_capsule_ext4 -- common/autotest_common.sh@929 -- # local force 00:14:25.386 11:25:20 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_in_capsule.filesystem_in_capsule_ext4 -- common/autotest_common.sh@931 -- # '[' ext4 = ext4 ']' 00:14:25.386 11:25:20 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_in_capsule.filesystem_in_capsule_ext4 -- common/autotest_common.sh@932 -- # force=-F 00:14:25.386 11:25:20 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_in_capsule.filesystem_in_capsule_ext4 -- common/autotest_common.sh@937 -- # mkfs.ext4 -F /dev/nvme0n1p1 00:14:25.386 mke2fs 1.47.0 (5-Feb-2023) 00:14:25.386 Discarding device blocks: 0/522240 done 00:14:25.386 Creating filesystem with 522240 1k blocks and 130560 inodes 00:14:25.386 Filesystem UUID: 1a573c20-756f-4f9c-b3c6-b01e28c1bf31 00:14:25.386 Superblock backups stored on blocks: 00:14:25.386 8193, 24577, 40961, 57345, 73729, 204801, 221185, 401409 00:14:25.386 00:14:25.386 Allocating group tables: 0/64 done 00:14:25.386 Writing inode tables: 0/64 done 00:14:25.386 Creating journal (8192 blocks): done 00:14:25.386 Writing superblocks and filesystem accounting information: 0/64 done 00:14:25.386 00:14:25.386 11:25:20 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_in_capsule.filesystem_in_capsule_ext4 -- common/autotest_common.sh@945 -- # return 0 00:14:25.386 11:25:20 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_in_capsule.filesystem_in_capsule_ext4 -- target/filesystem.sh@23 -- # mount /dev/nvme0n1p1 /mnt/device 00:14:30.697 11:25:26 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_in_capsule.filesystem_in_capsule_ext4 -- target/filesystem.sh@24 -- # touch /mnt/device/aaa 00:14:30.697 11:25:26 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_in_capsule.filesystem_in_capsule_ext4 -- target/filesystem.sh@25 -- # sync 00:14:30.697 11:25:26 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_in_capsule.filesystem_in_capsule_ext4 -- target/filesystem.sh@26 -- # rm /mnt/device/aaa 00:14:30.697 11:25:26 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_in_capsule.filesystem_in_capsule_ext4 -- target/filesystem.sh@27 -- # sync 00:14:30.697 11:25:26 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_in_capsule.filesystem_in_capsule_ext4 -- target/filesystem.sh@29 -- # i=0 00:14:30.697 11:25:26 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_in_capsule.filesystem_in_capsule_ext4 -- target/filesystem.sh@30 -- # umount /mnt/device 00:14:30.697 11:25:26 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_in_capsule.filesystem_in_capsule_ext4 -- target/filesystem.sh@37 -- # kill -0 72363 00:14:30.697 11:25:26 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_in_capsule.filesystem_in_capsule_ext4 -- target/filesystem.sh@40 -- # lsblk -l -o NAME 00:14:30.697 11:25:26 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_in_capsule.filesystem_in_capsule_ext4 -- target/filesystem.sh@40 -- # grep -q -w nvme0n1 00:14:30.697 11:25:26 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_in_capsule.filesystem_in_capsule_ext4 -- target/filesystem.sh@43 -- # lsblk -l -o NAME 00:14:30.697 11:25:26 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_in_capsule.filesystem_in_capsule_ext4 -- target/filesystem.sh@43 -- # grep -q -w nvme0n1p1 00:14:30.697 ************************************ 00:14:30.697 END TEST filesystem_in_capsule_ext4 00:14:30.697 ************************************ 00:14:30.697 00:14:30.697 real 0m5.653s 00:14:30.697 user 0m0.025s 00:14:30.697 sys 0m0.059s 00:14:30.697 11:25:26 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_in_capsule.filesystem_in_capsule_ext4 -- common/autotest_common.sh@1126 -- # xtrace_disable 00:14:30.698 11:25:26 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_in_capsule.filesystem_in_capsule_ext4 -- common/autotest_common.sh@10 -- # set +x 00:14:30.698 11:25:26 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_in_capsule -- target/filesystem.sh@82 -- # run_test filesystem_in_capsule_btrfs nvmf_filesystem_create btrfs nvme0n1 00:14:30.698 11:25:26 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_in_capsule -- common/autotest_common.sh@1101 -- # '[' 4 -le 1 ']' 00:14:30.698 11:25:26 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_in_capsule -- common/autotest_common.sh@1107 -- # xtrace_disable 00:14:30.698 11:25:26 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_in_capsule -- common/autotest_common.sh@10 -- # set +x 00:14:30.956 ************************************ 00:14:30.956 START TEST filesystem_in_capsule_btrfs 00:14:30.956 ************************************ 00:14:30.956 11:25:26 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_in_capsule.filesystem_in_capsule_btrfs -- common/autotest_common.sh@1125 -- # nvmf_filesystem_create btrfs nvme0n1 00:14:30.956 11:25:26 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_in_capsule.filesystem_in_capsule_btrfs -- target/filesystem.sh@18 -- # fstype=btrfs 00:14:30.956 11:25:26 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_in_capsule.filesystem_in_capsule_btrfs -- target/filesystem.sh@19 -- # nvme_name=nvme0n1 00:14:30.956 11:25:26 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_in_capsule.filesystem_in_capsule_btrfs -- target/filesystem.sh@21 -- # make_filesystem btrfs /dev/nvme0n1p1 00:14:30.956 11:25:26 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_in_capsule.filesystem_in_capsule_btrfs -- common/autotest_common.sh@926 -- # local fstype=btrfs 00:14:30.956 11:25:26 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_in_capsule.filesystem_in_capsule_btrfs -- common/autotest_common.sh@927 -- # local dev_name=/dev/nvme0n1p1 00:14:30.956 11:25:26 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_in_capsule.filesystem_in_capsule_btrfs -- common/autotest_common.sh@928 -- # local i=0 00:14:30.956 11:25:26 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_in_capsule.filesystem_in_capsule_btrfs -- common/autotest_common.sh@929 -- # local force 00:14:30.956 11:25:26 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_in_capsule.filesystem_in_capsule_btrfs -- common/autotest_common.sh@931 -- # '[' btrfs = ext4 ']' 00:14:30.956 11:25:26 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_in_capsule.filesystem_in_capsule_btrfs -- common/autotest_common.sh@934 -- # force=-f 00:14:30.956 11:25:26 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_in_capsule.filesystem_in_capsule_btrfs -- common/autotest_common.sh@937 -- # mkfs.btrfs -f /dev/nvme0n1p1 00:14:30.956 btrfs-progs v6.8.1 00:14:30.956 See https://btrfs.readthedocs.io for more information. 00:14:30.956 00:14:30.956 Performing full device TRIM /dev/nvme0n1p1 (510.00MiB) ... 00:14:30.956 NOTE: several default settings have changed in version 5.15, please make sure 00:14:30.956 this does not affect your deployments: 00:14:30.956 - DUP for metadata (-m dup) 00:14:30.956 - enabled no-holes (-O no-holes) 00:14:30.956 - enabled free-space-tree (-R free-space-tree) 00:14:30.956 00:14:30.956 Label: (null) 00:14:30.956 UUID: 6fcba379-3e0c-426b-87a3-d703220f0b87 00:14:30.956 Node size: 16384 00:14:30.956 Sector size: 4096 (CPU page size: 4096) 00:14:30.956 Filesystem size: 510.00MiB 00:14:30.956 Block group profiles: 00:14:30.956 Data: single 8.00MiB 00:14:30.956 Metadata: DUP 32.00MiB 00:14:30.956 System: DUP 8.00MiB 00:14:30.956 SSD detected: yes 00:14:30.956 Zoned device: no 00:14:30.956 Features: extref, skinny-metadata, no-holes, free-space-tree 00:14:30.956 Checksum: crc32c 00:14:30.956 Number of devices: 1 00:14:30.956 Devices: 00:14:30.956 ID SIZE PATH 00:14:30.956 1 510.00MiB /dev/nvme0n1p1 00:14:30.956 00:14:30.956 11:25:26 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_in_capsule.filesystem_in_capsule_btrfs -- common/autotest_common.sh@945 -- # return 0 00:14:30.956 11:25:26 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_in_capsule.filesystem_in_capsule_btrfs -- target/filesystem.sh@23 -- # mount /dev/nvme0n1p1 /mnt/device 00:14:30.956 11:25:26 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_in_capsule.filesystem_in_capsule_btrfs -- target/filesystem.sh@24 -- # touch /mnt/device/aaa 00:14:30.956 11:25:26 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_in_capsule.filesystem_in_capsule_btrfs -- target/filesystem.sh@25 -- # sync 00:14:30.956 11:25:26 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_in_capsule.filesystem_in_capsule_btrfs -- target/filesystem.sh@26 -- # rm /mnt/device/aaa 00:14:30.956 11:25:26 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_in_capsule.filesystem_in_capsule_btrfs -- target/filesystem.sh@27 -- # sync 00:14:30.956 11:25:26 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_in_capsule.filesystem_in_capsule_btrfs -- target/filesystem.sh@29 -- # i=0 00:14:30.957 11:25:26 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_in_capsule.filesystem_in_capsule_btrfs -- target/filesystem.sh@30 -- # umount /mnt/device 00:14:30.957 11:25:26 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_in_capsule.filesystem_in_capsule_btrfs -- target/filesystem.sh@37 -- # kill -0 72363 00:14:30.957 11:25:26 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_in_capsule.filesystem_in_capsule_btrfs -- target/filesystem.sh@40 -- # lsblk -l -o NAME 00:14:30.957 11:25:26 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_in_capsule.filesystem_in_capsule_btrfs -- target/filesystem.sh@40 -- # grep -q -w nvme0n1 00:14:30.957 11:25:26 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_in_capsule.filesystem_in_capsule_btrfs -- target/filesystem.sh@43 -- # lsblk -l -o NAME 00:14:30.957 11:25:26 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_in_capsule.filesystem_in_capsule_btrfs -- target/filesystem.sh@43 -- # grep -q -w nvme0n1p1 00:14:30.957 ************************************ 00:14:30.957 END TEST filesystem_in_capsule_btrfs 00:14:30.957 ************************************ 00:14:30.957 00:14:30.957 real 0m0.214s 00:14:30.957 user 0m0.022s 00:14:30.957 sys 0m0.061s 00:14:30.957 11:25:26 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_in_capsule.filesystem_in_capsule_btrfs -- common/autotest_common.sh@1126 -- # xtrace_disable 00:14:30.957 11:25:26 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_in_capsule.filesystem_in_capsule_btrfs -- common/autotest_common.sh@10 -- # set +x 00:14:30.957 11:25:26 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_in_capsule -- target/filesystem.sh@83 -- # run_test filesystem_in_capsule_xfs nvmf_filesystem_create xfs nvme0n1 00:14:30.957 11:25:26 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_in_capsule -- common/autotest_common.sh@1101 -- # '[' 4 -le 1 ']' 00:14:30.957 11:25:26 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_in_capsule -- common/autotest_common.sh@1107 -- # xtrace_disable 00:14:30.957 11:25:26 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_in_capsule -- common/autotest_common.sh@10 -- # set +x 00:14:31.215 ************************************ 00:14:31.215 START TEST filesystem_in_capsule_xfs 00:14:31.215 ************************************ 00:14:31.215 11:25:26 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_in_capsule.filesystem_in_capsule_xfs -- common/autotest_common.sh@1125 -- # nvmf_filesystem_create xfs nvme0n1 00:14:31.216 11:25:26 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_in_capsule.filesystem_in_capsule_xfs -- target/filesystem.sh@18 -- # fstype=xfs 00:14:31.216 11:25:26 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_in_capsule.filesystem_in_capsule_xfs -- target/filesystem.sh@19 -- # nvme_name=nvme0n1 00:14:31.216 11:25:26 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_in_capsule.filesystem_in_capsule_xfs -- target/filesystem.sh@21 -- # make_filesystem xfs /dev/nvme0n1p1 00:14:31.216 11:25:26 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_in_capsule.filesystem_in_capsule_xfs -- common/autotest_common.sh@926 -- # local fstype=xfs 00:14:31.216 11:25:26 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_in_capsule.filesystem_in_capsule_xfs -- common/autotest_common.sh@927 -- # local dev_name=/dev/nvme0n1p1 00:14:31.216 11:25:26 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_in_capsule.filesystem_in_capsule_xfs -- common/autotest_common.sh@928 -- # local i=0 00:14:31.216 11:25:26 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_in_capsule.filesystem_in_capsule_xfs -- common/autotest_common.sh@929 -- # local force 00:14:31.216 11:25:26 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_in_capsule.filesystem_in_capsule_xfs -- common/autotest_common.sh@931 -- # '[' xfs = ext4 ']' 00:14:31.216 11:25:26 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_in_capsule.filesystem_in_capsule_xfs -- common/autotest_common.sh@934 -- # force=-f 00:14:31.216 11:25:26 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_in_capsule.filesystem_in_capsule_xfs -- common/autotest_common.sh@937 -- # mkfs.xfs -f /dev/nvme0n1p1 00:14:31.216 meta-data=/dev/nvme0n1p1 isize=512 agcount=4, agsize=32640 blks 00:14:31.216 = sectsz=512 attr=2, projid32bit=1 00:14:31.216 = crc=1 finobt=1, sparse=1, rmapbt=0 00:14:31.216 = reflink=1 bigtime=1 inobtcount=1 nrext64=0 00:14:31.216 data = bsize=4096 blocks=130560, imaxpct=25 00:14:31.216 = sunit=0 swidth=0 blks 00:14:31.216 naming =version 2 bsize=4096 ascii-ci=0, ftype=1 00:14:31.216 log =internal log bsize=4096 blocks=16384, version=2 00:14:31.216 = sectsz=512 sunit=0 blks, lazy-count=1 00:14:31.216 realtime =none extsz=4096 blocks=0, rtextents=0 00:14:31.781 Discarding blocks...Done. 00:14:31.781 11:25:27 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_in_capsule.filesystem_in_capsule_xfs -- common/autotest_common.sh@945 -- # return 0 00:14:31.781 11:25:27 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_in_capsule.filesystem_in_capsule_xfs -- target/filesystem.sh@23 -- # mount /dev/nvme0n1p1 /mnt/device 00:14:33.689 11:25:29 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_in_capsule.filesystem_in_capsule_xfs -- target/filesystem.sh@24 -- # touch /mnt/device/aaa 00:14:33.689 11:25:29 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_in_capsule.filesystem_in_capsule_xfs -- target/filesystem.sh@25 -- # sync 00:14:33.689 11:25:29 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_in_capsule.filesystem_in_capsule_xfs -- target/filesystem.sh@26 -- # rm /mnt/device/aaa 00:14:33.689 11:25:29 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_in_capsule.filesystem_in_capsule_xfs -- target/filesystem.sh@27 -- # sync 00:14:33.689 11:25:29 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_in_capsule.filesystem_in_capsule_xfs -- target/filesystem.sh@29 -- # i=0 00:14:33.689 11:25:29 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_in_capsule.filesystem_in_capsule_xfs -- target/filesystem.sh@30 -- # umount /mnt/device 00:14:33.689 11:25:29 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_in_capsule.filesystem_in_capsule_xfs -- target/filesystem.sh@37 -- # kill -0 72363 00:14:33.689 11:25:29 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_in_capsule.filesystem_in_capsule_xfs -- target/filesystem.sh@40 -- # lsblk -l -o NAME 00:14:33.689 11:25:29 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_in_capsule.filesystem_in_capsule_xfs -- target/filesystem.sh@40 -- # grep -q -w nvme0n1 00:14:33.689 11:25:29 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_in_capsule.filesystem_in_capsule_xfs -- target/filesystem.sh@43 -- # lsblk -l -o NAME 00:14:33.689 11:25:29 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_in_capsule.filesystem_in_capsule_xfs -- target/filesystem.sh@43 -- # grep -q -w nvme0n1p1 00:14:33.689 00:14:33.689 real 0m2.614s 00:14:33.689 user 0m0.024s 00:14:33.689 sys 0m0.048s 00:14:33.689 ************************************ 00:14:33.689 END TEST filesystem_in_capsule_xfs 00:14:33.689 ************************************ 00:14:33.689 11:25:29 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_in_capsule.filesystem_in_capsule_xfs -- common/autotest_common.sh@1126 -- # xtrace_disable 00:14:33.689 11:25:29 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_in_capsule.filesystem_in_capsule_xfs -- common/autotest_common.sh@10 -- # set +x 00:14:33.689 11:25:29 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_in_capsule -- target/filesystem.sh@91 -- # flock /dev/nvme0n1 parted -s /dev/nvme0n1 rm 1 00:14:33.689 11:25:29 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_in_capsule -- target/filesystem.sh@93 -- # sync 00:14:33.689 11:25:29 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_in_capsule -- target/filesystem.sh@94 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:14:33.689 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:14:33.689 11:25:29 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_in_capsule -- target/filesystem.sh@95 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:14:33.689 11:25:29 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_in_capsule -- common/autotest_common.sh@1219 -- # local i=0 00:14:33.689 11:25:29 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_in_capsule -- common/autotest_common.sh@1220 -- # lsblk -o NAME,SERIAL 00:14:33.966 11:25:29 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_in_capsule -- common/autotest_common.sh@1220 -- # grep -q -w SPDKISFASTANDAWESOME 00:14:33.966 11:25:29 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_in_capsule -- common/autotest_common.sh@1227 -- # lsblk -l -o NAME,SERIAL 00:14:33.966 11:25:29 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_in_capsule -- common/autotest_common.sh@1227 -- # grep -q -w SPDKISFASTANDAWESOME 00:14:33.966 11:25:29 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_in_capsule -- common/autotest_common.sh@1231 -- # return 0 00:14:33.966 11:25:29 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_in_capsule -- target/filesystem.sh@97 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:14:33.966 11:25:29 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_in_capsule -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:33.966 11:25:29 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_in_capsule -- common/autotest_common.sh@10 -- # set +x 00:14:33.966 11:25:29 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_in_capsule -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:33.966 11:25:29 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_in_capsule -- target/filesystem.sh@99 -- # trap - SIGINT SIGTERM EXIT 00:14:33.966 11:25:29 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_in_capsule -- target/filesystem.sh@101 -- # killprocess 72363 00:14:33.966 11:25:29 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_in_capsule -- common/autotest_common.sh@950 -- # '[' -z 72363 ']' 00:14:33.966 11:25:29 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_in_capsule -- common/autotest_common.sh@954 -- # kill -0 72363 00:14:33.966 11:25:29 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_in_capsule -- common/autotest_common.sh@955 -- # uname 00:14:33.966 11:25:29 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_in_capsule -- common/autotest_common.sh@955 -- # '[' Linux = Linux ']' 00:14:33.966 11:25:29 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_in_capsule -- common/autotest_common.sh@956 -- # ps --no-headers -o comm= 72363 00:14:33.967 killing process with pid 72363 00:14:33.967 11:25:29 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_in_capsule -- common/autotest_common.sh@956 -- # process_name=reactor_0 00:14:33.967 11:25:29 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_in_capsule -- common/autotest_common.sh@960 -- # '[' reactor_0 = sudo ']' 00:14:33.967 11:25:29 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_in_capsule -- common/autotest_common.sh@968 -- # echo 'killing process with pid 72363' 00:14:33.967 11:25:29 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_in_capsule -- common/autotest_common.sh@969 -- # kill 72363 00:14:33.967 11:25:29 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_in_capsule -- common/autotest_common.sh@974 -- # wait 72363 00:14:34.224 11:25:29 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_in_capsule -- target/filesystem.sh@102 -- # nvmfpid= 00:14:34.224 00:14:34.224 real 0m14.027s 00:14:34.225 user 0m53.507s 00:14:34.225 sys 0m2.042s 00:14:34.225 11:25:29 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_in_capsule -- common/autotest_common.sh@1126 -- # xtrace_disable 00:14:34.225 ************************************ 00:14:34.225 END TEST nvmf_filesystem_in_capsule 00:14:34.225 ************************************ 00:14:34.225 11:25:29 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_in_capsule -- common/autotest_common.sh@10 -- # set +x 00:14:34.482 11:25:29 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- target/filesystem.sh@108 -- # nvmftestfini 00:14:34.482 11:25:29 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- nvmf/common.sh@514 -- # nvmfcleanup 00:14:34.482 11:25:29 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- nvmf/common.sh@121 -- # sync 00:14:34.482 11:25:29 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- nvmf/common.sh@123 -- # '[' tcp == tcp ']' 00:14:34.482 11:25:29 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- nvmf/common.sh@124 -- # set +e 00:14:34.482 11:25:29 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- nvmf/common.sh@125 -- # for i in {1..20} 00:14:34.482 11:25:29 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- nvmf/common.sh@126 -- # modprobe -v -r nvme-tcp 00:14:34.482 rmmod nvme_tcp 00:14:34.482 rmmod nvme_fabrics 00:14:34.482 rmmod nvme_keyring 00:14:34.482 11:25:29 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- nvmf/common.sh@127 -- # modprobe -v -r nvme-fabrics 00:14:34.482 11:25:29 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- nvmf/common.sh@128 -- # set -e 00:14:34.482 11:25:29 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- nvmf/common.sh@129 -- # return 0 00:14:34.482 11:25:29 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- nvmf/common.sh@515 -- # '[' -n '' ']' 00:14:34.482 11:25:29 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- nvmf/common.sh@518 -- # '[' '' == iso ']' 00:14:34.482 11:25:29 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- nvmf/common.sh@521 -- # [[ tcp == \t\c\p ]] 00:14:34.482 11:25:29 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- nvmf/common.sh@522 -- # nvmf_tcp_fini 00:14:34.482 11:25:29 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- nvmf/common.sh@297 -- # iptr 00:14:34.482 11:25:29 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- nvmf/common.sh@789 -- # iptables-save 00:14:34.482 11:25:29 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- nvmf/common.sh@789 -- # grep -v SPDK_NVMF 00:14:34.482 11:25:29 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- nvmf/common.sh@789 -- # iptables-restore 00:14:34.482 11:25:29 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- nvmf/common.sh@298 -- # [[ nvmf_tgt_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s\_\s\p\d\k ]] 00:14:34.482 11:25:29 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- nvmf/common.sh@299 -- # nvmf_veth_fini 00:14:34.482 11:25:29 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- nvmf/common.sh@233 -- # ip link set nvmf_init_br nomaster 00:14:34.482 11:25:29 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- nvmf/common.sh@234 -- # ip link set nvmf_init_br2 nomaster 00:14:34.482 11:25:29 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- nvmf/common.sh@235 -- # ip link set nvmf_tgt_br nomaster 00:14:34.482 11:25:29 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- nvmf/common.sh@236 -- # ip link set nvmf_tgt_br2 nomaster 00:14:34.482 11:25:29 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- nvmf/common.sh@237 -- # ip link set nvmf_init_br down 00:14:34.482 11:25:29 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- nvmf/common.sh@238 -- # ip link set nvmf_init_br2 down 00:14:34.482 11:25:29 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- nvmf/common.sh@239 -- # ip link set nvmf_tgt_br down 00:14:34.482 11:25:29 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- nvmf/common.sh@240 -- # ip link set nvmf_tgt_br2 down 00:14:34.482 11:25:29 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- nvmf/common.sh@241 -- # ip link delete nvmf_br type bridge 00:14:34.482 11:25:29 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- nvmf/common.sh@242 -- # ip link delete nvmf_init_if 00:14:34.739 11:25:30 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- nvmf/common.sh@243 -- # ip link delete nvmf_init_if2 00:14:34.739 11:25:30 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- nvmf/common.sh@244 -- # ip netns exec nvmf_tgt_ns_spdk ip link delete nvmf_tgt_if 00:14:34.739 11:25:30 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- nvmf/common.sh@245 -- # ip netns exec nvmf_tgt_ns_spdk ip link delete nvmf_tgt_if2 00:14:34.739 11:25:30 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- nvmf/common.sh@246 -- # remove_spdk_ns 00:14:34.739 11:25:30 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- nvmf/common.sh@654 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:14:34.739 11:25:30 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 15> /dev/null' 00:14:34.739 11:25:30 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:14:34.739 11:25:30 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- nvmf/common.sh@300 -- # return 0 00:14:34.739 00:14:34.739 real 0m29.858s 00:14:34.739 user 1m49.149s 00:14:34.739 sys 0m4.624s 00:14:34.740 11:25:30 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@1126 -- # xtrace_disable 00:14:34.740 11:25:30 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@10 -- # set +x 00:14:34.740 ************************************ 00:14:34.740 END TEST nvmf_filesystem 00:14:34.740 ************************************ 00:14:34.740 11:25:30 nvmf_tcp.nvmf_target_extra -- nvmf/nvmf_target_extra.sh@18 -- # run_test nvmf_target_discovery /home/vagrant/spdk_repo/spdk/test/nvmf/target/discovery.sh --transport=tcp 00:14:34.740 11:25:30 nvmf_tcp.nvmf_target_extra -- common/autotest_common.sh@1101 -- # '[' 3 -le 1 ']' 00:14:34.740 11:25:30 nvmf_tcp.nvmf_target_extra -- common/autotest_common.sh@1107 -- # xtrace_disable 00:14:34.740 11:25:30 nvmf_tcp.nvmf_target_extra -- common/autotest_common.sh@10 -- # set +x 00:14:34.740 ************************************ 00:14:34.740 START TEST nvmf_target_discovery 00:14:34.740 ************************************ 00:14:34.740 11:25:30 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- common/autotest_common.sh@1125 -- # /home/vagrant/spdk_repo/spdk/test/nvmf/target/discovery.sh --transport=tcp 00:14:34.740 * Looking for test storage... 00:14:34.740 * Found test storage at /home/vagrant/spdk_repo/spdk/test/nvmf/target 00:14:34.740 11:25:30 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- common/autotest_common.sh@1680 -- # [[ y == y ]] 00:14:34.740 11:25:30 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- common/autotest_common.sh@1681 -- # awk '{print $NF}' 00:14:34.740 11:25:30 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- common/autotest_common.sh@1681 -- # lcov --version 00:14:34.999 11:25:30 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- common/autotest_common.sh@1681 -- # lt 1.15 2 00:14:34.999 11:25:30 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- scripts/common.sh@373 -- # cmp_versions 1.15 '<' 2 00:14:34.999 11:25:30 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- scripts/common.sh@333 -- # local ver1 ver1_l 00:14:34.999 11:25:30 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- scripts/common.sh@334 -- # local ver2 ver2_l 00:14:34.999 11:25:30 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- scripts/common.sh@336 -- # IFS=.-: 00:14:34.999 11:25:30 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- scripts/common.sh@336 -- # read -ra ver1 00:14:34.999 11:25:30 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- scripts/common.sh@337 -- # IFS=.-: 00:14:34.999 11:25:30 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- scripts/common.sh@337 -- # read -ra ver2 00:14:34.999 11:25:30 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- scripts/common.sh@338 -- # local 'op=<' 00:14:34.999 11:25:30 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- scripts/common.sh@340 -- # ver1_l=2 00:14:34.999 11:25:30 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- scripts/common.sh@341 -- # ver2_l=1 00:14:34.999 11:25:30 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- scripts/common.sh@343 -- # local lt=0 gt=0 eq=0 v 00:14:34.999 11:25:30 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- scripts/common.sh@344 -- # case "$op" in 00:14:34.999 11:25:30 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- scripts/common.sh@345 -- # : 1 00:14:34.999 11:25:30 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- scripts/common.sh@364 -- # (( v = 0 )) 00:14:34.999 11:25:30 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- scripts/common.sh@364 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:14:34.999 11:25:30 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- scripts/common.sh@365 -- # decimal 1 00:14:34.999 11:25:30 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- scripts/common.sh@353 -- # local d=1 00:14:34.999 11:25:30 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- scripts/common.sh@354 -- # [[ 1 =~ ^[0-9]+$ ]] 00:14:34.999 11:25:30 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- scripts/common.sh@355 -- # echo 1 00:14:34.999 11:25:30 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- scripts/common.sh@365 -- # ver1[v]=1 00:14:35.000 11:25:30 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- scripts/common.sh@366 -- # decimal 2 00:14:35.000 11:25:30 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- scripts/common.sh@353 -- # local d=2 00:14:35.000 11:25:30 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- scripts/common.sh@354 -- # [[ 2 =~ ^[0-9]+$ ]] 00:14:35.000 11:25:30 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- scripts/common.sh@355 -- # echo 2 00:14:35.000 11:25:30 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- scripts/common.sh@366 -- # ver2[v]=2 00:14:35.000 11:25:30 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- scripts/common.sh@367 -- # (( ver1[v] > ver2[v] )) 00:14:35.000 11:25:30 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- scripts/common.sh@368 -- # (( ver1[v] < ver2[v] )) 00:14:35.000 11:25:30 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- scripts/common.sh@368 -- # return 0 00:14:35.000 11:25:30 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- common/autotest_common.sh@1682 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:14:35.000 11:25:30 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- common/autotest_common.sh@1694 -- # export 'LCOV_OPTS= 00:14:35.000 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:14:35.000 --rc genhtml_branch_coverage=1 00:14:35.000 --rc genhtml_function_coverage=1 00:14:35.000 --rc genhtml_legend=1 00:14:35.000 --rc geninfo_all_blocks=1 00:14:35.000 --rc geninfo_unexecuted_blocks=1 00:14:35.000 00:14:35.000 ' 00:14:35.000 11:25:30 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- common/autotest_common.sh@1694 -- # LCOV_OPTS=' 00:14:35.000 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:14:35.000 --rc genhtml_branch_coverage=1 00:14:35.000 --rc genhtml_function_coverage=1 00:14:35.000 --rc genhtml_legend=1 00:14:35.000 --rc geninfo_all_blocks=1 00:14:35.000 --rc geninfo_unexecuted_blocks=1 00:14:35.000 00:14:35.000 ' 00:14:35.000 11:25:30 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- common/autotest_common.sh@1695 -- # export 'LCOV=lcov 00:14:35.000 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:14:35.000 --rc genhtml_branch_coverage=1 00:14:35.000 --rc genhtml_function_coverage=1 00:14:35.000 --rc genhtml_legend=1 00:14:35.000 --rc geninfo_all_blocks=1 00:14:35.000 --rc geninfo_unexecuted_blocks=1 00:14:35.000 00:14:35.000 ' 00:14:35.000 11:25:30 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- common/autotest_common.sh@1695 -- # LCOV='lcov 00:14:35.000 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:14:35.000 --rc genhtml_branch_coverage=1 00:14:35.000 --rc genhtml_function_coverage=1 00:14:35.000 --rc genhtml_legend=1 00:14:35.000 --rc geninfo_all_blocks=1 00:14:35.000 --rc geninfo_unexecuted_blocks=1 00:14:35.000 00:14:35.000 ' 00:14:35.000 11:25:30 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- target/discovery.sh@9 -- # source /home/vagrant/spdk_repo/spdk/test/nvmf/common.sh 00:14:35.000 11:25:30 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- nvmf/common.sh@7 -- # uname -s 00:14:35.000 11:25:30 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:14:35.000 11:25:30 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:14:35.000 11:25:30 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:14:35.000 11:25:30 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:14:35.000 11:25:30 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:14:35.000 11:25:30 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:14:35.000 11:25:30 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:14:35.000 11:25:30 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:14:35.000 11:25:30 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:14:35.000 11:25:30 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:14:35.000 11:25:30 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:c758a4ed-f09f-4c82-9afb-3d096f035464 00:14:35.000 11:25:30 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- nvmf/common.sh@18 -- # NVME_HOSTID=c758a4ed-f09f-4c82-9afb-3d096f035464 00:14:35.000 11:25:30 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:14:35.000 11:25:30 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:14:35.000 11:25:30 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- nvmf/common.sh@21 -- # NET_TYPE=virt 00:14:35.000 11:25:30 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:14:35.000 11:25:30 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- nvmf/common.sh@49 -- # source /home/vagrant/spdk_repo/spdk/scripts/common.sh 00:14:35.000 11:25:30 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- scripts/common.sh@15 -- # shopt -s extglob 00:14:35.000 11:25:30 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- scripts/common.sh@544 -- # [[ -e /bin/wpdk_common.sh ]] 00:14:35.000 11:25:30 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- scripts/common.sh@552 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:14:35.000 11:25:30 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- scripts/common.sh@553 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:14:35.000 11:25:30 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:35.000 11:25:30 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:35.000 11:25:30 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:35.000 11:25:30 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- paths/export.sh@5 -- # export PATH 00:14:35.000 11:25:30 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:35.000 11:25:30 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- nvmf/common.sh@51 -- # : 0 00:14:35.000 11:25:30 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- nvmf/common.sh@52 -- # export NVMF_APP_SHM_ID 00:14:35.000 11:25:30 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- nvmf/common.sh@53 -- # build_nvmf_app_args 00:14:35.000 11:25:30 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:14:35.000 11:25:30 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:14:35.000 11:25:30 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:14:35.000 11:25:30 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- nvmf/common.sh@33 -- # '[' '' -eq 1 ']' 00:14:35.000 /home/vagrant/spdk_repo/spdk/test/nvmf/common.sh: line 33: [: : integer expression expected 00:14:35.000 11:25:30 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- nvmf/common.sh@37 -- # '[' -n '' ']' 00:14:35.000 11:25:30 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- nvmf/common.sh@39 -- # '[' 0 -eq 1 ']' 00:14:35.000 11:25:30 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- nvmf/common.sh@55 -- # have_pci_nics=0 00:14:35.000 11:25:30 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- target/discovery.sh@11 -- # NULL_BDEV_SIZE=102400 00:14:35.000 11:25:30 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- target/discovery.sh@12 -- # NULL_BLOCK_SIZE=512 00:14:35.000 11:25:30 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- target/discovery.sh@13 -- # NVMF_PORT_REFERRAL=4430 00:14:35.000 11:25:30 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- target/discovery.sh@15 -- # hash nvme 00:14:35.000 11:25:30 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- target/discovery.sh@20 -- # nvmftestinit 00:14:35.000 11:25:30 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- nvmf/common.sh@467 -- # '[' -z tcp ']' 00:14:35.000 11:25:30 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- nvmf/common.sh@472 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:14:35.000 11:25:30 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- nvmf/common.sh@474 -- # prepare_net_devs 00:14:35.000 11:25:30 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- nvmf/common.sh@436 -- # local -g is_hw=no 00:14:35.000 11:25:30 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- nvmf/common.sh@438 -- # remove_spdk_ns 00:14:35.000 11:25:30 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- nvmf/common.sh@654 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:14:35.000 11:25:30 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 15> /dev/null' 00:14:35.000 11:25:30 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:14:35.000 11:25:30 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- nvmf/common.sh@440 -- # [[ virt != virt ]] 00:14:35.000 11:25:30 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- nvmf/common.sh@442 -- # [[ no == yes ]] 00:14:35.000 11:25:30 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- nvmf/common.sh@449 -- # [[ virt == phy ]] 00:14:35.000 11:25:30 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- nvmf/common.sh@452 -- # [[ virt == phy-fallback ]] 00:14:35.000 11:25:30 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- nvmf/common.sh@457 -- # [[ tcp == tcp ]] 00:14:35.000 11:25:30 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- nvmf/common.sh@458 -- # nvmf_veth_init 00:14:35.000 11:25:30 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- nvmf/common.sh@145 -- # NVMF_FIRST_INITIATOR_IP=10.0.0.1 00:14:35.000 11:25:30 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- nvmf/common.sh@146 -- # NVMF_SECOND_INITIATOR_IP=10.0.0.2 00:14:35.000 11:25:30 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- nvmf/common.sh@147 -- # NVMF_FIRST_TARGET_IP=10.0.0.3 00:14:35.000 11:25:30 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- nvmf/common.sh@148 -- # NVMF_SECOND_TARGET_IP=10.0.0.4 00:14:35.000 11:25:30 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- nvmf/common.sh@149 -- # NVMF_INITIATOR_IP=10.0.0.1 00:14:35.000 11:25:30 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- nvmf/common.sh@150 -- # NVMF_BRIDGE=nvmf_br 00:14:35.001 11:25:30 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- nvmf/common.sh@151 -- # NVMF_INITIATOR_INTERFACE=nvmf_init_if 00:14:35.001 11:25:30 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- nvmf/common.sh@152 -- # NVMF_INITIATOR_INTERFACE2=nvmf_init_if2 00:14:35.001 11:25:30 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- nvmf/common.sh@153 -- # NVMF_INITIATOR_BRIDGE=nvmf_init_br 00:14:35.001 11:25:30 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- nvmf/common.sh@154 -- # NVMF_INITIATOR_BRIDGE2=nvmf_init_br2 00:14:35.001 11:25:30 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- nvmf/common.sh@155 -- # NVMF_TARGET_NAMESPACE=nvmf_tgt_ns_spdk 00:14:35.001 11:25:30 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- nvmf/common.sh@156 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:14:35.001 11:25:30 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- nvmf/common.sh@157 -- # NVMF_TARGET_INTERFACE=nvmf_tgt_if 00:14:35.001 11:25:30 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- nvmf/common.sh@158 -- # NVMF_TARGET_INTERFACE2=nvmf_tgt_if2 00:14:35.001 11:25:30 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- nvmf/common.sh@159 -- # NVMF_TARGET_BRIDGE=nvmf_tgt_br 00:14:35.001 11:25:30 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- nvmf/common.sh@160 -- # NVMF_TARGET_BRIDGE2=nvmf_tgt_br2 00:14:35.001 11:25:30 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- nvmf/common.sh@162 -- # ip link set nvmf_init_br nomaster 00:14:35.001 Cannot find device "nvmf_init_br" 00:14:35.001 11:25:30 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- nvmf/common.sh@162 -- # true 00:14:35.001 11:25:30 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- nvmf/common.sh@163 -- # ip link set nvmf_init_br2 nomaster 00:14:35.001 Cannot find device "nvmf_init_br2" 00:14:35.001 11:25:30 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- nvmf/common.sh@163 -- # true 00:14:35.001 11:25:30 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- nvmf/common.sh@164 -- # ip link set nvmf_tgt_br nomaster 00:14:35.001 Cannot find device "nvmf_tgt_br" 00:14:35.001 11:25:30 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- nvmf/common.sh@164 -- # true 00:14:35.001 11:25:30 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- nvmf/common.sh@165 -- # ip link set nvmf_tgt_br2 nomaster 00:14:35.001 Cannot find device "nvmf_tgt_br2" 00:14:35.001 11:25:30 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- nvmf/common.sh@165 -- # true 00:14:35.001 11:25:30 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- nvmf/common.sh@166 -- # ip link set nvmf_init_br down 00:14:35.001 Cannot find device "nvmf_init_br" 00:14:35.001 11:25:30 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- nvmf/common.sh@166 -- # true 00:14:35.001 11:25:30 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- nvmf/common.sh@167 -- # ip link set nvmf_init_br2 down 00:14:35.001 Cannot find device "nvmf_init_br2" 00:14:35.001 11:25:30 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- nvmf/common.sh@167 -- # true 00:14:35.001 11:25:30 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- nvmf/common.sh@168 -- # ip link set nvmf_tgt_br down 00:14:35.001 Cannot find device "nvmf_tgt_br" 00:14:35.001 11:25:30 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- nvmf/common.sh@168 -- # true 00:14:35.001 11:25:30 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- nvmf/common.sh@169 -- # ip link set nvmf_tgt_br2 down 00:14:35.001 Cannot find device "nvmf_tgt_br2" 00:14:35.001 11:25:30 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- nvmf/common.sh@169 -- # true 00:14:35.001 11:25:30 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- nvmf/common.sh@170 -- # ip link delete nvmf_br type bridge 00:14:35.001 Cannot find device "nvmf_br" 00:14:35.001 11:25:30 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- nvmf/common.sh@170 -- # true 00:14:35.001 11:25:30 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- nvmf/common.sh@171 -- # ip link delete nvmf_init_if 00:14:35.001 Cannot find device "nvmf_init_if" 00:14:35.001 11:25:30 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- nvmf/common.sh@171 -- # true 00:14:35.001 11:25:30 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- nvmf/common.sh@172 -- # ip link delete nvmf_init_if2 00:14:35.001 Cannot find device "nvmf_init_if2" 00:14:35.001 11:25:30 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- nvmf/common.sh@172 -- # true 00:14:35.001 11:25:30 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- nvmf/common.sh@173 -- # ip netns exec nvmf_tgt_ns_spdk ip link delete nvmf_tgt_if 00:14:35.001 Cannot open network namespace "nvmf_tgt_ns_spdk": No such file or directory 00:14:35.001 11:25:30 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- nvmf/common.sh@173 -- # true 00:14:35.001 11:25:30 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- nvmf/common.sh@174 -- # ip netns exec nvmf_tgt_ns_spdk ip link delete nvmf_tgt_if2 00:14:35.001 Cannot open network namespace "nvmf_tgt_ns_spdk": No such file or directory 00:14:35.001 11:25:30 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- nvmf/common.sh@174 -- # true 00:14:35.001 11:25:30 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- nvmf/common.sh@177 -- # ip netns add nvmf_tgt_ns_spdk 00:14:35.001 11:25:30 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- nvmf/common.sh@180 -- # ip link add nvmf_init_if type veth peer name nvmf_init_br 00:14:35.001 11:25:30 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- nvmf/common.sh@181 -- # ip link add nvmf_init_if2 type veth peer name nvmf_init_br2 00:14:35.001 11:25:30 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- nvmf/common.sh@182 -- # ip link add nvmf_tgt_if type veth peer name nvmf_tgt_br 00:14:35.281 11:25:30 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- nvmf/common.sh@183 -- # ip link add nvmf_tgt_if2 type veth peer name nvmf_tgt_br2 00:14:35.281 11:25:30 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- nvmf/common.sh@186 -- # ip link set nvmf_tgt_if netns nvmf_tgt_ns_spdk 00:14:35.281 11:25:30 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- nvmf/common.sh@187 -- # ip link set nvmf_tgt_if2 netns nvmf_tgt_ns_spdk 00:14:35.281 11:25:30 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- nvmf/common.sh@190 -- # ip addr add 10.0.0.1/24 dev nvmf_init_if 00:14:35.281 11:25:30 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- nvmf/common.sh@191 -- # ip addr add 10.0.0.2/24 dev nvmf_init_if2 00:14:35.281 11:25:30 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- nvmf/common.sh@192 -- # ip netns exec nvmf_tgt_ns_spdk ip addr add 10.0.0.3/24 dev nvmf_tgt_if 00:14:35.281 11:25:30 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- nvmf/common.sh@193 -- # ip netns exec nvmf_tgt_ns_spdk ip addr add 10.0.0.4/24 dev nvmf_tgt_if2 00:14:35.281 11:25:30 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- nvmf/common.sh@196 -- # ip link set nvmf_init_if up 00:14:35.281 11:25:30 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- nvmf/common.sh@197 -- # ip link set nvmf_init_if2 up 00:14:35.281 11:25:30 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- nvmf/common.sh@198 -- # ip link set nvmf_init_br up 00:14:35.281 11:25:30 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- nvmf/common.sh@199 -- # ip link set nvmf_init_br2 up 00:14:35.281 11:25:30 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- nvmf/common.sh@200 -- # ip link set nvmf_tgt_br up 00:14:35.281 11:25:30 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- nvmf/common.sh@201 -- # ip link set nvmf_tgt_br2 up 00:14:35.281 11:25:30 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- nvmf/common.sh@202 -- # ip netns exec nvmf_tgt_ns_spdk ip link set nvmf_tgt_if up 00:14:35.281 11:25:30 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- nvmf/common.sh@203 -- # ip netns exec nvmf_tgt_ns_spdk ip link set nvmf_tgt_if2 up 00:14:35.281 11:25:30 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- nvmf/common.sh@204 -- # ip netns exec nvmf_tgt_ns_spdk ip link set lo up 00:14:35.281 11:25:30 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- nvmf/common.sh@207 -- # ip link add nvmf_br type bridge 00:14:35.281 11:25:30 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- nvmf/common.sh@208 -- # ip link set nvmf_br up 00:14:35.281 11:25:30 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- nvmf/common.sh@211 -- # ip link set nvmf_init_br master nvmf_br 00:14:35.281 11:25:30 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- nvmf/common.sh@212 -- # ip link set nvmf_init_br2 master nvmf_br 00:14:35.281 11:25:30 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- nvmf/common.sh@213 -- # ip link set nvmf_tgt_br master nvmf_br 00:14:35.281 11:25:30 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- nvmf/common.sh@214 -- # ip link set nvmf_tgt_br2 master nvmf_br 00:14:35.281 11:25:30 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- nvmf/common.sh@217 -- # ipts -I INPUT 1 -i nvmf_init_if -p tcp --dport 4420 -j ACCEPT 00:14:35.281 11:25:30 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- nvmf/common.sh@788 -- # iptables -I INPUT 1 -i nvmf_init_if -p tcp --dport 4420 -j ACCEPT -m comment --comment 'SPDK_NVMF:-I INPUT 1 -i nvmf_init_if -p tcp --dport 4420 -j ACCEPT' 00:14:35.281 11:25:30 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- nvmf/common.sh@218 -- # ipts -I INPUT 1 -i nvmf_init_if2 -p tcp --dport 4420 -j ACCEPT 00:14:35.281 11:25:30 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- nvmf/common.sh@788 -- # iptables -I INPUT 1 -i nvmf_init_if2 -p tcp --dport 4420 -j ACCEPT -m comment --comment 'SPDK_NVMF:-I INPUT 1 -i nvmf_init_if2 -p tcp --dport 4420 -j ACCEPT' 00:14:35.281 11:25:30 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- nvmf/common.sh@219 -- # ipts -A FORWARD -i nvmf_br -o nvmf_br -j ACCEPT 00:14:35.281 11:25:30 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- nvmf/common.sh@788 -- # iptables -A FORWARD -i nvmf_br -o nvmf_br -j ACCEPT -m comment --comment 'SPDK_NVMF:-A FORWARD -i nvmf_br -o nvmf_br -j ACCEPT' 00:14:35.281 11:25:30 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- nvmf/common.sh@222 -- # ping -c 1 10.0.0.3 00:14:35.281 PING 10.0.0.3 (10.0.0.3) 56(84) bytes of data. 00:14:35.281 64 bytes from 10.0.0.3: icmp_seq=1 ttl=64 time=0.108 ms 00:14:35.281 00:14:35.281 --- 10.0.0.3 ping statistics --- 00:14:35.281 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:14:35.281 rtt min/avg/max/mdev = 0.108/0.108/0.108/0.000 ms 00:14:35.281 11:25:30 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- nvmf/common.sh@223 -- # ping -c 1 10.0.0.4 00:14:35.281 PING 10.0.0.4 (10.0.0.4) 56(84) bytes of data. 00:14:35.281 64 bytes from 10.0.0.4: icmp_seq=1 ttl=64 time=0.044 ms 00:14:35.281 00:14:35.281 --- 10.0.0.4 ping statistics --- 00:14:35.281 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:14:35.281 rtt min/avg/max/mdev = 0.044/0.044/0.044/0.000 ms 00:14:35.281 11:25:30 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- nvmf/common.sh@224 -- # ip netns exec nvmf_tgt_ns_spdk ping -c 1 10.0.0.1 00:14:35.281 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:14:35.281 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.028 ms 00:14:35.281 00:14:35.281 --- 10.0.0.1 ping statistics --- 00:14:35.281 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:14:35.281 rtt min/avg/max/mdev = 0.028/0.028/0.028/0.000 ms 00:14:35.281 11:25:30 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- nvmf/common.sh@225 -- # ip netns exec nvmf_tgt_ns_spdk ping -c 1 10.0.0.2 00:14:35.281 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:14:35.281 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.044 ms 00:14:35.281 00:14:35.281 --- 10.0.0.2 ping statistics --- 00:14:35.281 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:14:35.281 rtt min/avg/max/mdev = 0.044/0.044/0.044/0.000 ms 00:14:35.281 11:25:30 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- nvmf/common.sh@227 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:14:35.281 11:25:30 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- nvmf/common.sh@459 -- # return 0 00:14:35.281 11:25:30 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- nvmf/common.sh@476 -- # '[' '' == iso ']' 00:14:35.281 11:25:30 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- nvmf/common.sh@480 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:14:35.281 11:25:30 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- nvmf/common.sh@481 -- # [[ tcp == \r\d\m\a ]] 00:14:35.281 11:25:30 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- nvmf/common.sh@490 -- # [[ tcp == \t\c\p ]] 00:14:35.281 11:25:30 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- nvmf/common.sh@491 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:14:35.281 11:25:30 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- nvmf/common.sh@494 -- # '[' tcp == tcp ']' 00:14:35.281 11:25:30 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- nvmf/common.sh@500 -- # modprobe nvme-tcp 00:14:35.281 11:25:30 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- target/discovery.sh@21 -- # nvmfappstart -m 0xF 00:14:35.281 11:25:30 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- nvmf/common.sh@505 -- # timing_enter start_nvmf_tgt 00:14:35.281 11:25:30 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- common/autotest_common.sh@724 -- # xtrace_disable 00:14:35.281 11:25:30 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- common/autotest_common.sh@10 -- # set +x 00:14:35.281 11:25:30 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- nvmf/common.sh@507 -- # nvmfpid=72950 00:14:35.281 11:25:30 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- nvmf/common.sh@506 -- # ip netns exec nvmf_tgt_ns_spdk /home/vagrant/spdk_repo/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:14:35.282 11:25:30 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- nvmf/common.sh@508 -- # waitforlisten 72950 00:14:35.282 11:25:30 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- common/autotest_common.sh@831 -- # '[' -z 72950 ']' 00:14:35.282 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:14:35.282 11:25:30 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- common/autotest_common.sh@835 -- # local rpc_addr=/var/tmp/spdk.sock 00:14:35.282 11:25:30 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- common/autotest_common.sh@836 -- # local max_retries=100 00:14:35.282 11:25:30 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- common/autotest_common.sh@838 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:14:35.282 11:25:30 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- common/autotest_common.sh@840 -- # xtrace_disable 00:14:35.282 11:25:30 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- common/autotest_common.sh@10 -- # set +x 00:14:35.540 [2024-10-07 11:25:30.813781] Starting SPDK v25.01-pre git sha1 2a4f56c54 / DPDK 24.03.0 initialization... 00:14:35.540 [2024-10-07 11:25:30.814064] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --iova-mode=pa --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:14:35.540 [2024-10-07 11:25:30.956293] app.c: 917:spdk_app_start: *NOTICE*: Total cores available: 4 00:14:35.798 [2024-10-07 11:25:31.076912] app.c: 610:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:14:35.798 [2024-10-07 11:25:31.076971] app.c: 611:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:14:35.798 [2024-10-07 11:25:31.076992] app.c: 616:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:14:35.798 [2024-10-07 11:25:31.077003] app.c: 617:app_setup_trace: *NOTICE*: SPDK application currently running. 00:14:35.798 [2024-10-07 11:25:31.077013] app.c: 618:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:14:35.798 [2024-10-07 11:25:31.078356] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 1 00:14:35.798 [2024-10-07 11:25:31.078441] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 2 00:14:35.798 [2024-10-07 11:25:31.078524] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 3 00:14:35.798 [2024-10-07 11:25:31.078529] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 0 00:14:36.364 11:25:31 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- common/autotest_common.sh@860 -- # (( i == 0 )) 00:14:36.364 11:25:31 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- common/autotest_common.sh@864 -- # return 0 00:14:36.364 11:25:31 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- nvmf/common.sh@509 -- # timing_exit start_nvmf_tgt 00:14:36.364 11:25:31 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- common/autotest_common.sh@730 -- # xtrace_disable 00:14:36.364 11:25:31 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- common/autotest_common.sh@10 -- # set +x 00:14:36.623 11:25:31 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- nvmf/common.sh@510 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:14:36.623 11:25:31 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- target/discovery.sh@23 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:14:36.623 11:25:31 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:36.623 11:25:31 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- common/autotest_common.sh@10 -- # set +x 00:14:36.623 [2024-10-07 11:25:31.932344] tcp.c: 738:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:14:36.623 11:25:31 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:36.623 11:25:31 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- target/discovery.sh@26 -- # seq 1 4 00:14:36.623 11:25:31 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- target/discovery.sh@26 -- # for i in $(seq 1 4) 00:14:36.623 11:25:31 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- target/discovery.sh@27 -- # rpc_cmd bdev_null_create Null1 102400 512 00:14:36.623 11:25:31 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:36.623 11:25:31 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- common/autotest_common.sh@10 -- # set +x 00:14:36.623 Null1 00:14:36.623 11:25:31 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:36.623 11:25:31 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- target/discovery.sh@28 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:14:36.623 11:25:31 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:36.623 11:25:31 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- common/autotest_common.sh@10 -- # set +x 00:14:36.623 11:25:31 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:36.623 11:25:31 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- target/discovery.sh@29 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Null1 00:14:36.623 11:25:31 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:36.623 11:25:31 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- common/autotest_common.sh@10 -- # set +x 00:14:36.623 11:25:31 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:36.623 11:25:31 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- target/discovery.sh@30 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.3 -s 4420 00:14:36.623 11:25:31 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:36.623 11:25:31 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- common/autotest_common.sh@10 -- # set +x 00:14:36.623 [2024-10-07 11:25:31.976506] tcp.c:1081:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.3 port 4420 *** 00:14:36.623 11:25:31 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:36.623 11:25:31 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- target/discovery.sh@26 -- # for i in $(seq 1 4) 00:14:36.623 11:25:31 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- target/discovery.sh@27 -- # rpc_cmd bdev_null_create Null2 102400 512 00:14:36.623 11:25:31 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:36.623 11:25:31 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- common/autotest_common.sh@10 -- # set +x 00:14:36.623 Null2 00:14:36.623 11:25:31 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:36.623 11:25:31 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- target/discovery.sh@28 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode2 -a -s SPDK00000000000002 00:14:36.623 11:25:31 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:36.623 11:25:31 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- common/autotest_common.sh@10 -- # set +x 00:14:36.623 11:25:31 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:36.623 11:25:31 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- target/discovery.sh@29 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode2 Null2 00:14:36.623 11:25:31 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:36.623 11:25:31 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- common/autotest_common.sh@10 -- # set +x 00:14:36.623 11:25:32 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:36.623 11:25:32 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- target/discovery.sh@30 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode2 -t tcp -a 10.0.0.3 -s 4420 00:14:36.623 11:25:32 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:36.623 11:25:32 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- common/autotest_common.sh@10 -- # set +x 00:14:36.623 11:25:32 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:36.623 11:25:32 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- target/discovery.sh@26 -- # for i in $(seq 1 4) 00:14:36.623 11:25:32 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- target/discovery.sh@27 -- # rpc_cmd bdev_null_create Null3 102400 512 00:14:36.623 11:25:32 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:36.623 11:25:32 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- common/autotest_common.sh@10 -- # set +x 00:14:36.623 Null3 00:14:36.623 11:25:32 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:36.623 11:25:32 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- target/discovery.sh@28 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode3 -a -s SPDK00000000000003 00:14:36.623 11:25:32 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:36.623 11:25:32 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- common/autotest_common.sh@10 -- # set +x 00:14:36.623 11:25:32 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:36.623 11:25:32 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- target/discovery.sh@29 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode3 Null3 00:14:36.623 11:25:32 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:36.623 11:25:32 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- common/autotest_common.sh@10 -- # set +x 00:14:36.623 11:25:32 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:36.623 11:25:32 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- target/discovery.sh@30 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode3 -t tcp -a 10.0.0.3 -s 4420 00:14:36.623 11:25:32 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:36.623 11:25:32 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- common/autotest_common.sh@10 -- # set +x 00:14:36.623 11:25:32 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:36.623 11:25:32 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- target/discovery.sh@26 -- # for i in $(seq 1 4) 00:14:36.623 11:25:32 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- target/discovery.sh@27 -- # rpc_cmd bdev_null_create Null4 102400 512 00:14:36.623 11:25:32 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:36.623 11:25:32 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- common/autotest_common.sh@10 -- # set +x 00:14:36.623 Null4 00:14:36.623 11:25:32 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:36.623 11:25:32 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- target/discovery.sh@28 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode4 -a -s SPDK00000000000004 00:14:36.623 11:25:32 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:36.623 11:25:32 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- common/autotest_common.sh@10 -- # set +x 00:14:36.623 11:25:32 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:36.623 11:25:32 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- target/discovery.sh@29 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode4 Null4 00:14:36.623 11:25:32 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:36.623 11:25:32 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- common/autotest_common.sh@10 -- # set +x 00:14:36.623 11:25:32 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:36.623 11:25:32 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- target/discovery.sh@30 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode4 -t tcp -a 10.0.0.3 -s 4420 00:14:36.623 11:25:32 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:36.623 11:25:32 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- common/autotest_common.sh@10 -- # set +x 00:14:36.623 11:25:32 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:36.623 11:25:32 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- target/discovery.sh@32 -- # rpc_cmd nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.3 -s 4420 00:14:36.623 11:25:32 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:36.623 11:25:32 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- common/autotest_common.sh@10 -- # set +x 00:14:36.623 11:25:32 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:36.623 11:25:32 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- target/discovery.sh@35 -- # rpc_cmd nvmf_discovery_add_referral -t tcp -a 10.0.0.3 -s 4430 00:14:36.623 11:25:32 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:36.623 11:25:32 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- common/autotest_common.sh@10 -- # set +x 00:14:36.623 11:25:32 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:36.623 11:25:32 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- target/discovery.sh@37 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:c758a4ed-f09f-4c82-9afb-3d096f035464 --hostid=c758a4ed-f09f-4c82-9afb-3d096f035464 -t tcp -a 10.0.0.3 -s 4420 00:14:36.882 00:14:36.882 Discovery Log Number of Records 6, Generation counter 6 00:14:36.882 =====Discovery Log Entry 0====== 00:14:36.882 trtype: tcp 00:14:36.882 adrfam: ipv4 00:14:36.882 subtype: current discovery subsystem 00:14:36.882 treq: not required 00:14:36.882 portid: 0 00:14:36.882 trsvcid: 4420 00:14:36.883 subnqn: nqn.2014-08.org.nvmexpress.discovery 00:14:36.883 traddr: 10.0.0.3 00:14:36.883 eflags: explicit discovery connections, duplicate discovery information 00:14:36.883 sectype: none 00:14:36.883 =====Discovery Log Entry 1====== 00:14:36.883 trtype: tcp 00:14:36.883 adrfam: ipv4 00:14:36.883 subtype: nvme subsystem 00:14:36.883 treq: not required 00:14:36.883 portid: 0 00:14:36.883 trsvcid: 4420 00:14:36.883 subnqn: nqn.2016-06.io.spdk:cnode1 00:14:36.883 traddr: 10.0.0.3 00:14:36.883 eflags: none 00:14:36.883 sectype: none 00:14:36.883 =====Discovery Log Entry 2====== 00:14:36.883 trtype: tcp 00:14:36.883 adrfam: ipv4 00:14:36.883 subtype: nvme subsystem 00:14:36.883 treq: not required 00:14:36.883 portid: 0 00:14:36.883 trsvcid: 4420 00:14:36.883 subnqn: nqn.2016-06.io.spdk:cnode2 00:14:36.883 traddr: 10.0.0.3 00:14:36.883 eflags: none 00:14:36.883 sectype: none 00:14:36.883 =====Discovery Log Entry 3====== 00:14:36.883 trtype: tcp 00:14:36.883 adrfam: ipv4 00:14:36.883 subtype: nvme subsystem 00:14:36.883 treq: not required 00:14:36.883 portid: 0 00:14:36.883 trsvcid: 4420 00:14:36.883 subnqn: nqn.2016-06.io.spdk:cnode3 00:14:36.883 traddr: 10.0.0.3 00:14:36.883 eflags: none 00:14:36.883 sectype: none 00:14:36.883 =====Discovery Log Entry 4====== 00:14:36.883 trtype: tcp 00:14:36.883 adrfam: ipv4 00:14:36.883 subtype: nvme subsystem 00:14:36.883 treq: not required 00:14:36.883 portid: 0 00:14:36.883 trsvcid: 4420 00:14:36.883 subnqn: nqn.2016-06.io.spdk:cnode4 00:14:36.883 traddr: 10.0.0.3 00:14:36.883 eflags: none 00:14:36.883 sectype: none 00:14:36.883 =====Discovery Log Entry 5====== 00:14:36.883 trtype: tcp 00:14:36.883 adrfam: ipv4 00:14:36.883 subtype: discovery subsystem referral 00:14:36.883 treq: not required 00:14:36.883 portid: 0 00:14:36.883 trsvcid: 4430 00:14:36.883 subnqn: nqn.2014-08.org.nvmexpress.discovery 00:14:36.883 traddr: 10.0.0.3 00:14:36.883 eflags: none 00:14:36.883 sectype: none 00:14:36.883 Perform nvmf subsystem discovery via RPC 00:14:36.883 11:25:32 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- target/discovery.sh@39 -- # echo 'Perform nvmf subsystem discovery via RPC' 00:14:36.883 11:25:32 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- target/discovery.sh@40 -- # rpc_cmd nvmf_get_subsystems 00:14:36.883 11:25:32 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:36.883 11:25:32 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- common/autotest_common.sh@10 -- # set +x 00:14:36.883 [ 00:14:36.883 { 00:14:36.883 "allow_any_host": true, 00:14:36.883 "hosts": [], 00:14:36.883 "listen_addresses": [ 00:14:36.883 { 00:14:36.883 "adrfam": "IPv4", 00:14:36.883 "traddr": "10.0.0.3", 00:14:36.883 "trsvcid": "4420", 00:14:36.883 "trtype": "TCP" 00:14:36.883 } 00:14:36.883 ], 00:14:36.883 "nqn": "nqn.2014-08.org.nvmexpress.discovery", 00:14:36.883 "subtype": "Discovery" 00:14:36.883 }, 00:14:36.883 { 00:14:36.883 "allow_any_host": true, 00:14:36.883 "hosts": [], 00:14:36.883 "listen_addresses": [ 00:14:36.883 { 00:14:36.883 "adrfam": "IPv4", 00:14:36.883 "traddr": "10.0.0.3", 00:14:36.883 "trsvcid": "4420", 00:14:36.883 "trtype": "TCP" 00:14:36.883 } 00:14:36.883 ], 00:14:36.883 "max_cntlid": 65519, 00:14:36.883 "max_namespaces": 32, 00:14:36.883 "min_cntlid": 1, 00:14:36.883 "model_number": "SPDK bdev Controller", 00:14:36.883 "namespaces": [ 00:14:36.883 { 00:14:36.883 "bdev_name": "Null1", 00:14:36.883 "name": "Null1", 00:14:36.883 "nguid": "91E5168DCDCD4C3CAB6FD62C506FB145", 00:14:36.883 "nsid": 1, 00:14:36.883 "uuid": "91e5168d-cdcd-4c3c-ab6f-d62c506fb145" 00:14:36.883 } 00:14:36.883 ], 00:14:36.883 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:14:36.883 "serial_number": "SPDK00000000000001", 00:14:36.883 "subtype": "NVMe" 00:14:36.883 }, 00:14:36.883 { 00:14:36.883 "allow_any_host": true, 00:14:36.883 "hosts": [], 00:14:36.883 "listen_addresses": [ 00:14:36.883 { 00:14:36.883 "adrfam": "IPv4", 00:14:36.883 "traddr": "10.0.0.3", 00:14:36.883 "trsvcid": "4420", 00:14:36.883 "trtype": "TCP" 00:14:36.883 } 00:14:36.883 ], 00:14:36.883 "max_cntlid": 65519, 00:14:36.883 "max_namespaces": 32, 00:14:36.883 "min_cntlid": 1, 00:14:36.883 "model_number": "SPDK bdev Controller", 00:14:36.883 "namespaces": [ 00:14:36.883 { 00:14:36.883 "bdev_name": "Null2", 00:14:36.883 "name": "Null2", 00:14:36.883 "nguid": "D87CF9F37464413AAC59C1EA102E83A1", 00:14:36.883 "nsid": 1, 00:14:36.883 "uuid": "d87cf9f3-7464-413a-ac59-c1ea102e83a1" 00:14:36.883 } 00:14:36.883 ], 00:14:36.883 "nqn": "nqn.2016-06.io.spdk:cnode2", 00:14:36.883 "serial_number": "SPDK00000000000002", 00:14:36.883 "subtype": "NVMe" 00:14:36.883 }, 00:14:36.883 { 00:14:36.883 "allow_any_host": true, 00:14:36.883 "hosts": [], 00:14:36.883 "listen_addresses": [ 00:14:36.883 { 00:14:36.883 "adrfam": "IPv4", 00:14:36.883 "traddr": "10.0.0.3", 00:14:36.883 "trsvcid": "4420", 00:14:36.883 "trtype": "TCP" 00:14:36.883 } 00:14:36.883 ], 00:14:36.883 "max_cntlid": 65519, 00:14:36.883 "max_namespaces": 32, 00:14:36.883 "min_cntlid": 1, 00:14:36.883 "model_number": "SPDK bdev Controller", 00:14:36.883 "namespaces": [ 00:14:36.883 { 00:14:36.883 "bdev_name": "Null3", 00:14:36.883 "name": "Null3", 00:14:36.883 "nguid": "E6FCDCCCB0104307846D159798252567", 00:14:36.883 "nsid": 1, 00:14:36.883 "uuid": "e6fcdccc-b010-4307-846d-159798252567" 00:14:36.883 } 00:14:36.883 ], 00:14:36.883 "nqn": "nqn.2016-06.io.spdk:cnode3", 00:14:36.883 "serial_number": "SPDK00000000000003", 00:14:36.883 "subtype": "NVMe" 00:14:36.883 }, 00:14:36.883 { 00:14:36.883 "allow_any_host": true, 00:14:36.883 "hosts": [], 00:14:36.883 "listen_addresses": [ 00:14:36.883 { 00:14:36.883 "adrfam": "IPv4", 00:14:36.883 "traddr": "10.0.0.3", 00:14:36.883 "trsvcid": "4420", 00:14:36.883 "trtype": "TCP" 00:14:36.883 } 00:14:36.883 ], 00:14:36.883 "max_cntlid": 65519, 00:14:36.883 "max_namespaces": 32, 00:14:36.883 "min_cntlid": 1, 00:14:36.883 "model_number": "SPDK bdev Controller", 00:14:36.883 "namespaces": [ 00:14:36.883 { 00:14:36.883 "bdev_name": "Null4", 00:14:36.883 "name": "Null4", 00:14:36.883 "nguid": "B49ED335264E4DECBC347F4BFF6CB5C4", 00:14:36.883 "nsid": 1, 00:14:36.883 "uuid": "b49ed335-264e-4dec-bc34-7f4bff6cb5c4" 00:14:36.883 } 00:14:36.883 ], 00:14:36.883 "nqn": "nqn.2016-06.io.spdk:cnode4", 00:14:36.883 "serial_number": "SPDK00000000000004", 00:14:36.883 "subtype": "NVMe" 00:14:36.883 } 00:14:36.883 ] 00:14:36.883 11:25:32 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:36.883 11:25:32 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- target/discovery.sh@42 -- # seq 1 4 00:14:36.883 11:25:32 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- target/discovery.sh@42 -- # for i in $(seq 1 4) 00:14:36.883 11:25:32 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- target/discovery.sh@43 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:14:36.883 11:25:32 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:36.883 11:25:32 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- common/autotest_common.sh@10 -- # set +x 00:14:36.883 11:25:32 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:36.883 11:25:32 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- target/discovery.sh@44 -- # rpc_cmd bdev_null_delete Null1 00:14:36.883 11:25:32 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:36.883 11:25:32 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- common/autotest_common.sh@10 -- # set +x 00:14:36.883 11:25:32 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:36.883 11:25:32 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- target/discovery.sh@42 -- # for i in $(seq 1 4) 00:14:36.883 11:25:32 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- target/discovery.sh@43 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode2 00:14:36.883 11:25:32 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:36.883 11:25:32 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- common/autotest_common.sh@10 -- # set +x 00:14:36.883 11:25:32 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:36.883 11:25:32 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- target/discovery.sh@44 -- # rpc_cmd bdev_null_delete Null2 00:14:36.883 11:25:32 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:36.883 11:25:32 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- common/autotest_common.sh@10 -- # set +x 00:14:36.883 11:25:32 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:36.883 11:25:32 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- target/discovery.sh@42 -- # for i in $(seq 1 4) 00:14:36.883 11:25:32 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- target/discovery.sh@43 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode3 00:14:36.883 11:25:32 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:36.883 11:25:32 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- common/autotest_common.sh@10 -- # set +x 00:14:36.883 11:25:32 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:36.883 11:25:32 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- target/discovery.sh@44 -- # rpc_cmd bdev_null_delete Null3 00:14:36.883 11:25:32 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:36.883 11:25:32 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- common/autotest_common.sh@10 -- # set +x 00:14:36.884 11:25:32 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:36.884 11:25:32 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- target/discovery.sh@42 -- # for i in $(seq 1 4) 00:14:36.884 11:25:32 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- target/discovery.sh@43 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode4 00:14:36.884 11:25:32 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:36.884 11:25:32 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- common/autotest_common.sh@10 -- # set +x 00:14:36.884 11:25:32 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:36.884 11:25:32 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- target/discovery.sh@44 -- # rpc_cmd bdev_null_delete Null4 00:14:36.884 11:25:32 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:36.884 11:25:32 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- common/autotest_common.sh@10 -- # set +x 00:14:36.884 11:25:32 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:36.884 11:25:32 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- target/discovery.sh@47 -- # rpc_cmd nvmf_discovery_remove_referral -t tcp -a 10.0.0.3 -s 4430 00:14:36.884 11:25:32 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:36.884 11:25:32 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- common/autotest_common.sh@10 -- # set +x 00:14:36.884 11:25:32 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:36.884 11:25:32 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- target/discovery.sh@49 -- # rpc_cmd bdev_get_bdevs 00:14:36.884 11:25:32 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:36.884 11:25:32 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- common/autotest_common.sh@10 -- # set +x 00:14:36.884 11:25:32 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- target/discovery.sh@49 -- # jq -r '.[].name' 00:14:36.884 11:25:32 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:36.884 11:25:32 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- target/discovery.sh@49 -- # check_bdevs= 00:14:36.884 11:25:32 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- target/discovery.sh@50 -- # '[' -n '' ']' 00:14:36.884 11:25:32 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- target/discovery.sh@55 -- # trap - SIGINT SIGTERM EXIT 00:14:36.884 11:25:32 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- target/discovery.sh@57 -- # nvmftestfini 00:14:36.884 11:25:32 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- nvmf/common.sh@514 -- # nvmfcleanup 00:14:36.884 11:25:32 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- nvmf/common.sh@121 -- # sync 00:14:37.144 11:25:32 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- nvmf/common.sh@123 -- # '[' tcp == tcp ']' 00:14:37.144 11:25:32 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- nvmf/common.sh@124 -- # set +e 00:14:37.144 11:25:32 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- nvmf/common.sh@125 -- # for i in {1..20} 00:14:37.144 11:25:32 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- nvmf/common.sh@126 -- # modprobe -v -r nvme-tcp 00:14:37.144 rmmod nvme_tcp 00:14:37.144 rmmod nvme_fabrics 00:14:37.144 rmmod nvme_keyring 00:14:37.144 11:25:32 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- nvmf/common.sh@127 -- # modprobe -v -r nvme-fabrics 00:14:37.144 11:25:32 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- nvmf/common.sh@128 -- # set -e 00:14:37.144 11:25:32 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- nvmf/common.sh@129 -- # return 0 00:14:37.144 11:25:32 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- nvmf/common.sh@515 -- # '[' -n 72950 ']' 00:14:37.144 11:25:32 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- nvmf/common.sh@516 -- # killprocess 72950 00:14:37.144 11:25:32 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- common/autotest_common.sh@950 -- # '[' -z 72950 ']' 00:14:37.144 11:25:32 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- common/autotest_common.sh@954 -- # kill -0 72950 00:14:37.144 11:25:32 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- common/autotest_common.sh@955 -- # uname 00:14:37.144 11:25:32 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- common/autotest_common.sh@955 -- # '[' Linux = Linux ']' 00:14:37.144 11:25:32 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- common/autotest_common.sh@956 -- # ps --no-headers -o comm= 72950 00:14:37.144 killing process with pid 72950 00:14:37.144 11:25:32 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- common/autotest_common.sh@956 -- # process_name=reactor_0 00:14:37.144 11:25:32 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- common/autotest_common.sh@960 -- # '[' reactor_0 = sudo ']' 00:14:37.144 11:25:32 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- common/autotest_common.sh@968 -- # echo 'killing process with pid 72950' 00:14:37.144 11:25:32 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- common/autotest_common.sh@969 -- # kill 72950 00:14:37.144 11:25:32 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- common/autotest_common.sh@974 -- # wait 72950 00:14:37.403 11:25:32 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- nvmf/common.sh@518 -- # '[' '' == iso ']' 00:14:37.403 11:25:32 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- nvmf/common.sh@521 -- # [[ tcp == \t\c\p ]] 00:14:37.403 11:25:32 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- nvmf/common.sh@522 -- # nvmf_tcp_fini 00:14:37.403 11:25:32 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- nvmf/common.sh@297 -- # iptr 00:14:37.403 11:25:32 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- nvmf/common.sh@789 -- # iptables-save 00:14:37.403 11:25:32 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- nvmf/common.sh@789 -- # grep -v SPDK_NVMF 00:14:37.403 11:25:32 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- nvmf/common.sh@789 -- # iptables-restore 00:14:37.403 11:25:32 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- nvmf/common.sh@298 -- # [[ nvmf_tgt_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s\_\s\p\d\k ]] 00:14:37.403 11:25:32 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- nvmf/common.sh@299 -- # nvmf_veth_fini 00:14:37.403 11:25:32 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- nvmf/common.sh@233 -- # ip link set nvmf_init_br nomaster 00:14:37.403 11:25:32 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- nvmf/common.sh@234 -- # ip link set nvmf_init_br2 nomaster 00:14:37.403 11:25:32 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- nvmf/common.sh@235 -- # ip link set nvmf_tgt_br nomaster 00:14:37.403 11:25:32 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- nvmf/common.sh@236 -- # ip link set nvmf_tgt_br2 nomaster 00:14:37.403 11:25:32 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- nvmf/common.sh@237 -- # ip link set nvmf_init_br down 00:14:37.403 11:25:32 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- nvmf/common.sh@238 -- # ip link set nvmf_init_br2 down 00:14:37.403 11:25:32 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- nvmf/common.sh@239 -- # ip link set nvmf_tgt_br down 00:14:37.403 11:25:32 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- nvmf/common.sh@240 -- # ip link set nvmf_tgt_br2 down 00:14:37.403 11:25:32 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- nvmf/common.sh@241 -- # ip link delete nvmf_br type bridge 00:14:37.403 11:25:32 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- nvmf/common.sh@242 -- # ip link delete nvmf_init_if 00:14:37.403 11:25:32 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- nvmf/common.sh@243 -- # ip link delete nvmf_init_if2 00:14:37.403 11:25:32 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- nvmf/common.sh@244 -- # ip netns exec nvmf_tgt_ns_spdk ip link delete nvmf_tgt_if 00:14:37.661 11:25:32 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- nvmf/common.sh@245 -- # ip netns exec nvmf_tgt_ns_spdk ip link delete nvmf_tgt_if2 00:14:37.661 11:25:32 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- nvmf/common.sh@246 -- # remove_spdk_ns 00:14:37.661 11:25:32 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- nvmf/common.sh@654 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:14:37.661 11:25:32 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 15> /dev/null' 00:14:37.661 11:25:32 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:14:37.661 11:25:32 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- nvmf/common.sh@300 -- # return 0 00:14:37.661 00:14:37.661 real 0m2.843s 00:14:37.661 user 0m7.034s 00:14:37.661 sys 0m0.788s 00:14:37.661 11:25:32 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- common/autotest_common.sh@1126 -- # xtrace_disable 00:14:37.661 ************************************ 00:14:37.661 END TEST nvmf_target_discovery 00:14:37.661 ************************************ 00:14:37.661 11:25:32 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- common/autotest_common.sh@10 -- # set +x 00:14:37.661 11:25:33 nvmf_tcp.nvmf_target_extra -- nvmf/nvmf_target_extra.sh@19 -- # run_test nvmf_referrals /home/vagrant/spdk_repo/spdk/test/nvmf/target/referrals.sh --transport=tcp 00:14:37.661 11:25:33 nvmf_tcp.nvmf_target_extra -- common/autotest_common.sh@1101 -- # '[' 3 -le 1 ']' 00:14:37.661 11:25:33 nvmf_tcp.nvmf_target_extra -- common/autotest_common.sh@1107 -- # xtrace_disable 00:14:37.661 11:25:33 nvmf_tcp.nvmf_target_extra -- common/autotest_common.sh@10 -- # set +x 00:14:37.661 ************************************ 00:14:37.661 START TEST nvmf_referrals 00:14:37.661 ************************************ 00:14:37.661 11:25:33 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- common/autotest_common.sh@1125 -- # /home/vagrant/spdk_repo/spdk/test/nvmf/target/referrals.sh --transport=tcp 00:14:37.661 * Looking for test storage... 00:14:37.661 * Found test storage at /home/vagrant/spdk_repo/spdk/test/nvmf/target 00:14:37.661 11:25:33 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- common/autotest_common.sh@1680 -- # [[ y == y ]] 00:14:37.661 11:25:33 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- common/autotest_common.sh@1681 -- # lcov --version 00:14:37.661 11:25:33 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- common/autotest_common.sh@1681 -- # awk '{print $NF}' 00:14:37.920 11:25:33 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- common/autotest_common.sh@1681 -- # lt 1.15 2 00:14:37.920 11:25:33 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- scripts/common.sh@373 -- # cmp_versions 1.15 '<' 2 00:14:37.920 11:25:33 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- scripts/common.sh@333 -- # local ver1 ver1_l 00:14:37.920 11:25:33 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- scripts/common.sh@334 -- # local ver2 ver2_l 00:14:37.920 11:25:33 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- scripts/common.sh@336 -- # IFS=.-: 00:14:37.920 11:25:33 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- scripts/common.sh@336 -- # read -ra ver1 00:14:37.920 11:25:33 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- scripts/common.sh@337 -- # IFS=.-: 00:14:37.920 11:25:33 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- scripts/common.sh@337 -- # read -ra ver2 00:14:37.920 11:25:33 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- scripts/common.sh@338 -- # local 'op=<' 00:14:37.920 11:25:33 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- scripts/common.sh@340 -- # ver1_l=2 00:14:37.920 11:25:33 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- scripts/common.sh@341 -- # ver2_l=1 00:14:37.920 11:25:33 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- scripts/common.sh@343 -- # local lt=0 gt=0 eq=0 v 00:14:37.920 11:25:33 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- scripts/common.sh@344 -- # case "$op" in 00:14:37.920 11:25:33 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- scripts/common.sh@345 -- # : 1 00:14:37.920 11:25:33 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- scripts/common.sh@364 -- # (( v = 0 )) 00:14:37.920 11:25:33 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- scripts/common.sh@364 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:14:37.920 11:25:33 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- scripts/common.sh@365 -- # decimal 1 00:14:37.920 11:25:33 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- scripts/common.sh@353 -- # local d=1 00:14:37.920 11:25:33 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- scripts/common.sh@354 -- # [[ 1 =~ ^[0-9]+$ ]] 00:14:37.920 11:25:33 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- scripts/common.sh@355 -- # echo 1 00:14:37.920 11:25:33 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- scripts/common.sh@365 -- # ver1[v]=1 00:14:37.920 11:25:33 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- scripts/common.sh@366 -- # decimal 2 00:14:37.920 11:25:33 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- scripts/common.sh@353 -- # local d=2 00:14:37.920 11:25:33 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- scripts/common.sh@354 -- # [[ 2 =~ ^[0-9]+$ ]] 00:14:37.920 11:25:33 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- scripts/common.sh@355 -- # echo 2 00:14:37.920 11:25:33 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- scripts/common.sh@366 -- # ver2[v]=2 00:14:37.920 11:25:33 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- scripts/common.sh@367 -- # (( ver1[v] > ver2[v] )) 00:14:37.920 11:25:33 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- scripts/common.sh@368 -- # (( ver1[v] < ver2[v] )) 00:14:37.920 11:25:33 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- scripts/common.sh@368 -- # return 0 00:14:37.920 11:25:33 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- common/autotest_common.sh@1682 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:14:37.920 11:25:33 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- common/autotest_common.sh@1694 -- # export 'LCOV_OPTS= 00:14:37.920 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:14:37.920 --rc genhtml_branch_coverage=1 00:14:37.920 --rc genhtml_function_coverage=1 00:14:37.920 --rc genhtml_legend=1 00:14:37.920 --rc geninfo_all_blocks=1 00:14:37.920 --rc geninfo_unexecuted_blocks=1 00:14:37.920 00:14:37.920 ' 00:14:37.920 11:25:33 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- common/autotest_common.sh@1694 -- # LCOV_OPTS=' 00:14:37.920 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:14:37.920 --rc genhtml_branch_coverage=1 00:14:37.920 --rc genhtml_function_coverage=1 00:14:37.920 --rc genhtml_legend=1 00:14:37.920 --rc geninfo_all_blocks=1 00:14:37.920 --rc geninfo_unexecuted_blocks=1 00:14:37.920 00:14:37.920 ' 00:14:37.920 11:25:33 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- common/autotest_common.sh@1695 -- # export 'LCOV=lcov 00:14:37.920 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:14:37.920 --rc genhtml_branch_coverage=1 00:14:37.920 --rc genhtml_function_coverage=1 00:14:37.920 --rc genhtml_legend=1 00:14:37.920 --rc geninfo_all_blocks=1 00:14:37.920 --rc geninfo_unexecuted_blocks=1 00:14:37.920 00:14:37.920 ' 00:14:37.920 11:25:33 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- common/autotest_common.sh@1695 -- # LCOV='lcov 00:14:37.920 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:14:37.920 --rc genhtml_branch_coverage=1 00:14:37.920 --rc genhtml_function_coverage=1 00:14:37.920 --rc genhtml_legend=1 00:14:37.920 --rc geninfo_all_blocks=1 00:14:37.920 --rc geninfo_unexecuted_blocks=1 00:14:37.920 00:14:37.920 ' 00:14:37.920 11:25:33 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- target/referrals.sh@9 -- # source /home/vagrant/spdk_repo/spdk/test/nvmf/common.sh 00:14:37.920 11:25:33 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- nvmf/common.sh@7 -- # uname -s 00:14:37.920 11:25:33 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:14:37.920 11:25:33 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:14:37.920 11:25:33 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:14:37.920 11:25:33 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:14:37.920 11:25:33 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:14:37.920 11:25:33 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:14:37.920 11:25:33 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:14:37.920 11:25:33 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:14:37.920 11:25:33 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:14:37.920 11:25:33 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:14:37.920 11:25:33 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:c758a4ed-f09f-4c82-9afb-3d096f035464 00:14:37.920 11:25:33 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- nvmf/common.sh@18 -- # NVME_HOSTID=c758a4ed-f09f-4c82-9afb-3d096f035464 00:14:37.920 11:25:33 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:14:37.920 11:25:33 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:14:37.920 11:25:33 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- nvmf/common.sh@21 -- # NET_TYPE=virt 00:14:37.920 11:25:33 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:14:37.920 11:25:33 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- nvmf/common.sh@49 -- # source /home/vagrant/spdk_repo/spdk/scripts/common.sh 00:14:37.920 11:25:33 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- scripts/common.sh@15 -- # shopt -s extglob 00:14:37.920 11:25:33 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- scripts/common.sh@544 -- # [[ -e /bin/wpdk_common.sh ]] 00:14:37.920 11:25:33 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- scripts/common.sh@552 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:14:37.920 11:25:33 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- scripts/common.sh@553 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:14:37.920 11:25:33 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:37.920 11:25:33 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:37.920 11:25:33 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:37.920 11:25:33 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- paths/export.sh@5 -- # export PATH 00:14:37.920 11:25:33 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:37.920 11:25:33 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- nvmf/common.sh@51 -- # : 0 00:14:37.920 11:25:33 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- nvmf/common.sh@52 -- # export NVMF_APP_SHM_ID 00:14:37.920 11:25:33 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- nvmf/common.sh@53 -- # build_nvmf_app_args 00:14:37.920 11:25:33 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:14:37.920 11:25:33 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:14:37.920 11:25:33 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:14:37.920 11:25:33 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- nvmf/common.sh@33 -- # '[' '' -eq 1 ']' 00:14:37.920 /home/vagrant/spdk_repo/spdk/test/nvmf/common.sh: line 33: [: : integer expression expected 00:14:37.920 11:25:33 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- nvmf/common.sh@37 -- # '[' -n '' ']' 00:14:37.920 11:25:33 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- nvmf/common.sh@39 -- # '[' 0 -eq 1 ']' 00:14:37.920 11:25:33 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- nvmf/common.sh@55 -- # have_pci_nics=0 00:14:37.920 11:25:33 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- target/referrals.sh@11 -- # NVMF_REFERRAL_IP_1=127.0.0.2 00:14:37.920 11:25:33 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- target/referrals.sh@12 -- # NVMF_REFERRAL_IP_2=127.0.0.3 00:14:37.920 11:25:33 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- target/referrals.sh@13 -- # NVMF_REFERRAL_IP_3=127.0.0.4 00:14:37.920 11:25:33 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- target/referrals.sh@14 -- # NVMF_PORT_REFERRAL=4430 00:14:37.920 11:25:33 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- target/referrals.sh@15 -- # DISCOVERY_NQN=nqn.2014-08.org.nvmexpress.discovery 00:14:37.920 11:25:33 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- target/referrals.sh@16 -- # NQN=nqn.2016-06.io.spdk:cnode1 00:14:37.920 11:25:33 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- target/referrals.sh@37 -- # nvmftestinit 00:14:37.920 11:25:33 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- nvmf/common.sh@467 -- # '[' -z tcp ']' 00:14:37.920 11:25:33 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- nvmf/common.sh@472 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:14:37.920 11:25:33 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- nvmf/common.sh@474 -- # prepare_net_devs 00:14:37.920 11:25:33 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- nvmf/common.sh@436 -- # local -g is_hw=no 00:14:37.920 11:25:33 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- nvmf/common.sh@438 -- # remove_spdk_ns 00:14:37.920 11:25:33 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- nvmf/common.sh@654 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:14:37.920 11:25:33 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 15> /dev/null' 00:14:37.920 11:25:33 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:14:37.920 11:25:33 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- nvmf/common.sh@440 -- # [[ virt != virt ]] 00:14:37.920 11:25:33 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- nvmf/common.sh@442 -- # [[ no == yes ]] 00:14:37.920 11:25:33 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- nvmf/common.sh@449 -- # [[ virt == phy ]] 00:14:37.920 11:25:33 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- nvmf/common.sh@452 -- # [[ virt == phy-fallback ]] 00:14:37.920 11:25:33 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- nvmf/common.sh@457 -- # [[ tcp == tcp ]] 00:14:37.920 11:25:33 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- nvmf/common.sh@458 -- # nvmf_veth_init 00:14:37.920 11:25:33 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- nvmf/common.sh@145 -- # NVMF_FIRST_INITIATOR_IP=10.0.0.1 00:14:37.920 11:25:33 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- nvmf/common.sh@146 -- # NVMF_SECOND_INITIATOR_IP=10.0.0.2 00:14:37.920 11:25:33 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- nvmf/common.sh@147 -- # NVMF_FIRST_TARGET_IP=10.0.0.3 00:14:37.920 11:25:33 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- nvmf/common.sh@148 -- # NVMF_SECOND_TARGET_IP=10.0.0.4 00:14:37.920 11:25:33 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- nvmf/common.sh@149 -- # NVMF_INITIATOR_IP=10.0.0.1 00:14:37.920 11:25:33 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- nvmf/common.sh@150 -- # NVMF_BRIDGE=nvmf_br 00:14:37.920 11:25:33 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- nvmf/common.sh@151 -- # NVMF_INITIATOR_INTERFACE=nvmf_init_if 00:14:37.920 11:25:33 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- nvmf/common.sh@152 -- # NVMF_INITIATOR_INTERFACE2=nvmf_init_if2 00:14:37.920 11:25:33 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- nvmf/common.sh@153 -- # NVMF_INITIATOR_BRIDGE=nvmf_init_br 00:14:37.920 11:25:33 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- nvmf/common.sh@154 -- # NVMF_INITIATOR_BRIDGE2=nvmf_init_br2 00:14:37.920 11:25:33 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- nvmf/common.sh@155 -- # NVMF_TARGET_NAMESPACE=nvmf_tgt_ns_spdk 00:14:37.920 11:25:33 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- nvmf/common.sh@156 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:14:37.920 11:25:33 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- nvmf/common.sh@157 -- # NVMF_TARGET_INTERFACE=nvmf_tgt_if 00:14:37.920 11:25:33 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- nvmf/common.sh@158 -- # NVMF_TARGET_INTERFACE2=nvmf_tgt_if2 00:14:37.920 11:25:33 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- nvmf/common.sh@159 -- # NVMF_TARGET_BRIDGE=nvmf_tgt_br 00:14:37.920 11:25:33 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- nvmf/common.sh@160 -- # NVMF_TARGET_BRIDGE2=nvmf_tgt_br2 00:14:37.920 11:25:33 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- nvmf/common.sh@162 -- # ip link set nvmf_init_br nomaster 00:14:37.920 Cannot find device "nvmf_init_br" 00:14:37.920 11:25:33 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- nvmf/common.sh@162 -- # true 00:14:37.920 11:25:33 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- nvmf/common.sh@163 -- # ip link set nvmf_init_br2 nomaster 00:14:37.920 Cannot find device "nvmf_init_br2" 00:14:37.920 11:25:33 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- nvmf/common.sh@163 -- # true 00:14:37.920 11:25:33 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- nvmf/common.sh@164 -- # ip link set nvmf_tgt_br nomaster 00:14:37.920 Cannot find device "nvmf_tgt_br" 00:14:37.920 11:25:33 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- nvmf/common.sh@164 -- # true 00:14:37.920 11:25:33 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- nvmf/common.sh@165 -- # ip link set nvmf_tgt_br2 nomaster 00:14:37.920 Cannot find device "nvmf_tgt_br2" 00:14:37.920 11:25:33 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- nvmf/common.sh@165 -- # true 00:14:37.920 11:25:33 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- nvmf/common.sh@166 -- # ip link set nvmf_init_br down 00:14:37.920 Cannot find device "nvmf_init_br" 00:14:37.920 11:25:33 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- nvmf/common.sh@166 -- # true 00:14:37.920 11:25:33 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- nvmf/common.sh@167 -- # ip link set nvmf_init_br2 down 00:14:37.920 Cannot find device "nvmf_init_br2" 00:14:37.920 11:25:33 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- nvmf/common.sh@167 -- # true 00:14:37.920 11:25:33 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- nvmf/common.sh@168 -- # ip link set nvmf_tgt_br down 00:14:37.920 Cannot find device "nvmf_tgt_br" 00:14:37.920 11:25:33 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- nvmf/common.sh@168 -- # true 00:14:37.920 11:25:33 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- nvmf/common.sh@169 -- # ip link set nvmf_tgt_br2 down 00:14:37.920 Cannot find device "nvmf_tgt_br2" 00:14:37.920 11:25:33 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- nvmf/common.sh@169 -- # true 00:14:37.920 11:25:33 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- nvmf/common.sh@170 -- # ip link delete nvmf_br type bridge 00:14:37.920 Cannot find device "nvmf_br" 00:14:37.920 11:25:33 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- nvmf/common.sh@170 -- # true 00:14:37.920 11:25:33 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- nvmf/common.sh@171 -- # ip link delete nvmf_init_if 00:14:37.920 Cannot find device "nvmf_init_if" 00:14:37.920 11:25:33 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- nvmf/common.sh@171 -- # true 00:14:37.920 11:25:33 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- nvmf/common.sh@172 -- # ip link delete nvmf_init_if2 00:14:37.920 Cannot find device "nvmf_init_if2" 00:14:37.920 11:25:33 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- nvmf/common.sh@172 -- # true 00:14:37.920 11:25:33 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- nvmf/common.sh@173 -- # ip netns exec nvmf_tgt_ns_spdk ip link delete nvmf_tgt_if 00:14:37.920 Cannot open network namespace "nvmf_tgt_ns_spdk": No such file or directory 00:14:37.920 11:25:33 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- nvmf/common.sh@173 -- # true 00:14:37.920 11:25:33 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- nvmf/common.sh@174 -- # ip netns exec nvmf_tgt_ns_spdk ip link delete nvmf_tgt_if2 00:14:37.920 Cannot open network namespace "nvmf_tgt_ns_spdk": No such file or directory 00:14:37.920 11:25:33 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- nvmf/common.sh@174 -- # true 00:14:37.920 11:25:33 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- nvmf/common.sh@177 -- # ip netns add nvmf_tgt_ns_spdk 00:14:37.920 11:25:33 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- nvmf/common.sh@180 -- # ip link add nvmf_init_if type veth peer name nvmf_init_br 00:14:37.920 11:25:33 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- nvmf/common.sh@181 -- # ip link add nvmf_init_if2 type veth peer name nvmf_init_br2 00:14:37.920 11:25:33 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- nvmf/common.sh@182 -- # ip link add nvmf_tgt_if type veth peer name nvmf_tgt_br 00:14:37.920 11:25:33 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- nvmf/common.sh@183 -- # ip link add nvmf_tgt_if2 type veth peer name nvmf_tgt_br2 00:14:38.193 11:25:33 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- nvmf/common.sh@186 -- # ip link set nvmf_tgt_if netns nvmf_tgt_ns_spdk 00:14:38.193 11:25:33 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- nvmf/common.sh@187 -- # ip link set nvmf_tgt_if2 netns nvmf_tgt_ns_spdk 00:14:38.193 11:25:33 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- nvmf/common.sh@190 -- # ip addr add 10.0.0.1/24 dev nvmf_init_if 00:14:38.193 11:25:33 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- nvmf/common.sh@191 -- # ip addr add 10.0.0.2/24 dev nvmf_init_if2 00:14:38.193 11:25:33 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- nvmf/common.sh@192 -- # ip netns exec nvmf_tgt_ns_spdk ip addr add 10.0.0.3/24 dev nvmf_tgt_if 00:14:38.193 11:25:33 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- nvmf/common.sh@193 -- # ip netns exec nvmf_tgt_ns_spdk ip addr add 10.0.0.4/24 dev nvmf_tgt_if2 00:14:38.193 11:25:33 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- nvmf/common.sh@196 -- # ip link set nvmf_init_if up 00:14:38.193 11:25:33 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- nvmf/common.sh@197 -- # ip link set nvmf_init_if2 up 00:14:38.193 11:25:33 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- nvmf/common.sh@198 -- # ip link set nvmf_init_br up 00:14:38.193 11:25:33 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- nvmf/common.sh@199 -- # ip link set nvmf_init_br2 up 00:14:38.193 11:25:33 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- nvmf/common.sh@200 -- # ip link set nvmf_tgt_br up 00:14:38.193 11:25:33 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- nvmf/common.sh@201 -- # ip link set nvmf_tgt_br2 up 00:14:38.193 11:25:33 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- nvmf/common.sh@202 -- # ip netns exec nvmf_tgt_ns_spdk ip link set nvmf_tgt_if up 00:14:38.193 11:25:33 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- nvmf/common.sh@203 -- # ip netns exec nvmf_tgt_ns_spdk ip link set nvmf_tgt_if2 up 00:14:38.193 11:25:33 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- nvmf/common.sh@204 -- # ip netns exec nvmf_tgt_ns_spdk ip link set lo up 00:14:38.193 11:25:33 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- nvmf/common.sh@207 -- # ip link add nvmf_br type bridge 00:14:38.193 11:25:33 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- nvmf/common.sh@208 -- # ip link set nvmf_br up 00:14:38.193 11:25:33 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- nvmf/common.sh@211 -- # ip link set nvmf_init_br master nvmf_br 00:14:38.193 11:25:33 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- nvmf/common.sh@212 -- # ip link set nvmf_init_br2 master nvmf_br 00:14:38.193 11:25:33 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- nvmf/common.sh@213 -- # ip link set nvmf_tgt_br master nvmf_br 00:14:38.193 11:25:33 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- nvmf/common.sh@214 -- # ip link set nvmf_tgt_br2 master nvmf_br 00:14:38.193 11:25:33 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- nvmf/common.sh@217 -- # ipts -I INPUT 1 -i nvmf_init_if -p tcp --dport 4420 -j ACCEPT 00:14:38.193 11:25:33 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- nvmf/common.sh@788 -- # iptables -I INPUT 1 -i nvmf_init_if -p tcp --dport 4420 -j ACCEPT -m comment --comment 'SPDK_NVMF:-I INPUT 1 -i nvmf_init_if -p tcp --dport 4420 -j ACCEPT' 00:14:38.193 11:25:33 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- nvmf/common.sh@218 -- # ipts -I INPUT 1 -i nvmf_init_if2 -p tcp --dport 4420 -j ACCEPT 00:14:38.193 11:25:33 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- nvmf/common.sh@788 -- # iptables -I INPUT 1 -i nvmf_init_if2 -p tcp --dport 4420 -j ACCEPT -m comment --comment 'SPDK_NVMF:-I INPUT 1 -i nvmf_init_if2 -p tcp --dport 4420 -j ACCEPT' 00:14:38.193 11:25:33 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- nvmf/common.sh@219 -- # ipts -A FORWARD -i nvmf_br -o nvmf_br -j ACCEPT 00:14:38.193 11:25:33 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- nvmf/common.sh@788 -- # iptables -A FORWARD -i nvmf_br -o nvmf_br -j ACCEPT -m comment --comment 'SPDK_NVMF:-A FORWARD -i nvmf_br -o nvmf_br -j ACCEPT' 00:14:38.193 11:25:33 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- nvmf/common.sh@222 -- # ping -c 1 10.0.0.3 00:14:38.193 PING 10.0.0.3 (10.0.0.3) 56(84) bytes of data. 00:14:38.193 64 bytes from 10.0.0.3: icmp_seq=1 ttl=64 time=0.061 ms 00:14:38.193 00:14:38.193 --- 10.0.0.3 ping statistics --- 00:14:38.193 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:14:38.193 rtt min/avg/max/mdev = 0.061/0.061/0.061/0.000 ms 00:14:38.193 11:25:33 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- nvmf/common.sh@223 -- # ping -c 1 10.0.0.4 00:14:38.193 PING 10.0.0.4 (10.0.0.4) 56(84) bytes of data. 00:14:38.193 64 bytes from 10.0.0.4: icmp_seq=1 ttl=64 time=0.040 ms 00:14:38.193 00:14:38.193 --- 10.0.0.4 ping statistics --- 00:14:38.193 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:14:38.193 rtt min/avg/max/mdev = 0.040/0.040/0.040/0.000 ms 00:14:38.193 11:25:33 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- nvmf/common.sh@224 -- # ip netns exec nvmf_tgt_ns_spdk ping -c 1 10.0.0.1 00:14:38.193 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:14:38.193 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.035 ms 00:14:38.193 00:14:38.193 --- 10.0.0.1 ping statistics --- 00:14:38.193 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:14:38.193 rtt min/avg/max/mdev = 0.035/0.035/0.035/0.000 ms 00:14:38.193 11:25:33 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- nvmf/common.sh@225 -- # ip netns exec nvmf_tgt_ns_spdk ping -c 1 10.0.0.2 00:14:38.193 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:14:38.193 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.079 ms 00:14:38.193 00:14:38.193 --- 10.0.0.2 ping statistics --- 00:14:38.193 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:14:38.193 rtt min/avg/max/mdev = 0.079/0.079/0.079/0.000 ms 00:14:38.193 11:25:33 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- nvmf/common.sh@227 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:14:38.193 11:25:33 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- nvmf/common.sh@459 -- # return 0 00:14:38.193 11:25:33 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- nvmf/common.sh@476 -- # '[' '' == iso ']' 00:14:38.193 11:25:33 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- nvmf/common.sh@480 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:14:38.193 11:25:33 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- nvmf/common.sh@481 -- # [[ tcp == \r\d\m\a ]] 00:14:38.193 11:25:33 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- nvmf/common.sh@490 -- # [[ tcp == \t\c\p ]] 00:14:38.193 11:25:33 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- nvmf/common.sh@491 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:14:38.193 11:25:33 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- nvmf/common.sh@494 -- # '[' tcp == tcp ']' 00:14:38.193 11:25:33 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- nvmf/common.sh@500 -- # modprobe nvme-tcp 00:14:38.193 11:25:33 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- target/referrals.sh@38 -- # nvmfappstart -m 0xF 00:14:38.193 11:25:33 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- nvmf/common.sh@505 -- # timing_enter start_nvmf_tgt 00:14:38.193 11:25:33 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- common/autotest_common.sh@724 -- # xtrace_disable 00:14:38.193 11:25:33 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- common/autotest_common.sh@10 -- # set +x 00:14:38.193 11:25:33 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- nvmf/common.sh@507 -- # nvmfpid=73234 00:14:38.193 11:25:33 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- nvmf/common.sh@508 -- # waitforlisten 73234 00:14:38.193 11:25:33 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- common/autotest_common.sh@831 -- # '[' -z 73234 ']' 00:14:38.193 11:25:33 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- nvmf/common.sh@506 -- # ip netns exec nvmf_tgt_ns_spdk /home/vagrant/spdk_repo/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:14:38.193 11:25:33 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- common/autotest_common.sh@835 -- # local rpc_addr=/var/tmp/spdk.sock 00:14:38.193 11:25:33 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- common/autotest_common.sh@836 -- # local max_retries=100 00:14:38.193 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:14:38.193 11:25:33 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- common/autotest_common.sh@838 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:14:38.193 11:25:33 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- common/autotest_common.sh@840 -- # xtrace_disable 00:14:38.193 11:25:33 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- common/autotest_common.sh@10 -- # set +x 00:14:38.451 [2024-10-07 11:25:33.747115] Starting SPDK v25.01-pre git sha1 2a4f56c54 / DPDK 24.03.0 initialization... 00:14:38.451 [2024-10-07 11:25:33.747227] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --iova-mode=pa --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:14:38.451 [2024-10-07 11:25:33.895623] app.c: 917:spdk_app_start: *NOTICE*: Total cores available: 4 00:14:38.709 [2024-10-07 11:25:34.015221] app.c: 610:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:14:38.709 [2024-10-07 11:25:34.015280] app.c: 611:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:14:38.709 [2024-10-07 11:25:34.015295] app.c: 616:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:14:38.709 [2024-10-07 11:25:34.015317] app.c: 617:app_setup_trace: *NOTICE*: SPDK application currently running. 00:14:38.709 [2024-10-07 11:25:34.015327] app.c: 618:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:14:38.709 [2024-10-07 11:25:34.016644] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 1 00:14:38.709 [2024-10-07 11:25:34.016800] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 2 00:14:38.709 [2024-10-07 11:25:34.016921] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 3 00:14:38.709 [2024-10-07 11:25:34.016995] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 0 00:14:39.642 11:25:34 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- common/autotest_common.sh@860 -- # (( i == 0 )) 00:14:39.642 11:25:34 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- common/autotest_common.sh@864 -- # return 0 00:14:39.642 11:25:34 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- nvmf/common.sh@509 -- # timing_exit start_nvmf_tgt 00:14:39.642 11:25:34 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- common/autotest_common.sh@730 -- # xtrace_disable 00:14:39.642 11:25:34 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- common/autotest_common.sh@10 -- # set +x 00:14:39.642 11:25:34 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- nvmf/common.sh@510 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:14:39.642 11:25:34 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- target/referrals.sh@40 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:14:39.642 11:25:34 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:39.643 11:25:34 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- common/autotest_common.sh@10 -- # set +x 00:14:39.643 [2024-10-07 11:25:34.863410] tcp.c: 738:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:14:39.643 11:25:34 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:39.643 11:25:34 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- target/referrals.sh@41 -- # rpc_cmd nvmf_subsystem_add_listener -t tcp -a 10.0.0.3 -s 8009 discovery 00:14:39.643 11:25:34 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:39.643 11:25:34 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- common/autotest_common.sh@10 -- # set +x 00:14:39.643 [2024-10-07 11:25:34.879699] tcp.c:1081:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.3 port 8009 *** 00:14:39.643 11:25:34 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:39.643 11:25:34 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- target/referrals.sh@44 -- # rpc_cmd nvmf_discovery_add_referral -t tcp -a 127.0.0.2 -s 4430 00:14:39.643 11:25:34 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:39.643 11:25:34 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- common/autotest_common.sh@10 -- # set +x 00:14:39.643 11:25:34 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:39.643 11:25:34 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- target/referrals.sh@45 -- # rpc_cmd nvmf_discovery_add_referral -t tcp -a 127.0.0.3 -s 4430 00:14:39.643 11:25:34 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:39.643 11:25:34 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- common/autotest_common.sh@10 -- # set +x 00:14:39.643 11:25:34 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:39.643 11:25:34 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- target/referrals.sh@46 -- # rpc_cmd nvmf_discovery_add_referral -t tcp -a 127.0.0.4 -s 4430 00:14:39.643 11:25:34 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:39.643 11:25:34 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- common/autotest_common.sh@10 -- # set +x 00:14:39.643 11:25:34 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:39.643 11:25:34 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- target/referrals.sh@48 -- # jq length 00:14:39.643 11:25:34 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- target/referrals.sh@48 -- # rpc_cmd nvmf_discovery_get_referrals 00:14:39.643 11:25:34 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:39.643 11:25:34 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- common/autotest_common.sh@10 -- # set +x 00:14:39.643 11:25:34 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:39.643 11:25:34 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- target/referrals.sh@48 -- # (( 3 == 3 )) 00:14:39.643 11:25:34 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- target/referrals.sh@49 -- # get_referral_ips rpc 00:14:39.643 11:25:34 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- target/referrals.sh@19 -- # [[ rpc == \r\p\c ]] 00:14:39.643 11:25:34 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- target/referrals.sh@21 -- # rpc_cmd nvmf_discovery_get_referrals 00:14:39.643 11:25:34 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:39.643 11:25:34 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- common/autotest_common.sh@10 -- # set +x 00:14:39.643 11:25:34 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- target/referrals.sh@21 -- # sort 00:14:39.643 11:25:34 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- target/referrals.sh@21 -- # jq -r '.[].address.traddr' 00:14:39.643 11:25:34 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:39.643 11:25:35 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- target/referrals.sh@21 -- # echo 127.0.0.2 127.0.0.3 127.0.0.4 00:14:39.643 11:25:35 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- target/referrals.sh@49 -- # [[ 127.0.0.2 127.0.0.3 127.0.0.4 == \1\2\7\.\0\.\0\.\2\ \1\2\7\.\0\.\0\.\3\ \1\2\7\.\0\.\0\.\4 ]] 00:14:39.643 11:25:35 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- target/referrals.sh@50 -- # get_referral_ips nvme 00:14:39.643 11:25:35 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- target/referrals.sh@19 -- # [[ nvme == \r\p\c ]] 00:14:39.643 11:25:35 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- target/referrals.sh@22 -- # [[ nvme == \n\v\m\e ]] 00:14:39.643 11:25:35 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- target/referrals.sh@26 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:c758a4ed-f09f-4c82-9afb-3d096f035464 --hostid=c758a4ed-f09f-4c82-9afb-3d096f035464 -t tcp -a 10.0.0.3 -s 8009 -o json 00:14:39.643 11:25:35 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- target/referrals.sh@26 -- # jq -r '.records[] | select(.subtype != "current discovery subsystem").traddr' 00:14:39.643 11:25:35 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- target/referrals.sh@26 -- # sort 00:14:39.643 11:25:35 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- target/referrals.sh@26 -- # echo 127.0.0.2 127.0.0.3 127.0.0.4 00:14:39.643 11:25:35 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- target/referrals.sh@50 -- # [[ 127.0.0.2 127.0.0.3 127.0.0.4 == \1\2\7\.\0\.\0\.\2\ \1\2\7\.\0\.\0\.\3\ \1\2\7\.\0\.\0\.\4 ]] 00:14:39.643 11:25:35 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- target/referrals.sh@52 -- # rpc_cmd nvmf_discovery_remove_referral -t tcp -a 127.0.0.2 -s 4430 00:14:39.643 11:25:35 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:39.643 11:25:35 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- common/autotest_common.sh@10 -- # set +x 00:14:39.643 11:25:35 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:39.643 11:25:35 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- target/referrals.sh@53 -- # rpc_cmd nvmf_discovery_remove_referral -t tcp -a 127.0.0.3 -s 4430 00:14:39.643 11:25:35 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:39.643 11:25:35 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- common/autotest_common.sh@10 -- # set +x 00:14:39.643 11:25:35 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:39.643 11:25:35 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- target/referrals.sh@54 -- # rpc_cmd nvmf_discovery_remove_referral -t tcp -a 127.0.0.4 -s 4430 00:14:39.643 11:25:35 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:39.643 11:25:35 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- common/autotest_common.sh@10 -- # set +x 00:14:39.901 11:25:35 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:39.901 11:25:35 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- target/referrals.sh@56 -- # jq length 00:14:39.901 11:25:35 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- target/referrals.sh@56 -- # rpc_cmd nvmf_discovery_get_referrals 00:14:39.901 11:25:35 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:39.901 11:25:35 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- common/autotest_common.sh@10 -- # set +x 00:14:39.901 11:25:35 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:39.901 11:25:35 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- target/referrals.sh@56 -- # (( 0 == 0 )) 00:14:39.901 11:25:35 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- target/referrals.sh@57 -- # get_referral_ips nvme 00:14:39.902 11:25:35 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- target/referrals.sh@19 -- # [[ nvme == \r\p\c ]] 00:14:39.902 11:25:35 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- target/referrals.sh@22 -- # [[ nvme == \n\v\m\e ]] 00:14:39.902 11:25:35 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- target/referrals.sh@26 -- # jq -r '.records[] | select(.subtype != "current discovery subsystem").traddr' 00:14:39.902 11:25:35 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- target/referrals.sh@26 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:c758a4ed-f09f-4c82-9afb-3d096f035464 --hostid=c758a4ed-f09f-4c82-9afb-3d096f035464 -t tcp -a 10.0.0.3 -s 8009 -o json 00:14:39.902 11:25:35 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- target/referrals.sh@26 -- # sort 00:14:39.902 11:25:35 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- target/referrals.sh@26 -- # echo 00:14:39.902 11:25:35 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- target/referrals.sh@57 -- # [[ '' == '' ]] 00:14:39.902 11:25:35 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- target/referrals.sh@60 -- # rpc_cmd nvmf_discovery_add_referral -t tcp -a 127.0.0.2 -s 4430 -n discovery 00:14:39.902 11:25:35 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:39.902 11:25:35 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- common/autotest_common.sh@10 -- # set +x 00:14:39.902 11:25:35 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:39.902 11:25:35 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- target/referrals.sh@62 -- # rpc_cmd nvmf_discovery_add_referral -t tcp -a 127.0.0.2 -s 4430 -n nqn.2016-06.io.spdk:cnode1 00:14:39.902 11:25:35 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:39.902 11:25:35 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- common/autotest_common.sh@10 -- # set +x 00:14:39.902 11:25:35 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:39.902 11:25:35 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- target/referrals.sh@65 -- # get_referral_ips rpc 00:14:39.902 11:25:35 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- target/referrals.sh@19 -- # [[ rpc == \r\p\c ]] 00:14:39.902 11:25:35 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- target/referrals.sh@21 -- # rpc_cmd nvmf_discovery_get_referrals 00:14:39.902 11:25:35 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:39.902 11:25:35 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- common/autotest_common.sh@10 -- # set +x 00:14:39.902 11:25:35 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- target/referrals.sh@21 -- # jq -r '.[].address.traddr' 00:14:39.902 11:25:35 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- target/referrals.sh@21 -- # sort 00:14:39.902 11:25:35 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:40.160 11:25:35 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- target/referrals.sh@21 -- # echo 127.0.0.2 127.0.0.2 00:14:40.160 11:25:35 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- target/referrals.sh@65 -- # [[ 127.0.0.2 127.0.0.2 == \1\2\7\.\0\.\0\.\2\ \1\2\7\.\0\.\0\.\2 ]] 00:14:40.160 11:25:35 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- target/referrals.sh@66 -- # get_referral_ips nvme 00:14:40.160 11:25:35 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- target/referrals.sh@19 -- # [[ nvme == \r\p\c ]] 00:14:40.160 11:25:35 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- target/referrals.sh@22 -- # [[ nvme == \n\v\m\e ]] 00:14:40.160 11:25:35 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- target/referrals.sh@26 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:c758a4ed-f09f-4c82-9afb-3d096f035464 --hostid=c758a4ed-f09f-4c82-9afb-3d096f035464 -t tcp -a 10.0.0.3 -s 8009 -o json 00:14:40.160 11:25:35 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- target/referrals.sh@26 -- # jq -r '.records[] | select(.subtype != "current discovery subsystem").traddr' 00:14:40.160 11:25:35 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- target/referrals.sh@26 -- # sort 00:14:40.160 11:25:35 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- target/referrals.sh@26 -- # echo 127.0.0.2 127.0.0.2 00:14:40.160 11:25:35 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- target/referrals.sh@66 -- # [[ 127.0.0.2 127.0.0.2 == \1\2\7\.\0\.\0\.\2\ \1\2\7\.\0\.\0\.\2 ]] 00:14:40.160 11:25:35 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- target/referrals.sh@67 -- # get_discovery_entries 'nvme subsystem' 00:14:40.160 11:25:35 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- target/referrals.sh@31 -- # local 'subtype=nvme subsystem' 00:14:40.160 11:25:35 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- target/referrals.sh@67 -- # jq -r .subnqn 00:14:40.160 11:25:35 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- target/referrals.sh@33 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:c758a4ed-f09f-4c82-9afb-3d096f035464 --hostid=c758a4ed-f09f-4c82-9afb-3d096f035464 -t tcp -a 10.0.0.3 -s 8009 -o json 00:14:40.160 11:25:35 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- target/referrals.sh@34 -- # jq '.records[] | select(.subtype == "nvme subsystem")' 00:14:40.418 11:25:35 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- target/referrals.sh@67 -- # [[ nqn.2016-06.io.spdk:cnode1 == \n\q\n\.\2\0\1\6\-\0\6\.\i\o\.\s\p\d\k\:\c\n\o\d\e\1 ]] 00:14:40.418 11:25:35 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- target/referrals.sh@68 -- # get_discovery_entries 'discovery subsystem referral' 00:14:40.418 11:25:35 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- target/referrals.sh@31 -- # local 'subtype=discovery subsystem referral' 00:14:40.418 11:25:35 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- target/referrals.sh@68 -- # jq -r .subnqn 00:14:40.418 11:25:35 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- target/referrals.sh@33 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:c758a4ed-f09f-4c82-9afb-3d096f035464 --hostid=c758a4ed-f09f-4c82-9afb-3d096f035464 -t tcp -a 10.0.0.3 -s 8009 -o json 00:14:40.419 11:25:35 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- target/referrals.sh@34 -- # jq '.records[] | select(.subtype == "discovery subsystem referral")' 00:14:40.419 11:25:35 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- target/referrals.sh@68 -- # [[ nqn.2014-08.org.nvmexpress.discovery == \n\q\n\.\2\0\1\4\-\0\8\.\o\r\g\.\n\v\m\e\x\p\r\e\s\s\.\d\i\s\c\o\v\e\r\y ]] 00:14:40.419 11:25:35 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- target/referrals.sh@71 -- # rpc_cmd nvmf_discovery_remove_referral -t tcp -a 127.0.0.2 -s 4430 -n nqn.2016-06.io.spdk:cnode1 00:14:40.419 11:25:35 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:40.419 11:25:35 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- common/autotest_common.sh@10 -- # set +x 00:14:40.419 11:25:35 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:40.419 11:25:35 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- target/referrals.sh@73 -- # get_referral_ips rpc 00:14:40.419 11:25:35 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- target/referrals.sh@19 -- # [[ rpc == \r\p\c ]] 00:14:40.419 11:25:35 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- target/referrals.sh@21 -- # rpc_cmd nvmf_discovery_get_referrals 00:14:40.419 11:25:35 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:40.419 11:25:35 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- target/referrals.sh@21 -- # jq -r '.[].address.traddr' 00:14:40.419 11:25:35 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- common/autotest_common.sh@10 -- # set +x 00:14:40.419 11:25:35 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- target/referrals.sh@21 -- # sort 00:14:40.419 11:25:35 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:40.419 11:25:35 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- target/referrals.sh@21 -- # echo 127.0.0.2 00:14:40.419 11:25:35 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- target/referrals.sh@73 -- # [[ 127.0.0.2 == \1\2\7\.\0\.\0\.\2 ]] 00:14:40.419 11:25:35 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- target/referrals.sh@74 -- # get_referral_ips nvme 00:14:40.419 11:25:35 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- target/referrals.sh@19 -- # [[ nvme == \r\p\c ]] 00:14:40.419 11:25:35 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- target/referrals.sh@22 -- # [[ nvme == \n\v\m\e ]] 00:14:40.419 11:25:35 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- target/referrals.sh@26 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:c758a4ed-f09f-4c82-9afb-3d096f035464 --hostid=c758a4ed-f09f-4c82-9afb-3d096f035464 -t tcp -a 10.0.0.3 -s 8009 -o json 00:14:40.419 11:25:35 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- target/referrals.sh@26 -- # jq -r '.records[] | select(.subtype != "current discovery subsystem").traddr' 00:14:40.419 11:25:35 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- target/referrals.sh@26 -- # sort 00:14:40.677 11:25:35 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- target/referrals.sh@26 -- # echo 127.0.0.2 00:14:40.677 11:25:35 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- target/referrals.sh@74 -- # [[ 127.0.0.2 == \1\2\7\.\0\.\0\.\2 ]] 00:14:40.677 11:25:36 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- target/referrals.sh@75 -- # get_discovery_entries 'nvme subsystem' 00:14:40.677 11:25:36 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- target/referrals.sh@31 -- # local 'subtype=nvme subsystem' 00:14:40.677 11:25:36 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- target/referrals.sh@75 -- # jq -r .subnqn 00:14:40.677 11:25:36 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- target/referrals.sh@34 -- # jq '.records[] | select(.subtype == "nvme subsystem")' 00:14:40.677 11:25:36 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- target/referrals.sh@33 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:c758a4ed-f09f-4c82-9afb-3d096f035464 --hostid=c758a4ed-f09f-4c82-9afb-3d096f035464 -t tcp -a 10.0.0.3 -s 8009 -o json 00:14:40.677 11:25:36 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- target/referrals.sh@75 -- # [[ '' == '' ]] 00:14:40.677 11:25:36 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- target/referrals.sh@76 -- # get_discovery_entries 'discovery subsystem referral' 00:14:40.677 11:25:36 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- target/referrals.sh@76 -- # jq -r .subnqn 00:14:40.677 11:25:36 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- target/referrals.sh@31 -- # local 'subtype=discovery subsystem referral' 00:14:40.677 11:25:36 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- target/referrals.sh@34 -- # jq '.records[] | select(.subtype == "discovery subsystem referral")' 00:14:40.677 11:25:36 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- target/referrals.sh@33 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:c758a4ed-f09f-4c82-9afb-3d096f035464 --hostid=c758a4ed-f09f-4c82-9afb-3d096f035464 -t tcp -a 10.0.0.3 -s 8009 -o json 00:14:40.936 11:25:36 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- target/referrals.sh@76 -- # [[ nqn.2014-08.org.nvmexpress.discovery == \n\q\n\.\2\0\1\4\-\0\8\.\o\r\g\.\n\v\m\e\x\p\r\e\s\s\.\d\i\s\c\o\v\e\r\y ]] 00:14:40.936 11:25:36 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- target/referrals.sh@79 -- # rpc_cmd nvmf_discovery_remove_referral -t tcp -a 127.0.0.2 -s 4430 -n nqn.2014-08.org.nvmexpress.discovery 00:14:40.936 11:25:36 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:40.936 11:25:36 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- common/autotest_common.sh@10 -- # set +x 00:14:40.936 11:25:36 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:40.936 11:25:36 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- target/referrals.sh@82 -- # rpc_cmd nvmf_discovery_get_referrals 00:14:40.936 11:25:36 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:40.936 11:25:36 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- common/autotest_common.sh@10 -- # set +x 00:14:40.936 11:25:36 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- target/referrals.sh@82 -- # jq length 00:14:40.936 11:25:36 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:40.936 11:25:36 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- target/referrals.sh@82 -- # (( 0 == 0 )) 00:14:40.936 11:25:36 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- target/referrals.sh@83 -- # get_referral_ips nvme 00:14:40.936 11:25:36 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- target/referrals.sh@19 -- # [[ nvme == \r\p\c ]] 00:14:40.936 11:25:36 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- target/referrals.sh@22 -- # [[ nvme == \n\v\m\e ]] 00:14:40.936 11:25:36 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- target/referrals.sh@26 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:c758a4ed-f09f-4c82-9afb-3d096f035464 --hostid=c758a4ed-f09f-4c82-9afb-3d096f035464 -t tcp -a 10.0.0.3 -s 8009 -o json 00:14:40.936 11:25:36 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- target/referrals.sh@26 -- # jq -r '.records[] | select(.subtype != "current discovery subsystem").traddr' 00:14:40.936 11:25:36 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- target/referrals.sh@26 -- # sort 00:14:40.936 11:25:36 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- target/referrals.sh@26 -- # echo 00:14:40.936 11:25:36 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- target/referrals.sh@83 -- # [[ '' == '' ]] 00:14:40.936 11:25:36 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- target/referrals.sh@85 -- # trap - SIGINT SIGTERM EXIT 00:14:40.936 11:25:36 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- target/referrals.sh@86 -- # nvmftestfini 00:14:40.936 11:25:36 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- nvmf/common.sh@514 -- # nvmfcleanup 00:14:40.936 11:25:36 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- nvmf/common.sh@121 -- # sync 00:14:41.225 11:25:36 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- nvmf/common.sh@123 -- # '[' tcp == tcp ']' 00:14:41.225 11:25:36 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- nvmf/common.sh@124 -- # set +e 00:14:41.225 11:25:36 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- nvmf/common.sh@125 -- # for i in {1..20} 00:14:41.226 11:25:36 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- nvmf/common.sh@126 -- # modprobe -v -r nvme-tcp 00:14:41.226 rmmod nvme_tcp 00:14:41.226 rmmod nvme_fabrics 00:14:41.226 rmmod nvme_keyring 00:14:41.226 11:25:36 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- nvmf/common.sh@127 -- # modprobe -v -r nvme-fabrics 00:14:41.226 11:25:36 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- nvmf/common.sh@128 -- # set -e 00:14:41.226 11:25:36 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- nvmf/common.sh@129 -- # return 0 00:14:41.226 11:25:36 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- nvmf/common.sh@515 -- # '[' -n 73234 ']' 00:14:41.226 11:25:36 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- nvmf/common.sh@516 -- # killprocess 73234 00:14:41.226 11:25:36 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- common/autotest_common.sh@950 -- # '[' -z 73234 ']' 00:14:41.226 11:25:36 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- common/autotest_common.sh@954 -- # kill -0 73234 00:14:41.226 11:25:36 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- common/autotest_common.sh@955 -- # uname 00:14:41.226 11:25:36 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- common/autotest_common.sh@955 -- # '[' Linux = Linux ']' 00:14:41.226 11:25:36 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- common/autotest_common.sh@956 -- # ps --no-headers -o comm= 73234 00:14:41.226 killing process with pid 73234 00:14:41.226 11:25:36 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- common/autotest_common.sh@956 -- # process_name=reactor_0 00:14:41.226 11:25:36 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- common/autotest_common.sh@960 -- # '[' reactor_0 = sudo ']' 00:14:41.226 11:25:36 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- common/autotest_common.sh@968 -- # echo 'killing process with pid 73234' 00:14:41.226 11:25:36 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- common/autotest_common.sh@969 -- # kill 73234 00:14:41.226 11:25:36 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- common/autotest_common.sh@974 -- # wait 73234 00:14:41.485 11:25:36 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- nvmf/common.sh@518 -- # '[' '' == iso ']' 00:14:41.485 11:25:36 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- nvmf/common.sh@521 -- # [[ tcp == \t\c\p ]] 00:14:41.485 11:25:36 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- nvmf/common.sh@522 -- # nvmf_tcp_fini 00:14:41.485 11:25:36 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- nvmf/common.sh@297 -- # iptr 00:14:41.485 11:25:36 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- nvmf/common.sh@789 -- # iptables-save 00:14:41.485 11:25:36 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- nvmf/common.sh@789 -- # grep -v SPDK_NVMF 00:14:41.485 11:25:36 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- nvmf/common.sh@789 -- # iptables-restore 00:14:41.485 11:25:36 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- nvmf/common.sh@298 -- # [[ nvmf_tgt_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s\_\s\p\d\k ]] 00:14:41.485 11:25:36 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- nvmf/common.sh@299 -- # nvmf_veth_fini 00:14:41.485 11:25:36 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- nvmf/common.sh@233 -- # ip link set nvmf_init_br nomaster 00:14:41.485 11:25:36 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- nvmf/common.sh@234 -- # ip link set nvmf_init_br2 nomaster 00:14:41.485 11:25:36 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- nvmf/common.sh@235 -- # ip link set nvmf_tgt_br nomaster 00:14:41.485 11:25:36 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- nvmf/common.sh@236 -- # ip link set nvmf_tgt_br2 nomaster 00:14:41.485 11:25:36 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- nvmf/common.sh@237 -- # ip link set nvmf_init_br down 00:14:41.485 11:25:36 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- nvmf/common.sh@238 -- # ip link set nvmf_init_br2 down 00:14:41.485 11:25:36 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- nvmf/common.sh@239 -- # ip link set nvmf_tgt_br down 00:14:41.485 11:25:36 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- nvmf/common.sh@240 -- # ip link set nvmf_tgt_br2 down 00:14:41.485 11:25:36 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- nvmf/common.sh@241 -- # ip link delete nvmf_br type bridge 00:14:41.485 11:25:36 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- nvmf/common.sh@242 -- # ip link delete nvmf_init_if 00:14:41.485 11:25:36 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- nvmf/common.sh@243 -- # ip link delete nvmf_init_if2 00:14:41.485 11:25:36 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- nvmf/common.sh@244 -- # ip netns exec nvmf_tgt_ns_spdk ip link delete nvmf_tgt_if 00:14:41.745 11:25:37 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- nvmf/common.sh@245 -- # ip netns exec nvmf_tgt_ns_spdk ip link delete nvmf_tgt_if2 00:14:41.745 11:25:37 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- nvmf/common.sh@246 -- # remove_spdk_ns 00:14:41.745 11:25:37 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- nvmf/common.sh@654 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:14:41.745 11:25:37 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 15> /dev/null' 00:14:41.745 11:25:37 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:14:41.745 11:25:37 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- nvmf/common.sh@300 -- # return 0 00:14:41.745 00:14:41.745 real 0m4.026s 00:14:41.745 user 0m12.379s 00:14:41.745 sys 0m1.010s 00:14:41.745 ************************************ 00:14:41.745 END TEST nvmf_referrals 00:14:41.745 ************************************ 00:14:41.745 11:25:37 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- common/autotest_common.sh@1126 -- # xtrace_disable 00:14:41.745 11:25:37 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- common/autotest_common.sh@10 -- # set +x 00:14:41.745 11:25:37 nvmf_tcp.nvmf_target_extra -- nvmf/nvmf_target_extra.sh@20 -- # run_test nvmf_connect_disconnect /home/vagrant/spdk_repo/spdk/test/nvmf/target/connect_disconnect.sh --transport=tcp 00:14:41.745 11:25:37 nvmf_tcp.nvmf_target_extra -- common/autotest_common.sh@1101 -- # '[' 3 -le 1 ']' 00:14:41.745 11:25:37 nvmf_tcp.nvmf_target_extra -- common/autotest_common.sh@1107 -- # xtrace_disable 00:14:41.745 11:25:37 nvmf_tcp.nvmf_target_extra -- common/autotest_common.sh@10 -- # set +x 00:14:41.745 ************************************ 00:14:41.745 START TEST nvmf_connect_disconnect 00:14:41.745 ************************************ 00:14:41.745 11:25:37 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- common/autotest_common.sh@1125 -- # /home/vagrant/spdk_repo/spdk/test/nvmf/target/connect_disconnect.sh --transport=tcp 00:14:41.745 * Looking for test storage... 00:14:41.745 * Found test storage at /home/vagrant/spdk_repo/spdk/test/nvmf/target 00:14:41.745 11:25:37 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- common/autotest_common.sh@1680 -- # [[ y == y ]] 00:14:41.745 11:25:37 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- common/autotest_common.sh@1681 -- # lcov --version 00:14:41.745 11:25:37 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- common/autotest_common.sh@1681 -- # awk '{print $NF}' 00:14:42.005 11:25:37 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- common/autotest_common.sh@1681 -- # lt 1.15 2 00:14:42.005 11:25:37 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- scripts/common.sh@373 -- # cmp_versions 1.15 '<' 2 00:14:42.005 11:25:37 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- scripts/common.sh@333 -- # local ver1 ver1_l 00:14:42.005 11:25:37 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- scripts/common.sh@334 -- # local ver2 ver2_l 00:14:42.005 11:25:37 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- scripts/common.sh@336 -- # IFS=.-: 00:14:42.005 11:25:37 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- scripts/common.sh@336 -- # read -ra ver1 00:14:42.005 11:25:37 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- scripts/common.sh@337 -- # IFS=.-: 00:14:42.005 11:25:37 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- scripts/common.sh@337 -- # read -ra ver2 00:14:42.005 11:25:37 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- scripts/common.sh@338 -- # local 'op=<' 00:14:42.005 11:25:37 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- scripts/common.sh@340 -- # ver1_l=2 00:14:42.005 11:25:37 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- scripts/common.sh@341 -- # ver2_l=1 00:14:42.005 11:25:37 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- scripts/common.sh@343 -- # local lt=0 gt=0 eq=0 v 00:14:42.005 11:25:37 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- scripts/common.sh@344 -- # case "$op" in 00:14:42.005 11:25:37 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- scripts/common.sh@345 -- # : 1 00:14:42.005 11:25:37 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- scripts/common.sh@364 -- # (( v = 0 )) 00:14:42.005 11:25:37 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- scripts/common.sh@364 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:14:42.005 11:25:37 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- scripts/common.sh@365 -- # decimal 1 00:14:42.005 11:25:37 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- scripts/common.sh@353 -- # local d=1 00:14:42.005 11:25:37 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- scripts/common.sh@354 -- # [[ 1 =~ ^[0-9]+$ ]] 00:14:42.005 11:25:37 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- scripts/common.sh@355 -- # echo 1 00:14:42.005 11:25:37 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- scripts/common.sh@365 -- # ver1[v]=1 00:14:42.005 11:25:37 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- scripts/common.sh@366 -- # decimal 2 00:14:42.005 11:25:37 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- scripts/common.sh@353 -- # local d=2 00:14:42.005 11:25:37 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- scripts/common.sh@354 -- # [[ 2 =~ ^[0-9]+$ ]] 00:14:42.005 11:25:37 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- scripts/common.sh@355 -- # echo 2 00:14:42.005 11:25:37 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- scripts/common.sh@366 -- # ver2[v]=2 00:14:42.005 11:25:37 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- scripts/common.sh@367 -- # (( ver1[v] > ver2[v] )) 00:14:42.005 11:25:37 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- scripts/common.sh@368 -- # (( ver1[v] < ver2[v] )) 00:14:42.005 11:25:37 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- scripts/common.sh@368 -- # return 0 00:14:42.005 11:25:37 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- common/autotest_common.sh@1682 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:14:42.005 11:25:37 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- common/autotest_common.sh@1694 -- # export 'LCOV_OPTS= 00:14:42.005 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:14:42.005 --rc genhtml_branch_coverage=1 00:14:42.005 --rc genhtml_function_coverage=1 00:14:42.005 --rc genhtml_legend=1 00:14:42.005 --rc geninfo_all_blocks=1 00:14:42.005 --rc geninfo_unexecuted_blocks=1 00:14:42.005 00:14:42.005 ' 00:14:42.005 11:25:37 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- common/autotest_common.sh@1694 -- # LCOV_OPTS=' 00:14:42.005 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:14:42.005 --rc genhtml_branch_coverage=1 00:14:42.005 --rc genhtml_function_coverage=1 00:14:42.005 --rc genhtml_legend=1 00:14:42.005 --rc geninfo_all_blocks=1 00:14:42.005 --rc geninfo_unexecuted_blocks=1 00:14:42.005 00:14:42.005 ' 00:14:42.005 11:25:37 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- common/autotest_common.sh@1695 -- # export 'LCOV=lcov 00:14:42.005 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:14:42.005 --rc genhtml_branch_coverage=1 00:14:42.005 --rc genhtml_function_coverage=1 00:14:42.005 --rc genhtml_legend=1 00:14:42.005 --rc geninfo_all_blocks=1 00:14:42.005 --rc geninfo_unexecuted_blocks=1 00:14:42.005 00:14:42.005 ' 00:14:42.005 11:25:37 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- common/autotest_common.sh@1695 -- # LCOV='lcov 00:14:42.005 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:14:42.005 --rc genhtml_branch_coverage=1 00:14:42.005 --rc genhtml_function_coverage=1 00:14:42.005 --rc genhtml_legend=1 00:14:42.005 --rc geninfo_all_blocks=1 00:14:42.005 --rc geninfo_unexecuted_blocks=1 00:14:42.005 00:14:42.005 ' 00:14:42.005 11:25:37 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- target/connect_disconnect.sh@9 -- # source /home/vagrant/spdk_repo/spdk/test/nvmf/common.sh 00:14:42.005 11:25:37 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- nvmf/common.sh@7 -- # uname -s 00:14:42.005 11:25:37 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:14:42.005 11:25:37 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:14:42.005 11:25:37 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:14:42.005 11:25:37 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:14:42.005 11:25:37 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:14:42.005 11:25:37 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:14:42.005 11:25:37 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:14:42.005 11:25:37 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:14:42.005 11:25:37 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:14:42.005 11:25:37 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:14:42.005 11:25:37 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:c758a4ed-f09f-4c82-9afb-3d096f035464 00:14:42.005 11:25:37 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- nvmf/common.sh@18 -- # NVME_HOSTID=c758a4ed-f09f-4c82-9afb-3d096f035464 00:14:42.006 11:25:37 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:14:42.006 11:25:37 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:14:42.006 11:25:37 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- nvmf/common.sh@21 -- # NET_TYPE=virt 00:14:42.006 11:25:37 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:14:42.006 11:25:37 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- nvmf/common.sh@49 -- # source /home/vagrant/spdk_repo/spdk/scripts/common.sh 00:14:42.006 11:25:37 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- scripts/common.sh@15 -- # shopt -s extglob 00:14:42.006 11:25:37 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- scripts/common.sh@544 -- # [[ -e /bin/wpdk_common.sh ]] 00:14:42.006 11:25:37 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- scripts/common.sh@552 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:14:42.006 11:25:37 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- scripts/common.sh@553 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:14:42.006 11:25:37 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:42.006 11:25:37 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:42.006 11:25:37 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:42.006 11:25:37 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- paths/export.sh@5 -- # export PATH 00:14:42.006 11:25:37 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:42.006 11:25:37 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- nvmf/common.sh@51 -- # : 0 00:14:42.006 11:25:37 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- nvmf/common.sh@52 -- # export NVMF_APP_SHM_ID 00:14:42.006 11:25:37 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- nvmf/common.sh@53 -- # build_nvmf_app_args 00:14:42.006 11:25:37 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:14:42.006 11:25:37 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:14:42.006 11:25:37 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:14:42.006 11:25:37 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- nvmf/common.sh@33 -- # '[' '' -eq 1 ']' 00:14:42.006 /home/vagrant/spdk_repo/spdk/test/nvmf/common.sh: line 33: [: : integer expression expected 00:14:42.006 11:25:37 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- nvmf/common.sh@37 -- # '[' -n '' ']' 00:14:42.006 11:25:37 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- nvmf/common.sh@39 -- # '[' 0 -eq 1 ']' 00:14:42.006 11:25:37 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- nvmf/common.sh@55 -- # have_pci_nics=0 00:14:42.006 11:25:37 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- target/connect_disconnect.sh@11 -- # MALLOC_BDEV_SIZE=64 00:14:42.006 11:25:37 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- target/connect_disconnect.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:14:42.006 11:25:37 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- target/connect_disconnect.sh@15 -- # nvmftestinit 00:14:42.006 11:25:37 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- nvmf/common.sh@467 -- # '[' -z tcp ']' 00:14:42.006 11:25:37 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- nvmf/common.sh@472 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:14:42.006 11:25:37 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- nvmf/common.sh@474 -- # prepare_net_devs 00:14:42.006 11:25:37 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- nvmf/common.sh@436 -- # local -g is_hw=no 00:14:42.006 11:25:37 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- nvmf/common.sh@438 -- # remove_spdk_ns 00:14:42.006 11:25:37 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- nvmf/common.sh@654 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:14:42.006 11:25:37 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 15> /dev/null' 00:14:42.006 11:25:37 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:14:42.006 11:25:37 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- nvmf/common.sh@440 -- # [[ virt != virt ]] 00:14:42.006 11:25:37 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- nvmf/common.sh@442 -- # [[ no == yes ]] 00:14:42.006 11:25:37 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- nvmf/common.sh@449 -- # [[ virt == phy ]] 00:14:42.006 11:25:37 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- nvmf/common.sh@452 -- # [[ virt == phy-fallback ]] 00:14:42.006 11:25:37 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- nvmf/common.sh@457 -- # [[ tcp == tcp ]] 00:14:42.006 11:25:37 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- nvmf/common.sh@458 -- # nvmf_veth_init 00:14:42.006 11:25:37 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- nvmf/common.sh@145 -- # NVMF_FIRST_INITIATOR_IP=10.0.0.1 00:14:42.006 11:25:37 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- nvmf/common.sh@146 -- # NVMF_SECOND_INITIATOR_IP=10.0.0.2 00:14:42.006 11:25:37 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- nvmf/common.sh@147 -- # NVMF_FIRST_TARGET_IP=10.0.0.3 00:14:42.006 11:25:37 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- nvmf/common.sh@148 -- # NVMF_SECOND_TARGET_IP=10.0.0.4 00:14:42.006 11:25:37 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- nvmf/common.sh@149 -- # NVMF_INITIATOR_IP=10.0.0.1 00:14:42.006 11:25:37 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- nvmf/common.sh@150 -- # NVMF_BRIDGE=nvmf_br 00:14:42.006 11:25:37 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- nvmf/common.sh@151 -- # NVMF_INITIATOR_INTERFACE=nvmf_init_if 00:14:42.006 11:25:37 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- nvmf/common.sh@152 -- # NVMF_INITIATOR_INTERFACE2=nvmf_init_if2 00:14:42.006 11:25:37 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- nvmf/common.sh@153 -- # NVMF_INITIATOR_BRIDGE=nvmf_init_br 00:14:42.006 11:25:37 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- nvmf/common.sh@154 -- # NVMF_INITIATOR_BRIDGE2=nvmf_init_br2 00:14:42.006 11:25:37 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- nvmf/common.sh@155 -- # NVMF_TARGET_NAMESPACE=nvmf_tgt_ns_spdk 00:14:42.006 11:25:37 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- nvmf/common.sh@156 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:14:42.006 11:25:37 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- nvmf/common.sh@157 -- # NVMF_TARGET_INTERFACE=nvmf_tgt_if 00:14:42.006 11:25:37 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- nvmf/common.sh@158 -- # NVMF_TARGET_INTERFACE2=nvmf_tgt_if2 00:14:42.006 11:25:37 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- nvmf/common.sh@159 -- # NVMF_TARGET_BRIDGE=nvmf_tgt_br 00:14:42.006 11:25:37 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- nvmf/common.sh@160 -- # NVMF_TARGET_BRIDGE2=nvmf_tgt_br2 00:14:42.006 11:25:37 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- nvmf/common.sh@162 -- # ip link set nvmf_init_br nomaster 00:14:42.006 Cannot find device "nvmf_init_br" 00:14:42.006 11:25:37 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- nvmf/common.sh@162 -- # true 00:14:42.006 11:25:37 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- nvmf/common.sh@163 -- # ip link set nvmf_init_br2 nomaster 00:14:42.006 Cannot find device "nvmf_init_br2" 00:14:42.006 11:25:37 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- nvmf/common.sh@163 -- # true 00:14:42.006 11:25:37 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- nvmf/common.sh@164 -- # ip link set nvmf_tgt_br nomaster 00:14:42.006 Cannot find device "nvmf_tgt_br" 00:14:42.006 11:25:37 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- nvmf/common.sh@164 -- # true 00:14:42.006 11:25:37 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- nvmf/common.sh@165 -- # ip link set nvmf_tgt_br2 nomaster 00:14:42.006 Cannot find device "nvmf_tgt_br2" 00:14:42.006 11:25:37 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- nvmf/common.sh@165 -- # true 00:14:42.006 11:25:37 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- nvmf/common.sh@166 -- # ip link set nvmf_init_br down 00:14:42.006 Cannot find device "nvmf_init_br" 00:14:42.006 11:25:37 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- nvmf/common.sh@166 -- # true 00:14:42.006 11:25:37 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- nvmf/common.sh@167 -- # ip link set nvmf_init_br2 down 00:14:42.006 Cannot find device "nvmf_init_br2" 00:14:42.006 11:25:37 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- nvmf/common.sh@167 -- # true 00:14:42.006 11:25:37 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- nvmf/common.sh@168 -- # ip link set nvmf_tgt_br down 00:14:42.006 Cannot find device "nvmf_tgt_br" 00:14:42.006 11:25:37 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- nvmf/common.sh@168 -- # true 00:14:42.006 11:25:37 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- nvmf/common.sh@169 -- # ip link set nvmf_tgt_br2 down 00:14:42.006 Cannot find device "nvmf_tgt_br2" 00:14:42.006 11:25:37 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- nvmf/common.sh@169 -- # true 00:14:42.006 11:25:37 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- nvmf/common.sh@170 -- # ip link delete nvmf_br type bridge 00:14:42.006 Cannot find device "nvmf_br" 00:14:42.006 11:25:37 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- nvmf/common.sh@170 -- # true 00:14:42.006 11:25:37 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- nvmf/common.sh@171 -- # ip link delete nvmf_init_if 00:14:42.006 Cannot find device "nvmf_init_if" 00:14:42.006 11:25:37 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- nvmf/common.sh@171 -- # true 00:14:42.007 11:25:37 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- nvmf/common.sh@172 -- # ip link delete nvmf_init_if2 00:14:42.007 Cannot find device "nvmf_init_if2" 00:14:42.007 11:25:37 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- nvmf/common.sh@172 -- # true 00:14:42.007 11:25:37 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- nvmf/common.sh@173 -- # ip netns exec nvmf_tgt_ns_spdk ip link delete nvmf_tgt_if 00:14:42.007 Cannot open network namespace "nvmf_tgt_ns_spdk": No such file or directory 00:14:42.007 11:25:37 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- nvmf/common.sh@173 -- # true 00:14:42.007 11:25:37 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- nvmf/common.sh@174 -- # ip netns exec nvmf_tgt_ns_spdk ip link delete nvmf_tgt_if2 00:14:42.007 Cannot open network namespace "nvmf_tgt_ns_spdk": No such file or directory 00:14:42.007 11:25:37 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- nvmf/common.sh@174 -- # true 00:14:42.007 11:25:37 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- nvmf/common.sh@177 -- # ip netns add nvmf_tgt_ns_spdk 00:14:42.007 11:25:37 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- nvmf/common.sh@180 -- # ip link add nvmf_init_if type veth peer name nvmf_init_br 00:14:42.007 11:25:37 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- nvmf/common.sh@181 -- # ip link add nvmf_init_if2 type veth peer name nvmf_init_br2 00:14:42.007 11:25:37 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- nvmf/common.sh@182 -- # ip link add nvmf_tgt_if type veth peer name nvmf_tgt_br 00:14:42.007 11:25:37 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- nvmf/common.sh@183 -- # ip link add nvmf_tgt_if2 type veth peer name nvmf_tgt_br2 00:14:42.007 11:25:37 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- nvmf/common.sh@186 -- # ip link set nvmf_tgt_if netns nvmf_tgt_ns_spdk 00:14:42.266 11:25:37 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- nvmf/common.sh@187 -- # ip link set nvmf_tgt_if2 netns nvmf_tgt_ns_spdk 00:14:42.266 11:25:37 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- nvmf/common.sh@190 -- # ip addr add 10.0.0.1/24 dev nvmf_init_if 00:14:42.266 11:25:37 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- nvmf/common.sh@191 -- # ip addr add 10.0.0.2/24 dev nvmf_init_if2 00:14:42.266 11:25:37 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- nvmf/common.sh@192 -- # ip netns exec nvmf_tgt_ns_spdk ip addr add 10.0.0.3/24 dev nvmf_tgt_if 00:14:42.266 11:25:37 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- nvmf/common.sh@193 -- # ip netns exec nvmf_tgt_ns_spdk ip addr add 10.0.0.4/24 dev nvmf_tgt_if2 00:14:42.266 11:25:37 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- nvmf/common.sh@196 -- # ip link set nvmf_init_if up 00:14:42.266 11:25:37 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- nvmf/common.sh@197 -- # ip link set nvmf_init_if2 up 00:14:42.266 11:25:37 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- nvmf/common.sh@198 -- # ip link set nvmf_init_br up 00:14:42.266 11:25:37 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- nvmf/common.sh@199 -- # ip link set nvmf_init_br2 up 00:14:42.266 11:25:37 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- nvmf/common.sh@200 -- # ip link set nvmf_tgt_br up 00:14:42.266 11:25:37 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- nvmf/common.sh@201 -- # ip link set nvmf_tgt_br2 up 00:14:42.266 11:25:37 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- nvmf/common.sh@202 -- # ip netns exec nvmf_tgt_ns_spdk ip link set nvmf_tgt_if up 00:14:42.266 11:25:37 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- nvmf/common.sh@203 -- # ip netns exec nvmf_tgt_ns_spdk ip link set nvmf_tgt_if2 up 00:14:42.266 11:25:37 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- nvmf/common.sh@204 -- # ip netns exec nvmf_tgt_ns_spdk ip link set lo up 00:14:42.266 11:25:37 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- nvmf/common.sh@207 -- # ip link add nvmf_br type bridge 00:14:42.266 11:25:37 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- nvmf/common.sh@208 -- # ip link set nvmf_br up 00:14:42.266 11:25:37 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- nvmf/common.sh@211 -- # ip link set nvmf_init_br master nvmf_br 00:14:42.266 11:25:37 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- nvmf/common.sh@212 -- # ip link set nvmf_init_br2 master nvmf_br 00:14:42.266 11:25:37 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- nvmf/common.sh@213 -- # ip link set nvmf_tgt_br master nvmf_br 00:14:42.266 11:25:37 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- nvmf/common.sh@214 -- # ip link set nvmf_tgt_br2 master nvmf_br 00:14:42.266 11:25:37 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- nvmf/common.sh@217 -- # ipts -I INPUT 1 -i nvmf_init_if -p tcp --dport 4420 -j ACCEPT 00:14:42.266 11:25:37 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- nvmf/common.sh@788 -- # iptables -I INPUT 1 -i nvmf_init_if -p tcp --dport 4420 -j ACCEPT -m comment --comment 'SPDK_NVMF:-I INPUT 1 -i nvmf_init_if -p tcp --dport 4420 -j ACCEPT' 00:14:42.266 11:25:37 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- nvmf/common.sh@218 -- # ipts -I INPUT 1 -i nvmf_init_if2 -p tcp --dport 4420 -j ACCEPT 00:14:42.266 11:25:37 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- nvmf/common.sh@788 -- # iptables -I INPUT 1 -i nvmf_init_if2 -p tcp --dport 4420 -j ACCEPT -m comment --comment 'SPDK_NVMF:-I INPUT 1 -i nvmf_init_if2 -p tcp --dport 4420 -j ACCEPT' 00:14:42.266 11:25:37 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- nvmf/common.sh@219 -- # ipts -A FORWARD -i nvmf_br -o nvmf_br -j ACCEPT 00:14:42.266 11:25:37 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- nvmf/common.sh@788 -- # iptables -A FORWARD -i nvmf_br -o nvmf_br -j ACCEPT -m comment --comment 'SPDK_NVMF:-A FORWARD -i nvmf_br -o nvmf_br -j ACCEPT' 00:14:42.266 11:25:37 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- nvmf/common.sh@222 -- # ping -c 1 10.0.0.3 00:14:42.266 PING 10.0.0.3 (10.0.0.3) 56(84) bytes of data. 00:14:42.266 64 bytes from 10.0.0.3: icmp_seq=1 ttl=64 time=0.077 ms 00:14:42.266 00:14:42.266 --- 10.0.0.3 ping statistics --- 00:14:42.266 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:14:42.266 rtt min/avg/max/mdev = 0.077/0.077/0.077/0.000 ms 00:14:42.266 11:25:37 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- nvmf/common.sh@223 -- # ping -c 1 10.0.0.4 00:14:42.266 PING 10.0.0.4 (10.0.0.4) 56(84) bytes of data. 00:14:42.266 64 bytes from 10.0.0.4: icmp_seq=1 ttl=64 time=0.044 ms 00:14:42.266 00:14:42.266 --- 10.0.0.4 ping statistics --- 00:14:42.266 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:14:42.266 rtt min/avg/max/mdev = 0.044/0.044/0.044/0.000 ms 00:14:42.266 11:25:37 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- nvmf/common.sh@224 -- # ip netns exec nvmf_tgt_ns_spdk ping -c 1 10.0.0.1 00:14:42.266 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:14:42.266 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.034 ms 00:14:42.266 00:14:42.266 --- 10.0.0.1 ping statistics --- 00:14:42.266 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:14:42.266 rtt min/avg/max/mdev = 0.034/0.034/0.034/0.000 ms 00:14:42.266 11:25:37 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- nvmf/common.sh@225 -- # ip netns exec nvmf_tgt_ns_spdk ping -c 1 10.0.0.2 00:14:42.266 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:14:42.266 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.048 ms 00:14:42.266 00:14:42.266 --- 10.0.0.2 ping statistics --- 00:14:42.266 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:14:42.266 rtt min/avg/max/mdev = 0.048/0.048/0.048/0.000 ms 00:14:42.266 11:25:37 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- nvmf/common.sh@227 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:14:42.267 11:25:37 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- nvmf/common.sh@459 -- # return 0 00:14:42.267 11:25:37 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- nvmf/common.sh@476 -- # '[' '' == iso ']' 00:14:42.267 11:25:37 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- nvmf/common.sh@480 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:14:42.267 11:25:37 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- nvmf/common.sh@481 -- # [[ tcp == \r\d\m\a ]] 00:14:42.267 11:25:37 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- nvmf/common.sh@490 -- # [[ tcp == \t\c\p ]] 00:14:42.267 11:25:37 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- nvmf/common.sh@491 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:14:42.267 11:25:37 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- nvmf/common.sh@494 -- # '[' tcp == tcp ']' 00:14:42.267 11:25:37 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- nvmf/common.sh@500 -- # modprobe nvme-tcp 00:14:42.267 11:25:37 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- target/connect_disconnect.sh@16 -- # nvmfappstart -m 0xF 00:14:42.267 11:25:37 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- nvmf/common.sh@505 -- # timing_enter start_nvmf_tgt 00:14:42.267 11:25:37 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- common/autotest_common.sh@724 -- # xtrace_disable 00:14:42.267 11:25:37 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- common/autotest_common.sh@10 -- # set +x 00:14:42.267 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:14:42.267 11:25:37 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- nvmf/common.sh@507 -- # nvmfpid=73595 00:14:42.267 11:25:37 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- nvmf/common.sh@508 -- # waitforlisten 73595 00:14:42.267 11:25:37 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- common/autotest_common.sh@831 -- # '[' -z 73595 ']' 00:14:42.267 11:25:37 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- common/autotest_common.sh@835 -- # local rpc_addr=/var/tmp/spdk.sock 00:14:42.267 11:25:37 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- common/autotest_common.sh@836 -- # local max_retries=100 00:14:42.267 11:25:37 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- nvmf/common.sh@506 -- # ip netns exec nvmf_tgt_ns_spdk /home/vagrant/spdk_repo/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:14:42.267 11:25:37 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- common/autotest_common.sh@838 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:14:42.267 11:25:37 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- common/autotest_common.sh@840 -- # xtrace_disable 00:14:42.267 11:25:37 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- common/autotest_common.sh@10 -- # set +x 00:14:42.525 [2024-10-07 11:25:37.817284] Starting SPDK v25.01-pre git sha1 2a4f56c54 / DPDK 24.03.0 initialization... 00:14:42.525 [2024-10-07 11:25:37.817385] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --iova-mode=pa --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:14:42.525 [2024-10-07 11:25:37.953325] app.c: 917:spdk_app_start: *NOTICE*: Total cores available: 4 00:14:42.783 [2024-10-07 11:25:38.068788] app.c: 610:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:14:42.783 [2024-10-07 11:25:38.068850] app.c: 611:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:14:42.783 [2024-10-07 11:25:38.068878] app.c: 616:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:14:42.783 [2024-10-07 11:25:38.068886] app.c: 617:app_setup_trace: *NOTICE*: SPDK application currently running. 00:14:42.783 [2024-10-07 11:25:38.068894] app.c: 618:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:14:42.783 [2024-10-07 11:25:38.070082] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 1 00:14:42.783 [2024-10-07 11:25:38.070137] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 2 00:14:42.783 [2024-10-07 11:25:38.070387] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 3 00:14:42.783 [2024-10-07 11:25:38.070390] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 0 00:14:43.352 11:25:38 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- common/autotest_common.sh@860 -- # (( i == 0 )) 00:14:43.352 11:25:38 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- common/autotest_common.sh@864 -- # return 0 00:14:43.352 11:25:38 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- nvmf/common.sh@509 -- # timing_exit start_nvmf_tgt 00:14:43.352 11:25:38 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- common/autotest_common.sh@730 -- # xtrace_disable 00:14:43.352 11:25:38 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- common/autotest_common.sh@10 -- # set +x 00:14:43.352 11:25:38 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- nvmf/common.sh@510 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:14:43.352 11:25:38 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- target/connect_disconnect.sh@18 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 -c 0 00:14:43.352 11:25:38 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:43.352 11:25:38 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- common/autotest_common.sh@10 -- # set +x 00:14:43.610 [2024-10-07 11:25:38.884423] tcp.c: 738:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:14:43.610 11:25:38 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:43.610 11:25:38 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- target/connect_disconnect.sh@20 -- # rpc_cmd bdev_malloc_create 64 512 00:14:43.610 11:25:38 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:43.610 11:25:38 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- common/autotest_common.sh@10 -- # set +x 00:14:43.610 11:25:38 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:43.610 11:25:38 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- target/connect_disconnect.sh@20 -- # bdev=Malloc0 00:14:43.610 11:25:38 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- target/connect_disconnect.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDKISFASTANDAWESOME 00:14:43.610 11:25:38 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:43.610 11:25:38 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- common/autotest_common.sh@10 -- # set +x 00:14:43.610 11:25:38 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:43.610 11:25:38 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- target/connect_disconnect.sh@23 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:14:43.610 11:25:38 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:43.610 11:25:38 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- common/autotest_common.sh@10 -- # set +x 00:14:43.610 11:25:38 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:43.610 11:25:38 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- target/connect_disconnect.sh@24 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.3 -s 4420 00:14:43.610 11:25:38 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:43.610 11:25:38 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- common/autotest_common.sh@10 -- # set +x 00:14:43.610 [2024-10-07 11:25:38.944233] tcp.c:1081:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.3 port 4420 *** 00:14:43.610 11:25:38 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:43.610 11:25:38 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- target/connect_disconnect.sh@26 -- # '[' 0 -eq 1 ']' 00:14:43.610 11:25:38 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- target/connect_disconnect.sh@31 -- # num_iterations=5 00:14:43.610 11:25:38 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- target/connect_disconnect.sh@34 -- # set +x 00:14:46.160 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:14:48.059 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:14:50.712 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:14:52.610 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:14:55.137 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:14:55.137 11:25:50 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- target/connect_disconnect.sh@43 -- # trap - SIGINT SIGTERM EXIT 00:14:55.137 11:25:50 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- target/connect_disconnect.sh@45 -- # nvmftestfini 00:14:55.137 11:25:50 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- nvmf/common.sh@514 -- # nvmfcleanup 00:14:55.137 11:25:50 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- nvmf/common.sh@121 -- # sync 00:14:55.137 11:25:50 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- nvmf/common.sh@123 -- # '[' tcp == tcp ']' 00:14:55.137 11:25:50 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- nvmf/common.sh@124 -- # set +e 00:14:55.137 11:25:50 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- nvmf/common.sh@125 -- # for i in {1..20} 00:14:55.137 11:25:50 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- nvmf/common.sh@126 -- # modprobe -v -r nvme-tcp 00:14:55.137 rmmod nvme_tcp 00:14:55.137 rmmod nvme_fabrics 00:14:55.137 rmmod nvme_keyring 00:14:55.137 11:25:50 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- nvmf/common.sh@127 -- # modprobe -v -r nvme-fabrics 00:14:55.137 11:25:50 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- nvmf/common.sh@128 -- # set -e 00:14:55.137 11:25:50 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- nvmf/common.sh@129 -- # return 0 00:14:55.137 11:25:50 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- nvmf/common.sh@515 -- # '[' -n 73595 ']' 00:14:55.137 11:25:50 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- nvmf/common.sh@516 -- # killprocess 73595 00:14:55.138 11:25:50 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- common/autotest_common.sh@950 -- # '[' -z 73595 ']' 00:14:55.138 11:25:50 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- common/autotest_common.sh@954 -- # kill -0 73595 00:14:55.138 11:25:50 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- common/autotest_common.sh@955 -- # uname 00:14:55.138 11:25:50 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- common/autotest_common.sh@955 -- # '[' Linux = Linux ']' 00:14:55.138 11:25:50 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- common/autotest_common.sh@956 -- # ps --no-headers -o comm= 73595 00:14:55.138 killing process with pid 73595 00:14:55.138 11:25:50 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- common/autotest_common.sh@956 -- # process_name=reactor_0 00:14:55.138 11:25:50 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- common/autotest_common.sh@960 -- # '[' reactor_0 = sudo ']' 00:14:55.138 11:25:50 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- common/autotest_common.sh@968 -- # echo 'killing process with pid 73595' 00:14:55.138 11:25:50 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- common/autotest_common.sh@969 -- # kill 73595 00:14:55.138 11:25:50 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- common/autotest_common.sh@974 -- # wait 73595 00:14:55.138 11:25:50 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- nvmf/common.sh@518 -- # '[' '' == iso ']' 00:14:55.138 11:25:50 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- nvmf/common.sh@521 -- # [[ tcp == \t\c\p ]] 00:14:55.138 11:25:50 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- nvmf/common.sh@522 -- # nvmf_tcp_fini 00:14:55.138 11:25:50 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- nvmf/common.sh@297 -- # iptr 00:14:55.138 11:25:50 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- nvmf/common.sh@789 -- # iptables-save 00:14:55.138 11:25:50 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- nvmf/common.sh@789 -- # grep -v SPDK_NVMF 00:14:55.138 11:25:50 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- nvmf/common.sh@789 -- # iptables-restore 00:14:55.138 11:25:50 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- nvmf/common.sh@298 -- # [[ nvmf_tgt_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s\_\s\p\d\k ]] 00:14:55.138 11:25:50 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- nvmf/common.sh@299 -- # nvmf_veth_fini 00:14:55.138 11:25:50 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- nvmf/common.sh@233 -- # ip link set nvmf_init_br nomaster 00:14:55.138 11:25:50 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- nvmf/common.sh@234 -- # ip link set nvmf_init_br2 nomaster 00:14:55.138 11:25:50 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- nvmf/common.sh@235 -- # ip link set nvmf_tgt_br nomaster 00:14:55.138 11:25:50 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- nvmf/common.sh@236 -- # ip link set nvmf_tgt_br2 nomaster 00:14:55.138 11:25:50 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- nvmf/common.sh@237 -- # ip link set nvmf_init_br down 00:14:55.138 11:25:50 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- nvmf/common.sh@238 -- # ip link set nvmf_init_br2 down 00:14:55.138 11:25:50 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- nvmf/common.sh@239 -- # ip link set nvmf_tgt_br down 00:14:55.397 11:25:50 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- nvmf/common.sh@240 -- # ip link set nvmf_tgt_br2 down 00:14:55.397 11:25:50 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- nvmf/common.sh@241 -- # ip link delete nvmf_br type bridge 00:14:55.397 11:25:50 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- nvmf/common.sh@242 -- # ip link delete nvmf_init_if 00:14:55.397 11:25:50 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- nvmf/common.sh@243 -- # ip link delete nvmf_init_if2 00:14:55.397 11:25:50 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- nvmf/common.sh@244 -- # ip netns exec nvmf_tgt_ns_spdk ip link delete nvmf_tgt_if 00:14:55.397 11:25:50 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- nvmf/common.sh@245 -- # ip netns exec nvmf_tgt_ns_spdk ip link delete nvmf_tgt_if2 00:14:55.397 11:25:50 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- nvmf/common.sh@246 -- # remove_spdk_ns 00:14:55.397 11:25:50 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- nvmf/common.sh@654 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:14:55.397 11:25:50 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 15> /dev/null' 00:14:55.397 11:25:50 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:14:55.397 11:25:50 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- nvmf/common.sh@300 -- # return 0 00:14:55.397 ************************************ 00:14:55.397 END TEST nvmf_connect_disconnect 00:14:55.397 ************************************ 00:14:55.397 00:14:55.397 real 0m13.720s 00:14:55.397 user 0m49.049s 00:14:55.397 sys 0m2.060s 00:14:55.397 11:25:50 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- common/autotest_common.sh@1126 -- # xtrace_disable 00:14:55.397 11:25:50 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- common/autotest_common.sh@10 -- # set +x 00:14:55.397 11:25:50 nvmf_tcp.nvmf_target_extra -- nvmf/nvmf_target_extra.sh@21 -- # run_test nvmf_multitarget /home/vagrant/spdk_repo/spdk/test/nvmf/target/multitarget.sh --transport=tcp 00:14:55.397 11:25:50 nvmf_tcp.nvmf_target_extra -- common/autotest_common.sh@1101 -- # '[' 3 -le 1 ']' 00:14:55.397 11:25:50 nvmf_tcp.nvmf_target_extra -- common/autotest_common.sh@1107 -- # xtrace_disable 00:14:55.397 11:25:50 nvmf_tcp.nvmf_target_extra -- common/autotest_common.sh@10 -- # set +x 00:14:55.397 ************************************ 00:14:55.397 START TEST nvmf_multitarget 00:14:55.397 ************************************ 00:14:55.397 11:25:50 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- common/autotest_common.sh@1125 -- # /home/vagrant/spdk_repo/spdk/test/nvmf/target/multitarget.sh --transport=tcp 00:14:55.655 * Looking for test storage... 00:14:55.655 * Found test storage at /home/vagrant/spdk_repo/spdk/test/nvmf/target 00:14:55.655 11:25:50 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- common/autotest_common.sh@1680 -- # [[ y == y ]] 00:14:55.655 11:25:50 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- common/autotest_common.sh@1681 -- # lcov --version 00:14:55.655 11:25:50 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- common/autotest_common.sh@1681 -- # awk '{print $NF}' 00:14:55.655 11:25:51 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- common/autotest_common.sh@1681 -- # lt 1.15 2 00:14:55.655 11:25:51 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- scripts/common.sh@373 -- # cmp_versions 1.15 '<' 2 00:14:55.655 11:25:51 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- scripts/common.sh@333 -- # local ver1 ver1_l 00:14:55.655 11:25:51 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- scripts/common.sh@334 -- # local ver2 ver2_l 00:14:55.655 11:25:51 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- scripts/common.sh@336 -- # IFS=.-: 00:14:55.655 11:25:51 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- scripts/common.sh@336 -- # read -ra ver1 00:14:55.655 11:25:51 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- scripts/common.sh@337 -- # IFS=.-: 00:14:55.655 11:25:51 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- scripts/common.sh@337 -- # read -ra ver2 00:14:55.655 11:25:51 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- scripts/common.sh@338 -- # local 'op=<' 00:14:55.655 11:25:51 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- scripts/common.sh@340 -- # ver1_l=2 00:14:55.655 11:25:51 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- scripts/common.sh@341 -- # ver2_l=1 00:14:55.655 11:25:51 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- scripts/common.sh@343 -- # local lt=0 gt=0 eq=0 v 00:14:55.655 11:25:51 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- scripts/common.sh@344 -- # case "$op" in 00:14:55.655 11:25:51 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- scripts/common.sh@345 -- # : 1 00:14:55.655 11:25:51 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- scripts/common.sh@364 -- # (( v = 0 )) 00:14:55.655 11:25:51 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- scripts/common.sh@364 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:14:55.655 11:25:51 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- scripts/common.sh@365 -- # decimal 1 00:14:55.655 11:25:51 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- scripts/common.sh@353 -- # local d=1 00:14:55.655 11:25:51 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- scripts/common.sh@354 -- # [[ 1 =~ ^[0-9]+$ ]] 00:14:55.655 11:25:51 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- scripts/common.sh@355 -- # echo 1 00:14:55.655 11:25:51 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- scripts/common.sh@365 -- # ver1[v]=1 00:14:55.655 11:25:51 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- scripts/common.sh@366 -- # decimal 2 00:14:55.655 11:25:51 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- scripts/common.sh@353 -- # local d=2 00:14:55.655 11:25:51 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- scripts/common.sh@354 -- # [[ 2 =~ ^[0-9]+$ ]] 00:14:55.655 11:25:51 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- scripts/common.sh@355 -- # echo 2 00:14:55.656 11:25:51 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- scripts/common.sh@366 -- # ver2[v]=2 00:14:55.656 11:25:51 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- scripts/common.sh@367 -- # (( ver1[v] > ver2[v] )) 00:14:55.656 11:25:51 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- scripts/common.sh@368 -- # (( ver1[v] < ver2[v] )) 00:14:55.656 11:25:51 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- scripts/common.sh@368 -- # return 0 00:14:55.656 11:25:51 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- common/autotest_common.sh@1682 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:14:55.656 11:25:51 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- common/autotest_common.sh@1694 -- # export 'LCOV_OPTS= 00:14:55.656 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:14:55.656 --rc genhtml_branch_coverage=1 00:14:55.656 --rc genhtml_function_coverage=1 00:14:55.656 --rc genhtml_legend=1 00:14:55.656 --rc geninfo_all_blocks=1 00:14:55.656 --rc geninfo_unexecuted_blocks=1 00:14:55.656 00:14:55.656 ' 00:14:55.656 11:25:51 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- common/autotest_common.sh@1694 -- # LCOV_OPTS=' 00:14:55.656 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:14:55.656 --rc genhtml_branch_coverage=1 00:14:55.656 --rc genhtml_function_coverage=1 00:14:55.656 --rc genhtml_legend=1 00:14:55.656 --rc geninfo_all_blocks=1 00:14:55.656 --rc geninfo_unexecuted_blocks=1 00:14:55.656 00:14:55.656 ' 00:14:55.656 11:25:51 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- common/autotest_common.sh@1695 -- # export 'LCOV=lcov 00:14:55.656 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:14:55.656 --rc genhtml_branch_coverage=1 00:14:55.656 --rc genhtml_function_coverage=1 00:14:55.656 --rc genhtml_legend=1 00:14:55.656 --rc geninfo_all_blocks=1 00:14:55.656 --rc geninfo_unexecuted_blocks=1 00:14:55.656 00:14:55.656 ' 00:14:55.656 11:25:51 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- common/autotest_common.sh@1695 -- # LCOV='lcov 00:14:55.656 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:14:55.656 --rc genhtml_branch_coverage=1 00:14:55.656 --rc genhtml_function_coverage=1 00:14:55.656 --rc genhtml_legend=1 00:14:55.656 --rc geninfo_all_blocks=1 00:14:55.656 --rc geninfo_unexecuted_blocks=1 00:14:55.656 00:14:55.656 ' 00:14:55.656 11:25:51 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- target/multitarget.sh@9 -- # source /home/vagrant/spdk_repo/spdk/test/nvmf/common.sh 00:14:55.656 11:25:51 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- nvmf/common.sh@7 -- # uname -s 00:14:55.656 11:25:51 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:14:55.656 11:25:51 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:14:55.656 11:25:51 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:14:55.656 11:25:51 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:14:55.656 11:25:51 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:14:55.656 11:25:51 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:14:55.656 11:25:51 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:14:55.656 11:25:51 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:14:55.656 11:25:51 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:14:55.656 11:25:51 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:14:55.656 11:25:51 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:c758a4ed-f09f-4c82-9afb-3d096f035464 00:14:55.656 11:25:51 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- nvmf/common.sh@18 -- # NVME_HOSTID=c758a4ed-f09f-4c82-9afb-3d096f035464 00:14:55.656 11:25:51 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:14:55.656 11:25:51 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:14:55.656 11:25:51 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- nvmf/common.sh@21 -- # NET_TYPE=virt 00:14:55.656 11:25:51 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:14:55.656 11:25:51 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- nvmf/common.sh@49 -- # source /home/vagrant/spdk_repo/spdk/scripts/common.sh 00:14:55.656 11:25:51 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- scripts/common.sh@15 -- # shopt -s extglob 00:14:55.656 11:25:51 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- scripts/common.sh@544 -- # [[ -e /bin/wpdk_common.sh ]] 00:14:55.656 11:25:51 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- scripts/common.sh@552 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:14:55.656 11:25:51 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- scripts/common.sh@553 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:14:55.656 11:25:51 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:55.656 11:25:51 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:55.656 11:25:51 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:55.656 11:25:51 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- paths/export.sh@5 -- # export PATH 00:14:55.656 11:25:51 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:55.656 11:25:51 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- nvmf/common.sh@51 -- # : 0 00:14:55.656 11:25:51 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- nvmf/common.sh@52 -- # export NVMF_APP_SHM_ID 00:14:55.656 11:25:51 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- nvmf/common.sh@53 -- # build_nvmf_app_args 00:14:55.656 11:25:51 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:14:55.656 11:25:51 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:14:55.656 11:25:51 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:14:55.656 11:25:51 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- nvmf/common.sh@33 -- # '[' '' -eq 1 ']' 00:14:55.656 /home/vagrant/spdk_repo/spdk/test/nvmf/common.sh: line 33: [: : integer expression expected 00:14:55.656 11:25:51 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- nvmf/common.sh@37 -- # '[' -n '' ']' 00:14:55.656 11:25:51 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- nvmf/common.sh@39 -- # '[' 0 -eq 1 ']' 00:14:55.656 11:25:51 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- nvmf/common.sh@55 -- # have_pci_nics=0 00:14:55.656 11:25:51 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- target/multitarget.sh@13 -- # rpc_py=/home/vagrant/spdk_repo/spdk/test/nvmf/target/multitarget_rpc.py 00:14:55.656 11:25:51 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- target/multitarget.sh@15 -- # nvmftestinit 00:14:55.656 11:25:51 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- nvmf/common.sh@467 -- # '[' -z tcp ']' 00:14:55.656 11:25:51 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- nvmf/common.sh@472 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:14:55.656 11:25:51 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- nvmf/common.sh@474 -- # prepare_net_devs 00:14:55.656 11:25:51 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- nvmf/common.sh@436 -- # local -g is_hw=no 00:14:55.656 11:25:51 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- nvmf/common.sh@438 -- # remove_spdk_ns 00:14:55.656 11:25:51 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- nvmf/common.sh@654 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:14:55.656 11:25:51 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 15> /dev/null' 00:14:55.656 11:25:51 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:14:55.656 11:25:51 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- nvmf/common.sh@440 -- # [[ virt != virt ]] 00:14:55.656 11:25:51 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- nvmf/common.sh@442 -- # [[ no == yes ]] 00:14:55.656 11:25:51 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- nvmf/common.sh@449 -- # [[ virt == phy ]] 00:14:55.656 11:25:51 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- nvmf/common.sh@452 -- # [[ virt == phy-fallback ]] 00:14:55.656 11:25:51 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- nvmf/common.sh@457 -- # [[ tcp == tcp ]] 00:14:55.656 11:25:51 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- nvmf/common.sh@458 -- # nvmf_veth_init 00:14:55.656 11:25:51 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- nvmf/common.sh@145 -- # NVMF_FIRST_INITIATOR_IP=10.0.0.1 00:14:55.656 11:25:51 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- nvmf/common.sh@146 -- # NVMF_SECOND_INITIATOR_IP=10.0.0.2 00:14:55.656 11:25:51 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- nvmf/common.sh@147 -- # NVMF_FIRST_TARGET_IP=10.0.0.3 00:14:55.656 11:25:51 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- nvmf/common.sh@148 -- # NVMF_SECOND_TARGET_IP=10.0.0.4 00:14:55.656 11:25:51 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- nvmf/common.sh@149 -- # NVMF_INITIATOR_IP=10.0.0.1 00:14:55.656 11:25:51 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- nvmf/common.sh@150 -- # NVMF_BRIDGE=nvmf_br 00:14:55.656 11:25:51 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- nvmf/common.sh@151 -- # NVMF_INITIATOR_INTERFACE=nvmf_init_if 00:14:55.656 11:25:51 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- nvmf/common.sh@152 -- # NVMF_INITIATOR_INTERFACE2=nvmf_init_if2 00:14:55.656 11:25:51 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- nvmf/common.sh@153 -- # NVMF_INITIATOR_BRIDGE=nvmf_init_br 00:14:55.656 11:25:51 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- nvmf/common.sh@154 -- # NVMF_INITIATOR_BRIDGE2=nvmf_init_br2 00:14:55.656 11:25:51 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- nvmf/common.sh@155 -- # NVMF_TARGET_NAMESPACE=nvmf_tgt_ns_spdk 00:14:55.656 11:25:51 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- nvmf/common.sh@156 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:14:55.656 11:25:51 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- nvmf/common.sh@157 -- # NVMF_TARGET_INTERFACE=nvmf_tgt_if 00:14:55.656 11:25:51 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- nvmf/common.sh@158 -- # NVMF_TARGET_INTERFACE2=nvmf_tgt_if2 00:14:55.656 11:25:51 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- nvmf/common.sh@159 -- # NVMF_TARGET_BRIDGE=nvmf_tgt_br 00:14:55.656 11:25:51 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- nvmf/common.sh@160 -- # NVMF_TARGET_BRIDGE2=nvmf_tgt_br2 00:14:55.656 11:25:51 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- nvmf/common.sh@162 -- # ip link set nvmf_init_br nomaster 00:14:55.656 Cannot find device "nvmf_init_br" 00:14:55.656 11:25:51 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- nvmf/common.sh@162 -- # true 00:14:55.657 11:25:51 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- nvmf/common.sh@163 -- # ip link set nvmf_init_br2 nomaster 00:14:55.657 Cannot find device "nvmf_init_br2" 00:14:55.657 11:25:51 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- nvmf/common.sh@163 -- # true 00:14:55.657 11:25:51 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- nvmf/common.sh@164 -- # ip link set nvmf_tgt_br nomaster 00:14:55.657 Cannot find device "nvmf_tgt_br" 00:14:55.657 11:25:51 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- nvmf/common.sh@164 -- # true 00:14:55.657 11:25:51 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- nvmf/common.sh@165 -- # ip link set nvmf_tgt_br2 nomaster 00:14:55.657 Cannot find device "nvmf_tgt_br2" 00:14:55.657 11:25:51 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- nvmf/common.sh@165 -- # true 00:14:55.657 11:25:51 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- nvmf/common.sh@166 -- # ip link set nvmf_init_br down 00:14:55.657 Cannot find device "nvmf_init_br" 00:14:55.657 11:25:51 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- nvmf/common.sh@166 -- # true 00:14:55.657 11:25:51 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- nvmf/common.sh@167 -- # ip link set nvmf_init_br2 down 00:14:55.657 Cannot find device "nvmf_init_br2" 00:14:55.657 11:25:51 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- nvmf/common.sh@167 -- # true 00:14:55.657 11:25:51 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- nvmf/common.sh@168 -- # ip link set nvmf_tgt_br down 00:14:55.915 Cannot find device "nvmf_tgt_br" 00:14:55.915 11:25:51 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- nvmf/common.sh@168 -- # true 00:14:55.915 11:25:51 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- nvmf/common.sh@169 -- # ip link set nvmf_tgt_br2 down 00:14:55.915 Cannot find device "nvmf_tgt_br2" 00:14:55.915 11:25:51 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- nvmf/common.sh@169 -- # true 00:14:55.915 11:25:51 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- nvmf/common.sh@170 -- # ip link delete nvmf_br type bridge 00:14:55.915 Cannot find device "nvmf_br" 00:14:55.915 11:25:51 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- nvmf/common.sh@170 -- # true 00:14:55.915 11:25:51 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- nvmf/common.sh@171 -- # ip link delete nvmf_init_if 00:14:55.915 Cannot find device "nvmf_init_if" 00:14:55.915 11:25:51 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- nvmf/common.sh@171 -- # true 00:14:55.915 11:25:51 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- nvmf/common.sh@172 -- # ip link delete nvmf_init_if2 00:14:55.915 Cannot find device "nvmf_init_if2" 00:14:55.915 11:25:51 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- nvmf/common.sh@172 -- # true 00:14:55.915 11:25:51 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- nvmf/common.sh@173 -- # ip netns exec nvmf_tgt_ns_spdk ip link delete nvmf_tgt_if 00:14:55.915 Cannot open network namespace "nvmf_tgt_ns_spdk": No such file or directory 00:14:55.915 11:25:51 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- nvmf/common.sh@173 -- # true 00:14:55.915 11:25:51 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- nvmf/common.sh@174 -- # ip netns exec nvmf_tgt_ns_spdk ip link delete nvmf_tgt_if2 00:14:55.915 Cannot open network namespace "nvmf_tgt_ns_spdk": No such file or directory 00:14:55.915 11:25:51 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- nvmf/common.sh@174 -- # true 00:14:55.915 11:25:51 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- nvmf/common.sh@177 -- # ip netns add nvmf_tgt_ns_spdk 00:14:55.915 11:25:51 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- nvmf/common.sh@180 -- # ip link add nvmf_init_if type veth peer name nvmf_init_br 00:14:55.915 11:25:51 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- nvmf/common.sh@181 -- # ip link add nvmf_init_if2 type veth peer name nvmf_init_br2 00:14:55.915 11:25:51 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- nvmf/common.sh@182 -- # ip link add nvmf_tgt_if type veth peer name nvmf_tgt_br 00:14:55.915 11:25:51 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- nvmf/common.sh@183 -- # ip link add nvmf_tgt_if2 type veth peer name nvmf_tgt_br2 00:14:55.915 11:25:51 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- nvmf/common.sh@186 -- # ip link set nvmf_tgt_if netns nvmf_tgt_ns_spdk 00:14:55.915 11:25:51 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- nvmf/common.sh@187 -- # ip link set nvmf_tgt_if2 netns nvmf_tgt_ns_spdk 00:14:55.915 11:25:51 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- nvmf/common.sh@190 -- # ip addr add 10.0.0.1/24 dev nvmf_init_if 00:14:55.915 11:25:51 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- nvmf/common.sh@191 -- # ip addr add 10.0.0.2/24 dev nvmf_init_if2 00:14:55.915 11:25:51 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- nvmf/common.sh@192 -- # ip netns exec nvmf_tgt_ns_spdk ip addr add 10.0.0.3/24 dev nvmf_tgt_if 00:14:55.915 11:25:51 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- nvmf/common.sh@193 -- # ip netns exec nvmf_tgt_ns_spdk ip addr add 10.0.0.4/24 dev nvmf_tgt_if2 00:14:55.915 11:25:51 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- nvmf/common.sh@196 -- # ip link set nvmf_init_if up 00:14:55.915 11:25:51 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- nvmf/common.sh@197 -- # ip link set nvmf_init_if2 up 00:14:55.915 11:25:51 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- nvmf/common.sh@198 -- # ip link set nvmf_init_br up 00:14:55.915 11:25:51 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- nvmf/common.sh@199 -- # ip link set nvmf_init_br2 up 00:14:55.915 11:25:51 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- nvmf/common.sh@200 -- # ip link set nvmf_tgt_br up 00:14:55.915 11:25:51 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- nvmf/common.sh@201 -- # ip link set nvmf_tgt_br2 up 00:14:55.915 11:25:51 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- nvmf/common.sh@202 -- # ip netns exec nvmf_tgt_ns_spdk ip link set nvmf_tgt_if up 00:14:55.915 11:25:51 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- nvmf/common.sh@203 -- # ip netns exec nvmf_tgt_ns_spdk ip link set nvmf_tgt_if2 up 00:14:55.915 11:25:51 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- nvmf/common.sh@204 -- # ip netns exec nvmf_tgt_ns_spdk ip link set lo up 00:14:55.915 11:25:51 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- nvmf/common.sh@207 -- # ip link add nvmf_br type bridge 00:14:55.915 11:25:51 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- nvmf/common.sh@208 -- # ip link set nvmf_br up 00:14:55.915 11:25:51 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- nvmf/common.sh@211 -- # ip link set nvmf_init_br master nvmf_br 00:14:55.915 11:25:51 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- nvmf/common.sh@212 -- # ip link set nvmf_init_br2 master nvmf_br 00:14:55.915 11:25:51 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- nvmf/common.sh@213 -- # ip link set nvmf_tgt_br master nvmf_br 00:14:55.915 11:25:51 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- nvmf/common.sh@214 -- # ip link set nvmf_tgt_br2 master nvmf_br 00:14:56.174 11:25:51 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- nvmf/common.sh@217 -- # ipts -I INPUT 1 -i nvmf_init_if -p tcp --dport 4420 -j ACCEPT 00:14:56.174 11:25:51 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- nvmf/common.sh@788 -- # iptables -I INPUT 1 -i nvmf_init_if -p tcp --dport 4420 -j ACCEPT -m comment --comment 'SPDK_NVMF:-I INPUT 1 -i nvmf_init_if -p tcp --dport 4420 -j ACCEPT' 00:14:56.174 11:25:51 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- nvmf/common.sh@218 -- # ipts -I INPUT 1 -i nvmf_init_if2 -p tcp --dport 4420 -j ACCEPT 00:14:56.174 11:25:51 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- nvmf/common.sh@788 -- # iptables -I INPUT 1 -i nvmf_init_if2 -p tcp --dport 4420 -j ACCEPT -m comment --comment 'SPDK_NVMF:-I INPUT 1 -i nvmf_init_if2 -p tcp --dport 4420 -j ACCEPT' 00:14:56.174 11:25:51 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- nvmf/common.sh@219 -- # ipts -A FORWARD -i nvmf_br -o nvmf_br -j ACCEPT 00:14:56.174 11:25:51 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- nvmf/common.sh@788 -- # iptables -A FORWARD -i nvmf_br -o nvmf_br -j ACCEPT -m comment --comment 'SPDK_NVMF:-A FORWARD -i nvmf_br -o nvmf_br -j ACCEPT' 00:14:56.174 11:25:51 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- nvmf/common.sh@222 -- # ping -c 1 10.0.0.3 00:14:56.174 PING 10.0.0.3 (10.0.0.3) 56(84) bytes of data. 00:14:56.174 64 bytes from 10.0.0.3: icmp_seq=1 ttl=64 time=0.058 ms 00:14:56.174 00:14:56.174 --- 10.0.0.3 ping statistics --- 00:14:56.174 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:14:56.174 rtt min/avg/max/mdev = 0.058/0.058/0.058/0.000 ms 00:14:56.174 11:25:51 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- nvmf/common.sh@223 -- # ping -c 1 10.0.0.4 00:14:56.174 PING 10.0.0.4 (10.0.0.4) 56(84) bytes of data. 00:14:56.174 64 bytes from 10.0.0.4: icmp_seq=1 ttl=64 time=0.041 ms 00:14:56.174 00:14:56.174 --- 10.0.0.4 ping statistics --- 00:14:56.174 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:14:56.174 rtt min/avg/max/mdev = 0.041/0.041/0.041/0.000 ms 00:14:56.174 11:25:51 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- nvmf/common.sh@224 -- # ip netns exec nvmf_tgt_ns_spdk ping -c 1 10.0.0.1 00:14:56.174 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:14:56.174 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.018 ms 00:14:56.174 00:14:56.174 --- 10.0.0.1 ping statistics --- 00:14:56.174 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:14:56.174 rtt min/avg/max/mdev = 0.018/0.018/0.018/0.000 ms 00:14:56.174 11:25:51 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- nvmf/common.sh@225 -- # ip netns exec nvmf_tgt_ns_spdk ping -c 1 10.0.0.2 00:14:56.174 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:14:56.174 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.052 ms 00:14:56.174 00:14:56.174 --- 10.0.0.2 ping statistics --- 00:14:56.174 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:14:56.174 rtt min/avg/max/mdev = 0.052/0.052/0.052/0.000 ms 00:14:56.174 11:25:51 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- nvmf/common.sh@227 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:14:56.174 11:25:51 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- nvmf/common.sh@459 -- # return 0 00:14:56.174 11:25:51 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- nvmf/common.sh@476 -- # '[' '' == iso ']' 00:14:56.174 11:25:51 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- nvmf/common.sh@480 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:14:56.174 11:25:51 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- nvmf/common.sh@481 -- # [[ tcp == \r\d\m\a ]] 00:14:56.174 11:25:51 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- nvmf/common.sh@490 -- # [[ tcp == \t\c\p ]] 00:14:56.174 11:25:51 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- nvmf/common.sh@491 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:14:56.174 11:25:51 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- nvmf/common.sh@494 -- # '[' tcp == tcp ']' 00:14:56.174 11:25:51 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- nvmf/common.sh@500 -- # modprobe nvme-tcp 00:14:56.174 11:25:51 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- target/multitarget.sh@16 -- # nvmfappstart -m 0xF 00:14:56.174 11:25:51 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- nvmf/common.sh@505 -- # timing_enter start_nvmf_tgt 00:14:56.174 11:25:51 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- common/autotest_common.sh@724 -- # xtrace_disable 00:14:56.174 11:25:51 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- common/autotest_common.sh@10 -- # set +x 00:14:56.174 11:25:51 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- nvmf/common.sh@506 -- # ip netns exec nvmf_tgt_ns_spdk /home/vagrant/spdk_repo/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:14:56.174 11:25:51 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- nvmf/common.sh@507 -- # nvmfpid=74050 00:14:56.174 11:25:51 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- nvmf/common.sh@508 -- # waitforlisten 74050 00:14:56.174 11:25:51 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- common/autotest_common.sh@831 -- # '[' -z 74050 ']' 00:14:56.174 11:25:51 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- common/autotest_common.sh@835 -- # local rpc_addr=/var/tmp/spdk.sock 00:14:56.174 11:25:51 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- common/autotest_common.sh@836 -- # local max_retries=100 00:14:56.174 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:14:56.174 11:25:51 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- common/autotest_common.sh@838 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:14:56.174 11:25:51 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- common/autotest_common.sh@840 -- # xtrace_disable 00:14:56.174 11:25:51 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- common/autotest_common.sh@10 -- # set +x 00:14:56.174 [2024-10-07 11:25:51.550987] Starting SPDK v25.01-pre git sha1 2a4f56c54 / DPDK 24.03.0 initialization... 00:14:56.174 [2024-10-07 11:25:51.551197] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --iova-mode=pa --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:14:56.174 [2024-10-07 11:25:51.687497] app.c: 917:spdk_app_start: *NOTICE*: Total cores available: 4 00:14:56.431 [2024-10-07 11:25:51.804975] app.c: 610:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:14:56.431 [2024-10-07 11:25:51.805234] app.c: 611:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:14:56.431 [2024-10-07 11:25:51.805367] app.c: 616:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:14:56.431 [2024-10-07 11:25:51.805422] app.c: 617:app_setup_trace: *NOTICE*: SPDK application currently running. 00:14:56.431 [2024-10-07 11:25:51.805518] app.c: 618:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:14:56.431 [2024-10-07 11:25:51.806809] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 1 00:14:56.431 [2024-10-07 11:25:51.806890] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 2 00:14:56.431 [2024-10-07 11:25:51.807013] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 3 00:14:56.431 [2024-10-07 11:25:51.807017] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 0 00:14:56.431 11:25:51 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- common/autotest_common.sh@860 -- # (( i == 0 )) 00:14:56.432 11:25:51 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- common/autotest_common.sh@864 -- # return 0 00:14:56.432 11:25:51 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- nvmf/common.sh@509 -- # timing_exit start_nvmf_tgt 00:14:56.432 11:25:51 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- common/autotest_common.sh@730 -- # xtrace_disable 00:14:56.432 11:25:51 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- common/autotest_common.sh@10 -- # set +x 00:14:56.690 11:25:51 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- nvmf/common.sh@510 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:14:56.690 11:25:51 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- target/multitarget.sh@18 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; nvmftestfini $1; exit 1' SIGINT SIGTERM EXIT 00:14:56.690 11:25:51 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- target/multitarget.sh@21 -- # /home/vagrant/spdk_repo/spdk/test/nvmf/target/multitarget_rpc.py nvmf_get_targets 00:14:56.690 11:25:51 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- target/multitarget.sh@21 -- # jq length 00:14:56.690 11:25:52 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- target/multitarget.sh@21 -- # '[' 1 '!=' 1 ']' 00:14:56.690 11:25:52 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- target/multitarget.sh@25 -- # /home/vagrant/spdk_repo/spdk/test/nvmf/target/multitarget_rpc.py nvmf_create_target -n nvmf_tgt_1 -s 32 00:14:56.948 "nvmf_tgt_1" 00:14:56.948 11:25:52 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- target/multitarget.sh@26 -- # /home/vagrant/spdk_repo/spdk/test/nvmf/target/multitarget_rpc.py nvmf_create_target -n nvmf_tgt_2 -s 32 00:14:56.948 "nvmf_tgt_2" 00:14:56.948 11:25:52 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- target/multitarget.sh@28 -- # jq length 00:14:56.948 11:25:52 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- target/multitarget.sh@28 -- # /home/vagrant/spdk_repo/spdk/test/nvmf/target/multitarget_rpc.py nvmf_get_targets 00:14:57.205 11:25:52 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- target/multitarget.sh@28 -- # '[' 3 '!=' 3 ']' 00:14:57.205 11:25:52 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- target/multitarget.sh@32 -- # /home/vagrant/spdk_repo/spdk/test/nvmf/target/multitarget_rpc.py nvmf_delete_target -n nvmf_tgt_1 00:14:57.205 true 00:14:57.205 11:25:52 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- target/multitarget.sh@33 -- # /home/vagrant/spdk_repo/spdk/test/nvmf/target/multitarget_rpc.py nvmf_delete_target -n nvmf_tgt_2 00:14:57.463 true 00:14:57.463 11:25:52 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- target/multitarget.sh@35 -- # /home/vagrant/spdk_repo/spdk/test/nvmf/target/multitarget_rpc.py nvmf_get_targets 00:14:57.463 11:25:52 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- target/multitarget.sh@35 -- # jq length 00:14:57.722 11:25:53 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- target/multitarget.sh@35 -- # '[' 1 '!=' 1 ']' 00:14:57.722 11:25:53 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- target/multitarget.sh@39 -- # trap - SIGINT SIGTERM EXIT 00:14:57.722 11:25:53 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- target/multitarget.sh@41 -- # nvmftestfini 00:14:57.722 11:25:53 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- nvmf/common.sh@514 -- # nvmfcleanup 00:14:57.722 11:25:53 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- nvmf/common.sh@121 -- # sync 00:14:57.722 11:25:53 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- nvmf/common.sh@123 -- # '[' tcp == tcp ']' 00:14:57.722 11:25:53 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- nvmf/common.sh@124 -- # set +e 00:14:57.722 11:25:53 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- nvmf/common.sh@125 -- # for i in {1..20} 00:14:57.722 11:25:53 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- nvmf/common.sh@126 -- # modprobe -v -r nvme-tcp 00:14:57.722 rmmod nvme_tcp 00:14:57.722 rmmod nvme_fabrics 00:14:57.722 rmmod nvme_keyring 00:14:57.722 11:25:53 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- nvmf/common.sh@127 -- # modprobe -v -r nvme-fabrics 00:14:57.722 11:25:53 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- nvmf/common.sh@128 -- # set -e 00:14:57.722 11:25:53 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- nvmf/common.sh@129 -- # return 0 00:14:57.722 11:25:53 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- nvmf/common.sh@515 -- # '[' -n 74050 ']' 00:14:57.722 11:25:53 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- nvmf/common.sh@516 -- # killprocess 74050 00:14:57.722 11:25:53 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- common/autotest_common.sh@950 -- # '[' -z 74050 ']' 00:14:57.722 11:25:53 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- common/autotest_common.sh@954 -- # kill -0 74050 00:14:57.722 11:25:53 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- common/autotest_common.sh@955 -- # uname 00:14:57.722 11:25:53 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- common/autotest_common.sh@955 -- # '[' Linux = Linux ']' 00:14:57.722 11:25:53 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- common/autotest_common.sh@956 -- # ps --no-headers -o comm= 74050 00:14:57.722 killing process with pid 74050 00:14:57.722 11:25:53 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- common/autotest_common.sh@956 -- # process_name=reactor_0 00:14:57.722 11:25:53 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- common/autotest_common.sh@960 -- # '[' reactor_0 = sudo ']' 00:14:57.722 11:25:53 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- common/autotest_common.sh@968 -- # echo 'killing process with pid 74050' 00:14:57.722 11:25:53 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- common/autotest_common.sh@969 -- # kill 74050 00:14:57.722 11:25:53 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- common/autotest_common.sh@974 -- # wait 74050 00:14:57.981 11:25:53 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- nvmf/common.sh@518 -- # '[' '' == iso ']' 00:14:57.981 11:25:53 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- nvmf/common.sh@521 -- # [[ tcp == \t\c\p ]] 00:14:57.981 11:25:53 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- nvmf/common.sh@522 -- # nvmf_tcp_fini 00:14:57.981 11:25:53 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- nvmf/common.sh@297 -- # iptr 00:14:57.981 11:25:53 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- nvmf/common.sh@789 -- # iptables-save 00:14:57.981 11:25:53 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- nvmf/common.sh@789 -- # iptables-restore 00:14:57.981 11:25:53 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- nvmf/common.sh@789 -- # grep -v SPDK_NVMF 00:14:57.981 11:25:53 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- nvmf/common.sh@298 -- # [[ nvmf_tgt_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s\_\s\p\d\k ]] 00:14:57.981 11:25:53 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- nvmf/common.sh@299 -- # nvmf_veth_fini 00:14:57.981 11:25:53 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- nvmf/common.sh@233 -- # ip link set nvmf_init_br nomaster 00:14:57.981 11:25:53 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- nvmf/common.sh@234 -- # ip link set nvmf_init_br2 nomaster 00:14:57.981 11:25:53 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- nvmf/common.sh@235 -- # ip link set nvmf_tgt_br nomaster 00:14:57.981 11:25:53 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- nvmf/common.sh@236 -- # ip link set nvmf_tgt_br2 nomaster 00:14:57.981 11:25:53 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- nvmf/common.sh@237 -- # ip link set nvmf_init_br down 00:14:57.981 11:25:53 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- nvmf/common.sh@238 -- # ip link set nvmf_init_br2 down 00:14:57.981 11:25:53 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- nvmf/common.sh@239 -- # ip link set nvmf_tgt_br down 00:14:57.981 11:25:53 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- nvmf/common.sh@240 -- # ip link set nvmf_tgt_br2 down 00:14:57.981 11:25:53 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- nvmf/common.sh@241 -- # ip link delete nvmf_br type bridge 00:14:58.239 11:25:53 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- nvmf/common.sh@242 -- # ip link delete nvmf_init_if 00:14:58.239 11:25:53 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- nvmf/common.sh@243 -- # ip link delete nvmf_init_if2 00:14:58.239 11:25:53 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- nvmf/common.sh@244 -- # ip netns exec nvmf_tgt_ns_spdk ip link delete nvmf_tgt_if 00:14:58.239 11:25:53 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- nvmf/common.sh@245 -- # ip netns exec nvmf_tgt_ns_spdk ip link delete nvmf_tgt_if2 00:14:58.239 11:25:53 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- nvmf/common.sh@246 -- # remove_spdk_ns 00:14:58.239 11:25:53 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- nvmf/common.sh@654 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:14:58.239 11:25:53 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 15> /dev/null' 00:14:58.239 11:25:53 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:14:58.239 11:25:53 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- nvmf/common.sh@300 -- # return 0 00:14:58.239 ************************************ 00:14:58.239 END TEST nvmf_multitarget 00:14:58.239 ************************************ 00:14:58.239 00:14:58.239 real 0m2.730s 00:14:58.239 user 0m7.422s 00:14:58.239 sys 0m0.792s 00:14:58.239 11:25:53 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- common/autotest_common.sh@1126 -- # xtrace_disable 00:14:58.239 11:25:53 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- common/autotest_common.sh@10 -- # set +x 00:14:58.239 11:25:53 nvmf_tcp.nvmf_target_extra -- nvmf/nvmf_target_extra.sh@22 -- # run_test nvmf_rpc /home/vagrant/spdk_repo/spdk/test/nvmf/target/rpc.sh --transport=tcp 00:14:58.239 11:25:53 nvmf_tcp.nvmf_target_extra -- common/autotest_common.sh@1101 -- # '[' 3 -le 1 ']' 00:14:58.239 11:25:53 nvmf_tcp.nvmf_target_extra -- common/autotest_common.sh@1107 -- # xtrace_disable 00:14:58.239 11:25:53 nvmf_tcp.nvmf_target_extra -- common/autotest_common.sh@10 -- # set +x 00:14:58.239 ************************************ 00:14:58.239 START TEST nvmf_rpc 00:14:58.239 ************************************ 00:14:58.239 11:25:53 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@1125 -- # /home/vagrant/spdk_repo/spdk/test/nvmf/target/rpc.sh --transport=tcp 00:14:58.239 * Looking for test storage... 00:14:58.239 * Found test storage at /home/vagrant/spdk_repo/spdk/test/nvmf/target 00:14:58.239 11:25:53 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@1680 -- # [[ y == y ]] 00:14:58.239 11:25:53 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@1681 -- # lcov --version 00:14:58.239 11:25:53 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@1681 -- # awk '{print $NF}' 00:14:58.498 11:25:53 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@1681 -- # lt 1.15 2 00:14:58.498 11:25:53 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- scripts/common.sh@373 -- # cmp_versions 1.15 '<' 2 00:14:58.498 11:25:53 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- scripts/common.sh@333 -- # local ver1 ver1_l 00:14:58.498 11:25:53 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- scripts/common.sh@334 -- # local ver2 ver2_l 00:14:58.498 11:25:53 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- scripts/common.sh@336 -- # IFS=.-: 00:14:58.498 11:25:53 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- scripts/common.sh@336 -- # read -ra ver1 00:14:58.498 11:25:53 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- scripts/common.sh@337 -- # IFS=.-: 00:14:58.498 11:25:53 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- scripts/common.sh@337 -- # read -ra ver2 00:14:58.498 11:25:53 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- scripts/common.sh@338 -- # local 'op=<' 00:14:58.498 11:25:53 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- scripts/common.sh@340 -- # ver1_l=2 00:14:58.498 11:25:53 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- scripts/common.sh@341 -- # ver2_l=1 00:14:58.498 11:25:53 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- scripts/common.sh@343 -- # local lt=0 gt=0 eq=0 v 00:14:58.498 11:25:53 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- scripts/common.sh@344 -- # case "$op" in 00:14:58.498 11:25:53 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- scripts/common.sh@345 -- # : 1 00:14:58.498 11:25:53 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- scripts/common.sh@364 -- # (( v = 0 )) 00:14:58.498 11:25:53 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- scripts/common.sh@364 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:14:58.498 11:25:53 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- scripts/common.sh@365 -- # decimal 1 00:14:58.498 11:25:53 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- scripts/common.sh@353 -- # local d=1 00:14:58.498 11:25:53 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- scripts/common.sh@354 -- # [[ 1 =~ ^[0-9]+$ ]] 00:14:58.498 11:25:53 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- scripts/common.sh@355 -- # echo 1 00:14:58.498 11:25:53 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- scripts/common.sh@365 -- # ver1[v]=1 00:14:58.498 11:25:53 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- scripts/common.sh@366 -- # decimal 2 00:14:58.498 11:25:53 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- scripts/common.sh@353 -- # local d=2 00:14:58.498 11:25:53 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- scripts/common.sh@354 -- # [[ 2 =~ ^[0-9]+$ ]] 00:14:58.498 11:25:53 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- scripts/common.sh@355 -- # echo 2 00:14:58.498 11:25:53 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- scripts/common.sh@366 -- # ver2[v]=2 00:14:58.498 11:25:53 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- scripts/common.sh@367 -- # (( ver1[v] > ver2[v] )) 00:14:58.498 11:25:53 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- scripts/common.sh@368 -- # (( ver1[v] < ver2[v] )) 00:14:58.498 11:25:53 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- scripts/common.sh@368 -- # return 0 00:14:58.498 11:25:53 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@1682 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:14:58.498 11:25:53 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@1694 -- # export 'LCOV_OPTS= 00:14:58.498 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:14:58.498 --rc genhtml_branch_coverage=1 00:14:58.498 --rc genhtml_function_coverage=1 00:14:58.498 --rc genhtml_legend=1 00:14:58.498 --rc geninfo_all_blocks=1 00:14:58.498 --rc geninfo_unexecuted_blocks=1 00:14:58.498 00:14:58.498 ' 00:14:58.498 11:25:53 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@1694 -- # LCOV_OPTS=' 00:14:58.498 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:14:58.498 --rc genhtml_branch_coverage=1 00:14:58.498 --rc genhtml_function_coverage=1 00:14:58.498 --rc genhtml_legend=1 00:14:58.498 --rc geninfo_all_blocks=1 00:14:58.498 --rc geninfo_unexecuted_blocks=1 00:14:58.498 00:14:58.498 ' 00:14:58.498 11:25:53 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@1695 -- # export 'LCOV=lcov 00:14:58.498 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:14:58.498 --rc genhtml_branch_coverage=1 00:14:58.498 --rc genhtml_function_coverage=1 00:14:58.498 --rc genhtml_legend=1 00:14:58.498 --rc geninfo_all_blocks=1 00:14:58.498 --rc geninfo_unexecuted_blocks=1 00:14:58.498 00:14:58.498 ' 00:14:58.498 11:25:53 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@1695 -- # LCOV='lcov 00:14:58.498 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:14:58.498 --rc genhtml_branch_coverage=1 00:14:58.498 --rc genhtml_function_coverage=1 00:14:58.498 --rc genhtml_legend=1 00:14:58.498 --rc geninfo_all_blocks=1 00:14:58.498 --rc geninfo_unexecuted_blocks=1 00:14:58.498 00:14:58.498 ' 00:14:58.498 11:25:53 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- target/rpc.sh@9 -- # source /home/vagrant/spdk_repo/spdk/test/nvmf/common.sh 00:14:58.498 11:25:53 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- nvmf/common.sh@7 -- # uname -s 00:14:58.498 11:25:53 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:14:58.498 11:25:53 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:14:58.498 11:25:53 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:14:58.498 11:25:53 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:14:58.498 11:25:53 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:14:58.498 11:25:53 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:14:58.498 11:25:53 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:14:58.498 11:25:53 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:14:58.498 11:25:53 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:14:58.498 11:25:53 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:14:58.498 11:25:53 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:c758a4ed-f09f-4c82-9afb-3d096f035464 00:14:58.498 11:25:53 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- nvmf/common.sh@18 -- # NVME_HOSTID=c758a4ed-f09f-4c82-9afb-3d096f035464 00:14:58.498 11:25:53 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:14:58.498 11:25:53 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:14:58.498 11:25:53 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- nvmf/common.sh@21 -- # NET_TYPE=virt 00:14:58.498 11:25:53 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:14:58.498 11:25:53 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- nvmf/common.sh@49 -- # source /home/vagrant/spdk_repo/spdk/scripts/common.sh 00:14:58.498 11:25:53 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- scripts/common.sh@15 -- # shopt -s extglob 00:14:58.498 11:25:53 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- scripts/common.sh@544 -- # [[ -e /bin/wpdk_common.sh ]] 00:14:58.498 11:25:53 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- scripts/common.sh@552 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:14:58.498 11:25:53 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- scripts/common.sh@553 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:14:58.498 11:25:53 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:58.498 11:25:53 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:58.498 11:25:53 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:58.498 11:25:53 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- paths/export.sh@5 -- # export PATH 00:14:58.498 11:25:53 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:58.498 11:25:53 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- nvmf/common.sh@51 -- # : 0 00:14:58.498 11:25:53 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- nvmf/common.sh@52 -- # export NVMF_APP_SHM_ID 00:14:58.498 11:25:53 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- nvmf/common.sh@53 -- # build_nvmf_app_args 00:14:58.498 11:25:53 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:14:58.498 11:25:53 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:14:58.499 11:25:53 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:14:58.499 11:25:53 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- nvmf/common.sh@33 -- # '[' '' -eq 1 ']' 00:14:58.499 /home/vagrant/spdk_repo/spdk/test/nvmf/common.sh: line 33: [: : integer expression expected 00:14:58.499 11:25:53 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- nvmf/common.sh@37 -- # '[' -n '' ']' 00:14:58.499 11:25:53 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- nvmf/common.sh@39 -- # '[' 0 -eq 1 ']' 00:14:58.499 11:25:53 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- nvmf/common.sh@55 -- # have_pci_nics=0 00:14:58.499 11:25:53 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- target/rpc.sh@11 -- # loops=5 00:14:58.499 11:25:53 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- target/rpc.sh@23 -- # nvmftestinit 00:14:58.499 11:25:53 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- nvmf/common.sh@467 -- # '[' -z tcp ']' 00:14:58.499 11:25:53 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- nvmf/common.sh@472 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:14:58.499 11:25:53 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- nvmf/common.sh@474 -- # prepare_net_devs 00:14:58.499 11:25:53 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- nvmf/common.sh@436 -- # local -g is_hw=no 00:14:58.499 11:25:53 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- nvmf/common.sh@438 -- # remove_spdk_ns 00:14:58.499 11:25:53 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- nvmf/common.sh@654 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:14:58.499 11:25:53 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 15> /dev/null' 00:14:58.499 11:25:53 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:14:58.499 11:25:53 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- nvmf/common.sh@440 -- # [[ virt != virt ]] 00:14:58.499 11:25:53 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- nvmf/common.sh@442 -- # [[ no == yes ]] 00:14:58.499 11:25:53 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- nvmf/common.sh@449 -- # [[ virt == phy ]] 00:14:58.499 11:25:53 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- nvmf/common.sh@452 -- # [[ virt == phy-fallback ]] 00:14:58.499 11:25:53 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- nvmf/common.sh@457 -- # [[ tcp == tcp ]] 00:14:58.499 11:25:53 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- nvmf/common.sh@458 -- # nvmf_veth_init 00:14:58.499 11:25:53 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- nvmf/common.sh@145 -- # NVMF_FIRST_INITIATOR_IP=10.0.0.1 00:14:58.499 11:25:53 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- nvmf/common.sh@146 -- # NVMF_SECOND_INITIATOR_IP=10.0.0.2 00:14:58.499 11:25:53 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- nvmf/common.sh@147 -- # NVMF_FIRST_TARGET_IP=10.0.0.3 00:14:58.499 11:25:53 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- nvmf/common.sh@148 -- # NVMF_SECOND_TARGET_IP=10.0.0.4 00:14:58.499 11:25:53 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- nvmf/common.sh@149 -- # NVMF_INITIATOR_IP=10.0.0.1 00:14:58.499 11:25:53 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- nvmf/common.sh@150 -- # NVMF_BRIDGE=nvmf_br 00:14:58.499 11:25:53 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- nvmf/common.sh@151 -- # NVMF_INITIATOR_INTERFACE=nvmf_init_if 00:14:58.499 11:25:53 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- nvmf/common.sh@152 -- # NVMF_INITIATOR_INTERFACE2=nvmf_init_if2 00:14:58.499 11:25:53 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- nvmf/common.sh@153 -- # NVMF_INITIATOR_BRIDGE=nvmf_init_br 00:14:58.499 11:25:53 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- nvmf/common.sh@154 -- # NVMF_INITIATOR_BRIDGE2=nvmf_init_br2 00:14:58.499 11:25:53 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- nvmf/common.sh@155 -- # NVMF_TARGET_NAMESPACE=nvmf_tgt_ns_spdk 00:14:58.499 11:25:53 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- nvmf/common.sh@156 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:14:58.499 11:25:53 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- nvmf/common.sh@157 -- # NVMF_TARGET_INTERFACE=nvmf_tgt_if 00:14:58.499 11:25:53 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- nvmf/common.sh@158 -- # NVMF_TARGET_INTERFACE2=nvmf_tgt_if2 00:14:58.499 11:25:53 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- nvmf/common.sh@159 -- # NVMF_TARGET_BRIDGE=nvmf_tgt_br 00:14:58.499 11:25:53 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- nvmf/common.sh@160 -- # NVMF_TARGET_BRIDGE2=nvmf_tgt_br2 00:14:58.499 11:25:53 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- nvmf/common.sh@162 -- # ip link set nvmf_init_br nomaster 00:14:58.499 Cannot find device "nvmf_init_br" 00:14:58.499 11:25:53 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- nvmf/common.sh@162 -- # true 00:14:58.499 11:25:53 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- nvmf/common.sh@163 -- # ip link set nvmf_init_br2 nomaster 00:14:58.499 Cannot find device "nvmf_init_br2" 00:14:58.499 11:25:53 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- nvmf/common.sh@163 -- # true 00:14:58.499 11:25:53 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- nvmf/common.sh@164 -- # ip link set nvmf_tgt_br nomaster 00:14:58.499 Cannot find device "nvmf_tgt_br" 00:14:58.499 11:25:53 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- nvmf/common.sh@164 -- # true 00:14:58.499 11:25:53 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- nvmf/common.sh@165 -- # ip link set nvmf_tgt_br2 nomaster 00:14:58.499 Cannot find device "nvmf_tgt_br2" 00:14:58.499 11:25:53 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- nvmf/common.sh@165 -- # true 00:14:58.499 11:25:53 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- nvmf/common.sh@166 -- # ip link set nvmf_init_br down 00:14:58.499 Cannot find device "nvmf_init_br" 00:14:58.499 11:25:53 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- nvmf/common.sh@166 -- # true 00:14:58.499 11:25:53 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- nvmf/common.sh@167 -- # ip link set nvmf_init_br2 down 00:14:58.499 Cannot find device "nvmf_init_br2" 00:14:58.499 11:25:53 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- nvmf/common.sh@167 -- # true 00:14:58.499 11:25:53 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- nvmf/common.sh@168 -- # ip link set nvmf_tgt_br down 00:14:58.499 Cannot find device "nvmf_tgt_br" 00:14:58.499 11:25:53 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- nvmf/common.sh@168 -- # true 00:14:58.499 11:25:53 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- nvmf/common.sh@169 -- # ip link set nvmf_tgt_br2 down 00:14:58.499 Cannot find device "nvmf_tgt_br2" 00:14:58.499 11:25:53 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- nvmf/common.sh@169 -- # true 00:14:58.499 11:25:53 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- nvmf/common.sh@170 -- # ip link delete nvmf_br type bridge 00:14:58.499 Cannot find device "nvmf_br" 00:14:58.499 11:25:54 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- nvmf/common.sh@170 -- # true 00:14:58.499 11:25:54 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- nvmf/common.sh@171 -- # ip link delete nvmf_init_if 00:14:58.499 Cannot find device "nvmf_init_if" 00:14:58.499 11:25:54 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- nvmf/common.sh@171 -- # true 00:14:58.499 11:25:54 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- nvmf/common.sh@172 -- # ip link delete nvmf_init_if2 00:14:58.757 Cannot find device "nvmf_init_if2" 00:14:58.757 11:25:54 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- nvmf/common.sh@172 -- # true 00:14:58.757 11:25:54 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- nvmf/common.sh@173 -- # ip netns exec nvmf_tgt_ns_spdk ip link delete nvmf_tgt_if 00:14:58.757 Cannot open network namespace "nvmf_tgt_ns_spdk": No such file or directory 00:14:58.757 11:25:54 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- nvmf/common.sh@173 -- # true 00:14:58.757 11:25:54 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- nvmf/common.sh@174 -- # ip netns exec nvmf_tgt_ns_spdk ip link delete nvmf_tgt_if2 00:14:58.757 Cannot open network namespace "nvmf_tgt_ns_spdk": No such file or directory 00:14:58.757 11:25:54 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- nvmf/common.sh@174 -- # true 00:14:58.757 11:25:54 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- nvmf/common.sh@177 -- # ip netns add nvmf_tgt_ns_spdk 00:14:58.757 11:25:54 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- nvmf/common.sh@180 -- # ip link add nvmf_init_if type veth peer name nvmf_init_br 00:14:58.757 11:25:54 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- nvmf/common.sh@181 -- # ip link add nvmf_init_if2 type veth peer name nvmf_init_br2 00:14:58.757 11:25:54 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- nvmf/common.sh@182 -- # ip link add nvmf_tgt_if type veth peer name nvmf_tgt_br 00:14:58.757 11:25:54 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- nvmf/common.sh@183 -- # ip link add nvmf_tgt_if2 type veth peer name nvmf_tgt_br2 00:14:58.757 11:25:54 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- nvmf/common.sh@186 -- # ip link set nvmf_tgt_if netns nvmf_tgt_ns_spdk 00:14:58.757 11:25:54 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- nvmf/common.sh@187 -- # ip link set nvmf_tgt_if2 netns nvmf_tgt_ns_spdk 00:14:58.757 11:25:54 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- nvmf/common.sh@190 -- # ip addr add 10.0.0.1/24 dev nvmf_init_if 00:14:58.757 11:25:54 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- nvmf/common.sh@191 -- # ip addr add 10.0.0.2/24 dev nvmf_init_if2 00:14:58.757 11:25:54 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- nvmf/common.sh@192 -- # ip netns exec nvmf_tgt_ns_spdk ip addr add 10.0.0.3/24 dev nvmf_tgt_if 00:14:58.757 11:25:54 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- nvmf/common.sh@193 -- # ip netns exec nvmf_tgt_ns_spdk ip addr add 10.0.0.4/24 dev nvmf_tgt_if2 00:14:58.757 11:25:54 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- nvmf/common.sh@196 -- # ip link set nvmf_init_if up 00:14:58.757 11:25:54 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- nvmf/common.sh@197 -- # ip link set nvmf_init_if2 up 00:14:58.757 11:25:54 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- nvmf/common.sh@198 -- # ip link set nvmf_init_br up 00:14:58.757 11:25:54 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- nvmf/common.sh@199 -- # ip link set nvmf_init_br2 up 00:14:58.757 11:25:54 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- nvmf/common.sh@200 -- # ip link set nvmf_tgt_br up 00:14:58.757 11:25:54 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- nvmf/common.sh@201 -- # ip link set nvmf_tgt_br2 up 00:14:58.757 11:25:54 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- nvmf/common.sh@202 -- # ip netns exec nvmf_tgt_ns_spdk ip link set nvmf_tgt_if up 00:14:58.757 11:25:54 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- nvmf/common.sh@203 -- # ip netns exec nvmf_tgt_ns_spdk ip link set nvmf_tgt_if2 up 00:14:58.757 11:25:54 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- nvmf/common.sh@204 -- # ip netns exec nvmf_tgt_ns_spdk ip link set lo up 00:14:58.757 11:25:54 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- nvmf/common.sh@207 -- # ip link add nvmf_br type bridge 00:14:58.757 11:25:54 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- nvmf/common.sh@208 -- # ip link set nvmf_br up 00:14:58.757 11:25:54 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- nvmf/common.sh@211 -- # ip link set nvmf_init_br master nvmf_br 00:14:58.757 11:25:54 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- nvmf/common.sh@212 -- # ip link set nvmf_init_br2 master nvmf_br 00:14:58.757 11:25:54 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- nvmf/common.sh@213 -- # ip link set nvmf_tgt_br master nvmf_br 00:14:58.757 11:25:54 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- nvmf/common.sh@214 -- # ip link set nvmf_tgt_br2 master nvmf_br 00:14:58.757 11:25:54 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- nvmf/common.sh@217 -- # ipts -I INPUT 1 -i nvmf_init_if -p tcp --dport 4420 -j ACCEPT 00:14:58.757 11:25:54 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- nvmf/common.sh@788 -- # iptables -I INPUT 1 -i nvmf_init_if -p tcp --dport 4420 -j ACCEPT -m comment --comment 'SPDK_NVMF:-I INPUT 1 -i nvmf_init_if -p tcp --dport 4420 -j ACCEPT' 00:14:58.757 11:25:54 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- nvmf/common.sh@218 -- # ipts -I INPUT 1 -i nvmf_init_if2 -p tcp --dport 4420 -j ACCEPT 00:14:58.757 11:25:54 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- nvmf/common.sh@788 -- # iptables -I INPUT 1 -i nvmf_init_if2 -p tcp --dport 4420 -j ACCEPT -m comment --comment 'SPDK_NVMF:-I INPUT 1 -i nvmf_init_if2 -p tcp --dport 4420 -j ACCEPT' 00:14:58.757 11:25:54 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- nvmf/common.sh@219 -- # ipts -A FORWARD -i nvmf_br -o nvmf_br -j ACCEPT 00:14:58.757 11:25:54 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- nvmf/common.sh@788 -- # iptables -A FORWARD -i nvmf_br -o nvmf_br -j ACCEPT -m comment --comment 'SPDK_NVMF:-A FORWARD -i nvmf_br -o nvmf_br -j ACCEPT' 00:14:58.757 11:25:54 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- nvmf/common.sh@222 -- # ping -c 1 10.0.0.3 00:14:58.757 PING 10.0.0.3 (10.0.0.3) 56(84) bytes of data. 00:14:58.757 64 bytes from 10.0.0.3: icmp_seq=1 ttl=64 time=0.084 ms 00:14:58.757 00:14:58.757 --- 10.0.0.3 ping statistics --- 00:14:58.757 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:14:58.757 rtt min/avg/max/mdev = 0.084/0.084/0.084/0.000 ms 00:14:58.757 11:25:54 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- nvmf/common.sh@223 -- # ping -c 1 10.0.0.4 00:14:58.757 PING 10.0.0.4 (10.0.0.4) 56(84) bytes of data. 00:14:58.757 64 bytes from 10.0.0.4: icmp_seq=1 ttl=64 time=0.070 ms 00:14:58.757 00:14:58.757 --- 10.0.0.4 ping statistics --- 00:14:58.757 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:14:58.757 rtt min/avg/max/mdev = 0.070/0.070/0.070/0.000 ms 00:14:58.757 11:25:54 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- nvmf/common.sh@224 -- # ip netns exec nvmf_tgt_ns_spdk ping -c 1 10.0.0.1 00:14:59.015 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:14:59.015 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.030 ms 00:14:59.015 00:14:59.015 --- 10.0.0.1 ping statistics --- 00:14:59.015 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:14:59.015 rtt min/avg/max/mdev = 0.030/0.030/0.030/0.000 ms 00:14:59.015 11:25:54 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- nvmf/common.sh@225 -- # ip netns exec nvmf_tgt_ns_spdk ping -c 1 10.0.0.2 00:14:59.015 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:14:59.015 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.080 ms 00:14:59.015 00:14:59.015 --- 10.0.0.2 ping statistics --- 00:14:59.015 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:14:59.015 rtt min/avg/max/mdev = 0.080/0.080/0.080/0.000 ms 00:14:59.015 11:25:54 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- nvmf/common.sh@227 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:14:59.015 11:25:54 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- nvmf/common.sh@459 -- # return 0 00:14:59.015 11:25:54 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- nvmf/common.sh@476 -- # '[' '' == iso ']' 00:14:59.015 11:25:54 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- nvmf/common.sh@480 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:14:59.015 11:25:54 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- nvmf/common.sh@481 -- # [[ tcp == \r\d\m\a ]] 00:14:59.015 11:25:54 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- nvmf/common.sh@490 -- # [[ tcp == \t\c\p ]] 00:14:59.015 11:25:54 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- nvmf/common.sh@491 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:14:59.015 11:25:54 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- nvmf/common.sh@494 -- # '[' tcp == tcp ']' 00:14:59.015 11:25:54 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- nvmf/common.sh@500 -- # modprobe nvme-tcp 00:14:59.015 11:25:54 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- target/rpc.sh@24 -- # nvmfappstart -m 0xF 00:14:59.015 11:25:54 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- nvmf/common.sh@505 -- # timing_enter start_nvmf_tgt 00:14:59.015 11:25:54 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@724 -- # xtrace_disable 00:14:59.015 11:25:54 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@10 -- # set +x 00:14:59.015 11:25:54 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- nvmf/common.sh@507 -- # nvmfpid=74319 00:14:59.015 11:25:54 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- nvmf/common.sh@508 -- # waitforlisten 74319 00:14:59.015 11:25:54 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@831 -- # '[' -z 74319 ']' 00:14:59.015 11:25:54 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- nvmf/common.sh@506 -- # ip netns exec nvmf_tgt_ns_spdk /home/vagrant/spdk_repo/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:14:59.015 11:25:54 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@835 -- # local rpc_addr=/var/tmp/spdk.sock 00:14:59.015 11:25:54 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@836 -- # local max_retries=100 00:14:59.015 11:25:54 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@838 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:14:59.015 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:14:59.015 11:25:54 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@840 -- # xtrace_disable 00:14:59.015 11:25:54 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@10 -- # set +x 00:14:59.015 [2024-10-07 11:25:54.380884] Starting SPDK v25.01-pre git sha1 2a4f56c54 / DPDK 24.03.0 initialization... 00:14:59.015 [2024-10-07 11:25:54.381001] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --iova-mode=pa --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:14:59.015 [2024-10-07 11:25:54.522240] app.c: 917:spdk_app_start: *NOTICE*: Total cores available: 4 00:14:59.274 [2024-10-07 11:25:54.650520] app.c: 610:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:14:59.274 [2024-10-07 11:25:54.650573] app.c: 611:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:14:59.274 [2024-10-07 11:25:54.650587] app.c: 616:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:14:59.274 [2024-10-07 11:25:54.650598] app.c: 617:app_setup_trace: *NOTICE*: SPDK application currently running. 00:14:59.274 [2024-10-07 11:25:54.650608] app.c: 618:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:14:59.274 [2024-10-07 11:25:54.652042] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 1 00:14:59.274 [2024-10-07 11:25:54.652187] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 2 00:14:59.274 [2024-10-07 11:25:54.652244] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 3 00:14:59.274 [2024-10-07 11:25:54.652532] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 0 00:15:00.267 11:25:55 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@860 -- # (( i == 0 )) 00:15:00.267 11:25:55 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@864 -- # return 0 00:15:00.267 11:25:55 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- nvmf/common.sh@509 -- # timing_exit start_nvmf_tgt 00:15:00.267 11:25:55 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@730 -- # xtrace_disable 00:15:00.267 11:25:55 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@10 -- # set +x 00:15:00.267 11:25:55 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- nvmf/common.sh@510 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:15:00.267 11:25:55 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- target/rpc.sh@26 -- # rpc_cmd nvmf_get_stats 00:15:00.267 11:25:55 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:00.267 11:25:55 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@10 -- # set +x 00:15:00.267 11:25:55 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:00.267 11:25:55 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- target/rpc.sh@26 -- # stats='{ 00:15:00.267 "poll_groups": [ 00:15:00.267 { 00:15:00.267 "admin_qpairs": 0, 00:15:00.267 "completed_nvme_io": 0, 00:15:00.267 "current_admin_qpairs": 0, 00:15:00.267 "current_io_qpairs": 0, 00:15:00.267 "io_qpairs": 0, 00:15:00.267 "name": "nvmf_tgt_poll_group_000", 00:15:00.267 "pending_bdev_io": 0, 00:15:00.267 "transports": [] 00:15:00.267 }, 00:15:00.267 { 00:15:00.267 "admin_qpairs": 0, 00:15:00.267 "completed_nvme_io": 0, 00:15:00.267 "current_admin_qpairs": 0, 00:15:00.267 "current_io_qpairs": 0, 00:15:00.267 "io_qpairs": 0, 00:15:00.267 "name": "nvmf_tgt_poll_group_001", 00:15:00.267 "pending_bdev_io": 0, 00:15:00.267 "transports": [] 00:15:00.267 }, 00:15:00.267 { 00:15:00.267 "admin_qpairs": 0, 00:15:00.267 "completed_nvme_io": 0, 00:15:00.267 "current_admin_qpairs": 0, 00:15:00.267 "current_io_qpairs": 0, 00:15:00.267 "io_qpairs": 0, 00:15:00.267 "name": "nvmf_tgt_poll_group_002", 00:15:00.267 "pending_bdev_io": 0, 00:15:00.267 "transports": [] 00:15:00.267 }, 00:15:00.267 { 00:15:00.267 "admin_qpairs": 0, 00:15:00.267 "completed_nvme_io": 0, 00:15:00.267 "current_admin_qpairs": 0, 00:15:00.267 "current_io_qpairs": 0, 00:15:00.267 "io_qpairs": 0, 00:15:00.267 "name": "nvmf_tgt_poll_group_003", 00:15:00.267 "pending_bdev_io": 0, 00:15:00.267 "transports": [] 00:15:00.267 } 00:15:00.267 ], 00:15:00.267 "tick_rate": 2200000000 00:15:00.267 }' 00:15:00.267 11:25:55 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- target/rpc.sh@28 -- # jcount '.poll_groups[].name' 00:15:00.267 11:25:55 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- target/rpc.sh@14 -- # local 'filter=.poll_groups[].name' 00:15:00.267 11:25:55 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- target/rpc.sh@15 -- # jq '.poll_groups[].name' 00:15:00.267 11:25:55 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- target/rpc.sh@15 -- # wc -l 00:15:00.267 11:25:55 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- target/rpc.sh@28 -- # (( 4 == 4 )) 00:15:00.267 11:25:55 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- target/rpc.sh@29 -- # jq '.poll_groups[0].transports[0]' 00:15:00.267 11:25:55 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- target/rpc.sh@29 -- # [[ null == null ]] 00:15:00.267 11:25:55 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- target/rpc.sh@31 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:15:00.267 11:25:55 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:00.267 11:25:55 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@10 -- # set +x 00:15:00.267 [2024-10-07 11:25:55.641230] tcp.c: 738:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:15:00.267 11:25:55 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:00.267 11:25:55 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- target/rpc.sh@33 -- # rpc_cmd nvmf_get_stats 00:15:00.267 11:25:55 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:00.267 11:25:55 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@10 -- # set +x 00:15:00.267 11:25:55 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:00.267 11:25:55 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- target/rpc.sh@33 -- # stats='{ 00:15:00.267 "poll_groups": [ 00:15:00.267 { 00:15:00.267 "admin_qpairs": 0, 00:15:00.267 "completed_nvme_io": 0, 00:15:00.267 "current_admin_qpairs": 0, 00:15:00.267 "current_io_qpairs": 0, 00:15:00.267 "io_qpairs": 0, 00:15:00.267 "name": "nvmf_tgt_poll_group_000", 00:15:00.267 "pending_bdev_io": 0, 00:15:00.267 "transports": [ 00:15:00.267 { 00:15:00.267 "trtype": "TCP" 00:15:00.267 } 00:15:00.267 ] 00:15:00.267 }, 00:15:00.267 { 00:15:00.267 "admin_qpairs": 0, 00:15:00.267 "completed_nvme_io": 0, 00:15:00.267 "current_admin_qpairs": 0, 00:15:00.267 "current_io_qpairs": 0, 00:15:00.267 "io_qpairs": 0, 00:15:00.267 "name": "nvmf_tgt_poll_group_001", 00:15:00.267 "pending_bdev_io": 0, 00:15:00.267 "transports": [ 00:15:00.267 { 00:15:00.267 "trtype": "TCP" 00:15:00.267 } 00:15:00.267 ] 00:15:00.267 }, 00:15:00.267 { 00:15:00.267 "admin_qpairs": 0, 00:15:00.267 "completed_nvme_io": 0, 00:15:00.267 "current_admin_qpairs": 0, 00:15:00.267 "current_io_qpairs": 0, 00:15:00.267 "io_qpairs": 0, 00:15:00.267 "name": "nvmf_tgt_poll_group_002", 00:15:00.267 "pending_bdev_io": 0, 00:15:00.267 "transports": [ 00:15:00.267 { 00:15:00.267 "trtype": "TCP" 00:15:00.267 } 00:15:00.267 ] 00:15:00.268 }, 00:15:00.268 { 00:15:00.268 "admin_qpairs": 0, 00:15:00.268 "completed_nvme_io": 0, 00:15:00.268 "current_admin_qpairs": 0, 00:15:00.268 "current_io_qpairs": 0, 00:15:00.268 "io_qpairs": 0, 00:15:00.268 "name": "nvmf_tgt_poll_group_003", 00:15:00.268 "pending_bdev_io": 0, 00:15:00.268 "transports": [ 00:15:00.268 { 00:15:00.268 "trtype": "TCP" 00:15:00.268 } 00:15:00.268 ] 00:15:00.268 } 00:15:00.268 ], 00:15:00.268 "tick_rate": 2200000000 00:15:00.268 }' 00:15:00.268 11:25:55 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- target/rpc.sh@35 -- # jsum '.poll_groups[].admin_qpairs' 00:15:00.268 11:25:55 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- target/rpc.sh@19 -- # local 'filter=.poll_groups[].admin_qpairs' 00:15:00.268 11:25:55 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- target/rpc.sh@20 -- # awk '{s+=$1}END{print s}' 00:15:00.268 11:25:55 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- target/rpc.sh@20 -- # jq '.poll_groups[].admin_qpairs' 00:15:00.268 11:25:55 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- target/rpc.sh@35 -- # (( 0 == 0 )) 00:15:00.268 11:25:55 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- target/rpc.sh@36 -- # jsum '.poll_groups[].io_qpairs' 00:15:00.268 11:25:55 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- target/rpc.sh@19 -- # local 'filter=.poll_groups[].io_qpairs' 00:15:00.268 11:25:55 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- target/rpc.sh@20 -- # jq '.poll_groups[].io_qpairs' 00:15:00.268 11:25:55 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- target/rpc.sh@20 -- # awk '{s+=$1}END{print s}' 00:15:00.268 11:25:55 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- target/rpc.sh@36 -- # (( 0 == 0 )) 00:15:00.268 11:25:55 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- target/rpc.sh@38 -- # '[' rdma == tcp ']' 00:15:00.268 11:25:55 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- target/rpc.sh@46 -- # MALLOC_BDEV_SIZE=64 00:15:00.268 11:25:55 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- target/rpc.sh@47 -- # MALLOC_BLOCK_SIZE=512 00:15:00.268 11:25:55 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- target/rpc.sh@49 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc1 00:15:00.268 11:25:55 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:00.268 11:25:55 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@10 -- # set +x 00:15:00.526 Malloc1 00:15:00.526 11:25:55 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:00.526 11:25:55 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- target/rpc.sh@52 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDKISFASTANDAWESOME 00:15:00.526 11:25:55 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:00.526 11:25:55 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@10 -- # set +x 00:15:00.526 11:25:55 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:00.526 11:25:55 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- target/rpc.sh@53 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:15:00.526 11:25:55 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:00.526 11:25:55 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@10 -- # set +x 00:15:00.526 11:25:55 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:00.526 11:25:55 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- target/rpc.sh@54 -- # rpc_cmd nvmf_subsystem_allow_any_host -d nqn.2016-06.io.spdk:cnode1 00:15:00.526 11:25:55 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:00.526 11:25:55 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@10 -- # set +x 00:15:00.526 11:25:55 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:00.526 11:25:55 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- target/rpc.sh@55 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.3 -s 4420 00:15:00.526 11:25:55 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:00.526 11:25:55 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@10 -- # set +x 00:15:00.526 [2024-10-07 11:25:55.824282] tcp.c:1081:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.3 port 4420 *** 00:15:00.526 11:25:55 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:00.526 11:25:55 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- target/rpc.sh@58 -- # NOT nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:c758a4ed-f09f-4c82-9afb-3d096f035464 --hostid=c758a4ed-f09f-4c82-9afb-3d096f035464 -t tcp -n nqn.2016-06.io.spdk:cnode1 -q nqn.2014-08.org.nvmexpress:uuid:c758a4ed-f09f-4c82-9afb-3d096f035464 -a 10.0.0.3 -s 4420 00:15:00.526 11:25:55 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@650 -- # local es=0 00:15:00.526 11:25:55 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@652 -- # valid_exec_arg nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:c758a4ed-f09f-4c82-9afb-3d096f035464 --hostid=c758a4ed-f09f-4c82-9afb-3d096f035464 -t tcp -n nqn.2016-06.io.spdk:cnode1 -q nqn.2014-08.org.nvmexpress:uuid:c758a4ed-f09f-4c82-9afb-3d096f035464 -a 10.0.0.3 -s 4420 00:15:00.526 11:25:55 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@638 -- # local arg=nvme 00:15:00.526 11:25:55 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:15:00.526 11:25:55 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@642 -- # type -t nvme 00:15:00.526 11:25:55 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:15:00.526 11:25:55 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@644 -- # type -P nvme 00:15:00.526 11:25:55 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:15:00.526 11:25:55 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@644 -- # arg=/usr/sbin/nvme 00:15:00.526 11:25:55 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@644 -- # [[ -x /usr/sbin/nvme ]] 00:15:00.526 11:25:55 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@653 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:c758a4ed-f09f-4c82-9afb-3d096f035464 --hostid=c758a4ed-f09f-4c82-9afb-3d096f035464 -t tcp -n nqn.2016-06.io.spdk:cnode1 -q nqn.2014-08.org.nvmexpress:uuid:c758a4ed-f09f-4c82-9afb-3d096f035464 -a 10.0.0.3 -s 4420 00:15:00.526 [2024-10-07 11:25:55.856758] ctrlr.c: 823:nvmf_qpair_access_allowed: *ERROR*: Subsystem 'nqn.2016-06.io.spdk:cnode1' does not allow host 'nqn.2014-08.org.nvmexpress:uuid:c758a4ed-f09f-4c82-9afb-3d096f035464' 00:15:00.526 Failed to write to /dev/nvme-fabrics: Input/output error 00:15:00.526 could not add new controller: failed to write to nvme-fabrics device 00:15:00.526 11:25:55 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@653 -- # es=1 00:15:00.526 11:25:55 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:15:00.526 11:25:55 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:15:00.526 11:25:55 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:15:00.526 11:25:55 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- target/rpc.sh@61 -- # rpc_cmd nvmf_subsystem_add_host nqn.2016-06.io.spdk:cnode1 nqn.2014-08.org.nvmexpress:uuid:c758a4ed-f09f-4c82-9afb-3d096f035464 00:15:00.526 11:25:55 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:00.526 11:25:55 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@10 -- # set +x 00:15:00.526 11:25:55 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:00.526 11:25:55 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- target/rpc.sh@62 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:c758a4ed-f09f-4c82-9afb-3d096f035464 --hostid=c758a4ed-f09f-4c82-9afb-3d096f035464 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.3 -s 4420 00:15:00.526 11:25:56 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- target/rpc.sh@63 -- # waitforserial SPDKISFASTANDAWESOME 00:15:00.526 11:25:56 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@1198 -- # local i=0 00:15:00.526 11:25:56 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@1199 -- # local nvme_device_counter=1 nvme_devices=0 00:15:00.526 11:25:56 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@1200 -- # [[ -n '' ]] 00:15:00.526 11:25:56 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@1205 -- # sleep 2 00:15:03.075 11:25:58 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@1206 -- # (( i++ <= 15 )) 00:15:03.075 11:25:58 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@1207 -- # lsblk -l -o NAME,SERIAL 00:15:03.075 11:25:58 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@1207 -- # grep -c SPDKISFASTANDAWESOME 00:15:03.075 11:25:58 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@1207 -- # nvme_devices=1 00:15:03.075 11:25:58 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@1208 -- # (( nvme_devices == nvme_device_counter )) 00:15:03.075 11:25:58 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@1208 -- # return 0 00:15:03.075 11:25:58 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- target/rpc.sh@64 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:15:03.075 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:15:03.075 11:25:58 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- target/rpc.sh@65 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:15:03.075 11:25:58 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@1219 -- # local i=0 00:15:03.075 11:25:58 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@1220 -- # lsblk -o NAME,SERIAL 00:15:03.075 11:25:58 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@1220 -- # grep -q -w SPDKISFASTANDAWESOME 00:15:03.075 11:25:58 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@1227 -- # grep -q -w SPDKISFASTANDAWESOME 00:15:03.075 11:25:58 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@1227 -- # lsblk -l -o NAME,SERIAL 00:15:03.075 11:25:58 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@1231 -- # return 0 00:15:03.075 11:25:58 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- target/rpc.sh@68 -- # rpc_cmd nvmf_subsystem_remove_host nqn.2016-06.io.spdk:cnode1 nqn.2014-08.org.nvmexpress:uuid:c758a4ed-f09f-4c82-9afb-3d096f035464 00:15:03.075 11:25:58 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:03.075 11:25:58 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@10 -- # set +x 00:15:03.075 11:25:58 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:03.075 11:25:58 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- target/rpc.sh@69 -- # NOT nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:c758a4ed-f09f-4c82-9afb-3d096f035464 --hostid=c758a4ed-f09f-4c82-9afb-3d096f035464 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.3 -s 4420 00:15:03.075 11:25:58 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@650 -- # local es=0 00:15:03.075 11:25:58 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@652 -- # valid_exec_arg nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:c758a4ed-f09f-4c82-9afb-3d096f035464 --hostid=c758a4ed-f09f-4c82-9afb-3d096f035464 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.3 -s 4420 00:15:03.075 11:25:58 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@638 -- # local arg=nvme 00:15:03.075 11:25:58 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:15:03.075 11:25:58 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@642 -- # type -t nvme 00:15:03.075 11:25:58 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:15:03.075 11:25:58 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@644 -- # type -P nvme 00:15:03.075 11:25:58 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:15:03.075 11:25:58 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@644 -- # arg=/usr/sbin/nvme 00:15:03.075 11:25:58 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@644 -- # [[ -x /usr/sbin/nvme ]] 00:15:03.075 11:25:58 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@653 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:c758a4ed-f09f-4c82-9afb-3d096f035464 --hostid=c758a4ed-f09f-4c82-9afb-3d096f035464 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.3 -s 4420 00:15:03.075 [2024-10-07 11:25:58.159434] ctrlr.c: 823:nvmf_qpair_access_allowed: *ERROR*: Subsystem 'nqn.2016-06.io.spdk:cnode1' does not allow host 'nqn.2014-08.org.nvmexpress:uuid:c758a4ed-f09f-4c82-9afb-3d096f035464' 00:15:03.075 Failed to write to /dev/nvme-fabrics: Input/output error 00:15:03.075 could not add new controller: failed to write to nvme-fabrics device 00:15:03.075 11:25:58 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@653 -- # es=1 00:15:03.075 11:25:58 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:15:03.075 11:25:58 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:15:03.075 11:25:58 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:15:03.075 11:25:58 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- target/rpc.sh@72 -- # rpc_cmd nvmf_subsystem_allow_any_host -e nqn.2016-06.io.spdk:cnode1 00:15:03.075 11:25:58 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:03.075 11:25:58 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@10 -- # set +x 00:15:03.075 11:25:58 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:03.075 11:25:58 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- target/rpc.sh@73 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:c758a4ed-f09f-4c82-9afb-3d096f035464 --hostid=c758a4ed-f09f-4c82-9afb-3d096f035464 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.3 -s 4420 00:15:03.075 11:25:58 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- target/rpc.sh@74 -- # waitforserial SPDKISFASTANDAWESOME 00:15:03.075 11:25:58 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@1198 -- # local i=0 00:15:03.075 11:25:58 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@1199 -- # local nvme_device_counter=1 nvme_devices=0 00:15:03.075 11:25:58 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@1200 -- # [[ -n '' ]] 00:15:03.075 11:25:58 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@1205 -- # sleep 2 00:15:04.976 11:26:00 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@1206 -- # (( i++ <= 15 )) 00:15:04.976 11:26:00 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@1207 -- # lsblk -l -o NAME,SERIAL 00:15:04.976 11:26:00 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@1207 -- # grep -c SPDKISFASTANDAWESOME 00:15:04.976 11:26:00 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@1207 -- # nvme_devices=1 00:15:04.976 11:26:00 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@1208 -- # (( nvme_devices == nvme_device_counter )) 00:15:04.976 11:26:00 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@1208 -- # return 0 00:15:04.976 11:26:00 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- target/rpc.sh@75 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:15:05.234 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:15:05.234 11:26:00 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- target/rpc.sh@76 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:15:05.234 11:26:00 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@1219 -- # local i=0 00:15:05.234 11:26:00 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@1220 -- # lsblk -o NAME,SERIAL 00:15:05.234 11:26:00 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@1220 -- # grep -q -w SPDKISFASTANDAWESOME 00:15:05.234 11:26:00 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@1227 -- # lsblk -l -o NAME,SERIAL 00:15:05.234 11:26:00 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@1227 -- # grep -q -w SPDKISFASTANDAWESOME 00:15:05.234 11:26:00 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@1231 -- # return 0 00:15:05.234 11:26:00 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- target/rpc.sh@78 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:15:05.234 11:26:00 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:05.234 11:26:00 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@10 -- # set +x 00:15:05.234 11:26:00 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:05.234 11:26:00 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- target/rpc.sh@81 -- # seq 1 5 00:15:05.234 11:26:00 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- target/rpc.sh@81 -- # for i in $(seq 1 $loops) 00:15:05.234 11:26:00 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- target/rpc.sh@82 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDKISFASTANDAWESOME 00:15:05.234 11:26:00 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:05.234 11:26:00 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@10 -- # set +x 00:15:05.234 11:26:00 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:05.234 11:26:00 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- target/rpc.sh@83 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.3 -s 4420 00:15:05.234 11:26:00 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:05.234 11:26:00 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@10 -- # set +x 00:15:05.234 [2024-10-07 11:26:00.582803] tcp.c:1081:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.3 port 4420 *** 00:15:05.234 11:26:00 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:05.234 11:26:00 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- target/rpc.sh@84 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 -n 5 00:15:05.234 11:26:00 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:05.234 11:26:00 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@10 -- # set +x 00:15:05.235 11:26:00 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:05.235 11:26:00 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- target/rpc.sh@85 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode1 00:15:05.235 11:26:00 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:05.235 11:26:00 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@10 -- # set +x 00:15:05.235 11:26:00 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:05.235 11:26:00 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- target/rpc.sh@86 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:c758a4ed-f09f-4c82-9afb-3d096f035464 --hostid=c758a4ed-f09f-4c82-9afb-3d096f035464 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.3 -s 4420 00:15:05.493 11:26:00 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- target/rpc.sh@88 -- # waitforserial SPDKISFASTANDAWESOME 00:15:05.493 11:26:00 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@1198 -- # local i=0 00:15:05.493 11:26:00 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@1199 -- # local nvme_device_counter=1 nvme_devices=0 00:15:05.493 11:26:00 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@1200 -- # [[ -n '' ]] 00:15:05.493 11:26:00 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@1205 -- # sleep 2 00:15:07.391 11:26:02 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@1206 -- # (( i++ <= 15 )) 00:15:07.391 11:26:02 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@1207 -- # lsblk -l -o NAME,SERIAL 00:15:07.391 11:26:02 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@1207 -- # grep -c SPDKISFASTANDAWESOME 00:15:07.391 11:26:02 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@1207 -- # nvme_devices=1 00:15:07.391 11:26:02 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@1208 -- # (( nvme_devices == nvme_device_counter )) 00:15:07.391 11:26:02 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@1208 -- # return 0 00:15:07.391 11:26:02 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- target/rpc.sh@90 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:15:07.649 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:15:07.649 11:26:02 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- target/rpc.sh@91 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:15:07.649 11:26:02 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@1219 -- # local i=0 00:15:07.649 11:26:02 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@1220 -- # grep -q -w SPDKISFASTANDAWESOME 00:15:07.649 11:26:02 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@1220 -- # lsblk -o NAME,SERIAL 00:15:07.649 11:26:02 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@1227 -- # lsblk -l -o NAME,SERIAL 00:15:07.649 11:26:02 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@1227 -- # grep -q -w SPDKISFASTANDAWESOME 00:15:07.649 11:26:02 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@1231 -- # return 0 00:15:07.649 11:26:02 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- target/rpc.sh@93 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:15:07.649 11:26:02 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:07.649 11:26:02 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@10 -- # set +x 00:15:07.649 11:26:02 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:07.649 11:26:02 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- target/rpc.sh@94 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:15:07.649 11:26:02 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:07.649 11:26:02 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@10 -- # set +x 00:15:07.649 11:26:02 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:07.649 11:26:02 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- target/rpc.sh@81 -- # for i in $(seq 1 $loops) 00:15:07.649 11:26:02 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- target/rpc.sh@82 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDKISFASTANDAWESOME 00:15:07.649 11:26:02 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:07.649 11:26:02 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@10 -- # set +x 00:15:07.649 11:26:02 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:07.649 11:26:02 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- target/rpc.sh@83 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.3 -s 4420 00:15:07.649 11:26:02 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:07.649 11:26:02 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@10 -- # set +x 00:15:07.649 [2024-10-07 11:26:02.990463] tcp.c:1081:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.3 port 4420 *** 00:15:07.649 11:26:02 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:07.649 11:26:02 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- target/rpc.sh@84 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 -n 5 00:15:07.649 11:26:02 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:07.649 11:26:02 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@10 -- # set +x 00:15:07.649 11:26:03 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:07.649 11:26:03 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- target/rpc.sh@85 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode1 00:15:07.649 11:26:03 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:07.649 11:26:03 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@10 -- # set +x 00:15:07.649 11:26:03 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:07.649 11:26:03 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- target/rpc.sh@86 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:c758a4ed-f09f-4c82-9afb-3d096f035464 --hostid=c758a4ed-f09f-4c82-9afb-3d096f035464 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.3 -s 4420 00:15:07.907 11:26:03 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- target/rpc.sh@88 -- # waitforserial SPDKISFASTANDAWESOME 00:15:07.907 11:26:03 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@1198 -- # local i=0 00:15:07.907 11:26:03 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@1199 -- # local nvme_device_counter=1 nvme_devices=0 00:15:07.907 11:26:03 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@1200 -- # [[ -n '' ]] 00:15:07.907 11:26:03 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@1205 -- # sleep 2 00:15:09.822 11:26:05 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@1206 -- # (( i++ <= 15 )) 00:15:09.823 11:26:05 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@1207 -- # lsblk -l -o NAME,SERIAL 00:15:09.823 11:26:05 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@1207 -- # grep -c SPDKISFASTANDAWESOME 00:15:09.823 11:26:05 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@1207 -- # nvme_devices=1 00:15:09.823 11:26:05 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@1208 -- # (( nvme_devices == nvme_device_counter )) 00:15:09.823 11:26:05 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@1208 -- # return 0 00:15:09.823 11:26:05 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- target/rpc.sh@90 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:15:10.081 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:15:10.081 11:26:05 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- target/rpc.sh@91 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:15:10.081 11:26:05 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@1219 -- # local i=0 00:15:10.081 11:26:05 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@1220 -- # grep -q -w SPDKISFASTANDAWESOME 00:15:10.081 11:26:05 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@1220 -- # lsblk -o NAME,SERIAL 00:15:10.081 11:26:05 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@1227 -- # lsblk -l -o NAME,SERIAL 00:15:10.081 11:26:05 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@1227 -- # grep -q -w SPDKISFASTANDAWESOME 00:15:10.081 11:26:05 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@1231 -- # return 0 00:15:10.081 11:26:05 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- target/rpc.sh@93 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:15:10.081 11:26:05 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:10.081 11:26:05 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@10 -- # set +x 00:15:10.081 11:26:05 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:10.081 11:26:05 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- target/rpc.sh@94 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:15:10.081 11:26:05 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:10.081 11:26:05 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@10 -- # set +x 00:15:10.081 11:26:05 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:10.081 11:26:05 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- target/rpc.sh@81 -- # for i in $(seq 1 $loops) 00:15:10.081 11:26:05 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- target/rpc.sh@82 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDKISFASTANDAWESOME 00:15:10.081 11:26:05 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:10.081 11:26:05 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@10 -- # set +x 00:15:10.081 11:26:05 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:10.081 11:26:05 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- target/rpc.sh@83 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.3 -s 4420 00:15:10.081 11:26:05 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:10.081 11:26:05 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@10 -- # set +x 00:15:10.081 [2024-10-07 11:26:05.422360] tcp.c:1081:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.3 port 4420 *** 00:15:10.081 11:26:05 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:10.081 11:26:05 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- target/rpc.sh@84 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 -n 5 00:15:10.081 11:26:05 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:10.081 11:26:05 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@10 -- # set +x 00:15:10.081 11:26:05 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:10.081 11:26:05 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- target/rpc.sh@85 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode1 00:15:10.081 11:26:05 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:10.081 11:26:05 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@10 -- # set +x 00:15:10.081 11:26:05 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:10.081 11:26:05 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- target/rpc.sh@86 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:c758a4ed-f09f-4c82-9afb-3d096f035464 --hostid=c758a4ed-f09f-4c82-9afb-3d096f035464 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.3 -s 4420 00:15:10.339 11:26:05 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- target/rpc.sh@88 -- # waitforserial SPDKISFASTANDAWESOME 00:15:10.339 11:26:05 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@1198 -- # local i=0 00:15:10.339 11:26:05 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@1199 -- # local nvme_device_counter=1 nvme_devices=0 00:15:10.339 11:26:05 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@1200 -- # [[ -n '' ]] 00:15:10.339 11:26:05 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@1205 -- # sleep 2 00:15:12.236 11:26:07 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@1206 -- # (( i++ <= 15 )) 00:15:12.236 11:26:07 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@1207 -- # lsblk -l -o NAME,SERIAL 00:15:12.236 11:26:07 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@1207 -- # grep -c SPDKISFASTANDAWESOME 00:15:12.236 11:26:07 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@1207 -- # nvme_devices=1 00:15:12.236 11:26:07 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@1208 -- # (( nvme_devices == nvme_device_counter )) 00:15:12.236 11:26:07 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@1208 -- # return 0 00:15:12.236 11:26:07 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- target/rpc.sh@90 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:15:12.236 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:15:12.236 11:26:07 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- target/rpc.sh@91 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:15:12.236 11:26:07 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@1219 -- # local i=0 00:15:12.236 11:26:07 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@1220 -- # lsblk -o NAME,SERIAL 00:15:12.236 11:26:07 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@1220 -- # grep -q -w SPDKISFASTANDAWESOME 00:15:12.236 11:26:07 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@1227 -- # lsblk -l -o NAME,SERIAL 00:15:12.236 11:26:07 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@1227 -- # grep -q -w SPDKISFASTANDAWESOME 00:15:12.236 11:26:07 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@1231 -- # return 0 00:15:12.236 11:26:07 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- target/rpc.sh@93 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:15:12.236 11:26:07 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:12.236 11:26:07 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@10 -- # set +x 00:15:12.236 11:26:07 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:12.236 11:26:07 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- target/rpc.sh@94 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:15:12.236 11:26:07 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:12.236 11:26:07 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@10 -- # set +x 00:15:12.236 11:26:07 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:12.236 11:26:07 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- target/rpc.sh@81 -- # for i in $(seq 1 $loops) 00:15:12.236 11:26:07 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- target/rpc.sh@82 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDKISFASTANDAWESOME 00:15:12.236 11:26:07 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:12.236 11:26:07 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@10 -- # set +x 00:15:12.236 11:26:07 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:12.236 11:26:07 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- target/rpc.sh@83 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.3 -s 4420 00:15:12.236 11:26:07 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:12.236 11:26:07 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@10 -- # set +x 00:15:12.236 [2024-10-07 11:26:07.737338] tcp.c:1081:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.3 port 4420 *** 00:15:12.236 11:26:07 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:12.236 11:26:07 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- target/rpc.sh@84 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 -n 5 00:15:12.236 11:26:07 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:12.236 11:26:07 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@10 -- # set +x 00:15:12.236 11:26:07 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:12.236 11:26:07 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- target/rpc.sh@85 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode1 00:15:12.236 11:26:07 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:12.236 11:26:07 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@10 -- # set +x 00:15:12.236 11:26:07 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:12.236 11:26:07 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- target/rpc.sh@86 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:c758a4ed-f09f-4c82-9afb-3d096f035464 --hostid=c758a4ed-f09f-4c82-9afb-3d096f035464 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.3 -s 4420 00:15:12.494 11:26:07 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- target/rpc.sh@88 -- # waitforserial SPDKISFASTANDAWESOME 00:15:12.494 11:26:07 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@1198 -- # local i=0 00:15:12.494 11:26:07 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@1199 -- # local nvme_device_counter=1 nvme_devices=0 00:15:12.494 11:26:07 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@1200 -- # [[ -n '' ]] 00:15:12.494 11:26:07 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@1205 -- # sleep 2 00:15:15.024 11:26:09 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@1206 -- # (( i++ <= 15 )) 00:15:15.024 11:26:09 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@1207 -- # lsblk -l -o NAME,SERIAL 00:15:15.024 11:26:09 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@1207 -- # grep -c SPDKISFASTANDAWESOME 00:15:15.024 11:26:09 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@1207 -- # nvme_devices=1 00:15:15.024 11:26:09 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@1208 -- # (( nvme_devices == nvme_device_counter )) 00:15:15.024 11:26:09 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@1208 -- # return 0 00:15:15.024 11:26:09 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- target/rpc.sh@90 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:15:15.024 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:15:15.024 11:26:09 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- target/rpc.sh@91 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:15:15.024 11:26:09 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@1219 -- # local i=0 00:15:15.024 11:26:09 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@1220 -- # lsblk -o NAME,SERIAL 00:15:15.024 11:26:09 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@1220 -- # grep -q -w SPDKISFASTANDAWESOME 00:15:15.024 11:26:09 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@1227 -- # lsblk -l -o NAME,SERIAL 00:15:15.024 11:26:09 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@1227 -- # grep -q -w SPDKISFASTANDAWESOME 00:15:15.024 11:26:10 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@1231 -- # return 0 00:15:15.024 11:26:10 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- target/rpc.sh@93 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:15:15.024 11:26:10 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:15.024 11:26:10 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@10 -- # set +x 00:15:15.024 11:26:10 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:15.024 11:26:10 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- target/rpc.sh@94 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:15:15.024 11:26:10 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:15.024 11:26:10 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@10 -- # set +x 00:15:15.024 11:26:10 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:15.024 11:26:10 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- target/rpc.sh@81 -- # for i in $(seq 1 $loops) 00:15:15.024 11:26:10 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- target/rpc.sh@82 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDKISFASTANDAWESOME 00:15:15.024 11:26:10 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:15.024 11:26:10 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@10 -- # set +x 00:15:15.024 11:26:10 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:15.024 11:26:10 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- target/rpc.sh@83 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.3 -s 4420 00:15:15.024 11:26:10 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:15.024 11:26:10 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@10 -- # set +x 00:15:15.024 [2024-10-07 11:26:10.032584] tcp.c:1081:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.3 port 4420 *** 00:15:15.024 11:26:10 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:15.024 11:26:10 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- target/rpc.sh@84 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 -n 5 00:15:15.024 11:26:10 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:15.024 11:26:10 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@10 -- # set +x 00:15:15.024 11:26:10 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:15.024 11:26:10 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- target/rpc.sh@85 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode1 00:15:15.024 11:26:10 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:15.024 11:26:10 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@10 -- # set +x 00:15:15.024 11:26:10 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:15.024 11:26:10 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- target/rpc.sh@86 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:c758a4ed-f09f-4c82-9afb-3d096f035464 --hostid=c758a4ed-f09f-4c82-9afb-3d096f035464 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.3 -s 4420 00:15:15.024 11:26:10 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- target/rpc.sh@88 -- # waitforserial SPDKISFASTANDAWESOME 00:15:15.024 11:26:10 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@1198 -- # local i=0 00:15:15.024 11:26:10 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@1199 -- # local nvme_device_counter=1 nvme_devices=0 00:15:15.024 11:26:10 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@1200 -- # [[ -n '' ]] 00:15:15.024 11:26:10 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@1205 -- # sleep 2 00:15:16.925 11:26:12 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@1206 -- # (( i++ <= 15 )) 00:15:16.925 11:26:12 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@1207 -- # lsblk -l -o NAME,SERIAL 00:15:16.925 11:26:12 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@1207 -- # grep -c SPDKISFASTANDAWESOME 00:15:16.925 11:26:12 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@1207 -- # nvme_devices=1 00:15:16.925 11:26:12 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@1208 -- # (( nvme_devices == nvme_device_counter )) 00:15:16.925 11:26:12 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@1208 -- # return 0 00:15:16.925 11:26:12 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- target/rpc.sh@90 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:15:16.925 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:15:16.925 11:26:12 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- target/rpc.sh@91 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:15:16.925 11:26:12 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@1219 -- # local i=0 00:15:16.925 11:26:12 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@1220 -- # lsblk -o NAME,SERIAL 00:15:16.925 11:26:12 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@1220 -- # grep -q -w SPDKISFASTANDAWESOME 00:15:16.925 11:26:12 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@1227 -- # grep -q -w SPDKISFASTANDAWESOME 00:15:16.925 11:26:12 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@1227 -- # lsblk -l -o NAME,SERIAL 00:15:16.925 11:26:12 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@1231 -- # return 0 00:15:16.925 11:26:12 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- target/rpc.sh@93 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:15:16.925 11:26:12 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:16.925 11:26:12 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@10 -- # set +x 00:15:16.925 11:26:12 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:16.925 11:26:12 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- target/rpc.sh@94 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:15:16.925 11:26:12 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:16.925 11:26:12 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@10 -- # set +x 00:15:16.925 11:26:12 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:16.925 11:26:12 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- target/rpc.sh@99 -- # seq 1 5 00:15:16.926 11:26:12 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- target/rpc.sh@99 -- # for i in $(seq 1 $loops) 00:15:16.926 11:26:12 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- target/rpc.sh@100 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDKISFASTANDAWESOME 00:15:16.926 11:26:12 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:16.926 11:26:12 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@10 -- # set +x 00:15:16.926 11:26:12 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:16.926 11:26:12 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- target/rpc.sh@101 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.3 -s 4420 00:15:16.926 11:26:12 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:16.926 11:26:12 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@10 -- # set +x 00:15:16.926 [2024-10-07 11:26:12.355633] tcp.c:1081:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.3 port 4420 *** 00:15:16.926 11:26:12 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:16.926 11:26:12 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- target/rpc.sh@102 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:15:16.926 11:26:12 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:16.926 11:26:12 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@10 -- # set +x 00:15:16.926 11:26:12 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:16.926 11:26:12 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- target/rpc.sh@103 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode1 00:15:16.926 11:26:12 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:16.926 11:26:12 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@10 -- # set +x 00:15:16.926 11:26:12 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:16.926 11:26:12 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- target/rpc.sh@105 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:15:16.926 11:26:12 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:16.926 11:26:12 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@10 -- # set +x 00:15:16.926 11:26:12 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:16.926 11:26:12 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- target/rpc.sh@107 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:15:16.926 11:26:12 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:16.926 11:26:12 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@10 -- # set +x 00:15:16.926 11:26:12 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:16.926 11:26:12 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- target/rpc.sh@99 -- # for i in $(seq 1 $loops) 00:15:16.926 11:26:12 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- target/rpc.sh@100 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDKISFASTANDAWESOME 00:15:16.926 11:26:12 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:16.926 11:26:12 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@10 -- # set +x 00:15:16.926 11:26:12 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:16.926 11:26:12 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- target/rpc.sh@101 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.3 -s 4420 00:15:16.926 11:26:12 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:16.926 11:26:12 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@10 -- # set +x 00:15:16.926 [2024-10-07 11:26:12.407686] tcp.c:1081:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.3 port 4420 *** 00:15:16.926 11:26:12 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:16.926 11:26:12 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- target/rpc.sh@102 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:15:16.926 11:26:12 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:16.926 11:26:12 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@10 -- # set +x 00:15:16.926 11:26:12 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:16.926 11:26:12 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- target/rpc.sh@103 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode1 00:15:16.926 11:26:12 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:16.926 11:26:12 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@10 -- # set +x 00:15:16.926 11:26:12 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:16.926 11:26:12 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- target/rpc.sh@105 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:15:16.926 11:26:12 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:16.926 11:26:12 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@10 -- # set +x 00:15:16.926 11:26:12 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:16.926 11:26:12 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- target/rpc.sh@107 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:15:16.926 11:26:12 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:16.926 11:26:12 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@10 -- # set +x 00:15:16.926 11:26:12 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:16.926 11:26:12 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- target/rpc.sh@99 -- # for i in $(seq 1 $loops) 00:15:16.926 11:26:12 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- target/rpc.sh@100 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDKISFASTANDAWESOME 00:15:16.926 11:26:12 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:16.926 11:26:12 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@10 -- # set +x 00:15:17.185 11:26:12 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:17.185 11:26:12 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- target/rpc.sh@101 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.3 -s 4420 00:15:17.185 11:26:12 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:17.185 11:26:12 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@10 -- # set +x 00:15:17.185 [2024-10-07 11:26:12.455709] tcp.c:1081:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.3 port 4420 *** 00:15:17.185 11:26:12 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:17.185 11:26:12 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- target/rpc.sh@102 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:15:17.185 11:26:12 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:17.185 11:26:12 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@10 -- # set +x 00:15:17.185 11:26:12 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:17.185 11:26:12 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- target/rpc.sh@103 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode1 00:15:17.185 11:26:12 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:17.185 11:26:12 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@10 -- # set +x 00:15:17.185 11:26:12 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:17.185 11:26:12 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- target/rpc.sh@105 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:15:17.185 11:26:12 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:17.185 11:26:12 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@10 -- # set +x 00:15:17.185 11:26:12 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:17.185 11:26:12 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- target/rpc.sh@107 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:15:17.185 11:26:12 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:17.185 11:26:12 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@10 -- # set +x 00:15:17.185 11:26:12 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:17.185 11:26:12 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- target/rpc.sh@99 -- # for i in $(seq 1 $loops) 00:15:17.185 11:26:12 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- target/rpc.sh@100 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDKISFASTANDAWESOME 00:15:17.185 11:26:12 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:17.185 11:26:12 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@10 -- # set +x 00:15:17.185 11:26:12 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:17.185 11:26:12 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- target/rpc.sh@101 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.3 -s 4420 00:15:17.185 11:26:12 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:17.185 11:26:12 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@10 -- # set +x 00:15:17.185 [2024-10-07 11:26:12.503762] tcp.c:1081:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.3 port 4420 *** 00:15:17.185 11:26:12 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:17.185 11:26:12 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- target/rpc.sh@102 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:15:17.185 11:26:12 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:17.185 11:26:12 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@10 -- # set +x 00:15:17.186 11:26:12 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:17.186 11:26:12 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- target/rpc.sh@103 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode1 00:15:17.186 11:26:12 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:17.186 11:26:12 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@10 -- # set +x 00:15:17.186 11:26:12 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:17.186 11:26:12 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- target/rpc.sh@105 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:15:17.186 11:26:12 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:17.186 11:26:12 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@10 -- # set +x 00:15:17.186 11:26:12 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:17.186 11:26:12 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- target/rpc.sh@107 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:15:17.186 11:26:12 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:17.186 11:26:12 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@10 -- # set +x 00:15:17.186 11:26:12 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:17.186 11:26:12 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- target/rpc.sh@99 -- # for i in $(seq 1 $loops) 00:15:17.186 11:26:12 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- target/rpc.sh@100 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDKISFASTANDAWESOME 00:15:17.186 11:26:12 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:17.186 11:26:12 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@10 -- # set +x 00:15:17.186 11:26:12 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:17.186 11:26:12 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- target/rpc.sh@101 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.3 -s 4420 00:15:17.186 11:26:12 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:17.186 11:26:12 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@10 -- # set +x 00:15:17.186 [2024-10-07 11:26:12.555799] tcp.c:1081:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.3 port 4420 *** 00:15:17.186 11:26:12 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:17.186 11:26:12 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- target/rpc.sh@102 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:15:17.186 11:26:12 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:17.186 11:26:12 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@10 -- # set +x 00:15:17.186 11:26:12 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:17.186 11:26:12 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- target/rpc.sh@103 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode1 00:15:17.186 11:26:12 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:17.186 11:26:12 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@10 -- # set +x 00:15:17.186 11:26:12 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:17.186 11:26:12 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- target/rpc.sh@105 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:15:17.186 11:26:12 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:17.186 11:26:12 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@10 -- # set +x 00:15:17.186 11:26:12 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:17.186 11:26:12 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- target/rpc.sh@107 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:15:17.186 11:26:12 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:17.186 11:26:12 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@10 -- # set +x 00:15:17.186 11:26:12 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:17.186 11:26:12 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- target/rpc.sh@110 -- # rpc_cmd nvmf_get_stats 00:15:17.186 11:26:12 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:17.186 11:26:12 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@10 -- # set +x 00:15:17.186 11:26:12 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:17.186 11:26:12 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- target/rpc.sh@110 -- # stats='{ 00:15:17.186 "poll_groups": [ 00:15:17.186 { 00:15:17.186 "admin_qpairs": 2, 00:15:17.186 "completed_nvme_io": 66, 00:15:17.186 "current_admin_qpairs": 0, 00:15:17.186 "current_io_qpairs": 0, 00:15:17.186 "io_qpairs": 16, 00:15:17.186 "name": "nvmf_tgt_poll_group_000", 00:15:17.186 "pending_bdev_io": 0, 00:15:17.186 "transports": [ 00:15:17.186 { 00:15:17.186 "trtype": "TCP" 00:15:17.186 } 00:15:17.186 ] 00:15:17.186 }, 00:15:17.186 { 00:15:17.186 "admin_qpairs": 3, 00:15:17.186 "completed_nvme_io": 69, 00:15:17.186 "current_admin_qpairs": 0, 00:15:17.186 "current_io_qpairs": 0, 00:15:17.186 "io_qpairs": 17, 00:15:17.186 "name": "nvmf_tgt_poll_group_001", 00:15:17.186 "pending_bdev_io": 0, 00:15:17.186 "transports": [ 00:15:17.186 { 00:15:17.186 "trtype": "TCP" 00:15:17.186 } 00:15:17.186 ] 00:15:17.186 }, 00:15:17.186 { 00:15:17.186 "admin_qpairs": 1, 00:15:17.186 "completed_nvme_io": 118, 00:15:17.186 "current_admin_qpairs": 0, 00:15:17.186 "current_io_qpairs": 0, 00:15:17.186 "io_qpairs": 19, 00:15:17.186 "name": "nvmf_tgt_poll_group_002", 00:15:17.186 "pending_bdev_io": 0, 00:15:17.186 "transports": [ 00:15:17.186 { 00:15:17.186 "trtype": "TCP" 00:15:17.186 } 00:15:17.186 ] 00:15:17.186 }, 00:15:17.186 { 00:15:17.186 "admin_qpairs": 1, 00:15:17.186 "completed_nvme_io": 167, 00:15:17.186 "current_admin_qpairs": 0, 00:15:17.186 "current_io_qpairs": 0, 00:15:17.186 "io_qpairs": 18, 00:15:17.186 "name": "nvmf_tgt_poll_group_003", 00:15:17.186 "pending_bdev_io": 0, 00:15:17.186 "transports": [ 00:15:17.186 { 00:15:17.186 "trtype": "TCP" 00:15:17.186 } 00:15:17.186 ] 00:15:17.186 } 00:15:17.186 ], 00:15:17.186 "tick_rate": 2200000000 00:15:17.186 }' 00:15:17.186 11:26:12 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- target/rpc.sh@112 -- # jsum '.poll_groups[].admin_qpairs' 00:15:17.186 11:26:12 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- target/rpc.sh@19 -- # local 'filter=.poll_groups[].admin_qpairs' 00:15:17.186 11:26:12 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- target/rpc.sh@20 -- # jq '.poll_groups[].admin_qpairs' 00:15:17.186 11:26:12 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- target/rpc.sh@20 -- # awk '{s+=$1}END{print s}' 00:15:17.186 11:26:12 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- target/rpc.sh@112 -- # (( 7 > 0 )) 00:15:17.186 11:26:12 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- target/rpc.sh@113 -- # jsum '.poll_groups[].io_qpairs' 00:15:17.186 11:26:12 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- target/rpc.sh@19 -- # local 'filter=.poll_groups[].io_qpairs' 00:15:17.186 11:26:12 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- target/rpc.sh@20 -- # jq '.poll_groups[].io_qpairs' 00:15:17.186 11:26:12 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- target/rpc.sh@20 -- # awk '{s+=$1}END{print s}' 00:15:17.444 11:26:12 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- target/rpc.sh@113 -- # (( 70 > 0 )) 00:15:17.444 11:26:12 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- target/rpc.sh@115 -- # '[' rdma == tcp ']' 00:15:17.444 11:26:12 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- target/rpc.sh@121 -- # trap - SIGINT SIGTERM EXIT 00:15:17.444 11:26:12 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- target/rpc.sh@123 -- # nvmftestfini 00:15:17.444 11:26:12 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- nvmf/common.sh@514 -- # nvmfcleanup 00:15:17.444 11:26:12 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- nvmf/common.sh@121 -- # sync 00:15:17.444 11:26:12 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- nvmf/common.sh@123 -- # '[' tcp == tcp ']' 00:15:17.444 11:26:12 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- nvmf/common.sh@124 -- # set +e 00:15:17.444 11:26:12 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- nvmf/common.sh@125 -- # for i in {1..20} 00:15:17.444 11:26:12 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- nvmf/common.sh@126 -- # modprobe -v -r nvme-tcp 00:15:17.444 rmmod nvme_tcp 00:15:17.444 rmmod nvme_fabrics 00:15:17.444 rmmod nvme_keyring 00:15:17.444 11:26:12 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- nvmf/common.sh@127 -- # modprobe -v -r nvme-fabrics 00:15:17.444 11:26:12 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- nvmf/common.sh@128 -- # set -e 00:15:17.444 11:26:12 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- nvmf/common.sh@129 -- # return 0 00:15:17.444 11:26:12 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- nvmf/common.sh@515 -- # '[' -n 74319 ']' 00:15:17.444 11:26:12 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- nvmf/common.sh@516 -- # killprocess 74319 00:15:17.444 11:26:12 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@950 -- # '[' -z 74319 ']' 00:15:17.444 11:26:12 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@954 -- # kill -0 74319 00:15:17.444 11:26:12 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@955 -- # uname 00:15:17.444 11:26:12 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@955 -- # '[' Linux = Linux ']' 00:15:17.444 11:26:12 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@956 -- # ps --no-headers -o comm= 74319 00:15:17.444 11:26:12 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@956 -- # process_name=reactor_0 00:15:17.445 11:26:12 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@960 -- # '[' reactor_0 = sudo ']' 00:15:17.445 killing process with pid 74319 00:15:17.445 11:26:12 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@968 -- # echo 'killing process with pid 74319' 00:15:17.445 11:26:12 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@969 -- # kill 74319 00:15:17.445 11:26:12 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@974 -- # wait 74319 00:15:17.703 11:26:13 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- nvmf/common.sh@518 -- # '[' '' == iso ']' 00:15:17.703 11:26:13 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- nvmf/common.sh@521 -- # [[ tcp == \t\c\p ]] 00:15:17.703 11:26:13 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- nvmf/common.sh@522 -- # nvmf_tcp_fini 00:15:17.703 11:26:13 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- nvmf/common.sh@297 -- # iptr 00:15:17.703 11:26:13 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- nvmf/common.sh@789 -- # iptables-save 00:15:17.703 11:26:13 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- nvmf/common.sh@789 -- # grep -v SPDK_NVMF 00:15:17.703 11:26:13 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- nvmf/common.sh@789 -- # iptables-restore 00:15:17.703 11:26:13 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- nvmf/common.sh@298 -- # [[ nvmf_tgt_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s\_\s\p\d\k ]] 00:15:17.703 11:26:13 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- nvmf/common.sh@299 -- # nvmf_veth_fini 00:15:17.703 11:26:13 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- nvmf/common.sh@233 -- # ip link set nvmf_init_br nomaster 00:15:17.703 11:26:13 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- nvmf/common.sh@234 -- # ip link set nvmf_init_br2 nomaster 00:15:17.703 11:26:13 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- nvmf/common.sh@235 -- # ip link set nvmf_tgt_br nomaster 00:15:17.703 11:26:13 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- nvmf/common.sh@236 -- # ip link set nvmf_tgt_br2 nomaster 00:15:17.703 11:26:13 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- nvmf/common.sh@237 -- # ip link set nvmf_init_br down 00:15:17.703 11:26:13 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- nvmf/common.sh@238 -- # ip link set nvmf_init_br2 down 00:15:17.703 11:26:13 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- nvmf/common.sh@239 -- # ip link set nvmf_tgt_br down 00:15:17.703 11:26:13 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- nvmf/common.sh@240 -- # ip link set nvmf_tgt_br2 down 00:15:17.703 11:26:13 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- nvmf/common.sh@241 -- # ip link delete nvmf_br type bridge 00:15:17.961 11:26:13 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- nvmf/common.sh@242 -- # ip link delete nvmf_init_if 00:15:17.961 11:26:13 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- nvmf/common.sh@243 -- # ip link delete nvmf_init_if2 00:15:17.961 11:26:13 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- nvmf/common.sh@244 -- # ip netns exec nvmf_tgt_ns_spdk ip link delete nvmf_tgt_if 00:15:17.961 11:26:13 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- nvmf/common.sh@245 -- # ip netns exec nvmf_tgt_ns_spdk ip link delete nvmf_tgt_if2 00:15:17.961 11:26:13 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- nvmf/common.sh@246 -- # remove_spdk_ns 00:15:17.961 11:26:13 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- nvmf/common.sh@654 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:15:17.961 11:26:13 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 15> /dev/null' 00:15:17.961 11:26:13 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:15:17.961 11:26:13 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- nvmf/common.sh@300 -- # return 0 00:15:17.961 00:15:17.961 real 0m19.677s 00:15:17.961 user 1m12.771s 00:15:17.961 sys 0m2.801s 00:15:17.961 11:26:13 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@1126 -- # xtrace_disable 00:15:17.961 11:26:13 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@10 -- # set +x 00:15:17.961 ************************************ 00:15:17.961 END TEST nvmf_rpc 00:15:17.961 ************************************ 00:15:17.961 11:26:13 nvmf_tcp.nvmf_target_extra -- nvmf/nvmf_target_extra.sh@23 -- # run_test nvmf_invalid /home/vagrant/spdk_repo/spdk/test/nvmf/target/invalid.sh --transport=tcp 00:15:17.961 11:26:13 nvmf_tcp.nvmf_target_extra -- common/autotest_common.sh@1101 -- # '[' 3 -le 1 ']' 00:15:17.961 11:26:13 nvmf_tcp.nvmf_target_extra -- common/autotest_common.sh@1107 -- # xtrace_disable 00:15:17.961 11:26:13 nvmf_tcp.nvmf_target_extra -- common/autotest_common.sh@10 -- # set +x 00:15:17.961 ************************************ 00:15:17.961 START TEST nvmf_invalid 00:15:17.961 ************************************ 00:15:17.961 11:26:13 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- common/autotest_common.sh@1125 -- # /home/vagrant/spdk_repo/spdk/test/nvmf/target/invalid.sh --transport=tcp 00:15:17.961 * Looking for test storage... 00:15:17.961 * Found test storage at /home/vagrant/spdk_repo/spdk/test/nvmf/target 00:15:17.961 11:26:13 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- common/autotest_common.sh@1680 -- # [[ y == y ]] 00:15:17.961 11:26:13 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- common/autotest_common.sh@1681 -- # lcov --version 00:15:17.961 11:26:13 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- common/autotest_common.sh@1681 -- # awk '{print $NF}' 00:15:18.221 11:26:13 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- common/autotest_common.sh@1681 -- # lt 1.15 2 00:15:18.221 11:26:13 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- scripts/common.sh@373 -- # cmp_versions 1.15 '<' 2 00:15:18.221 11:26:13 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- scripts/common.sh@333 -- # local ver1 ver1_l 00:15:18.221 11:26:13 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- scripts/common.sh@334 -- # local ver2 ver2_l 00:15:18.221 11:26:13 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- scripts/common.sh@336 -- # IFS=.-: 00:15:18.221 11:26:13 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- scripts/common.sh@336 -- # read -ra ver1 00:15:18.221 11:26:13 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- scripts/common.sh@337 -- # IFS=.-: 00:15:18.221 11:26:13 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- scripts/common.sh@337 -- # read -ra ver2 00:15:18.221 11:26:13 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- scripts/common.sh@338 -- # local 'op=<' 00:15:18.221 11:26:13 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- scripts/common.sh@340 -- # ver1_l=2 00:15:18.221 11:26:13 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- scripts/common.sh@341 -- # ver2_l=1 00:15:18.221 11:26:13 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- scripts/common.sh@343 -- # local lt=0 gt=0 eq=0 v 00:15:18.221 11:26:13 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- scripts/common.sh@344 -- # case "$op" in 00:15:18.221 11:26:13 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- scripts/common.sh@345 -- # : 1 00:15:18.221 11:26:13 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- scripts/common.sh@364 -- # (( v = 0 )) 00:15:18.221 11:26:13 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- scripts/common.sh@364 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:15:18.221 11:26:13 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- scripts/common.sh@365 -- # decimal 1 00:15:18.221 11:26:13 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- scripts/common.sh@353 -- # local d=1 00:15:18.221 11:26:13 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- scripts/common.sh@354 -- # [[ 1 =~ ^[0-9]+$ ]] 00:15:18.221 11:26:13 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- scripts/common.sh@355 -- # echo 1 00:15:18.221 11:26:13 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- scripts/common.sh@365 -- # ver1[v]=1 00:15:18.221 11:26:13 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- scripts/common.sh@366 -- # decimal 2 00:15:18.221 11:26:13 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- scripts/common.sh@353 -- # local d=2 00:15:18.221 11:26:13 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- scripts/common.sh@354 -- # [[ 2 =~ ^[0-9]+$ ]] 00:15:18.221 11:26:13 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- scripts/common.sh@355 -- # echo 2 00:15:18.221 11:26:13 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- scripts/common.sh@366 -- # ver2[v]=2 00:15:18.221 11:26:13 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- scripts/common.sh@367 -- # (( ver1[v] > ver2[v] )) 00:15:18.221 11:26:13 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- scripts/common.sh@368 -- # (( ver1[v] < ver2[v] )) 00:15:18.221 11:26:13 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- scripts/common.sh@368 -- # return 0 00:15:18.221 11:26:13 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- common/autotest_common.sh@1682 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:15:18.221 11:26:13 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- common/autotest_common.sh@1694 -- # export 'LCOV_OPTS= 00:15:18.221 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:15:18.221 --rc genhtml_branch_coverage=1 00:15:18.221 --rc genhtml_function_coverage=1 00:15:18.221 --rc genhtml_legend=1 00:15:18.221 --rc geninfo_all_blocks=1 00:15:18.221 --rc geninfo_unexecuted_blocks=1 00:15:18.221 00:15:18.221 ' 00:15:18.221 11:26:13 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- common/autotest_common.sh@1694 -- # LCOV_OPTS=' 00:15:18.221 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:15:18.221 --rc genhtml_branch_coverage=1 00:15:18.221 --rc genhtml_function_coverage=1 00:15:18.221 --rc genhtml_legend=1 00:15:18.221 --rc geninfo_all_blocks=1 00:15:18.221 --rc geninfo_unexecuted_blocks=1 00:15:18.221 00:15:18.221 ' 00:15:18.221 11:26:13 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- common/autotest_common.sh@1695 -- # export 'LCOV=lcov 00:15:18.221 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:15:18.221 --rc genhtml_branch_coverage=1 00:15:18.221 --rc genhtml_function_coverage=1 00:15:18.221 --rc genhtml_legend=1 00:15:18.221 --rc geninfo_all_blocks=1 00:15:18.221 --rc geninfo_unexecuted_blocks=1 00:15:18.221 00:15:18.221 ' 00:15:18.221 11:26:13 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- common/autotest_common.sh@1695 -- # LCOV='lcov 00:15:18.221 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:15:18.221 --rc genhtml_branch_coverage=1 00:15:18.221 --rc genhtml_function_coverage=1 00:15:18.221 --rc genhtml_legend=1 00:15:18.221 --rc geninfo_all_blocks=1 00:15:18.221 --rc geninfo_unexecuted_blocks=1 00:15:18.221 00:15:18.221 ' 00:15:18.221 11:26:13 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@9 -- # source /home/vagrant/spdk_repo/spdk/test/nvmf/common.sh 00:15:18.221 11:26:13 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- nvmf/common.sh@7 -- # uname -s 00:15:18.221 11:26:13 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:15:18.221 11:26:13 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:15:18.221 11:26:13 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:15:18.221 11:26:13 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:15:18.221 11:26:13 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:15:18.221 11:26:13 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:15:18.221 11:26:13 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:15:18.221 11:26:13 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:15:18.221 11:26:13 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:15:18.221 11:26:13 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:15:18.221 11:26:13 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:c758a4ed-f09f-4c82-9afb-3d096f035464 00:15:18.221 11:26:13 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- nvmf/common.sh@18 -- # NVME_HOSTID=c758a4ed-f09f-4c82-9afb-3d096f035464 00:15:18.221 11:26:13 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:15:18.221 11:26:13 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:15:18.221 11:26:13 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- nvmf/common.sh@21 -- # NET_TYPE=virt 00:15:18.221 11:26:13 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:15:18.221 11:26:13 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- nvmf/common.sh@49 -- # source /home/vagrant/spdk_repo/spdk/scripts/common.sh 00:15:18.221 11:26:13 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- scripts/common.sh@15 -- # shopt -s extglob 00:15:18.221 11:26:13 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- scripts/common.sh@544 -- # [[ -e /bin/wpdk_common.sh ]] 00:15:18.221 11:26:13 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- scripts/common.sh@552 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:15:18.221 11:26:13 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- scripts/common.sh@553 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:15:18.221 11:26:13 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:18.221 11:26:13 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:18.221 11:26:13 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:18.221 11:26:13 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- paths/export.sh@5 -- # export PATH 00:15:18.222 11:26:13 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:18.222 11:26:13 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- nvmf/common.sh@51 -- # : 0 00:15:18.222 11:26:13 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- nvmf/common.sh@52 -- # export NVMF_APP_SHM_ID 00:15:18.222 11:26:13 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- nvmf/common.sh@53 -- # build_nvmf_app_args 00:15:18.222 11:26:13 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:15:18.222 11:26:13 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:15:18.222 11:26:13 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:15:18.222 11:26:13 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- nvmf/common.sh@33 -- # '[' '' -eq 1 ']' 00:15:18.222 /home/vagrant/spdk_repo/spdk/test/nvmf/common.sh: line 33: [: : integer expression expected 00:15:18.222 11:26:13 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- nvmf/common.sh@37 -- # '[' -n '' ']' 00:15:18.222 11:26:13 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- nvmf/common.sh@39 -- # '[' 0 -eq 1 ']' 00:15:18.222 11:26:13 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- nvmf/common.sh@55 -- # have_pci_nics=0 00:15:18.222 11:26:13 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@11 -- # multi_target_rpc=/home/vagrant/spdk_repo/spdk/test/nvmf/target/multitarget_rpc.py 00:15:18.222 11:26:13 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@12 -- # rpc=/home/vagrant/spdk_repo/spdk/scripts/rpc.py 00:15:18.222 11:26:13 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@13 -- # nqn=nqn.2016-06.io.spdk:cnode 00:15:18.222 11:26:13 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@14 -- # target=foobar 00:15:18.222 11:26:13 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@16 -- # RANDOM=0 00:15:18.222 11:26:13 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@34 -- # nvmftestinit 00:15:18.222 11:26:13 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- nvmf/common.sh@467 -- # '[' -z tcp ']' 00:15:18.222 11:26:13 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- nvmf/common.sh@472 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:15:18.222 11:26:13 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- nvmf/common.sh@474 -- # prepare_net_devs 00:15:18.222 11:26:13 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- nvmf/common.sh@436 -- # local -g is_hw=no 00:15:18.222 11:26:13 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- nvmf/common.sh@438 -- # remove_spdk_ns 00:15:18.222 11:26:13 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- nvmf/common.sh@654 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:15:18.222 11:26:13 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 15> /dev/null' 00:15:18.222 11:26:13 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:15:18.222 11:26:13 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- nvmf/common.sh@440 -- # [[ virt != virt ]] 00:15:18.222 11:26:13 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- nvmf/common.sh@442 -- # [[ no == yes ]] 00:15:18.222 11:26:13 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- nvmf/common.sh@449 -- # [[ virt == phy ]] 00:15:18.222 11:26:13 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- nvmf/common.sh@452 -- # [[ virt == phy-fallback ]] 00:15:18.222 11:26:13 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- nvmf/common.sh@457 -- # [[ tcp == tcp ]] 00:15:18.222 11:26:13 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- nvmf/common.sh@458 -- # nvmf_veth_init 00:15:18.222 11:26:13 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- nvmf/common.sh@145 -- # NVMF_FIRST_INITIATOR_IP=10.0.0.1 00:15:18.222 11:26:13 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- nvmf/common.sh@146 -- # NVMF_SECOND_INITIATOR_IP=10.0.0.2 00:15:18.222 11:26:13 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- nvmf/common.sh@147 -- # NVMF_FIRST_TARGET_IP=10.0.0.3 00:15:18.222 11:26:13 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- nvmf/common.sh@148 -- # NVMF_SECOND_TARGET_IP=10.0.0.4 00:15:18.222 11:26:13 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- nvmf/common.sh@149 -- # NVMF_INITIATOR_IP=10.0.0.1 00:15:18.222 11:26:13 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- nvmf/common.sh@150 -- # NVMF_BRIDGE=nvmf_br 00:15:18.222 11:26:13 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- nvmf/common.sh@151 -- # NVMF_INITIATOR_INTERFACE=nvmf_init_if 00:15:18.222 11:26:13 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- nvmf/common.sh@152 -- # NVMF_INITIATOR_INTERFACE2=nvmf_init_if2 00:15:18.222 11:26:13 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- nvmf/common.sh@153 -- # NVMF_INITIATOR_BRIDGE=nvmf_init_br 00:15:18.222 11:26:13 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- nvmf/common.sh@154 -- # NVMF_INITIATOR_BRIDGE2=nvmf_init_br2 00:15:18.222 11:26:13 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- nvmf/common.sh@155 -- # NVMF_TARGET_NAMESPACE=nvmf_tgt_ns_spdk 00:15:18.222 11:26:13 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- nvmf/common.sh@156 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:15:18.222 11:26:13 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- nvmf/common.sh@157 -- # NVMF_TARGET_INTERFACE=nvmf_tgt_if 00:15:18.222 11:26:13 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- nvmf/common.sh@158 -- # NVMF_TARGET_INTERFACE2=nvmf_tgt_if2 00:15:18.222 11:26:13 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- nvmf/common.sh@159 -- # NVMF_TARGET_BRIDGE=nvmf_tgt_br 00:15:18.222 11:26:13 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- nvmf/common.sh@160 -- # NVMF_TARGET_BRIDGE2=nvmf_tgt_br2 00:15:18.222 11:26:13 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- nvmf/common.sh@162 -- # ip link set nvmf_init_br nomaster 00:15:18.222 Cannot find device "nvmf_init_br" 00:15:18.222 11:26:13 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- nvmf/common.sh@162 -- # true 00:15:18.222 11:26:13 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- nvmf/common.sh@163 -- # ip link set nvmf_init_br2 nomaster 00:15:18.222 Cannot find device "nvmf_init_br2" 00:15:18.222 11:26:13 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- nvmf/common.sh@163 -- # true 00:15:18.222 11:26:13 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- nvmf/common.sh@164 -- # ip link set nvmf_tgt_br nomaster 00:15:18.222 Cannot find device "nvmf_tgt_br" 00:15:18.222 11:26:13 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- nvmf/common.sh@164 -- # true 00:15:18.222 11:26:13 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- nvmf/common.sh@165 -- # ip link set nvmf_tgt_br2 nomaster 00:15:18.222 Cannot find device "nvmf_tgt_br2" 00:15:18.222 11:26:13 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- nvmf/common.sh@165 -- # true 00:15:18.222 11:26:13 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- nvmf/common.sh@166 -- # ip link set nvmf_init_br down 00:15:18.222 Cannot find device "nvmf_init_br" 00:15:18.222 11:26:13 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- nvmf/common.sh@166 -- # true 00:15:18.222 11:26:13 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- nvmf/common.sh@167 -- # ip link set nvmf_init_br2 down 00:15:18.222 Cannot find device "nvmf_init_br2" 00:15:18.222 11:26:13 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- nvmf/common.sh@167 -- # true 00:15:18.222 11:26:13 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- nvmf/common.sh@168 -- # ip link set nvmf_tgt_br down 00:15:18.222 Cannot find device "nvmf_tgt_br" 00:15:18.222 11:26:13 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- nvmf/common.sh@168 -- # true 00:15:18.222 11:26:13 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- nvmf/common.sh@169 -- # ip link set nvmf_tgt_br2 down 00:15:18.222 Cannot find device "nvmf_tgt_br2" 00:15:18.222 11:26:13 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- nvmf/common.sh@169 -- # true 00:15:18.222 11:26:13 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- nvmf/common.sh@170 -- # ip link delete nvmf_br type bridge 00:15:18.222 Cannot find device "nvmf_br" 00:15:18.222 11:26:13 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- nvmf/common.sh@170 -- # true 00:15:18.222 11:26:13 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- nvmf/common.sh@171 -- # ip link delete nvmf_init_if 00:15:18.222 Cannot find device "nvmf_init_if" 00:15:18.222 11:26:13 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- nvmf/common.sh@171 -- # true 00:15:18.222 11:26:13 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- nvmf/common.sh@172 -- # ip link delete nvmf_init_if2 00:15:18.222 Cannot find device "nvmf_init_if2" 00:15:18.222 11:26:13 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- nvmf/common.sh@172 -- # true 00:15:18.222 11:26:13 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- nvmf/common.sh@173 -- # ip netns exec nvmf_tgt_ns_spdk ip link delete nvmf_tgt_if 00:15:18.222 Cannot open network namespace "nvmf_tgt_ns_spdk": No such file or directory 00:15:18.222 11:26:13 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- nvmf/common.sh@173 -- # true 00:15:18.222 11:26:13 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- nvmf/common.sh@174 -- # ip netns exec nvmf_tgt_ns_spdk ip link delete nvmf_tgt_if2 00:15:18.222 Cannot open network namespace "nvmf_tgt_ns_spdk": No such file or directory 00:15:18.222 11:26:13 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- nvmf/common.sh@174 -- # true 00:15:18.222 11:26:13 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- nvmf/common.sh@177 -- # ip netns add nvmf_tgt_ns_spdk 00:15:18.222 11:26:13 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- nvmf/common.sh@180 -- # ip link add nvmf_init_if type veth peer name nvmf_init_br 00:15:18.222 11:26:13 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- nvmf/common.sh@181 -- # ip link add nvmf_init_if2 type veth peer name nvmf_init_br2 00:15:18.222 11:26:13 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- nvmf/common.sh@182 -- # ip link add nvmf_tgt_if type veth peer name nvmf_tgt_br 00:15:18.490 11:26:13 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- nvmf/common.sh@183 -- # ip link add nvmf_tgt_if2 type veth peer name nvmf_tgt_br2 00:15:18.490 11:26:13 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- nvmf/common.sh@186 -- # ip link set nvmf_tgt_if netns nvmf_tgt_ns_spdk 00:15:18.490 11:26:13 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- nvmf/common.sh@187 -- # ip link set nvmf_tgt_if2 netns nvmf_tgt_ns_spdk 00:15:18.490 11:26:13 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- nvmf/common.sh@190 -- # ip addr add 10.0.0.1/24 dev nvmf_init_if 00:15:18.490 11:26:13 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- nvmf/common.sh@191 -- # ip addr add 10.0.0.2/24 dev nvmf_init_if2 00:15:18.490 11:26:13 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- nvmf/common.sh@192 -- # ip netns exec nvmf_tgt_ns_spdk ip addr add 10.0.0.3/24 dev nvmf_tgt_if 00:15:18.490 11:26:13 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- nvmf/common.sh@193 -- # ip netns exec nvmf_tgt_ns_spdk ip addr add 10.0.0.4/24 dev nvmf_tgt_if2 00:15:18.490 11:26:13 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- nvmf/common.sh@196 -- # ip link set nvmf_init_if up 00:15:18.490 11:26:13 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- nvmf/common.sh@197 -- # ip link set nvmf_init_if2 up 00:15:18.490 11:26:13 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- nvmf/common.sh@198 -- # ip link set nvmf_init_br up 00:15:18.490 11:26:13 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- nvmf/common.sh@199 -- # ip link set nvmf_init_br2 up 00:15:18.490 11:26:13 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- nvmf/common.sh@200 -- # ip link set nvmf_tgt_br up 00:15:18.490 11:26:13 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- nvmf/common.sh@201 -- # ip link set nvmf_tgt_br2 up 00:15:18.490 11:26:13 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- nvmf/common.sh@202 -- # ip netns exec nvmf_tgt_ns_spdk ip link set nvmf_tgt_if up 00:15:18.490 11:26:13 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- nvmf/common.sh@203 -- # ip netns exec nvmf_tgt_ns_spdk ip link set nvmf_tgt_if2 up 00:15:18.490 11:26:13 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- nvmf/common.sh@204 -- # ip netns exec nvmf_tgt_ns_spdk ip link set lo up 00:15:18.490 11:26:13 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- nvmf/common.sh@207 -- # ip link add nvmf_br type bridge 00:15:18.490 11:26:13 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- nvmf/common.sh@208 -- # ip link set nvmf_br up 00:15:18.490 11:26:13 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- nvmf/common.sh@211 -- # ip link set nvmf_init_br master nvmf_br 00:15:18.490 11:26:13 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- nvmf/common.sh@212 -- # ip link set nvmf_init_br2 master nvmf_br 00:15:18.490 11:26:13 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- nvmf/common.sh@213 -- # ip link set nvmf_tgt_br master nvmf_br 00:15:18.490 11:26:13 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- nvmf/common.sh@214 -- # ip link set nvmf_tgt_br2 master nvmf_br 00:15:18.490 11:26:13 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- nvmf/common.sh@217 -- # ipts -I INPUT 1 -i nvmf_init_if -p tcp --dport 4420 -j ACCEPT 00:15:18.490 11:26:13 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- nvmf/common.sh@788 -- # iptables -I INPUT 1 -i nvmf_init_if -p tcp --dport 4420 -j ACCEPT -m comment --comment 'SPDK_NVMF:-I INPUT 1 -i nvmf_init_if -p tcp --dport 4420 -j ACCEPT' 00:15:18.490 11:26:13 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- nvmf/common.sh@218 -- # ipts -I INPUT 1 -i nvmf_init_if2 -p tcp --dport 4420 -j ACCEPT 00:15:18.490 11:26:13 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- nvmf/common.sh@788 -- # iptables -I INPUT 1 -i nvmf_init_if2 -p tcp --dport 4420 -j ACCEPT -m comment --comment 'SPDK_NVMF:-I INPUT 1 -i nvmf_init_if2 -p tcp --dport 4420 -j ACCEPT' 00:15:18.490 11:26:13 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- nvmf/common.sh@219 -- # ipts -A FORWARD -i nvmf_br -o nvmf_br -j ACCEPT 00:15:18.490 11:26:13 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- nvmf/common.sh@788 -- # iptables -A FORWARD -i nvmf_br -o nvmf_br -j ACCEPT -m comment --comment 'SPDK_NVMF:-A FORWARD -i nvmf_br -o nvmf_br -j ACCEPT' 00:15:18.490 11:26:13 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- nvmf/common.sh@222 -- # ping -c 1 10.0.0.3 00:15:18.490 PING 10.0.0.3 (10.0.0.3) 56(84) bytes of data. 00:15:18.490 64 bytes from 10.0.0.3: icmp_seq=1 ttl=64 time=0.056 ms 00:15:18.490 00:15:18.490 --- 10.0.0.3 ping statistics --- 00:15:18.490 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:15:18.490 rtt min/avg/max/mdev = 0.056/0.056/0.056/0.000 ms 00:15:18.490 11:26:13 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- nvmf/common.sh@223 -- # ping -c 1 10.0.0.4 00:15:18.490 PING 10.0.0.4 (10.0.0.4) 56(84) bytes of data. 00:15:18.490 64 bytes from 10.0.0.4: icmp_seq=1 ttl=64 time=0.065 ms 00:15:18.490 00:15:18.490 --- 10.0.0.4 ping statistics --- 00:15:18.490 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:15:18.490 rtt min/avg/max/mdev = 0.065/0.065/0.065/0.000 ms 00:15:18.490 11:26:13 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- nvmf/common.sh@224 -- # ip netns exec nvmf_tgt_ns_spdk ping -c 1 10.0.0.1 00:15:18.490 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:15:18.490 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.019 ms 00:15:18.490 00:15:18.490 --- 10.0.0.1 ping statistics --- 00:15:18.490 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:15:18.490 rtt min/avg/max/mdev = 0.019/0.019/0.019/0.000 ms 00:15:18.490 11:26:13 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- nvmf/common.sh@225 -- # ip netns exec nvmf_tgt_ns_spdk ping -c 1 10.0.0.2 00:15:18.490 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:15:18.490 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.037 ms 00:15:18.490 00:15:18.490 --- 10.0.0.2 ping statistics --- 00:15:18.490 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:15:18.491 rtt min/avg/max/mdev = 0.037/0.037/0.037/0.000 ms 00:15:18.491 11:26:13 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- nvmf/common.sh@227 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:15:18.491 11:26:13 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- nvmf/common.sh@459 -- # return 0 00:15:18.491 11:26:13 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- nvmf/common.sh@476 -- # '[' '' == iso ']' 00:15:18.491 11:26:13 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- nvmf/common.sh@480 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:15:18.491 11:26:13 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- nvmf/common.sh@481 -- # [[ tcp == \r\d\m\a ]] 00:15:18.491 11:26:13 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- nvmf/common.sh@490 -- # [[ tcp == \t\c\p ]] 00:15:18.491 11:26:13 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- nvmf/common.sh@491 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:15:18.491 11:26:13 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- nvmf/common.sh@494 -- # '[' tcp == tcp ']' 00:15:18.491 11:26:13 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- nvmf/common.sh@500 -- # modprobe nvme-tcp 00:15:18.491 11:26:13 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@35 -- # nvmfappstart -m 0xF 00:15:18.491 11:26:13 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- nvmf/common.sh@505 -- # timing_enter start_nvmf_tgt 00:15:18.491 11:26:13 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- common/autotest_common.sh@724 -- # xtrace_disable 00:15:18.491 11:26:13 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- common/autotest_common.sh@10 -- # set +x 00:15:18.491 11:26:13 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- nvmf/common.sh@507 -- # nvmfpid=74890 00:15:18.491 11:26:13 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- nvmf/common.sh@506 -- # ip netns exec nvmf_tgt_ns_spdk /home/vagrant/spdk_repo/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:15:18.491 11:26:13 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- nvmf/common.sh@508 -- # waitforlisten 74890 00:15:18.491 11:26:13 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- common/autotest_common.sh@831 -- # '[' -z 74890 ']' 00:15:18.491 11:26:13 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- common/autotest_common.sh@835 -- # local rpc_addr=/var/tmp/spdk.sock 00:15:18.491 11:26:13 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- common/autotest_common.sh@836 -- # local max_retries=100 00:15:18.491 11:26:13 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- common/autotest_common.sh@838 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:15:18.491 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:15:18.491 11:26:13 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- common/autotest_common.sh@840 -- # xtrace_disable 00:15:18.491 11:26:13 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- common/autotest_common.sh@10 -- # set +x 00:15:18.774 [2024-10-07 11:26:14.038906] Starting SPDK v25.01-pre git sha1 2a4f56c54 / DPDK 24.03.0 initialization... 00:15:18.774 [2024-10-07 11:26:14.039012] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --iova-mode=pa --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:15:18.774 [2024-10-07 11:26:14.179265] app.c: 917:spdk_app_start: *NOTICE*: Total cores available: 4 00:15:19.033 [2024-10-07 11:26:14.308941] app.c: 610:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:15:19.033 [2024-10-07 11:26:14.309042] app.c: 611:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:15:19.033 [2024-10-07 11:26:14.309069] app.c: 616:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:15:19.033 [2024-10-07 11:26:14.309086] app.c: 617:app_setup_trace: *NOTICE*: SPDK application currently running. 00:15:19.033 [2024-10-07 11:26:14.309101] app.c: 618:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:15:19.033 [2024-10-07 11:26:14.310454] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 1 00:15:19.033 [2024-10-07 11:26:14.310539] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 2 00:15:19.033 [2024-10-07 11:26:14.310618] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 0 00:15:19.033 [2024-10-07 11:26:14.310618] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 3 00:15:19.598 11:26:15 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- common/autotest_common.sh@860 -- # (( i == 0 )) 00:15:19.598 11:26:15 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- common/autotest_common.sh@864 -- # return 0 00:15:19.598 11:26:15 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- nvmf/common.sh@509 -- # timing_exit start_nvmf_tgt 00:15:19.598 11:26:15 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- common/autotest_common.sh@730 -- # xtrace_disable 00:15:19.598 11:26:15 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- common/autotest_common.sh@10 -- # set +x 00:15:19.598 11:26:15 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- nvmf/common.sh@510 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:15:19.598 11:26:15 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@37 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; nvmftestfini $1; exit 1' SIGINT SIGTERM EXIT 00:15:19.598 11:26:15 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@40 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_create_subsystem -t foobar nqn.2016-06.io.spdk:cnode22173 00:15:20.163 [2024-10-07 11:26:15.392536] nvmf_rpc.c: 396:rpc_nvmf_create_subsystem: *ERROR*: Unable to find target foobar 00:15:20.163 11:26:15 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@40 -- # out='2024/10/07 11:26:15 error on JSON-RPC call, method: nvmf_create_subsystem, params: map[nqn:nqn.2016-06.io.spdk:cnode22173 tgt_name:foobar], err: error received for nvmf_create_subsystem method, err: Code=-32603 Msg=Unable to find target foobar 00:15:20.163 request: 00:15:20.163 { 00:15:20.163 "method": "nvmf_create_subsystem", 00:15:20.163 "params": { 00:15:20.163 "nqn": "nqn.2016-06.io.spdk:cnode22173", 00:15:20.163 "tgt_name": "foobar" 00:15:20.163 } 00:15:20.163 } 00:15:20.163 Got JSON-RPC error response 00:15:20.163 GoRPCClient: error on JSON-RPC call' 00:15:20.163 11:26:15 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@41 -- # [[ 2024/10/07 11:26:15 error on JSON-RPC call, method: nvmf_create_subsystem, params: map[nqn:nqn.2016-06.io.spdk:cnode22173 tgt_name:foobar], err: error received for nvmf_create_subsystem method, err: Code=-32603 Msg=Unable to find target foobar 00:15:20.163 request: 00:15:20.163 { 00:15:20.163 "method": "nvmf_create_subsystem", 00:15:20.163 "params": { 00:15:20.163 "nqn": "nqn.2016-06.io.spdk:cnode22173", 00:15:20.163 "tgt_name": "foobar" 00:15:20.163 } 00:15:20.163 } 00:15:20.163 Got JSON-RPC error response 00:15:20.163 GoRPCClient: error on JSON-RPC call == *\U\n\a\b\l\e\ \t\o\ \f\i\n\d\ \t\a\r\g\e\t* ]] 00:15:20.163 11:26:15 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@45 -- # echo -e '\x1f' 00:15:20.163 11:26:15 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@45 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_create_subsystem -s $'SPDKISFASTANDAWESOME\037' nqn.2016-06.io.spdk:cnode24130 00:15:20.163 [2024-10-07 11:26:15.660777] nvmf_rpc.c: 413:rpc_nvmf_create_subsystem: *ERROR*: Subsystem nqn.2016-06.io.spdk:cnode24130: invalid serial number 'SPDKISFASTANDAWESOME' 00:15:20.163 11:26:15 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@45 -- # out='2024/10/07 11:26:15 error on JSON-RPC call, method: nvmf_create_subsystem, params: map[nqn:nqn.2016-06.io.spdk:cnode24130 serial_number:SPDKISFASTANDAWESOME], err: error received for nvmf_create_subsystem method, err: Code=-32602 Msg=Invalid SN SPDKISFASTANDAWESOME 00:15:20.163 request: 00:15:20.163 { 00:15:20.163 "method": "nvmf_create_subsystem", 00:15:20.163 "params": { 00:15:20.163 "nqn": "nqn.2016-06.io.spdk:cnode24130", 00:15:20.163 "serial_number": "SPDKISFASTANDAWESOME\u001f" 00:15:20.163 } 00:15:20.163 } 00:15:20.163 Got JSON-RPC error response 00:15:20.163 GoRPCClient: error on JSON-RPC call' 00:15:20.163 11:26:15 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@46 -- # [[ 2024/10/07 11:26:15 error on JSON-RPC call, method: nvmf_create_subsystem, params: map[nqn:nqn.2016-06.io.spdk:cnode24130 serial_number:SPDKISFASTANDAWESOME], err: error received for nvmf_create_subsystem method, err: Code=-32602 Msg=Invalid SN SPDKISFASTANDAWESOME 00:15:20.163 request: 00:15:20.163 { 00:15:20.163 "method": "nvmf_create_subsystem", 00:15:20.163 "params": { 00:15:20.163 "nqn": "nqn.2016-06.io.spdk:cnode24130", 00:15:20.163 "serial_number": "SPDKISFASTANDAWESOME\u001f" 00:15:20.163 } 00:15:20.163 } 00:15:20.163 Got JSON-RPC error response 00:15:20.163 GoRPCClient: error on JSON-RPC call == *\I\n\v\a\l\i\d\ \S\N* ]] 00:15:20.421 11:26:15 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@50 -- # echo -e '\x1f' 00:15:20.421 11:26:15 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@50 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_create_subsystem -d $'SPDK_Controller\037' nqn.2016-06.io.spdk:cnode16384 00:15:20.680 [2024-10-07 11:26:16.065134] nvmf_rpc.c: 422:rpc_nvmf_create_subsystem: *ERROR*: Subsystem nqn.2016-06.io.spdk:cnode16384: invalid model number 'SPDK_Controller' 00:15:20.680 11:26:16 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@50 -- # out='2024/10/07 11:26:16 error on JSON-RPC call, method: nvmf_create_subsystem, params: map[model_number:SPDK_Controller nqn:nqn.2016-06.io.spdk:cnode16384], err: error received for nvmf_create_subsystem method, err: Code=-32602 Msg=Invalid MN SPDK_Controller 00:15:20.680 request: 00:15:20.680 { 00:15:20.680 "method": "nvmf_create_subsystem", 00:15:20.680 "params": { 00:15:20.680 "nqn": "nqn.2016-06.io.spdk:cnode16384", 00:15:20.680 "model_number": "SPDK_Controller\u001f" 00:15:20.680 } 00:15:20.680 } 00:15:20.680 Got JSON-RPC error response 00:15:20.680 GoRPCClient: error on JSON-RPC call' 00:15:20.680 11:26:16 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@51 -- # [[ 2024/10/07 11:26:16 error on JSON-RPC call, method: nvmf_create_subsystem, params: map[model_number:SPDK_Controller nqn:nqn.2016-06.io.spdk:cnode16384], err: error received for nvmf_create_subsystem method, err: Code=-32602 Msg=Invalid MN SPDK_Controller 00:15:20.680 request: 00:15:20.680 { 00:15:20.680 "method": "nvmf_create_subsystem", 00:15:20.680 "params": { 00:15:20.680 "nqn": "nqn.2016-06.io.spdk:cnode16384", 00:15:20.680 "model_number": "SPDK_Controller\u001f" 00:15:20.680 } 00:15:20.680 } 00:15:20.680 Got JSON-RPC error response 00:15:20.680 GoRPCClient: error on JSON-RPC call == *\I\n\v\a\l\i\d\ \M\N* ]] 00:15:20.680 11:26:16 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@54 -- # gen_random_s 21 00:15:20.680 11:26:16 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@19 -- # local length=21 ll 00:15:20.680 11:26:16 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@21 -- # chars=('32' '33' '34' '35' '36' '37' '38' '39' '40' '41' '42' '43' '44' '45' '46' '47' '48' '49' '50' '51' '52' '53' '54' '55' '56' '57' '58' '59' '60' '61' '62' '63' '64' '65' '66' '67' '68' '69' '70' '71' '72' '73' '74' '75' '76' '77' '78' '79' '80' '81' '82' '83' '84' '85' '86' '87' '88' '89' '90' '91' '92' '93' '94' '95' '96' '97' '98' '99' '100' '101' '102' '103' '104' '105' '106' '107' '108' '109' '110' '111' '112' '113' '114' '115' '116' '117' '118' '119' '120' '121' '122' '123' '124' '125' '126' '127') 00:15:20.680 11:26:16 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@21 -- # local chars 00:15:20.680 11:26:16 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@22 -- # local string 00:15:20.680 11:26:16 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@24 -- # (( ll = 0 )) 00:15:20.680 11:26:16 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@24 -- # (( ll < length )) 00:15:20.680 11:26:16 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@25 -- # printf %x 124 00:15:20.680 11:26:16 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@25 -- # echo -e '\x7c' 00:15:20.680 11:26:16 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@25 -- # string+='|' 00:15:20.680 11:26:16 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@24 -- # (( ll++ )) 00:15:20.680 11:26:16 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@24 -- # (( ll < length )) 00:15:20.680 11:26:16 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@25 -- # printf %x 44 00:15:20.680 11:26:16 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@25 -- # echo -e '\x2c' 00:15:20.680 11:26:16 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@25 -- # string+=, 00:15:20.680 11:26:16 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@24 -- # (( ll++ )) 00:15:20.680 11:26:16 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@24 -- # (( ll < length )) 00:15:20.680 11:26:16 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@25 -- # printf %x 89 00:15:20.680 11:26:16 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@25 -- # echo -e '\x59' 00:15:20.680 11:26:16 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@25 -- # string+=Y 00:15:20.680 11:26:16 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@24 -- # (( ll++ )) 00:15:20.680 11:26:16 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@24 -- # (( ll < length )) 00:15:20.680 11:26:16 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@25 -- # printf %x 36 00:15:20.680 11:26:16 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@25 -- # echo -e '\x24' 00:15:20.680 11:26:16 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@25 -- # string+='$' 00:15:20.680 11:26:16 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@24 -- # (( ll++ )) 00:15:20.680 11:26:16 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@24 -- # (( ll < length )) 00:15:20.680 11:26:16 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@25 -- # printf %x 45 00:15:20.680 11:26:16 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@25 -- # echo -e '\x2d' 00:15:20.680 11:26:16 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@25 -- # string+=- 00:15:20.680 11:26:16 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@24 -- # (( ll++ )) 00:15:20.680 11:26:16 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@24 -- # (( ll < length )) 00:15:20.680 11:26:16 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@25 -- # printf %x 38 00:15:20.680 11:26:16 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@25 -- # echo -e '\x26' 00:15:20.680 11:26:16 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@25 -- # string+='&' 00:15:20.680 11:26:16 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@24 -- # (( ll++ )) 00:15:20.680 11:26:16 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@24 -- # (( ll < length )) 00:15:20.680 11:26:16 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@25 -- # printf %x 41 00:15:20.680 11:26:16 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@25 -- # echo -e '\x29' 00:15:20.680 11:26:16 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@25 -- # string+=')' 00:15:20.680 11:26:16 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@24 -- # (( ll++ )) 00:15:20.680 11:26:16 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@24 -- # (( ll < length )) 00:15:20.680 11:26:16 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@25 -- # printf %x 44 00:15:20.680 11:26:16 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@25 -- # echo -e '\x2c' 00:15:20.680 11:26:16 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@25 -- # string+=, 00:15:20.680 11:26:16 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@24 -- # (( ll++ )) 00:15:20.680 11:26:16 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@24 -- # (( ll < length )) 00:15:20.680 11:26:16 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@25 -- # printf %x 110 00:15:20.680 11:26:16 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@25 -- # echo -e '\x6e' 00:15:20.680 11:26:16 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@25 -- # string+=n 00:15:20.680 11:26:16 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@24 -- # (( ll++ )) 00:15:20.680 11:26:16 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@24 -- # (( ll < length )) 00:15:20.680 11:26:16 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@25 -- # printf %x 98 00:15:20.680 11:26:16 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@25 -- # echo -e '\x62' 00:15:20.680 11:26:16 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@25 -- # string+=b 00:15:20.680 11:26:16 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@24 -- # (( ll++ )) 00:15:20.680 11:26:16 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@24 -- # (( ll < length )) 00:15:20.680 11:26:16 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@25 -- # printf %x 108 00:15:20.680 11:26:16 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@25 -- # echo -e '\x6c' 00:15:20.680 11:26:16 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@25 -- # string+=l 00:15:20.680 11:26:16 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@24 -- # (( ll++ )) 00:15:20.680 11:26:16 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@24 -- # (( ll < length )) 00:15:20.680 11:26:16 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@25 -- # printf %x 52 00:15:20.680 11:26:16 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@25 -- # echo -e '\x34' 00:15:20.680 11:26:16 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@25 -- # string+=4 00:15:20.680 11:26:16 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@24 -- # (( ll++ )) 00:15:20.680 11:26:16 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@24 -- # (( ll < length )) 00:15:20.680 11:26:16 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@25 -- # printf %x 93 00:15:20.680 11:26:16 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@25 -- # echo -e '\x5d' 00:15:20.680 11:26:16 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@25 -- # string+=']' 00:15:20.680 11:26:16 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@24 -- # (( ll++ )) 00:15:20.680 11:26:16 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@24 -- # (( ll < length )) 00:15:20.680 11:26:16 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@25 -- # printf %x 85 00:15:20.680 11:26:16 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@25 -- # echo -e '\x55' 00:15:20.681 11:26:16 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@25 -- # string+=U 00:15:20.681 11:26:16 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@24 -- # (( ll++ )) 00:15:20.681 11:26:16 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@24 -- # (( ll < length )) 00:15:20.681 11:26:16 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@25 -- # printf %x 105 00:15:20.681 11:26:16 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@25 -- # echo -e '\x69' 00:15:20.681 11:26:16 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@25 -- # string+=i 00:15:20.681 11:26:16 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@24 -- # (( ll++ )) 00:15:20.681 11:26:16 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@24 -- # (( ll < length )) 00:15:20.681 11:26:16 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@25 -- # printf %x 79 00:15:20.681 11:26:16 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@25 -- # echo -e '\x4f' 00:15:20.681 11:26:16 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@25 -- # string+=O 00:15:20.681 11:26:16 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@24 -- # (( ll++ )) 00:15:20.681 11:26:16 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@24 -- # (( ll < length )) 00:15:20.681 11:26:16 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@25 -- # printf %x 56 00:15:20.681 11:26:16 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@25 -- # echo -e '\x38' 00:15:20.681 11:26:16 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@25 -- # string+=8 00:15:20.681 11:26:16 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@24 -- # (( ll++ )) 00:15:20.681 11:26:16 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@24 -- # (( ll < length )) 00:15:20.681 11:26:16 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@25 -- # printf %x 126 00:15:20.681 11:26:16 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@25 -- # echo -e '\x7e' 00:15:20.681 11:26:16 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@25 -- # string+='~' 00:15:20.681 11:26:16 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@24 -- # (( ll++ )) 00:15:20.681 11:26:16 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@24 -- # (( ll < length )) 00:15:20.681 11:26:16 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@25 -- # printf %x 121 00:15:20.681 11:26:16 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@25 -- # echo -e '\x79' 00:15:20.681 11:26:16 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@25 -- # string+=y 00:15:20.681 11:26:16 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@24 -- # (( ll++ )) 00:15:20.681 11:26:16 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@24 -- # (( ll < length )) 00:15:20.681 11:26:16 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@25 -- # printf %x 47 00:15:20.681 11:26:16 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@25 -- # echo -e '\x2f' 00:15:20.681 11:26:16 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@25 -- # string+=/ 00:15:20.681 11:26:16 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@24 -- # (( ll++ )) 00:15:20.681 11:26:16 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@24 -- # (( ll < length )) 00:15:20.681 11:26:16 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@25 -- # printf %x 114 00:15:20.681 11:26:16 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@25 -- # echo -e '\x72' 00:15:20.681 11:26:16 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@25 -- # string+=r 00:15:20.681 11:26:16 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@24 -- # (( ll++ )) 00:15:20.681 11:26:16 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@24 -- # (( ll < length )) 00:15:20.681 11:26:16 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@28 -- # [[ | == \- ]] 00:15:20.681 11:26:16 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@31 -- # echo '|,Y$-&),nbl4]UiO8~y/r' 00:15:20.681 11:26:16 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@54 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_create_subsystem -s '|,Y$-&),nbl4]UiO8~y/r' nqn.2016-06.io.spdk:cnode20722 00:15:21.248 [2024-10-07 11:26:16.517529] nvmf_rpc.c: 413:rpc_nvmf_create_subsystem: *ERROR*: Subsystem nqn.2016-06.io.spdk:cnode20722: invalid serial number '|,Y$-&),nbl4]UiO8~y/r' 00:15:21.248 11:26:16 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@54 -- # out='2024/10/07 11:26:16 error on JSON-RPC call, method: nvmf_create_subsystem, params: map[nqn:nqn.2016-06.io.spdk:cnode20722 serial_number:|,Y$-&),nbl4]UiO8~y/r], err: error received for nvmf_create_subsystem method, err: Code=-32602 Msg=Invalid SN |,Y$-&),nbl4]UiO8~y/r 00:15:21.248 request: 00:15:21.248 { 00:15:21.248 "method": "nvmf_create_subsystem", 00:15:21.248 "params": { 00:15:21.248 "nqn": "nqn.2016-06.io.spdk:cnode20722", 00:15:21.248 "serial_number": "|,Y$-&),nbl4]UiO8~y/r" 00:15:21.248 } 00:15:21.248 } 00:15:21.248 Got JSON-RPC error response 00:15:21.248 GoRPCClient: error on JSON-RPC call' 00:15:21.248 11:26:16 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@55 -- # [[ 2024/10/07 11:26:16 error on JSON-RPC call, method: nvmf_create_subsystem, params: map[nqn:nqn.2016-06.io.spdk:cnode20722 serial_number:|,Y$-&),nbl4]UiO8~y/r], err: error received for nvmf_create_subsystem method, err: Code=-32602 Msg=Invalid SN |,Y$-&),nbl4]UiO8~y/r 00:15:21.248 request: 00:15:21.248 { 00:15:21.248 "method": "nvmf_create_subsystem", 00:15:21.248 "params": { 00:15:21.248 "nqn": "nqn.2016-06.io.spdk:cnode20722", 00:15:21.248 "serial_number": "|,Y$-&),nbl4]UiO8~y/r" 00:15:21.248 } 00:15:21.248 } 00:15:21.248 Got JSON-RPC error response 00:15:21.248 GoRPCClient: error on JSON-RPC call == *\I\n\v\a\l\i\d\ \S\N* ]] 00:15:21.248 11:26:16 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@58 -- # gen_random_s 41 00:15:21.248 11:26:16 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@19 -- # local length=41 ll 00:15:21.248 11:26:16 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@21 -- # chars=('32' '33' '34' '35' '36' '37' '38' '39' '40' '41' '42' '43' '44' '45' '46' '47' '48' '49' '50' '51' '52' '53' '54' '55' '56' '57' '58' '59' '60' '61' '62' '63' '64' '65' '66' '67' '68' '69' '70' '71' '72' '73' '74' '75' '76' '77' '78' '79' '80' '81' '82' '83' '84' '85' '86' '87' '88' '89' '90' '91' '92' '93' '94' '95' '96' '97' '98' '99' '100' '101' '102' '103' '104' '105' '106' '107' '108' '109' '110' '111' '112' '113' '114' '115' '116' '117' '118' '119' '120' '121' '122' '123' '124' '125' '126' '127') 00:15:21.248 11:26:16 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@21 -- # local chars 00:15:21.248 11:26:16 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@22 -- # local string 00:15:21.249 11:26:16 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@24 -- # (( ll = 0 )) 00:15:21.249 11:26:16 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@24 -- # (( ll < length )) 00:15:21.249 11:26:16 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@25 -- # printf %x 65 00:15:21.249 11:26:16 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@25 -- # echo -e '\x41' 00:15:21.249 11:26:16 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@25 -- # string+=A 00:15:21.249 11:26:16 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@24 -- # (( ll++ )) 00:15:21.249 11:26:16 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@24 -- # (( ll < length )) 00:15:21.249 11:26:16 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@25 -- # printf %x 118 00:15:21.249 11:26:16 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@25 -- # echo -e '\x76' 00:15:21.249 11:26:16 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@25 -- # string+=v 00:15:21.249 11:26:16 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@24 -- # (( ll++ )) 00:15:21.249 11:26:16 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@24 -- # (( ll < length )) 00:15:21.249 11:26:16 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@25 -- # printf %x 79 00:15:21.249 11:26:16 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@25 -- # echo -e '\x4f' 00:15:21.249 11:26:16 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@25 -- # string+=O 00:15:21.249 11:26:16 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@24 -- # (( ll++ )) 00:15:21.249 11:26:16 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@24 -- # (( ll < length )) 00:15:21.249 11:26:16 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@25 -- # printf %x 91 00:15:21.249 11:26:16 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@25 -- # echo -e '\x5b' 00:15:21.249 11:26:16 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@25 -- # string+='[' 00:15:21.249 11:26:16 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@24 -- # (( ll++ )) 00:15:21.249 11:26:16 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@24 -- # (( ll < length )) 00:15:21.249 11:26:16 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@25 -- # printf %x 45 00:15:21.249 11:26:16 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@25 -- # echo -e '\x2d' 00:15:21.249 11:26:16 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@25 -- # string+=- 00:15:21.249 11:26:16 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@24 -- # (( ll++ )) 00:15:21.249 11:26:16 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@24 -- # (( ll < length )) 00:15:21.249 11:26:16 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@25 -- # printf %x 63 00:15:21.249 11:26:16 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@25 -- # echo -e '\x3f' 00:15:21.249 11:26:16 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@25 -- # string+='?' 00:15:21.249 11:26:16 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@24 -- # (( ll++ )) 00:15:21.249 11:26:16 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@24 -- # (( ll < length )) 00:15:21.249 11:26:16 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@25 -- # printf %x 45 00:15:21.249 11:26:16 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@25 -- # echo -e '\x2d' 00:15:21.249 11:26:16 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@25 -- # string+=- 00:15:21.249 11:26:16 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@24 -- # (( ll++ )) 00:15:21.249 11:26:16 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@24 -- # (( ll < length )) 00:15:21.249 11:26:16 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@25 -- # printf %x 33 00:15:21.249 11:26:16 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@25 -- # echo -e '\x21' 00:15:21.249 11:26:16 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@25 -- # string+='!' 00:15:21.249 11:26:16 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@24 -- # (( ll++ )) 00:15:21.249 11:26:16 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@24 -- # (( ll < length )) 00:15:21.249 11:26:16 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@25 -- # printf %x 79 00:15:21.249 11:26:16 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@25 -- # echo -e '\x4f' 00:15:21.249 11:26:16 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@25 -- # string+=O 00:15:21.249 11:26:16 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@24 -- # (( ll++ )) 00:15:21.249 11:26:16 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@24 -- # (( ll < length )) 00:15:21.249 11:26:16 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@25 -- # printf %x 76 00:15:21.249 11:26:16 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@25 -- # echo -e '\x4c' 00:15:21.249 11:26:16 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@25 -- # string+=L 00:15:21.249 11:26:16 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@24 -- # (( ll++ )) 00:15:21.249 11:26:16 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@24 -- # (( ll < length )) 00:15:21.249 11:26:16 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@25 -- # printf %x 111 00:15:21.249 11:26:16 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@25 -- # echo -e '\x6f' 00:15:21.249 11:26:16 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@25 -- # string+=o 00:15:21.249 11:26:16 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@24 -- # (( ll++ )) 00:15:21.249 11:26:16 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@24 -- # (( ll < length )) 00:15:21.249 11:26:16 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@25 -- # printf %x 66 00:15:21.249 11:26:16 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@25 -- # echo -e '\x42' 00:15:21.249 11:26:16 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@25 -- # string+=B 00:15:21.249 11:26:16 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@24 -- # (( ll++ )) 00:15:21.249 11:26:16 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@24 -- # (( ll < length )) 00:15:21.249 11:26:16 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@25 -- # printf %x 119 00:15:21.249 11:26:16 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@25 -- # echo -e '\x77' 00:15:21.249 11:26:16 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@25 -- # string+=w 00:15:21.249 11:26:16 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@24 -- # (( ll++ )) 00:15:21.249 11:26:16 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@24 -- # (( ll < length )) 00:15:21.249 11:26:16 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@25 -- # printf %x 71 00:15:21.249 11:26:16 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@25 -- # echo -e '\x47' 00:15:21.249 11:26:16 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@25 -- # string+=G 00:15:21.249 11:26:16 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@24 -- # (( ll++ )) 00:15:21.249 11:26:16 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@24 -- # (( ll < length )) 00:15:21.249 11:26:16 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@25 -- # printf %x 88 00:15:21.249 11:26:16 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@25 -- # echo -e '\x58' 00:15:21.249 11:26:16 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@25 -- # string+=X 00:15:21.249 11:26:16 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@24 -- # (( ll++ )) 00:15:21.249 11:26:16 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@24 -- # (( ll < length )) 00:15:21.249 11:26:16 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@25 -- # printf %x 118 00:15:21.249 11:26:16 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@25 -- # echo -e '\x76' 00:15:21.249 11:26:16 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@25 -- # string+=v 00:15:21.249 11:26:16 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@24 -- # (( ll++ )) 00:15:21.249 11:26:16 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@24 -- # (( ll < length )) 00:15:21.249 11:26:16 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@25 -- # printf %x 91 00:15:21.249 11:26:16 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@25 -- # echo -e '\x5b' 00:15:21.249 11:26:16 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@25 -- # string+='[' 00:15:21.249 11:26:16 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@24 -- # (( ll++ )) 00:15:21.249 11:26:16 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@24 -- # (( ll < length )) 00:15:21.249 11:26:16 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@25 -- # printf %x 96 00:15:21.249 11:26:16 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@25 -- # echo -e '\x60' 00:15:21.249 11:26:16 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@25 -- # string+='`' 00:15:21.249 11:26:16 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@24 -- # (( ll++ )) 00:15:21.250 11:26:16 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@24 -- # (( ll < length )) 00:15:21.250 11:26:16 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@25 -- # printf %x 99 00:15:21.250 11:26:16 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@25 -- # echo -e '\x63' 00:15:21.250 11:26:16 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@25 -- # string+=c 00:15:21.250 11:26:16 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@24 -- # (( ll++ )) 00:15:21.250 11:26:16 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@24 -- # (( ll < length )) 00:15:21.250 11:26:16 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@25 -- # printf %x 85 00:15:21.250 11:26:16 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@25 -- # echo -e '\x55' 00:15:21.250 11:26:16 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@25 -- # string+=U 00:15:21.250 11:26:16 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@24 -- # (( ll++ )) 00:15:21.250 11:26:16 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@24 -- # (( ll < length )) 00:15:21.250 11:26:16 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@25 -- # printf %x 48 00:15:21.250 11:26:16 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@25 -- # echo -e '\x30' 00:15:21.250 11:26:16 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@25 -- # string+=0 00:15:21.250 11:26:16 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@24 -- # (( ll++ )) 00:15:21.250 11:26:16 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@24 -- # (( ll < length )) 00:15:21.250 11:26:16 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@25 -- # printf %x 83 00:15:21.250 11:26:16 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@25 -- # echo -e '\x53' 00:15:21.250 11:26:16 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@25 -- # string+=S 00:15:21.250 11:26:16 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@24 -- # (( ll++ )) 00:15:21.250 11:26:16 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@24 -- # (( ll < length )) 00:15:21.250 11:26:16 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@25 -- # printf %x 90 00:15:21.250 11:26:16 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@25 -- # echo -e '\x5a' 00:15:21.250 11:26:16 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@25 -- # string+=Z 00:15:21.250 11:26:16 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@24 -- # (( ll++ )) 00:15:21.250 11:26:16 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@24 -- # (( ll < length )) 00:15:21.250 11:26:16 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@25 -- # printf %x 62 00:15:21.250 11:26:16 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@25 -- # echo -e '\x3e' 00:15:21.250 11:26:16 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@25 -- # string+='>' 00:15:21.250 11:26:16 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@24 -- # (( ll++ )) 00:15:21.250 11:26:16 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@24 -- # (( ll < length )) 00:15:21.250 11:26:16 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@25 -- # printf %x 116 00:15:21.250 11:26:16 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@25 -- # echo -e '\x74' 00:15:21.250 11:26:16 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@25 -- # string+=t 00:15:21.250 11:26:16 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@24 -- # (( ll++ )) 00:15:21.250 11:26:16 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@24 -- # (( ll < length )) 00:15:21.250 11:26:16 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@25 -- # printf %x 126 00:15:21.250 11:26:16 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@25 -- # echo -e '\x7e' 00:15:21.250 11:26:16 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@25 -- # string+='~' 00:15:21.250 11:26:16 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@24 -- # (( ll++ )) 00:15:21.250 11:26:16 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@24 -- # (( ll < length )) 00:15:21.250 11:26:16 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@25 -- # printf %x 70 00:15:21.250 11:26:16 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@25 -- # echo -e '\x46' 00:15:21.250 11:26:16 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@25 -- # string+=F 00:15:21.250 11:26:16 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@24 -- # (( ll++ )) 00:15:21.250 11:26:16 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@24 -- # (( ll < length )) 00:15:21.250 11:26:16 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@25 -- # printf %x 126 00:15:21.250 11:26:16 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@25 -- # echo -e '\x7e' 00:15:21.250 11:26:16 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@25 -- # string+='~' 00:15:21.250 11:26:16 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@24 -- # (( ll++ )) 00:15:21.250 11:26:16 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@24 -- # (( ll < length )) 00:15:21.250 11:26:16 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@25 -- # printf %x 116 00:15:21.250 11:26:16 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@25 -- # echo -e '\x74' 00:15:21.250 11:26:16 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@25 -- # string+=t 00:15:21.250 11:26:16 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@24 -- # (( ll++ )) 00:15:21.250 11:26:16 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@24 -- # (( ll < length )) 00:15:21.250 11:26:16 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@25 -- # printf %x 74 00:15:21.250 11:26:16 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@25 -- # echo -e '\x4a' 00:15:21.250 11:26:16 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@25 -- # string+=J 00:15:21.250 11:26:16 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@24 -- # (( ll++ )) 00:15:21.250 11:26:16 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@24 -- # (( ll < length )) 00:15:21.250 11:26:16 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@25 -- # printf %x 45 00:15:21.250 11:26:16 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@25 -- # echo -e '\x2d' 00:15:21.250 11:26:16 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@25 -- # string+=- 00:15:21.250 11:26:16 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@24 -- # (( ll++ )) 00:15:21.250 11:26:16 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@24 -- # (( ll < length )) 00:15:21.250 11:26:16 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@25 -- # printf %x 39 00:15:21.250 11:26:16 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@25 -- # echo -e '\x27' 00:15:21.250 11:26:16 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@25 -- # string+=\' 00:15:21.250 11:26:16 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@24 -- # (( ll++ )) 00:15:21.250 11:26:16 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@24 -- # (( ll < length )) 00:15:21.250 11:26:16 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@25 -- # printf %x 97 00:15:21.250 11:26:16 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@25 -- # echo -e '\x61' 00:15:21.250 11:26:16 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@25 -- # string+=a 00:15:21.250 11:26:16 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@24 -- # (( ll++ )) 00:15:21.250 11:26:16 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@24 -- # (( ll < length )) 00:15:21.250 11:26:16 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@25 -- # printf %x 49 00:15:21.250 11:26:16 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@25 -- # echo -e '\x31' 00:15:21.250 11:26:16 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@25 -- # string+=1 00:15:21.250 11:26:16 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@24 -- # (( ll++ )) 00:15:21.250 11:26:16 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@24 -- # (( ll < length )) 00:15:21.250 11:26:16 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@25 -- # printf %x 45 00:15:21.250 11:26:16 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@25 -- # echo -e '\x2d' 00:15:21.250 11:26:16 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@25 -- # string+=- 00:15:21.250 11:26:16 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@24 -- # (( ll++ )) 00:15:21.250 11:26:16 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@24 -- # (( ll < length )) 00:15:21.250 11:26:16 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@25 -- # printf %x 96 00:15:21.250 11:26:16 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@25 -- # echo -e '\x60' 00:15:21.250 11:26:16 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@25 -- # string+='`' 00:15:21.251 11:26:16 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@24 -- # (( ll++ )) 00:15:21.251 11:26:16 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@24 -- # (( ll < length )) 00:15:21.251 11:26:16 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@25 -- # printf %x 63 00:15:21.251 11:26:16 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@25 -- # echo -e '\x3f' 00:15:21.251 11:26:16 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@25 -- # string+='?' 00:15:21.251 11:26:16 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@24 -- # (( ll++ )) 00:15:21.251 11:26:16 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@24 -- # (( ll < length )) 00:15:21.251 11:26:16 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@25 -- # printf %x 69 00:15:21.251 11:26:16 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@25 -- # echo -e '\x45' 00:15:21.251 11:26:16 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@25 -- # string+=E 00:15:21.251 11:26:16 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@24 -- # (( ll++ )) 00:15:21.251 11:26:16 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@24 -- # (( ll < length )) 00:15:21.251 11:26:16 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@25 -- # printf %x 46 00:15:21.251 11:26:16 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@25 -- # echo -e '\x2e' 00:15:21.251 11:26:16 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@25 -- # string+=. 00:15:21.251 11:26:16 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@24 -- # (( ll++ )) 00:15:21.251 11:26:16 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@24 -- # (( ll < length )) 00:15:21.251 11:26:16 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@25 -- # printf %x 53 00:15:21.251 11:26:16 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@25 -- # echo -e '\x35' 00:15:21.251 11:26:16 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@25 -- # string+=5 00:15:21.251 11:26:16 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@24 -- # (( ll++ )) 00:15:21.251 11:26:16 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@24 -- # (( ll < length )) 00:15:21.251 11:26:16 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@25 -- # printf %x 34 00:15:21.251 11:26:16 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@25 -- # echo -e '\x22' 00:15:21.251 11:26:16 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@25 -- # string+='"' 00:15:21.251 11:26:16 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@24 -- # (( ll++ )) 00:15:21.251 11:26:16 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@24 -- # (( ll < length )) 00:15:21.251 11:26:16 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@28 -- # [[ A == \- ]] 00:15:21.251 11:26:16 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@31 -- # echo 'AvO[-?-!OLoBwGXv[`cU0SZ>t~F~tJ-'\''a1-`?E.5"' 00:15:21.251 11:26:16 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@58 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_create_subsystem -d 'AvO[-?-!OLoBwGXv[`cU0SZ>t~F~tJ-'\''a1-`?E.5"' nqn.2016-06.io.spdk:cnode21719 00:15:21.817 [2024-10-07 11:26:17.070057] nvmf_rpc.c: 422:rpc_nvmf_create_subsystem: *ERROR*: Subsystem nqn.2016-06.io.spdk:cnode21719: invalid model number 'AvO[-?-!OLoBwGXv[`cU0SZ>t~F~tJ-'a1-`?E.5"' 00:15:21.817 11:26:17 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@58 -- # out='2024/10/07 11:26:17 error on JSON-RPC call, method: nvmf_create_subsystem, params: map[model_number:AvO[-?-!OLoBwGXv[`cU0SZ>t~F~tJ-'\''a1-`?E.5" nqn:nqn.2016-06.io.spdk:cnode21719], err: error received for nvmf_create_subsystem method, err: Code=-32602 Msg=Invalid MN AvO[-?-!OLoBwGXv[`cU0SZ>t~F~tJ-'\''a1-`?E.5" 00:15:21.817 request: 00:15:21.817 { 00:15:21.817 "method": "nvmf_create_subsystem", 00:15:21.817 "params": { 00:15:21.817 "nqn": "nqn.2016-06.io.spdk:cnode21719", 00:15:21.817 "model_number": "AvO[-?-!OLoBwGXv[`cU0SZ>t~F~tJ-'\''a1-`?E.5\"" 00:15:21.817 } 00:15:21.817 } 00:15:21.817 Got JSON-RPC error response 00:15:21.817 GoRPCClient: error on JSON-RPC call' 00:15:21.817 11:26:17 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@59 -- # [[ 2024/10/07 11:26:17 error on JSON-RPC call, method: nvmf_create_subsystem, params: map[model_number:AvO[-?-!OLoBwGXv[`cU0SZ>t~F~tJ-'a1-`?E.5" nqn:nqn.2016-06.io.spdk:cnode21719], err: error received for nvmf_create_subsystem method, err: Code=-32602 Msg=Invalid MN AvO[-?-!OLoBwGXv[`cU0SZ>t~F~tJ-'a1-`?E.5" 00:15:21.817 request: 00:15:21.817 { 00:15:21.817 "method": "nvmf_create_subsystem", 00:15:21.817 "params": { 00:15:21.817 "nqn": "nqn.2016-06.io.spdk:cnode21719", 00:15:21.817 "model_number": "AvO[-?-!OLoBwGXv[`cU0SZ>t~F~tJ-'a1-`?E.5\"" 00:15:21.817 } 00:15:21.817 } 00:15:21.817 Got JSON-RPC error response 00:15:21.817 GoRPCClient: error on JSON-RPC call == *\I\n\v\a\l\i\d\ \M\N* ]] 00:15:21.817 11:26:17 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@62 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_create_transport --trtype tcp 00:15:22.074 [2024-10-07 11:26:17.398389] tcp.c: 738:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:15:22.074 11:26:17 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@63 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode -s SPDK001 -a 00:15:22.414 11:26:17 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@64 -- # [[ tcp == \T\C\P ]] 00:15:22.414 11:26:17 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@67 -- # echo '' 00:15:22.414 11:26:17 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@67 -- # head -n 1 00:15:22.414 11:26:17 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@67 -- # IP= 00:15:22.414 11:26:17 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@69 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_remove_listener nqn.2016-06.io.spdk:cnode -t tcp -a '' -s 4421 00:15:22.672 [2024-10-07 11:26:18.013413] nvmf_rpc.c: 783:nvmf_rpc_listen_paused: *ERROR*: Unable to remove listener, rc -2 00:15:22.672 11:26:18 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@69 -- # out='2024/10/07 11:26:18 error on JSON-RPC call, method: nvmf_subsystem_remove_listener, params: map[listen_address:map[traddr: trsvcid:4421 trtype:tcp] nqn:nqn.2016-06.io.spdk:cnode], err: error received for nvmf_subsystem_remove_listener method, err: Code=-32602 Msg=Invalid parameters 00:15:22.672 request: 00:15:22.672 { 00:15:22.672 "method": "nvmf_subsystem_remove_listener", 00:15:22.672 "params": { 00:15:22.672 "nqn": "nqn.2016-06.io.spdk:cnode", 00:15:22.672 "listen_address": { 00:15:22.672 "trtype": "tcp", 00:15:22.672 "traddr": "", 00:15:22.672 "trsvcid": "4421" 00:15:22.672 } 00:15:22.672 } 00:15:22.672 } 00:15:22.672 Got JSON-RPC error response 00:15:22.672 GoRPCClient: error on JSON-RPC call' 00:15:22.673 11:26:18 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@70 -- # [[ 2024/10/07 11:26:18 error on JSON-RPC call, method: nvmf_subsystem_remove_listener, params: map[listen_address:map[traddr: trsvcid:4421 trtype:tcp] nqn:nqn.2016-06.io.spdk:cnode], err: error received for nvmf_subsystem_remove_listener method, err: Code=-32602 Msg=Invalid parameters 00:15:22.673 request: 00:15:22.673 { 00:15:22.673 "method": "nvmf_subsystem_remove_listener", 00:15:22.673 "params": { 00:15:22.673 "nqn": "nqn.2016-06.io.spdk:cnode", 00:15:22.673 "listen_address": { 00:15:22.673 "trtype": "tcp", 00:15:22.673 "traddr": "", 00:15:22.673 "trsvcid": "4421" 00:15:22.673 } 00:15:22.673 } 00:15:22.673 } 00:15:22.673 Got JSON-RPC error response 00:15:22.673 GoRPCClient: error on JSON-RPC call != *\U\n\a\b\l\e\ \t\o\ \s\t\o\p\ \l\i\s\t\e\n\e\r\.* ]] 00:15:22.673 11:26:18 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@73 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode28828 -i 0 00:15:22.930 [2024-10-07 11:26:18.349611] nvmf_rpc.c: 434:rpc_nvmf_create_subsystem: *ERROR*: Subsystem nqn.2016-06.io.spdk:cnode28828: invalid cntlid range [0-65519] 00:15:22.930 11:26:18 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@73 -- # out='2024/10/07 11:26:18 error on JSON-RPC call, method: nvmf_create_subsystem, params: map[min_cntlid:0 nqn:nqn.2016-06.io.spdk:cnode28828], err: error received for nvmf_create_subsystem method, err: Code=-32602 Msg=Invalid cntlid range [0-65519] 00:15:22.930 request: 00:15:22.930 { 00:15:22.930 "method": "nvmf_create_subsystem", 00:15:22.930 "params": { 00:15:22.930 "nqn": "nqn.2016-06.io.spdk:cnode28828", 00:15:22.930 "min_cntlid": 0 00:15:22.930 } 00:15:22.930 } 00:15:22.930 Got JSON-RPC error response 00:15:22.930 GoRPCClient: error on JSON-RPC call' 00:15:22.930 11:26:18 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@74 -- # [[ 2024/10/07 11:26:18 error on JSON-RPC call, method: nvmf_create_subsystem, params: map[min_cntlid:0 nqn:nqn.2016-06.io.spdk:cnode28828], err: error received for nvmf_create_subsystem method, err: Code=-32602 Msg=Invalid cntlid range [0-65519] 00:15:22.930 request: 00:15:22.930 { 00:15:22.930 "method": "nvmf_create_subsystem", 00:15:22.930 "params": { 00:15:22.930 "nqn": "nqn.2016-06.io.spdk:cnode28828", 00:15:22.930 "min_cntlid": 0 00:15:22.930 } 00:15:22.930 } 00:15:22.930 Got JSON-RPC error response 00:15:22.930 GoRPCClient: error on JSON-RPC call == *\I\n\v\a\l\i\d\ \c\n\t\l\i\d\ \r\a\n\g\e* ]] 00:15:22.930 11:26:18 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@75 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode6555 -i 65520 00:15:23.187 [2024-10-07 11:26:18.617858] nvmf_rpc.c: 434:rpc_nvmf_create_subsystem: *ERROR*: Subsystem nqn.2016-06.io.spdk:cnode6555: invalid cntlid range [65520-65519] 00:15:23.187 11:26:18 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@75 -- # out='2024/10/07 11:26:18 error on JSON-RPC call, method: nvmf_create_subsystem, params: map[min_cntlid:65520 nqn:nqn.2016-06.io.spdk:cnode6555], err: error received for nvmf_create_subsystem method, err: Code=-32602 Msg=Invalid cntlid range [65520-65519] 00:15:23.187 request: 00:15:23.187 { 00:15:23.187 "method": "nvmf_create_subsystem", 00:15:23.187 "params": { 00:15:23.187 "nqn": "nqn.2016-06.io.spdk:cnode6555", 00:15:23.187 "min_cntlid": 65520 00:15:23.187 } 00:15:23.187 } 00:15:23.187 Got JSON-RPC error response 00:15:23.188 GoRPCClient: error on JSON-RPC call' 00:15:23.188 11:26:18 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@76 -- # [[ 2024/10/07 11:26:18 error on JSON-RPC call, method: nvmf_create_subsystem, params: map[min_cntlid:65520 nqn:nqn.2016-06.io.spdk:cnode6555], err: error received for nvmf_create_subsystem method, err: Code=-32602 Msg=Invalid cntlid range [65520-65519] 00:15:23.188 request: 00:15:23.188 { 00:15:23.188 "method": "nvmf_create_subsystem", 00:15:23.188 "params": { 00:15:23.188 "nqn": "nqn.2016-06.io.spdk:cnode6555", 00:15:23.188 "min_cntlid": 65520 00:15:23.188 } 00:15:23.188 } 00:15:23.188 Got JSON-RPC error response 00:15:23.188 GoRPCClient: error on JSON-RPC call == *\I\n\v\a\l\i\d\ \c\n\t\l\i\d\ \r\a\n\g\e* ]] 00:15:23.188 11:26:18 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@77 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode18568 -I 0 00:15:23.445 [2024-10-07 11:26:18.890072] nvmf_rpc.c: 434:rpc_nvmf_create_subsystem: *ERROR*: Subsystem nqn.2016-06.io.spdk:cnode18568: invalid cntlid range [1-0] 00:15:23.445 11:26:18 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@77 -- # out='2024/10/07 11:26:18 error on JSON-RPC call, method: nvmf_create_subsystem, params: map[max_cntlid:0 nqn:nqn.2016-06.io.spdk:cnode18568], err: error received for nvmf_create_subsystem method, err: Code=-32602 Msg=Invalid cntlid range [1-0] 00:15:23.445 request: 00:15:23.445 { 00:15:23.445 "method": "nvmf_create_subsystem", 00:15:23.445 "params": { 00:15:23.446 "nqn": "nqn.2016-06.io.spdk:cnode18568", 00:15:23.446 "max_cntlid": 0 00:15:23.446 } 00:15:23.446 } 00:15:23.446 Got JSON-RPC error response 00:15:23.446 GoRPCClient: error on JSON-RPC call' 00:15:23.446 11:26:18 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@78 -- # [[ 2024/10/07 11:26:18 error on JSON-RPC call, method: nvmf_create_subsystem, params: map[max_cntlid:0 nqn:nqn.2016-06.io.spdk:cnode18568], err: error received for nvmf_create_subsystem method, err: Code=-32602 Msg=Invalid cntlid range [1-0] 00:15:23.446 request: 00:15:23.446 { 00:15:23.446 "method": "nvmf_create_subsystem", 00:15:23.446 "params": { 00:15:23.446 "nqn": "nqn.2016-06.io.spdk:cnode18568", 00:15:23.446 "max_cntlid": 0 00:15:23.446 } 00:15:23.446 } 00:15:23.446 Got JSON-RPC error response 00:15:23.446 GoRPCClient: error on JSON-RPC call == *\I\n\v\a\l\i\d\ \c\n\t\l\i\d\ \r\a\n\g\e* ]] 00:15:23.446 11:26:18 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@79 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode8173 -I 65520 00:15:23.703 [2024-10-07 11:26:19.166307] nvmf_rpc.c: 434:rpc_nvmf_create_subsystem: *ERROR*: Subsystem nqn.2016-06.io.spdk:cnode8173: invalid cntlid range [1-65520] 00:15:23.704 11:26:19 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@79 -- # out='2024/10/07 11:26:19 error on JSON-RPC call, method: nvmf_create_subsystem, params: map[max_cntlid:65520 nqn:nqn.2016-06.io.spdk:cnode8173], err: error received for nvmf_create_subsystem method, err: Code=-32602 Msg=Invalid cntlid range [1-65520] 00:15:23.704 request: 00:15:23.704 { 00:15:23.704 "method": "nvmf_create_subsystem", 00:15:23.704 "params": { 00:15:23.704 "nqn": "nqn.2016-06.io.spdk:cnode8173", 00:15:23.704 "max_cntlid": 65520 00:15:23.704 } 00:15:23.704 } 00:15:23.704 Got JSON-RPC error response 00:15:23.704 GoRPCClient: error on JSON-RPC call' 00:15:23.704 11:26:19 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@80 -- # [[ 2024/10/07 11:26:19 error on JSON-RPC call, method: nvmf_create_subsystem, params: map[max_cntlid:65520 nqn:nqn.2016-06.io.spdk:cnode8173], err: error received for nvmf_create_subsystem method, err: Code=-32602 Msg=Invalid cntlid range [1-65520] 00:15:23.704 request: 00:15:23.704 { 00:15:23.704 "method": "nvmf_create_subsystem", 00:15:23.704 "params": { 00:15:23.704 "nqn": "nqn.2016-06.io.spdk:cnode8173", 00:15:23.704 "max_cntlid": 65520 00:15:23.704 } 00:15:23.704 } 00:15:23.704 Got JSON-RPC error response 00:15:23.704 GoRPCClient: error on JSON-RPC call == *\I\n\v\a\l\i\d\ \c\n\t\l\i\d\ \r\a\n\g\e* ]] 00:15:23.704 11:26:19 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@83 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode17720 -i 6 -I 5 00:15:24.269 [2024-10-07 11:26:19.546640] nvmf_rpc.c: 434:rpc_nvmf_create_subsystem: *ERROR*: Subsystem nqn.2016-06.io.spdk:cnode17720: invalid cntlid range [6-5] 00:15:24.269 11:26:19 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@83 -- # out='2024/10/07 11:26:19 error on JSON-RPC call, method: nvmf_create_subsystem, params: map[max_cntlid:5 min_cntlid:6 nqn:nqn.2016-06.io.spdk:cnode17720], err: error received for nvmf_create_subsystem method, err: Code=-32602 Msg=Invalid cntlid range [6-5] 00:15:24.269 request: 00:15:24.269 { 00:15:24.269 "method": "nvmf_create_subsystem", 00:15:24.269 "params": { 00:15:24.269 "nqn": "nqn.2016-06.io.spdk:cnode17720", 00:15:24.269 "min_cntlid": 6, 00:15:24.269 "max_cntlid": 5 00:15:24.269 } 00:15:24.269 } 00:15:24.269 Got JSON-RPC error response 00:15:24.269 GoRPCClient: error on JSON-RPC call' 00:15:24.269 11:26:19 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@84 -- # [[ 2024/10/07 11:26:19 error on JSON-RPC call, method: nvmf_create_subsystem, params: map[max_cntlid:5 min_cntlid:6 nqn:nqn.2016-06.io.spdk:cnode17720], err: error received for nvmf_create_subsystem method, err: Code=-32602 Msg=Invalid cntlid range [6-5] 00:15:24.269 request: 00:15:24.269 { 00:15:24.270 "method": "nvmf_create_subsystem", 00:15:24.270 "params": { 00:15:24.270 "nqn": "nqn.2016-06.io.spdk:cnode17720", 00:15:24.270 "min_cntlid": 6, 00:15:24.270 "max_cntlid": 5 00:15:24.270 } 00:15:24.270 } 00:15:24.270 Got JSON-RPC error response 00:15:24.270 GoRPCClient: error on JSON-RPC call == *\I\n\v\a\l\i\d\ \c\n\t\l\i\d\ \r\a\n\g\e* ]] 00:15:24.270 11:26:19 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@87 -- # /home/vagrant/spdk_repo/spdk/test/nvmf/target/multitarget_rpc.py nvmf_delete_target --name foobar 00:15:24.270 11:26:19 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@87 -- # out='request: 00:15:24.270 { 00:15:24.270 "name": "foobar", 00:15:24.270 "method": "nvmf_delete_target", 00:15:24.270 "req_id": 1 00:15:24.270 } 00:15:24.270 Got JSON-RPC error response 00:15:24.270 response: 00:15:24.270 { 00:15:24.270 "code": -32602, 00:15:24.270 "message": "The specified target doesn'\''t exist, cannot delete it." 00:15:24.270 }' 00:15:24.270 11:26:19 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@88 -- # [[ request: 00:15:24.270 { 00:15:24.270 "name": "foobar", 00:15:24.270 "method": "nvmf_delete_target", 00:15:24.270 "req_id": 1 00:15:24.270 } 00:15:24.270 Got JSON-RPC error response 00:15:24.270 response: 00:15:24.270 { 00:15:24.270 "code": -32602, 00:15:24.270 "message": "The specified target doesn't exist, cannot delete it." 00:15:24.270 } == *\T\h\e\ \s\p\e\c\i\f\i\e\d\ \t\a\r\g\e\t\ \d\o\e\s\n\'\t\ \e\x\i\s\t\,\ \c\a\n\n\o\t\ \d\e\l\e\t\e\ \i\t\.* ]] 00:15:24.270 11:26:19 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@90 -- # trap - SIGINT SIGTERM EXIT 00:15:24.270 11:26:19 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@91 -- # nvmftestfini 00:15:24.270 11:26:19 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- nvmf/common.sh@514 -- # nvmfcleanup 00:15:24.270 11:26:19 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- nvmf/common.sh@121 -- # sync 00:15:24.270 11:26:19 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- nvmf/common.sh@123 -- # '[' tcp == tcp ']' 00:15:24.270 11:26:19 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- nvmf/common.sh@124 -- # set +e 00:15:24.270 11:26:19 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- nvmf/common.sh@125 -- # for i in {1..20} 00:15:24.270 11:26:19 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- nvmf/common.sh@126 -- # modprobe -v -r nvme-tcp 00:15:24.270 rmmod nvme_tcp 00:15:24.270 rmmod nvme_fabrics 00:15:24.527 rmmod nvme_keyring 00:15:24.527 11:26:19 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- nvmf/common.sh@127 -- # modprobe -v -r nvme-fabrics 00:15:24.527 11:26:19 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- nvmf/common.sh@128 -- # set -e 00:15:24.527 11:26:19 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- nvmf/common.sh@129 -- # return 0 00:15:24.527 11:26:19 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- nvmf/common.sh@515 -- # '[' -n 74890 ']' 00:15:24.527 11:26:19 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- nvmf/common.sh@516 -- # killprocess 74890 00:15:24.527 11:26:19 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- common/autotest_common.sh@950 -- # '[' -z 74890 ']' 00:15:24.527 11:26:19 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- common/autotest_common.sh@954 -- # kill -0 74890 00:15:24.527 11:26:19 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- common/autotest_common.sh@955 -- # uname 00:15:24.527 11:26:19 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- common/autotest_common.sh@955 -- # '[' Linux = Linux ']' 00:15:24.527 11:26:19 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- common/autotest_common.sh@956 -- # ps --no-headers -o comm= 74890 00:15:24.527 11:26:19 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- common/autotest_common.sh@956 -- # process_name=reactor_0 00:15:24.527 killing process with pid 74890 00:15:24.527 11:26:19 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- common/autotest_common.sh@960 -- # '[' reactor_0 = sudo ']' 00:15:24.527 11:26:19 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- common/autotest_common.sh@968 -- # echo 'killing process with pid 74890' 00:15:24.527 11:26:19 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- common/autotest_common.sh@969 -- # kill 74890 00:15:24.527 11:26:19 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- common/autotest_common.sh@974 -- # wait 74890 00:15:24.785 11:26:20 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- nvmf/common.sh@518 -- # '[' '' == iso ']' 00:15:24.785 11:26:20 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- nvmf/common.sh@521 -- # [[ tcp == \t\c\p ]] 00:15:24.785 11:26:20 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- nvmf/common.sh@522 -- # nvmf_tcp_fini 00:15:24.785 11:26:20 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- nvmf/common.sh@297 -- # iptr 00:15:24.785 11:26:20 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- nvmf/common.sh@789 -- # iptables-save 00:15:24.785 11:26:20 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- nvmf/common.sh@789 -- # grep -v SPDK_NVMF 00:15:24.785 11:26:20 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- nvmf/common.sh@789 -- # iptables-restore 00:15:24.785 11:26:20 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- nvmf/common.sh@298 -- # [[ nvmf_tgt_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s\_\s\p\d\k ]] 00:15:24.785 11:26:20 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- nvmf/common.sh@299 -- # nvmf_veth_fini 00:15:24.785 11:26:20 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- nvmf/common.sh@233 -- # ip link set nvmf_init_br nomaster 00:15:24.785 11:26:20 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- nvmf/common.sh@234 -- # ip link set nvmf_init_br2 nomaster 00:15:24.785 11:26:20 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- nvmf/common.sh@235 -- # ip link set nvmf_tgt_br nomaster 00:15:24.785 11:26:20 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- nvmf/common.sh@236 -- # ip link set nvmf_tgt_br2 nomaster 00:15:24.785 11:26:20 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- nvmf/common.sh@237 -- # ip link set nvmf_init_br down 00:15:24.785 11:26:20 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- nvmf/common.sh@238 -- # ip link set nvmf_init_br2 down 00:15:24.785 11:26:20 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- nvmf/common.sh@239 -- # ip link set nvmf_tgt_br down 00:15:24.785 11:26:20 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- nvmf/common.sh@240 -- # ip link set nvmf_tgt_br2 down 00:15:24.785 11:26:20 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- nvmf/common.sh@241 -- # ip link delete nvmf_br type bridge 00:15:24.785 11:26:20 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- nvmf/common.sh@242 -- # ip link delete nvmf_init_if 00:15:24.785 11:26:20 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- nvmf/common.sh@243 -- # ip link delete nvmf_init_if2 00:15:24.785 11:26:20 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- nvmf/common.sh@244 -- # ip netns exec nvmf_tgt_ns_spdk ip link delete nvmf_tgt_if 00:15:25.043 11:26:20 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- nvmf/common.sh@245 -- # ip netns exec nvmf_tgt_ns_spdk ip link delete nvmf_tgt_if2 00:15:25.043 11:26:20 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- nvmf/common.sh@246 -- # remove_spdk_ns 00:15:25.043 11:26:20 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- nvmf/common.sh@654 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:15:25.043 11:26:20 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 15> /dev/null' 00:15:25.043 11:26:20 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:15:25.043 11:26:20 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- nvmf/common.sh@300 -- # return 0 00:15:25.043 00:15:25.043 real 0m6.978s 00:15:25.043 user 0m27.215s 00:15:25.043 sys 0m1.441s 00:15:25.043 11:26:20 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- common/autotest_common.sh@1126 -- # xtrace_disable 00:15:25.043 11:26:20 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- common/autotest_common.sh@10 -- # set +x 00:15:25.043 ************************************ 00:15:25.043 END TEST nvmf_invalid 00:15:25.043 ************************************ 00:15:25.043 11:26:20 nvmf_tcp.nvmf_target_extra -- nvmf/nvmf_target_extra.sh@24 -- # run_test nvmf_connect_stress /home/vagrant/spdk_repo/spdk/test/nvmf/target/connect_stress.sh --transport=tcp 00:15:25.043 11:26:20 nvmf_tcp.nvmf_target_extra -- common/autotest_common.sh@1101 -- # '[' 3 -le 1 ']' 00:15:25.043 11:26:20 nvmf_tcp.nvmf_target_extra -- common/autotest_common.sh@1107 -- # xtrace_disable 00:15:25.043 11:26:20 nvmf_tcp.nvmf_target_extra -- common/autotest_common.sh@10 -- # set +x 00:15:25.043 ************************************ 00:15:25.043 START TEST nvmf_connect_stress 00:15:25.043 ************************************ 00:15:25.043 11:26:20 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- common/autotest_common.sh@1125 -- # /home/vagrant/spdk_repo/spdk/test/nvmf/target/connect_stress.sh --transport=tcp 00:15:25.043 * Looking for test storage... 00:15:25.043 * Found test storage at /home/vagrant/spdk_repo/spdk/test/nvmf/target 00:15:25.043 11:26:20 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- common/autotest_common.sh@1680 -- # [[ y == y ]] 00:15:25.043 11:26:20 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- common/autotest_common.sh@1681 -- # lcov --version 00:15:25.043 11:26:20 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- common/autotest_common.sh@1681 -- # awk '{print $NF}' 00:15:25.303 11:26:20 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- common/autotest_common.sh@1681 -- # lt 1.15 2 00:15:25.303 11:26:20 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- scripts/common.sh@373 -- # cmp_versions 1.15 '<' 2 00:15:25.303 11:26:20 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- scripts/common.sh@333 -- # local ver1 ver1_l 00:15:25.303 11:26:20 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- scripts/common.sh@334 -- # local ver2 ver2_l 00:15:25.303 11:26:20 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- scripts/common.sh@336 -- # IFS=.-: 00:15:25.303 11:26:20 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- scripts/common.sh@336 -- # read -ra ver1 00:15:25.303 11:26:20 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- scripts/common.sh@337 -- # IFS=.-: 00:15:25.303 11:26:20 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- scripts/common.sh@337 -- # read -ra ver2 00:15:25.303 11:26:20 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- scripts/common.sh@338 -- # local 'op=<' 00:15:25.303 11:26:20 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- scripts/common.sh@340 -- # ver1_l=2 00:15:25.303 11:26:20 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- scripts/common.sh@341 -- # ver2_l=1 00:15:25.303 11:26:20 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- scripts/common.sh@343 -- # local lt=0 gt=0 eq=0 v 00:15:25.303 11:26:20 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- scripts/common.sh@344 -- # case "$op" in 00:15:25.303 11:26:20 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- scripts/common.sh@345 -- # : 1 00:15:25.303 11:26:20 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- scripts/common.sh@364 -- # (( v = 0 )) 00:15:25.303 11:26:20 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- scripts/common.sh@364 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:15:25.303 11:26:20 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- scripts/common.sh@365 -- # decimal 1 00:15:25.303 11:26:20 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- scripts/common.sh@353 -- # local d=1 00:15:25.303 11:26:20 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- scripts/common.sh@354 -- # [[ 1 =~ ^[0-9]+$ ]] 00:15:25.303 11:26:20 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- scripts/common.sh@355 -- # echo 1 00:15:25.303 11:26:20 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- scripts/common.sh@365 -- # ver1[v]=1 00:15:25.303 11:26:20 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- scripts/common.sh@366 -- # decimal 2 00:15:25.303 11:26:20 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- scripts/common.sh@353 -- # local d=2 00:15:25.303 11:26:20 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- scripts/common.sh@354 -- # [[ 2 =~ ^[0-9]+$ ]] 00:15:25.303 11:26:20 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- scripts/common.sh@355 -- # echo 2 00:15:25.303 11:26:20 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- scripts/common.sh@366 -- # ver2[v]=2 00:15:25.303 11:26:20 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- scripts/common.sh@367 -- # (( ver1[v] > ver2[v] )) 00:15:25.303 11:26:20 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- scripts/common.sh@368 -- # (( ver1[v] < ver2[v] )) 00:15:25.303 11:26:20 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- scripts/common.sh@368 -- # return 0 00:15:25.303 11:26:20 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- common/autotest_common.sh@1682 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:15:25.303 11:26:20 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- common/autotest_common.sh@1694 -- # export 'LCOV_OPTS= 00:15:25.303 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:15:25.303 --rc genhtml_branch_coverage=1 00:15:25.303 --rc genhtml_function_coverage=1 00:15:25.303 --rc genhtml_legend=1 00:15:25.303 --rc geninfo_all_blocks=1 00:15:25.303 --rc geninfo_unexecuted_blocks=1 00:15:25.303 00:15:25.303 ' 00:15:25.303 11:26:20 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- common/autotest_common.sh@1694 -- # LCOV_OPTS=' 00:15:25.303 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:15:25.303 --rc genhtml_branch_coverage=1 00:15:25.303 --rc genhtml_function_coverage=1 00:15:25.303 --rc genhtml_legend=1 00:15:25.303 --rc geninfo_all_blocks=1 00:15:25.303 --rc geninfo_unexecuted_blocks=1 00:15:25.303 00:15:25.303 ' 00:15:25.303 11:26:20 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- common/autotest_common.sh@1695 -- # export 'LCOV=lcov 00:15:25.303 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:15:25.303 --rc genhtml_branch_coverage=1 00:15:25.303 --rc genhtml_function_coverage=1 00:15:25.303 --rc genhtml_legend=1 00:15:25.303 --rc geninfo_all_blocks=1 00:15:25.303 --rc geninfo_unexecuted_blocks=1 00:15:25.303 00:15:25.303 ' 00:15:25.303 11:26:20 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- common/autotest_common.sh@1695 -- # LCOV='lcov 00:15:25.303 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:15:25.303 --rc genhtml_branch_coverage=1 00:15:25.303 --rc genhtml_function_coverage=1 00:15:25.303 --rc genhtml_legend=1 00:15:25.303 --rc geninfo_all_blocks=1 00:15:25.303 --rc geninfo_unexecuted_blocks=1 00:15:25.303 00:15:25.303 ' 00:15:25.303 11:26:20 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- target/connect_stress.sh@10 -- # source /home/vagrant/spdk_repo/spdk/test/nvmf/common.sh 00:15:25.303 11:26:20 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- nvmf/common.sh@7 -- # uname -s 00:15:25.303 11:26:20 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:15:25.303 11:26:20 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:15:25.303 11:26:20 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:15:25.303 11:26:20 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:15:25.303 11:26:20 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:15:25.303 11:26:20 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:15:25.303 11:26:20 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:15:25.303 11:26:20 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:15:25.303 11:26:20 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:15:25.303 11:26:20 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:15:25.303 11:26:20 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:c758a4ed-f09f-4c82-9afb-3d096f035464 00:15:25.303 11:26:20 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- nvmf/common.sh@18 -- # NVME_HOSTID=c758a4ed-f09f-4c82-9afb-3d096f035464 00:15:25.303 11:26:20 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:15:25.303 11:26:20 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:15:25.303 11:26:20 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- nvmf/common.sh@21 -- # NET_TYPE=virt 00:15:25.303 11:26:20 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:15:25.303 11:26:20 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- nvmf/common.sh@49 -- # source /home/vagrant/spdk_repo/spdk/scripts/common.sh 00:15:25.303 11:26:20 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- scripts/common.sh@15 -- # shopt -s extglob 00:15:25.303 11:26:20 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- scripts/common.sh@544 -- # [[ -e /bin/wpdk_common.sh ]] 00:15:25.303 11:26:20 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- scripts/common.sh@552 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:15:25.303 11:26:20 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- scripts/common.sh@553 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:15:25.303 11:26:20 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:25.303 11:26:20 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:25.304 11:26:20 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:25.304 11:26:20 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- paths/export.sh@5 -- # export PATH 00:15:25.304 11:26:20 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:25.304 11:26:20 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- nvmf/common.sh@51 -- # : 0 00:15:25.304 11:26:20 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- nvmf/common.sh@52 -- # export NVMF_APP_SHM_ID 00:15:25.304 11:26:20 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- nvmf/common.sh@53 -- # build_nvmf_app_args 00:15:25.304 11:26:20 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:15:25.304 11:26:20 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:15:25.304 11:26:20 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:15:25.304 11:26:20 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- nvmf/common.sh@33 -- # '[' '' -eq 1 ']' 00:15:25.304 /home/vagrant/spdk_repo/spdk/test/nvmf/common.sh: line 33: [: : integer expression expected 00:15:25.304 11:26:20 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- nvmf/common.sh@37 -- # '[' -n '' ']' 00:15:25.304 11:26:20 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- nvmf/common.sh@39 -- # '[' 0 -eq 1 ']' 00:15:25.304 11:26:20 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- nvmf/common.sh@55 -- # have_pci_nics=0 00:15:25.304 11:26:20 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- target/connect_stress.sh@12 -- # nvmftestinit 00:15:25.304 11:26:20 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- nvmf/common.sh@467 -- # '[' -z tcp ']' 00:15:25.304 11:26:20 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- nvmf/common.sh@472 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:15:25.304 11:26:20 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- nvmf/common.sh@474 -- # prepare_net_devs 00:15:25.304 11:26:20 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- nvmf/common.sh@436 -- # local -g is_hw=no 00:15:25.304 11:26:20 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- nvmf/common.sh@438 -- # remove_spdk_ns 00:15:25.304 11:26:20 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- nvmf/common.sh@654 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:15:25.304 11:26:20 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 15> /dev/null' 00:15:25.304 11:26:20 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:15:25.304 11:26:20 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- nvmf/common.sh@440 -- # [[ virt != virt ]] 00:15:25.304 11:26:20 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- nvmf/common.sh@442 -- # [[ no == yes ]] 00:15:25.304 11:26:20 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- nvmf/common.sh@449 -- # [[ virt == phy ]] 00:15:25.304 11:26:20 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- nvmf/common.sh@452 -- # [[ virt == phy-fallback ]] 00:15:25.304 11:26:20 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- nvmf/common.sh@457 -- # [[ tcp == tcp ]] 00:15:25.304 11:26:20 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- nvmf/common.sh@458 -- # nvmf_veth_init 00:15:25.304 11:26:20 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- nvmf/common.sh@145 -- # NVMF_FIRST_INITIATOR_IP=10.0.0.1 00:15:25.304 11:26:20 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- nvmf/common.sh@146 -- # NVMF_SECOND_INITIATOR_IP=10.0.0.2 00:15:25.304 11:26:20 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- nvmf/common.sh@147 -- # NVMF_FIRST_TARGET_IP=10.0.0.3 00:15:25.304 11:26:20 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- nvmf/common.sh@148 -- # NVMF_SECOND_TARGET_IP=10.0.0.4 00:15:25.304 11:26:20 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- nvmf/common.sh@149 -- # NVMF_INITIATOR_IP=10.0.0.1 00:15:25.304 11:26:20 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- nvmf/common.sh@150 -- # NVMF_BRIDGE=nvmf_br 00:15:25.304 11:26:20 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- nvmf/common.sh@151 -- # NVMF_INITIATOR_INTERFACE=nvmf_init_if 00:15:25.304 11:26:20 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- nvmf/common.sh@152 -- # NVMF_INITIATOR_INTERFACE2=nvmf_init_if2 00:15:25.304 11:26:20 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- nvmf/common.sh@153 -- # NVMF_INITIATOR_BRIDGE=nvmf_init_br 00:15:25.304 11:26:20 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- nvmf/common.sh@154 -- # NVMF_INITIATOR_BRIDGE2=nvmf_init_br2 00:15:25.304 11:26:20 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- nvmf/common.sh@155 -- # NVMF_TARGET_NAMESPACE=nvmf_tgt_ns_spdk 00:15:25.304 11:26:20 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- nvmf/common.sh@156 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:15:25.304 11:26:20 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- nvmf/common.sh@157 -- # NVMF_TARGET_INTERFACE=nvmf_tgt_if 00:15:25.304 11:26:20 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- nvmf/common.sh@158 -- # NVMF_TARGET_INTERFACE2=nvmf_tgt_if2 00:15:25.304 11:26:20 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- nvmf/common.sh@159 -- # NVMF_TARGET_BRIDGE=nvmf_tgt_br 00:15:25.304 11:26:20 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- nvmf/common.sh@160 -- # NVMF_TARGET_BRIDGE2=nvmf_tgt_br2 00:15:25.304 11:26:20 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- nvmf/common.sh@162 -- # ip link set nvmf_init_br nomaster 00:15:25.304 Cannot find device "nvmf_init_br" 00:15:25.304 11:26:20 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- nvmf/common.sh@162 -- # true 00:15:25.304 11:26:20 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- nvmf/common.sh@163 -- # ip link set nvmf_init_br2 nomaster 00:15:25.304 Cannot find device "nvmf_init_br2" 00:15:25.304 11:26:20 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- nvmf/common.sh@163 -- # true 00:15:25.304 11:26:20 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- nvmf/common.sh@164 -- # ip link set nvmf_tgt_br nomaster 00:15:25.304 Cannot find device "nvmf_tgt_br" 00:15:25.304 11:26:20 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- nvmf/common.sh@164 -- # true 00:15:25.304 11:26:20 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- nvmf/common.sh@165 -- # ip link set nvmf_tgt_br2 nomaster 00:15:25.304 Cannot find device "nvmf_tgt_br2" 00:15:25.304 11:26:20 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- nvmf/common.sh@165 -- # true 00:15:25.304 11:26:20 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- nvmf/common.sh@166 -- # ip link set nvmf_init_br down 00:15:25.304 Cannot find device "nvmf_init_br" 00:15:25.304 11:26:20 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- nvmf/common.sh@166 -- # true 00:15:25.304 11:26:20 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- nvmf/common.sh@167 -- # ip link set nvmf_init_br2 down 00:15:25.304 Cannot find device "nvmf_init_br2" 00:15:25.304 11:26:20 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- nvmf/common.sh@167 -- # true 00:15:25.304 11:26:20 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- nvmf/common.sh@168 -- # ip link set nvmf_tgt_br down 00:15:25.304 Cannot find device "nvmf_tgt_br" 00:15:25.304 11:26:20 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- nvmf/common.sh@168 -- # true 00:15:25.304 11:26:20 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- nvmf/common.sh@169 -- # ip link set nvmf_tgt_br2 down 00:15:25.304 Cannot find device "nvmf_tgt_br2" 00:15:25.304 11:26:20 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- nvmf/common.sh@169 -- # true 00:15:25.304 11:26:20 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- nvmf/common.sh@170 -- # ip link delete nvmf_br type bridge 00:15:25.304 Cannot find device "nvmf_br" 00:15:25.304 11:26:20 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- nvmf/common.sh@170 -- # true 00:15:25.304 11:26:20 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- nvmf/common.sh@171 -- # ip link delete nvmf_init_if 00:15:25.304 Cannot find device "nvmf_init_if" 00:15:25.304 11:26:20 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- nvmf/common.sh@171 -- # true 00:15:25.304 11:26:20 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- nvmf/common.sh@172 -- # ip link delete nvmf_init_if2 00:15:25.304 Cannot find device "nvmf_init_if2" 00:15:25.304 11:26:20 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- nvmf/common.sh@172 -- # true 00:15:25.304 11:26:20 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- nvmf/common.sh@173 -- # ip netns exec nvmf_tgt_ns_spdk ip link delete nvmf_tgt_if 00:15:25.304 Cannot open network namespace "nvmf_tgt_ns_spdk": No such file or directory 00:15:25.304 11:26:20 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- nvmf/common.sh@173 -- # true 00:15:25.304 11:26:20 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- nvmf/common.sh@174 -- # ip netns exec nvmf_tgt_ns_spdk ip link delete nvmf_tgt_if2 00:15:25.304 Cannot open network namespace "nvmf_tgt_ns_spdk": No such file or directory 00:15:25.304 11:26:20 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- nvmf/common.sh@174 -- # true 00:15:25.304 11:26:20 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- nvmf/common.sh@177 -- # ip netns add nvmf_tgt_ns_spdk 00:15:25.304 11:26:20 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- nvmf/common.sh@180 -- # ip link add nvmf_init_if type veth peer name nvmf_init_br 00:15:25.304 11:26:20 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- nvmf/common.sh@181 -- # ip link add nvmf_init_if2 type veth peer name nvmf_init_br2 00:15:25.304 11:26:20 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- nvmf/common.sh@182 -- # ip link add nvmf_tgt_if type veth peer name nvmf_tgt_br 00:15:25.304 11:26:20 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- nvmf/common.sh@183 -- # ip link add nvmf_tgt_if2 type veth peer name nvmf_tgt_br2 00:15:25.304 11:26:20 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- nvmf/common.sh@186 -- # ip link set nvmf_tgt_if netns nvmf_tgt_ns_spdk 00:15:25.563 11:26:20 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- nvmf/common.sh@187 -- # ip link set nvmf_tgt_if2 netns nvmf_tgt_ns_spdk 00:15:25.563 11:26:20 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- nvmf/common.sh@190 -- # ip addr add 10.0.0.1/24 dev nvmf_init_if 00:15:25.563 11:26:20 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- nvmf/common.sh@191 -- # ip addr add 10.0.0.2/24 dev nvmf_init_if2 00:15:25.563 11:26:20 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- nvmf/common.sh@192 -- # ip netns exec nvmf_tgt_ns_spdk ip addr add 10.0.0.3/24 dev nvmf_tgt_if 00:15:25.563 11:26:20 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- nvmf/common.sh@193 -- # ip netns exec nvmf_tgt_ns_spdk ip addr add 10.0.0.4/24 dev nvmf_tgt_if2 00:15:25.563 11:26:20 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- nvmf/common.sh@196 -- # ip link set nvmf_init_if up 00:15:25.563 11:26:20 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- nvmf/common.sh@197 -- # ip link set nvmf_init_if2 up 00:15:25.563 11:26:20 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- nvmf/common.sh@198 -- # ip link set nvmf_init_br up 00:15:25.563 11:26:20 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- nvmf/common.sh@199 -- # ip link set nvmf_init_br2 up 00:15:25.563 11:26:20 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- nvmf/common.sh@200 -- # ip link set nvmf_tgt_br up 00:15:25.563 11:26:20 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- nvmf/common.sh@201 -- # ip link set nvmf_tgt_br2 up 00:15:25.563 11:26:20 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- nvmf/common.sh@202 -- # ip netns exec nvmf_tgt_ns_spdk ip link set nvmf_tgt_if up 00:15:25.563 11:26:20 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- nvmf/common.sh@203 -- # ip netns exec nvmf_tgt_ns_spdk ip link set nvmf_tgt_if2 up 00:15:25.563 11:26:20 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- nvmf/common.sh@204 -- # ip netns exec nvmf_tgt_ns_spdk ip link set lo up 00:15:25.563 11:26:20 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- nvmf/common.sh@207 -- # ip link add nvmf_br type bridge 00:15:25.563 11:26:20 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- nvmf/common.sh@208 -- # ip link set nvmf_br up 00:15:25.563 11:26:20 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- nvmf/common.sh@211 -- # ip link set nvmf_init_br master nvmf_br 00:15:25.563 11:26:20 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- nvmf/common.sh@212 -- # ip link set nvmf_init_br2 master nvmf_br 00:15:25.563 11:26:20 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- nvmf/common.sh@213 -- # ip link set nvmf_tgt_br master nvmf_br 00:15:25.563 11:26:20 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- nvmf/common.sh@214 -- # ip link set nvmf_tgt_br2 master nvmf_br 00:15:25.563 11:26:20 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- nvmf/common.sh@217 -- # ipts -I INPUT 1 -i nvmf_init_if -p tcp --dport 4420 -j ACCEPT 00:15:25.563 11:26:20 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- nvmf/common.sh@788 -- # iptables -I INPUT 1 -i nvmf_init_if -p tcp --dport 4420 -j ACCEPT -m comment --comment 'SPDK_NVMF:-I INPUT 1 -i nvmf_init_if -p tcp --dport 4420 -j ACCEPT' 00:15:25.563 11:26:20 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- nvmf/common.sh@218 -- # ipts -I INPUT 1 -i nvmf_init_if2 -p tcp --dport 4420 -j ACCEPT 00:15:25.563 11:26:20 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- nvmf/common.sh@788 -- # iptables -I INPUT 1 -i nvmf_init_if2 -p tcp --dport 4420 -j ACCEPT -m comment --comment 'SPDK_NVMF:-I INPUT 1 -i nvmf_init_if2 -p tcp --dport 4420 -j ACCEPT' 00:15:25.563 11:26:20 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- nvmf/common.sh@219 -- # ipts -A FORWARD -i nvmf_br -o nvmf_br -j ACCEPT 00:15:25.563 11:26:20 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- nvmf/common.sh@788 -- # iptables -A FORWARD -i nvmf_br -o nvmf_br -j ACCEPT -m comment --comment 'SPDK_NVMF:-A FORWARD -i nvmf_br -o nvmf_br -j ACCEPT' 00:15:25.563 11:26:20 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- nvmf/common.sh@222 -- # ping -c 1 10.0.0.3 00:15:25.563 PING 10.0.0.3 (10.0.0.3) 56(84) bytes of data. 00:15:25.563 64 bytes from 10.0.0.3: icmp_seq=1 ttl=64 time=0.070 ms 00:15:25.563 00:15:25.563 --- 10.0.0.3 ping statistics --- 00:15:25.563 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:15:25.563 rtt min/avg/max/mdev = 0.070/0.070/0.070/0.000 ms 00:15:25.563 11:26:20 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- nvmf/common.sh@223 -- # ping -c 1 10.0.0.4 00:15:25.563 PING 10.0.0.4 (10.0.0.4) 56(84) bytes of data. 00:15:25.563 64 bytes from 10.0.0.4: icmp_seq=1 ttl=64 time=0.052 ms 00:15:25.563 00:15:25.563 --- 10.0.0.4 ping statistics --- 00:15:25.563 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:15:25.563 rtt min/avg/max/mdev = 0.052/0.052/0.052/0.000 ms 00:15:25.564 11:26:20 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- nvmf/common.sh@224 -- # ip netns exec nvmf_tgt_ns_spdk ping -c 1 10.0.0.1 00:15:25.564 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:15:25.564 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.021 ms 00:15:25.564 00:15:25.564 --- 10.0.0.1 ping statistics --- 00:15:25.564 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:15:25.564 rtt min/avg/max/mdev = 0.021/0.021/0.021/0.000 ms 00:15:25.564 11:26:20 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- nvmf/common.sh@225 -- # ip netns exec nvmf_tgt_ns_spdk ping -c 1 10.0.0.2 00:15:25.564 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:15:25.564 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.047 ms 00:15:25.564 00:15:25.564 --- 10.0.0.2 ping statistics --- 00:15:25.564 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:15:25.564 rtt min/avg/max/mdev = 0.047/0.047/0.047/0.000 ms 00:15:25.564 11:26:21 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- nvmf/common.sh@227 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:15:25.564 11:26:21 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- nvmf/common.sh@459 -- # return 0 00:15:25.564 11:26:21 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- nvmf/common.sh@476 -- # '[' '' == iso ']' 00:15:25.564 11:26:21 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- nvmf/common.sh@480 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:15:25.564 11:26:21 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- nvmf/common.sh@481 -- # [[ tcp == \r\d\m\a ]] 00:15:25.564 11:26:21 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- nvmf/common.sh@490 -- # [[ tcp == \t\c\p ]] 00:15:25.564 11:26:21 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- nvmf/common.sh@491 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:15:25.564 11:26:21 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- nvmf/common.sh@494 -- # '[' tcp == tcp ']' 00:15:25.564 11:26:21 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- nvmf/common.sh@500 -- # modprobe nvme-tcp 00:15:25.564 11:26:21 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- target/connect_stress.sh@13 -- # nvmfappstart -m 0xE 00:15:25.564 11:26:21 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- nvmf/common.sh@505 -- # timing_enter start_nvmf_tgt 00:15:25.564 11:26:21 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- common/autotest_common.sh@724 -- # xtrace_disable 00:15:25.564 11:26:21 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- common/autotest_common.sh@10 -- # set +x 00:15:25.564 11:26:21 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- nvmf/common.sh@507 -- # nvmfpid=75458 00:15:25.564 11:26:21 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- nvmf/common.sh@506 -- # ip netns exec nvmf_tgt_ns_spdk /home/vagrant/spdk_repo/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xE 00:15:25.564 11:26:21 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- nvmf/common.sh@508 -- # waitforlisten 75458 00:15:25.564 11:26:21 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- common/autotest_common.sh@831 -- # '[' -z 75458 ']' 00:15:25.564 11:26:21 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- common/autotest_common.sh@835 -- # local rpc_addr=/var/tmp/spdk.sock 00:15:25.564 11:26:21 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- common/autotest_common.sh@836 -- # local max_retries=100 00:15:25.564 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:15:25.564 11:26:21 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- common/autotest_common.sh@838 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:15:25.564 11:26:21 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- common/autotest_common.sh@840 -- # xtrace_disable 00:15:25.564 11:26:21 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- common/autotest_common.sh@10 -- # set +x 00:15:25.822 [2024-10-07 11:26:21.100720] Starting SPDK v25.01-pre git sha1 2a4f56c54 / DPDK 24.03.0 initialization... 00:15:25.822 [2024-10-07 11:26:21.100820] [ DPDK EAL parameters: nvmf -c 0xE --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --iova-mode=pa --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:15:25.822 [2024-10-07 11:26:21.237843] app.c: 917:spdk_app_start: *NOTICE*: Total cores available: 3 00:15:26.080 [2024-10-07 11:26:21.357382] app.c: 610:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:15:26.080 [2024-10-07 11:26:21.357440] app.c: 611:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:15:26.080 [2024-10-07 11:26:21.357453] app.c: 616:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:15:26.080 [2024-10-07 11:26:21.357462] app.c: 617:app_setup_trace: *NOTICE*: SPDK application currently running. 00:15:26.080 [2024-10-07 11:26:21.357470] app.c: 618:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:15:26.080 [2024-10-07 11:26:21.358284] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 2 00:15:26.080 [2024-10-07 11:26:21.358348] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 3 00:15:26.080 [2024-10-07 11:26:21.358355] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 1 00:15:26.661 11:26:22 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- common/autotest_common.sh@860 -- # (( i == 0 )) 00:15:26.661 11:26:22 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- common/autotest_common.sh@864 -- # return 0 00:15:26.661 11:26:22 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- nvmf/common.sh@509 -- # timing_exit start_nvmf_tgt 00:15:26.661 11:26:22 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- common/autotest_common.sh@730 -- # xtrace_disable 00:15:26.661 11:26:22 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- common/autotest_common.sh@10 -- # set +x 00:15:26.919 11:26:22 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- nvmf/common.sh@510 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:15:26.919 11:26:22 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- target/connect_stress.sh@15 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:15:26.919 11:26:22 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:26.919 11:26:22 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- common/autotest_common.sh@10 -- # set +x 00:15:26.919 [2024-10-07 11:26:22.206265] tcp.c: 738:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:15:26.919 11:26:22 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:26.919 11:26:22 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- target/connect_stress.sh@16 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 -m 10 00:15:26.919 11:26:22 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:26.919 11:26:22 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- common/autotest_common.sh@10 -- # set +x 00:15:26.919 11:26:22 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:26.919 11:26:22 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- target/connect_stress.sh@17 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.3 -s 4420 00:15:26.919 11:26:22 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:26.919 11:26:22 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- common/autotest_common.sh@10 -- # set +x 00:15:26.919 [2024-10-07 11:26:22.236126] tcp.c:1081:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.3 port 4420 *** 00:15:26.919 11:26:22 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:26.919 11:26:22 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- target/connect_stress.sh@18 -- # rpc_cmd bdev_null_create NULL1 1000 512 00:15:26.919 11:26:22 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:26.919 11:26:22 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- common/autotest_common.sh@10 -- # set +x 00:15:26.919 NULL1 00:15:26.919 11:26:22 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:26.919 11:26:22 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- target/connect_stress.sh@21 -- # PERF_PID=75516 00:15:26.919 11:26:22 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- target/connect_stress.sh@20 -- # /home/vagrant/spdk_repo/spdk/test/nvme/connect_stress/connect_stress -c 0x1 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.3 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1' -t 10 00:15:26.919 11:26:22 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- target/connect_stress.sh@23 -- # rpcs=/home/vagrant/spdk_repo/spdk/test/nvmf/target/rpc.txt 00:15:26.919 11:26:22 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- target/connect_stress.sh@25 -- # rm -f /home/vagrant/spdk_repo/spdk/test/nvmf/target/rpc.txt 00:15:26.919 11:26:22 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- target/connect_stress.sh@27 -- # seq 1 20 00:15:26.919 11:26:22 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:15:26.919 11:26:22 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- target/connect_stress.sh@28 -- # cat 00:15:26.919 11:26:22 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:15:26.919 11:26:22 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- target/connect_stress.sh@28 -- # cat 00:15:26.919 11:26:22 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:15:26.919 11:26:22 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- target/connect_stress.sh@28 -- # cat 00:15:26.919 11:26:22 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:15:26.919 11:26:22 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- target/connect_stress.sh@28 -- # cat 00:15:26.919 11:26:22 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:15:26.919 11:26:22 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- target/connect_stress.sh@28 -- # cat 00:15:26.919 11:26:22 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:15:26.919 11:26:22 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- target/connect_stress.sh@28 -- # cat 00:15:26.919 11:26:22 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:15:26.919 11:26:22 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- target/connect_stress.sh@28 -- # cat 00:15:26.919 11:26:22 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:15:26.919 11:26:22 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- target/connect_stress.sh@28 -- # cat 00:15:26.919 11:26:22 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:15:26.919 11:26:22 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- target/connect_stress.sh@28 -- # cat 00:15:26.919 11:26:22 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:15:26.919 11:26:22 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- target/connect_stress.sh@28 -- # cat 00:15:26.919 11:26:22 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:15:26.919 11:26:22 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- target/connect_stress.sh@28 -- # cat 00:15:26.919 11:26:22 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:15:26.919 11:26:22 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- target/connect_stress.sh@28 -- # cat 00:15:26.919 11:26:22 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:15:26.919 11:26:22 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- target/connect_stress.sh@28 -- # cat 00:15:26.919 11:26:22 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:15:26.919 11:26:22 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- target/connect_stress.sh@28 -- # cat 00:15:26.919 11:26:22 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:15:26.919 11:26:22 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- target/connect_stress.sh@28 -- # cat 00:15:26.919 11:26:22 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:15:26.919 11:26:22 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- target/connect_stress.sh@28 -- # cat 00:15:26.919 11:26:22 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:15:26.919 11:26:22 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- target/connect_stress.sh@28 -- # cat 00:15:26.919 11:26:22 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:15:26.919 11:26:22 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- target/connect_stress.sh@28 -- # cat 00:15:26.919 11:26:22 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:15:26.919 11:26:22 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- target/connect_stress.sh@28 -- # cat 00:15:26.919 11:26:22 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:15:26.919 11:26:22 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- target/connect_stress.sh@28 -- # cat 00:15:26.919 11:26:22 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- target/connect_stress.sh@34 -- # kill -0 75516 00:15:26.919 11:26:22 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- target/connect_stress.sh@35 -- # rpc_cmd 00:15:26.919 11:26:22 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:26.919 11:26:22 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- common/autotest_common.sh@10 -- # set +x 00:15:27.178 11:26:22 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:27.178 11:26:22 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- target/connect_stress.sh@34 -- # kill -0 75516 00:15:27.178 11:26:22 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- target/connect_stress.sh@35 -- # rpc_cmd 00:15:27.178 11:26:22 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:27.178 11:26:22 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- common/autotest_common.sh@10 -- # set +x 00:15:27.743 11:26:22 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:27.743 11:26:22 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- target/connect_stress.sh@34 -- # kill -0 75516 00:15:27.743 11:26:22 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- target/connect_stress.sh@35 -- # rpc_cmd 00:15:27.743 11:26:22 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:27.743 11:26:22 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- common/autotest_common.sh@10 -- # set +x 00:15:28.001 11:26:23 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:28.001 11:26:23 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- target/connect_stress.sh@34 -- # kill -0 75516 00:15:28.001 11:26:23 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- target/connect_stress.sh@35 -- # rpc_cmd 00:15:28.001 11:26:23 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:28.001 11:26:23 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- common/autotest_common.sh@10 -- # set +x 00:15:28.259 11:26:23 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:28.259 11:26:23 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- target/connect_stress.sh@34 -- # kill -0 75516 00:15:28.259 11:26:23 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- target/connect_stress.sh@35 -- # rpc_cmd 00:15:28.259 11:26:23 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:28.259 11:26:23 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- common/autotest_common.sh@10 -- # set +x 00:15:28.517 11:26:23 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:28.518 11:26:23 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- target/connect_stress.sh@34 -- # kill -0 75516 00:15:28.518 11:26:23 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- target/connect_stress.sh@35 -- # rpc_cmd 00:15:28.518 11:26:23 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:28.518 11:26:23 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- common/autotest_common.sh@10 -- # set +x 00:15:28.776 11:26:24 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:28.776 11:26:24 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- target/connect_stress.sh@34 -- # kill -0 75516 00:15:28.776 11:26:24 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- target/connect_stress.sh@35 -- # rpc_cmd 00:15:28.776 11:26:24 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:28.776 11:26:24 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- common/autotest_common.sh@10 -- # set +x 00:15:29.340 11:26:24 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:29.340 11:26:24 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- target/connect_stress.sh@34 -- # kill -0 75516 00:15:29.340 11:26:24 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- target/connect_stress.sh@35 -- # rpc_cmd 00:15:29.340 11:26:24 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:29.340 11:26:24 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- common/autotest_common.sh@10 -- # set +x 00:15:29.597 11:26:24 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:29.597 11:26:24 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- target/connect_stress.sh@34 -- # kill -0 75516 00:15:29.597 11:26:24 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- target/connect_stress.sh@35 -- # rpc_cmd 00:15:29.597 11:26:24 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:29.597 11:26:24 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- common/autotest_common.sh@10 -- # set +x 00:15:29.855 11:26:25 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:29.855 11:26:25 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- target/connect_stress.sh@34 -- # kill -0 75516 00:15:29.855 11:26:25 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- target/connect_stress.sh@35 -- # rpc_cmd 00:15:29.855 11:26:25 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:29.855 11:26:25 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- common/autotest_common.sh@10 -- # set +x 00:15:30.113 11:26:25 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:30.113 11:26:25 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- target/connect_stress.sh@34 -- # kill -0 75516 00:15:30.113 11:26:25 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- target/connect_stress.sh@35 -- # rpc_cmd 00:15:30.113 11:26:25 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:30.113 11:26:25 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- common/autotest_common.sh@10 -- # set +x 00:15:30.371 11:26:25 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:30.371 11:26:25 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- target/connect_stress.sh@34 -- # kill -0 75516 00:15:30.371 11:26:25 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- target/connect_stress.sh@35 -- # rpc_cmd 00:15:30.371 11:26:25 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:30.371 11:26:25 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- common/autotest_common.sh@10 -- # set +x 00:15:30.949 11:26:26 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:30.949 11:26:26 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- target/connect_stress.sh@34 -- # kill -0 75516 00:15:30.949 11:26:26 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- target/connect_stress.sh@35 -- # rpc_cmd 00:15:30.949 11:26:26 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:30.949 11:26:26 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- common/autotest_common.sh@10 -- # set +x 00:15:31.208 11:26:26 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:31.208 11:26:26 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- target/connect_stress.sh@34 -- # kill -0 75516 00:15:31.208 11:26:26 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- target/connect_stress.sh@35 -- # rpc_cmd 00:15:31.208 11:26:26 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:31.208 11:26:26 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- common/autotest_common.sh@10 -- # set +x 00:15:31.477 11:26:26 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:31.477 11:26:26 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- target/connect_stress.sh@34 -- # kill -0 75516 00:15:31.477 11:26:26 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- target/connect_stress.sh@35 -- # rpc_cmd 00:15:31.477 11:26:26 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:31.477 11:26:26 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- common/autotest_common.sh@10 -- # set +x 00:15:31.734 11:26:27 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:31.734 11:26:27 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- target/connect_stress.sh@34 -- # kill -0 75516 00:15:31.734 11:26:27 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- target/connect_stress.sh@35 -- # rpc_cmd 00:15:31.734 11:26:27 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:31.734 11:26:27 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- common/autotest_common.sh@10 -- # set +x 00:15:31.991 11:26:27 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:31.991 11:26:27 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- target/connect_stress.sh@34 -- # kill -0 75516 00:15:31.991 11:26:27 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- target/connect_stress.sh@35 -- # rpc_cmd 00:15:31.991 11:26:27 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:31.991 11:26:27 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- common/autotest_common.sh@10 -- # set +x 00:15:32.556 11:26:27 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:32.556 11:26:27 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- target/connect_stress.sh@34 -- # kill -0 75516 00:15:32.556 11:26:27 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- target/connect_stress.sh@35 -- # rpc_cmd 00:15:32.556 11:26:27 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:32.556 11:26:27 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- common/autotest_common.sh@10 -- # set +x 00:15:32.814 11:26:28 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:32.814 11:26:28 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- target/connect_stress.sh@34 -- # kill -0 75516 00:15:32.814 11:26:28 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- target/connect_stress.sh@35 -- # rpc_cmd 00:15:32.814 11:26:28 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:32.814 11:26:28 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- common/autotest_common.sh@10 -- # set +x 00:15:33.075 11:26:28 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:33.075 11:26:28 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- target/connect_stress.sh@34 -- # kill -0 75516 00:15:33.075 11:26:28 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- target/connect_stress.sh@35 -- # rpc_cmd 00:15:33.075 11:26:28 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:33.075 11:26:28 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- common/autotest_common.sh@10 -- # set +x 00:15:33.335 11:26:28 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:33.335 11:26:28 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- target/connect_stress.sh@34 -- # kill -0 75516 00:15:33.335 11:26:28 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- target/connect_stress.sh@35 -- # rpc_cmd 00:15:33.335 11:26:28 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:33.335 11:26:28 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- common/autotest_common.sh@10 -- # set +x 00:15:33.593 11:26:29 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:33.593 11:26:29 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- target/connect_stress.sh@34 -- # kill -0 75516 00:15:33.593 11:26:29 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- target/connect_stress.sh@35 -- # rpc_cmd 00:15:33.593 11:26:29 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:33.593 11:26:29 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- common/autotest_common.sh@10 -- # set +x 00:15:34.161 11:26:29 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:34.161 11:26:29 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- target/connect_stress.sh@34 -- # kill -0 75516 00:15:34.161 11:26:29 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- target/connect_stress.sh@35 -- # rpc_cmd 00:15:34.161 11:26:29 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:34.161 11:26:29 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- common/autotest_common.sh@10 -- # set +x 00:15:34.419 11:26:29 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:34.419 11:26:29 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- target/connect_stress.sh@34 -- # kill -0 75516 00:15:34.419 11:26:29 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- target/connect_stress.sh@35 -- # rpc_cmd 00:15:34.419 11:26:29 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:34.419 11:26:29 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- common/autotest_common.sh@10 -- # set +x 00:15:34.678 11:26:30 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:34.678 11:26:30 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- target/connect_stress.sh@34 -- # kill -0 75516 00:15:34.678 11:26:30 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- target/connect_stress.sh@35 -- # rpc_cmd 00:15:34.678 11:26:30 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:34.678 11:26:30 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- common/autotest_common.sh@10 -- # set +x 00:15:34.936 11:26:30 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:34.936 11:26:30 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- target/connect_stress.sh@34 -- # kill -0 75516 00:15:34.936 11:26:30 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- target/connect_stress.sh@35 -- # rpc_cmd 00:15:34.936 11:26:30 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:34.936 11:26:30 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- common/autotest_common.sh@10 -- # set +x 00:15:35.195 11:26:30 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:35.195 11:26:30 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- target/connect_stress.sh@34 -- # kill -0 75516 00:15:35.195 11:26:30 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- target/connect_stress.sh@35 -- # rpc_cmd 00:15:35.195 11:26:30 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:35.195 11:26:30 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- common/autotest_common.sh@10 -- # set +x 00:15:35.761 11:26:30 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:35.761 11:26:30 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- target/connect_stress.sh@34 -- # kill -0 75516 00:15:35.761 11:26:30 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- target/connect_stress.sh@35 -- # rpc_cmd 00:15:35.761 11:26:30 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:35.761 11:26:30 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- common/autotest_common.sh@10 -- # set +x 00:15:36.041 11:26:31 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:36.041 11:26:31 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- target/connect_stress.sh@34 -- # kill -0 75516 00:15:36.041 11:26:31 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- target/connect_stress.sh@35 -- # rpc_cmd 00:15:36.041 11:26:31 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:36.041 11:26:31 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- common/autotest_common.sh@10 -- # set +x 00:15:36.304 11:26:31 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:36.304 11:26:31 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- target/connect_stress.sh@34 -- # kill -0 75516 00:15:36.304 11:26:31 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- target/connect_stress.sh@35 -- # rpc_cmd 00:15:36.304 11:26:31 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:36.304 11:26:31 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- common/autotest_common.sh@10 -- # set +x 00:15:36.562 11:26:31 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:36.562 11:26:31 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- target/connect_stress.sh@34 -- # kill -0 75516 00:15:36.562 11:26:31 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- target/connect_stress.sh@35 -- # rpc_cmd 00:15:36.562 11:26:31 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:36.562 11:26:31 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- common/autotest_common.sh@10 -- # set +x 00:15:36.819 11:26:32 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:36.819 11:26:32 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- target/connect_stress.sh@34 -- # kill -0 75516 00:15:36.819 11:26:32 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- target/connect_stress.sh@35 -- # rpc_cmd 00:15:36.819 11:26:32 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:36.819 11:26:32 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- common/autotest_common.sh@10 -- # set +x 00:15:37.077 Testing NVMe over Fabrics controller at 10.0.0.3:4420: nqn.2016-06.io.spdk:cnode1 00:15:37.077 11:26:32 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:37.077 11:26:32 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- target/connect_stress.sh@34 -- # kill -0 75516 00:15:37.077 /home/vagrant/spdk_repo/spdk/test/nvmf/target/connect_stress.sh: line 34: kill: (75516) - No such process 00:15:37.077 11:26:32 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- target/connect_stress.sh@38 -- # wait 75516 00:15:37.077 11:26:32 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- target/connect_stress.sh@39 -- # rm -f /home/vagrant/spdk_repo/spdk/test/nvmf/target/rpc.txt 00:15:37.335 11:26:32 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- target/connect_stress.sh@41 -- # trap - SIGINT SIGTERM EXIT 00:15:37.335 11:26:32 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- target/connect_stress.sh@43 -- # nvmftestfini 00:15:37.335 11:26:32 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- nvmf/common.sh@514 -- # nvmfcleanup 00:15:37.335 11:26:32 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- nvmf/common.sh@121 -- # sync 00:15:37.335 11:26:32 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- nvmf/common.sh@123 -- # '[' tcp == tcp ']' 00:15:37.335 11:26:32 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- nvmf/common.sh@124 -- # set +e 00:15:37.335 11:26:32 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- nvmf/common.sh@125 -- # for i in {1..20} 00:15:37.335 11:26:32 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- nvmf/common.sh@126 -- # modprobe -v -r nvme-tcp 00:15:37.335 rmmod nvme_tcp 00:15:37.335 rmmod nvme_fabrics 00:15:37.335 rmmod nvme_keyring 00:15:37.335 11:26:32 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- nvmf/common.sh@127 -- # modprobe -v -r nvme-fabrics 00:15:37.335 11:26:32 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- nvmf/common.sh@128 -- # set -e 00:15:37.335 11:26:32 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- nvmf/common.sh@129 -- # return 0 00:15:37.335 11:26:32 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- nvmf/common.sh@515 -- # '[' -n 75458 ']' 00:15:37.335 11:26:32 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- nvmf/common.sh@516 -- # killprocess 75458 00:15:37.335 11:26:32 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- common/autotest_common.sh@950 -- # '[' -z 75458 ']' 00:15:37.335 11:26:32 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- common/autotest_common.sh@954 -- # kill -0 75458 00:15:37.335 11:26:32 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- common/autotest_common.sh@955 -- # uname 00:15:37.335 11:26:32 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- common/autotest_common.sh@955 -- # '[' Linux = Linux ']' 00:15:37.335 11:26:32 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- common/autotest_common.sh@956 -- # ps --no-headers -o comm= 75458 00:15:37.335 killing process with pid 75458 00:15:37.335 11:26:32 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- common/autotest_common.sh@956 -- # process_name=reactor_1 00:15:37.335 11:26:32 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- common/autotest_common.sh@960 -- # '[' reactor_1 = sudo ']' 00:15:37.335 11:26:32 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- common/autotest_common.sh@968 -- # echo 'killing process with pid 75458' 00:15:37.335 11:26:32 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- common/autotest_common.sh@969 -- # kill 75458 00:15:37.335 11:26:32 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- common/autotest_common.sh@974 -- # wait 75458 00:15:37.593 11:26:33 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- nvmf/common.sh@518 -- # '[' '' == iso ']' 00:15:37.593 11:26:33 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- nvmf/common.sh@521 -- # [[ tcp == \t\c\p ]] 00:15:37.593 11:26:33 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- nvmf/common.sh@522 -- # nvmf_tcp_fini 00:15:37.593 11:26:33 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- nvmf/common.sh@297 -- # iptr 00:15:37.593 11:26:33 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- nvmf/common.sh@789 -- # iptables-save 00:15:37.593 11:26:33 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- nvmf/common.sh@789 -- # iptables-restore 00:15:37.593 11:26:33 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- nvmf/common.sh@789 -- # grep -v SPDK_NVMF 00:15:37.593 11:26:33 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- nvmf/common.sh@298 -- # [[ nvmf_tgt_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s\_\s\p\d\k ]] 00:15:37.593 11:26:33 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- nvmf/common.sh@299 -- # nvmf_veth_fini 00:15:37.593 11:26:33 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- nvmf/common.sh@233 -- # ip link set nvmf_init_br nomaster 00:15:37.593 11:26:33 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- nvmf/common.sh@234 -- # ip link set nvmf_init_br2 nomaster 00:15:37.593 11:26:33 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- nvmf/common.sh@235 -- # ip link set nvmf_tgt_br nomaster 00:15:37.593 11:26:33 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- nvmf/common.sh@236 -- # ip link set nvmf_tgt_br2 nomaster 00:15:37.593 11:26:33 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- nvmf/common.sh@237 -- # ip link set nvmf_init_br down 00:15:37.593 11:26:33 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- nvmf/common.sh@238 -- # ip link set nvmf_init_br2 down 00:15:37.852 11:26:33 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- nvmf/common.sh@239 -- # ip link set nvmf_tgt_br down 00:15:37.852 11:26:33 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- nvmf/common.sh@240 -- # ip link set nvmf_tgt_br2 down 00:15:37.852 11:26:33 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- nvmf/common.sh@241 -- # ip link delete nvmf_br type bridge 00:15:37.852 11:26:33 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- nvmf/common.sh@242 -- # ip link delete nvmf_init_if 00:15:37.852 11:26:33 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- nvmf/common.sh@243 -- # ip link delete nvmf_init_if2 00:15:37.852 11:26:33 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- nvmf/common.sh@244 -- # ip netns exec nvmf_tgt_ns_spdk ip link delete nvmf_tgt_if 00:15:37.852 11:26:33 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- nvmf/common.sh@245 -- # ip netns exec nvmf_tgt_ns_spdk ip link delete nvmf_tgt_if2 00:15:37.852 11:26:33 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- nvmf/common.sh@246 -- # remove_spdk_ns 00:15:37.852 11:26:33 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- nvmf/common.sh@654 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:15:37.852 11:26:33 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 15> /dev/null' 00:15:37.852 11:26:33 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:15:37.852 11:26:33 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- nvmf/common.sh@300 -- # return 0 00:15:37.852 00:15:37.852 real 0m12.851s 00:15:37.852 user 0m41.500s 00:15:37.852 sys 0m3.435s 00:15:37.852 11:26:33 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- common/autotest_common.sh@1126 -- # xtrace_disable 00:15:37.852 ************************************ 00:15:37.852 END TEST nvmf_connect_stress 00:15:37.852 ************************************ 00:15:37.852 11:26:33 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- common/autotest_common.sh@10 -- # set +x 00:15:37.852 11:26:33 nvmf_tcp.nvmf_target_extra -- nvmf/nvmf_target_extra.sh@25 -- # run_test nvmf_fused_ordering /home/vagrant/spdk_repo/spdk/test/nvmf/target/fused_ordering.sh --transport=tcp 00:15:37.852 11:26:33 nvmf_tcp.nvmf_target_extra -- common/autotest_common.sh@1101 -- # '[' 3 -le 1 ']' 00:15:37.852 11:26:33 nvmf_tcp.nvmf_target_extra -- common/autotest_common.sh@1107 -- # xtrace_disable 00:15:37.852 11:26:33 nvmf_tcp.nvmf_target_extra -- common/autotest_common.sh@10 -- # set +x 00:15:37.852 ************************************ 00:15:37.852 START TEST nvmf_fused_ordering 00:15:37.852 ************************************ 00:15:37.852 11:26:33 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- common/autotest_common.sh@1125 -- # /home/vagrant/spdk_repo/spdk/test/nvmf/target/fused_ordering.sh --transport=tcp 00:15:38.111 * Looking for test storage... 00:15:38.111 * Found test storage at /home/vagrant/spdk_repo/spdk/test/nvmf/target 00:15:38.111 11:26:33 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- common/autotest_common.sh@1680 -- # [[ y == y ]] 00:15:38.111 11:26:33 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- common/autotest_common.sh@1681 -- # lcov --version 00:15:38.111 11:26:33 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- common/autotest_common.sh@1681 -- # awk '{print $NF}' 00:15:38.111 11:26:33 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- common/autotest_common.sh@1681 -- # lt 1.15 2 00:15:38.111 11:26:33 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- scripts/common.sh@373 -- # cmp_versions 1.15 '<' 2 00:15:38.111 11:26:33 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- scripts/common.sh@333 -- # local ver1 ver1_l 00:15:38.111 11:26:33 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- scripts/common.sh@334 -- # local ver2 ver2_l 00:15:38.111 11:26:33 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- scripts/common.sh@336 -- # IFS=.-: 00:15:38.111 11:26:33 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- scripts/common.sh@336 -- # read -ra ver1 00:15:38.111 11:26:33 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- scripts/common.sh@337 -- # IFS=.-: 00:15:38.111 11:26:33 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- scripts/common.sh@337 -- # read -ra ver2 00:15:38.111 11:26:33 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- scripts/common.sh@338 -- # local 'op=<' 00:15:38.111 11:26:33 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- scripts/common.sh@340 -- # ver1_l=2 00:15:38.111 11:26:33 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- scripts/common.sh@341 -- # ver2_l=1 00:15:38.111 11:26:33 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- scripts/common.sh@343 -- # local lt=0 gt=0 eq=0 v 00:15:38.111 11:26:33 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- scripts/common.sh@344 -- # case "$op" in 00:15:38.111 11:26:33 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- scripts/common.sh@345 -- # : 1 00:15:38.111 11:26:33 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- scripts/common.sh@364 -- # (( v = 0 )) 00:15:38.111 11:26:33 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- scripts/common.sh@364 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:15:38.111 11:26:33 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- scripts/common.sh@365 -- # decimal 1 00:15:38.111 11:26:33 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- scripts/common.sh@353 -- # local d=1 00:15:38.111 11:26:33 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- scripts/common.sh@354 -- # [[ 1 =~ ^[0-9]+$ ]] 00:15:38.111 11:26:33 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- scripts/common.sh@355 -- # echo 1 00:15:38.111 11:26:33 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- scripts/common.sh@365 -- # ver1[v]=1 00:15:38.111 11:26:33 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- scripts/common.sh@366 -- # decimal 2 00:15:38.111 11:26:33 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- scripts/common.sh@353 -- # local d=2 00:15:38.111 11:26:33 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- scripts/common.sh@354 -- # [[ 2 =~ ^[0-9]+$ ]] 00:15:38.111 11:26:33 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- scripts/common.sh@355 -- # echo 2 00:15:38.111 11:26:33 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- scripts/common.sh@366 -- # ver2[v]=2 00:15:38.111 11:26:33 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- scripts/common.sh@367 -- # (( ver1[v] > ver2[v] )) 00:15:38.111 11:26:33 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- scripts/common.sh@368 -- # (( ver1[v] < ver2[v] )) 00:15:38.111 11:26:33 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- scripts/common.sh@368 -- # return 0 00:15:38.111 11:26:33 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- common/autotest_common.sh@1682 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:15:38.111 11:26:33 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- common/autotest_common.sh@1694 -- # export 'LCOV_OPTS= 00:15:38.111 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:15:38.111 --rc genhtml_branch_coverage=1 00:15:38.111 --rc genhtml_function_coverage=1 00:15:38.111 --rc genhtml_legend=1 00:15:38.111 --rc geninfo_all_blocks=1 00:15:38.111 --rc geninfo_unexecuted_blocks=1 00:15:38.111 00:15:38.111 ' 00:15:38.111 11:26:33 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- common/autotest_common.sh@1694 -- # LCOV_OPTS=' 00:15:38.111 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:15:38.111 --rc genhtml_branch_coverage=1 00:15:38.111 --rc genhtml_function_coverage=1 00:15:38.111 --rc genhtml_legend=1 00:15:38.111 --rc geninfo_all_blocks=1 00:15:38.111 --rc geninfo_unexecuted_blocks=1 00:15:38.111 00:15:38.111 ' 00:15:38.111 11:26:33 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- common/autotest_common.sh@1695 -- # export 'LCOV=lcov 00:15:38.111 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:15:38.111 --rc genhtml_branch_coverage=1 00:15:38.111 --rc genhtml_function_coverage=1 00:15:38.111 --rc genhtml_legend=1 00:15:38.111 --rc geninfo_all_blocks=1 00:15:38.111 --rc geninfo_unexecuted_blocks=1 00:15:38.111 00:15:38.111 ' 00:15:38.111 11:26:33 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- common/autotest_common.sh@1695 -- # LCOV='lcov 00:15:38.111 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:15:38.111 --rc genhtml_branch_coverage=1 00:15:38.111 --rc genhtml_function_coverage=1 00:15:38.111 --rc genhtml_legend=1 00:15:38.111 --rc geninfo_all_blocks=1 00:15:38.111 --rc geninfo_unexecuted_blocks=1 00:15:38.111 00:15:38.111 ' 00:15:38.111 11:26:33 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- target/fused_ordering.sh@10 -- # source /home/vagrant/spdk_repo/spdk/test/nvmf/common.sh 00:15:38.111 11:26:33 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- nvmf/common.sh@7 -- # uname -s 00:15:38.111 11:26:33 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:15:38.111 11:26:33 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:15:38.111 11:26:33 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:15:38.111 11:26:33 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:15:38.111 11:26:33 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:15:38.111 11:26:33 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:15:38.111 11:26:33 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:15:38.111 11:26:33 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:15:38.111 11:26:33 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:15:38.111 11:26:33 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:15:38.111 11:26:33 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:c758a4ed-f09f-4c82-9afb-3d096f035464 00:15:38.111 11:26:33 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- nvmf/common.sh@18 -- # NVME_HOSTID=c758a4ed-f09f-4c82-9afb-3d096f035464 00:15:38.111 11:26:33 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:15:38.111 11:26:33 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:15:38.111 11:26:33 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- nvmf/common.sh@21 -- # NET_TYPE=virt 00:15:38.111 11:26:33 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:15:38.111 11:26:33 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- nvmf/common.sh@49 -- # source /home/vagrant/spdk_repo/spdk/scripts/common.sh 00:15:38.111 11:26:33 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- scripts/common.sh@15 -- # shopt -s extglob 00:15:38.111 11:26:33 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- scripts/common.sh@544 -- # [[ -e /bin/wpdk_common.sh ]] 00:15:38.111 11:26:33 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- scripts/common.sh@552 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:15:38.111 11:26:33 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- scripts/common.sh@553 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:15:38.111 11:26:33 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:38.111 11:26:33 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:38.112 11:26:33 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:38.112 11:26:33 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- paths/export.sh@5 -- # export PATH 00:15:38.112 11:26:33 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:38.112 11:26:33 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- nvmf/common.sh@51 -- # : 0 00:15:38.112 11:26:33 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- nvmf/common.sh@52 -- # export NVMF_APP_SHM_ID 00:15:38.112 11:26:33 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- nvmf/common.sh@53 -- # build_nvmf_app_args 00:15:38.112 11:26:33 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:15:38.112 11:26:33 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:15:38.112 11:26:33 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:15:38.112 11:26:33 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- nvmf/common.sh@33 -- # '[' '' -eq 1 ']' 00:15:38.112 /home/vagrant/spdk_repo/spdk/test/nvmf/common.sh: line 33: [: : integer expression expected 00:15:38.112 11:26:33 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- nvmf/common.sh@37 -- # '[' -n '' ']' 00:15:38.112 11:26:33 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- nvmf/common.sh@39 -- # '[' 0 -eq 1 ']' 00:15:38.112 11:26:33 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- nvmf/common.sh@55 -- # have_pci_nics=0 00:15:38.112 11:26:33 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- target/fused_ordering.sh@12 -- # nvmftestinit 00:15:38.112 11:26:33 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- nvmf/common.sh@467 -- # '[' -z tcp ']' 00:15:38.112 11:26:33 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- nvmf/common.sh@472 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:15:38.112 11:26:33 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- nvmf/common.sh@474 -- # prepare_net_devs 00:15:38.112 11:26:33 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- nvmf/common.sh@436 -- # local -g is_hw=no 00:15:38.112 11:26:33 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- nvmf/common.sh@438 -- # remove_spdk_ns 00:15:38.112 11:26:33 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- nvmf/common.sh@654 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:15:38.112 11:26:33 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 15> /dev/null' 00:15:38.112 11:26:33 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:15:38.112 11:26:33 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- nvmf/common.sh@440 -- # [[ virt != virt ]] 00:15:38.112 11:26:33 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- nvmf/common.sh@442 -- # [[ no == yes ]] 00:15:38.112 11:26:33 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- nvmf/common.sh@449 -- # [[ virt == phy ]] 00:15:38.112 11:26:33 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- nvmf/common.sh@452 -- # [[ virt == phy-fallback ]] 00:15:38.112 11:26:33 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- nvmf/common.sh@457 -- # [[ tcp == tcp ]] 00:15:38.112 11:26:33 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- nvmf/common.sh@458 -- # nvmf_veth_init 00:15:38.112 11:26:33 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- nvmf/common.sh@145 -- # NVMF_FIRST_INITIATOR_IP=10.0.0.1 00:15:38.112 11:26:33 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- nvmf/common.sh@146 -- # NVMF_SECOND_INITIATOR_IP=10.0.0.2 00:15:38.112 11:26:33 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- nvmf/common.sh@147 -- # NVMF_FIRST_TARGET_IP=10.0.0.3 00:15:38.112 11:26:33 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- nvmf/common.sh@148 -- # NVMF_SECOND_TARGET_IP=10.0.0.4 00:15:38.112 11:26:33 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- nvmf/common.sh@149 -- # NVMF_INITIATOR_IP=10.0.0.1 00:15:38.112 11:26:33 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- nvmf/common.sh@150 -- # NVMF_BRIDGE=nvmf_br 00:15:38.112 11:26:33 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- nvmf/common.sh@151 -- # NVMF_INITIATOR_INTERFACE=nvmf_init_if 00:15:38.112 11:26:33 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- nvmf/common.sh@152 -- # NVMF_INITIATOR_INTERFACE2=nvmf_init_if2 00:15:38.112 11:26:33 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- nvmf/common.sh@153 -- # NVMF_INITIATOR_BRIDGE=nvmf_init_br 00:15:38.112 11:26:33 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- nvmf/common.sh@154 -- # NVMF_INITIATOR_BRIDGE2=nvmf_init_br2 00:15:38.112 11:26:33 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- nvmf/common.sh@155 -- # NVMF_TARGET_NAMESPACE=nvmf_tgt_ns_spdk 00:15:38.112 11:26:33 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- nvmf/common.sh@156 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:15:38.112 11:26:33 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- nvmf/common.sh@157 -- # NVMF_TARGET_INTERFACE=nvmf_tgt_if 00:15:38.112 11:26:33 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- nvmf/common.sh@158 -- # NVMF_TARGET_INTERFACE2=nvmf_tgt_if2 00:15:38.112 11:26:33 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- nvmf/common.sh@159 -- # NVMF_TARGET_BRIDGE=nvmf_tgt_br 00:15:38.112 11:26:33 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- nvmf/common.sh@160 -- # NVMF_TARGET_BRIDGE2=nvmf_tgt_br2 00:15:38.112 11:26:33 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- nvmf/common.sh@162 -- # ip link set nvmf_init_br nomaster 00:15:38.112 Cannot find device "nvmf_init_br" 00:15:38.112 11:26:33 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- nvmf/common.sh@162 -- # true 00:15:38.112 11:26:33 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- nvmf/common.sh@163 -- # ip link set nvmf_init_br2 nomaster 00:15:38.112 Cannot find device "nvmf_init_br2" 00:15:38.112 11:26:33 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- nvmf/common.sh@163 -- # true 00:15:38.112 11:26:33 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- nvmf/common.sh@164 -- # ip link set nvmf_tgt_br nomaster 00:15:38.112 Cannot find device "nvmf_tgt_br" 00:15:38.112 11:26:33 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- nvmf/common.sh@164 -- # true 00:15:38.112 11:26:33 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- nvmf/common.sh@165 -- # ip link set nvmf_tgt_br2 nomaster 00:15:38.112 Cannot find device "nvmf_tgt_br2" 00:15:38.112 11:26:33 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- nvmf/common.sh@165 -- # true 00:15:38.112 11:26:33 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- nvmf/common.sh@166 -- # ip link set nvmf_init_br down 00:15:38.112 Cannot find device "nvmf_init_br" 00:15:38.112 11:26:33 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- nvmf/common.sh@166 -- # true 00:15:38.112 11:26:33 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- nvmf/common.sh@167 -- # ip link set nvmf_init_br2 down 00:15:38.112 Cannot find device "nvmf_init_br2" 00:15:38.112 11:26:33 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- nvmf/common.sh@167 -- # true 00:15:38.112 11:26:33 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- nvmf/common.sh@168 -- # ip link set nvmf_tgt_br down 00:15:38.112 Cannot find device "nvmf_tgt_br" 00:15:38.112 11:26:33 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- nvmf/common.sh@168 -- # true 00:15:38.112 11:26:33 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- nvmf/common.sh@169 -- # ip link set nvmf_tgt_br2 down 00:15:38.112 Cannot find device "nvmf_tgt_br2" 00:15:38.112 11:26:33 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- nvmf/common.sh@169 -- # true 00:15:38.112 11:26:33 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- nvmf/common.sh@170 -- # ip link delete nvmf_br type bridge 00:15:38.112 Cannot find device "nvmf_br" 00:15:38.112 11:26:33 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- nvmf/common.sh@170 -- # true 00:15:38.112 11:26:33 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- nvmf/common.sh@171 -- # ip link delete nvmf_init_if 00:15:38.370 Cannot find device "nvmf_init_if" 00:15:38.370 11:26:33 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- nvmf/common.sh@171 -- # true 00:15:38.370 11:26:33 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- nvmf/common.sh@172 -- # ip link delete nvmf_init_if2 00:15:38.370 Cannot find device "nvmf_init_if2" 00:15:38.370 11:26:33 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- nvmf/common.sh@172 -- # true 00:15:38.370 11:26:33 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- nvmf/common.sh@173 -- # ip netns exec nvmf_tgt_ns_spdk ip link delete nvmf_tgt_if 00:15:38.370 Cannot open network namespace "nvmf_tgt_ns_spdk": No such file or directory 00:15:38.370 11:26:33 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- nvmf/common.sh@173 -- # true 00:15:38.370 11:26:33 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- nvmf/common.sh@174 -- # ip netns exec nvmf_tgt_ns_spdk ip link delete nvmf_tgt_if2 00:15:38.370 Cannot open network namespace "nvmf_tgt_ns_spdk": No such file or directory 00:15:38.370 11:26:33 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- nvmf/common.sh@174 -- # true 00:15:38.370 11:26:33 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- nvmf/common.sh@177 -- # ip netns add nvmf_tgt_ns_spdk 00:15:38.370 11:26:33 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- nvmf/common.sh@180 -- # ip link add nvmf_init_if type veth peer name nvmf_init_br 00:15:38.370 11:26:33 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- nvmf/common.sh@181 -- # ip link add nvmf_init_if2 type veth peer name nvmf_init_br2 00:15:38.370 11:26:33 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- nvmf/common.sh@182 -- # ip link add nvmf_tgt_if type veth peer name nvmf_tgt_br 00:15:38.370 11:26:33 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- nvmf/common.sh@183 -- # ip link add nvmf_tgt_if2 type veth peer name nvmf_tgt_br2 00:15:38.370 11:26:33 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- nvmf/common.sh@186 -- # ip link set nvmf_tgt_if netns nvmf_tgt_ns_spdk 00:15:38.370 11:26:33 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- nvmf/common.sh@187 -- # ip link set nvmf_tgt_if2 netns nvmf_tgt_ns_spdk 00:15:38.370 11:26:33 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- nvmf/common.sh@190 -- # ip addr add 10.0.0.1/24 dev nvmf_init_if 00:15:38.370 11:26:33 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- nvmf/common.sh@191 -- # ip addr add 10.0.0.2/24 dev nvmf_init_if2 00:15:38.370 11:26:33 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- nvmf/common.sh@192 -- # ip netns exec nvmf_tgt_ns_spdk ip addr add 10.0.0.3/24 dev nvmf_tgt_if 00:15:38.370 11:26:33 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- nvmf/common.sh@193 -- # ip netns exec nvmf_tgt_ns_spdk ip addr add 10.0.0.4/24 dev nvmf_tgt_if2 00:15:38.370 11:26:33 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- nvmf/common.sh@196 -- # ip link set nvmf_init_if up 00:15:38.370 11:26:33 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- nvmf/common.sh@197 -- # ip link set nvmf_init_if2 up 00:15:38.370 11:26:33 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- nvmf/common.sh@198 -- # ip link set nvmf_init_br up 00:15:38.370 11:26:33 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- nvmf/common.sh@199 -- # ip link set nvmf_init_br2 up 00:15:38.370 11:26:33 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- nvmf/common.sh@200 -- # ip link set nvmf_tgt_br up 00:15:38.370 11:26:33 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- nvmf/common.sh@201 -- # ip link set nvmf_tgt_br2 up 00:15:38.370 11:26:33 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- nvmf/common.sh@202 -- # ip netns exec nvmf_tgt_ns_spdk ip link set nvmf_tgt_if up 00:15:38.370 11:26:33 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- nvmf/common.sh@203 -- # ip netns exec nvmf_tgt_ns_spdk ip link set nvmf_tgt_if2 up 00:15:38.370 11:26:33 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- nvmf/common.sh@204 -- # ip netns exec nvmf_tgt_ns_spdk ip link set lo up 00:15:38.370 11:26:33 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- nvmf/common.sh@207 -- # ip link add nvmf_br type bridge 00:15:38.370 11:26:33 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- nvmf/common.sh@208 -- # ip link set nvmf_br up 00:15:38.370 11:26:33 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- nvmf/common.sh@211 -- # ip link set nvmf_init_br master nvmf_br 00:15:38.370 11:26:33 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- nvmf/common.sh@212 -- # ip link set nvmf_init_br2 master nvmf_br 00:15:38.370 11:26:33 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- nvmf/common.sh@213 -- # ip link set nvmf_tgt_br master nvmf_br 00:15:38.370 11:26:33 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- nvmf/common.sh@214 -- # ip link set nvmf_tgt_br2 master nvmf_br 00:15:38.629 11:26:33 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- nvmf/common.sh@217 -- # ipts -I INPUT 1 -i nvmf_init_if -p tcp --dport 4420 -j ACCEPT 00:15:38.629 11:26:33 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- nvmf/common.sh@788 -- # iptables -I INPUT 1 -i nvmf_init_if -p tcp --dport 4420 -j ACCEPT -m comment --comment 'SPDK_NVMF:-I INPUT 1 -i nvmf_init_if -p tcp --dport 4420 -j ACCEPT' 00:15:38.629 11:26:33 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- nvmf/common.sh@218 -- # ipts -I INPUT 1 -i nvmf_init_if2 -p tcp --dport 4420 -j ACCEPT 00:15:38.629 11:26:33 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- nvmf/common.sh@788 -- # iptables -I INPUT 1 -i nvmf_init_if2 -p tcp --dport 4420 -j ACCEPT -m comment --comment 'SPDK_NVMF:-I INPUT 1 -i nvmf_init_if2 -p tcp --dport 4420 -j ACCEPT' 00:15:38.629 11:26:33 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- nvmf/common.sh@219 -- # ipts -A FORWARD -i nvmf_br -o nvmf_br -j ACCEPT 00:15:38.629 11:26:33 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- nvmf/common.sh@788 -- # iptables -A FORWARD -i nvmf_br -o nvmf_br -j ACCEPT -m comment --comment 'SPDK_NVMF:-A FORWARD -i nvmf_br -o nvmf_br -j ACCEPT' 00:15:38.629 11:26:33 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- nvmf/common.sh@222 -- # ping -c 1 10.0.0.3 00:15:38.629 PING 10.0.0.3 (10.0.0.3) 56(84) bytes of data. 00:15:38.629 64 bytes from 10.0.0.3: icmp_seq=1 ttl=64 time=0.081 ms 00:15:38.629 00:15:38.629 --- 10.0.0.3 ping statistics --- 00:15:38.629 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:15:38.629 rtt min/avg/max/mdev = 0.081/0.081/0.081/0.000 ms 00:15:38.629 11:26:33 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- nvmf/common.sh@223 -- # ping -c 1 10.0.0.4 00:15:38.629 PING 10.0.0.4 (10.0.0.4) 56(84) bytes of data. 00:15:38.629 64 bytes from 10.0.0.4: icmp_seq=1 ttl=64 time=0.125 ms 00:15:38.629 00:15:38.629 --- 10.0.0.4 ping statistics --- 00:15:38.629 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:15:38.629 rtt min/avg/max/mdev = 0.125/0.125/0.125/0.000 ms 00:15:38.629 11:26:33 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- nvmf/common.sh@224 -- # ip netns exec nvmf_tgt_ns_spdk ping -c 1 10.0.0.1 00:15:38.629 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:15:38.629 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.029 ms 00:15:38.629 00:15:38.629 --- 10.0.0.1 ping statistics --- 00:15:38.629 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:15:38.629 rtt min/avg/max/mdev = 0.029/0.029/0.029/0.000 ms 00:15:38.629 11:26:33 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- nvmf/common.sh@225 -- # ip netns exec nvmf_tgt_ns_spdk ping -c 1 10.0.0.2 00:15:38.629 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:15:38.629 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.047 ms 00:15:38.629 00:15:38.629 --- 10.0.0.2 ping statistics --- 00:15:38.629 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:15:38.629 rtt min/avg/max/mdev = 0.047/0.047/0.047/0.000 ms 00:15:38.629 11:26:33 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- nvmf/common.sh@227 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:15:38.629 11:26:33 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- nvmf/common.sh@459 -- # return 0 00:15:38.629 11:26:33 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- nvmf/common.sh@476 -- # '[' '' == iso ']' 00:15:38.629 11:26:33 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- nvmf/common.sh@480 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:15:38.629 11:26:33 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- nvmf/common.sh@481 -- # [[ tcp == \r\d\m\a ]] 00:15:38.629 11:26:33 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- nvmf/common.sh@490 -- # [[ tcp == \t\c\p ]] 00:15:38.629 11:26:33 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- nvmf/common.sh@491 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:15:38.629 11:26:33 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- nvmf/common.sh@494 -- # '[' tcp == tcp ']' 00:15:38.629 11:26:33 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- nvmf/common.sh@500 -- # modprobe nvme-tcp 00:15:38.629 11:26:33 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- target/fused_ordering.sh@13 -- # nvmfappstart -m 0x2 00:15:38.629 11:26:33 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- nvmf/common.sh@505 -- # timing_enter start_nvmf_tgt 00:15:38.629 11:26:33 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- common/autotest_common.sh@724 -- # xtrace_disable 00:15:38.629 11:26:33 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- common/autotest_common.sh@10 -- # set +x 00:15:38.629 11:26:33 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- nvmf/common.sh@507 -- # nvmfpid=75895 00:15:38.629 11:26:33 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- nvmf/common.sh@506 -- # ip netns exec nvmf_tgt_ns_spdk /home/vagrant/spdk_repo/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x2 00:15:38.629 11:26:33 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- nvmf/common.sh@508 -- # waitforlisten 75895 00:15:38.629 11:26:33 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- common/autotest_common.sh@831 -- # '[' -z 75895 ']' 00:15:38.629 11:26:33 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- common/autotest_common.sh@835 -- # local rpc_addr=/var/tmp/spdk.sock 00:15:38.629 11:26:33 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- common/autotest_common.sh@836 -- # local max_retries=100 00:15:38.629 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:15:38.629 11:26:33 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- common/autotest_common.sh@838 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:15:38.629 11:26:33 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- common/autotest_common.sh@840 -- # xtrace_disable 00:15:38.629 11:26:33 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- common/autotest_common.sh@10 -- # set +x 00:15:38.629 [2024-10-07 11:26:34.041677] Starting SPDK v25.01-pre git sha1 2a4f56c54 / DPDK 24.03.0 initialization... 00:15:38.629 [2024-10-07 11:26:34.041803] [ DPDK EAL parameters: nvmf -c 0x2 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --iova-mode=pa --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:15:38.887 [2024-10-07 11:26:34.183030] app.c: 917:spdk_app_start: *NOTICE*: Total cores available: 1 00:15:38.887 [2024-10-07 11:26:34.363001] app.c: 610:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:15:38.887 [2024-10-07 11:26:34.363107] app.c: 611:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:15:38.887 [2024-10-07 11:26:34.363124] app.c: 616:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:15:38.887 [2024-10-07 11:26:34.363136] app.c: 617:app_setup_trace: *NOTICE*: SPDK application currently running. 00:15:38.887 [2024-10-07 11:26:34.363146] app.c: 618:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:15:38.887 [2024-10-07 11:26:34.363724] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 1 00:15:39.821 11:26:35 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- common/autotest_common.sh@860 -- # (( i == 0 )) 00:15:39.821 11:26:35 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- common/autotest_common.sh@864 -- # return 0 00:15:39.821 11:26:35 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- nvmf/common.sh@509 -- # timing_exit start_nvmf_tgt 00:15:39.821 11:26:35 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- common/autotest_common.sh@730 -- # xtrace_disable 00:15:39.821 11:26:35 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- common/autotest_common.sh@10 -- # set +x 00:15:39.821 11:26:35 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- nvmf/common.sh@510 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:15:39.821 11:26:35 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- target/fused_ordering.sh@15 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:15:39.821 11:26:35 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:39.821 11:26:35 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- common/autotest_common.sh@10 -- # set +x 00:15:39.821 [2024-10-07 11:26:35.170199] tcp.c: 738:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:15:39.821 11:26:35 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:39.821 11:26:35 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- target/fused_ordering.sh@16 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 -m 10 00:15:39.821 11:26:35 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:39.821 11:26:35 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- common/autotest_common.sh@10 -- # set +x 00:15:39.821 11:26:35 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:39.821 11:26:35 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- target/fused_ordering.sh@17 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.3 -s 4420 00:15:39.821 11:26:35 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:39.821 11:26:35 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- common/autotest_common.sh@10 -- # set +x 00:15:39.821 [2024-10-07 11:26:35.186336] tcp.c:1081:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.3 port 4420 *** 00:15:39.821 11:26:35 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:39.821 11:26:35 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- target/fused_ordering.sh@18 -- # rpc_cmd bdev_null_create NULL1 1000 512 00:15:39.822 11:26:35 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:39.822 11:26:35 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- common/autotest_common.sh@10 -- # set +x 00:15:39.822 NULL1 00:15:39.822 11:26:35 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:39.822 11:26:35 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- target/fused_ordering.sh@19 -- # rpc_cmd bdev_wait_for_examine 00:15:39.822 11:26:35 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:39.822 11:26:35 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- common/autotest_common.sh@10 -- # set +x 00:15:39.822 11:26:35 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:39.822 11:26:35 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- target/fused_ordering.sh@20 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 NULL1 00:15:39.822 11:26:35 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:39.822 11:26:35 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- common/autotest_common.sh@10 -- # set +x 00:15:39.822 11:26:35 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:39.822 11:26:35 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- target/fused_ordering.sh@22 -- # /home/vagrant/spdk_repo/spdk/test/nvme/fused_ordering/fused_ordering -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.3 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1' 00:15:39.822 [2024-10-07 11:26:35.238492] Starting SPDK v25.01-pre git sha1 2a4f56c54 / DPDK 24.03.0 initialization... 00:15:39.822 [2024-10-07 11:26:35.238552] [ DPDK EAL parameters: fused_ordering --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --iova-mode=pa --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid75945 ] 00:15:40.387 Attached to nqn.2016-06.io.spdk:cnode1 00:15:40.387 Namespace ID: 1 size: 1GB 00:15:40.387 fused_ordering(0) 00:15:40.387 fused_ordering(1) 00:15:40.387 fused_ordering(2) 00:15:40.387 fused_ordering(3) 00:15:40.387 fused_ordering(4) 00:15:40.387 fused_ordering(5) 00:15:40.387 fused_ordering(6) 00:15:40.387 fused_ordering(7) 00:15:40.387 fused_ordering(8) 00:15:40.387 fused_ordering(9) 00:15:40.387 fused_ordering(10) 00:15:40.387 fused_ordering(11) 00:15:40.387 fused_ordering(12) 00:15:40.387 fused_ordering(13) 00:15:40.387 fused_ordering(14) 00:15:40.387 fused_ordering(15) 00:15:40.387 fused_ordering(16) 00:15:40.387 fused_ordering(17) 00:15:40.387 fused_ordering(18) 00:15:40.387 fused_ordering(19) 00:15:40.387 fused_ordering(20) 00:15:40.387 fused_ordering(21) 00:15:40.387 fused_ordering(22) 00:15:40.387 fused_ordering(23) 00:15:40.387 fused_ordering(24) 00:15:40.387 fused_ordering(25) 00:15:40.387 fused_ordering(26) 00:15:40.387 fused_ordering(27) 00:15:40.387 fused_ordering(28) 00:15:40.387 fused_ordering(29) 00:15:40.387 fused_ordering(30) 00:15:40.387 fused_ordering(31) 00:15:40.387 fused_ordering(32) 00:15:40.387 fused_ordering(33) 00:15:40.387 fused_ordering(34) 00:15:40.387 fused_ordering(35) 00:15:40.387 fused_ordering(36) 00:15:40.387 fused_ordering(37) 00:15:40.387 fused_ordering(38) 00:15:40.387 fused_ordering(39) 00:15:40.387 fused_ordering(40) 00:15:40.387 fused_ordering(41) 00:15:40.387 fused_ordering(42) 00:15:40.387 fused_ordering(43) 00:15:40.387 fused_ordering(44) 00:15:40.387 fused_ordering(45) 00:15:40.387 fused_ordering(46) 00:15:40.387 fused_ordering(47) 00:15:40.387 fused_ordering(48) 00:15:40.387 fused_ordering(49) 00:15:40.387 fused_ordering(50) 00:15:40.387 fused_ordering(51) 00:15:40.387 fused_ordering(52) 00:15:40.387 fused_ordering(53) 00:15:40.387 fused_ordering(54) 00:15:40.387 fused_ordering(55) 00:15:40.387 fused_ordering(56) 00:15:40.387 fused_ordering(57) 00:15:40.387 fused_ordering(58) 00:15:40.387 fused_ordering(59) 00:15:40.387 fused_ordering(60) 00:15:40.387 fused_ordering(61) 00:15:40.387 fused_ordering(62) 00:15:40.387 fused_ordering(63) 00:15:40.387 fused_ordering(64) 00:15:40.387 fused_ordering(65) 00:15:40.387 fused_ordering(66) 00:15:40.387 fused_ordering(67) 00:15:40.387 fused_ordering(68) 00:15:40.387 fused_ordering(69) 00:15:40.387 fused_ordering(70) 00:15:40.387 fused_ordering(71) 00:15:40.387 fused_ordering(72) 00:15:40.387 fused_ordering(73) 00:15:40.387 fused_ordering(74) 00:15:40.387 fused_ordering(75) 00:15:40.387 fused_ordering(76) 00:15:40.387 fused_ordering(77) 00:15:40.387 fused_ordering(78) 00:15:40.387 fused_ordering(79) 00:15:40.387 fused_ordering(80) 00:15:40.387 fused_ordering(81) 00:15:40.387 fused_ordering(82) 00:15:40.387 fused_ordering(83) 00:15:40.387 fused_ordering(84) 00:15:40.387 fused_ordering(85) 00:15:40.387 fused_ordering(86) 00:15:40.387 fused_ordering(87) 00:15:40.387 fused_ordering(88) 00:15:40.387 fused_ordering(89) 00:15:40.387 fused_ordering(90) 00:15:40.387 fused_ordering(91) 00:15:40.387 fused_ordering(92) 00:15:40.387 fused_ordering(93) 00:15:40.387 fused_ordering(94) 00:15:40.387 fused_ordering(95) 00:15:40.387 fused_ordering(96) 00:15:40.387 fused_ordering(97) 00:15:40.387 fused_ordering(98) 00:15:40.387 fused_ordering(99) 00:15:40.387 fused_ordering(100) 00:15:40.387 fused_ordering(101) 00:15:40.387 fused_ordering(102) 00:15:40.387 fused_ordering(103) 00:15:40.387 fused_ordering(104) 00:15:40.387 fused_ordering(105) 00:15:40.387 fused_ordering(106) 00:15:40.387 fused_ordering(107) 00:15:40.387 fused_ordering(108) 00:15:40.387 fused_ordering(109) 00:15:40.387 fused_ordering(110) 00:15:40.387 fused_ordering(111) 00:15:40.387 fused_ordering(112) 00:15:40.387 fused_ordering(113) 00:15:40.387 fused_ordering(114) 00:15:40.387 fused_ordering(115) 00:15:40.387 fused_ordering(116) 00:15:40.387 fused_ordering(117) 00:15:40.387 fused_ordering(118) 00:15:40.387 fused_ordering(119) 00:15:40.387 fused_ordering(120) 00:15:40.387 fused_ordering(121) 00:15:40.387 fused_ordering(122) 00:15:40.388 fused_ordering(123) 00:15:40.388 fused_ordering(124) 00:15:40.388 fused_ordering(125) 00:15:40.388 fused_ordering(126) 00:15:40.388 fused_ordering(127) 00:15:40.388 fused_ordering(128) 00:15:40.388 fused_ordering(129) 00:15:40.388 fused_ordering(130) 00:15:40.388 fused_ordering(131) 00:15:40.388 fused_ordering(132) 00:15:40.388 fused_ordering(133) 00:15:40.388 fused_ordering(134) 00:15:40.388 fused_ordering(135) 00:15:40.388 fused_ordering(136) 00:15:40.388 fused_ordering(137) 00:15:40.388 fused_ordering(138) 00:15:40.388 fused_ordering(139) 00:15:40.388 fused_ordering(140) 00:15:40.388 fused_ordering(141) 00:15:40.388 fused_ordering(142) 00:15:40.388 fused_ordering(143) 00:15:40.388 fused_ordering(144) 00:15:40.388 fused_ordering(145) 00:15:40.388 fused_ordering(146) 00:15:40.388 fused_ordering(147) 00:15:40.388 fused_ordering(148) 00:15:40.388 fused_ordering(149) 00:15:40.388 fused_ordering(150) 00:15:40.388 fused_ordering(151) 00:15:40.388 fused_ordering(152) 00:15:40.388 fused_ordering(153) 00:15:40.388 fused_ordering(154) 00:15:40.388 fused_ordering(155) 00:15:40.388 fused_ordering(156) 00:15:40.388 fused_ordering(157) 00:15:40.388 fused_ordering(158) 00:15:40.388 fused_ordering(159) 00:15:40.388 fused_ordering(160) 00:15:40.388 fused_ordering(161) 00:15:40.388 fused_ordering(162) 00:15:40.388 fused_ordering(163) 00:15:40.388 fused_ordering(164) 00:15:40.388 fused_ordering(165) 00:15:40.388 fused_ordering(166) 00:15:40.388 fused_ordering(167) 00:15:40.388 fused_ordering(168) 00:15:40.388 fused_ordering(169) 00:15:40.388 fused_ordering(170) 00:15:40.388 fused_ordering(171) 00:15:40.388 fused_ordering(172) 00:15:40.388 fused_ordering(173) 00:15:40.388 fused_ordering(174) 00:15:40.388 fused_ordering(175) 00:15:40.388 fused_ordering(176) 00:15:40.388 fused_ordering(177) 00:15:40.388 fused_ordering(178) 00:15:40.388 fused_ordering(179) 00:15:40.388 fused_ordering(180) 00:15:40.388 fused_ordering(181) 00:15:40.388 fused_ordering(182) 00:15:40.388 fused_ordering(183) 00:15:40.388 fused_ordering(184) 00:15:40.388 fused_ordering(185) 00:15:40.388 fused_ordering(186) 00:15:40.388 fused_ordering(187) 00:15:40.388 fused_ordering(188) 00:15:40.388 fused_ordering(189) 00:15:40.388 fused_ordering(190) 00:15:40.388 fused_ordering(191) 00:15:40.388 fused_ordering(192) 00:15:40.388 fused_ordering(193) 00:15:40.388 fused_ordering(194) 00:15:40.388 fused_ordering(195) 00:15:40.388 fused_ordering(196) 00:15:40.388 fused_ordering(197) 00:15:40.388 fused_ordering(198) 00:15:40.388 fused_ordering(199) 00:15:40.388 fused_ordering(200) 00:15:40.388 fused_ordering(201) 00:15:40.388 fused_ordering(202) 00:15:40.388 fused_ordering(203) 00:15:40.388 fused_ordering(204) 00:15:40.388 fused_ordering(205) 00:15:40.646 fused_ordering(206) 00:15:40.646 fused_ordering(207) 00:15:40.646 fused_ordering(208) 00:15:40.646 fused_ordering(209) 00:15:40.646 fused_ordering(210) 00:15:40.646 fused_ordering(211) 00:15:40.646 fused_ordering(212) 00:15:40.646 fused_ordering(213) 00:15:40.646 fused_ordering(214) 00:15:40.646 fused_ordering(215) 00:15:40.646 fused_ordering(216) 00:15:40.646 fused_ordering(217) 00:15:40.646 fused_ordering(218) 00:15:40.646 fused_ordering(219) 00:15:40.646 fused_ordering(220) 00:15:40.646 fused_ordering(221) 00:15:40.646 fused_ordering(222) 00:15:40.646 fused_ordering(223) 00:15:40.646 fused_ordering(224) 00:15:40.646 fused_ordering(225) 00:15:40.646 fused_ordering(226) 00:15:40.646 fused_ordering(227) 00:15:40.646 fused_ordering(228) 00:15:40.646 fused_ordering(229) 00:15:40.646 fused_ordering(230) 00:15:40.646 fused_ordering(231) 00:15:40.646 fused_ordering(232) 00:15:40.646 fused_ordering(233) 00:15:40.646 fused_ordering(234) 00:15:40.646 fused_ordering(235) 00:15:40.646 fused_ordering(236) 00:15:40.646 fused_ordering(237) 00:15:40.646 fused_ordering(238) 00:15:40.646 fused_ordering(239) 00:15:40.646 fused_ordering(240) 00:15:40.646 fused_ordering(241) 00:15:40.646 fused_ordering(242) 00:15:40.646 fused_ordering(243) 00:15:40.646 fused_ordering(244) 00:15:40.646 fused_ordering(245) 00:15:40.646 fused_ordering(246) 00:15:40.646 fused_ordering(247) 00:15:40.646 fused_ordering(248) 00:15:40.646 fused_ordering(249) 00:15:40.646 fused_ordering(250) 00:15:40.646 fused_ordering(251) 00:15:40.646 fused_ordering(252) 00:15:40.646 fused_ordering(253) 00:15:40.646 fused_ordering(254) 00:15:40.646 fused_ordering(255) 00:15:40.646 fused_ordering(256) 00:15:40.646 fused_ordering(257) 00:15:40.646 fused_ordering(258) 00:15:40.646 fused_ordering(259) 00:15:40.646 fused_ordering(260) 00:15:40.646 fused_ordering(261) 00:15:40.646 fused_ordering(262) 00:15:40.646 fused_ordering(263) 00:15:40.646 fused_ordering(264) 00:15:40.646 fused_ordering(265) 00:15:40.646 fused_ordering(266) 00:15:40.646 fused_ordering(267) 00:15:40.647 fused_ordering(268) 00:15:40.647 fused_ordering(269) 00:15:40.647 fused_ordering(270) 00:15:40.647 fused_ordering(271) 00:15:40.647 fused_ordering(272) 00:15:40.647 fused_ordering(273) 00:15:40.647 fused_ordering(274) 00:15:40.647 fused_ordering(275) 00:15:40.647 fused_ordering(276) 00:15:40.647 fused_ordering(277) 00:15:40.647 fused_ordering(278) 00:15:40.647 fused_ordering(279) 00:15:40.647 fused_ordering(280) 00:15:40.647 fused_ordering(281) 00:15:40.647 fused_ordering(282) 00:15:40.647 fused_ordering(283) 00:15:40.647 fused_ordering(284) 00:15:40.647 fused_ordering(285) 00:15:40.647 fused_ordering(286) 00:15:40.647 fused_ordering(287) 00:15:40.647 fused_ordering(288) 00:15:40.647 fused_ordering(289) 00:15:40.647 fused_ordering(290) 00:15:40.647 fused_ordering(291) 00:15:40.647 fused_ordering(292) 00:15:40.647 fused_ordering(293) 00:15:40.647 fused_ordering(294) 00:15:40.647 fused_ordering(295) 00:15:40.647 fused_ordering(296) 00:15:40.647 fused_ordering(297) 00:15:40.647 fused_ordering(298) 00:15:40.647 fused_ordering(299) 00:15:40.647 fused_ordering(300) 00:15:40.647 fused_ordering(301) 00:15:40.647 fused_ordering(302) 00:15:40.647 fused_ordering(303) 00:15:40.647 fused_ordering(304) 00:15:40.647 fused_ordering(305) 00:15:40.647 fused_ordering(306) 00:15:40.647 fused_ordering(307) 00:15:40.647 fused_ordering(308) 00:15:40.647 fused_ordering(309) 00:15:40.647 fused_ordering(310) 00:15:40.647 fused_ordering(311) 00:15:40.647 fused_ordering(312) 00:15:40.647 fused_ordering(313) 00:15:40.647 fused_ordering(314) 00:15:40.647 fused_ordering(315) 00:15:40.647 fused_ordering(316) 00:15:40.647 fused_ordering(317) 00:15:40.647 fused_ordering(318) 00:15:40.647 fused_ordering(319) 00:15:40.647 fused_ordering(320) 00:15:40.647 fused_ordering(321) 00:15:40.647 fused_ordering(322) 00:15:40.647 fused_ordering(323) 00:15:40.647 fused_ordering(324) 00:15:40.647 fused_ordering(325) 00:15:40.647 fused_ordering(326) 00:15:40.647 fused_ordering(327) 00:15:40.647 fused_ordering(328) 00:15:40.647 fused_ordering(329) 00:15:40.647 fused_ordering(330) 00:15:40.647 fused_ordering(331) 00:15:40.647 fused_ordering(332) 00:15:40.647 fused_ordering(333) 00:15:40.647 fused_ordering(334) 00:15:40.647 fused_ordering(335) 00:15:40.647 fused_ordering(336) 00:15:40.647 fused_ordering(337) 00:15:40.647 fused_ordering(338) 00:15:40.647 fused_ordering(339) 00:15:40.647 fused_ordering(340) 00:15:40.647 fused_ordering(341) 00:15:40.647 fused_ordering(342) 00:15:40.647 fused_ordering(343) 00:15:40.647 fused_ordering(344) 00:15:40.647 fused_ordering(345) 00:15:40.647 fused_ordering(346) 00:15:40.647 fused_ordering(347) 00:15:40.647 fused_ordering(348) 00:15:40.647 fused_ordering(349) 00:15:40.647 fused_ordering(350) 00:15:40.647 fused_ordering(351) 00:15:40.647 fused_ordering(352) 00:15:40.647 fused_ordering(353) 00:15:40.647 fused_ordering(354) 00:15:40.647 fused_ordering(355) 00:15:40.647 fused_ordering(356) 00:15:40.647 fused_ordering(357) 00:15:40.647 fused_ordering(358) 00:15:40.647 fused_ordering(359) 00:15:40.647 fused_ordering(360) 00:15:40.647 fused_ordering(361) 00:15:40.647 fused_ordering(362) 00:15:40.647 fused_ordering(363) 00:15:40.647 fused_ordering(364) 00:15:40.647 fused_ordering(365) 00:15:40.647 fused_ordering(366) 00:15:40.647 fused_ordering(367) 00:15:40.647 fused_ordering(368) 00:15:40.647 fused_ordering(369) 00:15:40.647 fused_ordering(370) 00:15:40.647 fused_ordering(371) 00:15:40.647 fused_ordering(372) 00:15:40.647 fused_ordering(373) 00:15:40.647 fused_ordering(374) 00:15:40.647 fused_ordering(375) 00:15:40.647 fused_ordering(376) 00:15:40.647 fused_ordering(377) 00:15:40.647 fused_ordering(378) 00:15:40.647 fused_ordering(379) 00:15:40.647 fused_ordering(380) 00:15:40.647 fused_ordering(381) 00:15:40.647 fused_ordering(382) 00:15:40.647 fused_ordering(383) 00:15:40.647 fused_ordering(384) 00:15:40.647 fused_ordering(385) 00:15:40.647 fused_ordering(386) 00:15:40.647 fused_ordering(387) 00:15:40.647 fused_ordering(388) 00:15:40.647 fused_ordering(389) 00:15:40.647 fused_ordering(390) 00:15:40.647 fused_ordering(391) 00:15:40.647 fused_ordering(392) 00:15:40.647 fused_ordering(393) 00:15:40.647 fused_ordering(394) 00:15:40.647 fused_ordering(395) 00:15:40.647 fused_ordering(396) 00:15:40.647 fused_ordering(397) 00:15:40.647 fused_ordering(398) 00:15:40.647 fused_ordering(399) 00:15:40.647 fused_ordering(400) 00:15:40.647 fused_ordering(401) 00:15:40.647 fused_ordering(402) 00:15:40.647 fused_ordering(403) 00:15:40.647 fused_ordering(404) 00:15:40.647 fused_ordering(405) 00:15:40.647 fused_ordering(406) 00:15:40.647 fused_ordering(407) 00:15:40.647 fused_ordering(408) 00:15:40.647 fused_ordering(409) 00:15:40.647 fused_ordering(410) 00:15:40.906 fused_ordering(411) 00:15:40.906 fused_ordering(412) 00:15:40.906 fused_ordering(413) 00:15:40.906 fused_ordering(414) 00:15:40.906 fused_ordering(415) 00:15:40.906 fused_ordering(416) 00:15:40.906 fused_ordering(417) 00:15:40.906 fused_ordering(418) 00:15:40.906 fused_ordering(419) 00:15:40.906 fused_ordering(420) 00:15:40.906 fused_ordering(421) 00:15:40.906 fused_ordering(422) 00:15:40.906 fused_ordering(423) 00:15:40.906 fused_ordering(424) 00:15:40.906 fused_ordering(425) 00:15:40.906 fused_ordering(426) 00:15:40.906 fused_ordering(427) 00:15:40.906 fused_ordering(428) 00:15:40.906 fused_ordering(429) 00:15:40.906 fused_ordering(430) 00:15:40.906 fused_ordering(431) 00:15:40.906 fused_ordering(432) 00:15:40.906 fused_ordering(433) 00:15:40.906 fused_ordering(434) 00:15:40.906 fused_ordering(435) 00:15:40.906 fused_ordering(436) 00:15:40.906 fused_ordering(437) 00:15:40.906 fused_ordering(438) 00:15:40.906 fused_ordering(439) 00:15:40.906 fused_ordering(440) 00:15:40.906 fused_ordering(441) 00:15:40.906 fused_ordering(442) 00:15:40.906 fused_ordering(443) 00:15:40.906 fused_ordering(444) 00:15:40.906 fused_ordering(445) 00:15:40.906 fused_ordering(446) 00:15:40.906 fused_ordering(447) 00:15:40.906 fused_ordering(448) 00:15:40.906 fused_ordering(449) 00:15:40.906 fused_ordering(450) 00:15:40.906 fused_ordering(451) 00:15:40.906 fused_ordering(452) 00:15:40.906 fused_ordering(453) 00:15:40.906 fused_ordering(454) 00:15:40.906 fused_ordering(455) 00:15:40.906 fused_ordering(456) 00:15:40.906 fused_ordering(457) 00:15:40.906 fused_ordering(458) 00:15:40.906 fused_ordering(459) 00:15:40.906 fused_ordering(460) 00:15:40.906 fused_ordering(461) 00:15:40.906 fused_ordering(462) 00:15:40.906 fused_ordering(463) 00:15:40.906 fused_ordering(464) 00:15:40.906 fused_ordering(465) 00:15:40.906 fused_ordering(466) 00:15:40.906 fused_ordering(467) 00:15:40.906 fused_ordering(468) 00:15:40.906 fused_ordering(469) 00:15:40.906 fused_ordering(470) 00:15:40.906 fused_ordering(471) 00:15:40.906 fused_ordering(472) 00:15:40.906 fused_ordering(473) 00:15:40.906 fused_ordering(474) 00:15:40.906 fused_ordering(475) 00:15:40.906 fused_ordering(476) 00:15:40.906 fused_ordering(477) 00:15:40.906 fused_ordering(478) 00:15:40.906 fused_ordering(479) 00:15:40.906 fused_ordering(480) 00:15:40.906 fused_ordering(481) 00:15:40.906 fused_ordering(482) 00:15:40.906 fused_ordering(483) 00:15:40.906 fused_ordering(484) 00:15:40.906 fused_ordering(485) 00:15:40.906 fused_ordering(486) 00:15:40.906 fused_ordering(487) 00:15:40.906 fused_ordering(488) 00:15:40.906 fused_ordering(489) 00:15:40.906 fused_ordering(490) 00:15:40.906 fused_ordering(491) 00:15:40.906 fused_ordering(492) 00:15:40.906 fused_ordering(493) 00:15:40.906 fused_ordering(494) 00:15:40.906 fused_ordering(495) 00:15:40.906 fused_ordering(496) 00:15:40.906 fused_ordering(497) 00:15:40.906 fused_ordering(498) 00:15:40.906 fused_ordering(499) 00:15:40.906 fused_ordering(500) 00:15:40.906 fused_ordering(501) 00:15:40.906 fused_ordering(502) 00:15:40.906 fused_ordering(503) 00:15:40.906 fused_ordering(504) 00:15:40.906 fused_ordering(505) 00:15:40.906 fused_ordering(506) 00:15:40.906 fused_ordering(507) 00:15:40.906 fused_ordering(508) 00:15:40.906 fused_ordering(509) 00:15:40.906 fused_ordering(510) 00:15:40.906 fused_ordering(511) 00:15:40.906 fused_ordering(512) 00:15:40.906 fused_ordering(513) 00:15:40.906 fused_ordering(514) 00:15:40.906 fused_ordering(515) 00:15:40.906 fused_ordering(516) 00:15:40.906 fused_ordering(517) 00:15:40.906 fused_ordering(518) 00:15:40.906 fused_ordering(519) 00:15:40.906 fused_ordering(520) 00:15:40.906 fused_ordering(521) 00:15:40.906 fused_ordering(522) 00:15:40.906 fused_ordering(523) 00:15:40.906 fused_ordering(524) 00:15:40.906 fused_ordering(525) 00:15:40.906 fused_ordering(526) 00:15:40.906 fused_ordering(527) 00:15:40.906 fused_ordering(528) 00:15:40.906 fused_ordering(529) 00:15:40.906 fused_ordering(530) 00:15:40.906 fused_ordering(531) 00:15:40.906 fused_ordering(532) 00:15:40.906 fused_ordering(533) 00:15:40.906 fused_ordering(534) 00:15:40.906 fused_ordering(535) 00:15:40.906 fused_ordering(536) 00:15:40.906 fused_ordering(537) 00:15:40.906 fused_ordering(538) 00:15:40.906 fused_ordering(539) 00:15:40.906 fused_ordering(540) 00:15:40.906 fused_ordering(541) 00:15:40.906 fused_ordering(542) 00:15:40.906 fused_ordering(543) 00:15:40.906 fused_ordering(544) 00:15:40.906 fused_ordering(545) 00:15:40.906 fused_ordering(546) 00:15:40.906 fused_ordering(547) 00:15:40.906 fused_ordering(548) 00:15:40.906 fused_ordering(549) 00:15:40.906 fused_ordering(550) 00:15:40.906 fused_ordering(551) 00:15:40.906 fused_ordering(552) 00:15:40.906 fused_ordering(553) 00:15:40.906 fused_ordering(554) 00:15:40.906 fused_ordering(555) 00:15:40.906 fused_ordering(556) 00:15:40.906 fused_ordering(557) 00:15:40.906 fused_ordering(558) 00:15:40.906 fused_ordering(559) 00:15:40.906 fused_ordering(560) 00:15:40.906 fused_ordering(561) 00:15:40.906 fused_ordering(562) 00:15:40.906 fused_ordering(563) 00:15:40.906 fused_ordering(564) 00:15:40.906 fused_ordering(565) 00:15:40.906 fused_ordering(566) 00:15:40.906 fused_ordering(567) 00:15:40.906 fused_ordering(568) 00:15:40.906 fused_ordering(569) 00:15:40.906 fused_ordering(570) 00:15:40.906 fused_ordering(571) 00:15:40.906 fused_ordering(572) 00:15:40.906 fused_ordering(573) 00:15:40.906 fused_ordering(574) 00:15:40.906 fused_ordering(575) 00:15:40.906 fused_ordering(576) 00:15:40.906 fused_ordering(577) 00:15:40.906 fused_ordering(578) 00:15:40.906 fused_ordering(579) 00:15:40.906 fused_ordering(580) 00:15:40.906 fused_ordering(581) 00:15:40.906 fused_ordering(582) 00:15:40.906 fused_ordering(583) 00:15:40.906 fused_ordering(584) 00:15:40.906 fused_ordering(585) 00:15:40.906 fused_ordering(586) 00:15:40.906 fused_ordering(587) 00:15:40.906 fused_ordering(588) 00:15:40.906 fused_ordering(589) 00:15:40.906 fused_ordering(590) 00:15:40.906 fused_ordering(591) 00:15:40.906 fused_ordering(592) 00:15:40.906 fused_ordering(593) 00:15:40.906 fused_ordering(594) 00:15:40.906 fused_ordering(595) 00:15:40.906 fused_ordering(596) 00:15:40.906 fused_ordering(597) 00:15:40.906 fused_ordering(598) 00:15:40.906 fused_ordering(599) 00:15:40.906 fused_ordering(600) 00:15:40.906 fused_ordering(601) 00:15:40.906 fused_ordering(602) 00:15:40.906 fused_ordering(603) 00:15:40.906 fused_ordering(604) 00:15:40.906 fused_ordering(605) 00:15:40.906 fused_ordering(606) 00:15:40.906 fused_ordering(607) 00:15:40.906 fused_ordering(608) 00:15:40.906 fused_ordering(609) 00:15:40.906 fused_ordering(610) 00:15:40.906 fused_ordering(611) 00:15:40.906 fused_ordering(612) 00:15:40.906 fused_ordering(613) 00:15:40.906 fused_ordering(614) 00:15:40.906 fused_ordering(615) 00:15:41.473 fused_ordering(616) 00:15:41.473 fused_ordering(617) 00:15:41.473 fused_ordering(618) 00:15:41.473 fused_ordering(619) 00:15:41.473 fused_ordering(620) 00:15:41.473 fused_ordering(621) 00:15:41.473 fused_ordering(622) 00:15:41.473 fused_ordering(623) 00:15:41.473 fused_ordering(624) 00:15:41.473 fused_ordering(625) 00:15:41.473 fused_ordering(626) 00:15:41.473 fused_ordering(627) 00:15:41.473 fused_ordering(628) 00:15:41.473 fused_ordering(629) 00:15:41.473 fused_ordering(630) 00:15:41.473 fused_ordering(631) 00:15:41.473 fused_ordering(632) 00:15:41.473 fused_ordering(633) 00:15:41.473 fused_ordering(634) 00:15:41.473 fused_ordering(635) 00:15:41.473 fused_ordering(636) 00:15:41.473 fused_ordering(637) 00:15:41.473 fused_ordering(638) 00:15:41.473 fused_ordering(639) 00:15:41.473 fused_ordering(640) 00:15:41.473 fused_ordering(641) 00:15:41.473 fused_ordering(642) 00:15:41.473 fused_ordering(643) 00:15:41.473 fused_ordering(644) 00:15:41.473 fused_ordering(645) 00:15:41.473 fused_ordering(646) 00:15:41.473 fused_ordering(647) 00:15:41.473 fused_ordering(648) 00:15:41.473 fused_ordering(649) 00:15:41.473 fused_ordering(650) 00:15:41.473 fused_ordering(651) 00:15:41.473 fused_ordering(652) 00:15:41.473 fused_ordering(653) 00:15:41.473 fused_ordering(654) 00:15:41.473 fused_ordering(655) 00:15:41.473 fused_ordering(656) 00:15:41.473 fused_ordering(657) 00:15:41.473 fused_ordering(658) 00:15:41.473 fused_ordering(659) 00:15:41.473 fused_ordering(660) 00:15:41.473 fused_ordering(661) 00:15:41.473 fused_ordering(662) 00:15:41.473 fused_ordering(663) 00:15:41.473 fused_ordering(664) 00:15:41.473 fused_ordering(665) 00:15:41.473 fused_ordering(666) 00:15:41.473 fused_ordering(667) 00:15:41.473 fused_ordering(668) 00:15:41.473 fused_ordering(669) 00:15:41.473 fused_ordering(670) 00:15:41.474 fused_ordering(671) 00:15:41.474 fused_ordering(672) 00:15:41.474 fused_ordering(673) 00:15:41.474 fused_ordering(674) 00:15:41.474 fused_ordering(675) 00:15:41.474 fused_ordering(676) 00:15:41.474 fused_ordering(677) 00:15:41.474 fused_ordering(678) 00:15:41.474 fused_ordering(679) 00:15:41.474 fused_ordering(680) 00:15:41.474 fused_ordering(681) 00:15:41.474 fused_ordering(682) 00:15:41.474 fused_ordering(683) 00:15:41.474 fused_ordering(684) 00:15:41.474 fused_ordering(685) 00:15:41.474 fused_ordering(686) 00:15:41.474 fused_ordering(687) 00:15:41.474 fused_ordering(688) 00:15:41.474 fused_ordering(689) 00:15:41.474 fused_ordering(690) 00:15:41.474 fused_ordering(691) 00:15:41.474 fused_ordering(692) 00:15:41.474 fused_ordering(693) 00:15:41.474 fused_ordering(694) 00:15:41.474 fused_ordering(695) 00:15:41.474 fused_ordering(696) 00:15:41.474 fused_ordering(697) 00:15:41.474 fused_ordering(698) 00:15:41.474 fused_ordering(699) 00:15:41.474 fused_ordering(700) 00:15:41.474 fused_ordering(701) 00:15:41.474 fused_ordering(702) 00:15:41.474 fused_ordering(703) 00:15:41.474 fused_ordering(704) 00:15:41.474 fused_ordering(705) 00:15:41.474 fused_ordering(706) 00:15:41.474 fused_ordering(707) 00:15:41.474 fused_ordering(708) 00:15:41.474 fused_ordering(709) 00:15:41.474 fused_ordering(710) 00:15:41.474 fused_ordering(711) 00:15:41.474 fused_ordering(712) 00:15:41.474 fused_ordering(713) 00:15:41.474 fused_ordering(714) 00:15:41.474 fused_ordering(715) 00:15:41.474 fused_ordering(716) 00:15:41.474 fused_ordering(717) 00:15:41.474 fused_ordering(718) 00:15:41.474 fused_ordering(719) 00:15:41.474 fused_ordering(720) 00:15:41.474 fused_ordering(721) 00:15:41.474 fused_ordering(722) 00:15:41.474 fused_ordering(723) 00:15:41.474 fused_ordering(724) 00:15:41.474 fused_ordering(725) 00:15:41.474 fused_ordering(726) 00:15:41.474 fused_ordering(727) 00:15:41.474 fused_ordering(728) 00:15:41.474 fused_ordering(729) 00:15:41.474 fused_ordering(730) 00:15:41.474 fused_ordering(731) 00:15:41.474 fused_ordering(732) 00:15:41.474 fused_ordering(733) 00:15:41.474 fused_ordering(734) 00:15:41.474 fused_ordering(735) 00:15:41.474 fused_ordering(736) 00:15:41.474 fused_ordering(737) 00:15:41.474 fused_ordering(738) 00:15:41.474 fused_ordering(739) 00:15:41.474 fused_ordering(740) 00:15:41.474 fused_ordering(741) 00:15:41.474 fused_ordering(742) 00:15:41.474 fused_ordering(743) 00:15:41.474 fused_ordering(744) 00:15:41.474 fused_ordering(745) 00:15:41.474 fused_ordering(746) 00:15:41.474 fused_ordering(747) 00:15:41.474 fused_ordering(748) 00:15:41.474 fused_ordering(749) 00:15:41.474 fused_ordering(750) 00:15:41.474 fused_ordering(751) 00:15:41.474 fused_ordering(752) 00:15:41.474 fused_ordering(753) 00:15:41.474 fused_ordering(754) 00:15:41.474 fused_ordering(755) 00:15:41.474 fused_ordering(756) 00:15:41.474 fused_ordering(757) 00:15:41.474 fused_ordering(758) 00:15:41.474 fused_ordering(759) 00:15:41.474 fused_ordering(760) 00:15:41.474 fused_ordering(761) 00:15:41.474 fused_ordering(762) 00:15:41.474 fused_ordering(763) 00:15:41.474 fused_ordering(764) 00:15:41.474 fused_ordering(765) 00:15:41.474 fused_ordering(766) 00:15:41.474 fused_ordering(767) 00:15:41.474 fused_ordering(768) 00:15:41.474 fused_ordering(769) 00:15:41.474 fused_ordering(770) 00:15:41.474 fused_ordering(771) 00:15:41.474 fused_ordering(772) 00:15:41.474 fused_ordering(773) 00:15:41.474 fused_ordering(774) 00:15:41.474 fused_ordering(775) 00:15:41.474 fused_ordering(776) 00:15:41.474 fused_ordering(777) 00:15:41.474 fused_ordering(778) 00:15:41.474 fused_ordering(779) 00:15:41.474 fused_ordering(780) 00:15:41.474 fused_ordering(781) 00:15:41.474 fused_ordering(782) 00:15:41.474 fused_ordering(783) 00:15:41.474 fused_ordering(784) 00:15:41.474 fused_ordering(785) 00:15:41.474 fused_ordering(786) 00:15:41.474 fused_ordering(787) 00:15:41.474 fused_ordering(788) 00:15:41.474 fused_ordering(789) 00:15:41.474 fused_ordering(790) 00:15:41.474 fused_ordering(791) 00:15:41.474 fused_ordering(792) 00:15:41.474 fused_ordering(793) 00:15:41.474 fused_ordering(794) 00:15:41.474 fused_ordering(795) 00:15:41.474 fused_ordering(796) 00:15:41.474 fused_ordering(797) 00:15:41.474 fused_ordering(798) 00:15:41.474 fused_ordering(799) 00:15:41.474 fused_ordering(800) 00:15:41.474 fused_ordering(801) 00:15:41.474 fused_ordering(802) 00:15:41.474 fused_ordering(803) 00:15:41.474 fused_ordering(804) 00:15:41.474 fused_ordering(805) 00:15:41.474 fused_ordering(806) 00:15:41.474 fused_ordering(807) 00:15:41.474 fused_ordering(808) 00:15:41.474 fused_ordering(809) 00:15:41.474 fused_ordering(810) 00:15:41.474 fused_ordering(811) 00:15:41.474 fused_ordering(812) 00:15:41.474 fused_ordering(813) 00:15:41.474 fused_ordering(814) 00:15:41.474 fused_ordering(815) 00:15:41.474 fused_ordering(816) 00:15:41.474 fused_ordering(817) 00:15:41.474 fused_ordering(818) 00:15:41.474 fused_ordering(819) 00:15:41.474 fused_ordering(820) 00:15:42.041 fused_ordering(821) 00:15:42.041 fused_ordering(822) 00:15:42.041 fused_ordering(823) 00:15:42.041 fused_ordering(824) 00:15:42.041 fused_ordering(825) 00:15:42.041 fused_ordering(826) 00:15:42.041 fused_ordering(827) 00:15:42.041 fused_ordering(828) 00:15:42.041 fused_ordering(829) 00:15:42.041 fused_ordering(830) 00:15:42.041 fused_ordering(831) 00:15:42.041 fused_ordering(832) 00:15:42.041 fused_ordering(833) 00:15:42.041 fused_ordering(834) 00:15:42.041 fused_ordering(835) 00:15:42.041 fused_ordering(836) 00:15:42.041 fused_ordering(837) 00:15:42.041 fused_ordering(838) 00:15:42.041 fused_ordering(839) 00:15:42.041 fused_ordering(840) 00:15:42.041 fused_ordering(841) 00:15:42.041 fused_ordering(842) 00:15:42.041 fused_ordering(843) 00:15:42.041 fused_ordering(844) 00:15:42.041 fused_ordering(845) 00:15:42.041 fused_ordering(846) 00:15:42.041 fused_ordering(847) 00:15:42.041 fused_ordering(848) 00:15:42.041 fused_ordering(849) 00:15:42.041 fused_ordering(850) 00:15:42.041 fused_ordering(851) 00:15:42.041 fused_ordering(852) 00:15:42.041 fused_ordering(853) 00:15:42.041 fused_ordering(854) 00:15:42.041 fused_ordering(855) 00:15:42.041 fused_ordering(856) 00:15:42.041 fused_ordering(857) 00:15:42.041 fused_ordering(858) 00:15:42.041 fused_ordering(859) 00:15:42.041 fused_ordering(860) 00:15:42.041 fused_ordering(861) 00:15:42.041 fused_ordering(862) 00:15:42.041 fused_ordering(863) 00:15:42.041 fused_ordering(864) 00:15:42.041 fused_ordering(865) 00:15:42.041 fused_ordering(866) 00:15:42.041 fused_ordering(867) 00:15:42.041 fused_ordering(868) 00:15:42.041 fused_ordering(869) 00:15:42.041 fused_ordering(870) 00:15:42.041 fused_ordering(871) 00:15:42.041 fused_ordering(872) 00:15:42.041 fused_ordering(873) 00:15:42.041 fused_ordering(874) 00:15:42.041 fused_ordering(875) 00:15:42.041 fused_ordering(876) 00:15:42.041 fused_ordering(877) 00:15:42.041 fused_ordering(878) 00:15:42.041 fused_ordering(879) 00:15:42.041 fused_ordering(880) 00:15:42.041 fused_ordering(881) 00:15:42.041 fused_ordering(882) 00:15:42.041 fused_ordering(883) 00:15:42.041 fused_ordering(884) 00:15:42.041 fused_ordering(885) 00:15:42.041 fused_ordering(886) 00:15:42.041 fused_ordering(887) 00:15:42.041 fused_ordering(888) 00:15:42.041 fused_ordering(889) 00:15:42.041 fused_ordering(890) 00:15:42.041 fused_ordering(891) 00:15:42.041 fused_ordering(892) 00:15:42.041 fused_ordering(893) 00:15:42.041 fused_ordering(894) 00:15:42.041 fused_ordering(895) 00:15:42.041 fused_ordering(896) 00:15:42.041 fused_ordering(897) 00:15:42.041 fused_ordering(898) 00:15:42.041 fused_ordering(899) 00:15:42.041 fused_ordering(900) 00:15:42.041 fused_ordering(901) 00:15:42.041 fused_ordering(902) 00:15:42.041 fused_ordering(903) 00:15:42.041 fused_ordering(904) 00:15:42.041 fused_ordering(905) 00:15:42.041 fused_ordering(906) 00:15:42.041 fused_ordering(907) 00:15:42.041 fused_ordering(908) 00:15:42.041 fused_ordering(909) 00:15:42.041 fused_ordering(910) 00:15:42.041 fused_ordering(911) 00:15:42.041 fused_ordering(912) 00:15:42.041 fused_ordering(913) 00:15:42.041 fused_ordering(914) 00:15:42.041 fused_ordering(915) 00:15:42.041 fused_ordering(916) 00:15:42.041 fused_ordering(917) 00:15:42.041 fused_ordering(918) 00:15:42.041 fused_ordering(919) 00:15:42.041 fused_ordering(920) 00:15:42.041 fused_ordering(921) 00:15:42.041 fused_ordering(922) 00:15:42.041 fused_ordering(923) 00:15:42.041 fused_ordering(924) 00:15:42.041 fused_ordering(925) 00:15:42.041 fused_ordering(926) 00:15:42.041 fused_ordering(927) 00:15:42.041 fused_ordering(928) 00:15:42.041 fused_ordering(929) 00:15:42.041 fused_ordering(930) 00:15:42.041 fused_ordering(931) 00:15:42.041 fused_ordering(932) 00:15:42.041 fused_ordering(933) 00:15:42.041 fused_ordering(934) 00:15:42.041 fused_ordering(935) 00:15:42.041 fused_ordering(936) 00:15:42.041 fused_ordering(937) 00:15:42.041 fused_ordering(938) 00:15:42.041 fused_ordering(939) 00:15:42.041 fused_ordering(940) 00:15:42.041 fused_ordering(941) 00:15:42.041 fused_ordering(942) 00:15:42.041 fused_ordering(943) 00:15:42.041 fused_ordering(944) 00:15:42.041 fused_ordering(945) 00:15:42.041 fused_ordering(946) 00:15:42.041 fused_ordering(947) 00:15:42.041 fused_ordering(948) 00:15:42.041 fused_ordering(949) 00:15:42.041 fused_ordering(950) 00:15:42.041 fused_ordering(951) 00:15:42.041 fused_ordering(952) 00:15:42.041 fused_ordering(953) 00:15:42.041 fused_ordering(954) 00:15:42.041 fused_ordering(955) 00:15:42.041 fused_ordering(956) 00:15:42.041 fused_ordering(957) 00:15:42.041 fused_ordering(958) 00:15:42.041 fused_ordering(959) 00:15:42.041 fused_ordering(960) 00:15:42.041 fused_ordering(961) 00:15:42.041 fused_ordering(962) 00:15:42.041 fused_ordering(963) 00:15:42.041 fused_ordering(964) 00:15:42.041 fused_ordering(965) 00:15:42.041 fused_ordering(966) 00:15:42.041 fused_ordering(967) 00:15:42.041 fused_ordering(968) 00:15:42.041 fused_ordering(969) 00:15:42.041 fused_ordering(970) 00:15:42.041 fused_ordering(971) 00:15:42.041 fused_ordering(972) 00:15:42.041 fused_ordering(973) 00:15:42.041 fused_ordering(974) 00:15:42.041 fused_ordering(975) 00:15:42.041 fused_ordering(976) 00:15:42.041 fused_ordering(977) 00:15:42.041 fused_ordering(978) 00:15:42.041 fused_ordering(979) 00:15:42.041 fused_ordering(980) 00:15:42.041 fused_ordering(981) 00:15:42.041 fused_ordering(982) 00:15:42.041 fused_ordering(983) 00:15:42.041 fused_ordering(984) 00:15:42.041 fused_ordering(985) 00:15:42.041 fused_ordering(986) 00:15:42.041 fused_ordering(987) 00:15:42.041 fused_ordering(988) 00:15:42.041 fused_ordering(989) 00:15:42.041 fused_ordering(990) 00:15:42.041 fused_ordering(991) 00:15:42.041 fused_ordering(992) 00:15:42.041 fused_ordering(993) 00:15:42.041 fused_ordering(994) 00:15:42.041 fused_ordering(995) 00:15:42.041 fused_ordering(996) 00:15:42.041 fused_ordering(997) 00:15:42.041 fused_ordering(998) 00:15:42.041 fused_ordering(999) 00:15:42.041 fused_ordering(1000) 00:15:42.041 fused_ordering(1001) 00:15:42.041 fused_ordering(1002) 00:15:42.041 fused_ordering(1003) 00:15:42.041 fused_ordering(1004) 00:15:42.041 fused_ordering(1005) 00:15:42.041 fused_ordering(1006) 00:15:42.041 fused_ordering(1007) 00:15:42.041 fused_ordering(1008) 00:15:42.041 fused_ordering(1009) 00:15:42.041 fused_ordering(1010) 00:15:42.041 fused_ordering(1011) 00:15:42.041 fused_ordering(1012) 00:15:42.041 fused_ordering(1013) 00:15:42.041 fused_ordering(1014) 00:15:42.041 fused_ordering(1015) 00:15:42.041 fused_ordering(1016) 00:15:42.041 fused_ordering(1017) 00:15:42.041 fused_ordering(1018) 00:15:42.041 fused_ordering(1019) 00:15:42.041 fused_ordering(1020) 00:15:42.041 fused_ordering(1021) 00:15:42.041 fused_ordering(1022) 00:15:42.041 fused_ordering(1023) 00:15:42.041 11:26:37 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- target/fused_ordering.sh@23 -- # trap - SIGINT SIGTERM EXIT 00:15:42.041 11:26:37 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- target/fused_ordering.sh@25 -- # nvmftestfini 00:15:42.041 11:26:37 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- nvmf/common.sh@514 -- # nvmfcleanup 00:15:42.041 11:26:37 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- nvmf/common.sh@121 -- # sync 00:15:42.041 11:26:37 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- nvmf/common.sh@123 -- # '[' tcp == tcp ']' 00:15:42.041 11:26:37 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- nvmf/common.sh@124 -- # set +e 00:15:42.041 11:26:37 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- nvmf/common.sh@125 -- # for i in {1..20} 00:15:42.041 11:26:37 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- nvmf/common.sh@126 -- # modprobe -v -r nvme-tcp 00:15:42.041 rmmod nvme_tcp 00:15:42.041 rmmod nvme_fabrics 00:15:42.041 rmmod nvme_keyring 00:15:42.041 11:26:37 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- nvmf/common.sh@127 -- # modprobe -v -r nvme-fabrics 00:15:42.041 11:26:37 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- nvmf/common.sh@128 -- # set -e 00:15:42.042 11:26:37 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- nvmf/common.sh@129 -- # return 0 00:15:42.042 11:26:37 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- nvmf/common.sh@515 -- # '[' -n 75895 ']' 00:15:42.042 11:26:37 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- nvmf/common.sh@516 -- # killprocess 75895 00:15:42.042 11:26:37 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- common/autotest_common.sh@950 -- # '[' -z 75895 ']' 00:15:42.042 11:26:37 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- common/autotest_common.sh@954 -- # kill -0 75895 00:15:42.042 11:26:37 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- common/autotest_common.sh@955 -- # uname 00:15:42.042 11:26:37 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- common/autotest_common.sh@955 -- # '[' Linux = Linux ']' 00:15:42.042 11:26:37 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- common/autotest_common.sh@956 -- # ps --no-headers -o comm= 75895 00:15:42.042 11:26:37 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- common/autotest_common.sh@956 -- # process_name=reactor_1 00:15:42.042 11:26:37 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- common/autotest_common.sh@960 -- # '[' reactor_1 = sudo ']' 00:15:42.042 killing process with pid 75895 00:15:42.042 11:26:37 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- common/autotest_common.sh@968 -- # echo 'killing process with pid 75895' 00:15:42.042 11:26:37 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- common/autotest_common.sh@969 -- # kill 75895 00:15:42.042 11:26:37 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- common/autotest_common.sh@974 -- # wait 75895 00:15:42.300 11:26:37 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- nvmf/common.sh@518 -- # '[' '' == iso ']' 00:15:42.300 11:26:37 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- nvmf/common.sh@521 -- # [[ tcp == \t\c\p ]] 00:15:42.300 11:26:37 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- nvmf/common.sh@522 -- # nvmf_tcp_fini 00:15:42.300 11:26:37 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- nvmf/common.sh@297 -- # iptr 00:15:42.300 11:26:37 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- nvmf/common.sh@789 -- # grep -v SPDK_NVMF 00:15:42.300 11:26:37 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- nvmf/common.sh@789 -- # iptables-save 00:15:42.300 11:26:37 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- nvmf/common.sh@789 -- # iptables-restore 00:15:42.300 11:26:37 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- nvmf/common.sh@298 -- # [[ nvmf_tgt_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s\_\s\p\d\k ]] 00:15:42.300 11:26:37 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- nvmf/common.sh@299 -- # nvmf_veth_fini 00:15:42.300 11:26:37 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- nvmf/common.sh@233 -- # ip link set nvmf_init_br nomaster 00:15:42.300 11:26:37 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- nvmf/common.sh@234 -- # ip link set nvmf_init_br2 nomaster 00:15:42.300 11:26:37 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- nvmf/common.sh@235 -- # ip link set nvmf_tgt_br nomaster 00:15:42.300 11:26:37 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- nvmf/common.sh@236 -- # ip link set nvmf_tgt_br2 nomaster 00:15:42.300 11:26:37 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- nvmf/common.sh@237 -- # ip link set nvmf_init_br down 00:15:42.300 11:26:37 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- nvmf/common.sh@238 -- # ip link set nvmf_init_br2 down 00:15:42.300 11:26:37 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- nvmf/common.sh@239 -- # ip link set nvmf_tgt_br down 00:15:42.300 11:26:37 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- nvmf/common.sh@240 -- # ip link set nvmf_tgt_br2 down 00:15:42.300 11:26:37 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- nvmf/common.sh@241 -- # ip link delete nvmf_br type bridge 00:15:42.558 11:26:37 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- nvmf/common.sh@242 -- # ip link delete nvmf_init_if 00:15:42.558 11:26:37 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- nvmf/common.sh@243 -- # ip link delete nvmf_init_if2 00:15:42.558 11:26:37 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- nvmf/common.sh@244 -- # ip netns exec nvmf_tgt_ns_spdk ip link delete nvmf_tgt_if 00:15:42.558 11:26:37 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- nvmf/common.sh@245 -- # ip netns exec nvmf_tgt_ns_spdk ip link delete nvmf_tgt_if2 00:15:42.558 11:26:37 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- nvmf/common.sh@246 -- # remove_spdk_ns 00:15:42.558 11:26:37 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- nvmf/common.sh@654 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:15:42.558 11:26:37 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 15> /dev/null' 00:15:42.558 11:26:37 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:15:42.558 11:26:37 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- nvmf/common.sh@300 -- # return 0 00:15:42.558 00:15:42.558 real 0m4.648s 00:15:42.558 user 0m5.232s 00:15:42.558 sys 0m1.600s 00:15:42.558 11:26:37 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- common/autotest_common.sh@1126 -- # xtrace_disable 00:15:42.558 ************************************ 00:15:42.558 END TEST nvmf_fused_ordering 00:15:42.558 ************************************ 00:15:42.558 11:26:37 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- common/autotest_common.sh@10 -- # set +x 00:15:42.558 11:26:37 nvmf_tcp.nvmf_target_extra -- nvmf/nvmf_target_extra.sh@26 -- # run_test nvmf_ns_masking test/nvmf/target/ns_masking.sh --transport=tcp 00:15:42.558 11:26:37 nvmf_tcp.nvmf_target_extra -- common/autotest_common.sh@1101 -- # '[' 3 -le 1 ']' 00:15:42.558 11:26:37 nvmf_tcp.nvmf_target_extra -- common/autotest_common.sh@1107 -- # xtrace_disable 00:15:42.559 11:26:37 nvmf_tcp.nvmf_target_extra -- common/autotest_common.sh@10 -- # set +x 00:15:42.559 ************************************ 00:15:42.559 START TEST nvmf_ns_masking 00:15:42.559 ************************************ 00:15:42.559 11:26:38 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- common/autotest_common.sh@1125 -- # test/nvmf/target/ns_masking.sh --transport=tcp 00:15:42.559 * Looking for test storage... 00:15:42.559 * Found test storage at /home/vagrant/spdk_repo/spdk/test/nvmf/target 00:15:42.559 11:26:38 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- common/autotest_common.sh@1680 -- # [[ y == y ]] 00:15:42.818 11:26:38 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- common/autotest_common.sh@1681 -- # awk '{print $NF}' 00:15:42.818 11:26:38 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- common/autotest_common.sh@1681 -- # lcov --version 00:15:42.818 11:26:38 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- common/autotest_common.sh@1681 -- # lt 1.15 2 00:15:42.818 11:26:38 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- scripts/common.sh@373 -- # cmp_versions 1.15 '<' 2 00:15:42.818 11:26:38 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- scripts/common.sh@333 -- # local ver1 ver1_l 00:15:42.818 11:26:38 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- scripts/common.sh@334 -- # local ver2 ver2_l 00:15:42.818 11:26:38 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- scripts/common.sh@336 -- # IFS=.-: 00:15:42.818 11:26:38 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- scripts/common.sh@336 -- # read -ra ver1 00:15:42.818 11:26:38 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- scripts/common.sh@337 -- # IFS=.-: 00:15:42.818 11:26:38 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- scripts/common.sh@337 -- # read -ra ver2 00:15:42.818 11:26:38 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- scripts/common.sh@338 -- # local 'op=<' 00:15:42.818 11:26:38 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- scripts/common.sh@340 -- # ver1_l=2 00:15:42.818 11:26:38 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- scripts/common.sh@341 -- # ver2_l=1 00:15:42.818 11:26:38 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- scripts/common.sh@343 -- # local lt=0 gt=0 eq=0 v 00:15:42.818 11:26:38 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- scripts/common.sh@344 -- # case "$op" in 00:15:42.818 11:26:38 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- scripts/common.sh@345 -- # : 1 00:15:42.818 11:26:38 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- scripts/common.sh@364 -- # (( v = 0 )) 00:15:42.818 11:26:38 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- scripts/common.sh@364 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:15:42.818 11:26:38 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- scripts/common.sh@365 -- # decimal 1 00:15:42.818 11:26:38 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- scripts/common.sh@353 -- # local d=1 00:15:42.818 11:26:38 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- scripts/common.sh@354 -- # [[ 1 =~ ^[0-9]+$ ]] 00:15:42.818 11:26:38 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- scripts/common.sh@355 -- # echo 1 00:15:42.818 11:26:38 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- scripts/common.sh@365 -- # ver1[v]=1 00:15:42.818 11:26:38 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- scripts/common.sh@366 -- # decimal 2 00:15:42.818 11:26:38 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- scripts/common.sh@353 -- # local d=2 00:15:42.818 11:26:38 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- scripts/common.sh@354 -- # [[ 2 =~ ^[0-9]+$ ]] 00:15:42.818 11:26:38 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- scripts/common.sh@355 -- # echo 2 00:15:42.818 11:26:38 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- scripts/common.sh@366 -- # ver2[v]=2 00:15:42.818 11:26:38 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- scripts/common.sh@367 -- # (( ver1[v] > ver2[v] )) 00:15:42.818 11:26:38 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- scripts/common.sh@368 -- # (( ver1[v] < ver2[v] )) 00:15:42.818 11:26:38 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- scripts/common.sh@368 -- # return 0 00:15:42.818 11:26:38 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- common/autotest_common.sh@1682 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:15:42.818 11:26:38 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- common/autotest_common.sh@1694 -- # export 'LCOV_OPTS= 00:15:42.818 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:15:42.818 --rc genhtml_branch_coverage=1 00:15:42.818 --rc genhtml_function_coverage=1 00:15:42.818 --rc genhtml_legend=1 00:15:42.818 --rc geninfo_all_blocks=1 00:15:42.818 --rc geninfo_unexecuted_blocks=1 00:15:42.818 00:15:42.818 ' 00:15:42.818 11:26:38 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- common/autotest_common.sh@1694 -- # LCOV_OPTS=' 00:15:42.818 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:15:42.818 --rc genhtml_branch_coverage=1 00:15:42.818 --rc genhtml_function_coverage=1 00:15:42.818 --rc genhtml_legend=1 00:15:42.818 --rc geninfo_all_blocks=1 00:15:42.818 --rc geninfo_unexecuted_blocks=1 00:15:42.818 00:15:42.818 ' 00:15:42.818 11:26:38 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- common/autotest_common.sh@1695 -- # export 'LCOV=lcov 00:15:42.818 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:15:42.818 --rc genhtml_branch_coverage=1 00:15:42.818 --rc genhtml_function_coverage=1 00:15:42.818 --rc genhtml_legend=1 00:15:42.818 --rc geninfo_all_blocks=1 00:15:42.818 --rc geninfo_unexecuted_blocks=1 00:15:42.818 00:15:42.818 ' 00:15:42.818 11:26:38 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- common/autotest_common.sh@1695 -- # LCOV='lcov 00:15:42.818 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:15:42.818 --rc genhtml_branch_coverage=1 00:15:42.818 --rc genhtml_function_coverage=1 00:15:42.818 --rc genhtml_legend=1 00:15:42.818 --rc geninfo_all_blocks=1 00:15:42.818 --rc geninfo_unexecuted_blocks=1 00:15:42.818 00:15:42.818 ' 00:15:42.818 11:26:38 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- target/ns_masking.sh@8 -- # source /home/vagrant/spdk_repo/spdk/test/nvmf/common.sh 00:15:42.818 11:26:38 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- nvmf/common.sh@7 -- # uname -s 00:15:42.818 11:26:38 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:15:42.818 11:26:38 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:15:42.818 11:26:38 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:15:42.818 11:26:38 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:15:42.818 11:26:38 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:15:42.818 11:26:38 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:15:42.818 11:26:38 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:15:42.818 11:26:38 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:15:42.818 11:26:38 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:15:42.818 11:26:38 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:15:42.818 11:26:38 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:c758a4ed-f09f-4c82-9afb-3d096f035464 00:15:42.818 11:26:38 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- nvmf/common.sh@18 -- # NVME_HOSTID=c758a4ed-f09f-4c82-9afb-3d096f035464 00:15:42.818 11:26:38 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:15:42.818 11:26:38 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:15:42.818 11:26:38 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- nvmf/common.sh@21 -- # NET_TYPE=virt 00:15:42.818 11:26:38 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:15:42.818 11:26:38 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- nvmf/common.sh@49 -- # source /home/vagrant/spdk_repo/spdk/scripts/common.sh 00:15:42.818 11:26:38 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- scripts/common.sh@15 -- # shopt -s extglob 00:15:42.818 11:26:38 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- scripts/common.sh@544 -- # [[ -e /bin/wpdk_common.sh ]] 00:15:42.818 11:26:38 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- scripts/common.sh@552 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:15:42.818 11:26:38 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- scripts/common.sh@553 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:15:42.818 11:26:38 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:42.818 11:26:38 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:42.818 11:26:38 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:42.818 11:26:38 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- paths/export.sh@5 -- # export PATH 00:15:42.818 11:26:38 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:42.818 11:26:38 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- nvmf/common.sh@51 -- # : 0 00:15:42.819 11:26:38 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- nvmf/common.sh@52 -- # export NVMF_APP_SHM_ID 00:15:42.819 11:26:38 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- nvmf/common.sh@53 -- # build_nvmf_app_args 00:15:42.819 11:26:38 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:15:42.819 11:26:38 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:15:42.819 11:26:38 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:15:42.819 11:26:38 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- nvmf/common.sh@33 -- # '[' '' -eq 1 ']' 00:15:42.819 /home/vagrant/spdk_repo/spdk/test/nvmf/common.sh: line 33: [: : integer expression expected 00:15:42.819 11:26:38 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- nvmf/common.sh@37 -- # '[' -n '' ']' 00:15:42.819 11:26:38 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- nvmf/common.sh@39 -- # '[' 0 -eq 1 ']' 00:15:42.819 11:26:38 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- nvmf/common.sh@55 -- # have_pci_nics=0 00:15:42.819 11:26:38 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- target/ns_masking.sh@10 -- # rpc_py=/home/vagrant/spdk_repo/spdk/scripts/rpc.py 00:15:42.819 11:26:38 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- target/ns_masking.sh@11 -- # hostsock=/var/tmp/host.sock 00:15:42.819 11:26:38 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- target/ns_masking.sh@12 -- # loops=5 00:15:42.819 11:26:38 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- target/ns_masking.sh@13 -- # uuidgen 00:15:42.819 11:26:38 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- target/ns_masking.sh@13 -- # ns1uuid=ab963cf9-7f01-4533-a7ce-aafe87f92623 00:15:42.819 11:26:38 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- target/ns_masking.sh@14 -- # uuidgen 00:15:42.819 11:26:38 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- target/ns_masking.sh@14 -- # ns2uuid=6c227a88-373e-46bf-89bb-8c78ce20d013 00:15:42.819 11:26:38 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- target/ns_masking.sh@16 -- # SUBSYSNQN=nqn.2016-06.io.spdk:cnode1 00:15:42.819 11:26:38 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- target/ns_masking.sh@17 -- # HOSTNQN1=nqn.2016-06.io.spdk:host1 00:15:42.819 11:26:38 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- target/ns_masking.sh@18 -- # HOSTNQN2=nqn.2016-06.io.spdk:host2 00:15:42.819 11:26:38 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- target/ns_masking.sh@19 -- # uuidgen 00:15:42.819 11:26:38 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- target/ns_masking.sh@19 -- # HOSTID=0d500810-d292-4b43-9fd9-bcab1888f70c 00:15:42.819 11:26:38 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- target/ns_masking.sh@50 -- # nvmftestinit 00:15:42.819 11:26:38 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- nvmf/common.sh@467 -- # '[' -z tcp ']' 00:15:42.819 11:26:38 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- nvmf/common.sh@472 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:15:42.819 11:26:38 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- nvmf/common.sh@474 -- # prepare_net_devs 00:15:42.819 11:26:38 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- nvmf/common.sh@436 -- # local -g is_hw=no 00:15:42.819 11:26:38 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- nvmf/common.sh@438 -- # remove_spdk_ns 00:15:42.819 11:26:38 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- nvmf/common.sh@654 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:15:42.819 11:26:38 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 15> /dev/null' 00:15:42.819 11:26:38 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:15:42.819 11:26:38 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- nvmf/common.sh@440 -- # [[ virt != virt ]] 00:15:42.819 11:26:38 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- nvmf/common.sh@442 -- # [[ no == yes ]] 00:15:42.819 11:26:38 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- nvmf/common.sh@449 -- # [[ virt == phy ]] 00:15:42.819 11:26:38 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- nvmf/common.sh@452 -- # [[ virt == phy-fallback ]] 00:15:42.819 11:26:38 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- nvmf/common.sh@457 -- # [[ tcp == tcp ]] 00:15:42.819 11:26:38 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- nvmf/common.sh@458 -- # nvmf_veth_init 00:15:42.819 11:26:38 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- nvmf/common.sh@145 -- # NVMF_FIRST_INITIATOR_IP=10.0.0.1 00:15:42.819 11:26:38 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- nvmf/common.sh@146 -- # NVMF_SECOND_INITIATOR_IP=10.0.0.2 00:15:42.819 11:26:38 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- nvmf/common.sh@147 -- # NVMF_FIRST_TARGET_IP=10.0.0.3 00:15:42.819 11:26:38 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- nvmf/common.sh@148 -- # NVMF_SECOND_TARGET_IP=10.0.0.4 00:15:42.819 11:26:38 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- nvmf/common.sh@149 -- # NVMF_INITIATOR_IP=10.0.0.1 00:15:42.819 11:26:38 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- nvmf/common.sh@150 -- # NVMF_BRIDGE=nvmf_br 00:15:42.819 11:26:38 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- nvmf/common.sh@151 -- # NVMF_INITIATOR_INTERFACE=nvmf_init_if 00:15:42.819 11:26:38 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- nvmf/common.sh@152 -- # NVMF_INITIATOR_INTERFACE2=nvmf_init_if2 00:15:42.819 11:26:38 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- nvmf/common.sh@153 -- # NVMF_INITIATOR_BRIDGE=nvmf_init_br 00:15:42.819 11:26:38 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- nvmf/common.sh@154 -- # NVMF_INITIATOR_BRIDGE2=nvmf_init_br2 00:15:42.819 11:26:38 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- nvmf/common.sh@155 -- # NVMF_TARGET_NAMESPACE=nvmf_tgt_ns_spdk 00:15:42.819 11:26:38 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- nvmf/common.sh@156 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:15:42.819 11:26:38 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- nvmf/common.sh@157 -- # NVMF_TARGET_INTERFACE=nvmf_tgt_if 00:15:42.819 11:26:38 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- nvmf/common.sh@158 -- # NVMF_TARGET_INTERFACE2=nvmf_tgt_if2 00:15:42.819 11:26:38 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- nvmf/common.sh@159 -- # NVMF_TARGET_BRIDGE=nvmf_tgt_br 00:15:42.819 11:26:38 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- nvmf/common.sh@160 -- # NVMF_TARGET_BRIDGE2=nvmf_tgt_br2 00:15:42.819 11:26:38 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- nvmf/common.sh@162 -- # ip link set nvmf_init_br nomaster 00:15:42.819 Cannot find device "nvmf_init_br" 00:15:42.819 11:26:38 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- nvmf/common.sh@162 -- # true 00:15:42.819 11:26:38 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- nvmf/common.sh@163 -- # ip link set nvmf_init_br2 nomaster 00:15:42.819 Cannot find device "nvmf_init_br2" 00:15:42.819 11:26:38 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- nvmf/common.sh@163 -- # true 00:15:42.819 11:26:38 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- nvmf/common.sh@164 -- # ip link set nvmf_tgt_br nomaster 00:15:42.819 Cannot find device "nvmf_tgt_br" 00:15:42.819 11:26:38 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- nvmf/common.sh@164 -- # true 00:15:42.819 11:26:38 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- nvmf/common.sh@165 -- # ip link set nvmf_tgt_br2 nomaster 00:15:42.819 Cannot find device "nvmf_tgt_br2" 00:15:42.819 11:26:38 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- nvmf/common.sh@165 -- # true 00:15:42.819 11:26:38 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- nvmf/common.sh@166 -- # ip link set nvmf_init_br down 00:15:42.819 Cannot find device "nvmf_init_br" 00:15:42.819 11:26:38 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- nvmf/common.sh@166 -- # true 00:15:42.819 11:26:38 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- nvmf/common.sh@167 -- # ip link set nvmf_init_br2 down 00:15:42.819 Cannot find device "nvmf_init_br2" 00:15:42.819 11:26:38 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- nvmf/common.sh@167 -- # true 00:15:42.819 11:26:38 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- nvmf/common.sh@168 -- # ip link set nvmf_tgt_br down 00:15:42.819 Cannot find device "nvmf_tgt_br" 00:15:42.819 11:26:38 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- nvmf/common.sh@168 -- # true 00:15:42.819 11:26:38 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- nvmf/common.sh@169 -- # ip link set nvmf_tgt_br2 down 00:15:42.819 Cannot find device "nvmf_tgt_br2" 00:15:42.819 11:26:38 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- nvmf/common.sh@169 -- # true 00:15:42.819 11:26:38 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- nvmf/common.sh@170 -- # ip link delete nvmf_br type bridge 00:15:42.819 Cannot find device "nvmf_br" 00:15:42.819 11:26:38 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- nvmf/common.sh@170 -- # true 00:15:42.819 11:26:38 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- nvmf/common.sh@171 -- # ip link delete nvmf_init_if 00:15:43.076 Cannot find device "nvmf_init_if" 00:15:43.076 11:26:38 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- nvmf/common.sh@171 -- # true 00:15:43.076 11:26:38 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- nvmf/common.sh@172 -- # ip link delete nvmf_init_if2 00:15:43.076 Cannot find device "nvmf_init_if2" 00:15:43.076 11:26:38 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- nvmf/common.sh@172 -- # true 00:15:43.076 11:26:38 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- nvmf/common.sh@173 -- # ip netns exec nvmf_tgt_ns_spdk ip link delete nvmf_tgt_if 00:15:43.076 Cannot open network namespace "nvmf_tgt_ns_spdk": No such file or directory 00:15:43.076 11:26:38 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- nvmf/common.sh@173 -- # true 00:15:43.076 11:26:38 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- nvmf/common.sh@174 -- # ip netns exec nvmf_tgt_ns_spdk ip link delete nvmf_tgt_if2 00:15:43.076 Cannot open network namespace "nvmf_tgt_ns_spdk": No such file or directory 00:15:43.076 11:26:38 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- nvmf/common.sh@174 -- # true 00:15:43.076 11:26:38 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- nvmf/common.sh@177 -- # ip netns add nvmf_tgt_ns_spdk 00:15:43.076 11:26:38 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- nvmf/common.sh@180 -- # ip link add nvmf_init_if type veth peer name nvmf_init_br 00:15:43.076 11:26:38 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- nvmf/common.sh@181 -- # ip link add nvmf_init_if2 type veth peer name nvmf_init_br2 00:15:43.076 11:26:38 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- nvmf/common.sh@182 -- # ip link add nvmf_tgt_if type veth peer name nvmf_tgt_br 00:15:43.076 11:26:38 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- nvmf/common.sh@183 -- # ip link add nvmf_tgt_if2 type veth peer name nvmf_tgt_br2 00:15:43.076 11:26:38 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- nvmf/common.sh@186 -- # ip link set nvmf_tgt_if netns nvmf_tgt_ns_spdk 00:15:43.076 11:26:38 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- nvmf/common.sh@187 -- # ip link set nvmf_tgt_if2 netns nvmf_tgt_ns_spdk 00:15:43.076 11:26:38 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- nvmf/common.sh@190 -- # ip addr add 10.0.0.1/24 dev nvmf_init_if 00:15:43.076 11:26:38 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- nvmf/common.sh@191 -- # ip addr add 10.0.0.2/24 dev nvmf_init_if2 00:15:43.076 11:26:38 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- nvmf/common.sh@192 -- # ip netns exec nvmf_tgt_ns_spdk ip addr add 10.0.0.3/24 dev nvmf_tgt_if 00:15:43.076 11:26:38 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- nvmf/common.sh@193 -- # ip netns exec nvmf_tgt_ns_spdk ip addr add 10.0.0.4/24 dev nvmf_tgt_if2 00:15:43.076 11:26:38 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- nvmf/common.sh@196 -- # ip link set nvmf_init_if up 00:15:43.076 11:26:38 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- nvmf/common.sh@197 -- # ip link set nvmf_init_if2 up 00:15:43.076 11:26:38 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- nvmf/common.sh@198 -- # ip link set nvmf_init_br up 00:15:43.076 11:26:38 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- nvmf/common.sh@199 -- # ip link set nvmf_init_br2 up 00:15:43.076 11:26:38 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- nvmf/common.sh@200 -- # ip link set nvmf_tgt_br up 00:15:43.076 11:26:38 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- nvmf/common.sh@201 -- # ip link set nvmf_tgt_br2 up 00:15:43.076 11:26:38 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- nvmf/common.sh@202 -- # ip netns exec nvmf_tgt_ns_spdk ip link set nvmf_tgt_if up 00:15:43.076 11:26:38 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- nvmf/common.sh@203 -- # ip netns exec nvmf_tgt_ns_spdk ip link set nvmf_tgt_if2 up 00:15:43.076 11:26:38 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- nvmf/common.sh@204 -- # ip netns exec nvmf_tgt_ns_spdk ip link set lo up 00:15:43.076 11:26:38 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- nvmf/common.sh@207 -- # ip link add nvmf_br type bridge 00:15:43.076 11:26:38 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- nvmf/common.sh@208 -- # ip link set nvmf_br up 00:15:43.076 11:26:38 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- nvmf/common.sh@211 -- # ip link set nvmf_init_br master nvmf_br 00:15:43.076 11:26:38 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- nvmf/common.sh@212 -- # ip link set nvmf_init_br2 master nvmf_br 00:15:43.076 11:26:38 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- nvmf/common.sh@213 -- # ip link set nvmf_tgt_br master nvmf_br 00:15:43.076 11:26:38 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- nvmf/common.sh@214 -- # ip link set nvmf_tgt_br2 master nvmf_br 00:15:43.334 11:26:38 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- nvmf/common.sh@217 -- # ipts -I INPUT 1 -i nvmf_init_if -p tcp --dport 4420 -j ACCEPT 00:15:43.334 11:26:38 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- nvmf/common.sh@788 -- # iptables -I INPUT 1 -i nvmf_init_if -p tcp --dport 4420 -j ACCEPT -m comment --comment 'SPDK_NVMF:-I INPUT 1 -i nvmf_init_if -p tcp --dport 4420 -j ACCEPT' 00:15:43.334 11:26:38 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- nvmf/common.sh@218 -- # ipts -I INPUT 1 -i nvmf_init_if2 -p tcp --dport 4420 -j ACCEPT 00:15:43.334 11:26:38 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- nvmf/common.sh@788 -- # iptables -I INPUT 1 -i nvmf_init_if2 -p tcp --dport 4420 -j ACCEPT -m comment --comment 'SPDK_NVMF:-I INPUT 1 -i nvmf_init_if2 -p tcp --dport 4420 -j ACCEPT' 00:15:43.334 11:26:38 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- nvmf/common.sh@219 -- # ipts -A FORWARD -i nvmf_br -o nvmf_br -j ACCEPT 00:15:43.334 11:26:38 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- nvmf/common.sh@788 -- # iptables -A FORWARD -i nvmf_br -o nvmf_br -j ACCEPT -m comment --comment 'SPDK_NVMF:-A FORWARD -i nvmf_br -o nvmf_br -j ACCEPT' 00:15:43.334 11:26:38 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- nvmf/common.sh@222 -- # ping -c 1 10.0.0.3 00:15:43.334 PING 10.0.0.3 (10.0.0.3) 56(84) bytes of data. 00:15:43.334 64 bytes from 10.0.0.3: icmp_seq=1 ttl=64 time=0.095 ms 00:15:43.334 00:15:43.334 --- 10.0.0.3 ping statistics --- 00:15:43.334 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:15:43.334 rtt min/avg/max/mdev = 0.095/0.095/0.095/0.000 ms 00:15:43.334 11:26:38 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- nvmf/common.sh@223 -- # ping -c 1 10.0.0.4 00:15:43.334 PING 10.0.0.4 (10.0.0.4) 56(84) bytes of data. 00:15:43.334 64 bytes from 10.0.0.4: icmp_seq=1 ttl=64 time=0.040 ms 00:15:43.334 00:15:43.334 --- 10.0.0.4 ping statistics --- 00:15:43.334 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:15:43.335 rtt min/avg/max/mdev = 0.040/0.040/0.040/0.000 ms 00:15:43.335 11:26:38 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- nvmf/common.sh@224 -- # ip netns exec nvmf_tgt_ns_spdk ping -c 1 10.0.0.1 00:15:43.335 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:15:43.335 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.028 ms 00:15:43.335 00:15:43.335 --- 10.0.0.1 ping statistics --- 00:15:43.335 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:15:43.335 rtt min/avg/max/mdev = 0.028/0.028/0.028/0.000 ms 00:15:43.335 11:26:38 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- nvmf/common.sh@225 -- # ip netns exec nvmf_tgt_ns_spdk ping -c 1 10.0.0.2 00:15:43.335 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:15:43.335 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.106 ms 00:15:43.335 00:15:43.335 --- 10.0.0.2 ping statistics --- 00:15:43.335 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:15:43.335 rtt min/avg/max/mdev = 0.106/0.106/0.106/0.000 ms 00:15:43.335 11:26:38 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- nvmf/common.sh@227 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:15:43.335 11:26:38 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- nvmf/common.sh@459 -- # return 0 00:15:43.335 11:26:38 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- nvmf/common.sh@476 -- # '[' '' == iso ']' 00:15:43.335 11:26:38 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- nvmf/common.sh@480 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:15:43.335 11:26:38 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- nvmf/common.sh@481 -- # [[ tcp == \r\d\m\a ]] 00:15:43.335 11:26:38 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- nvmf/common.sh@490 -- # [[ tcp == \t\c\p ]] 00:15:43.335 11:26:38 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- nvmf/common.sh@491 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:15:43.335 11:26:38 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- nvmf/common.sh@494 -- # '[' tcp == tcp ']' 00:15:43.335 11:26:38 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- nvmf/common.sh@500 -- # modprobe nvme-tcp 00:15:43.335 11:26:38 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- target/ns_masking.sh@51 -- # nvmfappstart 00:15:43.335 11:26:38 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- nvmf/common.sh@505 -- # timing_enter start_nvmf_tgt 00:15:43.335 11:26:38 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- common/autotest_common.sh@724 -- # xtrace_disable 00:15:43.335 11:26:38 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- common/autotest_common.sh@10 -- # set +x 00:15:43.335 11:26:38 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- nvmf/common.sh@507 -- # nvmfpid=76214 00:15:43.335 11:26:38 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- nvmf/common.sh@506 -- # ip netns exec nvmf_tgt_ns_spdk /home/vagrant/spdk_repo/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF 00:15:43.335 11:26:38 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- nvmf/common.sh@508 -- # waitforlisten 76214 00:15:43.335 11:26:38 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- common/autotest_common.sh@831 -- # '[' -z 76214 ']' 00:15:43.335 11:26:38 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- common/autotest_common.sh@835 -- # local rpc_addr=/var/tmp/spdk.sock 00:15:43.335 11:26:38 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- common/autotest_common.sh@836 -- # local max_retries=100 00:15:43.335 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:15:43.335 11:26:38 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- common/autotest_common.sh@838 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:15:43.335 11:26:38 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- common/autotest_common.sh@840 -- # xtrace_disable 00:15:43.335 11:26:38 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- common/autotest_common.sh@10 -- # set +x 00:15:43.335 [2024-10-07 11:26:38.727622] Starting SPDK v25.01-pre git sha1 2a4f56c54 / DPDK 24.03.0 initialization... 00:15:43.335 [2024-10-07 11:26:38.727737] [ DPDK EAL parameters: nvmf -c 0x1 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --iova-mode=pa --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:15:43.610 [2024-10-07 11:26:38.865845] app.c: 917:spdk_app_start: *NOTICE*: Total cores available: 1 00:15:43.610 [2024-10-07 11:26:38.985461] app.c: 610:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:15:43.610 [2024-10-07 11:26:38.985524] app.c: 611:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:15:43.610 [2024-10-07 11:26:38.985538] app.c: 616:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:15:43.610 [2024-10-07 11:26:38.985549] app.c: 617:app_setup_trace: *NOTICE*: SPDK application currently running. 00:15:43.610 [2024-10-07 11:26:38.985559] app.c: 618:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:15:43.610 [2024-10-07 11:26:38.986044] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 0 00:15:44.190 11:26:39 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- common/autotest_common.sh@860 -- # (( i == 0 )) 00:15:44.190 11:26:39 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- common/autotest_common.sh@864 -- # return 0 00:15:44.190 11:26:39 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- nvmf/common.sh@509 -- # timing_exit start_nvmf_tgt 00:15:44.190 11:26:39 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- common/autotest_common.sh@730 -- # xtrace_disable 00:15:44.190 11:26:39 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- common/autotest_common.sh@10 -- # set +x 00:15:44.448 11:26:39 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- nvmf/common.sh@510 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:15:44.448 11:26:39 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- target/ns_masking.sh@53 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_create_transport -t tcp -o -u 8192 00:15:44.705 [2024-10-07 11:26:39.995785] tcp.c: 738:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:15:44.705 11:26:40 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- target/ns_masking.sh@55 -- # MALLOC_BDEV_SIZE=64 00:15:44.705 11:26:40 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- target/ns_masking.sh@56 -- # MALLOC_BLOCK_SIZE=512 00:15:44.705 11:26:40 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- target/ns_masking.sh@58 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py bdev_malloc_create 64 512 -b Malloc1 00:15:44.963 Malloc1 00:15:44.963 11:26:40 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- target/ns_masking.sh@59 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py bdev_malloc_create 64 512 -b Malloc2 00:15:45.220 Malloc2 00:15:45.220 11:26:40 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- target/ns_masking.sh@62 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDKISFASTANDAWESOME 00:15:45.479 11:26:40 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- target/ns_masking.sh@63 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 -n 1 00:15:45.737 11:26:41 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- target/ns_masking.sh@64 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.3 -s 4420 00:15:45.996 [2024-10-07 11:26:41.439008] tcp.c:1081:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.3 port 4420 *** 00:15:45.996 11:26:41 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- target/ns_masking.sh@67 -- # connect 00:15:45.996 11:26:41 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- target/ns_masking.sh@22 -- # nvme connect -t tcp -n nqn.2016-06.io.spdk:cnode1 -q nqn.2016-06.io.spdk:host1 -I 0d500810-d292-4b43-9fd9-bcab1888f70c -a 10.0.0.3 -s 4420 -i 4 00:15:46.254 11:26:41 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- target/ns_masking.sh@24 -- # waitforserial SPDKISFASTANDAWESOME 00:15:46.254 11:26:41 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- common/autotest_common.sh@1198 -- # local i=0 00:15:46.254 11:26:41 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- common/autotest_common.sh@1199 -- # local nvme_device_counter=1 nvme_devices=0 00:15:46.254 11:26:41 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- common/autotest_common.sh@1200 -- # [[ -n '' ]] 00:15:46.254 11:26:41 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- common/autotest_common.sh@1205 -- # sleep 2 00:15:48.157 11:26:43 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- common/autotest_common.sh@1206 -- # (( i++ <= 15 )) 00:15:48.157 11:26:43 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- common/autotest_common.sh@1207 -- # lsblk -l -o NAME,SERIAL 00:15:48.157 11:26:43 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- common/autotest_common.sh@1207 -- # grep -c SPDKISFASTANDAWESOME 00:15:48.157 11:26:43 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- common/autotest_common.sh@1207 -- # nvme_devices=1 00:15:48.157 11:26:43 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- common/autotest_common.sh@1208 -- # (( nvme_devices == nvme_device_counter )) 00:15:48.157 11:26:43 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- common/autotest_common.sh@1208 -- # return 0 00:15:48.157 11:26:43 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- target/ns_masking.sh@26 -- # jq -r '.[].Subsystems[] | select(.NQN=="nqn.2016-06.io.spdk:cnode1") | .Paths[0].Name' 00:15:48.157 11:26:43 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- target/ns_masking.sh@26 -- # nvme list-subsys -o json 00:15:48.157 11:26:43 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- target/ns_masking.sh@26 -- # ctrl_id=nvme0 00:15:48.157 11:26:43 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- target/ns_masking.sh@27 -- # [[ -z nvme0 ]] 00:15:48.157 11:26:43 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- target/ns_masking.sh@68 -- # ns_is_visible 0x1 00:15:48.157 11:26:43 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- target/ns_masking.sh@43 -- # grep 0x1 00:15:48.157 11:26:43 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- target/ns_masking.sh@43 -- # nvme list-ns /dev/nvme0 00:15:48.157 [ 0]:0x1 00:15:48.157 11:26:43 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- target/ns_masking.sh@44 -- # nvme id-ns /dev/nvme0 -n 0x1 -o json 00:15:48.157 11:26:43 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- target/ns_masking.sh@44 -- # jq -r .nguid 00:15:48.414 11:26:43 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- target/ns_masking.sh@44 -- # nguid=aab917712c3c4930888695c8a8e15003 00:15:48.414 11:26:43 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- target/ns_masking.sh@45 -- # [[ aab917712c3c4930888695c8a8e15003 != \0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0 ]] 00:15:48.414 11:26:43 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- target/ns_masking.sh@71 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc2 -n 2 00:15:48.673 11:26:44 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- target/ns_masking.sh@72 -- # ns_is_visible 0x1 00:15:48.673 11:26:44 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- target/ns_masking.sh@43 -- # grep 0x1 00:15:48.673 11:26:44 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- target/ns_masking.sh@43 -- # nvme list-ns /dev/nvme0 00:15:48.673 [ 0]:0x1 00:15:48.673 11:26:44 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- target/ns_masking.sh@44 -- # nvme id-ns /dev/nvme0 -n 0x1 -o json 00:15:48.673 11:26:44 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- target/ns_masking.sh@44 -- # jq -r .nguid 00:15:48.673 11:26:44 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- target/ns_masking.sh@44 -- # nguid=aab917712c3c4930888695c8a8e15003 00:15:48.673 11:26:44 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- target/ns_masking.sh@45 -- # [[ aab917712c3c4930888695c8a8e15003 != \0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0 ]] 00:15:48.673 11:26:44 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- target/ns_masking.sh@73 -- # ns_is_visible 0x2 00:15:48.673 11:26:44 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- target/ns_masking.sh@43 -- # nvme list-ns /dev/nvme0 00:15:48.673 11:26:44 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- target/ns_masking.sh@43 -- # grep 0x2 00:15:48.673 [ 1]:0x2 00:15:48.673 11:26:44 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- target/ns_masking.sh@44 -- # nvme id-ns /dev/nvme0 -n 0x2 -o json 00:15:48.673 11:26:44 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- target/ns_masking.sh@44 -- # jq -r .nguid 00:15:48.673 11:26:44 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- target/ns_masking.sh@44 -- # nguid=8a5869baf1484f848b51d0619a09b25b 00:15:48.673 11:26:44 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- target/ns_masking.sh@45 -- # [[ 8a5869baf1484f848b51d0619a09b25b != \0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0 ]] 00:15:48.673 11:26:44 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- target/ns_masking.sh@75 -- # disconnect 00:15:48.673 11:26:44 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- target/ns_masking.sh@38 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:15:48.932 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:15:48.932 11:26:44 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- target/ns_masking.sh@79 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:15:49.190 11:26:44 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- target/ns_masking.sh@80 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 -n 1 --no-auto-visible 00:15:49.448 11:26:44 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- target/ns_masking.sh@83 -- # connect 1 00:15:49.448 11:26:44 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- target/ns_masking.sh@22 -- # nvme connect -t tcp -n nqn.2016-06.io.spdk:cnode1 -q nqn.2016-06.io.spdk:host1 -I 0d500810-d292-4b43-9fd9-bcab1888f70c -a 10.0.0.3 -s 4420 -i 4 00:15:49.448 11:26:44 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- target/ns_masking.sh@24 -- # waitforserial SPDKISFASTANDAWESOME 1 00:15:49.448 11:26:44 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- common/autotest_common.sh@1198 -- # local i=0 00:15:49.448 11:26:44 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- common/autotest_common.sh@1199 -- # local nvme_device_counter=1 nvme_devices=0 00:15:49.448 11:26:44 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- common/autotest_common.sh@1200 -- # [[ -n 1 ]] 00:15:49.448 11:26:44 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- common/autotest_common.sh@1201 -- # nvme_device_counter=1 00:15:49.448 11:26:44 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- common/autotest_common.sh@1205 -- # sleep 2 00:15:51.369 11:26:46 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- common/autotest_common.sh@1206 -- # (( i++ <= 15 )) 00:15:51.369 11:26:46 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- common/autotest_common.sh@1207 -- # lsblk -l -o NAME,SERIAL 00:15:51.369 11:26:46 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- common/autotest_common.sh@1207 -- # grep -c SPDKISFASTANDAWESOME 00:15:51.627 11:26:46 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- common/autotest_common.sh@1207 -- # nvme_devices=1 00:15:51.627 11:26:46 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- common/autotest_common.sh@1208 -- # (( nvme_devices == nvme_device_counter )) 00:15:51.627 11:26:46 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- common/autotest_common.sh@1208 -- # return 0 00:15:51.627 11:26:46 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- target/ns_masking.sh@26 -- # nvme list-subsys -o json 00:15:51.627 11:26:46 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- target/ns_masking.sh@26 -- # jq -r '.[].Subsystems[] | select(.NQN=="nqn.2016-06.io.spdk:cnode1") | .Paths[0].Name' 00:15:51.627 11:26:46 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- target/ns_masking.sh@26 -- # ctrl_id=nvme0 00:15:51.627 11:26:46 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- target/ns_masking.sh@27 -- # [[ -z nvme0 ]] 00:15:51.627 11:26:46 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- target/ns_masking.sh@84 -- # NOT ns_is_visible 0x1 00:15:51.627 11:26:46 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- common/autotest_common.sh@650 -- # local es=0 00:15:51.627 11:26:46 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- common/autotest_common.sh@652 -- # valid_exec_arg ns_is_visible 0x1 00:15:51.627 11:26:46 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- common/autotest_common.sh@638 -- # local arg=ns_is_visible 00:15:51.627 11:26:46 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:15:51.627 11:26:46 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- common/autotest_common.sh@642 -- # type -t ns_is_visible 00:15:51.627 11:26:46 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:15:51.627 11:26:46 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- common/autotest_common.sh@653 -- # ns_is_visible 0x1 00:15:51.627 11:26:46 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- target/ns_masking.sh@43 -- # nvme list-ns /dev/nvme0 00:15:51.627 11:26:46 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- target/ns_masking.sh@43 -- # grep 0x1 00:15:51.627 11:26:46 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- target/ns_masking.sh@44 -- # nvme id-ns /dev/nvme0 -n 0x1 -o json 00:15:51.627 11:26:46 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- target/ns_masking.sh@44 -- # jq -r .nguid 00:15:51.627 11:26:47 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- target/ns_masking.sh@44 -- # nguid=00000000000000000000000000000000 00:15:51.627 11:26:47 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- target/ns_masking.sh@45 -- # [[ 00000000000000000000000000000000 != \0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0 ]] 00:15:51.627 11:26:47 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- common/autotest_common.sh@653 -- # es=1 00:15:51.627 11:26:47 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:15:51.627 11:26:47 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:15:51.627 11:26:47 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:15:51.627 11:26:47 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- target/ns_masking.sh@85 -- # ns_is_visible 0x2 00:15:51.627 11:26:47 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- target/ns_masking.sh@43 -- # nvme list-ns /dev/nvme0 00:15:51.627 11:26:47 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- target/ns_masking.sh@43 -- # grep 0x2 00:15:51.627 [ 0]:0x2 00:15:51.627 11:26:47 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- target/ns_masking.sh@44 -- # nvme id-ns /dev/nvme0 -n 0x2 -o json 00:15:51.627 11:26:47 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- target/ns_masking.sh@44 -- # jq -r .nguid 00:15:51.627 11:26:47 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- target/ns_masking.sh@44 -- # nguid=8a5869baf1484f848b51d0619a09b25b 00:15:51.627 11:26:47 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- target/ns_masking.sh@45 -- # [[ 8a5869baf1484f848b51d0619a09b25b != \0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0 ]] 00:15:51.627 11:26:47 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- target/ns_masking.sh@88 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_ns_add_host nqn.2016-06.io.spdk:cnode1 1 nqn.2016-06.io.spdk:host1 00:15:52.193 11:26:47 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- target/ns_masking.sh@89 -- # ns_is_visible 0x1 00:15:52.193 11:26:47 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- target/ns_masking.sh@43 -- # nvme list-ns /dev/nvme0 00:15:52.193 11:26:47 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- target/ns_masking.sh@43 -- # grep 0x1 00:15:52.193 [ 0]:0x1 00:15:52.193 11:26:47 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- target/ns_masking.sh@44 -- # nvme id-ns /dev/nvme0 -n 0x1 -o json 00:15:52.193 11:26:47 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- target/ns_masking.sh@44 -- # jq -r .nguid 00:15:52.193 11:26:47 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- target/ns_masking.sh@44 -- # nguid=aab917712c3c4930888695c8a8e15003 00:15:52.193 11:26:47 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- target/ns_masking.sh@45 -- # [[ aab917712c3c4930888695c8a8e15003 != \0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0 ]] 00:15:52.193 11:26:47 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- target/ns_masking.sh@90 -- # ns_is_visible 0x2 00:15:52.193 11:26:47 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- target/ns_masking.sh@43 -- # nvme list-ns /dev/nvme0 00:15:52.193 11:26:47 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- target/ns_masking.sh@43 -- # grep 0x2 00:15:52.193 [ 1]:0x2 00:15:52.193 11:26:47 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- target/ns_masking.sh@44 -- # nvme id-ns /dev/nvme0 -n 0x2 -o json 00:15:52.193 11:26:47 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- target/ns_masking.sh@44 -- # jq -r .nguid 00:15:52.193 11:26:47 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- target/ns_masking.sh@44 -- # nguid=8a5869baf1484f848b51d0619a09b25b 00:15:52.193 11:26:47 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- target/ns_masking.sh@45 -- # [[ 8a5869baf1484f848b51d0619a09b25b != \0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0 ]] 00:15:52.193 11:26:47 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- target/ns_masking.sh@93 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_ns_remove_host nqn.2016-06.io.spdk:cnode1 1 nqn.2016-06.io.spdk:host1 00:15:52.451 11:26:47 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- target/ns_masking.sh@94 -- # NOT ns_is_visible 0x1 00:15:52.451 11:26:47 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- common/autotest_common.sh@650 -- # local es=0 00:15:52.451 11:26:47 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- common/autotest_common.sh@652 -- # valid_exec_arg ns_is_visible 0x1 00:15:52.451 11:26:47 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- common/autotest_common.sh@638 -- # local arg=ns_is_visible 00:15:52.451 11:26:47 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:15:52.451 11:26:47 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- common/autotest_common.sh@642 -- # type -t ns_is_visible 00:15:52.451 11:26:47 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:15:52.451 11:26:47 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- common/autotest_common.sh@653 -- # ns_is_visible 0x1 00:15:52.451 11:26:47 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- target/ns_masking.sh@43 -- # nvme list-ns /dev/nvme0 00:15:52.452 11:26:47 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- target/ns_masking.sh@43 -- # grep 0x1 00:15:52.452 11:26:47 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- target/ns_masking.sh@44 -- # nvme id-ns /dev/nvme0 -n 0x1 -o json 00:15:52.452 11:26:47 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- target/ns_masking.sh@44 -- # jq -r .nguid 00:15:52.452 11:26:47 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- target/ns_masking.sh@44 -- # nguid=00000000000000000000000000000000 00:15:52.452 11:26:47 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- target/ns_masking.sh@45 -- # [[ 00000000000000000000000000000000 != \0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0 ]] 00:15:52.452 11:26:47 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- common/autotest_common.sh@653 -- # es=1 00:15:52.452 11:26:47 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:15:52.452 11:26:47 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:15:52.452 11:26:47 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:15:52.452 11:26:47 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- target/ns_masking.sh@95 -- # ns_is_visible 0x2 00:15:52.452 11:26:47 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- target/ns_masking.sh@43 -- # nvme list-ns /dev/nvme0 00:15:52.452 11:26:47 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- target/ns_masking.sh@43 -- # grep 0x2 00:15:52.452 [ 0]:0x2 00:15:52.452 11:26:47 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- target/ns_masking.sh@44 -- # nvme id-ns /dev/nvme0 -n 0x2 -o json 00:15:52.452 11:26:47 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- target/ns_masking.sh@44 -- # jq -r .nguid 00:15:52.710 11:26:47 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- target/ns_masking.sh@44 -- # nguid=8a5869baf1484f848b51d0619a09b25b 00:15:52.710 11:26:47 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- target/ns_masking.sh@45 -- # [[ 8a5869baf1484f848b51d0619a09b25b != \0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0 ]] 00:15:52.710 11:26:47 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- target/ns_masking.sh@97 -- # disconnect 00:15:52.710 11:26:47 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- target/ns_masking.sh@38 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:15:52.710 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:15:52.710 11:26:48 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- target/ns_masking.sh@100 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_ns_add_host nqn.2016-06.io.spdk:cnode1 1 nqn.2016-06.io.spdk:host1 00:15:52.973 11:26:48 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- target/ns_masking.sh@101 -- # connect 2 00:15:52.973 11:26:48 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- target/ns_masking.sh@22 -- # nvme connect -t tcp -n nqn.2016-06.io.spdk:cnode1 -q nqn.2016-06.io.spdk:host1 -I 0d500810-d292-4b43-9fd9-bcab1888f70c -a 10.0.0.3 -s 4420 -i 4 00:15:52.973 11:26:48 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- target/ns_masking.sh@24 -- # waitforserial SPDKISFASTANDAWESOME 2 00:15:52.973 11:26:48 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- common/autotest_common.sh@1198 -- # local i=0 00:15:52.973 11:26:48 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- common/autotest_common.sh@1199 -- # local nvme_device_counter=1 nvme_devices=0 00:15:52.973 11:26:48 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- common/autotest_common.sh@1200 -- # [[ -n 2 ]] 00:15:52.973 11:26:48 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- common/autotest_common.sh@1201 -- # nvme_device_counter=2 00:15:52.973 11:26:48 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- common/autotest_common.sh@1205 -- # sleep 2 00:15:55.503 11:26:50 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- common/autotest_common.sh@1206 -- # (( i++ <= 15 )) 00:15:55.503 11:26:50 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- common/autotest_common.sh@1207 -- # lsblk -l -o NAME,SERIAL 00:15:55.503 11:26:50 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- common/autotest_common.sh@1207 -- # grep -c SPDKISFASTANDAWESOME 00:15:55.503 11:26:50 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- common/autotest_common.sh@1207 -- # nvme_devices=2 00:15:55.503 11:26:50 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- common/autotest_common.sh@1208 -- # (( nvme_devices == nvme_device_counter )) 00:15:55.503 11:26:50 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- common/autotest_common.sh@1208 -- # return 0 00:15:55.503 11:26:50 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- target/ns_masking.sh@26 -- # nvme list-subsys -o json 00:15:55.503 11:26:50 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- target/ns_masking.sh@26 -- # jq -r '.[].Subsystems[] | select(.NQN=="nqn.2016-06.io.spdk:cnode1") | .Paths[0].Name' 00:15:55.503 11:26:50 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- target/ns_masking.sh@26 -- # ctrl_id=nvme0 00:15:55.503 11:26:50 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- target/ns_masking.sh@27 -- # [[ -z nvme0 ]] 00:15:55.503 11:26:50 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- target/ns_masking.sh@102 -- # ns_is_visible 0x1 00:15:55.503 11:26:50 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- target/ns_masking.sh@43 -- # nvme list-ns /dev/nvme0 00:15:55.503 11:26:50 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- target/ns_masking.sh@43 -- # grep 0x1 00:15:55.503 [ 0]:0x1 00:15:55.503 11:26:50 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- target/ns_masking.sh@44 -- # nvme id-ns /dev/nvme0 -n 0x1 -o json 00:15:55.503 11:26:50 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- target/ns_masking.sh@44 -- # jq -r .nguid 00:15:55.503 11:26:50 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- target/ns_masking.sh@44 -- # nguid=aab917712c3c4930888695c8a8e15003 00:15:55.503 11:26:50 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- target/ns_masking.sh@45 -- # [[ aab917712c3c4930888695c8a8e15003 != \0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0 ]] 00:15:55.503 11:26:50 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- target/ns_masking.sh@103 -- # ns_is_visible 0x2 00:15:55.503 11:26:50 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- target/ns_masking.sh@43 -- # nvme list-ns /dev/nvme0 00:15:55.503 11:26:50 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- target/ns_masking.sh@43 -- # grep 0x2 00:15:55.503 [ 1]:0x2 00:15:55.503 11:26:50 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- target/ns_masking.sh@44 -- # jq -r .nguid 00:15:55.503 11:26:50 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- target/ns_masking.sh@44 -- # nvme id-ns /dev/nvme0 -n 0x2 -o json 00:15:55.503 11:26:50 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- target/ns_masking.sh@44 -- # nguid=8a5869baf1484f848b51d0619a09b25b 00:15:55.503 11:26:50 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- target/ns_masking.sh@45 -- # [[ 8a5869baf1484f848b51d0619a09b25b != \0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0 ]] 00:15:55.503 11:26:50 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- target/ns_masking.sh@106 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_ns_remove_host nqn.2016-06.io.spdk:cnode1 1 nqn.2016-06.io.spdk:host1 00:15:55.503 11:26:50 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- target/ns_masking.sh@107 -- # NOT ns_is_visible 0x1 00:15:55.503 11:26:50 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- common/autotest_common.sh@650 -- # local es=0 00:15:55.503 11:26:50 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- common/autotest_common.sh@652 -- # valid_exec_arg ns_is_visible 0x1 00:15:55.503 11:26:50 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- common/autotest_common.sh@638 -- # local arg=ns_is_visible 00:15:55.503 11:26:50 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:15:55.503 11:26:50 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- common/autotest_common.sh@642 -- # type -t ns_is_visible 00:15:55.503 11:26:50 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:15:55.503 11:26:50 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- common/autotest_common.sh@653 -- # ns_is_visible 0x1 00:15:55.503 11:26:50 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- target/ns_masking.sh@43 -- # nvme list-ns /dev/nvme0 00:15:55.503 11:26:50 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- target/ns_masking.sh@43 -- # grep 0x1 00:15:55.503 11:26:50 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- target/ns_masking.sh@44 -- # nvme id-ns /dev/nvme0 -n 0x1 -o json 00:15:55.503 11:26:50 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- target/ns_masking.sh@44 -- # jq -r .nguid 00:15:55.761 11:26:51 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- target/ns_masking.sh@44 -- # nguid=00000000000000000000000000000000 00:15:55.761 11:26:51 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- target/ns_masking.sh@45 -- # [[ 00000000000000000000000000000000 != \0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0 ]] 00:15:55.761 11:26:51 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- common/autotest_common.sh@653 -- # es=1 00:15:55.761 11:26:51 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:15:55.761 11:26:51 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:15:55.761 11:26:51 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:15:55.762 11:26:51 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- target/ns_masking.sh@108 -- # ns_is_visible 0x2 00:15:55.762 11:26:51 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- target/ns_masking.sh@43 -- # nvme list-ns /dev/nvme0 00:15:55.762 11:26:51 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- target/ns_masking.sh@43 -- # grep 0x2 00:15:55.762 [ 0]:0x2 00:15:55.762 11:26:51 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- target/ns_masking.sh@44 -- # nvme id-ns /dev/nvme0 -n 0x2 -o json 00:15:55.762 11:26:51 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- target/ns_masking.sh@44 -- # jq -r .nguid 00:15:55.762 11:26:51 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- target/ns_masking.sh@44 -- # nguid=8a5869baf1484f848b51d0619a09b25b 00:15:55.762 11:26:51 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- target/ns_masking.sh@45 -- # [[ 8a5869baf1484f848b51d0619a09b25b != \0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0 ]] 00:15:55.762 11:26:51 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- target/ns_masking.sh@111 -- # NOT /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_ns_remove_host nqn.2016-06.io.spdk:cnode1 2 nqn.2016-06.io.spdk:host1 00:15:55.762 11:26:51 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- common/autotest_common.sh@650 -- # local es=0 00:15:55.762 11:26:51 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- common/autotest_common.sh@652 -- # valid_exec_arg /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_ns_remove_host nqn.2016-06.io.spdk:cnode1 2 nqn.2016-06.io.spdk:host1 00:15:55.762 11:26:51 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- common/autotest_common.sh@638 -- # local arg=/home/vagrant/spdk_repo/spdk/scripts/rpc.py 00:15:55.762 11:26:51 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:15:55.762 11:26:51 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- common/autotest_common.sh@642 -- # type -t /home/vagrant/spdk_repo/spdk/scripts/rpc.py 00:15:55.762 11:26:51 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:15:55.762 11:26:51 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- common/autotest_common.sh@644 -- # type -P /home/vagrant/spdk_repo/spdk/scripts/rpc.py 00:15:55.762 11:26:51 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:15:55.762 11:26:51 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- common/autotest_common.sh@644 -- # arg=/home/vagrant/spdk_repo/spdk/scripts/rpc.py 00:15:55.762 11:26:51 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- common/autotest_common.sh@644 -- # [[ -x /home/vagrant/spdk_repo/spdk/scripts/rpc.py ]] 00:15:55.762 11:26:51 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- common/autotest_common.sh@653 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_ns_remove_host nqn.2016-06.io.spdk:cnode1 2 nqn.2016-06.io.spdk:host1 00:15:56.020 [2024-10-07 11:26:51.398167] nvmf_rpc.c:1870:nvmf_rpc_ns_visible_paused: *ERROR*: Unable to add/remove nqn.2016-06.io.spdk:host1 to namespace ID 2 00:15:56.020 2024/10/07 11:26:51 error on JSON-RPC call, method: nvmf_ns_remove_host, params: map[host:nqn.2016-06.io.spdk:host1 nqn:nqn.2016-06.io.spdk:cnode1 nsid:2], err: error received for nvmf_ns_remove_host method, err: Code=-32602 Msg=Invalid parameters 00:15:56.020 request: 00:15:56.020 { 00:15:56.020 "method": "nvmf_ns_remove_host", 00:15:56.020 "params": { 00:15:56.020 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:15:56.020 "nsid": 2, 00:15:56.020 "host": "nqn.2016-06.io.spdk:host1" 00:15:56.020 } 00:15:56.020 } 00:15:56.020 Got JSON-RPC error response 00:15:56.020 GoRPCClient: error on JSON-RPC call 00:15:56.020 11:26:51 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- common/autotest_common.sh@653 -- # es=1 00:15:56.020 11:26:51 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:15:56.020 11:26:51 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:15:56.020 11:26:51 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:15:56.020 11:26:51 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- target/ns_masking.sh@112 -- # NOT ns_is_visible 0x1 00:15:56.020 11:26:51 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- common/autotest_common.sh@650 -- # local es=0 00:15:56.020 11:26:51 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- common/autotest_common.sh@652 -- # valid_exec_arg ns_is_visible 0x1 00:15:56.020 11:26:51 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- common/autotest_common.sh@638 -- # local arg=ns_is_visible 00:15:56.020 11:26:51 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:15:56.020 11:26:51 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- common/autotest_common.sh@642 -- # type -t ns_is_visible 00:15:56.020 11:26:51 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:15:56.020 11:26:51 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- common/autotest_common.sh@653 -- # ns_is_visible 0x1 00:15:56.020 11:26:51 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- target/ns_masking.sh@43 -- # nvme list-ns /dev/nvme0 00:15:56.020 11:26:51 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- target/ns_masking.sh@43 -- # grep 0x1 00:15:56.020 11:26:51 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- target/ns_masking.sh@44 -- # nvme id-ns /dev/nvme0 -n 0x1 -o json 00:15:56.020 11:26:51 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- target/ns_masking.sh@44 -- # jq -r .nguid 00:15:56.020 11:26:51 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- target/ns_masking.sh@44 -- # nguid=00000000000000000000000000000000 00:15:56.020 11:26:51 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- target/ns_masking.sh@45 -- # [[ 00000000000000000000000000000000 != \0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0 ]] 00:15:56.020 11:26:51 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- common/autotest_common.sh@653 -- # es=1 00:15:56.020 11:26:51 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:15:56.020 11:26:51 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:15:56.020 11:26:51 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:15:56.020 11:26:51 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- target/ns_masking.sh@113 -- # ns_is_visible 0x2 00:15:56.020 11:26:51 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- target/ns_masking.sh@43 -- # nvme list-ns /dev/nvme0 00:15:56.020 11:26:51 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- target/ns_masking.sh@43 -- # grep 0x2 00:15:56.020 [ 0]:0x2 00:15:56.020 11:26:51 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- target/ns_masking.sh@44 -- # jq -r .nguid 00:15:56.020 11:26:51 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- target/ns_masking.sh@44 -- # nvme id-ns /dev/nvme0 -n 0x2 -o json 00:15:56.020 11:26:51 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- target/ns_masking.sh@44 -- # nguid=8a5869baf1484f848b51d0619a09b25b 00:15:56.020 11:26:51 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- target/ns_masking.sh@45 -- # [[ 8a5869baf1484f848b51d0619a09b25b != \0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0 ]] 00:15:56.020 11:26:51 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- target/ns_masking.sh@114 -- # disconnect 00:15:56.020 11:26:51 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- target/ns_masking.sh@38 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:15:56.278 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:15:56.278 11:26:51 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- target/ns_masking.sh@118 -- # hostpid=76597 00:15:56.278 11:26:51 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- target/ns_masking.sh@117 -- # /home/vagrant/spdk_repo/spdk/build/bin/spdk_tgt -r /var/tmp/host.sock -m 2 00:15:56.278 11:26:51 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- target/ns_masking.sh@119 -- # trap 'killprocess $hostpid; nvmftestfini' SIGINT SIGTERM EXIT 00:15:56.278 11:26:51 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- target/ns_masking.sh@121 -- # waitforlisten 76597 /var/tmp/host.sock 00:15:56.278 11:26:51 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- common/autotest_common.sh@831 -- # '[' -z 76597 ']' 00:15:56.278 11:26:51 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- common/autotest_common.sh@835 -- # local rpc_addr=/var/tmp/host.sock 00:15:56.278 11:26:51 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- common/autotest_common.sh@836 -- # local max_retries=100 00:15:56.278 Waiting for process to start up and listen on UNIX domain socket /var/tmp/host.sock... 00:15:56.278 11:26:51 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- common/autotest_common.sh@838 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/host.sock...' 00:15:56.278 11:26:51 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- common/autotest_common.sh@840 -- # xtrace_disable 00:15:56.278 11:26:51 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- common/autotest_common.sh@10 -- # set +x 00:15:56.278 [2024-10-07 11:26:51.645557] Starting SPDK v25.01-pre git sha1 2a4f56c54 / DPDK 24.03.0 initialization... 00:15:56.278 [2024-10-07 11:26:51.645679] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 2 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --iova-mode=pa --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid76597 ] 00:15:56.278 [2024-10-07 11:26:51.779477] app.c: 917:spdk_app_start: *NOTICE*: Total cores available: 1 00:15:56.536 [2024-10-07 11:26:51.890118] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 1 00:15:57.493 11:26:52 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- common/autotest_common.sh@860 -- # (( i == 0 )) 00:15:57.493 11:26:52 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- common/autotest_common.sh@864 -- # return 0 00:15:57.493 11:26:52 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- target/ns_masking.sh@122 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:15:57.493 11:26:52 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- target/ns_masking.sh@123 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 2 00:15:58.057 11:26:53 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- target/ns_masking.sh@124 -- # uuid2nguid ab963cf9-7f01-4533-a7ce-aafe87f92623 00:15:58.057 11:26:53 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- nvmf/common.sh@785 -- # tr -d - 00:15:58.057 11:26:53 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- target/ns_masking.sh@124 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 -n 1 -g AB963CF97F014533A7CEAAFE87F92623 -i 00:15:58.314 11:26:53 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- target/ns_masking.sh@125 -- # uuid2nguid 6c227a88-373e-46bf-89bb-8c78ce20d013 00:15:58.314 11:26:53 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- nvmf/common.sh@785 -- # tr -d - 00:15:58.314 11:26:53 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- target/ns_masking.sh@125 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc2 -n 2 -g 6C227A88373E46BF89BB8C78CE20D013 -i 00:15:58.572 11:26:53 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- target/ns_masking.sh@126 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_ns_add_host nqn.2016-06.io.spdk:cnode1 1 nqn.2016-06.io.spdk:host1 00:15:58.830 11:26:54 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- target/ns_masking.sh@127 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_ns_add_host nqn.2016-06.io.spdk:cnode1 2 nqn.2016-06.io.spdk:host2 00:15:59.087 11:26:54 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- target/ns_masking.sh@129 -- # hostrpc bdev_nvme_attach_controller -t tcp -a 10.0.0.3 -f ipv4 -s 4420 -n nqn.2016-06.io.spdk:cnode1 -q nqn.2016-06.io.spdk:host1 -b nvme0 00:15:59.087 11:26:54 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- target/ns_masking.sh@48 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_attach_controller -t tcp -a 10.0.0.3 -f ipv4 -s 4420 -n nqn.2016-06.io.spdk:cnode1 -q nqn.2016-06.io.spdk:host1 -b nvme0 00:15:59.345 nvme0n1 00:15:59.345 11:26:54 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- target/ns_masking.sh@131 -- # hostrpc bdev_nvme_attach_controller -t tcp -a 10.0.0.3 -f ipv4 -s 4420 -n nqn.2016-06.io.spdk:cnode1 -q nqn.2016-06.io.spdk:host2 -b nvme1 00:15:59.345 11:26:54 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- target/ns_masking.sh@48 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_attach_controller -t tcp -a 10.0.0.3 -f ipv4 -s 4420 -n nqn.2016-06.io.spdk:cnode1 -q nqn.2016-06.io.spdk:host2 -b nvme1 00:15:59.912 nvme1n2 00:15:59.912 11:26:55 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- target/ns_masking.sh@134 -- # jq -r '.[].name' 00:15:59.912 11:26:55 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- target/ns_masking.sh@134 -- # hostrpc bdev_get_bdevs 00:15:59.912 11:26:55 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- target/ns_masking.sh@134 -- # sort 00:15:59.912 11:26:55 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- target/ns_masking.sh@48 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_get_bdevs 00:15:59.912 11:26:55 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- target/ns_masking.sh@134 -- # xargs 00:16:00.170 11:26:55 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- target/ns_masking.sh@134 -- # [[ nvme0n1 nvme1n2 == \n\v\m\e\0\n\1\ \n\v\m\e\1\n\2 ]] 00:16:00.170 11:26:55 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- target/ns_masking.sh@135 -- # hostrpc bdev_get_bdevs -b nvme0n1 00:16:00.170 11:26:55 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- target/ns_masking.sh@135 -- # jq -r '.[].uuid' 00:16:00.170 11:26:55 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- target/ns_masking.sh@48 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_get_bdevs -b nvme0n1 00:16:00.428 11:26:55 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- target/ns_masking.sh@135 -- # [[ ab963cf9-7f01-4533-a7ce-aafe87f92623 == \a\b\9\6\3\c\f\9\-\7\f\0\1\-\4\5\3\3\-\a\7\c\e\-\a\a\f\e\8\7\f\9\2\6\2\3 ]] 00:16:00.428 11:26:55 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- target/ns_masking.sh@136 -- # hostrpc bdev_get_bdevs -b nvme1n2 00:16:00.428 11:26:55 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- target/ns_masking.sh@48 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_get_bdevs -b nvme1n2 00:16:00.428 11:26:55 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- target/ns_masking.sh@136 -- # jq -r '.[].uuid' 00:16:00.741 11:26:56 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- target/ns_masking.sh@136 -- # [[ 6c227a88-373e-46bf-89bb-8c78ce20d013 == \6\c\2\2\7\a\8\8\-\3\7\3\e\-\4\6\b\f\-\8\9\b\b\-\8\c\7\8\c\e\2\0\d\0\1\3 ]] 00:16:00.741 11:26:56 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- target/ns_masking.sh@138 -- # killprocess 76597 00:16:00.741 11:26:56 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- common/autotest_common.sh@950 -- # '[' -z 76597 ']' 00:16:00.741 11:26:56 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- common/autotest_common.sh@954 -- # kill -0 76597 00:16:00.741 11:26:56 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- common/autotest_common.sh@955 -- # uname 00:16:00.741 11:26:56 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- common/autotest_common.sh@955 -- # '[' Linux = Linux ']' 00:16:00.741 11:26:56 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- common/autotest_common.sh@956 -- # ps --no-headers -o comm= 76597 00:16:00.741 11:26:56 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- common/autotest_common.sh@956 -- # process_name=reactor_1 00:16:00.741 11:26:56 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- common/autotest_common.sh@960 -- # '[' reactor_1 = sudo ']' 00:16:00.741 11:26:56 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- common/autotest_common.sh@968 -- # echo 'killing process with pid 76597' 00:16:00.741 killing process with pid 76597 00:16:00.742 11:26:56 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- common/autotest_common.sh@969 -- # kill 76597 00:16:00.742 11:26:56 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- common/autotest_common.sh@974 -- # wait 76597 00:16:01.305 11:26:56 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- target/ns_masking.sh@139 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:16:01.563 11:26:56 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- target/ns_masking.sh@141 -- # trap - SIGINT SIGTERM EXIT 00:16:01.563 11:26:56 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- target/ns_masking.sh@142 -- # nvmftestfini 00:16:01.563 11:26:56 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- nvmf/common.sh@514 -- # nvmfcleanup 00:16:01.563 11:26:56 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- nvmf/common.sh@121 -- # sync 00:16:01.563 11:26:56 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- nvmf/common.sh@123 -- # '[' tcp == tcp ']' 00:16:01.563 11:26:56 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- nvmf/common.sh@124 -- # set +e 00:16:01.563 11:26:56 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- nvmf/common.sh@125 -- # for i in {1..20} 00:16:01.563 11:26:56 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- nvmf/common.sh@126 -- # modprobe -v -r nvme-tcp 00:16:01.563 rmmod nvme_tcp 00:16:01.563 rmmod nvme_fabrics 00:16:01.563 rmmod nvme_keyring 00:16:01.563 11:26:56 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- nvmf/common.sh@127 -- # modprobe -v -r nvme-fabrics 00:16:01.563 11:26:56 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- nvmf/common.sh@128 -- # set -e 00:16:01.563 11:26:56 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- nvmf/common.sh@129 -- # return 0 00:16:01.563 11:26:56 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- nvmf/common.sh@515 -- # '[' -n 76214 ']' 00:16:01.563 11:26:56 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- nvmf/common.sh@516 -- # killprocess 76214 00:16:01.563 11:26:56 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- common/autotest_common.sh@950 -- # '[' -z 76214 ']' 00:16:01.563 11:26:56 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- common/autotest_common.sh@954 -- # kill -0 76214 00:16:01.563 11:26:56 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- common/autotest_common.sh@955 -- # uname 00:16:01.563 11:26:56 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- common/autotest_common.sh@955 -- # '[' Linux = Linux ']' 00:16:01.563 11:26:56 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- common/autotest_common.sh@956 -- # ps --no-headers -o comm= 76214 00:16:01.563 11:26:56 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- common/autotest_common.sh@956 -- # process_name=reactor_0 00:16:01.563 11:26:56 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- common/autotest_common.sh@960 -- # '[' reactor_0 = sudo ']' 00:16:01.563 killing process with pid 76214 00:16:01.563 11:26:56 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- common/autotest_common.sh@968 -- # echo 'killing process with pid 76214' 00:16:01.563 11:26:56 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- common/autotest_common.sh@969 -- # kill 76214 00:16:01.563 11:26:56 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- common/autotest_common.sh@974 -- # wait 76214 00:16:01.829 11:26:57 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- nvmf/common.sh@518 -- # '[' '' == iso ']' 00:16:01.829 11:26:57 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- nvmf/common.sh@521 -- # [[ tcp == \t\c\p ]] 00:16:01.829 11:26:57 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- nvmf/common.sh@522 -- # nvmf_tcp_fini 00:16:01.830 11:26:57 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- nvmf/common.sh@297 -- # iptr 00:16:01.830 11:26:57 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- nvmf/common.sh@789 -- # grep -v SPDK_NVMF 00:16:01.830 11:26:57 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- nvmf/common.sh@789 -- # iptables-save 00:16:01.830 11:26:57 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- nvmf/common.sh@789 -- # iptables-restore 00:16:01.830 11:26:57 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- nvmf/common.sh@298 -- # [[ nvmf_tgt_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s\_\s\p\d\k ]] 00:16:01.830 11:26:57 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- nvmf/common.sh@299 -- # nvmf_veth_fini 00:16:01.830 11:26:57 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- nvmf/common.sh@233 -- # ip link set nvmf_init_br nomaster 00:16:01.830 11:26:57 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- nvmf/common.sh@234 -- # ip link set nvmf_init_br2 nomaster 00:16:01.830 11:26:57 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- nvmf/common.sh@235 -- # ip link set nvmf_tgt_br nomaster 00:16:01.830 11:26:57 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- nvmf/common.sh@236 -- # ip link set nvmf_tgt_br2 nomaster 00:16:01.830 11:26:57 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- nvmf/common.sh@237 -- # ip link set nvmf_init_br down 00:16:01.830 11:26:57 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- nvmf/common.sh@238 -- # ip link set nvmf_init_br2 down 00:16:01.830 11:26:57 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- nvmf/common.sh@239 -- # ip link set nvmf_tgt_br down 00:16:01.830 11:26:57 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- nvmf/common.sh@240 -- # ip link set nvmf_tgt_br2 down 00:16:01.830 11:26:57 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- nvmf/common.sh@241 -- # ip link delete nvmf_br type bridge 00:16:02.090 11:26:57 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- nvmf/common.sh@242 -- # ip link delete nvmf_init_if 00:16:02.090 11:26:57 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- nvmf/common.sh@243 -- # ip link delete nvmf_init_if2 00:16:02.090 11:26:57 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- nvmf/common.sh@244 -- # ip netns exec nvmf_tgt_ns_spdk ip link delete nvmf_tgt_if 00:16:02.090 11:26:57 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- nvmf/common.sh@245 -- # ip netns exec nvmf_tgt_ns_spdk ip link delete nvmf_tgt_if2 00:16:02.090 11:26:57 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- nvmf/common.sh@246 -- # remove_spdk_ns 00:16:02.090 11:26:57 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- nvmf/common.sh@654 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:16:02.090 11:26:57 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 15> /dev/null' 00:16:02.090 11:26:57 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:16:02.090 11:26:57 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- nvmf/common.sh@300 -- # return 0 00:16:02.090 00:16:02.090 real 0m19.491s 00:16:02.090 user 0m31.074s 00:16:02.090 sys 0m3.078s 00:16:02.090 11:26:57 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- common/autotest_common.sh@1126 -- # xtrace_disable 00:16:02.090 11:26:57 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- common/autotest_common.sh@10 -- # set +x 00:16:02.090 ************************************ 00:16:02.090 END TEST nvmf_ns_masking 00:16:02.090 ************************************ 00:16:02.090 11:26:57 nvmf_tcp.nvmf_target_extra -- nvmf/nvmf_target_extra.sh@27 -- # [[ 0 -eq 1 ]] 00:16:02.090 11:26:57 nvmf_tcp.nvmf_target_extra -- nvmf/nvmf_target_extra.sh@30 -- # [[ 0 -eq 1 ]] 00:16:02.090 11:26:57 nvmf_tcp.nvmf_target_extra -- nvmf/nvmf_target_extra.sh@37 -- # run_test nvmf_auth_target /home/vagrant/spdk_repo/spdk/test/nvmf/target/auth.sh --transport=tcp 00:16:02.090 11:26:57 nvmf_tcp.nvmf_target_extra -- common/autotest_common.sh@1101 -- # '[' 3 -le 1 ']' 00:16:02.090 11:26:57 nvmf_tcp.nvmf_target_extra -- common/autotest_common.sh@1107 -- # xtrace_disable 00:16:02.090 11:26:57 nvmf_tcp.nvmf_target_extra -- common/autotest_common.sh@10 -- # set +x 00:16:02.090 ************************************ 00:16:02.090 START TEST nvmf_auth_target 00:16:02.090 ************************************ 00:16:02.090 11:26:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@1125 -- # /home/vagrant/spdk_repo/spdk/test/nvmf/target/auth.sh --transport=tcp 00:16:02.348 * Looking for test storage... 00:16:02.348 * Found test storage at /home/vagrant/spdk_repo/spdk/test/nvmf/target 00:16:02.348 11:26:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@1680 -- # [[ y == y ]] 00:16:02.348 11:26:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@1681 -- # lcov --version 00:16:02.348 11:26:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@1681 -- # awk '{print $NF}' 00:16:02.348 11:26:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@1681 -- # lt 1.15 2 00:16:02.348 11:26:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- scripts/common.sh@373 -- # cmp_versions 1.15 '<' 2 00:16:02.348 11:26:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- scripts/common.sh@333 -- # local ver1 ver1_l 00:16:02.348 11:26:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- scripts/common.sh@334 -- # local ver2 ver2_l 00:16:02.348 11:26:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- scripts/common.sh@336 -- # IFS=.-: 00:16:02.348 11:26:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- scripts/common.sh@336 -- # read -ra ver1 00:16:02.348 11:26:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- scripts/common.sh@337 -- # IFS=.-: 00:16:02.348 11:26:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- scripts/common.sh@337 -- # read -ra ver2 00:16:02.348 11:26:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- scripts/common.sh@338 -- # local 'op=<' 00:16:02.348 11:26:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- scripts/common.sh@340 -- # ver1_l=2 00:16:02.348 11:26:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- scripts/common.sh@341 -- # ver2_l=1 00:16:02.348 11:26:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- scripts/common.sh@343 -- # local lt=0 gt=0 eq=0 v 00:16:02.348 11:26:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- scripts/common.sh@344 -- # case "$op" in 00:16:02.348 11:26:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- scripts/common.sh@345 -- # : 1 00:16:02.348 11:26:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- scripts/common.sh@364 -- # (( v = 0 )) 00:16:02.348 11:26:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- scripts/common.sh@364 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:16:02.348 11:26:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- scripts/common.sh@365 -- # decimal 1 00:16:02.348 11:26:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- scripts/common.sh@353 -- # local d=1 00:16:02.348 11:26:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- scripts/common.sh@354 -- # [[ 1 =~ ^[0-9]+$ ]] 00:16:02.348 11:26:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- scripts/common.sh@355 -- # echo 1 00:16:02.348 11:26:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- scripts/common.sh@365 -- # ver1[v]=1 00:16:02.348 11:26:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- scripts/common.sh@366 -- # decimal 2 00:16:02.348 11:26:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- scripts/common.sh@353 -- # local d=2 00:16:02.348 11:26:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- scripts/common.sh@354 -- # [[ 2 =~ ^[0-9]+$ ]] 00:16:02.348 11:26:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- scripts/common.sh@355 -- # echo 2 00:16:02.348 11:26:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- scripts/common.sh@366 -- # ver2[v]=2 00:16:02.348 11:26:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- scripts/common.sh@367 -- # (( ver1[v] > ver2[v] )) 00:16:02.348 11:26:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- scripts/common.sh@368 -- # (( ver1[v] < ver2[v] )) 00:16:02.348 11:26:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- scripts/common.sh@368 -- # return 0 00:16:02.348 11:26:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@1682 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:16:02.348 11:26:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@1694 -- # export 'LCOV_OPTS= 00:16:02.348 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:16:02.348 --rc genhtml_branch_coverage=1 00:16:02.348 --rc genhtml_function_coverage=1 00:16:02.348 --rc genhtml_legend=1 00:16:02.348 --rc geninfo_all_blocks=1 00:16:02.348 --rc geninfo_unexecuted_blocks=1 00:16:02.348 00:16:02.348 ' 00:16:02.348 11:26:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@1694 -- # LCOV_OPTS=' 00:16:02.348 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:16:02.348 --rc genhtml_branch_coverage=1 00:16:02.348 --rc genhtml_function_coverage=1 00:16:02.348 --rc genhtml_legend=1 00:16:02.348 --rc geninfo_all_blocks=1 00:16:02.348 --rc geninfo_unexecuted_blocks=1 00:16:02.348 00:16:02.348 ' 00:16:02.348 11:26:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@1695 -- # export 'LCOV=lcov 00:16:02.348 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:16:02.348 --rc genhtml_branch_coverage=1 00:16:02.348 --rc genhtml_function_coverage=1 00:16:02.348 --rc genhtml_legend=1 00:16:02.348 --rc geninfo_all_blocks=1 00:16:02.348 --rc geninfo_unexecuted_blocks=1 00:16:02.348 00:16:02.348 ' 00:16:02.348 11:26:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@1695 -- # LCOV='lcov 00:16:02.348 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:16:02.348 --rc genhtml_branch_coverage=1 00:16:02.348 --rc genhtml_function_coverage=1 00:16:02.348 --rc genhtml_legend=1 00:16:02.348 --rc geninfo_all_blocks=1 00:16:02.348 --rc geninfo_unexecuted_blocks=1 00:16:02.348 00:16:02.348 ' 00:16:02.348 11:26:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@10 -- # source /home/vagrant/spdk_repo/spdk/test/nvmf/common.sh 00:16:02.348 11:26:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@7 -- # uname -s 00:16:02.348 11:26:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:16:02.348 11:26:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:16:02.348 11:26:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:16:02.348 11:26:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:16:02.348 11:26:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:16:02.348 11:26:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:16:02.348 11:26:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:16:02.348 11:26:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:16:02.348 11:26:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:16:02.348 11:26:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:16:02.348 11:26:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:c758a4ed-f09f-4c82-9afb-3d096f035464 00:16:02.348 11:26:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@18 -- # NVME_HOSTID=c758a4ed-f09f-4c82-9afb-3d096f035464 00:16:02.348 11:26:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:16:02.348 11:26:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:16:02.348 11:26:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@21 -- # NET_TYPE=virt 00:16:02.348 11:26:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:16:02.348 11:26:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@49 -- # source /home/vagrant/spdk_repo/spdk/scripts/common.sh 00:16:02.348 11:26:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- scripts/common.sh@15 -- # shopt -s extglob 00:16:02.348 11:26:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- scripts/common.sh@544 -- # [[ -e /bin/wpdk_common.sh ]] 00:16:02.348 11:26:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- scripts/common.sh@552 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:16:02.348 11:26:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- scripts/common.sh@553 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:16:02.348 11:26:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:02.348 11:26:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:02.348 11:26:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:02.348 11:26:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- paths/export.sh@5 -- # export PATH 00:16:02.348 11:26:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:02.348 11:26:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@51 -- # : 0 00:16:02.348 11:26:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@52 -- # export NVMF_APP_SHM_ID 00:16:02.348 11:26:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@53 -- # build_nvmf_app_args 00:16:02.348 11:26:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:16:02.348 11:26:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:16:02.348 11:26:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:16:02.348 11:26:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@33 -- # '[' '' -eq 1 ']' 00:16:02.348 /home/vagrant/spdk_repo/spdk/test/nvmf/common.sh: line 33: [: : integer expression expected 00:16:02.348 11:26:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@37 -- # '[' -n '' ']' 00:16:02.348 11:26:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@39 -- # '[' 0 -eq 1 ']' 00:16:02.348 11:26:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@55 -- # have_pci_nics=0 00:16:02.348 11:26:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@13 -- # digests=("sha256" "sha384" "sha512") 00:16:02.348 11:26:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@14 -- # dhgroups=("null" "ffdhe2048" "ffdhe3072" "ffdhe4096" "ffdhe6144" "ffdhe8192") 00:16:02.348 11:26:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@15 -- # subnqn=nqn.2024-03.io.spdk:cnode0 00:16:02.348 11:26:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@16 -- # hostnqn=nqn.2014-08.org.nvmexpress:uuid:c758a4ed-f09f-4c82-9afb-3d096f035464 00:16:02.348 11:26:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@17 -- # hostsock=/var/tmp/host.sock 00:16:02.348 11:26:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@18 -- # keys=() 00:16:02.348 11:26:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@18 -- # ckeys=() 00:16:02.348 11:26:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@86 -- # nvmftestinit 00:16:02.348 11:26:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@467 -- # '[' -z tcp ']' 00:16:02.348 11:26:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@472 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:16:02.348 11:26:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@474 -- # prepare_net_devs 00:16:02.348 11:26:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@436 -- # local -g is_hw=no 00:16:02.348 11:26:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@438 -- # remove_spdk_ns 00:16:02.348 11:26:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@654 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:16:02.348 11:26:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 15> /dev/null' 00:16:02.348 11:26:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:16:02.348 11:26:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@440 -- # [[ virt != virt ]] 00:16:02.348 11:26:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@442 -- # [[ no == yes ]] 00:16:02.348 11:26:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@449 -- # [[ virt == phy ]] 00:16:02.348 11:26:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@452 -- # [[ virt == phy-fallback ]] 00:16:02.348 11:26:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@457 -- # [[ tcp == tcp ]] 00:16:02.348 11:26:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@458 -- # nvmf_veth_init 00:16:02.348 11:26:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@145 -- # NVMF_FIRST_INITIATOR_IP=10.0.0.1 00:16:02.348 11:26:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@146 -- # NVMF_SECOND_INITIATOR_IP=10.0.0.2 00:16:02.349 11:26:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@147 -- # NVMF_FIRST_TARGET_IP=10.0.0.3 00:16:02.349 11:26:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@148 -- # NVMF_SECOND_TARGET_IP=10.0.0.4 00:16:02.349 11:26:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@149 -- # NVMF_INITIATOR_IP=10.0.0.1 00:16:02.349 11:26:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@150 -- # NVMF_BRIDGE=nvmf_br 00:16:02.349 11:26:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@151 -- # NVMF_INITIATOR_INTERFACE=nvmf_init_if 00:16:02.349 11:26:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@152 -- # NVMF_INITIATOR_INTERFACE2=nvmf_init_if2 00:16:02.349 11:26:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@153 -- # NVMF_INITIATOR_BRIDGE=nvmf_init_br 00:16:02.349 11:26:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@154 -- # NVMF_INITIATOR_BRIDGE2=nvmf_init_br2 00:16:02.349 11:26:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@155 -- # NVMF_TARGET_NAMESPACE=nvmf_tgt_ns_spdk 00:16:02.349 11:26:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@156 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:16:02.349 11:26:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@157 -- # NVMF_TARGET_INTERFACE=nvmf_tgt_if 00:16:02.349 11:26:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@158 -- # NVMF_TARGET_INTERFACE2=nvmf_tgt_if2 00:16:02.349 11:26:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@159 -- # NVMF_TARGET_BRIDGE=nvmf_tgt_br 00:16:02.349 11:26:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@160 -- # NVMF_TARGET_BRIDGE2=nvmf_tgt_br2 00:16:02.349 11:26:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@162 -- # ip link set nvmf_init_br nomaster 00:16:02.349 Cannot find device "nvmf_init_br" 00:16:02.349 11:26:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@162 -- # true 00:16:02.349 11:26:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@163 -- # ip link set nvmf_init_br2 nomaster 00:16:02.349 Cannot find device "nvmf_init_br2" 00:16:02.349 11:26:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@163 -- # true 00:16:02.349 11:26:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@164 -- # ip link set nvmf_tgt_br nomaster 00:16:02.349 Cannot find device "nvmf_tgt_br" 00:16:02.349 11:26:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@164 -- # true 00:16:02.349 11:26:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@165 -- # ip link set nvmf_tgt_br2 nomaster 00:16:02.349 Cannot find device "nvmf_tgt_br2" 00:16:02.349 11:26:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@165 -- # true 00:16:02.349 11:26:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@166 -- # ip link set nvmf_init_br down 00:16:02.349 Cannot find device "nvmf_init_br" 00:16:02.349 11:26:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@166 -- # true 00:16:02.349 11:26:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@167 -- # ip link set nvmf_init_br2 down 00:16:02.349 Cannot find device "nvmf_init_br2" 00:16:02.349 11:26:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@167 -- # true 00:16:02.349 11:26:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@168 -- # ip link set nvmf_tgt_br down 00:16:02.349 Cannot find device "nvmf_tgt_br" 00:16:02.349 11:26:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@168 -- # true 00:16:02.349 11:26:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@169 -- # ip link set nvmf_tgt_br2 down 00:16:02.605 Cannot find device "nvmf_tgt_br2" 00:16:02.606 11:26:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@169 -- # true 00:16:02.606 11:26:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@170 -- # ip link delete nvmf_br type bridge 00:16:02.606 Cannot find device "nvmf_br" 00:16:02.606 11:26:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@170 -- # true 00:16:02.606 11:26:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@171 -- # ip link delete nvmf_init_if 00:16:02.606 Cannot find device "nvmf_init_if" 00:16:02.606 11:26:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@171 -- # true 00:16:02.606 11:26:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@172 -- # ip link delete nvmf_init_if2 00:16:02.606 Cannot find device "nvmf_init_if2" 00:16:02.606 11:26:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@172 -- # true 00:16:02.606 11:26:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@173 -- # ip netns exec nvmf_tgt_ns_spdk ip link delete nvmf_tgt_if 00:16:02.606 Cannot open network namespace "nvmf_tgt_ns_spdk": No such file or directory 00:16:02.606 11:26:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@173 -- # true 00:16:02.606 11:26:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@174 -- # ip netns exec nvmf_tgt_ns_spdk ip link delete nvmf_tgt_if2 00:16:02.606 Cannot open network namespace "nvmf_tgt_ns_spdk": No such file or directory 00:16:02.606 11:26:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@174 -- # true 00:16:02.606 11:26:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@177 -- # ip netns add nvmf_tgt_ns_spdk 00:16:02.606 11:26:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@180 -- # ip link add nvmf_init_if type veth peer name nvmf_init_br 00:16:02.606 11:26:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@181 -- # ip link add nvmf_init_if2 type veth peer name nvmf_init_br2 00:16:02.606 11:26:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@182 -- # ip link add nvmf_tgt_if type veth peer name nvmf_tgt_br 00:16:02.606 11:26:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@183 -- # ip link add nvmf_tgt_if2 type veth peer name nvmf_tgt_br2 00:16:02.606 11:26:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@186 -- # ip link set nvmf_tgt_if netns nvmf_tgt_ns_spdk 00:16:02.606 11:26:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@187 -- # ip link set nvmf_tgt_if2 netns nvmf_tgt_ns_spdk 00:16:02.606 11:26:58 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@190 -- # ip addr add 10.0.0.1/24 dev nvmf_init_if 00:16:02.606 11:26:58 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@191 -- # ip addr add 10.0.0.2/24 dev nvmf_init_if2 00:16:02.606 11:26:58 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@192 -- # ip netns exec nvmf_tgt_ns_spdk ip addr add 10.0.0.3/24 dev nvmf_tgt_if 00:16:02.606 11:26:58 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@193 -- # ip netns exec nvmf_tgt_ns_spdk ip addr add 10.0.0.4/24 dev nvmf_tgt_if2 00:16:02.606 11:26:58 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@196 -- # ip link set nvmf_init_if up 00:16:02.606 11:26:58 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@197 -- # ip link set nvmf_init_if2 up 00:16:02.606 11:26:58 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@198 -- # ip link set nvmf_init_br up 00:16:02.606 11:26:58 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@199 -- # ip link set nvmf_init_br2 up 00:16:02.606 11:26:58 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@200 -- # ip link set nvmf_tgt_br up 00:16:02.606 11:26:58 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@201 -- # ip link set nvmf_tgt_br2 up 00:16:02.606 11:26:58 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@202 -- # ip netns exec nvmf_tgt_ns_spdk ip link set nvmf_tgt_if up 00:16:02.606 11:26:58 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@203 -- # ip netns exec nvmf_tgt_ns_spdk ip link set nvmf_tgt_if2 up 00:16:02.606 11:26:58 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@204 -- # ip netns exec nvmf_tgt_ns_spdk ip link set lo up 00:16:02.606 11:26:58 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@207 -- # ip link add nvmf_br type bridge 00:16:02.606 11:26:58 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@208 -- # ip link set nvmf_br up 00:16:02.606 11:26:58 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@211 -- # ip link set nvmf_init_br master nvmf_br 00:16:02.606 11:26:58 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@212 -- # ip link set nvmf_init_br2 master nvmf_br 00:16:02.606 11:26:58 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@213 -- # ip link set nvmf_tgt_br master nvmf_br 00:16:02.606 11:26:58 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@214 -- # ip link set nvmf_tgt_br2 master nvmf_br 00:16:02.863 11:26:58 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@217 -- # ipts -I INPUT 1 -i nvmf_init_if -p tcp --dport 4420 -j ACCEPT 00:16:02.863 11:26:58 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@788 -- # iptables -I INPUT 1 -i nvmf_init_if -p tcp --dport 4420 -j ACCEPT -m comment --comment 'SPDK_NVMF:-I INPUT 1 -i nvmf_init_if -p tcp --dport 4420 -j ACCEPT' 00:16:02.863 11:26:58 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@218 -- # ipts -I INPUT 1 -i nvmf_init_if2 -p tcp --dport 4420 -j ACCEPT 00:16:02.863 11:26:58 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@788 -- # iptables -I INPUT 1 -i nvmf_init_if2 -p tcp --dport 4420 -j ACCEPT -m comment --comment 'SPDK_NVMF:-I INPUT 1 -i nvmf_init_if2 -p tcp --dport 4420 -j ACCEPT' 00:16:02.863 11:26:58 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@219 -- # ipts -A FORWARD -i nvmf_br -o nvmf_br -j ACCEPT 00:16:02.863 11:26:58 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@788 -- # iptables -A FORWARD -i nvmf_br -o nvmf_br -j ACCEPT -m comment --comment 'SPDK_NVMF:-A FORWARD -i nvmf_br -o nvmf_br -j ACCEPT' 00:16:02.863 11:26:58 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@222 -- # ping -c 1 10.0.0.3 00:16:02.863 PING 10.0.0.3 (10.0.0.3) 56(84) bytes of data. 00:16:02.863 64 bytes from 10.0.0.3: icmp_seq=1 ttl=64 time=0.071 ms 00:16:02.863 00:16:02.863 --- 10.0.0.3 ping statistics --- 00:16:02.863 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:16:02.863 rtt min/avg/max/mdev = 0.071/0.071/0.071/0.000 ms 00:16:02.863 11:26:58 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@223 -- # ping -c 1 10.0.0.4 00:16:02.863 PING 10.0.0.4 (10.0.0.4) 56(84) bytes of data. 00:16:02.863 64 bytes from 10.0.0.4: icmp_seq=1 ttl=64 time=0.043 ms 00:16:02.863 00:16:02.863 --- 10.0.0.4 ping statistics --- 00:16:02.863 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:16:02.863 rtt min/avg/max/mdev = 0.043/0.043/0.043/0.000 ms 00:16:02.863 11:26:58 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@224 -- # ip netns exec nvmf_tgt_ns_spdk ping -c 1 10.0.0.1 00:16:02.863 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:16:02.863 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.023 ms 00:16:02.863 00:16:02.863 --- 10.0.0.1 ping statistics --- 00:16:02.863 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:16:02.863 rtt min/avg/max/mdev = 0.023/0.023/0.023/0.000 ms 00:16:02.863 11:26:58 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@225 -- # ip netns exec nvmf_tgt_ns_spdk ping -c 1 10.0.0.2 00:16:02.863 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:16:02.863 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.068 ms 00:16:02.863 00:16:02.863 --- 10.0.0.2 ping statistics --- 00:16:02.863 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:16:02.863 rtt min/avg/max/mdev = 0.068/0.068/0.068/0.000 ms 00:16:02.863 11:26:58 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@227 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:16:02.863 11:26:58 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@459 -- # return 0 00:16:02.863 11:26:58 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@476 -- # '[' '' == iso ']' 00:16:02.863 11:26:58 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@480 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:16:02.863 11:26:58 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@481 -- # [[ tcp == \r\d\m\a ]] 00:16:02.863 11:26:58 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@490 -- # [[ tcp == \t\c\p ]] 00:16:02.863 11:26:58 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@491 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:16:02.863 11:26:58 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@494 -- # '[' tcp == tcp ']' 00:16:02.863 11:26:58 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@500 -- # modprobe nvme-tcp 00:16:02.863 11:26:58 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@87 -- # nvmfappstart -L nvmf_auth 00:16:02.863 11:26:58 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@505 -- # timing_enter start_nvmf_tgt 00:16:02.863 11:26:58 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@724 -- # xtrace_disable 00:16:02.863 11:26:58 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:16:02.863 11:26:58 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@507 -- # nvmfpid=77018 00:16:02.863 11:26:58 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@506 -- # ip netns exec nvmf_tgt_ns_spdk /home/vagrant/spdk_repo/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -L nvmf_auth 00:16:02.863 11:26:58 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@508 -- # waitforlisten 77018 00:16:02.863 11:26:58 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@831 -- # '[' -z 77018 ']' 00:16:02.863 11:26:58 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@835 -- # local rpc_addr=/var/tmp/spdk.sock 00:16:02.863 11:26:58 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@836 -- # local max_retries=100 00:16:02.863 11:26:58 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@838 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:16:02.863 11:26:58 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@840 -- # xtrace_disable 00:16:02.863 11:26:58 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:16:04.235 11:26:59 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@860 -- # (( i == 0 )) 00:16:04.235 11:26:59 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@864 -- # return 0 00:16:04.235 11:26:59 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@509 -- # timing_exit start_nvmf_tgt 00:16:04.235 11:26:59 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@730 -- # xtrace_disable 00:16:04.235 11:26:59 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:16:04.235 11:26:59 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@510 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:16:04.235 11:26:59 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@89 -- # hostpid=77062 00:16:04.235 11:26:59 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@88 -- # /home/vagrant/spdk_repo/spdk/build/bin/spdk_tgt -m 2 -r /var/tmp/host.sock -L nvme_auth 00:16:04.235 11:26:59 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@91 -- # trap 'dumplogs; cleanup' SIGINT SIGTERM EXIT 00:16:04.235 11:26:59 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@94 -- # gen_dhchap_key null 48 00:16:04.235 11:26:59 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@749 -- # local digest len file key 00:16:04.235 11:26:59 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@750 -- # digests=(['null']='0' ['sha256']='1' ['sha384']='2' ['sha512']='3') 00:16:04.235 11:26:59 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@750 -- # local -A digests 00:16:04.235 11:26:59 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@752 -- # digest=null 00:16:04.235 11:26:59 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@752 -- # len=48 00:16:04.235 11:26:59 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@753 -- # xxd -p -c0 -l 24 /dev/urandom 00:16:04.235 11:26:59 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@753 -- # key=a470669c1d707d2fda4efb63a73a38700b7b50ffa6d0ee76 00:16:04.235 11:26:59 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@754 -- # mktemp -t spdk.key-null.XXX 00:16:04.235 11:26:59 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@754 -- # file=/tmp/spdk.key-null.kDS 00:16:04.235 11:26:59 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@755 -- # format_dhchap_key a470669c1d707d2fda4efb63a73a38700b7b50ffa6d0ee76 0 00:16:04.235 11:26:59 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@745 -- # format_key DHHC-1 a470669c1d707d2fda4efb63a73a38700b7b50ffa6d0ee76 0 00:16:04.235 11:26:59 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@728 -- # local prefix key digest 00:16:04.235 11:26:59 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@730 -- # prefix=DHHC-1 00:16:04.235 11:26:59 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@730 -- # key=a470669c1d707d2fda4efb63a73a38700b7b50ffa6d0ee76 00:16:04.235 11:26:59 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@730 -- # digest=0 00:16:04.235 11:26:59 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@731 -- # python - 00:16:04.235 11:26:59 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@756 -- # chmod 0600 /tmp/spdk.key-null.kDS 00:16:04.235 11:26:59 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@758 -- # echo /tmp/spdk.key-null.kDS 00:16:04.235 11:26:59 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@94 -- # keys[0]=/tmp/spdk.key-null.kDS 00:16:04.235 11:26:59 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@94 -- # gen_dhchap_key sha512 64 00:16:04.235 11:26:59 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@749 -- # local digest len file key 00:16:04.235 11:26:59 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@750 -- # digests=(['null']='0' ['sha256']='1' ['sha384']='2' ['sha512']='3') 00:16:04.235 11:26:59 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@750 -- # local -A digests 00:16:04.235 11:26:59 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@752 -- # digest=sha512 00:16:04.235 11:26:59 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@752 -- # len=64 00:16:04.235 11:26:59 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@753 -- # xxd -p -c0 -l 32 /dev/urandom 00:16:04.235 11:26:59 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@753 -- # key=bf544227a0e9d974aba221159834d8d44117bac1770d844e95918e879c514c6c 00:16:04.235 11:26:59 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@754 -- # mktemp -t spdk.key-sha512.XXX 00:16:04.235 11:26:59 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@754 -- # file=/tmp/spdk.key-sha512.vjU 00:16:04.235 11:26:59 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@755 -- # format_dhchap_key bf544227a0e9d974aba221159834d8d44117bac1770d844e95918e879c514c6c 3 00:16:04.235 11:26:59 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@745 -- # format_key DHHC-1 bf544227a0e9d974aba221159834d8d44117bac1770d844e95918e879c514c6c 3 00:16:04.235 11:26:59 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@728 -- # local prefix key digest 00:16:04.235 11:26:59 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@730 -- # prefix=DHHC-1 00:16:04.235 11:26:59 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@730 -- # key=bf544227a0e9d974aba221159834d8d44117bac1770d844e95918e879c514c6c 00:16:04.235 11:26:59 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@730 -- # digest=3 00:16:04.235 11:26:59 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@731 -- # python - 00:16:04.235 11:26:59 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@756 -- # chmod 0600 /tmp/spdk.key-sha512.vjU 00:16:04.235 11:26:59 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@758 -- # echo /tmp/spdk.key-sha512.vjU 00:16:04.235 11:26:59 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@94 -- # ckeys[0]=/tmp/spdk.key-sha512.vjU 00:16:04.235 11:26:59 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@95 -- # gen_dhchap_key sha256 32 00:16:04.235 11:26:59 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@749 -- # local digest len file key 00:16:04.235 11:26:59 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@750 -- # digests=(['null']='0' ['sha256']='1' ['sha384']='2' ['sha512']='3') 00:16:04.235 11:26:59 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@750 -- # local -A digests 00:16:04.235 11:26:59 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@752 -- # digest=sha256 00:16:04.235 11:26:59 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@752 -- # len=32 00:16:04.235 11:26:59 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@753 -- # xxd -p -c0 -l 16 /dev/urandom 00:16:04.235 11:26:59 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@753 -- # key=a56e4b01d33b21f7d050bb9b0bdb40e4 00:16:04.235 11:26:59 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@754 -- # mktemp -t spdk.key-sha256.XXX 00:16:04.235 11:26:59 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@754 -- # file=/tmp/spdk.key-sha256.9hE 00:16:04.235 11:26:59 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@755 -- # format_dhchap_key a56e4b01d33b21f7d050bb9b0bdb40e4 1 00:16:04.235 11:26:59 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@745 -- # format_key DHHC-1 a56e4b01d33b21f7d050bb9b0bdb40e4 1 00:16:04.235 11:26:59 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@728 -- # local prefix key digest 00:16:04.235 11:26:59 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@730 -- # prefix=DHHC-1 00:16:04.235 11:26:59 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@730 -- # key=a56e4b01d33b21f7d050bb9b0bdb40e4 00:16:04.236 11:26:59 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@730 -- # digest=1 00:16:04.236 11:26:59 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@731 -- # python - 00:16:04.236 11:26:59 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@756 -- # chmod 0600 /tmp/spdk.key-sha256.9hE 00:16:04.236 11:26:59 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@758 -- # echo /tmp/spdk.key-sha256.9hE 00:16:04.236 11:26:59 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@95 -- # keys[1]=/tmp/spdk.key-sha256.9hE 00:16:04.236 11:26:59 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@95 -- # gen_dhchap_key sha384 48 00:16:04.236 11:26:59 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@749 -- # local digest len file key 00:16:04.236 11:26:59 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@750 -- # digests=(['null']='0' ['sha256']='1' ['sha384']='2' ['sha512']='3') 00:16:04.236 11:26:59 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@750 -- # local -A digests 00:16:04.236 11:26:59 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@752 -- # digest=sha384 00:16:04.236 11:26:59 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@752 -- # len=48 00:16:04.236 11:26:59 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@753 -- # xxd -p -c0 -l 24 /dev/urandom 00:16:04.236 11:26:59 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@753 -- # key=f6c9abdbab777918d04ff504114293bed86fa2c772d36661 00:16:04.236 11:26:59 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@754 -- # mktemp -t spdk.key-sha384.XXX 00:16:04.236 11:26:59 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@754 -- # file=/tmp/spdk.key-sha384.KLI 00:16:04.236 11:26:59 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@755 -- # format_dhchap_key f6c9abdbab777918d04ff504114293bed86fa2c772d36661 2 00:16:04.236 11:26:59 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@745 -- # format_key DHHC-1 f6c9abdbab777918d04ff504114293bed86fa2c772d36661 2 00:16:04.236 11:26:59 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@728 -- # local prefix key digest 00:16:04.236 11:26:59 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@730 -- # prefix=DHHC-1 00:16:04.236 11:26:59 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@730 -- # key=f6c9abdbab777918d04ff504114293bed86fa2c772d36661 00:16:04.236 11:26:59 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@730 -- # digest=2 00:16:04.236 11:26:59 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@731 -- # python - 00:16:04.236 11:26:59 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@756 -- # chmod 0600 /tmp/spdk.key-sha384.KLI 00:16:04.236 11:26:59 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@758 -- # echo /tmp/spdk.key-sha384.KLI 00:16:04.236 11:26:59 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@95 -- # ckeys[1]=/tmp/spdk.key-sha384.KLI 00:16:04.236 11:26:59 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@96 -- # gen_dhchap_key sha384 48 00:16:04.236 11:26:59 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@749 -- # local digest len file key 00:16:04.236 11:26:59 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@750 -- # digests=(['null']='0' ['sha256']='1' ['sha384']='2' ['sha512']='3') 00:16:04.236 11:26:59 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@750 -- # local -A digests 00:16:04.236 11:26:59 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@752 -- # digest=sha384 00:16:04.236 11:26:59 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@752 -- # len=48 00:16:04.236 11:26:59 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@753 -- # xxd -p -c0 -l 24 /dev/urandom 00:16:04.236 11:26:59 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@753 -- # key=b6b057a85e045d30f5ec4c3fc754659cdfd76e6ac6d17fef 00:16:04.236 11:26:59 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@754 -- # mktemp -t spdk.key-sha384.XXX 00:16:04.236 11:26:59 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@754 -- # file=/tmp/spdk.key-sha384.0e0 00:16:04.236 11:26:59 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@755 -- # format_dhchap_key b6b057a85e045d30f5ec4c3fc754659cdfd76e6ac6d17fef 2 00:16:04.236 11:26:59 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@745 -- # format_key DHHC-1 b6b057a85e045d30f5ec4c3fc754659cdfd76e6ac6d17fef 2 00:16:04.236 11:26:59 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@728 -- # local prefix key digest 00:16:04.236 11:26:59 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@730 -- # prefix=DHHC-1 00:16:04.236 11:26:59 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@730 -- # key=b6b057a85e045d30f5ec4c3fc754659cdfd76e6ac6d17fef 00:16:04.236 11:26:59 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@730 -- # digest=2 00:16:04.236 11:26:59 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@731 -- # python - 00:16:04.236 11:26:59 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@756 -- # chmod 0600 /tmp/spdk.key-sha384.0e0 00:16:04.236 11:26:59 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@758 -- # echo /tmp/spdk.key-sha384.0e0 00:16:04.236 11:26:59 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@96 -- # keys[2]=/tmp/spdk.key-sha384.0e0 00:16:04.236 11:26:59 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@96 -- # gen_dhchap_key sha256 32 00:16:04.236 11:26:59 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@749 -- # local digest len file key 00:16:04.236 11:26:59 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@750 -- # digests=(['null']='0' ['sha256']='1' ['sha384']='2' ['sha512']='3') 00:16:04.236 11:26:59 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@750 -- # local -A digests 00:16:04.236 11:26:59 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@752 -- # digest=sha256 00:16:04.236 11:26:59 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@752 -- # len=32 00:16:04.236 11:26:59 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@753 -- # xxd -p -c0 -l 16 /dev/urandom 00:16:04.236 11:26:59 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@753 -- # key=bd7d085abb27b7c5ec37843be38e577f 00:16:04.236 11:26:59 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@754 -- # mktemp -t spdk.key-sha256.XXX 00:16:04.236 11:26:59 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@754 -- # file=/tmp/spdk.key-sha256.BpF 00:16:04.236 11:26:59 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@755 -- # format_dhchap_key bd7d085abb27b7c5ec37843be38e577f 1 00:16:04.236 11:26:59 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@745 -- # format_key DHHC-1 bd7d085abb27b7c5ec37843be38e577f 1 00:16:04.236 11:26:59 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@728 -- # local prefix key digest 00:16:04.236 11:26:59 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@730 -- # prefix=DHHC-1 00:16:04.236 11:26:59 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@730 -- # key=bd7d085abb27b7c5ec37843be38e577f 00:16:04.236 11:26:59 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@730 -- # digest=1 00:16:04.236 11:26:59 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@731 -- # python - 00:16:04.495 11:26:59 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@756 -- # chmod 0600 /tmp/spdk.key-sha256.BpF 00:16:04.495 11:26:59 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@758 -- # echo /tmp/spdk.key-sha256.BpF 00:16:04.495 11:26:59 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@96 -- # ckeys[2]=/tmp/spdk.key-sha256.BpF 00:16:04.495 11:26:59 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@97 -- # gen_dhchap_key sha512 64 00:16:04.495 11:26:59 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@749 -- # local digest len file key 00:16:04.495 11:26:59 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@750 -- # digests=(['null']='0' ['sha256']='1' ['sha384']='2' ['sha512']='3') 00:16:04.495 11:26:59 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@750 -- # local -A digests 00:16:04.495 11:26:59 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@752 -- # digest=sha512 00:16:04.495 11:26:59 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@752 -- # len=64 00:16:04.495 11:26:59 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@753 -- # xxd -p -c0 -l 32 /dev/urandom 00:16:04.495 11:26:59 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@753 -- # key=b53c4e6467d0447dfa7ea853b9dcb69ebec576b92b3c0721eed2c19235a93d80 00:16:04.495 11:26:59 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@754 -- # mktemp -t spdk.key-sha512.XXX 00:16:04.495 11:26:59 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@754 -- # file=/tmp/spdk.key-sha512.eJX 00:16:04.495 11:26:59 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@755 -- # format_dhchap_key b53c4e6467d0447dfa7ea853b9dcb69ebec576b92b3c0721eed2c19235a93d80 3 00:16:04.495 11:26:59 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@745 -- # format_key DHHC-1 b53c4e6467d0447dfa7ea853b9dcb69ebec576b92b3c0721eed2c19235a93d80 3 00:16:04.495 11:26:59 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@728 -- # local prefix key digest 00:16:04.495 11:26:59 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@730 -- # prefix=DHHC-1 00:16:04.495 11:26:59 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@730 -- # key=b53c4e6467d0447dfa7ea853b9dcb69ebec576b92b3c0721eed2c19235a93d80 00:16:04.495 11:26:59 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@730 -- # digest=3 00:16:04.495 11:26:59 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@731 -- # python - 00:16:04.495 11:26:59 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@756 -- # chmod 0600 /tmp/spdk.key-sha512.eJX 00:16:04.495 11:26:59 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@758 -- # echo /tmp/spdk.key-sha512.eJX 00:16:04.495 11:26:59 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@97 -- # keys[3]=/tmp/spdk.key-sha512.eJX 00:16:04.495 11:26:59 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@97 -- # ckeys[3]= 00:16:04.495 11:26:59 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@99 -- # waitforlisten 77018 00:16:04.495 11:26:59 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@831 -- # '[' -z 77018 ']' 00:16:04.495 11:26:59 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@835 -- # local rpc_addr=/var/tmp/spdk.sock 00:16:04.495 11:26:59 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@836 -- # local max_retries=100 00:16:04.495 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:16:04.495 11:26:59 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@838 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:16:04.495 11:26:59 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@840 -- # xtrace_disable 00:16:04.495 11:26:59 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:16:04.753 11:27:00 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@860 -- # (( i == 0 )) 00:16:04.753 11:27:00 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@864 -- # return 0 00:16:04.753 11:27:00 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@100 -- # waitforlisten 77062 /var/tmp/host.sock 00:16:04.753 11:27:00 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@831 -- # '[' -z 77062 ']' 00:16:04.753 11:27:00 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@835 -- # local rpc_addr=/var/tmp/host.sock 00:16:04.753 11:27:00 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@836 -- # local max_retries=100 00:16:04.753 Waiting for process to start up and listen on UNIX domain socket /var/tmp/host.sock... 00:16:04.753 11:27:00 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@838 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/host.sock...' 00:16:04.753 11:27:00 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@840 -- # xtrace_disable 00:16:04.753 11:27:00 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:16:05.010 11:27:00 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@860 -- # (( i == 0 )) 00:16:05.010 11:27:00 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@864 -- # return 0 00:16:05.010 11:27:00 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@101 -- # rpc_cmd 00:16:05.010 11:27:00 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:05.010 11:27:00 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:16:05.010 11:27:00 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:05.010 11:27:00 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@108 -- # for i in "${!keys[@]}" 00:16:05.010 11:27:00 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@109 -- # rpc_cmd keyring_file_add_key key0 /tmp/spdk.key-null.kDS 00:16:05.010 11:27:00 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:05.010 11:27:00 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:16:05.010 11:27:00 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:05.010 11:27:00 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@110 -- # hostrpc keyring_file_add_key key0 /tmp/spdk.key-null.kDS 00:16:05.010 11:27:00 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock keyring_file_add_key key0 /tmp/spdk.key-null.kDS 00:16:05.269 11:27:00 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@111 -- # [[ -n /tmp/spdk.key-sha512.vjU ]] 00:16:05.269 11:27:00 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@112 -- # rpc_cmd keyring_file_add_key ckey0 /tmp/spdk.key-sha512.vjU 00:16:05.269 11:27:00 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:05.269 11:27:00 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:16:05.269 11:27:00 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:05.269 11:27:00 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@113 -- # hostrpc keyring_file_add_key ckey0 /tmp/spdk.key-sha512.vjU 00:16:05.269 11:27:00 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock keyring_file_add_key ckey0 /tmp/spdk.key-sha512.vjU 00:16:05.835 11:27:01 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@108 -- # for i in "${!keys[@]}" 00:16:05.835 11:27:01 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@109 -- # rpc_cmd keyring_file_add_key key1 /tmp/spdk.key-sha256.9hE 00:16:05.835 11:27:01 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:05.835 11:27:01 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:16:05.835 11:27:01 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:05.835 11:27:01 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@110 -- # hostrpc keyring_file_add_key key1 /tmp/spdk.key-sha256.9hE 00:16:05.835 11:27:01 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock keyring_file_add_key key1 /tmp/spdk.key-sha256.9hE 00:16:06.092 11:27:01 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@111 -- # [[ -n /tmp/spdk.key-sha384.KLI ]] 00:16:06.093 11:27:01 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@112 -- # rpc_cmd keyring_file_add_key ckey1 /tmp/spdk.key-sha384.KLI 00:16:06.093 11:27:01 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:06.093 11:27:01 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:16:06.093 11:27:01 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:06.093 11:27:01 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@113 -- # hostrpc keyring_file_add_key ckey1 /tmp/spdk.key-sha384.KLI 00:16:06.093 11:27:01 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock keyring_file_add_key ckey1 /tmp/spdk.key-sha384.KLI 00:16:06.351 11:27:01 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@108 -- # for i in "${!keys[@]}" 00:16:06.351 11:27:01 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@109 -- # rpc_cmd keyring_file_add_key key2 /tmp/spdk.key-sha384.0e0 00:16:06.351 11:27:01 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:06.351 11:27:01 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:16:06.351 11:27:01 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:06.351 11:27:01 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@110 -- # hostrpc keyring_file_add_key key2 /tmp/spdk.key-sha384.0e0 00:16:06.351 11:27:01 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock keyring_file_add_key key2 /tmp/spdk.key-sha384.0e0 00:16:06.609 11:27:01 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@111 -- # [[ -n /tmp/spdk.key-sha256.BpF ]] 00:16:06.609 11:27:01 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@112 -- # rpc_cmd keyring_file_add_key ckey2 /tmp/spdk.key-sha256.BpF 00:16:06.609 11:27:01 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:06.609 11:27:01 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:16:06.609 11:27:01 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:06.609 11:27:01 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@113 -- # hostrpc keyring_file_add_key ckey2 /tmp/spdk.key-sha256.BpF 00:16:06.609 11:27:01 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock keyring_file_add_key ckey2 /tmp/spdk.key-sha256.BpF 00:16:06.867 11:27:02 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@108 -- # for i in "${!keys[@]}" 00:16:06.867 11:27:02 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@109 -- # rpc_cmd keyring_file_add_key key3 /tmp/spdk.key-sha512.eJX 00:16:06.867 11:27:02 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:06.867 11:27:02 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:16:06.867 11:27:02 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:06.867 11:27:02 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@110 -- # hostrpc keyring_file_add_key key3 /tmp/spdk.key-sha512.eJX 00:16:06.867 11:27:02 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock keyring_file_add_key key3 /tmp/spdk.key-sha512.eJX 00:16:07.124 11:27:02 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@111 -- # [[ -n '' ]] 00:16:07.124 11:27:02 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@118 -- # for digest in "${digests[@]}" 00:16:07.124 11:27:02 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@119 -- # for dhgroup in "${dhgroups[@]}" 00:16:07.124 11:27:02 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@120 -- # for keyid in "${!keys[@]}" 00:16:07.124 11:27:02 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@121 -- # hostrpc bdev_nvme_set_options --dhchap-digests sha256 --dhchap-dhgroups null 00:16:07.124 11:27:02 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_set_options --dhchap-digests sha256 --dhchap-dhgroups null 00:16:07.382 11:27:02 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@123 -- # connect_authenticate sha256 null 0 00:16:07.382 11:27:02 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@65 -- # local digest dhgroup key ckey qpairs 00:16:07.382 11:27:02 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # digest=sha256 00:16:07.382 11:27:02 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # dhgroup=null 00:16:07.382 11:27:02 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # key=key0 00:16:07.382 11:27:02 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@68 -- # ckey=(${ckeys[$3]:+--dhchap-ctrlr-key "ckey$3"}) 00:16:07.382 11:27:02 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@70 -- # rpc_cmd nvmf_subsystem_add_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:c758a4ed-f09f-4c82-9afb-3d096f035464 --dhchap-key key0 --dhchap-ctrlr-key ckey0 00:16:07.382 11:27:02 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:07.382 11:27:02 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:16:07.382 11:27:02 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:07.382 11:27:02 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@71 -- # bdev_connect -b nvme0 --dhchap-key key0 --dhchap-ctrlr-key ckey0 00:16:07.383 11:27:02 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@60 -- # hostrpc bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.3 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:c758a4ed-f09f-4c82-9afb-3d096f035464 -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key0 --dhchap-ctrlr-key ckey0 00:16:07.383 11:27:02 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.3 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:c758a4ed-f09f-4c82-9afb-3d096f035464 -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key0 --dhchap-ctrlr-key ckey0 00:16:07.641 00:16:07.641 11:27:03 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # hostrpc bdev_nvme_get_controllers 00:16:07.641 11:27:03 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # jq -r '.[].name' 00:16:07.641 11:27:03 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_get_controllers 00:16:07.899 11:27:03 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:16:07.899 11:27:03 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@74 -- # rpc_cmd nvmf_subsystem_get_qpairs nqn.2024-03.io.spdk:cnode0 00:16:07.899 11:27:03 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:07.899 11:27:03 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:16:08.157 11:27:03 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:08.157 11:27:03 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@74 -- # qpairs='[ 00:16:08.157 { 00:16:08.157 "auth": { 00:16:08.157 "dhgroup": "null", 00:16:08.157 "digest": "sha256", 00:16:08.157 "state": "completed" 00:16:08.157 }, 00:16:08.157 "cntlid": 1, 00:16:08.157 "hostnqn": "nqn.2014-08.org.nvmexpress:uuid:c758a4ed-f09f-4c82-9afb-3d096f035464", 00:16:08.157 "listen_address": { 00:16:08.157 "adrfam": "IPv4", 00:16:08.157 "traddr": "10.0.0.3", 00:16:08.157 "trsvcid": "4420", 00:16:08.157 "trtype": "TCP" 00:16:08.157 }, 00:16:08.157 "peer_address": { 00:16:08.157 "adrfam": "IPv4", 00:16:08.157 "traddr": "10.0.0.1", 00:16:08.157 "trsvcid": "44256", 00:16:08.157 "trtype": "TCP" 00:16:08.157 }, 00:16:08.157 "qid": 0, 00:16:08.157 "state": "enabled", 00:16:08.157 "thread": "nvmf_tgt_poll_group_000" 00:16:08.157 } 00:16:08.157 ]' 00:16:08.157 11:27:03 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@75 -- # jq -r '.[0].auth.digest' 00:16:08.157 11:27:03 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@75 -- # [[ sha256 == \s\h\a\2\5\6 ]] 00:16:08.157 11:27:03 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@76 -- # jq -r '.[0].auth.dhgroup' 00:16:08.157 11:27:03 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@76 -- # [[ null == \n\u\l\l ]] 00:16:08.157 11:27:03 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@77 -- # jq -r '.[0].auth.state' 00:16:08.157 11:27:03 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@77 -- # [[ completed == \c\o\m\p\l\e\t\e\d ]] 00:16:08.157 11:27:03 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@78 -- # hostrpc bdev_nvme_detach_controller nvme0 00:16:08.157 11:27:03 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_detach_controller nvme0 00:16:08.417 11:27:03 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@80 -- # nvme_connect --dhchap-secret DHHC-1:00:YTQ3MDY2OWMxZDcwN2QyZmRhNGVmYjYzYTczYTM4NzAwYjdiNTBmZmE2ZDBlZTc28YG94Q==: --dhchap-ctrl-secret DHHC-1:03:YmY1NDQyMjdhMGU5ZDk3NGFiYTIyMTE1OTgzNGQ4ZDQ0MTE3YmFjMTc3MGQ4NDRlOTU5MThlODc5YzUxNGM2Y9nOg8I=: 00:16:08.417 11:27:03 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@36 -- # nvme connect -t tcp -a 10.0.0.3 -n nqn.2024-03.io.spdk:cnode0 -i 1 -q nqn.2014-08.org.nvmexpress:uuid:c758a4ed-f09f-4c82-9afb-3d096f035464 --hostid c758a4ed-f09f-4c82-9afb-3d096f035464 -l 0 --dhchap-secret DHHC-1:00:YTQ3MDY2OWMxZDcwN2QyZmRhNGVmYjYzYTczYTM4NzAwYjdiNTBmZmE2ZDBlZTc28YG94Q==: --dhchap-ctrl-secret DHHC-1:03:YmY1NDQyMjdhMGU5ZDk3NGFiYTIyMTE1OTgzNGQ4ZDQ0MTE3YmFjMTc3MGQ4NDRlOTU5MThlODc5YzUxNGM2Y9nOg8I=: 00:16:13.720 11:27:08 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@82 -- # nvme disconnect -n nqn.2024-03.io.spdk:cnode0 00:16:13.720 NQN:nqn.2024-03.io.spdk:cnode0 disconnected 1 controller(s) 00:16:13.720 11:27:08 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@83 -- # rpc_cmd nvmf_subsystem_remove_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:c758a4ed-f09f-4c82-9afb-3d096f035464 00:16:13.720 11:27:08 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:13.720 11:27:08 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:16:13.720 11:27:08 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:13.720 11:27:08 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@120 -- # for keyid in "${!keys[@]}" 00:16:13.720 11:27:08 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@121 -- # hostrpc bdev_nvme_set_options --dhchap-digests sha256 --dhchap-dhgroups null 00:16:13.720 11:27:08 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_set_options --dhchap-digests sha256 --dhchap-dhgroups null 00:16:13.720 11:27:08 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@123 -- # connect_authenticate sha256 null 1 00:16:13.720 11:27:08 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@65 -- # local digest dhgroup key ckey qpairs 00:16:13.720 11:27:08 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # digest=sha256 00:16:13.720 11:27:08 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # dhgroup=null 00:16:13.720 11:27:08 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # key=key1 00:16:13.720 11:27:08 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@68 -- # ckey=(${ckeys[$3]:+--dhchap-ctrlr-key "ckey$3"}) 00:16:13.720 11:27:08 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@70 -- # rpc_cmd nvmf_subsystem_add_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:c758a4ed-f09f-4c82-9afb-3d096f035464 --dhchap-key key1 --dhchap-ctrlr-key ckey1 00:16:13.720 11:27:08 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:13.720 11:27:08 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:16:13.720 11:27:08 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:13.720 11:27:08 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@71 -- # bdev_connect -b nvme0 --dhchap-key key1 --dhchap-ctrlr-key ckey1 00:16:13.720 11:27:08 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@60 -- # hostrpc bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.3 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:c758a4ed-f09f-4c82-9afb-3d096f035464 -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key1 --dhchap-ctrlr-key ckey1 00:16:13.720 11:27:08 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.3 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:c758a4ed-f09f-4c82-9afb-3d096f035464 -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key1 --dhchap-ctrlr-key ckey1 00:16:13.720 00:16:13.720 11:27:09 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # hostrpc bdev_nvme_get_controllers 00:16:13.720 11:27:09 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # jq -r '.[].name' 00:16:13.720 11:27:09 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_get_controllers 00:16:13.978 11:27:09 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:16:13.978 11:27:09 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@74 -- # rpc_cmd nvmf_subsystem_get_qpairs nqn.2024-03.io.spdk:cnode0 00:16:13.978 11:27:09 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:13.978 11:27:09 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:16:13.978 11:27:09 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:13.978 11:27:09 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@74 -- # qpairs='[ 00:16:13.978 { 00:16:13.978 "auth": { 00:16:13.978 "dhgroup": "null", 00:16:13.978 "digest": "sha256", 00:16:13.978 "state": "completed" 00:16:13.978 }, 00:16:13.978 "cntlid": 3, 00:16:13.978 "hostnqn": "nqn.2014-08.org.nvmexpress:uuid:c758a4ed-f09f-4c82-9afb-3d096f035464", 00:16:13.978 "listen_address": { 00:16:13.978 "adrfam": "IPv4", 00:16:13.978 "traddr": "10.0.0.3", 00:16:13.978 "trsvcid": "4420", 00:16:13.978 "trtype": "TCP" 00:16:13.978 }, 00:16:13.978 "peer_address": { 00:16:13.978 "adrfam": "IPv4", 00:16:13.978 "traddr": "10.0.0.1", 00:16:13.978 "trsvcid": "44272", 00:16:13.978 "trtype": "TCP" 00:16:13.978 }, 00:16:13.978 "qid": 0, 00:16:13.978 "state": "enabled", 00:16:13.978 "thread": "nvmf_tgt_poll_group_000" 00:16:13.978 } 00:16:13.978 ]' 00:16:13.978 11:27:09 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@75 -- # jq -r '.[0].auth.digest' 00:16:13.978 11:27:09 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@75 -- # [[ sha256 == \s\h\a\2\5\6 ]] 00:16:13.978 11:27:09 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@76 -- # jq -r '.[0].auth.dhgroup' 00:16:13.978 11:27:09 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@76 -- # [[ null == \n\u\l\l ]] 00:16:13.978 11:27:09 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@77 -- # jq -r '.[0].auth.state' 00:16:14.236 11:27:09 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@77 -- # [[ completed == \c\o\m\p\l\e\t\e\d ]] 00:16:14.236 11:27:09 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@78 -- # hostrpc bdev_nvme_detach_controller nvme0 00:16:14.236 11:27:09 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_detach_controller nvme0 00:16:14.494 11:27:09 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@80 -- # nvme_connect --dhchap-secret DHHC-1:01:YTU2ZTRiMDFkMzNiMjFmN2QwNTBiYjliMGJkYjQwZTTsDgGm: --dhchap-ctrl-secret DHHC-1:02:ZjZjOWFiZGJhYjc3NzkxOGQwNGZmNTA0MTE0MjkzYmVkODZmYTJjNzcyZDM2NjYxWbIiww==: 00:16:14.494 11:27:09 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@36 -- # nvme connect -t tcp -a 10.0.0.3 -n nqn.2024-03.io.spdk:cnode0 -i 1 -q nqn.2014-08.org.nvmexpress:uuid:c758a4ed-f09f-4c82-9afb-3d096f035464 --hostid c758a4ed-f09f-4c82-9afb-3d096f035464 -l 0 --dhchap-secret DHHC-1:01:YTU2ZTRiMDFkMzNiMjFmN2QwNTBiYjliMGJkYjQwZTTsDgGm: --dhchap-ctrl-secret DHHC-1:02:ZjZjOWFiZGJhYjc3NzkxOGQwNGZmNTA0MTE0MjkzYmVkODZmYTJjNzcyZDM2NjYxWbIiww==: 00:16:15.060 11:27:10 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@82 -- # nvme disconnect -n nqn.2024-03.io.spdk:cnode0 00:16:15.060 NQN:nqn.2024-03.io.spdk:cnode0 disconnected 1 controller(s) 00:16:15.060 11:27:10 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@83 -- # rpc_cmd nvmf_subsystem_remove_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:c758a4ed-f09f-4c82-9afb-3d096f035464 00:16:15.060 11:27:10 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:15.060 11:27:10 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:16:15.060 11:27:10 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:15.060 11:27:10 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@120 -- # for keyid in "${!keys[@]}" 00:16:15.060 11:27:10 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@121 -- # hostrpc bdev_nvme_set_options --dhchap-digests sha256 --dhchap-dhgroups null 00:16:15.060 11:27:10 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_set_options --dhchap-digests sha256 --dhchap-dhgroups null 00:16:15.626 11:27:10 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@123 -- # connect_authenticate sha256 null 2 00:16:15.626 11:27:10 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@65 -- # local digest dhgroup key ckey qpairs 00:16:15.626 11:27:10 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # digest=sha256 00:16:15.626 11:27:10 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # dhgroup=null 00:16:15.626 11:27:10 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # key=key2 00:16:15.626 11:27:10 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@68 -- # ckey=(${ckeys[$3]:+--dhchap-ctrlr-key "ckey$3"}) 00:16:15.626 11:27:10 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@70 -- # rpc_cmd nvmf_subsystem_add_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:c758a4ed-f09f-4c82-9afb-3d096f035464 --dhchap-key key2 --dhchap-ctrlr-key ckey2 00:16:15.626 11:27:10 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:15.626 11:27:10 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:16:15.626 11:27:10 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:15.626 11:27:10 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@71 -- # bdev_connect -b nvme0 --dhchap-key key2 --dhchap-ctrlr-key ckey2 00:16:15.626 11:27:10 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@60 -- # hostrpc bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.3 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:c758a4ed-f09f-4c82-9afb-3d096f035464 -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key2 --dhchap-ctrlr-key ckey2 00:16:15.626 11:27:10 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.3 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:c758a4ed-f09f-4c82-9afb-3d096f035464 -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key2 --dhchap-ctrlr-key ckey2 00:16:15.885 00:16:15.885 11:27:11 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # hostrpc bdev_nvme_get_controllers 00:16:15.885 11:27:11 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_get_controllers 00:16:15.885 11:27:11 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # jq -r '.[].name' 00:16:16.143 11:27:11 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:16:16.143 11:27:11 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@74 -- # rpc_cmd nvmf_subsystem_get_qpairs nqn.2024-03.io.spdk:cnode0 00:16:16.143 11:27:11 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:16.143 11:27:11 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:16:16.143 11:27:11 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:16.143 11:27:11 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@74 -- # qpairs='[ 00:16:16.143 { 00:16:16.143 "auth": { 00:16:16.143 "dhgroup": "null", 00:16:16.143 "digest": "sha256", 00:16:16.143 "state": "completed" 00:16:16.143 }, 00:16:16.143 "cntlid": 5, 00:16:16.143 "hostnqn": "nqn.2014-08.org.nvmexpress:uuid:c758a4ed-f09f-4c82-9afb-3d096f035464", 00:16:16.143 "listen_address": { 00:16:16.143 "adrfam": "IPv4", 00:16:16.143 "traddr": "10.0.0.3", 00:16:16.143 "trsvcid": "4420", 00:16:16.143 "trtype": "TCP" 00:16:16.143 }, 00:16:16.143 "peer_address": { 00:16:16.143 "adrfam": "IPv4", 00:16:16.143 "traddr": "10.0.0.1", 00:16:16.143 "trsvcid": "44310", 00:16:16.143 "trtype": "TCP" 00:16:16.143 }, 00:16:16.143 "qid": 0, 00:16:16.143 "state": "enabled", 00:16:16.143 "thread": "nvmf_tgt_poll_group_000" 00:16:16.143 } 00:16:16.143 ]' 00:16:16.143 11:27:11 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@75 -- # jq -r '.[0].auth.digest' 00:16:16.143 11:27:11 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@75 -- # [[ sha256 == \s\h\a\2\5\6 ]] 00:16:16.143 11:27:11 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@76 -- # jq -r '.[0].auth.dhgroup' 00:16:16.143 11:27:11 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@76 -- # [[ null == \n\u\l\l ]] 00:16:16.143 11:27:11 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@77 -- # jq -r '.[0].auth.state' 00:16:16.401 11:27:11 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@77 -- # [[ completed == \c\o\m\p\l\e\t\e\d ]] 00:16:16.401 11:27:11 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@78 -- # hostrpc bdev_nvme_detach_controller nvme0 00:16:16.401 11:27:11 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_detach_controller nvme0 00:16:16.659 11:27:11 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@80 -- # nvme_connect --dhchap-secret DHHC-1:02:YjZiMDU3YTg1ZTA0NWQzMGY1ZWM0YzNmYzc1NDY1OWNkZmQ3NmU2YWM2ZDE3ZmVmgTRtHQ==: --dhchap-ctrl-secret DHHC-1:01:YmQ3ZDA4NWFiYjI3YjdjNWVjMzc4NDNiZTM4ZTU3N2a6gUZi: 00:16:16.659 11:27:11 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@36 -- # nvme connect -t tcp -a 10.0.0.3 -n nqn.2024-03.io.spdk:cnode0 -i 1 -q nqn.2014-08.org.nvmexpress:uuid:c758a4ed-f09f-4c82-9afb-3d096f035464 --hostid c758a4ed-f09f-4c82-9afb-3d096f035464 -l 0 --dhchap-secret DHHC-1:02:YjZiMDU3YTg1ZTA0NWQzMGY1ZWM0YzNmYzc1NDY1OWNkZmQ3NmU2YWM2ZDE3ZmVmgTRtHQ==: --dhchap-ctrl-secret DHHC-1:01:YmQ3ZDA4NWFiYjI3YjdjNWVjMzc4NDNiZTM4ZTU3N2a6gUZi: 00:16:17.225 11:27:12 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@82 -- # nvme disconnect -n nqn.2024-03.io.spdk:cnode0 00:16:17.225 NQN:nqn.2024-03.io.spdk:cnode0 disconnected 1 controller(s) 00:16:17.225 11:27:12 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@83 -- # rpc_cmd nvmf_subsystem_remove_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:c758a4ed-f09f-4c82-9afb-3d096f035464 00:16:17.225 11:27:12 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:17.225 11:27:12 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:16:17.225 11:27:12 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:17.225 11:27:12 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@120 -- # for keyid in "${!keys[@]}" 00:16:17.225 11:27:12 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@121 -- # hostrpc bdev_nvme_set_options --dhchap-digests sha256 --dhchap-dhgroups null 00:16:17.225 11:27:12 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_set_options --dhchap-digests sha256 --dhchap-dhgroups null 00:16:17.484 11:27:12 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@123 -- # connect_authenticate sha256 null 3 00:16:17.484 11:27:12 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@65 -- # local digest dhgroup key ckey qpairs 00:16:17.484 11:27:12 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # digest=sha256 00:16:17.484 11:27:12 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # dhgroup=null 00:16:17.484 11:27:12 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # key=key3 00:16:17.484 11:27:12 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@68 -- # ckey=(${ckeys[$3]:+--dhchap-ctrlr-key "ckey$3"}) 00:16:17.484 11:27:12 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@70 -- # rpc_cmd nvmf_subsystem_add_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:c758a4ed-f09f-4c82-9afb-3d096f035464 --dhchap-key key3 00:16:17.484 11:27:12 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:17.484 11:27:12 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:16:17.484 11:27:12 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:17.484 11:27:12 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@71 -- # bdev_connect -b nvme0 --dhchap-key key3 00:16:17.484 11:27:12 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@60 -- # hostrpc bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.3 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:c758a4ed-f09f-4c82-9afb-3d096f035464 -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key3 00:16:17.484 11:27:12 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.3 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:c758a4ed-f09f-4c82-9afb-3d096f035464 -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key3 00:16:18.049 00:16:18.049 11:27:13 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # hostrpc bdev_nvme_get_controllers 00:16:18.049 11:27:13 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_get_controllers 00:16:18.049 11:27:13 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # jq -r '.[].name' 00:16:18.308 11:27:13 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:16:18.308 11:27:13 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@74 -- # rpc_cmd nvmf_subsystem_get_qpairs nqn.2024-03.io.spdk:cnode0 00:16:18.308 11:27:13 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:18.308 11:27:13 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:16:18.308 11:27:13 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:18.308 11:27:13 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@74 -- # qpairs='[ 00:16:18.308 { 00:16:18.308 "auth": { 00:16:18.308 "dhgroup": "null", 00:16:18.308 "digest": "sha256", 00:16:18.308 "state": "completed" 00:16:18.308 }, 00:16:18.308 "cntlid": 7, 00:16:18.308 "hostnqn": "nqn.2014-08.org.nvmexpress:uuid:c758a4ed-f09f-4c82-9afb-3d096f035464", 00:16:18.308 "listen_address": { 00:16:18.308 "adrfam": "IPv4", 00:16:18.308 "traddr": "10.0.0.3", 00:16:18.308 "trsvcid": "4420", 00:16:18.308 "trtype": "TCP" 00:16:18.308 }, 00:16:18.308 "peer_address": { 00:16:18.308 "adrfam": "IPv4", 00:16:18.308 "traddr": "10.0.0.1", 00:16:18.308 "trsvcid": "42634", 00:16:18.308 "trtype": "TCP" 00:16:18.308 }, 00:16:18.308 "qid": 0, 00:16:18.308 "state": "enabled", 00:16:18.308 "thread": "nvmf_tgt_poll_group_000" 00:16:18.308 } 00:16:18.308 ]' 00:16:18.308 11:27:13 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@75 -- # jq -r '.[0].auth.digest' 00:16:18.308 11:27:13 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@75 -- # [[ sha256 == \s\h\a\2\5\6 ]] 00:16:18.308 11:27:13 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@76 -- # jq -r '.[0].auth.dhgroup' 00:16:18.308 11:27:13 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@76 -- # [[ null == \n\u\l\l ]] 00:16:18.308 11:27:13 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@77 -- # jq -r '.[0].auth.state' 00:16:18.308 11:27:13 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@77 -- # [[ completed == \c\o\m\p\l\e\t\e\d ]] 00:16:18.308 11:27:13 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@78 -- # hostrpc bdev_nvme_detach_controller nvme0 00:16:18.308 11:27:13 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_detach_controller nvme0 00:16:18.874 11:27:14 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@80 -- # nvme_connect --dhchap-secret DHHC-1:03:YjUzYzRlNjQ2N2QwNDQ3ZGZhN2VhODUzYjlkY2I2OWViZWM1NzZiOTJiM2MwNzIxZWVkMmMxOTIzNWE5M2Q4MDbs9Og=: 00:16:18.874 11:27:14 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@36 -- # nvme connect -t tcp -a 10.0.0.3 -n nqn.2024-03.io.spdk:cnode0 -i 1 -q nqn.2014-08.org.nvmexpress:uuid:c758a4ed-f09f-4c82-9afb-3d096f035464 --hostid c758a4ed-f09f-4c82-9afb-3d096f035464 -l 0 --dhchap-secret DHHC-1:03:YjUzYzRlNjQ2N2QwNDQ3ZGZhN2VhODUzYjlkY2I2OWViZWM1NzZiOTJiM2MwNzIxZWVkMmMxOTIzNWE5M2Q4MDbs9Og=: 00:16:19.439 11:27:14 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@82 -- # nvme disconnect -n nqn.2024-03.io.spdk:cnode0 00:16:19.439 NQN:nqn.2024-03.io.spdk:cnode0 disconnected 1 controller(s) 00:16:19.439 11:27:14 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@83 -- # rpc_cmd nvmf_subsystem_remove_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:c758a4ed-f09f-4c82-9afb-3d096f035464 00:16:19.439 11:27:14 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:19.439 11:27:14 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:16:19.439 11:27:14 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:19.439 11:27:14 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@119 -- # for dhgroup in "${dhgroups[@]}" 00:16:19.439 11:27:14 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@120 -- # for keyid in "${!keys[@]}" 00:16:19.439 11:27:14 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@121 -- # hostrpc bdev_nvme_set_options --dhchap-digests sha256 --dhchap-dhgroups ffdhe2048 00:16:19.439 11:27:14 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_set_options --dhchap-digests sha256 --dhchap-dhgroups ffdhe2048 00:16:19.697 11:27:15 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@123 -- # connect_authenticate sha256 ffdhe2048 0 00:16:19.697 11:27:15 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@65 -- # local digest dhgroup key ckey qpairs 00:16:19.697 11:27:15 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # digest=sha256 00:16:19.697 11:27:15 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # dhgroup=ffdhe2048 00:16:19.697 11:27:15 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # key=key0 00:16:19.697 11:27:15 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@68 -- # ckey=(${ckeys[$3]:+--dhchap-ctrlr-key "ckey$3"}) 00:16:19.697 11:27:15 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@70 -- # rpc_cmd nvmf_subsystem_add_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:c758a4ed-f09f-4c82-9afb-3d096f035464 --dhchap-key key0 --dhchap-ctrlr-key ckey0 00:16:19.697 11:27:15 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:19.697 11:27:15 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:16:19.697 11:27:15 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:19.697 11:27:15 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@71 -- # bdev_connect -b nvme0 --dhchap-key key0 --dhchap-ctrlr-key ckey0 00:16:19.697 11:27:15 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@60 -- # hostrpc bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.3 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:c758a4ed-f09f-4c82-9afb-3d096f035464 -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key0 --dhchap-ctrlr-key ckey0 00:16:19.697 11:27:15 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.3 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:c758a4ed-f09f-4c82-9afb-3d096f035464 -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key0 --dhchap-ctrlr-key ckey0 00:16:19.955 00:16:19.955 11:27:15 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # hostrpc bdev_nvme_get_controllers 00:16:19.955 11:27:15 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_get_controllers 00:16:19.955 11:27:15 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # jq -r '.[].name' 00:16:20.521 11:27:15 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:16:20.521 11:27:15 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@74 -- # rpc_cmd nvmf_subsystem_get_qpairs nqn.2024-03.io.spdk:cnode0 00:16:20.521 11:27:15 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:20.521 11:27:15 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:16:20.521 11:27:15 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:20.521 11:27:15 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@74 -- # qpairs='[ 00:16:20.521 { 00:16:20.521 "auth": { 00:16:20.521 "dhgroup": "ffdhe2048", 00:16:20.521 "digest": "sha256", 00:16:20.521 "state": "completed" 00:16:20.521 }, 00:16:20.521 "cntlid": 9, 00:16:20.521 "hostnqn": "nqn.2014-08.org.nvmexpress:uuid:c758a4ed-f09f-4c82-9afb-3d096f035464", 00:16:20.521 "listen_address": { 00:16:20.521 "adrfam": "IPv4", 00:16:20.521 "traddr": "10.0.0.3", 00:16:20.521 "trsvcid": "4420", 00:16:20.521 "trtype": "TCP" 00:16:20.521 }, 00:16:20.521 "peer_address": { 00:16:20.521 "adrfam": "IPv4", 00:16:20.521 "traddr": "10.0.0.1", 00:16:20.521 "trsvcid": "42656", 00:16:20.521 "trtype": "TCP" 00:16:20.521 }, 00:16:20.521 "qid": 0, 00:16:20.521 "state": "enabled", 00:16:20.521 "thread": "nvmf_tgt_poll_group_000" 00:16:20.521 } 00:16:20.521 ]' 00:16:20.521 11:27:15 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@75 -- # jq -r '.[0].auth.digest' 00:16:20.521 11:27:15 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@75 -- # [[ sha256 == \s\h\a\2\5\6 ]] 00:16:20.521 11:27:15 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@76 -- # jq -r '.[0].auth.dhgroup' 00:16:20.521 11:27:15 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@76 -- # [[ ffdhe2048 == \f\f\d\h\e\2\0\4\8 ]] 00:16:20.521 11:27:15 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@77 -- # jq -r '.[0].auth.state' 00:16:20.521 11:27:15 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@77 -- # [[ completed == \c\o\m\p\l\e\t\e\d ]] 00:16:20.521 11:27:15 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@78 -- # hostrpc bdev_nvme_detach_controller nvme0 00:16:20.521 11:27:15 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_detach_controller nvme0 00:16:20.780 11:27:16 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@80 -- # nvme_connect --dhchap-secret DHHC-1:00:YTQ3MDY2OWMxZDcwN2QyZmRhNGVmYjYzYTczYTM4NzAwYjdiNTBmZmE2ZDBlZTc28YG94Q==: --dhchap-ctrl-secret DHHC-1:03:YmY1NDQyMjdhMGU5ZDk3NGFiYTIyMTE1OTgzNGQ4ZDQ0MTE3YmFjMTc3MGQ4NDRlOTU5MThlODc5YzUxNGM2Y9nOg8I=: 00:16:20.780 11:27:16 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@36 -- # nvme connect -t tcp -a 10.0.0.3 -n nqn.2024-03.io.spdk:cnode0 -i 1 -q nqn.2014-08.org.nvmexpress:uuid:c758a4ed-f09f-4c82-9afb-3d096f035464 --hostid c758a4ed-f09f-4c82-9afb-3d096f035464 -l 0 --dhchap-secret DHHC-1:00:YTQ3MDY2OWMxZDcwN2QyZmRhNGVmYjYzYTczYTM4NzAwYjdiNTBmZmE2ZDBlZTc28YG94Q==: --dhchap-ctrl-secret DHHC-1:03:YmY1NDQyMjdhMGU5ZDk3NGFiYTIyMTE1OTgzNGQ4ZDQ0MTE3YmFjMTc3MGQ4NDRlOTU5MThlODc5YzUxNGM2Y9nOg8I=: 00:16:21.713 11:27:17 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@82 -- # nvme disconnect -n nqn.2024-03.io.spdk:cnode0 00:16:21.713 NQN:nqn.2024-03.io.spdk:cnode0 disconnected 1 controller(s) 00:16:21.713 11:27:17 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@83 -- # rpc_cmd nvmf_subsystem_remove_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:c758a4ed-f09f-4c82-9afb-3d096f035464 00:16:21.713 11:27:17 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:21.713 11:27:17 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:16:21.713 11:27:17 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:21.713 11:27:17 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@120 -- # for keyid in "${!keys[@]}" 00:16:21.713 11:27:17 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@121 -- # hostrpc bdev_nvme_set_options --dhchap-digests sha256 --dhchap-dhgroups ffdhe2048 00:16:21.713 11:27:17 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_set_options --dhchap-digests sha256 --dhchap-dhgroups ffdhe2048 00:16:21.971 11:27:17 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@123 -- # connect_authenticate sha256 ffdhe2048 1 00:16:21.971 11:27:17 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@65 -- # local digest dhgroup key ckey qpairs 00:16:21.971 11:27:17 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # digest=sha256 00:16:21.971 11:27:17 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # dhgroup=ffdhe2048 00:16:21.971 11:27:17 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # key=key1 00:16:21.971 11:27:17 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@68 -- # ckey=(${ckeys[$3]:+--dhchap-ctrlr-key "ckey$3"}) 00:16:21.971 11:27:17 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@70 -- # rpc_cmd nvmf_subsystem_add_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:c758a4ed-f09f-4c82-9afb-3d096f035464 --dhchap-key key1 --dhchap-ctrlr-key ckey1 00:16:21.971 11:27:17 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:21.971 11:27:17 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:16:21.971 11:27:17 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:21.971 11:27:17 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@71 -- # bdev_connect -b nvme0 --dhchap-key key1 --dhchap-ctrlr-key ckey1 00:16:21.971 11:27:17 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@60 -- # hostrpc bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.3 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:c758a4ed-f09f-4c82-9afb-3d096f035464 -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key1 --dhchap-ctrlr-key ckey1 00:16:21.971 11:27:17 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.3 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:c758a4ed-f09f-4c82-9afb-3d096f035464 -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key1 --dhchap-ctrlr-key ckey1 00:16:22.229 00:16:22.229 11:27:17 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # hostrpc bdev_nvme_get_controllers 00:16:22.229 11:27:17 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_get_controllers 00:16:22.229 11:27:17 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # jq -r '.[].name' 00:16:22.486 11:27:18 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:16:22.486 11:27:18 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@74 -- # rpc_cmd nvmf_subsystem_get_qpairs nqn.2024-03.io.spdk:cnode0 00:16:22.486 11:27:18 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:22.486 11:27:18 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:16:22.769 11:27:18 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:22.770 11:27:18 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@74 -- # qpairs='[ 00:16:22.770 { 00:16:22.770 "auth": { 00:16:22.770 "dhgroup": "ffdhe2048", 00:16:22.770 "digest": "sha256", 00:16:22.770 "state": "completed" 00:16:22.770 }, 00:16:22.770 "cntlid": 11, 00:16:22.770 "hostnqn": "nqn.2014-08.org.nvmexpress:uuid:c758a4ed-f09f-4c82-9afb-3d096f035464", 00:16:22.770 "listen_address": { 00:16:22.770 "adrfam": "IPv4", 00:16:22.770 "traddr": "10.0.0.3", 00:16:22.770 "trsvcid": "4420", 00:16:22.770 "trtype": "TCP" 00:16:22.770 }, 00:16:22.770 "peer_address": { 00:16:22.770 "adrfam": "IPv4", 00:16:22.770 "traddr": "10.0.0.1", 00:16:22.770 "trsvcid": "42690", 00:16:22.770 "trtype": "TCP" 00:16:22.770 }, 00:16:22.770 "qid": 0, 00:16:22.770 "state": "enabled", 00:16:22.770 "thread": "nvmf_tgt_poll_group_000" 00:16:22.770 } 00:16:22.770 ]' 00:16:22.770 11:27:18 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@75 -- # jq -r '.[0].auth.digest' 00:16:22.770 11:27:18 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@75 -- # [[ sha256 == \s\h\a\2\5\6 ]] 00:16:22.770 11:27:18 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@76 -- # jq -r '.[0].auth.dhgroup' 00:16:22.770 11:27:18 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@76 -- # [[ ffdhe2048 == \f\f\d\h\e\2\0\4\8 ]] 00:16:22.770 11:27:18 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@77 -- # jq -r '.[0].auth.state' 00:16:22.770 11:27:18 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@77 -- # [[ completed == \c\o\m\p\l\e\t\e\d ]] 00:16:22.770 11:27:18 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@78 -- # hostrpc bdev_nvme_detach_controller nvme0 00:16:22.770 11:27:18 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_detach_controller nvme0 00:16:23.341 11:27:18 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@80 -- # nvme_connect --dhchap-secret DHHC-1:01:YTU2ZTRiMDFkMzNiMjFmN2QwNTBiYjliMGJkYjQwZTTsDgGm: --dhchap-ctrl-secret DHHC-1:02:ZjZjOWFiZGJhYjc3NzkxOGQwNGZmNTA0MTE0MjkzYmVkODZmYTJjNzcyZDM2NjYxWbIiww==: 00:16:23.341 11:27:18 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@36 -- # nvme connect -t tcp -a 10.0.0.3 -n nqn.2024-03.io.spdk:cnode0 -i 1 -q nqn.2014-08.org.nvmexpress:uuid:c758a4ed-f09f-4c82-9afb-3d096f035464 --hostid c758a4ed-f09f-4c82-9afb-3d096f035464 -l 0 --dhchap-secret DHHC-1:01:YTU2ZTRiMDFkMzNiMjFmN2QwNTBiYjliMGJkYjQwZTTsDgGm: --dhchap-ctrl-secret DHHC-1:02:ZjZjOWFiZGJhYjc3NzkxOGQwNGZmNTA0MTE0MjkzYmVkODZmYTJjNzcyZDM2NjYxWbIiww==: 00:16:23.906 11:27:19 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@82 -- # nvme disconnect -n nqn.2024-03.io.spdk:cnode0 00:16:23.906 NQN:nqn.2024-03.io.spdk:cnode0 disconnected 1 controller(s) 00:16:23.906 11:27:19 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@83 -- # rpc_cmd nvmf_subsystem_remove_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:c758a4ed-f09f-4c82-9afb-3d096f035464 00:16:23.906 11:27:19 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:23.906 11:27:19 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:16:23.906 11:27:19 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:23.906 11:27:19 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@120 -- # for keyid in "${!keys[@]}" 00:16:23.906 11:27:19 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@121 -- # hostrpc bdev_nvme_set_options --dhchap-digests sha256 --dhchap-dhgroups ffdhe2048 00:16:23.906 11:27:19 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_set_options --dhchap-digests sha256 --dhchap-dhgroups ffdhe2048 00:16:24.164 11:27:19 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@123 -- # connect_authenticate sha256 ffdhe2048 2 00:16:24.164 11:27:19 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@65 -- # local digest dhgroup key ckey qpairs 00:16:24.164 11:27:19 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # digest=sha256 00:16:24.164 11:27:19 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # dhgroup=ffdhe2048 00:16:24.164 11:27:19 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # key=key2 00:16:24.164 11:27:19 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@68 -- # ckey=(${ckeys[$3]:+--dhchap-ctrlr-key "ckey$3"}) 00:16:24.164 11:27:19 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@70 -- # rpc_cmd nvmf_subsystem_add_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:c758a4ed-f09f-4c82-9afb-3d096f035464 --dhchap-key key2 --dhchap-ctrlr-key ckey2 00:16:24.164 11:27:19 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:24.164 11:27:19 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:16:24.164 11:27:19 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:24.164 11:27:19 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@71 -- # bdev_connect -b nvme0 --dhchap-key key2 --dhchap-ctrlr-key ckey2 00:16:24.164 11:27:19 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@60 -- # hostrpc bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.3 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:c758a4ed-f09f-4c82-9afb-3d096f035464 -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key2 --dhchap-ctrlr-key ckey2 00:16:24.164 11:27:19 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.3 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:c758a4ed-f09f-4c82-9afb-3d096f035464 -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key2 --dhchap-ctrlr-key ckey2 00:16:24.421 00:16:24.679 11:27:19 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # hostrpc bdev_nvme_get_controllers 00:16:24.679 11:27:19 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_get_controllers 00:16:24.679 11:27:19 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # jq -r '.[].name' 00:16:24.936 11:27:20 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:16:24.936 11:27:20 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@74 -- # rpc_cmd nvmf_subsystem_get_qpairs nqn.2024-03.io.spdk:cnode0 00:16:24.936 11:27:20 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:24.936 11:27:20 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:16:24.936 11:27:20 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:24.936 11:27:20 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@74 -- # qpairs='[ 00:16:24.936 { 00:16:24.936 "auth": { 00:16:24.936 "dhgroup": "ffdhe2048", 00:16:24.936 "digest": "sha256", 00:16:24.936 "state": "completed" 00:16:24.936 }, 00:16:24.936 "cntlid": 13, 00:16:24.936 "hostnqn": "nqn.2014-08.org.nvmexpress:uuid:c758a4ed-f09f-4c82-9afb-3d096f035464", 00:16:24.936 "listen_address": { 00:16:24.936 "adrfam": "IPv4", 00:16:24.936 "traddr": "10.0.0.3", 00:16:24.936 "trsvcid": "4420", 00:16:24.936 "trtype": "TCP" 00:16:24.936 }, 00:16:24.936 "peer_address": { 00:16:24.936 "adrfam": "IPv4", 00:16:24.936 "traddr": "10.0.0.1", 00:16:24.936 "trsvcid": "42710", 00:16:24.936 "trtype": "TCP" 00:16:24.936 }, 00:16:24.936 "qid": 0, 00:16:24.936 "state": "enabled", 00:16:24.936 "thread": "nvmf_tgt_poll_group_000" 00:16:24.936 } 00:16:24.936 ]' 00:16:24.936 11:27:20 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@75 -- # jq -r '.[0].auth.digest' 00:16:24.936 11:27:20 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@75 -- # [[ sha256 == \s\h\a\2\5\6 ]] 00:16:24.936 11:27:20 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@76 -- # jq -r '.[0].auth.dhgroup' 00:16:24.936 11:27:20 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@76 -- # [[ ffdhe2048 == \f\f\d\h\e\2\0\4\8 ]] 00:16:24.936 11:27:20 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@77 -- # jq -r '.[0].auth.state' 00:16:25.193 11:27:20 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@77 -- # [[ completed == \c\o\m\p\l\e\t\e\d ]] 00:16:25.193 11:27:20 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@78 -- # hostrpc bdev_nvme_detach_controller nvme0 00:16:25.194 11:27:20 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_detach_controller nvme0 00:16:25.451 11:27:20 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@80 -- # nvme_connect --dhchap-secret DHHC-1:02:YjZiMDU3YTg1ZTA0NWQzMGY1ZWM0YzNmYzc1NDY1OWNkZmQ3NmU2YWM2ZDE3ZmVmgTRtHQ==: --dhchap-ctrl-secret DHHC-1:01:YmQ3ZDA4NWFiYjI3YjdjNWVjMzc4NDNiZTM4ZTU3N2a6gUZi: 00:16:25.451 11:27:20 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@36 -- # nvme connect -t tcp -a 10.0.0.3 -n nqn.2024-03.io.spdk:cnode0 -i 1 -q nqn.2014-08.org.nvmexpress:uuid:c758a4ed-f09f-4c82-9afb-3d096f035464 --hostid c758a4ed-f09f-4c82-9afb-3d096f035464 -l 0 --dhchap-secret DHHC-1:02:YjZiMDU3YTg1ZTA0NWQzMGY1ZWM0YzNmYzc1NDY1OWNkZmQ3NmU2YWM2ZDE3ZmVmgTRtHQ==: --dhchap-ctrl-secret DHHC-1:01:YmQ3ZDA4NWFiYjI3YjdjNWVjMzc4NDNiZTM4ZTU3N2a6gUZi: 00:16:26.016 11:27:21 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@82 -- # nvme disconnect -n nqn.2024-03.io.spdk:cnode0 00:16:26.016 NQN:nqn.2024-03.io.spdk:cnode0 disconnected 1 controller(s) 00:16:26.273 11:27:21 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@83 -- # rpc_cmd nvmf_subsystem_remove_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:c758a4ed-f09f-4c82-9afb-3d096f035464 00:16:26.273 11:27:21 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:26.273 11:27:21 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:16:26.273 11:27:21 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:26.273 11:27:21 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@120 -- # for keyid in "${!keys[@]}" 00:16:26.273 11:27:21 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@121 -- # hostrpc bdev_nvme_set_options --dhchap-digests sha256 --dhchap-dhgroups ffdhe2048 00:16:26.273 11:27:21 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_set_options --dhchap-digests sha256 --dhchap-dhgroups ffdhe2048 00:16:26.531 11:27:21 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@123 -- # connect_authenticate sha256 ffdhe2048 3 00:16:26.531 11:27:21 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@65 -- # local digest dhgroup key ckey qpairs 00:16:26.531 11:27:21 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # digest=sha256 00:16:26.531 11:27:21 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # dhgroup=ffdhe2048 00:16:26.531 11:27:21 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # key=key3 00:16:26.531 11:27:21 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@68 -- # ckey=(${ckeys[$3]:+--dhchap-ctrlr-key "ckey$3"}) 00:16:26.531 11:27:21 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@70 -- # rpc_cmd nvmf_subsystem_add_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:c758a4ed-f09f-4c82-9afb-3d096f035464 --dhchap-key key3 00:16:26.531 11:27:21 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:26.532 11:27:21 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:16:26.532 11:27:21 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:26.532 11:27:21 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@71 -- # bdev_connect -b nvme0 --dhchap-key key3 00:16:26.532 11:27:21 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@60 -- # hostrpc bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.3 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:c758a4ed-f09f-4c82-9afb-3d096f035464 -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key3 00:16:26.532 11:27:21 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.3 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:c758a4ed-f09f-4c82-9afb-3d096f035464 -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key3 00:16:26.789 00:16:26.789 11:27:22 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # hostrpc bdev_nvme_get_controllers 00:16:26.789 11:27:22 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # jq -r '.[].name' 00:16:26.789 11:27:22 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_get_controllers 00:16:27.047 11:27:22 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:16:27.047 11:27:22 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@74 -- # rpc_cmd nvmf_subsystem_get_qpairs nqn.2024-03.io.spdk:cnode0 00:16:27.047 11:27:22 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:27.047 11:27:22 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:16:27.305 11:27:22 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:27.305 11:27:22 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@74 -- # qpairs='[ 00:16:27.305 { 00:16:27.305 "auth": { 00:16:27.305 "dhgroup": "ffdhe2048", 00:16:27.305 "digest": "sha256", 00:16:27.305 "state": "completed" 00:16:27.305 }, 00:16:27.305 "cntlid": 15, 00:16:27.305 "hostnqn": "nqn.2014-08.org.nvmexpress:uuid:c758a4ed-f09f-4c82-9afb-3d096f035464", 00:16:27.305 "listen_address": { 00:16:27.305 "adrfam": "IPv4", 00:16:27.305 "traddr": "10.0.0.3", 00:16:27.305 "trsvcid": "4420", 00:16:27.305 "trtype": "TCP" 00:16:27.305 }, 00:16:27.305 "peer_address": { 00:16:27.305 "adrfam": "IPv4", 00:16:27.305 "traddr": "10.0.0.1", 00:16:27.305 "trsvcid": "60148", 00:16:27.305 "trtype": "TCP" 00:16:27.305 }, 00:16:27.305 "qid": 0, 00:16:27.305 "state": "enabled", 00:16:27.305 "thread": "nvmf_tgt_poll_group_000" 00:16:27.305 } 00:16:27.305 ]' 00:16:27.305 11:27:22 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@75 -- # jq -r '.[0].auth.digest' 00:16:27.305 11:27:22 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@75 -- # [[ sha256 == \s\h\a\2\5\6 ]] 00:16:27.305 11:27:22 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@76 -- # jq -r '.[0].auth.dhgroup' 00:16:27.305 11:27:22 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@76 -- # [[ ffdhe2048 == \f\f\d\h\e\2\0\4\8 ]] 00:16:27.305 11:27:22 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@77 -- # jq -r '.[0].auth.state' 00:16:27.305 11:27:22 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@77 -- # [[ completed == \c\o\m\p\l\e\t\e\d ]] 00:16:27.305 11:27:22 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@78 -- # hostrpc bdev_nvme_detach_controller nvme0 00:16:27.305 11:27:22 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_detach_controller nvme0 00:16:27.563 11:27:22 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@80 -- # nvme_connect --dhchap-secret DHHC-1:03:YjUzYzRlNjQ2N2QwNDQ3ZGZhN2VhODUzYjlkY2I2OWViZWM1NzZiOTJiM2MwNzIxZWVkMmMxOTIzNWE5M2Q4MDbs9Og=: 00:16:27.563 11:27:22 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@36 -- # nvme connect -t tcp -a 10.0.0.3 -n nqn.2024-03.io.spdk:cnode0 -i 1 -q nqn.2014-08.org.nvmexpress:uuid:c758a4ed-f09f-4c82-9afb-3d096f035464 --hostid c758a4ed-f09f-4c82-9afb-3d096f035464 -l 0 --dhchap-secret DHHC-1:03:YjUzYzRlNjQ2N2QwNDQ3ZGZhN2VhODUzYjlkY2I2OWViZWM1NzZiOTJiM2MwNzIxZWVkMmMxOTIzNWE5M2Q4MDbs9Og=: 00:16:28.149 11:27:23 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@82 -- # nvme disconnect -n nqn.2024-03.io.spdk:cnode0 00:16:28.149 NQN:nqn.2024-03.io.spdk:cnode0 disconnected 1 controller(s) 00:16:28.149 11:27:23 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@83 -- # rpc_cmd nvmf_subsystem_remove_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:c758a4ed-f09f-4c82-9afb-3d096f035464 00:16:28.149 11:27:23 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:28.149 11:27:23 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:16:28.149 11:27:23 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:28.149 11:27:23 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@119 -- # for dhgroup in "${dhgroups[@]}" 00:16:28.149 11:27:23 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@120 -- # for keyid in "${!keys[@]}" 00:16:28.149 11:27:23 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@121 -- # hostrpc bdev_nvme_set_options --dhchap-digests sha256 --dhchap-dhgroups ffdhe3072 00:16:28.149 11:27:23 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_set_options --dhchap-digests sha256 --dhchap-dhgroups ffdhe3072 00:16:28.714 11:27:23 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@123 -- # connect_authenticate sha256 ffdhe3072 0 00:16:28.714 11:27:23 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@65 -- # local digest dhgroup key ckey qpairs 00:16:28.714 11:27:23 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # digest=sha256 00:16:28.714 11:27:23 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # dhgroup=ffdhe3072 00:16:28.714 11:27:23 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # key=key0 00:16:28.714 11:27:23 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@68 -- # ckey=(${ckeys[$3]:+--dhchap-ctrlr-key "ckey$3"}) 00:16:28.715 11:27:23 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@70 -- # rpc_cmd nvmf_subsystem_add_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:c758a4ed-f09f-4c82-9afb-3d096f035464 --dhchap-key key0 --dhchap-ctrlr-key ckey0 00:16:28.715 11:27:23 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:28.715 11:27:23 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:16:28.715 11:27:23 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:28.715 11:27:23 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@71 -- # bdev_connect -b nvme0 --dhchap-key key0 --dhchap-ctrlr-key ckey0 00:16:28.715 11:27:23 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@60 -- # hostrpc bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.3 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:c758a4ed-f09f-4c82-9afb-3d096f035464 -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key0 --dhchap-ctrlr-key ckey0 00:16:28.715 11:27:23 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.3 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:c758a4ed-f09f-4c82-9afb-3d096f035464 -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key0 --dhchap-ctrlr-key ckey0 00:16:28.972 00:16:28.972 11:27:24 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # jq -r '.[].name' 00:16:28.972 11:27:24 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # hostrpc bdev_nvme_get_controllers 00:16:28.972 11:27:24 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_get_controllers 00:16:29.229 11:27:24 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:16:29.229 11:27:24 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@74 -- # rpc_cmd nvmf_subsystem_get_qpairs nqn.2024-03.io.spdk:cnode0 00:16:29.229 11:27:24 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:29.229 11:27:24 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:16:29.229 11:27:24 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:29.229 11:27:24 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@74 -- # qpairs='[ 00:16:29.229 { 00:16:29.229 "auth": { 00:16:29.229 "dhgroup": "ffdhe3072", 00:16:29.229 "digest": "sha256", 00:16:29.229 "state": "completed" 00:16:29.229 }, 00:16:29.229 "cntlid": 17, 00:16:29.229 "hostnqn": "nqn.2014-08.org.nvmexpress:uuid:c758a4ed-f09f-4c82-9afb-3d096f035464", 00:16:29.229 "listen_address": { 00:16:29.229 "adrfam": "IPv4", 00:16:29.229 "traddr": "10.0.0.3", 00:16:29.229 "trsvcid": "4420", 00:16:29.229 "trtype": "TCP" 00:16:29.229 }, 00:16:29.229 "peer_address": { 00:16:29.229 "adrfam": "IPv4", 00:16:29.229 "traddr": "10.0.0.1", 00:16:29.229 "trsvcid": "60166", 00:16:29.229 "trtype": "TCP" 00:16:29.229 }, 00:16:29.229 "qid": 0, 00:16:29.229 "state": "enabled", 00:16:29.229 "thread": "nvmf_tgt_poll_group_000" 00:16:29.229 } 00:16:29.229 ]' 00:16:29.229 11:27:24 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@75 -- # jq -r '.[0].auth.digest' 00:16:29.487 11:27:24 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@75 -- # [[ sha256 == \s\h\a\2\5\6 ]] 00:16:29.487 11:27:24 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@76 -- # jq -r '.[0].auth.dhgroup' 00:16:29.487 11:27:24 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@76 -- # [[ ffdhe3072 == \f\f\d\h\e\3\0\7\2 ]] 00:16:29.487 11:27:24 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@77 -- # jq -r '.[0].auth.state' 00:16:29.487 11:27:24 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@77 -- # [[ completed == \c\o\m\p\l\e\t\e\d ]] 00:16:29.487 11:27:24 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@78 -- # hostrpc bdev_nvme_detach_controller nvme0 00:16:29.487 11:27:24 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_detach_controller nvme0 00:16:29.745 11:27:25 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@80 -- # nvme_connect --dhchap-secret DHHC-1:00:YTQ3MDY2OWMxZDcwN2QyZmRhNGVmYjYzYTczYTM4NzAwYjdiNTBmZmE2ZDBlZTc28YG94Q==: --dhchap-ctrl-secret DHHC-1:03:YmY1NDQyMjdhMGU5ZDk3NGFiYTIyMTE1OTgzNGQ4ZDQ0MTE3YmFjMTc3MGQ4NDRlOTU5MThlODc5YzUxNGM2Y9nOg8I=: 00:16:29.745 11:27:25 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@36 -- # nvme connect -t tcp -a 10.0.0.3 -n nqn.2024-03.io.spdk:cnode0 -i 1 -q nqn.2014-08.org.nvmexpress:uuid:c758a4ed-f09f-4c82-9afb-3d096f035464 --hostid c758a4ed-f09f-4c82-9afb-3d096f035464 -l 0 --dhchap-secret DHHC-1:00:YTQ3MDY2OWMxZDcwN2QyZmRhNGVmYjYzYTczYTM4NzAwYjdiNTBmZmE2ZDBlZTc28YG94Q==: --dhchap-ctrl-secret DHHC-1:03:YmY1NDQyMjdhMGU5ZDk3NGFiYTIyMTE1OTgzNGQ4ZDQ0MTE3YmFjMTc3MGQ4NDRlOTU5MThlODc5YzUxNGM2Y9nOg8I=: 00:16:30.679 11:27:25 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@82 -- # nvme disconnect -n nqn.2024-03.io.spdk:cnode0 00:16:30.679 NQN:nqn.2024-03.io.spdk:cnode0 disconnected 1 controller(s) 00:16:30.679 11:27:25 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@83 -- # rpc_cmd nvmf_subsystem_remove_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:c758a4ed-f09f-4c82-9afb-3d096f035464 00:16:30.679 11:27:25 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:30.679 11:27:25 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:16:30.679 11:27:25 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:30.679 11:27:25 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@120 -- # for keyid in "${!keys[@]}" 00:16:30.679 11:27:25 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@121 -- # hostrpc bdev_nvme_set_options --dhchap-digests sha256 --dhchap-dhgroups ffdhe3072 00:16:30.679 11:27:25 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_set_options --dhchap-digests sha256 --dhchap-dhgroups ffdhe3072 00:16:30.937 11:27:26 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@123 -- # connect_authenticate sha256 ffdhe3072 1 00:16:30.937 11:27:26 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@65 -- # local digest dhgroup key ckey qpairs 00:16:30.937 11:27:26 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # digest=sha256 00:16:30.937 11:27:26 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # dhgroup=ffdhe3072 00:16:30.937 11:27:26 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # key=key1 00:16:30.937 11:27:26 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@68 -- # ckey=(${ckeys[$3]:+--dhchap-ctrlr-key "ckey$3"}) 00:16:30.937 11:27:26 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@70 -- # rpc_cmd nvmf_subsystem_add_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:c758a4ed-f09f-4c82-9afb-3d096f035464 --dhchap-key key1 --dhchap-ctrlr-key ckey1 00:16:30.937 11:27:26 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:30.937 11:27:26 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:16:30.937 11:27:26 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:30.937 11:27:26 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@71 -- # bdev_connect -b nvme0 --dhchap-key key1 --dhchap-ctrlr-key ckey1 00:16:30.937 11:27:26 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@60 -- # hostrpc bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.3 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:c758a4ed-f09f-4c82-9afb-3d096f035464 -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key1 --dhchap-ctrlr-key ckey1 00:16:30.937 11:27:26 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.3 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:c758a4ed-f09f-4c82-9afb-3d096f035464 -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key1 --dhchap-ctrlr-key ckey1 00:16:31.195 00:16:31.195 11:27:26 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # hostrpc bdev_nvme_get_controllers 00:16:31.195 11:27:26 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_get_controllers 00:16:31.195 11:27:26 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # jq -r '.[].name' 00:16:31.454 11:27:26 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:16:31.454 11:27:26 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@74 -- # rpc_cmd nvmf_subsystem_get_qpairs nqn.2024-03.io.spdk:cnode0 00:16:31.454 11:27:26 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:31.454 11:27:26 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:16:31.454 11:27:26 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:31.454 11:27:26 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@74 -- # qpairs='[ 00:16:31.454 { 00:16:31.454 "auth": { 00:16:31.454 "dhgroup": "ffdhe3072", 00:16:31.454 "digest": "sha256", 00:16:31.454 "state": "completed" 00:16:31.454 }, 00:16:31.454 "cntlid": 19, 00:16:31.454 "hostnqn": "nqn.2014-08.org.nvmexpress:uuid:c758a4ed-f09f-4c82-9afb-3d096f035464", 00:16:31.454 "listen_address": { 00:16:31.454 "adrfam": "IPv4", 00:16:31.454 "traddr": "10.0.0.3", 00:16:31.454 "trsvcid": "4420", 00:16:31.454 "trtype": "TCP" 00:16:31.454 }, 00:16:31.454 "peer_address": { 00:16:31.454 "adrfam": "IPv4", 00:16:31.454 "traddr": "10.0.0.1", 00:16:31.454 "trsvcid": "60182", 00:16:31.454 "trtype": "TCP" 00:16:31.454 }, 00:16:31.454 "qid": 0, 00:16:31.454 "state": "enabled", 00:16:31.454 "thread": "nvmf_tgt_poll_group_000" 00:16:31.454 } 00:16:31.454 ]' 00:16:31.454 11:27:26 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@75 -- # jq -r '.[0].auth.digest' 00:16:31.454 11:27:26 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@75 -- # [[ sha256 == \s\h\a\2\5\6 ]] 00:16:31.454 11:27:26 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@76 -- # jq -r '.[0].auth.dhgroup' 00:16:31.454 11:27:26 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@76 -- # [[ ffdhe3072 == \f\f\d\h\e\3\0\7\2 ]] 00:16:31.454 11:27:26 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@77 -- # jq -r '.[0].auth.state' 00:16:31.731 11:27:26 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@77 -- # [[ completed == \c\o\m\p\l\e\t\e\d ]] 00:16:31.731 11:27:26 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@78 -- # hostrpc bdev_nvme_detach_controller nvme0 00:16:31.731 11:27:26 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_detach_controller nvme0 00:16:31.989 11:27:27 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@80 -- # nvme_connect --dhchap-secret DHHC-1:01:YTU2ZTRiMDFkMzNiMjFmN2QwNTBiYjliMGJkYjQwZTTsDgGm: --dhchap-ctrl-secret DHHC-1:02:ZjZjOWFiZGJhYjc3NzkxOGQwNGZmNTA0MTE0MjkzYmVkODZmYTJjNzcyZDM2NjYxWbIiww==: 00:16:31.989 11:27:27 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@36 -- # nvme connect -t tcp -a 10.0.0.3 -n nqn.2024-03.io.spdk:cnode0 -i 1 -q nqn.2014-08.org.nvmexpress:uuid:c758a4ed-f09f-4c82-9afb-3d096f035464 --hostid c758a4ed-f09f-4c82-9afb-3d096f035464 -l 0 --dhchap-secret DHHC-1:01:YTU2ZTRiMDFkMzNiMjFmN2QwNTBiYjliMGJkYjQwZTTsDgGm: --dhchap-ctrl-secret DHHC-1:02:ZjZjOWFiZGJhYjc3NzkxOGQwNGZmNTA0MTE0MjkzYmVkODZmYTJjNzcyZDM2NjYxWbIiww==: 00:16:32.553 11:27:27 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@82 -- # nvme disconnect -n nqn.2024-03.io.spdk:cnode0 00:16:32.553 NQN:nqn.2024-03.io.spdk:cnode0 disconnected 1 controller(s) 00:16:32.553 11:27:28 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@83 -- # rpc_cmd nvmf_subsystem_remove_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:c758a4ed-f09f-4c82-9afb-3d096f035464 00:16:32.553 11:27:28 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:32.553 11:27:28 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:16:32.553 11:27:28 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:32.553 11:27:28 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@120 -- # for keyid in "${!keys[@]}" 00:16:32.553 11:27:28 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@121 -- # hostrpc bdev_nvme_set_options --dhchap-digests sha256 --dhchap-dhgroups ffdhe3072 00:16:32.553 11:27:28 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_set_options --dhchap-digests sha256 --dhchap-dhgroups ffdhe3072 00:16:32.810 11:27:28 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@123 -- # connect_authenticate sha256 ffdhe3072 2 00:16:32.811 11:27:28 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@65 -- # local digest dhgroup key ckey qpairs 00:16:32.811 11:27:28 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # digest=sha256 00:16:32.811 11:27:28 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # dhgroup=ffdhe3072 00:16:32.811 11:27:28 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # key=key2 00:16:32.811 11:27:28 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@68 -- # ckey=(${ckeys[$3]:+--dhchap-ctrlr-key "ckey$3"}) 00:16:32.811 11:27:28 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@70 -- # rpc_cmd nvmf_subsystem_add_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:c758a4ed-f09f-4c82-9afb-3d096f035464 --dhchap-key key2 --dhchap-ctrlr-key ckey2 00:16:32.811 11:27:28 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:32.811 11:27:28 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:16:32.811 11:27:28 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:32.811 11:27:28 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@71 -- # bdev_connect -b nvme0 --dhchap-key key2 --dhchap-ctrlr-key ckey2 00:16:32.811 11:27:28 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@60 -- # hostrpc bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.3 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:c758a4ed-f09f-4c82-9afb-3d096f035464 -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key2 --dhchap-ctrlr-key ckey2 00:16:32.811 11:27:28 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.3 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:c758a4ed-f09f-4c82-9afb-3d096f035464 -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key2 --dhchap-ctrlr-key ckey2 00:16:33.384 00:16:33.384 11:27:28 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # hostrpc bdev_nvme_get_controllers 00:16:33.384 11:27:28 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_get_controllers 00:16:33.384 11:27:28 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # jq -r '.[].name' 00:16:33.642 11:27:29 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:16:33.642 11:27:29 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@74 -- # rpc_cmd nvmf_subsystem_get_qpairs nqn.2024-03.io.spdk:cnode0 00:16:33.642 11:27:29 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:33.642 11:27:29 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:16:33.642 11:27:29 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:33.642 11:27:29 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@74 -- # qpairs='[ 00:16:33.642 { 00:16:33.642 "auth": { 00:16:33.642 "dhgroup": "ffdhe3072", 00:16:33.642 "digest": "sha256", 00:16:33.642 "state": "completed" 00:16:33.642 }, 00:16:33.642 "cntlid": 21, 00:16:33.642 "hostnqn": "nqn.2014-08.org.nvmexpress:uuid:c758a4ed-f09f-4c82-9afb-3d096f035464", 00:16:33.642 "listen_address": { 00:16:33.642 "adrfam": "IPv4", 00:16:33.642 "traddr": "10.0.0.3", 00:16:33.642 "trsvcid": "4420", 00:16:33.642 "trtype": "TCP" 00:16:33.642 }, 00:16:33.642 "peer_address": { 00:16:33.642 "adrfam": "IPv4", 00:16:33.642 "traddr": "10.0.0.1", 00:16:33.642 "trsvcid": "60210", 00:16:33.642 "trtype": "TCP" 00:16:33.642 }, 00:16:33.642 "qid": 0, 00:16:33.642 "state": "enabled", 00:16:33.642 "thread": "nvmf_tgt_poll_group_000" 00:16:33.642 } 00:16:33.642 ]' 00:16:33.642 11:27:29 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@75 -- # jq -r '.[0].auth.digest' 00:16:33.642 11:27:29 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@75 -- # [[ sha256 == \s\h\a\2\5\6 ]] 00:16:33.642 11:27:29 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@76 -- # jq -r '.[0].auth.dhgroup' 00:16:33.901 11:27:29 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@76 -- # [[ ffdhe3072 == \f\f\d\h\e\3\0\7\2 ]] 00:16:33.901 11:27:29 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@77 -- # jq -r '.[0].auth.state' 00:16:33.901 11:27:29 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@77 -- # [[ completed == \c\o\m\p\l\e\t\e\d ]] 00:16:33.901 11:27:29 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@78 -- # hostrpc bdev_nvme_detach_controller nvme0 00:16:33.901 11:27:29 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_detach_controller nvme0 00:16:34.159 11:27:29 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@80 -- # nvme_connect --dhchap-secret DHHC-1:02:YjZiMDU3YTg1ZTA0NWQzMGY1ZWM0YzNmYzc1NDY1OWNkZmQ3NmU2YWM2ZDE3ZmVmgTRtHQ==: --dhchap-ctrl-secret DHHC-1:01:YmQ3ZDA4NWFiYjI3YjdjNWVjMzc4NDNiZTM4ZTU3N2a6gUZi: 00:16:34.159 11:27:29 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@36 -- # nvme connect -t tcp -a 10.0.0.3 -n nqn.2024-03.io.spdk:cnode0 -i 1 -q nqn.2014-08.org.nvmexpress:uuid:c758a4ed-f09f-4c82-9afb-3d096f035464 --hostid c758a4ed-f09f-4c82-9afb-3d096f035464 -l 0 --dhchap-secret DHHC-1:02:YjZiMDU3YTg1ZTA0NWQzMGY1ZWM0YzNmYzc1NDY1OWNkZmQ3NmU2YWM2ZDE3ZmVmgTRtHQ==: --dhchap-ctrl-secret DHHC-1:01:YmQ3ZDA4NWFiYjI3YjdjNWVjMzc4NDNiZTM4ZTU3N2a6gUZi: 00:16:35.094 11:27:30 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@82 -- # nvme disconnect -n nqn.2024-03.io.spdk:cnode0 00:16:35.094 NQN:nqn.2024-03.io.spdk:cnode0 disconnected 1 controller(s) 00:16:35.094 11:27:30 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@83 -- # rpc_cmd nvmf_subsystem_remove_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:c758a4ed-f09f-4c82-9afb-3d096f035464 00:16:35.094 11:27:30 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:35.094 11:27:30 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:16:35.094 11:27:30 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:35.094 11:27:30 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@120 -- # for keyid in "${!keys[@]}" 00:16:35.094 11:27:30 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@121 -- # hostrpc bdev_nvme_set_options --dhchap-digests sha256 --dhchap-dhgroups ffdhe3072 00:16:35.094 11:27:30 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_set_options --dhchap-digests sha256 --dhchap-dhgroups ffdhe3072 00:16:35.352 11:27:30 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@123 -- # connect_authenticate sha256 ffdhe3072 3 00:16:35.352 11:27:30 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@65 -- # local digest dhgroup key ckey qpairs 00:16:35.352 11:27:30 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # digest=sha256 00:16:35.352 11:27:30 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # dhgroup=ffdhe3072 00:16:35.352 11:27:30 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # key=key3 00:16:35.352 11:27:30 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@68 -- # ckey=(${ckeys[$3]:+--dhchap-ctrlr-key "ckey$3"}) 00:16:35.352 11:27:30 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@70 -- # rpc_cmd nvmf_subsystem_add_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:c758a4ed-f09f-4c82-9afb-3d096f035464 --dhchap-key key3 00:16:35.352 11:27:30 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:35.352 11:27:30 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:16:35.352 11:27:30 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:35.352 11:27:30 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@71 -- # bdev_connect -b nvme0 --dhchap-key key3 00:16:35.352 11:27:30 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@60 -- # hostrpc bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.3 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:c758a4ed-f09f-4c82-9afb-3d096f035464 -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key3 00:16:35.352 11:27:30 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.3 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:c758a4ed-f09f-4c82-9afb-3d096f035464 -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key3 00:16:35.611 00:16:35.611 11:27:31 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # jq -r '.[].name' 00:16:35.611 11:27:31 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # hostrpc bdev_nvme_get_controllers 00:16:35.611 11:27:31 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_get_controllers 00:16:35.894 11:27:31 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:16:35.894 11:27:31 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@74 -- # rpc_cmd nvmf_subsystem_get_qpairs nqn.2024-03.io.spdk:cnode0 00:16:35.894 11:27:31 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:35.894 11:27:31 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:16:35.894 11:27:31 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:35.894 11:27:31 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@74 -- # qpairs='[ 00:16:35.894 { 00:16:35.894 "auth": { 00:16:35.894 "dhgroup": "ffdhe3072", 00:16:35.894 "digest": "sha256", 00:16:35.894 "state": "completed" 00:16:35.894 }, 00:16:35.894 "cntlid": 23, 00:16:35.894 "hostnqn": "nqn.2014-08.org.nvmexpress:uuid:c758a4ed-f09f-4c82-9afb-3d096f035464", 00:16:35.894 "listen_address": { 00:16:35.894 "adrfam": "IPv4", 00:16:35.894 "traddr": "10.0.0.3", 00:16:35.894 "trsvcid": "4420", 00:16:35.894 "trtype": "TCP" 00:16:35.894 }, 00:16:35.894 "peer_address": { 00:16:35.894 "adrfam": "IPv4", 00:16:35.894 "traddr": "10.0.0.1", 00:16:35.894 "trsvcid": "60228", 00:16:35.894 "trtype": "TCP" 00:16:35.894 }, 00:16:35.894 "qid": 0, 00:16:35.894 "state": "enabled", 00:16:35.894 "thread": "nvmf_tgt_poll_group_000" 00:16:35.894 } 00:16:35.894 ]' 00:16:35.894 11:27:31 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@75 -- # jq -r '.[0].auth.digest' 00:16:36.152 11:27:31 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@75 -- # [[ sha256 == \s\h\a\2\5\6 ]] 00:16:36.152 11:27:31 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@76 -- # jq -r '.[0].auth.dhgroup' 00:16:36.152 11:27:31 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@76 -- # [[ ffdhe3072 == \f\f\d\h\e\3\0\7\2 ]] 00:16:36.152 11:27:31 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@77 -- # jq -r '.[0].auth.state' 00:16:36.152 11:27:31 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@77 -- # [[ completed == \c\o\m\p\l\e\t\e\d ]] 00:16:36.152 11:27:31 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@78 -- # hostrpc bdev_nvme_detach_controller nvme0 00:16:36.152 11:27:31 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_detach_controller nvme0 00:16:36.718 11:27:31 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@80 -- # nvme_connect --dhchap-secret DHHC-1:03:YjUzYzRlNjQ2N2QwNDQ3ZGZhN2VhODUzYjlkY2I2OWViZWM1NzZiOTJiM2MwNzIxZWVkMmMxOTIzNWE5M2Q4MDbs9Og=: 00:16:36.718 11:27:31 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@36 -- # nvme connect -t tcp -a 10.0.0.3 -n nqn.2024-03.io.spdk:cnode0 -i 1 -q nqn.2014-08.org.nvmexpress:uuid:c758a4ed-f09f-4c82-9afb-3d096f035464 --hostid c758a4ed-f09f-4c82-9afb-3d096f035464 -l 0 --dhchap-secret DHHC-1:03:YjUzYzRlNjQ2N2QwNDQ3ZGZhN2VhODUzYjlkY2I2OWViZWM1NzZiOTJiM2MwNzIxZWVkMmMxOTIzNWE5M2Q4MDbs9Og=: 00:16:37.284 11:27:32 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@82 -- # nvme disconnect -n nqn.2024-03.io.spdk:cnode0 00:16:37.284 NQN:nqn.2024-03.io.spdk:cnode0 disconnected 1 controller(s) 00:16:37.284 11:27:32 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@83 -- # rpc_cmd nvmf_subsystem_remove_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:c758a4ed-f09f-4c82-9afb-3d096f035464 00:16:37.284 11:27:32 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:37.284 11:27:32 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:16:37.284 11:27:32 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:37.284 11:27:32 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@119 -- # for dhgroup in "${dhgroups[@]}" 00:16:37.284 11:27:32 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@120 -- # for keyid in "${!keys[@]}" 00:16:37.284 11:27:32 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@121 -- # hostrpc bdev_nvme_set_options --dhchap-digests sha256 --dhchap-dhgroups ffdhe4096 00:16:37.284 11:27:32 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_set_options --dhchap-digests sha256 --dhchap-dhgroups ffdhe4096 00:16:37.542 11:27:32 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@123 -- # connect_authenticate sha256 ffdhe4096 0 00:16:37.542 11:27:32 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@65 -- # local digest dhgroup key ckey qpairs 00:16:37.542 11:27:32 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # digest=sha256 00:16:37.542 11:27:32 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # dhgroup=ffdhe4096 00:16:37.542 11:27:32 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # key=key0 00:16:37.542 11:27:32 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@68 -- # ckey=(${ckeys[$3]:+--dhchap-ctrlr-key "ckey$3"}) 00:16:37.542 11:27:32 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@70 -- # rpc_cmd nvmf_subsystem_add_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:c758a4ed-f09f-4c82-9afb-3d096f035464 --dhchap-key key0 --dhchap-ctrlr-key ckey0 00:16:37.542 11:27:32 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:37.542 11:27:32 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:16:37.542 11:27:32 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:37.542 11:27:32 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@71 -- # bdev_connect -b nvme0 --dhchap-key key0 --dhchap-ctrlr-key ckey0 00:16:37.542 11:27:32 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@60 -- # hostrpc bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.3 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:c758a4ed-f09f-4c82-9afb-3d096f035464 -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key0 --dhchap-ctrlr-key ckey0 00:16:37.542 11:27:32 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.3 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:c758a4ed-f09f-4c82-9afb-3d096f035464 -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key0 --dhchap-ctrlr-key ckey0 00:16:38.108 00:16:38.108 11:27:33 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # hostrpc bdev_nvme_get_controllers 00:16:38.108 11:27:33 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_get_controllers 00:16:38.108 11:27:33 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # jq -r '.[].name' 00:16:38.378 11:27:33 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:16:38.378 11:27:33 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@74 -- # rpc_cmd nvmf_subsystem_get_qpairs nqn.2024-03.io.spdk:cnode0 00:16:38.378 11:27:33 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:38.378 11:27:33 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:16:38.378 11:27:33 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:38.378 11:27:33 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@74 -- # qpairs='[ 00:16:38.378 { 00:16:38.378 "auth": { 00:16:38.378 "dhgroup": "ffdhe4096", 00:16:38.378 "digest": "sha256", 00:16:38.378 "state": "completed" 00:16:38.378 }, 00:16:38.378 "cntlid": 25, 00:16:38.378 "hostnqn": "nqn.2014-08.org.nvmexpress:uuid:c758a4ed-f09f-4c82-9afb-3d096f035464", 00:16:38.378 "listen_address": { 00:16:38.378 "adrfam": "IPv4", 00:16:38.378 "traddr": "10.0.0.3", 00:16:38.378 "trsvcid": "4420", 00:16:38.378 "trtype": "TCP" 00:16:38.378 }, 00:16:38.378 "peer_address": { 00:16:38.378 "adrfam": "IPv4", 00:16:38.378 "traddr": "10.0.0.1", 00:16:38.378 "trsvcid": "36446", 00:16:38.378 "trtype": "TCP" 00:16:38.378 }, 00:16:38.378 "qid": 0, 00:16:38.378 "state": "enabled", 00:16:38.378 "thread": "nvmf_tgt_poll_group_000" 00:16:38.378 } 00:16:38.378 ]' 00:16:38.378 11:27:33 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@75 -- # jq -r '.[0].auth.digest' 00:16:38.378 11:27:33 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@75 -- # [[ sha256 == \s\h\a\2\5\6 ]] 00:16:38.378 11:27:33 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@76 -- # jq -r '.[0].auth.dhgroup' 00:16:38.378 11:27:33 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@76 -- # [[ ffdhe4096 == \f\f\d\h\e\4\0\9\6 ]] 00:16:38.378 11:27:33 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@77 -- # jq -r '.[0].auth.state' 00:16:38.378 11:27:33 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@77 -- # [[ completed == \c\o\m\p\l\e\t\e\d ]] 00:16:38.378 11:27:33 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@78 -- # hostrpc bdev_nvme_detach_controller nvme0 00:16:38.378 11:27:33 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_detach_controller nvme0 00:16:38.649 11:27:34 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@80 -- # nvme_connect --dhchap-secret DHHC-1:00:YTQ3MDY2OWMxZDcwN2QyZmRhNGVmYjYzYTczYTM4NzAwYjdiNTBmZmE2ZDBlZTc28YG94Q==: --dhchap-ctrl-secret DHHC-1:03:YmY1NDQyMjdhMGU5ZDk3NGFiYTIyMTE1OTgzNGQ4ZDQ0MTE3YmFjMTc3MGQ4NDRlOTU5MThlODc5YzUxNGM2Y9nOg8I=: 00:16:38.649 11:27:34 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@36 -- # nvme connect -t tcp -a 10.0.0.3 -n nqn.2024-03.io.spdk:cnode0 -i 1 -q nqn.2014-08.org.nvmexpress:uuid:c758a4ed-f09f-4c82-9afb-3d096f035464 --hostid c758a4ed-f09f-4c82-9afb-3d096f035464 -l 0 --dhchap-secret DHHC-1:00:YTQ3MDY2OWMxZDcwN2QyZmRhNGVmYjYzYTczYTM4NzAwYjdiNTBmZmE2ZDBlZTc28YG94Q==: --dhchap-ctrl-secret DHHC-1:03:YmY1NDQyMjdhMGU5ZDk3NGFiYTIyMTE1OTgzNGQ4ZDQ0MTE3YmFjMTc3MGQ4NDRlOTU5MThlODc5YzUxNGM2Y9nOg8I=: 00:16:39.583 11:27:34 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@82 -- # nvme disconnect -n nqn.2024-03.io.spdk:cnode0 00:16:39.583 NQN:nqn.2024-03.io.spdk:cnode0 disconnected 1 controller(s) 00:16:39.583 11:27:34 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@83 -- # rpc_cmd nvmf_subsystem_remove_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:c758a4ed-f09f-4c82-9afb-3d096f035464 00:16:39.583 11:27:34 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:39.583 11:27:34 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:16:39.583 11:27:34 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:39.583 11:27:34 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@120 -- # for keyid in "${!keys[@]}" 00:16:39.583 11:27:34 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@121 -- # hostrpc bdev_nvme_set_options --dhchap-digests sha256 --dhchap-dhgroups ffdhe4096 00:16:39.583 11:27:34 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_set_options --dhchap-digests sha256 --dhchap-dhgroups ffdhe4096 00:16:39.841 11:27:35 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@123 -- # connect_authenticate sha256 ffdhe4096 1 00:16:39.841 11:27:35 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@65 -- # local digest dhgroup key ckey qpairs 00:16:39.841 11:27:35 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # digest=sha256 00:16:39.841 11:27:35 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # dhgroup=ffdhe4096 00:16:39.841 11:27:35 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # key=key1 00:16:39.841 11:27:35 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@68 -- # ckey=(${ckeys[$3]:+--dhchap-ctrlr-key "ckey$3"}) 00:16:39.841 11:27:35 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@70 -- # rpc_cmd nvmf_subsystem_add_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:c758a4ed-f09f-4c82-9afb-3d096f035464 --dhchap-key key1 --dhchap-ctrlr-key ckey1 00:16:39.841 11:27:35 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:39.841 11:27:35 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:16:39.841 11:27:35 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:39.841 11:27:35 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@71 -- # bdev_connect -b nvme0 --dhchap-key key1 --dhchap-ctrlr-key ckey1 00:16:39.841 11:27:35 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@60 -- # hostrpc bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.3 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:c758a4ed-f09f-4c82-9afb-3d096f035464 -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key1 --dhchap-ctrlr-key ckey1 00:16:39.841 11:27:35 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.3 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:c758a4ed-f09f-4c82-9afb-3d096f035464 -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key1 --dhchap-ctrlr-key ckey1 00:16:40.406 00:16:40.406 11:27:35 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # jq -r '.[].name' 00:16:40.406 11:27:35 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # hostrpc bdev_nvme_get_controllers 00:16:40.406 11:27:35 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_get_controllers 00:16:40.664 11:27:35 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:16:40.664 11:27:35 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@74 -- # rpc_cmd nvmf_subsystem_get_qpairs nqn.2024-03.io.spdk:cnode0 00:16:40.664 11:27:35 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:40.664 11:27:35 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:16:40.664 11:27:35 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:40.664 11:27:35 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@74 -- # qpairs='[ 00:16:40.664 { 00:16:40.664 "auth": { 00:16:40.664 "dhgroup": "ffdhe4096", 00:16:40.664 "digest": "sha256", 00:16:40.664 "state": "completed" 00:16:40.664 }, 00:16:40.664 "cntlid": 27, 00:16:40.664 "hostnqn": "nqn.2014-08.org.nvmexpress:uuid:c758a4ed-f09f-4c82-9afb-3d096f035464", 00:16:40.664 "listen_address": { 00:16:40.664 "adrfam": "IPv4", 00:16:40.664 "traddr": "10.0.0.3", 00:16:40.664 "trsvcid": "4420", 00:16:40.664 "trtype": "TCP" 00:16:40.664 }, 00:16:40.664 "peer_address": { 00:16:40.664 "adrfam": "IPv4", 00:16:40.664 "traddr": "10.0.0.1", 00:16:40.664 "trsvcid": "36466", 00:16:40.664 "trtype": "TCP" 00:16:40.664 }, 00:16:40.664 "qid": 0, 00:16:40.664 "state": "enabled", 00:16:40.664 "thread": "nvmf_tgt_poll_group_000" 00:16:40.664 } 00:16:40.664 ]' 00:16:40.664 11:27:35 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@75 -- # jq -r '.[0].auth.digest' 00:16:40.664 11:27:36 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@75 -- # [[ sha256 == \s\h\a\2\5\6 ]] 00:16:40.664 11:27:36 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@76 -- # jq -r '.[0].auth.dhgroup' 00:16:40.664 11:27:36 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@76 -- # [[ ffdhe4096 == \f\f\d\h\e\4\0\9\6 ]] 00:16:40.664 11:27:36 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@77 -- # jq -r '.[0].auth.state' 00:16:40.664 11:27:36 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@77 -- # [[ completed == \c\o\m\p\l\e\t\e\d ]] 00:16:40.664 11:27:36 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@78 -- # hostrpc bdev_nvme_detach_controller nvme0 00:16:40.664 11:27:36 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_detach_controller nvme0 00:16:40.921 11:27:36 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@80 -- # nvme_connect --dhchap-secret DHHC-1:01:YTU2ZTRiMDFkMzNiMjFmN2QwNTBiYjliMGJkYjQwZTTsDgGm: --dhchap-ctrl-secret DHHC-1:02:ZjZjOWFiZGJhYjc3NzkxOGQwNGZmNTA0MTE0MjkzYmVkODZmYTJjNzcyZDM2NjYxWbIiww==: 00:16:40.921 11:27:36 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@36 -- # nvme connect -t tcp -a 10.0.0.3 -n nqn.2024-03.io.spdk:cnode0 -i 1 -q nqn.2014-08.org.nvmexpress:uuid:c758a4ed-f09f-4c82-9afb-3d096f035464 --hostid c758a4ed-f09f-4c82-9afb-3d096f035464 -l 0 --dhchap-secret DHHC-1:01:YTU2ZTRiMDFkMzNiMjFmN2QwNTBiYjliMGJkYjQwZTTsDgGm: --dhchap-ctrl-secret DHHC-1:02:ZjZjOWFiZGJhYjc3NzkxOGQwNGZmNTA0MTE0MjkzYmVkODZmYTJjNzcyZDM2NjYxWbIiww==: 00:16:41.856 11:27:37 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@82 -- # nvme disconnect -n nqn.2024-03.io.spdk:cnode0 00:16:41.856 NQN:nqn.2024-03.io.spdk:cnode0 disconnected 1 controller(s) 00:16:41.856 11:27:37 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@83 -- # rpc_cmd nvmf_subsystem_remove_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:c758a4ed-f09f-4c82-9afb-3d096f035464 00:16:41.856 11:27:37 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:41.856 11:27:37 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:16:41.856 11:27:37 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:41.856 11:27:37 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@120 -- # for keyid in "${!keys[@]}" 00:16:41.856 11:27:37 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@121 -- # hostrpc bdev_nvme_set_options --dhchap-digests sha256 --dhchap-dhgroups ffdhe4096 00:16:41.857 11:27:37 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_set_options --dhchap-digests sha256 --dhchap-dhgroups ffdhe4096 00:16:42.115 11:27:37 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@123 -- # connect_authenticate sha256 ffdhe4096 2 00:16:42.115 11:27:37 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@65 -- # local digest dhgroup key ckey qpairs 00:16:42.115 11:27:37 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # digest=sha256 00:16:42.115 11:27:37 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # dhgroup=ffdhe4096 00:16:42.115 11:27:37 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # key=key2 00:16:42.115 11:27:37 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@68 -- # ckey=(${ckeys[$3]:+--dhchap-ctrlr-key "ckey$3"}) 00:16:42.115 11:27:37 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@70 -- # rpc_cmd nvmf_subsystem_add_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:c758a4ed-f09f-4c82-9afb-3d096f035464 --dhchap-key key2 --dhchap-ctrlr-key ckey2 00:16:42.115 11:27:37 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:42.115 11:27:37 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:16:42.115 11:27:37 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:42.115 11:27:37 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@71 -- # bdev_connect -b nvme0 --dhchap-key key2 --dhchap-ctrlr-key ckey2 00:16:42.115 11:27:37 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@60 -- # hostrpc bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.3 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:c758a4ed-f09f-4c82-9afb-3d096f035464 -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key2 --dhchap-ctrlr-key ckey2 00:16:42.115 11:27:37 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.3 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:c758a4ed-f09f-4c82-9afb-3d096f035464 -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key2 --dhchap-ctrlr-key ckey2 00:16:42.373 00:16:42.373 11:27:37 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # jq -r '.[].name' 00:16:42.373 11:27:37 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # hostrpc bdev_nvme_get_controllers 00:16:42.373 11:27:37 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_get_controllers 00:16:42.938 11:27:38 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:16:42.938 11:27:38 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@74 -- # rpc_cmd nvmf_subsystem_get_qpairs nqn.2024-03.io.spdk:cnode0 00:16:42.938 11:27:38 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:42.938 11:27:38 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:16:42.938 11:27:38 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:42.938 11:27:38 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@74 -- # qpairs='[ 00:16:42.938 { 00:16:42.938 "auth": { 00:16:42.938 "dhgroup": "ffdhe4096", 00:16:42.938 "digest": "sha256", 00:16:42.938 "state": "completed" 00:16:42.938 }, 00:16:42.938 "cntlid": 29, 00:16:42.938 "hostnqn": "nqn.2014-08.org.nvmexpress:uuid:c758a4ed-f09f-4c82-9afb-3d096f035464", 00:16:42.938 "listen_address": { 00:16:42.938 "adrfam": "IPv4", 00:16:42.938 "traddr": "10.0.0.3", 00:16:42.938 "trsvcid": "4420", 00:16:42.938 "trtype": "TCP" 00:16:42.938 }, 00:16:42.938 "peer_address": { 00:16:42.938 "adrfam": "IPv4", 00:16:42.938 "traddr": "10.0.0.1", 00:16:42.938 "trsvcid": "36484", 00:16:42.938 "trtype": "TCP" 00:16:42.938 }, 00:16:42.938 "qid": 0, 00:16:42.938 "state": "enabled", 00:16:42.938 "thread": "nvmf_tgt_poll_group_000" 00:16:42.938 } 00:16:42.938 ]' 00:16:42.938 11:27:38 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@75 -- # jq -r '.[0].auth.digest' 00:16:42.938 11:27:38 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@75 -- # [[ sha256 == \s\h\a\2\5\6 ]] 00:16:42.938 11:27:38 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@76 -- # jq -r '.[0].auth.dhgroup' 00:16:42.938 11:27:38 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@76 -- # [[ ffdhe4096 == \f\f\d\h\e\4\0\9\6 ]] 00:16:42.938 11:27:38 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@77 -- # jq -r '.[0].auth.state' 00:16:42.938 11:27:38 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@77 -- # [[ completed == \c\o\m\p\l\e\t\e\d ]] 00:16:42.938 11:27:38 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@78 -- # hostrpc bdev_nvme_detach_controller nvme0 00:16:42.938 11:27:38 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_detach_controller nvme0 00:16:43.195 11:27:38 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@80 -- # nvme_connect --dhchap-secret DHHC-1:02:YjZiMDU3YTg1ZTA0NWQzMGY1ZWM0YzNmYzc1NDY1OWNkZmQ3NmU2YWM2ZDE3ZmVmgTRtHQ==: --dhchap-ctrl-secret DHHC-1:01:YmQ3ZDA4NWFiYjI3YjdjNWVjMzc4NDNiZTM4ZTU3N2a6gUZi: 00:16:43.195 11:27:38 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@36 -- # nvme connect -t tcp -a 10.0.0.3 -n nqn.2024-03.io.spdk:cnode0 -i 1 -q nqn.2014-08.org.nvmexpress:uuid:c758a4ed-f09f-4c82-9afb-3d096f035464 --hostid c758a4ed-f09f-4c82-9afb-3d096f035464 -l 0 --dhchap-secret DHHC-1:02:YjZiMDU3YTg1ZTA0NWQzMGY1ZWM0YzNmYzc1NDY1OWNkZmQ3NmU2YWM2ZDE3ZmVmgTRtHQ==: --dhchap-ctrl-secret DHHC-1:01:YmQ3ZDA4NWFiYjI3YjdjNWVjMzc4NDNiZTM4ZTU3N2a6gUZi: 00:16:44.129 11:27:39 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@82 -- # nvme disconnect -n nqn.2024-03.io.spdk:cnode0 00:16:44.129 NQN:nqn.2024-03.io.spdk:cnode0 disconnected 1 controller(s) 00:16:44.129 11:27:39 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@83 -- # rpc_cmd nvmf_subsystem_remove_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:c758a4ed-f09f-4c82-9afb-3d096f035464 00:16:44.129 11:27:39 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:44.129 11:27:39 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:16:44.129 11:27:39 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:44.129 11:27:39 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@120 -- # for keyid in "${!keys[@]}" 00:16:44.129 11:27:39 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@121 -- # hostrpc bdev_nvme_set_options --dhchap-digests sha256 --dhchap-dhgroups ffdhe4096 00:16:44.129 11:27:39 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_set_options --dhchap-digests sha256 --dhchap-dhgroups ffdhe4096 00:16:44.129 11:27:39 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@123 -- # connect_authenticate sha256 ffdhe4096 3 00:16:44.129 11:27:39 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@65 -- # local digest dhgroup key ckey qpairs 00:16:44.129 11:27:39 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # digest=sha256 00:16:44.129 11:27:39 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # dhgroup=ffdhe4096 00:16:44.129 11:27:39 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # key=key3 00:16:44.129 11:27:39 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@68 -- # ckey=(${ckeys[$3]:+--dhchap-ctrlr-key "ckey$3"}) 00:16:44.129 11:27:39 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@70 -- # rpc_cmd nvmf_subsystem_add_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:c758a4ed-f09f-4c82-9afb-3d096f035464 --dhchap-key key3 00:16:44.129 11:27:39 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:44.129 11:27:39 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:16:44.387 11:27:39 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:44.387 11:27:39 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@71 -- # bdev_connect -b nvme0 --dhchap-key key3 00:16:44.387 11:27:39 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@60 -- # hostrpc bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.3 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:c758a4ed-f09f-4c82-9afb-3d096f035464 -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key3 00:16:44.387 11:27:39 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.3 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:c758a4ed-f09f-4c82-9afb-3d096f035464 -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key3 00:16:44.644 00:16:44.644 11:27:40 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # hostrpc bdev_nvme_get_controllers 00:16:44.644 11:27:40 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_get_controllers 00:16:44.644 11:27:40 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # jq -r '.[].name' 00:16:44.902 11:27:40 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:16:44.902 11:27:40 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@74 -- # rpc_cmd nvmf_subsystem_get_qpairs nqn.2024-03.io.spdk:cnode0 00:16:44.902 11:27:40 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:44.902 11:27:40 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:16:44.902 11:27:40 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:44.902 11:27:40 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@74 -- # qpairs='[ 00:16:44.902 { 00:16:44.902 "auth": { 00:16:44.902 "dhgroup": "ffdhe4096", 00:16:44.902 "digest": "sha256", 00:16:44.902 "state": "completed" 00:16:44.902 }, 00:16:44.902 "cntlid": 31, 00:16:44.902 "hostnqn": "nqn.2014-08.org.nvmexpress:uuid:c758a4ed-f09f-4c82-9afb-3d096f035464", 00:16:44.902 "listen_address": { 00:16:44.902 "adrfam": "IPv4", 00:16:44.902 "traddr": "10.0.0.3", 00:16:44.902 "trsvcid": "4420", 00:16:44.902 "trtype": "TCP" 00:16:44.902 }, 00:16:44.902 "peer_address": { 00:16:44.902 "adrfam": "IPv4", 00:16:44.902 "traddr": "10.0.0.1", 00:16:44.902 "trsvcid": "36510", 00:16:44.902 "trtype": "TCP" 00:16:44.902 }, 00:16:44.902 "qid": 0, 00:16:44.902 "state": "enabled", 00:16:44.902 "thread": "nvmf_tgt_poll_group_000" 00:16:44.902 } 00:16:44.902 ]' 00:16:44.902 11:27:40 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@75 -- # jq -r '.[0].auth.digest' 00:16:45.159 11:27:40 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@75 -- # [[ sha256 == \s\h\a\2\5\6 ]] 00:16:45.159 11:27:40 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@76 -- # jq -r '.[0].auth.dhgroup' 00:16:45.159 11:27:40 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@76 -- # [[ ffdhe4096 == \f\f\d\h\e\4\0\9\6 ]] 00:16:45.160 11:27:40 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@77 -- # jq -r '.[0].auth.state' 00:16:45.160 11:27:40 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@77 -- # [[ completed == \c\o\m\p\l\e\t\e\d ]] 00:16:45.160 11:27:40 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@78 -- # hostrpc bdev_nvme_detach_controller nvme0 00:16:45.160 11:27:40 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_detach_controller nvme0 00:16:45.417 11:27:40 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@80 -- # nvme_connect --dhchap-secret DHHC-1:03:YjUzYzRlNjQ2N2QwNDQ3ZGZhN2VhODUzYjlkY2I2OWViZWM1NzZiOTJiM2MwNzIxZWVkMmMxOTIzNWE5M2Q4MDbs9Og=: 00:16:45.417 11:27:40 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@36 -- # nvme connect -t tcp -a 10.0.0.3 -n nqn.2024-03.io.spdk:cnode0 -i 1 -q nqn.2014-08.org.nvmexpress:uuid:c758a4ed-f09f-4c82-9afb-3d096f035464 --hostid c758a4ed-f09f-4c82-9afb-3d096f035464 -l 0 --dhchap-secret DHHC-1:03:YjUzYzRlNjQ2N2QwNDQ3ZGZhN2VhODUzYjlkY2I2OWViZWM1NzZiOTJiM2MwNzIxZWVkMmMxOTIzNWE5M2Q4MDbs9Og=: 00:16:46.408 11:27:41 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@82 -- # nvme disconnect -n nqn.2024-03.io.spdk:cnode0 00:16:46.408 NQN:nqn.2024-03.io.spdk:cnode0 disconnected 1 controller(s) 00:16:46.408 11:27:41 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@83 -- # rpc_cmd nvmf_subsystem_remove_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:c758a4ed-f09f-4c82-9afb-3d096f035464 00:16:46.408 11:27:41 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:46.408 11:27:41 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:16:46.408 11:27:41 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:46.408 11:27:41 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@119 -- # for dhgroup in "${dhgroups[@]}" 00:16:46.408 11:27:41 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@120 -- # for keyid in "${!keys[@]}" 00:16:46.408 11:27:41 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@121 -- # hostrpc bdev_nvme_set_options --dhchap-digests sha256 --dhchap-dhgroups ffdhe6144 00:16:46.408 11:27:41 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_set_options --dhchap-digests sha256 --dhchap-dhgroups ffdhe6144 00:16:46.408 11:27:41 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@123 -- # connect_authenticate sha256 ffdhe6144 0 00:16:46.408 11:27:41 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@65 -- # local digest dhgroup key ckey qpairs 00:16:46.408 11:27:41 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # digest=sha256 00:16:46.408 11:27:41 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # dhgroup=ffdhe6144 00:16:46.408 11:27:41 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # key=key0 00:16:46.408 11:27:41 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@68 -- # ckey=(${ckeys[$3]:+--dhchap-ctrlr-key "ckey$3"}) 00:16:46.408 11:27:41 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@70 -- # rpc_cmd nvmf_subsystem_add_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:c758a4ed-f09f-4c82-9afb-3d096f035464 --dhchap-key key0 --dhchap-ctrlr-key ckey0 00:16:46.408 11:27:41 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:46.408 11:27:41 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:16:46.408 11:27:41 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:46.408 11:27:41 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@71 -- # bdev_connect -b nvme0 --dhchap-key key0 --dhchap-ctrlr-key ckey0 00:16:46.408 11:27:41 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@60 -- # hostrpc bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.3 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:c758a4ed-f09f-4c82-9afb-3d096f035464 -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key0 --dhchap-ctrlr-key ckey0 00:16:46.408 11:27:41 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.3 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:c758a4ed-f09f-4c82-9afb-3d096f035464 -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key0 --dhchap-ctrlr-key ckey0 00:16:46.974 00:16:46.974 11:27:42 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # jq -r '.[].name' 00:16:46.974 11:27:42 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # hostrpc bdev_nvme_get_controllers 00:16:46.974 11:27:42 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_get_controllers 00:16:47.232 11:27:42 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:16:47.232 11:27:42 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@74 -- # rpc_cmd nvmf_subsystem_get_qpairs nqn.2024-03.io.spdk:cnode0 00:16:47.232 11:27:42 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:47.232 11:27:42 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:16:47.232 11:27:42 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:47.232 11:27:42 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@74 -- # qpairs='[ 00:16:47.232 { 00:16:47.232 "auth": { 00:16:47.232 "dhgroup": "ffdhe6144", 00:16:47.232 "digest": "sha256", 00:16:47.232 "state": "completed" 00:16:47.232 }, 00:16:47.232 "cntlid": 33, 00:16:47.232 "hostnqn": "nqn.2014-08.org.nvmexpress:uuid:c758a4ed-f09f-4c82-9afb-3d096f035464", 00:16:47.232 "listen_address": { 00:16:47.232 "adrfam": "IPv4", 00:16:47.232 "traddr": "10.0.0.3", 00:16:47.232 "trsvcid": "4420", 00:16:47.232 "trtype": "TCP" 00:16:47.232 }, 00:16:47.232 "peer_address": { 00:16:47.232 "adrfam": "IPv4", 00:16:47.232 "traddr": "10.0.0.1", 00:16:47.232 "trsvcid": "46366", 00:16:47.232 "trtype": "TCP" 00:16:47.232 }, 00:16:47.232 "qid": 0, 00:16:47.232 "state": "enabled", 00:16:47.232 "thread": "nvmf_tgt_poll_group_000" 00:16:47.232 } 00:16:47.232 ]' 00:16:47.232 11:27:42 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@75 -- # jq -r '.[0].auth.digest' 00:16:47.232 11:27:42 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@75 -- # [[ sha256 == \s\h\a\2\5\6 ]] 00:16:47.232 11:27:42 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@76 -- # jq -r '.[0].auth.dhgroup' 00:16:47.232 11:27:42 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@76 -- # [[ ffdhe6144 == \f\f\d\h\e\6\1\4\4 ]] 00:16:47.232 11:27:42 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@77 -- # jq -r '.[0].auth.state' 00:16:47.232 11:27:42 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@77 -- # [[ completed == \c\o\m\p\l\e\t\e\d ]] 00:16:47.232 11:27:42 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@78 -- # hostrpc bdev_nvme_detach_controller nvme0 00:16:47.232 11:27:42 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_detach_controller nvme0 00:16:47.798 11:27:43 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@80 -- # nvme_connect --dhchap-secret DHHC-1:00:YTQ3MDY2OWMxZDcwN2QyZmRhNGVmYjYzYTczYTM4NzAwYjdiNTBmZmE2ZDBlZTc28YG94Q==: --dhchap-ctrl-secret DHHC-1:03:YmY1NDQyMjdhMGU5ZDk3NGFiYTIyMTE1OTgzNGQ4ZDQ0MTE3YmFjMTc3MGQ4NDRlOTU5MThlODc5YzUxNGM2Y9nOg8I=: 00:16:47.798 11:27:43 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@36 -- # nvme connect -t tcp -a 10.0.0.3 -n nqn.2024-03.io.spdk:cnode0 -i 1 -q nqn.2014-08.org.nvmexpress:uuid:c758a4ed-f09f-4c82-9afb-3d096f035464 --hostid c758a4ed-f09f-4c82-9afb-3d096f035464 -l 0 --dhchap-secret DHHC-1:00:YTQ3MDY2OWMxZDcwN2QyZmRhNGVmYjYzYTczYTM4NzAwYjdiNTBmZmE2ZDBlZTc28YG94Q==: --dhchap-ctrl-secret DHHC-1:03:YmY1NDQyMjdhMGU5ZDk3NGFiYTIyMTE1OTgzNGQ4ZDQ0MTE3YmFjMTc3MGQ4NDRlOTU5MThlODc5YzUxNGM2Y9nOg8I=: 00:16:48.363 11:27:43 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@82 -- # nvme disconnect -n nqn.2024-03.io.spdk:cnode0 00:16:48.363 NQN:nqn.2024-03.io.spdk:cnode0 disconnected 1 controller(s) 00:16:48.363 11:27:43 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@83 -- # rpc_cmd nvmf_subsystem_remove_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:c758a4ed-f09f-4c82-9afb-3d096f035464 00:16:48.363 11:27:43 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:48.363 11:27:43 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:16:48.363 11:27:43 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:48.363 11:27:43 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@120 -- # for keyid in "${!keys[@]}" 00:16:48.363 11:27:43 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@121 -- # hostrpc bdev_nvme_set_options --dhchap-digests sha256 --dhchap-dhgroups ffdhe6144 00:16:48.363 11:27:43 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_set_options --dhchap-digests sha256 --dhchap-dhgroups ffdhe6144 00:16:48.638 11:27:44 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@123 -- # connect_authenticate sha256 ffdhe6144 1 00:16:48.638 11:27:44 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@65 -- # local digest dhgroup key ckey qpairs 00:16:48.638 11:27:44 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # digest=sha256 00:16:48.638 11:27:44 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # dhgroup=ffdhe6144 00:16:48.638 11:27:44 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # key=key1 00:16:48.638 11:27:44 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@68 -- # ckey=(${ckeys[$3]:+--dhchap-ctrlr-key "ckey$3"}) 00:16:48.639 11:27:44 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@70 -- # rpc_cmd nvmf_subsystem_add_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:c758a4ed-f09f-4c82-9afb-3d096f035464 --dhchap-key key1 --dhchap-ctrlr-key ckey1 00:16:48.639 11:27:44 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:48.639 11:27:44 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:16:48.639 11:27:44 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:48.639 11:27:44 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@71 -- # bdev_connect -b nvme0 --dhchap-key key1 --dhchap-ctrlr-key ckey1 00:16:48.639 11:27:44 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@60 -- # hostrpc bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.3 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:c758a4ed-f09f-4c82-9afb-3d096f035464 -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key1 --dhchap-ctrlr-key ckey1 00:16:48.639 11:27:44 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.3 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:c758a4ed-f09f-4c82-9afb-3d096f035464 -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key1 --dhchap-ctrlr-key ckey1 00:16:49.204 00:16:49.204 11:27:44 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # hostrpc bdev_nvme_get_controllers 00:16:49.204 11:27:44 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_get_controllers 00:16:49.204 11:27:44 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # jq -r '.[].name' 00:16:49.462 11:27:44 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:16:49.462 11:27:44 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@74 -- # rpc_cmd nvmf_subsystem_get_qpairs nqn.2024-03.io.spdk:cnode0 00:16:49.462 11:27:44 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:49.462 11:27:44 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:16:49.462 11:27:44 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:49.462 11:27:44 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@74 -- # qpairs='[ 00:16:49.462 { 00:16:49.462 "auth": { 00:16:49.462 "dhgroup": "ffdhe6144", 00:16:49.462 "digest": "sha256", 00:16:49.462 "state": "completed" 00:16:49.462 }, 00:16:49.462 "cntlid": 35, 00:16:49.462 "hostnqn": "nqn.2014-08.org.nvmexpress:uuid:c758a4ed-f09f-4c82-9afb-3d096f035464", 00:16:49.462 "listen_address": { 00:16:49.462 "adrfam": "IPv4", 00:16:49.462 "traddr": "10.0.0.3", 00:16:49.462 "trsvcid": "4420", 00:16:49.462 "trtype": "TCP" 00:16:49.462 }, 00:16:49.462 "peer_address": { 00:16:49.462 "adrfam": "IPv4", 00:16:49.462 "traddr": "10.0.0.1", 00:16:49.462 "trsvcid": "46406", 00:16:49.462 "trtype": "TCP" 00:16:49.462 }, 00:16:49.462 "qid": 0, 00:16:49.462 "state": "enabled", 00:16:49.462 "thread": "nvmf_tgt_poll_group_000" 00:16:49.462 } 00:16:49.462 ]' 00:16:49.462 11:27:44 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@75 -- # jq -r '.[0].auth.digest' 00:16:49.462 11:27:44 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@75 -- # [[ sha256 == \s\h\a\2\5\6 ]] 00:16:49.462 11:27:44 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@76 -- # jq -r '.[0].auth.dhgroup' 00:16:49.462 11:27:44 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@76 -- # [[ ffdhe6144 == \f\f\d\h\e\6\1\4\4 ]] 00:16:49.462 11:27:44 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@77 -- # jq -r '.[0].auth.state' 00:16:49.462 11:27:44 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@77 -- # [[ completed == \c\o\m\p\l\e\t\e\d ]] 00:16:49.462 11:27:44 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@78 -- # hostrpc bdev_nvme_detach_controller nvme0 00:16:49.462 11:27:44 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_detach_controller nvme0 00:16:50.027 11:27:45 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@80 -- # nvme_connect --dhchap-secret DHHC-1:01:YTU2ZTRiMDFkMzNiMjFmN2QwNTBiYjliMGJkYjQwZTTsDgGm: --dhchap-ctrl-secret DHHC-1:02:ZjZjOWFiZGJhYjc3NzkxOGQwNGZmNTA0MTE0MjkzYmVkODZmYTJjNzcyZDM2NjYxWbIiww==: 00:16:50.027 11:27:45 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@36 -- # nvme connect -t tcp -a 10.0.0.3 -n nqn.2024-03.io.spdk:cnode0 -i 1 -q nqn.2014-08.org.nvmexpress:uuid:c758a4ed-f09f-4c82-9afb-3d096f035464 --hostid c758a4ed-f09f-4c82-9afb-3d096f035464 -l 0 --dhchap-secret DHHC-1:01:YTU2ZTRiMDFkMzNiMjFmN2QwNTBiYjliMGJkYjQwZTTsDgGm: --dhchap-ctrl-secret DHHC-1:02:ZjZjOWFiZGJhYjc3NzkxOGQwNGZmNTA0MTE0MjkzYmVkODZmYTJjNzcyZDM2NjYxWbIiww==: 00:16:50.591 11:27:45 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@82 -- # nvme disconnect -n nqn.2024-03.io.spdk:cnode0 00:16:50.591 NQN:nqn.2024-03.io.spdk:cnode0 disconnected 1 controller(s) 00:16:50.591 11:27:45 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@83 -- # rpc_cmd nvmf_subsystem_remove_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:c758a4ed-f09f-4c82-9afb-3d096f035464 00:16:50.592 11:27:45 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:50.592 11:27:45 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:16:50.592 11:27:45 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:50.592 11:27:45 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@120 -- # for keyid in "${!keys[@]}" 00:16:50.592 11:27:45 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@121 -- # hostrpc bdev_nvme_set_options --dhchap-digests sha256 --dhchap-dhgroups ffdhe6144 00:16:50.592 11:27:45 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_set_options --dhchap-digests sha256 --dhchap-dhgroups ffdhe6144 00:16:50.849 11:27:46 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@123 -- # connect_authenticate sha256 ffdhe6144 2 00:16:50.849 11:27:46 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@65 -- # local digest dhgroup key ckey qpairs 00:16:50.849 11:27:46 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # digest=sha256 00:16:50.849 11:27:46 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # dhgroup=ffdhe6144 00:16:50.849 11:27:46 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # key=key2 00:16:50.849 11:27:46 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@68 -- # ckey=(${ckeys[$3]:+--dhchap-ctrlr-key "ckey$3"}) 00:16:50.849 11:27:46 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@70 -- # rpc_cmd nvmf_subsystem_add_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:c758a4ed-f09f-4c82-9afb-3d096f035464 --dhchap-key key2 --dhchap-ctrlr-key ckey2 00:16:50.849 11:27:46 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:50.849 11:27:46 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:16:50.849 11:27:46 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:50.849 11:27:46 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@71 -- # bdev_connect -b nvme0 --dhchap-key key2 --dhchap-ctrlr-key ckey2 00:16:50.849 11:27:46 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@60 -- # hostrpc bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.3 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:c758a4ed-f09f-4c82-9afb-3d096f035464 -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key2 --dhchap-ctrlr-key ckey2 00:16:50.849 11:27:46 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.3 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:c758a4ed-f09f-4c82-9afb-3d096f035464 -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key2 --dhchap-ctrlr-key ckey2 00:16:51.413 00:16:51.413 11:27:46 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # hostrpc bdev_nvme_get_controllers 00:16:51.413 11:27:46 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # jq -r '.[].name' 00:16:51.413 11:27:46 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_get_controllers 00:16:51.671 11:27:47 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:16:51.671 11:27:47 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@74 -- # rpc_cmd nvmf_subsystem_get_qpairs nqn.2024-03.io.spdk:cnode0 00:16:51.671 11:27:47 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:51.671 11:27:47 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:16:51.671 11:27:47 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:51.671 11:27:47 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@74 -- # qpairs='[ 00:16:51.671 { 00:16:51.671 "auth": { 00:16:51.671 "dhgroup": "ffdhe6144", 00:16:51.671 "digest": "sha256", 00:16:51.671 "state": "completed" 00:16:51.671 }, 00:16:51.671 "cntlid": 37, 00:16:51.671 "hostnqn": "nqn.2014-08.org.nvmexpress:uuid:c758a4ed-f09f-4c82-9afb-3d096f035464", 00:16:51.671 "listen_address": { 00:16:51.671 "adrfam": "IPv4", 00:16:51.671 "traddr": "10.0.0.3", 00:16:51.671 "trsvcid": "4420", 00:16:51.671 "trtype": "TCP" 00:16:51.671 }, 00:16:51.671 "peer_address": { 00:16:51.671 "adrfam": "IPv4", 00:16:51.671 "traddr": "10.0.0.1", 00:16:51.671 "trsvcid": "46430", 00:16:51.671 "trtype": "TCP" 00:16:51.671 }, 00:16:51.671 "qid": 0, 00:16:51.671 "state": "enabled", 00:16:51.671 "thread": "nvmf_tgt_poll_group_000" 00:16:51.671 } 00:16:51.671 ]' 00:16:51.671 11:27:47 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@75 -- # jq -r '.[0].auth.digest' 00:16:51.671 11:27:47 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@75 -- # [[ sha256 == \s\h\a\2\5\6 ]] 00:16:51.671 11:27:47 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@76 -- # jq -r '.[0].auth.dhgroup' 00:16:51.671 11:27:47 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@76 -- # [[ ffdhe6144 == \f\f\d\h\e\6\1\4\4 ]] 00:16:51.671 11:27:47 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@77 -- # jq -r '.[0].auth.state' 00:16:51.671 11:27:47 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@77 -- # [[ completed == \c\o\m\p\l\e\t\e\d ]] 00:16:51.671 11:27:47 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@78 -- # hostrpc bdev_nvme_detach_controller nvme0 00:16:51.671 11:27:47 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_detach_controller nvme0 00:16:51.930 11:27:47 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@80 -- # nvme_connect --dhchap-secret DHHC-1:02:YjZiMDU3YTg1ZTA0NWQzMGY1ZWM0YzNmYzc1NDY1OWNkZmQ3NmU2YWM2ZDE3ZmVmgTRtHQ==: --dhchap-ctrl-secret DHHC-1:01:YmQ3ZDA4NWFiYjI3YjdjNWVjMzc4NDNiZTM4ZTU3N2a6gUZi: 00:16:51.930 11:27:47 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@36 -- # nvme connect -t tcp -a 10.0.0.3 -n nqn.2024-03.io.spdk:cnode0 -i 1 -q nqn.2014-08.org.nvmexpress:uuid:c758a4ed-f09f-4c82-9afb-3d096f035464 --hostid c758a4ed-f09f-4c82-9afb-3d096f035464 -l 0 --dhchap-secret DHHC-1:02:YjZiMDU3YTg1ZTA0NWQzMGY1ZWM0YzNmYzc1NDY1OWNkZmQ3NmU2YWM2ZDE3ZmVmgTRtHQ==: --dhchap-ctrl-secret DHHC-1:01:YmQ3ZDA4NWFiYjI3YjdjNWVjMzc4NDNiZTM4ZTU3N2a6gUZi: 00:16:52.862 11:27:48 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@82 -- # nvme disconnect -n nqn.2024-03.io.spdk:cnode0 00:16:52.862 NQN:nqn.2024-03.io.spdk:cnode0 disconnected 1 controller(s) 00:16:52.862 11:27:48 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@83 -- # rpc_cmd nvmf_subsystem_remove_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:c758a4ed-f09f-4c82-9afb-3d096f035464 00:16:52.862 11:27:48 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:52.862 11:27:48 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:16:52.862 11:27:48 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:52.862 11:27:48 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@120 -- # for keyid in "${!keys[@]}" 00:16:52.862 11:27:48 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@121 -- # hostrpc bdev_nvme_set_options --dhchap-digests sha256 --dhchap-dhgroups ffdhe6144 00:16:52.862 11:27:48 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_set_options --dhchap-digests sha256 --dhchap-dhgroups ffdhe6144 00:16:53.120 11:27:48 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@123 -- # connect_authenticate sha256 ffdhe6144 3 00:16:53.120 11:27:48 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@65 -- # local digest dhgroup key ckey qpairs 00:16:53.120 11:27:48 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # digest=sha256 00:16:53.120 11:27:48 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # dhgroup=ffdhe6144 00:16:53.120 11:27:48 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # key=key3 00:16:53.120 11:27:48 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@68 -- # ckey=(${ckeys[$3]:+--dhchap-ctrlr-key "ckey$3"}) 00:16:53.120 11:27:48 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@70 -- # rpc_cmd nvmf_subsystem_add_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:c758a4ed-f09f-4c82-9afb-3d096f035464 --dhchap-key key3 00:16:53.120 11:27:48 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:53.120 11:27:48 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:16:53.120 11:27:48 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:53.120 11:27:48 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@71 -- # bdev_connect -b nvme0 --dhchap-key key3 00:16:53.120 11:27:48 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@60 -- # hostrpc bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.3 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:c758a4ed-f09f-4c82-9afb-3d096f035464 -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key3 00:16:53.120 11:27:48 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.3 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:c758a4ed-f09f-4c82-9afb-3d096f035464 -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key3 00:16:53.377 00:16:53.634 11:27:48 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # hostrpc bdev_nvme_get_controllers 00:16:53.634 11:27:48 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # jq -r '.[].name' 00:16:53.634 11:27:48 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_get_controllers 00:16:53.893 11:27:49 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:16:53.893 11:27:49 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@74 -- # rpc_cmd nvmf_subsystem_get_qpairs nqn.2024-03.io.spdk:cnode0 00:16:53.893 11:27:49 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:53.893 11:27:49 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:16:53.893 11:27:49 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:53.893 11:27:49 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@74 -- # qpairs='[ 00:16:53.893 { 00:16:53.893 "auth": { 00:16:53.893 "dhgroup": "ffdhe6144", 00:16:53.893 "digest": "sha256", 00:16:53.893 "state": "completed" 00:16:53.893 }, 00:16:53.893 "cntlid": 39, 00:16:53.893 "hostnqn": "nqn.2014-08.org.nvmexpress:uuid:c758a4ed-f09f-4c82-9afb-3d096f035464", 00:16:53.893 "listen_address": { 00:16:53.893 "adrfam": "IPv4", 00:16:53.893 "traddr": "10.0.0.3", 00:16:53.893 "trsvcid": "4420", 00:16:53.893 "trtype": "TCP" 00:16:53.893 }, 00:16:53.893 "peer_address": { 00:16:53.893 "adrfam": "IPv4", 00:16:53.893 "traddr": "10.0.0.1", 00:16:53.893 "trsvcid": "46462", 00:16:53.893 "trtype": "TCP" 00:16:53.893 }, 00:16:53.893 "qid": 0, 00:16:53.893 "state": "enabled", 00:16:53.893 "thread": "nvmf_tgt_poll_group_000" 00:16:53.893 } 00:16:53.893 ]' 00:16:53.893 11:27:49 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@75 -- # jq -r '.[0].auth.digest' 00:16:53.893 11:27:49 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@75 -- # [[ sha256 == \s\h\a\2\5\6 ]] 00:16:53.893 11:27:49 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@76 -- # jq -r '.[0].auth.dhgroup' 00:16:53.893 11:27:49 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@76 -- # [[ ffdhe6144 == \f\f\d\h\e\6\1\4\4 ]] 00:16:53.893 11:27:49 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@77 -- # jq -r '.[0].auth.state' 00:16:54.180 11:27:49 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@77 -- # [[ completed == \c\o\m\p\l\e\t\e\d ]] 00:16:54.180 11:27:49 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@78 -- # hostrpc bdev_nvme_detach_controller nvme0 00:16:54.180 11:27:49 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_detach_controller nvme0 00:16:54.447 11:27:49 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@80 -- # nvme_connect --dhchap-secret DHHC-1:03:YjUzYzRlNjQ2N2QwNDQ3ZGZhN2VhODUzYjlkY2I2OWViZWM1NzZiOTJiM2MwNzIxZWVkMmMxOTIzNWE5M2Q4MDbs9Og=: 00:16:54.447 11:27:49 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@36 -- # nvme connect -t tcp -a 10.0.0.3 -n nqn.2024-03.io.spdk:cnode0 -i 1 -q nqn.2014-08.org.nvmexpress:uuid:c758a4ed-f09f-4c82-9afb-3d096f035464 --hostid c758a4ed-f09f-4c82-9afb-3d096f035464 -l 0 --dhchap-secret DHHC-1:03:YjUzYzRlNjQ2N2QwNDQ3ZGZhN2VhODUzYjlkY2I2OWViZWM1NzZiOTJiM2MwNzIxZWVkMmMxOTIzNWE5M2Q4MDbs9Og=: 00:16:55.012 11:27:50 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@82 -- # nvme disconnect -n nqn.2024-03.io.spdk:cnode0 00:16:55.012 NQN:nqn.2024-03.io.spdk:cnode0 disconnected 1 controller(s) 00:16:55.012 11:27:50 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@83 -- # rpc_cmd nvmf_subsystem_remove_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:c758a4ed-f09f-4c82-9afb-3d096f035464 00:16:55.012 11:27:50 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:55.012 11:27:50 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:16:55.012 11:27:50 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:55.012 11:27:50 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@119 -- # for dhgroup in "${dhgroups[@]}" 00:16:55.012 11:27:50 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@120 -- # for keyid in "${!keys[@]}" 00:16:55.012 11:27:50 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@121 -- # hostrpc bdev_nvme_set_options --dhchap-digests sha256 --dhchap-dhgroups ffdhe8192 00:16:55.012 11:27:50 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_set_options --dhchap-digests sha256 --dhchap-dhgroups ffdhe8192 00:16:55.578 11:27:50 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@123 -- # connect_authenticate sha256 ffdhe8192 0 00:16:55.578 11:27:50 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@65 -- # local digest dhgroup key ckey qpairs 00:16:55.578 11:27:50 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # digest=sha256 00:16:55.578 11:27:50 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # dhgroup=ffdhe8192 00:16:55.578 11:27:50 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # key=key0 00:16:55.578 11:27:50 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@68 -- # ckey=(${ckeys[$3]:+--dhchap-ctrlr-key "ckey$3"}) 00:16:55.578 11:27:50 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@70 -- # rpc_cmd nvmf_subsystem_add_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:c758a4ed-f09f-4c82-9afb-3d096f035464 --dhchap-key key0 --dhchap-ctrlr-key ckey0 00:16:55.578 11:27:50 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:55.578 11:27:50 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:16:55.578 11:27:50 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:55.578 11:27:50 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@71 -- # bdev_connect -b nvme0 --dhchap-key key0 --dhchap-ctrlr-key ckey0 00:16:55.578 11:27:50 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@60 -- # hostrpc bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.3 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:c758a4ed-f09f-4c82-9afb-3d096f035464 -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key0 --dhchap-ctrlr-key ckey0 00:16:55.578 11:27:50 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.3 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:c758a4ed-f09f-4c82-9afb-3d096f035464 -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key0 --dhchap-ctrlr-key ckey0 00:16:56.145 00:16:56.145 11:27:51 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # hostrpc bdev_nvme_get_controllers 00:16:56.145 11:27:51 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_get_controllers 00:16:56.145 11:27:51 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # jq -r '.[].name' 00:16:56.403 11:27:51 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:16:56.403 11:27:51 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@74 -- # rpc_cmd nvmf_subsystem_get_qpairs nqn.2024-03.io.spdk:cnode0 00:16:56.403 11:27:51 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:56.403 11:27:51 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:16:56.403 11:27:51 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:56.403 11:27:51 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@74 -- # qpairs='[ 00:16:56.403 { 00:16:56.403 "auth": { 00:16:56.403 "dhgroup": "ffdhe8192", 00:16:56.403 "digest": "sha256", 00:16:56.403 "state": "completed" 00:16:56.403 }, 00:16:56.403 "cntlid": 41, 00:16:56.403 "hostnqn": "nqn.2014-08.org.nvmexpress:uuid:c758a4ed-f09f-4c82-9afb-3d096f035464", 00:16:56.403 "listen_address": { 00:16:56.403 "adrfam": "IPv4", 00:16:56.403 "traddr": "10.0.0.3", 00:16:56.403 "trsvcid": "4420", 00:16:56.403 "trtype": "TCP" 00:16:56.403 }, 00:16:56.403 "peer_address": { 00:16:56.403 "adrfam": "IPv4", 00:16:56.403 "traddr": "10.0.0.1", 00:16:56.403 "trsvcid": "46484", 00:16:56.403 "trtype": "TCP" 00:16:56.403 }, 00:16:56.403 "qid": 0, 00:16:56.403 "state": "enabled", 00:16:56.403 "thread": "nvmf_tgt_poll_group_000" 00:16:56.403 } 00:16:56.403 ]' 00:16:56.403 11:27:51 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@75 -- # jq -r '.[0].auth.digest' 00:16:56.403 11:27:51 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@75 -- # [[ sha256 == \s\h\a\2\5\6 ]] 00:16:56.403 11:27:51 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@76 -- # jq -r '.[0].auth.dhgroup' 00:16:56.403 11:27:51 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@76 -- # [[ ffdhe8192 == \f\f\d\h\e\8\1\9\2 ]] 00:16:56.403 11:27:51 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@77 -- # jq -r '.[0].auth.state' 00:16:56.403 11:27:51 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@77 -- # [[ completed == \c\o\m\p\l\e\t\e\d ]] 00:16:56.403 11:27:51 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@78 -- # hostrpc bdev_nvme_detach_controller nvme0 00:16:56.403 11:27:51 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_detach_controller nvme0 00:16:56.967 11:27:52 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@80 -- # nvme_connect --dhchap-secret DHHC-1:00:YTQ3MDY2OWMxZDcwN2QyZmRhNGVmYjYzYTczYTM4NzAwYjdiNTBmZmE2ZDBlZTc28YG94Q==: --dhchap-ctrl-secret DHHC-1:03:YmY1NDQyMjdhMGU5ZDk3NGFiYTIyMTE1OTgzNGQ4ZDQ0MTE3YmFjMTc3MGQ4NDRlOTU5MThlODc5YzUxNGM2Y9nOg8I=: 00:16:56.967 11:27:52 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@36 -- # nvme connect -t tcp -a 10.0.0.3 -n nqn.2024-03.io.spdk:cnode0 -i 1 -q nqn.2014-08.org.nvmexpress:uuid:c758a4ed-f09f-4c82-9afb-3d096f035464 --hostid c758a4ed-f09f-4c82-9afb-3d096f035464 -l 0 --dhchap-secret DHHC-1:00:YTQ3MDY2OWMxZDcwN2QyZmRhNGVmYjYzYTczYTM4NzAwYjdiNTBmZmE2ZDBlZTc28YG94Q==: --dhchap-ctrl-secret DHHC-1:03:YmY1NDQyMjdhMGU5ZDk3NGFiYTIyMTE1OTgzNGQ4ZDQ0MTE3YmFjMTc3MGQ4NDRlOTU5MThlODc5YzUxNGM2Y9nOg8I=: 00:16:57.533 11:27:52 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@82 -- # nvme disconnect -n nqn.2024-03.io.spdk:cnode0 00:16:57.533 NQN:nqn.2024-03.io.spdk:cnode0 disconnected 1 controller(s) 00:16:57.533 11:27:52 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@83 -- # rpc_cmd nvmf_subsystem_remove_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:c758a4ed-f09f-4c82-9afb-3d096f035464 00:16:57.533 11:27:52 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:57.533 11:27:52 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:16:57.533 11:27:52 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:57.533 11:27:52 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@120 -- # for keyid in "${!keys[@]}" 00:16:57.533 11:27:52 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@121 -- # hostrpc bdev_nvme_set_options --dhchap-digests sha256 --dhchap-dhgroups ffdhe8192 00:16:57.533 11:27:52 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_set_options --dhchap-digests sha256 --dhchap-dhgroups ffdhe8192 00:16:57.791 11:27:53 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@123 -- # connect_authenticate sha256 ffdhe8192 1 00:16:57.791 11:27:53 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@65 -- # local digest dhgroup key ckey qpairs 00:16:57.791 11:27:53 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # digest=sha256 00:16:57.791 11:27:53 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # dhgroup=ffdhe8192 00:16:57.791 11:27:53 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # key=key1 00:16:57.791 11:27:53 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@68 -- # ckey=(${ckeys[$3]:+--dhchap-ctrlr-key "ckey$3"}) 00:16:57.791 11:27:53 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@70 -- # rpc_cmd nvmf_subsystem_add_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:c758a4ed-f09f-4c82-9afb-3d096f035464 --dhchap-key key1 --dhchap-ctrlr-key ckey1 00:16:57.791 11:27:53 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:57.791 11:27:53 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:16:57.791 11:27:53 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:57.791 11:27:53 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@71 -- # bdev_connect -b nvme0 --dhchap-key key1 --dhchap-ctrlr-key ckey1 00:16:57.791 11:27:53 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@60 -- # hostrpc bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.3 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:c758a4ed-f09f-4c82-9afb-3d096f035464 -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key1 --dhchap-ctrlr-key ckey1 00:16:57.791 11:27:53 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.3 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:c758a4ed-f09f-4c82-9afb-3d096f035464 -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key1 --dhchap-ctrlr-key ckey1 00:16:58.725 00:16:58.725 11:27:53 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # hostrpc bdev_nvme_get_controllers 00:16:58.725 11:27:53 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # jq -r '.[].name' 00:16:58.725 11:27:53 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_get_controllers 00:16:58.725 11:27:54 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:16:58.725 11:27:54 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@74 -- # rpc_cmd nvmf_subsystem_get_qpairs nqn.2024-03.io.spdk:cnode0 00:16:58.725 11:27:54 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:58.725 11:27:54 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:16:58.725 11:27:54 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:58.725 11:27:54 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@74 -- # qpairs='[ 00:16:58.725 { 00:16:58.725 "auth": { 00:16:58.725 "dhgroup": "ffdhe8192", 00:16:58.725 "digest": "sha256", 00:16:58.725 "state": "completed" 00:16:58.725 }, 00:16:58.725 "cntlid": 43, 00:16:58.725 "hostnqn": "nqn.2014-08.org.nvmexpress:uuid:c758a4ed-f09f-4c82-9afb-3d096f035464", 00:16:58.725 "listen_address": { 00:16:58.725 "adrfam": "IPv4", 00:16:58.725 "traddr": "10.0.0.3", 00:16:58.725 "trsvcid": "4420", 00:16:58.725 "trtype": "TCP" 00:16:58.725 }, 00:16:58.725 "peer_address": { 00:16:58.725 "adrfam": "IPv4", 00:16:58.725 "traddr": "10.0.0.1", 00:16:58.725 "trsvcid": "43582", 00:16:58.725 "trtype": "TCP" 00:16:58.725 }, 00:16:58.725 "qid": 0, 00:16:58.725 "state": "enabled", 00:16:58.725 "thread": "nvmf_tgt_poll_group_000" 00:16:58.725 } 00:16:58.725 ]' 00:16:58.725 11:27:54 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@75 -- # jq -r '.[0].auth.digest' 00:16:58.983 11:27:54 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@75 -- # [[ sha256 == \s\h\a\2\5\6 ]] 00:16:58.983 11:27:54 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@76 -- # jq -r '.[0].auth.dhgroup' 00:16:58.983 11:27:54 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@76 -- # [[ ffdhe8192 == \f\f\d\h\e\8\1\9\2 ]] 00:16:58.983 11:27:54 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@77 -- # jq -r '.[0].auth.state' 00:16:58.983 11:27:54 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@77 -- # [[ completed == \c\o\m\p\l\e\t\e\d ]] 00:16:58.983 11:27:54 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@78 -- # hostrpc bdev_nvme_detach_controller nvme0 00:16:58.983 11:27:54 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_detach_controller nvme0 00:16:59.241 11:27:54 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@80 -- # nvme_connect --dhchap-secret DHHC-1:01:YTU2ZTRiMDFkMzNiMjFmN2QwNTBiYjliMGJkYjQwZTTsDgGm: --dhchap-ctrl-secret DHHC-1:02:ZjZjOWFiZGJhYjc3NzkxOGQwNGZmNTA0MTE0MjkzYmVkODZmYTJjNzcyZDM2NjYxWbIiww==: 00:16:59.241 11:27:54 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@36 -- # nvme connect -t tcp -a 10.0.0.3 -n nqn.2024-03.io.spdk:cnode0 -i 1 -q nqn.2014-08.org.nvmexpress:uuid:c758a4ed-f09f-4c82-9afb-3d096f035464 --hostid c758a4ed-f09f-4c82-9afb-3d096f035464 -l 0 --dhchap-secret DHHC-1:01:YTU2ZTRiMDFkMzNiMjFmN2QwNTBiYjliMGJkYjQwZTTsDgGm: --dhchap-ctrl-secret DHHC-1:02:ZjZjOWFiZGJhYjc3NzkxOGQwNGZmNTA0MTE0MjkzYmVkODZmYTJjNzcyZDM2NjYxWbIiww==: 00:17:00.175 11:27:55 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@82 -- # nvme disconnect -n nqn.2024-03.io.spdk:cnode0 00:17:00.175 NQN:nqn.2024-03.io.spdk:cnode0 disconnected 1 controller(s) 00:17:00.175 11:27:55 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@83 -- # rpc_cmd nvmf_subsystem_remove_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:c758a4ed-f09f-4c82-9afb-3d096f035464 00:17:00.175 11:27:55 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:17:00.176 11:27:55 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:17:00.176 11:27:55 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:17:00.176 11:27:55 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@120 -- # for keyid in "${!keys[@]}" 00:17:00.176 11:27:55 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@121 -- # hostrpc bdev_nvme_set_options --dhchap-digests sha256 --dhchap-dhgroups ffdhe8192 00:17:00.176 11:27:55 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_set_options --dhchap-digests sha256 --dhchap-dhgroups ffdhe8192 00:17:00.434 11:27:55 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@123 -- # connect_authenticate sha256 ffdhe8192 2 00:17:00.434 11:27:55 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@65 -- # local digest dhgroup key ckey qpairs 00:17:00.434 11:27:55 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # digest=sha256 00:17:00.434 11:27:55 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # dhgroup=ffdhe8192 00:17:00.434 11:27:55 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # key=key2 00:17:00.434 11:27:55 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@68 -- # ckey=(${ckeys[$3]:+--dhchap-ctrlr-key "ckey$3"}) 00:17:00.434 11:27:55 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@70 -- # rpc_cmd nvmf_subsystem_add_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:c758a4ed-f09f-4c82-9afb-3d096f035464 --dhchap-key key2 --dhchap-ctrlr-key ckey2 00:17:00.434 11:27:55 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:17:00.434 11:27:55 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:17:00.434 11:27:55 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:17:00.434 11:27:55 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@71 -- # bdev_connect -b nvme0 --dhchap-key key2 --dhchap-ctrlr-key ckey2 00:17:00.434 11:27:55 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@60 -- # hostrpc bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.3 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:c758a4ed-f09f-4c82-9afb-3d096f035464 -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key2 --dhchap-ctrlr-key ckey2 00:17:00.434 11:27:55 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.3 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:c758a4ed-f09f-4c82-9afb-3d096f035464 -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key2 --dhchap-ctrlr-key ckey2 00:17:00.999 00:17:00.999 11:27:56 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # hostrpc bdev_nvme_get_controllers 00:17:00.999 11:27:56 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # jq -r '.[].name' 00:17:00.999 11:27:56 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_get_controllers 00:17:01.257 11:27:56 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:17:01.257 11:27:56 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@74 -- # rpc_cmd nvmf_subsystem_get_qpairs nqn.2024-03.io.spdk:cnode0 00:17:01.257 11:27:56 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:17:01.257 11:27:56 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:17:01.257 11:27:56 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:17:01.257 11:27:56 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@74 -- # qpairs='[ 00:17:01.257 { 00:17:01.257 "auth": { 00:17:01.257 "dhgroup": "ffdhe8192", 00:17:01.257 "digest": "sha256", 00:17:01.257 "state": "completed" 00:17:01.257 }, 00:17:01.257 "cntlid": 45, 00:17:01.257 "hostnqn": "nqn.2014-08.org.nvmexpress:uuid:c758a4ed-f09f-4c82-9afb-3d096f035464", 00:17:01.257 "listen_address": { 00:17:01.257 "adrfam": "IPv4", 00:17:01.257 "traddr": "10.0.0.3", 00:17:01.257 "trsvcid": "4420", 00:17:01.257 "trtype": "TCP" 00:17:01.257 }, 00:17:01.257 "peer_address": { 00:17:01.257 "adrfam": "IPv4", 00:17:01.257 "traddr": "10.0.0.1", 00:17:01.257 "trsvcid": "43608", 00:17:01.257 "trtype": "TCP" 00:17:01.257 }, 00:17:01.257 "qid": 0, 00:17:01.257 "state": "enabled", 00:17:01.257 "thread": "nvmf_tgt_poll_group_000" 00:17:01.257 } 00:17:01.257 ]' 00:17:01.257 11:27:56 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@75 -- # jq -r '.[0].auth.digest' 00:17:01.515 11:27:56 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@75 -- # [[ sha256 == \s\h\a\2\5\6 ]] 00:17:01.515 11:27:56 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@76 -- # jq -r '.[0].auth.dhgroup' 00:17:01.515 11:27:56 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@76 -- # [[ ffdhe8192 == \f\f\d\h\e\8\1\9\2 ]] 00:17:01.515 11:27:56 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@77 -- # jq -r '.[0].auth.state' 00:17:01.515 11:27:56 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@77 -- # [[ completed == \c\o\m\p\l\e\t\e\d ]] 00:17:01.515 11:27:56 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@78 -- # hostrpc bdev_nvme_detach_controller nvme0 00:17:01.515 11:27:56 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_detach_controller nvme0 00:17:01.772 11:27:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@80 -- # nvme_connect --dhchap-secret DHHC-1:02:YjZiMDU3YTg1ZTA0NWQzMGY1ZWM0YzNmYzc1NDY1OWNkZmQ3NmU2YWM2ZDE3ZmVmgTRtHQ==: --dhchap-ctrl-secret DHHC-1:01:YmQ3ZDA4NWFiYjI3YjdjNWVjMzc4NDNiZTM4ZTU3N2a6gUZi: 00:17:01.772 11:27:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@36 -- # nvme connect -t tcp -a 10.0.0.3 -n nqn.2024-03.io.spdk:cnode0 -i 1 -q nqn.2014-08.org.nvmexpress:uuid:c758a4ed-f09f-4c82-9afb-3d096f035464 --hostid c758a4ed-f09f-4c82-9afb-3d096f035464 -l 0 --dhchap-secret DHHC-1:02:YjZiMDU3YTg1ZTA0NWQzMGY1ZWM0YzNmYzc1NDY1OWNkZmQ3NmU2YWM2ZDE3ZmVmgTRtHQ==: --dhchap-ctrl-secret DHHC-1:01:YmQ3ZDA4NWFiYjI3YjdjNWVjMzc4NDNiZTM4ZTU3N2a6gUZi: 00:17:02.337 11:27:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@82 -- # nvme disconnect -n nqn.2024-03.io.spdk:cnode0 00:17:02.337 NQN:nqn.2024-03.io.spdk:cnode0 disconnected 1 controller(s) 00:17:02.337 11:27:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@83 -- # rpc_cmd nvmf_subsystem_remove_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:c758a4ed-f09f-4c82-9afb-3d096f035464 00:17:02.337 11:27:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:17:02.337 11:27:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:17:02.337 11:27:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:17:02.337 11:27:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@120 -- # for keyid in "${!keys[@]}" 00:17:02.337 11:27:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@121 -- # hostrpc bdev_nvme_set_options --dhchap-digests sha256 --dhchap-dhgroups ffdhe8192 00:17:02.337 11:27:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_set_options --dhchap-digests sha256 --dhchap-dhgroups ffdhe8192 00:17:02.595 11:27:58 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@123 -- # connect_authenticate sha256 ffdhe8192 3 00:17:02.595 11:27:58 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@65 -- # local digest dhgroup key ckey qpairs 00:17:02.595 11:27:58 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # digest=sha256 00:17:02.595 11:27:58 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # dhgroup=ffdhe8192 00:17:02.595 11:27:58 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # key=key3 00:17:02.595 11:27:58 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@68 -- # ckey=(${ckeys[$3]:+--dhchap-ctrlr-key "ckey$3"}) 00:17:02.596 11:27:58 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@70 -- # rpc_cmd nvmf_subsystem_add_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:c758a4ed-f09f-4c82-9afb-3d096f035464 --dhchap-key key3 00:17:02.596 11:27:58 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:17:02.596 11:27:58 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:17:02.596 11:27:58 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:17:02.596 11:27:58 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@71 -- # bdev_connect -b nvme0 --dhchap-key key3 00:17:02.596 11:27:58 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@60 -- # hostrpc bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.3 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:c758a4ed-f09f-4c82-9afb-3d096f035464 -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key3 00:17:02.596 11:27:58 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.3 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:c758a4ed-f09f-4c82-9afb-3d096f035464 -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key3 00:17:03.530 00:17:03.530 11:27:58 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # jq -r '.[].name' 00:17:03.530 11:27:58 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # hostrpc bdev_nvme_get_controllers 00:17:03.530 11:27:58 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_get_controllers 00:17:03.787 11:27:59 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:17:03.787 11:27:59 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@74 -- # rpc_cmd nvmf_subsystem_get_qpairs nqn.2024-03.io.spdk:cnode0 00:17:03.787 11:27:59 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:17:03.787 11:27:59 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:17:03.787 11:27:59 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:17:03.787 11:27:59 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@74 -- # qpairs='[ 00:17:03.787 { 00:17:03.787 "auth": { 00:17:03.787 "dhgroup": "ffdhe8192", 00:17:03.787 "digest": "sha256", 00:17:03.787 "state": "completed" 00:17:03.787 }, 00:17:03.787 "cntlid": 47, 00:17:03.787 "hostnqn": "nqn.2014-08.org.nvmexpress:uuid:c758a4ed-f09f-4c82-9afb-3d096f035464", 00:17:03.787 "listen_address": { 00:17:03.787 "adrfam": "IPv4", 00:17:03.787 "traddr": "10.0.0.3", 00:17:03.787 "trsvcid": "4420", 00:17:03.787 "trtype": "TCP" 00:17:03.787 }, 00:17:03.787 "peer_address": { 00:17:03.787 "adrfam": "IPv4", 00:17:03.787 "traddr": "10.0.0.1", 00:17:03.787 "trsvcid": "43628", 00:17:03.787 "trtype": "TCP" 00:17:03.787 }, 00:17:03.787 "qid": 0, 00:17:03.787 "state": "enabled", 00:17:03.787 "thread": "nvmf_tgt_poll_group_000" 00:17:03.787 } 00:17:03.787 ]' 00:17:03.787 11:27:59 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@75 -- # jq -r '.[0].auth.digest' 00:17:03.787 11:27:59 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@75 -- # [[ sha256 == \s\h\a\2\5\6 ]] 00:17:03.787 11:27:59 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@76 -- # jq -r '.[0].auth.dhgroup' 00:17:03.787 11:27:59 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@76 -- # [[ ffdhe8192 == \f\f\d\h\e\8\1\9\2 ]] 00:17:03.787 11:27:59 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@77 -- # jq -r '.[0].auth.state' 00:17:03.787 11:27:59 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@77 -- # [[ completed == \c\o\m\p\l\e\t\e\d ]] 00:17:03.787 11:27:59 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@78 -- # hostrpc bdev_nvme_detach_controller nvme0 00:17:03.787 11:27:59 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_detach_controller nvme0 00:17:04.044 11:27:59 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@80 -- # nvme_connect --dhchap-secret DHHC-1:03:YjUzYzRlNjQ2N2QwNDQ3ZGZhN2VhODUzYjlkY2I2OWViZWM1NzZiOTJiM2MwNzIxZWVkMmMxOTIzNWE5M2Q4MDbs9Og=: 00:17:04.044 11:27:59 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@36 -- # nvme connect -t tcp -a 10.0.0.3 -n nqn.2024-03.io.spdk:cnode0 -i 1 -q nqn.2014-08.org.nvmexpress:uuid:c758a4ed-f09f-4c82-9afb-3d096f035464 --hostid c758a4ed-f09f-4c82-9afb-3d096f035464 -l 0 --dhchap-secret DHHC-1:03:YjUzYzRlNjQ2N2QwNDQ3ZGZhN2VhODUzYjlkY2I2OWViZWM1NzZiOTJiM2MwNzIxZWVkMmMxOTIzNWE5M2Q4MDbs9Og=: 00:17:04.975 11:28:00 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@82 -- # nvme disconnect -n nqn.2024-03.io.spdk:cnode0 00:17:04.975 NQN:nqn.2024-03.io.spdk:cnode0 disconnected 1 controller(s) 00:17:04.975 11:28:00 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@83 -- # rpc_cmd nvmf_subsystem_remove_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:c758a4ed-f09f-4c82-9afb-3d096f035464 00:17:04.975 11:28:00 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:17:04.975 11:28:00 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:17:04.975 11:28:00 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:17:04.975 11:28:00 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@118 -- # for digest in "${digests[@]}" 00:17:04.975 11:28:00 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@119 -- # for dhgroup in "${dhgroups[@]}" 00:17:04.975 11:28:00 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@120 -- # for keyid in "${!keys[@]}" 00:17:04.975 11:28:00 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@121 -- # hostrpc bdev_nvme_set_options --dhchap-digests sha384 --dhchap-dhgroups null 00:17:04.975 11:28:00 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_set_options --dhchap-digests sha384 --dhchap-dhgroups null 00:17:05.231 11:28:00 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@123 -- # connect_authenticate sha384 null 0 00:17:05.231 11:28:00 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@65 -- # local digest dhgroup key ckey qpairs 00:17:05.231 11:28:00 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # digest=sha384 00:17:05.231 11:28:00 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # dhgroup=null 00:17:05.232 11:28:00 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # key=key0 00:17:05.232 11:28:00 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@68 -- # ckey=(${ckeys[$3]:+--dhchap-ctrlr-key "ckey$3"}) 00:17:05.232 11:28:00 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@70 -- # rpc_cmd nvmf_subsystem_add_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:c758a4ed-f09f-4c82-9afb-3d096f035464 --dhchap-key key0 --dhchap-ctrlr-key ckey0 00:17:05.232 11:28:00 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:17:05.232 11:28:00 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:17:05.232 11:28:00 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:17:05.232 11:28:00 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@71 -- # bdev_connect -b nvme0 --dhchap-key key0 --dhchap-ctrlr-key ckey0 00:17:05.232 11:28:00 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@60 -- # hostrpc bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.3 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:c758a4ed-f09f-4c82-9afb-3d096f035464 -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key0 --dhchap-ctrlr-key ckey0 00:17:05.232 11:28:00 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.3 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:c758a4ed-f09f-4c82-9afb-3d096f035464 -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key0 --dhchap-ctrlr-key ckey0 00:17:05.489 00:17:05.489 11:28:00 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # hostrpc bdev_nvme_get_controllers 00:17:05.489 11:28:00 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_get_controllers 00:17:05.489 11:28:00 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # jq -r '.[].name' 00:17:05.746 11:28:01 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:17:05.746 11:28:01 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@74 -- # rpc_cmd nvmf_subsystem_get_qpairs nqn.2024-03.io.spdk:cnode0 00:17:05.746 11:28:01 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:17:05.746 11:28:01 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:17:05.746 11:28:01 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:17:05.746 11:28:01 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@74 -- # qpairs='[ 00:17:05.746 { 00:17:05.746 "auth": { 00:17:05.746 "dhgroup": "null", 00:17:05.746 "digest": "sha384", 00:17:05.746 "state": "completed" 00:17:05.746 }, 00:17:05.746 "cntlid": 49, 00:17:05.746 "hostnqn": "nqn.2014-08.org.nvmexpress:uuid:c758a4ed-f09f-4c82-9afb-3d096f035464", 00:17:05.746 "listen_address": { 00:17:05.746 "adrfam": "IPv4", 00:17:05.746 "traddr": "10.0.0.3", 00:17:05.746 "trsvcid": "4420", 00:17:05.746 "trtype": "TCP" 00:17:05.746 }, 00:17:05.746 "peer_address": { 00:17:05.746 "adrfam": "IPv4", 00:17:05.746 "traddr": "10.0.0.1", 00:17:05.746 "trsvcid": "43660", 00:17:05.746 "trtype": "TCP" 00:17:05.746 }, 00:17:05.746 "qid": 0, 00:17:05.746 "state": "enabled", 00:17:05.746 "thread": "nvmf_tgt_poll_group_000" 00:17:05.746 } 00:17:05.746 ]' 00:17:05.746 11:28:01 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@75 -- # jq -r '.[0].auth.digest' 00:17:05.746 11:28:01 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@75 -- # [[ sha384 == \s\h\a\3\8\4 ]] 00:17:05.746 11:28:01 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@76 -- # jq -r '.[0].auth.dhgroup' 00:17:06.003 11:28:01 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@76 -- # [[ null == \n\u\l\l ]] 00:17:06.003 11:28:01 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@77 -- # jq -r '.[0].auth.state' 00:17:06.003 11:28:01 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@77 -- # [[ completed == \c\o\m\p\l\e\t\e\d ]] 00:17:06.003 11:28:01 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@78 -- # hostrpc bdev_nvme_detach_controller nvme0 00:17:06.003 11:28:01 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_detach_controller nvme0 00:17:06.260 11:28:01 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@80 -- # nvme_connect --dhchap-secret DHHC-1:00:YTQ3MDY2OWMxZDcwN2QyZmRhNGVmYjYzYTczYTM4NzAwYjdiNTBmZmE2ZDBlZTc28YG94Q==: --dhchap-ctrl-secret DHHC-1:03:YmY1NDQyMjdhMGU5ZDk3NGFiYTIyMTE1OTgzNGQ4ZDQ0MTE3YmFjMTc3MGQ4NDRlOTU5MThlODc5YzUxNGM2Y9nOg8I=: 00:17:06.260 11:28:01 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@36 -- # nvme connect -t tcp -a 10.0.0.3 -n nqn.2024-03.io.spdk:cnode0 -i 1 -q nqn.2014-08.org.nvmexpress:uuid:c758a4ed-f09f-4c82-9afb-3d096f035464 --hostid c758a4ed-f09f-4c82-9afb-3d096f035464 -l 0 --dhchap-secret DHHC-1:00:YTQ3MDY2OWMxZDcwN2QyZmRhNGVmYjYzYTczYTM4NzAwYjdiNTBmZmE2ZDBlZTc28YG94Q==: --dhchap-ctrl-secret DHHC-1:03:YmY1NDQyMjdhMGU5ZDk3NGFiYTIyMTE1OTgzNGQ4ZDQ0MTE3YmFjMTc3MGQ4NDRlOTU5MThlODc5YzUxNGM2Y9nOg8I=: 00:17:06.825 11:28:02 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@82 -- # nvme disconnect -n nqn.2024-03.io.spdk:cnode0 00:17:06.825 NQN:nqn.2024-03.io.spdk:cnode0 disconnected 1 controller(s) 00:17:06.825 11:28:02 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@83 -- # rpc_cmd nvmf_subsystem_remove_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:c758a4ed-f09f-4c82-9afb-3d096f035464 00:17:06.825 11:28:02 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:17:06.825 11:28:02 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:17:06.825 11:28:02 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:17:06.825 11:28:02 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@120 -- # for keyid in "${!keys[@]}" 00:17:06.825 11:28:02 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@121 -- # hostrpc bdev_nvme_set_options --dhchap-digests sha384 --dhchap-dhgroups null 00:17:06.825 11:28:02 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_set_options --dhchap-digests sha384 --dhchap-dhgroups null 00:17:07.082 11:28:02 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@123 -- # connect_authenticate sha384 null 1 00:17:07.082 11:28:02 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@65 -- # local digest dhgroup key ckey qpairs 00:17:07.082 11:28:02 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # digest=sha384 00:17:07.082 11:28:02 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # dhgroup=null 00:17:07.082 11:28:02 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # key=key1 00:17:07.082 11:28:02 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@68 -- # ckey=(${ckeys[$3]:+--dhchap-ctrlr-key "ckey$3"}) 00:17:07.082 11:28:02 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@70 -- # rpc_cmd nvmf_subsystem_add_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:c758a4ed-f09f-4c82-9afb-3d096f035464 --dhchap-key key1 --dhchap-ctrlr-key ckey1 00:17:07.082 11:28:02 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:17:07.082 11:28:02 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:17:07.374 11:28:02 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:17:07.374 11:28:02 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@71 -- # bdev_connect -b nvme0 --dhchap-key key1 --dhchap-ctrlr-key ckey1 00:17:07.374 11:28:02 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@60 -- # hostrpc bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.3 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:c758a4ed-f09f-4c82-9afb-3d096f035464 -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key1 --dhchap-ctrlr-key ckey1 00:17:07.374 11:28:02 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.3 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:c758a4ed-f09f-4c82-9afb-3d096f035464 -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key1 --dhchap-ctrlr-key ckey1 00:17:07.631 00:17:07.631 11:28:02 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # hostrpc bdev_nvme_get_controllers 00:17:07.631 11:28:02 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # jq -r '.[].name' 00:17:07.631 11:28:02 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_get_controllers 00:17:07.888 11:28:03 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:17:07.888 11:28:03 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@74 -- # rpc_cmd nvmf_subsystem_get_qpairs nqn.2024-03.io.spdk:cnode0 00:17:07.888 11:28:03 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:17:07.888 11:28:03 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:17:07.888 11:28:03 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:17:07.888 11:28:03 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@74 -- # qpairs='[ 00:17:07.888 { 00:17:07.888 "auth": { 00:17:07.888 "dhgroup": "null", 00:17:07.888 "digest": "sha384", 00:17:07.888 "state": "completed" 00:17:07.888 }, 00:17:07.888 "cntlid": 51, 00:17:07.888 "hostnqn": "nqn.2014-08.org.nvmexpress:uuid:c758a4ed-f09f-4c82-9afb-3d096f035464", 00:17:07.888 "listen_address": { 00:17:07.888 "adrfam": "IPv4", 00:17:07.888 "traddr": "10.0.0.3", 00:17:07.888 "trsvcid": "4420", 00:17:07.888 "trtype": "TCP" 00:17:07.888 }, 00:17:07.888 "peer_address": { 00:17:07.888 "adrfam": "IPv4", 00:17:07.888 "traddr": "10.0.0.1", 00:17:07.888 "trsvcid": "45934", 00:17:07.888 "trtype": "TCP" 00:17:07.888 }, 00:17:07.888 "qid": 0, 00:17:07.888 "state": "enabled", 00:17:07.888 "thread": "nvmf_tgt_poll_group_000" 00:17:07.888 } 00:17:07.888 ]' 00:17:07.888 11:28:03 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@75 -- # jq -r '.[0].auth.digest' 00:17:07.888 11:28:03 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@75 -- # [[ sha384 == \s\h\a\3\8\4 ]] 00:17:07.888 11:28:03 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@76 -- # jq -r '.[0].auth.dhgroup' 00:17:07.888 11:28:03 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@76 -- # [[ null == \n\u\l\l ]] 00:17:07.888 11:28:03 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@77 -- # jq -r '.[0].auth.state' 00:17:08.146 11:28:03 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@77 -- # [[ completed == \c\o\m\p\l\e\t\e\d ]] 00:17:08.146 11:28:03 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@78 -- # hostrpc bdev_nvme_detach_controller nvme0 00:17:08.146 11:28:03 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_detach_controller nvme0 00:17:08.404 11:28:03 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@80 -- # nvme_connect --dhchap-secret DHHC-1:01:YTU2ZTRiMDFkMzNiMjFmN2QwNTBiYjliMGJkYjQwZTTsDgGm: --dhchap-ctrl-secret DHHC-1:02:ZjZjOWFiZGJhYjc3NzkxOGQwNGZmNTA0MTE0MjkzYmVkODZmYTJjNzcyZDM2NjYxWbIiww==: 00:17:08.404 11:28:03 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@36 -- # nvme connect -t tcp -a 10.0.0.3 -n nqn.2024-03.io.spdk:cnode0 -i 1 -q nqn.2014-08.org.nvmexpress:uuid:c758a4ed-f09f-4c82-9afb-3d096f035464 --hostid c758a4ed-f09f-4c82-9afb-3d096f035464 -l 0 --dhchap-secret DHHC-1:01:YTU2ZTRiMDFkMzNiMjFmN2QwNTBiYjliMGJkYjQwZTTsDgGm: --dhchap-ctrl-secret DHHC-1:02:ZjZjOWFiZGJhYjc3NzkxOGQwNGZmNTA0MTE0MjkzYmVkODZmYTJjNzcyZDM2NjYxWbIiww==: 00:17:08.970 11:28:04 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@82 -- # nvme disconnect -n nqn.2024-03.io.spdk:cnode0 00:17:08.970 NQN:nqn.2024-03.io.spdk:cnode0 disconnected 1 controller(s) 00:17:08.970 11:28:04 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@83 -- # rpc_cmd nvmf_subsystem_remove_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:c758a4ed-f09f-4c82-9afb-3d096f035464 00:17:08.970 11:28:04 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:17:08.970 11:28:04 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:17:08.970 11:28:04 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:17:08.970 11:28:04 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@120 -- # for keyid in "${!keys[@]}" 00:17:08.970 11:28:04 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@121 -- # hostrpc bdev_nvme_set_options --dhchap-digests sha384 --dhchap-dhgroups null 00:17:08.970 11:28:04 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_set_options --dhchap-digests sha384 --dhchap-dhgroups null 00:17:09.228 11:28:04 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@123 -- # connect_authenticate sha384 null 2 00:17:09.228 11:28:04 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@65 -- # local digest dhgroup key ckey qpairs 00:17:09.228 11:28:04 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # digest=sha384 00:17:09.228 11:28:04 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # dhgroup=null 00:17:09.228 11:28:04 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # key=key2 00:17:09.228 11:28:04 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@68 -- # ckey=(${ckeys[$3]:+--dhchap-ctrlr-key "ckey$3"}) 00:17:09.228 11:28:04 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@70 -- # rpc_cmd nvmf_subsystem_add_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:c758a4ed-f09f-4c82-9afb-3d096f035464 --dhchap-key key2 --dhchap-ctrlr-key ckey2 00:17:09.228 11:28:04 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:17:09.228 11:28:04 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:17:09.228 11:28:04 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:17:09.228 11:28:04 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@71 -- # bdev_connect -b nvme0 --dhchap-key key2 --dhchap-ctrlr-key ckey2 00:17:09.228 11:28:04 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@60 -- # hostrpc bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.3 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:c758a4ed-f09f-4c82-9afb-3d096f035464 -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key2 --dhchap-ctrlr-key ckey2 00:17:09.228 11:28:04 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.3 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:c758a4ed-f09f-4c82-9afb-3d096f035464 -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key2 --dhchap-ctrlr-key ckey2 00:17:09.862 00:17:09.862 11:28:05 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # hostrpc bdev_nvme_get_controllers 00:17:09.862 11:28:05 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # jq -r '.[].name' 00:17:09.862 11:28:05 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_get_controllers 00:17:09.862 11:28:05 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:17:09.862 11:28:05 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@74 -- # rpc_cmd nvmf_subsystem_get_qpairs nqn.2024-03.io.spdk:cnode0 00:17:09.862 11:28:05 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:17:09.862 11:28:05 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:17:09.862 11:28:05 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:17:09.862 11:28:05 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@74 -- # qpairs='[ 00:17:09.862 { 00:17:09.862 "auth": { 00:17:09.862 "dhgroup": "null", 00:17:09.862 "digest": "sha384", 00:17:09.862 "state": "completed" 00:17:09.862 }, 00:17:09.862 "cntlid": 53, 00:17:09.862 "hostnqn": "nqn.2014-08.org.nvmexpress:uuid:c758a4ed-f09f-4c82-9afb-3d096f035464", 00:17:09.862 "listen_address": { 00:17:09.862 "adrfam": "IPv4", 00:17:09.862 "traddr": "10.0.0.3", 00:17:09.862 "trsvcid": "4420", 00:17:09.862 "trtype": "TCP" 00:17:09.862 }, 00:17:09.862 "peer_address": { 00:17:09.862 "adrfam": "IPv4", 00:17:09.862 "traddr": "10.0.0.1", 00:17:09.862 "trsvcid": "45968", 00:17:09.862 "trtype": "TCP" 00:17:09.862 }, 00:17:09.862 "qid": 0, 00:17:09.862 "state": "enabled", 00:17:09.862 "thread": "nvmf_tgt_poll_group_000" 00:17:09.862 } 00:17:09.862 ]' 00:17:09.862 11:28:05 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@75 -- # jq -r '.[0].auth.digest' 00:17:10.120 11:28:05 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@75 -- # [[ sha384 == \s\h\a\3\8\4 ]] 00:17:10.120 11:28:05 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@76 -- # jq -r '.[0].auth.dhgroup' 00:17:10.120 11:28:05 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@76 -- # [[ null == \n\u\l\l ]] 00:17:10.120 11:28:05 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@77 -- # jq -r '.[0].auth.state' 00:17:10.120 11:28:05 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@77 -- # [[ completed == \c\o\m\p\l\e\t\e\d ]] 00:17:10.120 11:28:05 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@78 -- # hostrpc bdev_nvme_detach_controller nvme0 00:17:10.120 11:28:05 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_detach_controller nvme0 00:17:10.379 11:28:05 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@80 -- # nvme_connect --dhchap-secret DHHC-1:02:YjZiMDU3YTg1ZTA0NWQzMGY1ZWM0YzNmYzc1NDY1OWNkZmQ3NmU2YWM2ZDE3ZmVmgTRtHQ==: --dhchap-ctrl-secret DHHC-1:01:YmQ3ZDA4NWFiYjI3YjdjNWVjMzc4NDNiZTM4ZTU3N2a6gUZi: 00:17:10.379 11:28:05 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@36 -- # nvme connect -t tcp -a 10.0.0.3 -n nqn.2024-03.io.spdk:cnode0 -i 1 -q nqn.2014-08.org.nvmexpress:uuid:c758a4ed-f09f-4c82-9afb-3d096f035464 --hostid c758a4ed-f09f-4c82-9afb-3d096f035464 -l 0 --dhchap-secret DHHC-1:02:YjZiMDU3YTg1ZTA0NWQzMGY1ZWM0YzNmYzc1NDY1OWNkZmQ3NmU2YWM2ZDE3ZmVmgTRtHQ==: --dhchap-ctrl-secret DHHC-1:01:YmQ3ZDA4NWFiYjI3YjdjNWVjMzc4NDNiZTM4ZTU3N2a6gUZi: 00:17:10.962 11:28:06 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@82 -- # nvme disconnect -n nqn.2024-03.io.spdk:cnode0 00:17:10.962 NQN:nqn.2024-03.io.spdk:cnode0 disconnected 1 controller(s) 00:17:10.962 11:28:06 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@83 -- # rpc_cmd nvmf_subsystem_remove_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:c758a4ed-f09f-4c82-9afb-3d096f035464 00:17:10.962 11:28:06 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:17:10.962 11:28:06 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:17:10.962 11:28:06 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:17:10.962 11:28:06 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@120 -- # for keyid in "${!keys[@]}" 00:17:10.962 11:28:06 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@121 -- # hostrpc bdev_nvme_set_options --dhchap-digests sha384 --dhchap-dhgroups null 00:17:10.962 11:28:06 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_set_options --dhchap-digests sha384 --dhchap-dhgroups null 00:17:11.220 11:28:06 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@123 -- # connect_authenticate sha384 null 3 00:17:11.220 11:28:06 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@65 -- # local digest dhgroup key ckey qpairs 00:17:11.220 11:28:06 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # digest=sha384 00:17:11.220 11:28:06 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # dhgroup=null 00:17:11.220 11:28:06 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # key=key3 00:17:11.220 11:28:06 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@68 -- # ckey=(${ckeys[$3]:+--dhchap-ctrlr-key "ckey$3"}) 00:17:11.220 11:28:06 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@70 -- # rpc_cmd nvmf_subsystem_add_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:c758a4ed-f09f-4c82-9afb-3d096f035464 --dhchap-key key3 00:17:11.220 11:28:06 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:17:11.220 11:28:06 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:17:11.478 11:28:06 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:17:11.478 11:28:06 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@71 -- # bdev_connect -b nvme0 --dhchap-key key3 00:17:11.478 11:28:06 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@60 -- # hostrpc bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.3 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:c758a4ed-f09f-4c82-9afb-3d096f035464 -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key3 00:17:11.478 11:28:06 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.3 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:c758a4ed-f09f-4c82-9afb-3d096f035464 -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key3 00:17:11.736 00:17:11.736 11:28:07 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # hostrpc bdev_nvme_get_controllers 00:17:11.736 11:28:07 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_get_controllers 00:17:11.736 11:28:07 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # jq -r '.[].name' 00:17:11.994 11:28:07 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:17:11.994 11:28:07 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@74 -- # rpc_cmd nvmf_subsystem_get_qpairs nqn.2024-03.io.spdk:cnode0 00:17:11.994 11:28:07 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:17:11.994 11:28:07 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:17:11.994 11:28:07 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:17:11.994 11:28:07 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@74 -- # qpairs='[ 00:17:11.994 { 00:17:11.994 "auth": { 00:17:11.994 "dhgroup": "null", 00:17:11.994 "digest": "sha384", 00:17:11.994 "state": "completed" 00:17:11.994 }, 00:17:11.994 "cntlid": 55, 00:17:11.994 "hostnqn": "nqn.2014-08.org.nvmexpress:uuid:c758a4ed-f09f-4c82-9afb-3d096f035464", 00:17:11.994 "listen_address": { 00:17:11.994 "adrfam": "IPv4", 00:17:11.994 "traddr": "10.0.0.3", 00:17:11.994 "trsvcid": "4420", 00:17:11.994 "trtype": "TCP" 00:17:11.994 }, 00:17:11.994 "peer_address": { 00:17:11.994 "adrfam": "IPv4", 00:17:11.994 "traddr": "10.0.0.1", 00:17:11.994 "trsvcid": "46004", 00:17:11.994 "trtype": "TCP" 00:17:11.994 }, 00:17:11.994 "qid": 0, 00:17:11.994 "state": "enabled", 00:17:11.994 "thread": "nvmf_tgt_poll_group_000" 00:17:11.994 } 00:17:11.995 ]' 00:17:11.995 11:28:07 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@75 -- # jq -r '.[0].auth.digest' 00:17:11.995 11:28:07 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@75 -- # [[ sha384 == \s\h\a\3\8\4 ]] 00:17:11.995 11:28:07 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@76 -- # jq -r '.[0].auth.dhgroup' 00:17:11.995 11:28:07 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@76 -- # [[ null == \n\u\l\l ]] 00:17:11.995 11:28:07 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@77 -- # jq -r '.[0].auth.state' 00:17:12.252 11:28:07 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@77 -- # [[ completed == \c\o\m\p\l\e\t\e\d ]] 00:17:12.253 11:28:07 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@78 -- # hostrpc bdev_nvme_detach_controller nvme0 00:17:12.253 11:28:07 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_detach_controller nvme0 00:17:12.510 11:28:07 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@80 -- # nvme_connect --dhchap-secret DHHC-1:03:YjUzYzRlNjQ2N2QwNDQ3ZGZhN2VhODUzYjlkY2I2OWViZWM1NzZiOTJiM2MwNzIxZWVkMmMxOTIzNWE5M2Q4MDbs9Og=: 00:17:12.511 11:28:07 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@36 -- # nvme connect -t tcp -a 10.0.0.3 -n nqn.2024-03.io.spdk:cnode0 -i 1 -q nqn.2014-08.org.nvmexpress:uuid:c758a4ed-f09f-4c82-9afb-3d096f035464 --hostid c758a4ed-f09f-4c82-9afb-3d096f035464 -l 0 --dhchap-secret DHHC-1:03:YjUzYzRlNjQ2N2QwNDQ3ZGZhN2VhODUzYjlkY2I2OWViZWM1NzZiOTJiM2MwNzIxZWVkMmMxOTIzNWE5M2Q4MDbs9Og=: 00:17:13.076 11:28:08 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@82 -- # nvme disconnect -n nqn.2024-03.io.spdk:cnode0 00:17:13.076 NQN:nqn.2024-03.io.spdk:cnode0 disconnected 1 controller(s) 00:17:13.076 11:28:08 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@83 -- # rpc_cmd nvmf_subsystem_remove_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:c758a4ed-f09f-4c82-9afb-3d096f035464 00:17:13.076 11:28:08 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:17:13.076 11:28:08 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:17:13.076 11:28:08 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:17:13.076 11:28:08 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@119 -- # for dhgroup in "${dhgroups[@]}" 00:17:13.076 11:28:08 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@120 -- # for keyid in "${!keys[@]}" 00:17:13.076 11:28:08 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@121 -- # hostrpc bdev_nvme_set_options --dhchap-digests sha384 --dhchap-dhgroups ffdhe2048 00:17:13.076 11:28:08 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_set_options --dhchap-digests sha384 --dhchap-dhgroups ffdhe2048 00:17:13.643 11:28:08 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@123 -- # connect_authenticate sha384 ffdhe2048 0 00:17:13.643 11:28:08 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@65 -- # local digest dhgroup key ckey qpairs 00:17:13.643 11:28:08 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # digest=sha384 00:17:13.643 11:28:08 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # dhgroup=ffdhe2048 00:17:13.643 11:28:08 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # key=key0 00:17:13.643 11:28:08 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@68 -- # ckey=(${ckeys[$3]:+--dhchap-ctrlr-key "ckey$3"}) 00:17:13.643 11:28:08 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@70 -- # rpc_cmd nvmf_subsystem_add_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:c758a4ed-f09f-4c82-9afb-3d096f035464 --dhchap-key key0 --dhchap-ctrlr-key ckey0 00:17:13.643 11:28:08 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:17:13.643 11:28:08 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:17:13.643 11:28:08 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:17:13.643 11:28:08 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@71 -- # bdev_connect -b nvme0 --dhchap-key key0 --dhchap-ctrlr-key ckey0 00:17:13.643 11:28:08 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@60 -- # hostrpc bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.3 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:c758a4ed-f09f-4c82-9afb-3d096f035464 -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key0 --dhchap-ctrlr-key ckey0 00:17:13.643 11:28:08 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.3 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:c758a4ed-f09f-4c82-9afb-3d096f035464 -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key0 --dhchap-ctrlr-key ckey0 00:17:13.902 00:17:13.902 11:28:09 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # hostrpc bdev_nvme_get_controllers 00:17:13.902 11:28:09 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_get_controllers 00:17:13.902 11:28:09 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # jq -r '.[].name' 00:17:14.467 11:28:09 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:17:14.467 11:28:09 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@74 -- # rpc_cmd nvmf_subsystem_get_qpairs nqn.2024-03.io.spdk:cnode0 00:17:14.467 11:28:09 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:17:14.467 11:28:09 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:17:14.467 11:28:09 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:17:14.467 11:28:09 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@74 -- # qpairs='[ 00:17:14.467 { 00:17:14.467 "auth": { 00:17:14.467 "dhgroup": "ffdhe2048", 00:17:14.467 "digest": "sha384", 00:17:14.467 "state": "completed" 00:17:14.467 }, 00:17:14.467 "cntlid": 57, 00:17:14.467 "hostnqn": "nqn.2014-08.org.nvmexpress:uuid:c758a4ed-f09f-4c82-9afb-3d096f035464", 00:17:14.467 "listen_address": { 00:17:14.467 "adrfam": "IPv4", 00:17:14.467 "traddr": "10.0.0.3", 00:17:14.467 "trsvcid": "4420", 00:17:14.467 "trtype": "TCP" 00:17:14.467 }, 00:17:14.467 "peer_address": { 00:17:14.467 "adrfam": "IPv4", 00:17:14.467 "traddr": "10.0.0.1", 00:17:14.467 "trsvcid": "46042", 00:17:14.467 "trtype": "TCP" 00:17:14.467 }, 00:17:14.467 "qid": 0, 00:17:14.467 "state": "enabled", 00:17:14.467 "thread": "nvmf_tgt_poll_group_000" 00:17:14.467 } 00:17:14.467 ]' 00:17:14.467 11:28:09 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@75 -- # jq -r '.[0].auth.digest' 00:17:14.467 11:28:09 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@75 -- # [[ sha384 == \s\h\a\3\8\4 ]] 00:17:14.467 11:28:09 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@76 -- # jq -r '.[0].auth.dhgroup' 00:17:14.467 11:28:09 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@76 -- # [[ ffdhe2048 == \f\f\d\h\e\2\0\4\8 ]] 00:17:14.467 11:28:09 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@77 -- # jq -r '.[0].auth.state' 00:17:14.467 11:28:09 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@77 -- # [[ completed == \c\o\m\p\l\e\t\e\d ]] 00:17:14.467 11:28:09 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@78 -- # hostrpc bdev_nvme_detach_controller nvme0 00:17:14.467 11:28:09 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_detach_controller nvme0 00:17:14.725 11:28:10 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@80 -- # nvme_connect --dhchap-secret DHHC-1:00:YTQ3MDY2OWMxZDcwN2QyZmRhNGVmYjYzYTczYTM4NzAwYjdiNTBmZmE2ZDBlZTc28YG94Q==: --dhchap-ctrl-secret DHHC-1:03:YmY1NDQyMjdhMGU5ZDk3NGFiYTIyMTE1OTgzNGQ4ZDQ0MTE3YmFjMTc3MGQ4NDRlOTU5MThlODc5YzUxNGM2Y9nOg8I=: 00:17:14.725 11:28:10 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@36 -- # nvme connect -t tcp -a 10.0.0.3 -n nqn.2024-03.io.spdk:cnode0 -i 1 -q nqn.2014-08.org.nvmexpress:uuid:c758a4ed-f09f-4c82-9afb-3d096f035464 --hostid c758a4ed-f09f-4c82-9afb-3d096f035464 -l 0 --dhchap-secret DHHC-1:00:YTQ3MDY2OWMxZDcwN2QyZmRhNGVmYjYzYTczYTM4NzAwYjdiNTBmZmE2ZDBlZTc28YG94Q==: --dhchap-ctrl-secret DHHC-1:03:YmY1NDQyMjdhMGU5ZDk3NGFiYTIyMTE1OTgzNGQ4ZDQ0MTE3YmFjMTc3MGQ4NDRlOTU5MThlODc5YzUxNGM2Y9nOg8I=: 00:17:15.660 11:28:10 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@82 -- # nvme disconnect -n nqn.2024-03.io.spdk:cnode0 00:17:15.660 NQN:nqn.2024-03.io.spdk:cnode0 disconnected 1 controller(s) 00:17:15.660 11:28:10 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@83 -- # rpc_cmd nvmf_subsystem_remove_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:c758a4ed-f09f-4c82-9afb-3d096f035464 00:17:15.660 11:28:10 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:17:15.660 11:28:10 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:17:15.660 11:28:10 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:17:15.660 11:28:10 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@120 -- # for keyid in "${!keys[@]}" 00:17:15.660 11:28:10 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@121 -- # hostrpc bdev_nvme_set_options --dhchap-digests sha384 --dhchap-dhgroups ffdhe2048 00:17:15.660 11:28:10 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_set_options --dhchap-digests sha384 --dhchap-dhgroups ffdhe2048 00:17:15.919 11:28:11 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@123 -- # connect_authenticate sha384 ffdhe2048 1 00:17:15.919 11:28:11 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@65 -- # local digest dhgroup key ckey qpairs 00:17:15.919 11:28:11 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # digest=sha384 00:17:15.919 11:28:11 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # dhgroup=ffdhe2048 00:17:15.919 11:28:11 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # key=key1 00:17:15.919 11:28:11 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@68 -- # ckey=(${ckeys[$3]:+--dhchap-ctrlr-key "ckey$3"}) 00:17:15.919 11:28:11 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@70 -- # rpc_cmd nvmf_subsystem_add_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:c758a4ed-f09f-4c82-9afb-3d096f035464 --dhchap-key key1 --dhchap-ctrlr-key ckey1 00:17:15.919 11:28:11 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:17:15.919 11:28:11 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:17:15.919 11:28:11 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:17:15.919 11:28:11 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@71 -- # bdev_connect -b nvme0 --dhchap-key key1 --dhchap-ctrlr-key ckey1 00:17:15.919 11:28:11 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@60 -- # hostrpc bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.3 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:c758a4ed-f09f-4c82-9afb-3d096f035464 -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key1 --dhchap-ctrlr-key ckey1 00:17:15.919 11:28:11 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.3 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:c758a4ed-f09f-4c82-9afb-3d096f035464 -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key1 --dhchap-ctrlr-key ckey1 00:17:16.489 00:17:16.489 11:28:11 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # jq -r '.[].name' 00:17:16.489 11:28:11 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # hostrpc bdev_nvme_get_controllers 00:17:16.489 11:28:11 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_get_controllers 00:17:16.747 11:28:12 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:17:16.747 11:28:12 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@74 -- # rpc_cmd nvmf_subsystem_get_qpairs nqn.2024-03.io.spdk:cnode0 00:17:16.747 11:28:12 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:17:16.747 11:28:12 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:17:16.747 11:28:12 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:17:16.747 11:28:12 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@74 -- # qpairs='[ 00:17:16.747 { 00:17:16.747 "auth": { 00:17:16.747 "dhgroup": "ffdhe2048", 00:17:16.748 "digest": "sha384", 00:17:16.748 "state": "completed" 00:17:16.748 }, 00:17:16.748 "cntlid": 59, 00:17:16.748 "hostnqn": "nqn.2014-08.org.nvmexpress:uuid:c758a4ed-f09f-4c82-9afb-3d096f035464", 00:17:16.748 "listen_address": { 00:17:16.748 "adrfam": "IPv4", 00:17:16.748 "traddr": "10.0.0.3", 00:17:16.748 "trsvcid": "4420", 00:17:16.748 "trtype": "TCP" 00:17:16.748 }, 00:17:16.748 "peer_address": { 00:17:16.748 "adrfam": "IPv4", 00:17:16.748 "traddr": "10.0.0.1", 00:17:16.748 "trsvcid": "46082", 00:17:16.748 "trtype": "TCP" 00:17:16.748 }, 00:17:16.748 "qid": 0, 00:17:16.748 "state": "enabled", 00:17:16.748 "thread": "nvmf_tgt_poll_group_000" 00:17:16.748 } 00:17:16.748 ]' 00:17:16.748 11:28:12 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@75 -- # jq -r '.[0].auth.digest' 00:17:16.748 11:28:12 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@75 -- # [[ sha384 == \s\h\a\3\8\4 ]] 00:17:16.748 11:28:12 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@76 -- # jq -r '.[0].auth.dhgroup' 00:17:16.748 11:28:12 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@76 -- # [[ ffdhe2048 == \f\f\d\h\e\2\0\4\8 ]] 00:17:16.748 11:28:12 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@77 -- # jq -r '.[0].auth.state' 00:17:16.748 11:28:12 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@77 -- # [[ completed == \c\o\m\p\l\e\t\e\d ]] 00:17:16.748 11:28:12 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@78 -- # hostrpc bdev_nvme_detach_controller nvme0 00:17:16.748 11:28:12 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_detach_controller nvme0 00:17:17.005 11:28:12 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@80 -- # nvme_connect --dhchap-secret DHHC-1:01:YTU2ZTRiMDFkMzNiMjFmN2QwNTBiYjliMGJkYjQwZTTsDgGm: --dhchap-ctrl-secret DHHC-1:02:ZjZjOWFiZGJhYjc3NzkxOGQwNGZmNTA0MTE0MjkzYmVkODZmYTJjNzcyZDM2NjYxWbIiww==: 00:17:17.005 11:28:12 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@36 -- # nvme connect -t tcp -a 10.0.0.3 -n nqn.2024-03.io.spdk:cnode0 -i 1 -q nqn.2014-08.org.nvmexpress:uuid:c758a4ed-f09f-4c82-9afb-3d096f035464 --hostid c758a4ed-f09f-4c82-9afb-3d096f035464 -l 0 --dhchap-secret DHHC-1:01:YTU2ZTRiMDFkMzNiMjFmN2QwNTBiYjliMGJkYjQwZTTsDgGm: --dhchap-ctrl-secret DHHC-1:02:ZjZjOWFiZGJhYjc3NzkxOGQwNGZmNTA0MTE0MjkzYmVkODZmYTJjNzcyZDM2NjYxWbIiww==: 00:17:17.939 11:28:13 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@82 -- # nvme disconnect -n nqn.2024-03.io.spdk:cnode0 00:17:17.939 NQN:nqn.2024-03.io.spdk:cnode0 disconnected 1 controller(s) 00:17:17.939 11:28:13 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@83 -- # rpc_cmd nvmf_subsystem_remove_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:c758a4ed-f09f-4c82-9afb-3d096f035464 00:17:17.939 11:28:13 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:17:17.939 11:28:13 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:17:17.939 11:28:13 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:17:17.939 11:28:13 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@120 -- # for keyid in "${!keys[@]}" 00:17:17.939 11:28:13 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@121 -- # hostrpc bdev_nvme_set_options --dhchap-digests sha384 --dhchap-dhgroups ffdhe2048 00:17:17.939 11:28:13 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_set_options --dhchap-digests sha384 --dhchap-dhgroups ffdhe2048 00:17:18.197 11:28:13 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@123 -- # connect_authenticate sha384 ffdhe2048 2 00:17:18.197 11:28:13 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@65 -- # local digest dhgroup key ckey qpairs 00:17:18.197 11:28:13 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # digest=sha384 00:17:18.197 11:28:13 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # dhgroup=ffdhe2048 00:17:18.197 11:28:13 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # key=key2 00:17:18.197 11:28:13 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@68 -- # ckey=(${ckeys[$3]:+--dhchap-ctrlr-key "ckey$3"}) 00:17:18.197 11:28:13 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@70 -- # rpc_cmd nvmf_subsystem_add_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:c758a4ed-f09f-4c82-9afb-3d096f035464 --dhchap-key key2 --dhchap-ctrlr-key ckey2 00:17:18.197 11:28:13 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:17:18.197 11:28:13 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:17:18.197 11:28:13 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:17:18.197 11:28:13 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@71 -- # bdev_connect -b nvme0 --dhchap-key key2 --dhchap-ctrlr-key ckey2 00:17:18.197 11:28:13 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@60 -- # hostrpc bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.3 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:c758a4ed-f09f-4c82-9afb-3d096f035464 -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key2 --dhchap-ctrlr-key ckey2 00:17:18.197 11:28:13 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.3 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:c758a4ed-f09f-4c82-9afb-3d096f035464 -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key2 --dhchap-ctrlr-key ckey2 00:17:18.456 00:17:18.456 11:28:13 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # hostrpc bdev_nvme_get_controllers 00:17:18.456 11:28:13 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_get_controllers 00:17:18.456 11:28:13 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # jq -r '.[].name' 00:17:18.714 11:28:14 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:17:18.714 11:28:14 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@74 -- # rpc_cmd nvmf_subsystem_get_qpairs nqn.2024-03.io.spdk:cnode0 00:17:18.714 11:28:14 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:17:18.714 11:28:14 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:17:18.714 11:28:14 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:17:18.714 11:28:14 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@74 -- # qpairs='[ 00:17:18.714 { 00:17:18.714 "auth": { 00:17:18.714 "dhgroup": "ffdhe2048", 00:17:18.714 "digest": "sha384", 00:17:18.714 "state": "completed" 00:17:18.714 }, 00:17:18.714 "cntlid": 61, 00:17:18.714 "hostnqn": "nqn.2014-08.org.nvmexpress:uuid:c758a4ed-f09f-4c82-9afb-3d096f035464", 00:17:18.714 "listen_address": { 00:17:18.714 "adrfam": "IPv4", 00:17:18.714 "traddr": "10.0.0.3", 00:17:18.714 "trsvcid": "4420", 00:17:18.714 "trtype": "TCP" 00:17:18.714 }, 00:17:18.714 "peer_address": { 00:17:18.714 "adrfam": "IPv4", 00:17:18.714 "traddr": "10.0.0.1", 00:17:18.714 "trsvcid": "50910", 00:17:18.714 "trtype": "TCP" 00:17:18.714 }, 00:17:18.714 "qid": 0, 00:17:18.714 "state": "enabled", 00:17:18.714 "thread": "nvmf_tgt_poll_group_000" 00:17:18.714 } 00:17:18.714 ]' 00:17:18.714 11:28:14 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@75 -- # jq -r '.[0].auth.digest' 00:17:18.972 11:28:14 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@75 -- # [[ sha384 == \s\h\a\3\8\4 ]] 00:17:18.972 11:28:14 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@76 -- # jq -r '.[0].auth.dhgroup' 00:17:18.972 11:28:14 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@76 -- # [[ ffdhe2048 == \f\f\d\h\e\2\0\4\8 ]] 00:17:18.972 11:28:14 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@77 -- # jq -r '.[0].auth.state' 00:17:18.972 11:28:14 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@77 -- # [[ completed == \c\o\m\p\l\e\t\e\d ]] 00:17:18.972 11:28:14 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@78 -- # hostrpc bdev_nvme_detach_controller nvme0 00:17:18.972 11:28:14 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_detach_controller nvme0 00:17:19.229 11:28:14 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@80 -- # nvme_connect --dhchap-secret DHHC-1:02:YjZiMDU3YTg1ZTA0NWQzMGY1ZWM0YzNmYzc1NDY1OWNkZmQ3NmU2YWM2ZDE3ZmVmgTRtHQ==: --dhchap-ctrl-secret DHHC-1:01:YmQ3ZDA4NWFiYjI3YjdjNWVjMzc4NDNiZTM4ZTU3N2a6gUZi: 00:17:19.230 11:28:14 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@36 -- # nvme connect -t tcp -a 10.0.0.3 -n nqn.2024-03.io.spdk:cnode0 -i 1 -q nqn.2014-08.org.nvmexpress:uuid:c758a4ed-f09f-4c82-9afb-3d096f035464 --hostid c758a4ed-f09f-4c82-9afb-3d096f035464 -l 0 --dhchap-secret DHHC-1:02:YjZiMDU3YTg1ZTA0NWQzMGY1ZWM0YzNmYzc1NDY1OWNkZmQ3NmU2YWM2ZDE3ZmVmgTRtHQ==: --dhchap-ctrl-secret DHHC-1:01:YmQ3ZDA4NWFiYjI3YjdjNWVjMzc4NDNiZTM4ZTU3N2a6gUZi: 00:17:20.164 11:28:15 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@82 -- # nvme disconnect -n nqn.2024-03.io.spdk:cnode0 00:17:20.164 NQN:nqn.2024-03.io.spdk:cnode0 disconnected 1 controller(s) 00:17:20.164 11:28:15 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@83 -- # rpc_cmd nvmf_subsystem_remove_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:c758a4ed-f09f-4c82-9afb-3d096f035464 00:17:20.164 11:28:15 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:17:20.164 11:28:15 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:17:20.164 11:28:15 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:17:20.164 11:28:15 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@120 -- # for keyid in "${!keys[@]}" 00:17:20.164 11:28:15 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@121 -- # hostrpc bdev_nvme_set_options --dhchap-digests sha384 --dhchap-dhgroups ffdhe2048 00:17:20.164 11:28:15 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_set_options --dhchap-digests sha384 --dhchap-dhgroups ffdhe2048 00:17:20.422 11:28:15 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@123 -- # connect_authenticate sha384 ffdhe2048 3 00:17:20.422 11:28:15 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@65 -- # local digest dhgroup key ckey qpairs 00:17:20.422 11:28:15 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # digest=sha384 00:17:20.422 11:28:15 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # dhgroup=ffdhe2048 00:17:20.422 11:28:15 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # key=key3 00:17:20.422 11:28:15 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@68 -- # ckey=(${ckeys[$3]:+--dhchap-ctrlr-key "ckey$3"}) 00:17:20.422 11:28:15 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@70 -- # rpc_cmd nvmf_subsystem_add_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:c758a4ed-f09f-4c82-9afb-3d096f035464 --dhchap-key key3 00:17:20.422 11:28:15 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:17:20.422 11:28:15 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:17:20.422 11:28:15 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:17:20.422 11:28:15 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@71 -- # bdev_connect -b nvme0 --dhchap-key key3 00:17:20.422 11:28:15 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@60 -- # hostrpc bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.3 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:c758a4ed-f09f-4c82-9afb-3d096f035464 -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key3 00:17:20.422 11:28:15 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.3 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:c758a4ed-f09f-4c82-9afb-3d096f035464 -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key3 00:17:20.680 00:17:20.938 11:28:16 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # hostrpc bdev_nvme_get_controllers 00:17:20.938 11:28:16 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # jq -r '.[].name' 00:17:20.938 11:28:16 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_get_controllers 00:17:21.196 11:28:16 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:17:21.196 11:28:16 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@74 -- # rpc_cmd nvmf_subsystem_get_qpairs nqn.2024-03.io.spdk:cnode0 00:17:21.196 11:28:16 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:17:21.196 11:28:16 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:17:21.196 11:28:16 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:17:21.196 11:28:16 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@74 -- # qpairs='[ 00:17:21.196 { 00:17:21.196 "auth": { 00:17:21.196 "dhgroup": "ffdhe2048", 00:17:21.196 "digest": "sha384", 00:17:21.196 "state": "completed" 00:17:21.196 }, 00:17:21.196 "cntlid": 63, 00:17:21.196 "hostnqn": "nqn.2014-08.org.nvmexpress:uuid:c758a4ed-f09f-4c82-9afb-3d096f035464", 00:17:21.196 "listen_address": { 00:17:21.196 "adrfam": "IPv4", 00:17:21.196 "traddr": "10.0.0.3", 00:17:21.196 "trsvcid": "4420", 00:17:21.196 "trtype": "TCP" 00:17:21.196 }, 00:17:21.196 "peer_address": { 00:17:21.196 "adrfam": "IPv4", 00:17:21.196 "traddr": "10.0.0.1", 00:17:21.196 "trsvcid": "50946", 00:17:21.196 "trtype": "TCP" 00:17:21.196 }, 00:17:21.196 "qid": 0, 00:17:21.196 "state": "enabled", 00:17:21.196 "thread": "nvmf_tgt_poll_group_000" 00:17:21.196 } 00:17:21.196 ]' 00:17:21.196 11:28:16 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@75 -- # jq -r '.[0].auth.digest' 00:17:21.196 11:28:16 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@75 -- # [[ sha384 == \s\h\a\3\8\4 ]] 00:17:21.196 11:28:16 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@76 -- # jq -r '.[0].auth.dhgroup' 00:17:21.196 11:28:16 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@76 -- # [[ ffdhe2048 == \f\f\d\h\e\2\0\4\8 ]] 00:17:21.196 11:28:16 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@77 -- # jq -r '.[0].auth.state' 00:17:21.196 11:28:16 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@77 -- # [[ completed == \c\o\m\p\l\e\t\e\d ]] 00:17:21.196 11:28:16 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@78 -- # hostrpc bdev_nvme_detach_controller nvme0 00:17:21.196 11:28:16 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_detach_controller nvme0 00:17:21.762 11:28:17 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@80 -- # nvme_connect --dhchap-secret DHHC-1:03:YjUzYzRlNjQ2N2QwNDQ3ZGZhN2VhODUzYjlkY2I2OWViZWM1NzZiOTJiM2MwNzIxZWVkMmMxOTIzNWE5M2Q4MDbs9Og=: 00:17:21.762 11:28:17 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@36 -- # nvme connect -t tcp -a 10.0.0.3 -n nqn.2024-03.io.spdk:cnode0 -i 1 -q nqn.2014-08.org.nvmexpress:uuid:c758a4ed-f09f-4c82-9afb-3d096f035464 --hostid c758a4ed-f09f-4c82-9afb-3d096f035464 -l 0 --dhchap-secret DHHC-1:03:YjUzYzRlNjQ2N2QwNDQ3ZGZhN2VhODUzYjlkY2I2OWViZWM1NzZiOTJiM2MwNzIxZWVkMmMxOTIzNWE5M2Q4MDbs9Og=: 00:17:22.329 11:28:17 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@82 -- # nvme disconnect -n nqn.2024-03.io.spdk:cnode0 00:17:22.329 NQN:nqn.2024-03.io.spdk:cnode0 disconnected 1 controller(s) 00:17:22.329 11:28:17 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@83 -- # rpc_cmd nvmf_subsystem_remove_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:c758a4ed-f09f-4c82-9afb-3d096f035464 00:17:22.329 11:28:17 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:17:22.329 11:28:17 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:17:22.329 11:28:17 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:17:22.329 11:28:17 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@119 -- # for dhgroup in "${dhgroups[@]}" 00:17:22.329 11:28:17 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@120 -- # for keyid in "${!keys[@]}" 00:17:22.329 11:28:17 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@121 -- # hostrpc bdev_nvme_set_options --dhchap-digests sha384 --dhchap-dhgroups ffdhe3072 00:17:22.329 11:28:17 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_set_options --dhchap-digests sha384 --dhchap-dhgroups ffdhe3072 00:17:22.895 11:28:18 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@123 -- # connect_authenticate sha384 ffdhe3072 0 00:17:22.895 11:28:18 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@65 -- # local digest dhgroup key ckey qpairs 00:17:22.895 11:28:18 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # digest=sha384 00:17:22.895 11:28:18 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # dhgroup=ffdhe3072 00:17:22.895 11:28:18 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # key=key0 00:17:22.895 11:28:18 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@68 -- # ckey=(${ckeys[$3]:+--dhchap-ctrlr-key "ckey$3"}) 00:17:22.895 11:28:18 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@70 -- # rpc_cmd nvmf_subsystem_add_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:c758a4ed-f09f-4c82-9afb-3d096f035464 --dhchap-key key0 --dhchap-ctrlr-key ckey0 00:17:22.895 11:28:18 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:17:22.895 11:28:18 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:17:22.895 11:28:18 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:17:22.895 11:28:18 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@71 -- # bdev_connect -b nvme0 --dhchap-key key0 --dhchap-ctrlr-key ckey0 00:17:22.895 11:28:18 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@60 -- # hostrpc bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.3 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:c758a4ed-f09f-4c82-9afb-3d096f035464 -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key0 --dhchap-ctrlr-key ckey0 00:17:22.895 11:28:18 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.3 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:c758a4ed-f09f-4c82-9afb-3d096f035464 -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key0 --dhchap-ctrlr-key ckey0 00:17:23.153 00:17:23.153 11:28:18 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # hostrpc bdev_nvme_get_controllers 00:17:23.153 11:28:18 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_get_controllers 00:17:23.153 11:28:18 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # jq -r '.[].name' 00:17:23.410 11:28:18 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:17:23.410 11:28:18 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@74 -- # rpc_cmd nvmf_subsystem_get_qpairs nqn.2024-03.io.spdk:cnode0 00:17:23.410 11:28:18 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:17:23.410 11:28:18 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:17:23.410 11:28:18 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:17:23.410 11:28:18 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@74 -- # qpairs='[ 00:17:23.410 { 00:17:23.410 "auth": { 00:17:23.410 "dhgroup": "ffdhe3072", 00:17:23.410 "digest": "sha384", 00:17:23.410 "state": "completed" 00:17:23.410 }, 00:17:23.410 "cntlid": 65, 00:17:23.410 "hostnqn": "nqn.2014-08.org.nvmexpress:uuid:c758a4ed-f09f-4c82-9afb-3d096f035464", 00:17:23.410 "listen_address": { 00:17:23.410 "adrfam": "IPv4", 00:17:23.410 "traddr": "10.0.0.3", 00:17:23.410 "trsvcid": "4420", 00:17:23.410 "trtype": "TCP" 00:17:23.410 }, 00:17:23.410 "peer_address": { 00:17:23.410 "adrfam": "IPv4", 00:17:23.410 "traddr": "10.0.0.1", 00:17:23.410 "trsvcid": "50956", 00:17:23.410 "trtype": "TCP" 00:17:23.410 }, 00:17:23.410 "qid": 0, 00:17:23.410 "state": "enabled", 00:17:23.410 "thread": "nvmf_tgt_poll_group_000" 00:17:23.410 } 00:17:23.410 ]' 00:17:23.410 11:28:18 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@75 -- # jq -r '.[0].auth.digest' 00:17:23.667 11:28:18 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@75 -- # [[ sha384 == \s\h\a\3\8\4 ]] 00:17:23.667 11:28:18 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@76 -- # jq -r '.[0].auth.dhgroup' 00:17:23.667 11:28:19 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@76 -- # [[ ffdhe3072 == \f\f\d\h\e\3\0\7\2 ]] 00:17:23.667 11:28:19 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@77 -- # jq -r '.[0].auth.state' 00:17:23.667 11:28:19 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@77 -- # [[ completed == \c\o\m\p\l\e\t\e\d ]] 00:17:23.667 11:28:19 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@78 -- # hostrpc bdev_nvme_detach_controller nvme0 00:17:23.667 11:28:19 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_detach_controller nvme0 00:17:23.924 11:28:19 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@80 -- # nvme_connect --dhchap-secret DHHC-1:00:YTQ3MDY2OWMxZDcwN2QyZmRhNGVmYjYzYTczYTM4NzAwYjdiNTBmZmE2ZDBlZTc28YG94Q==: --dhchap-ctrl-secret DHHC-1:03:YmY1NDQyMjdhMGU5ZDk3NGFiYTIyMTE1OTgzNGQ4ZDQ0MTE3YmFjMTc3MGQ4NDRlOTU5MThlODc5YzUxNGM2Y9nOg8I=: 00:17:23.924 11:28:19 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@36 -- # nvme connect -t tcp -a 10.0.0.3 -n nqn.2024-03.io.spdk:cnode0 -i 1 -q nqn.2014-08.org.nvmexpress:uuid:c758a4ed-f09f-4c82-9afb-3d096f035464 --hostid c758a4ed-f09f-4c82-9afb-3d096f035464 -l 0 --dhchap-secret DHHC-1:00:YTQ3MDY2OWMxZDcwN2QyZmRhNGVmYjYzYTczYTM4NzAwYjdiNTBmZmE2ZDBlZTc28YG94Q==: --dhchap-ctrl-secret DHHC-1:03:YmY1NDQyMjdhMGU5ZDk3NGFiYTIyMTE1OTgzNGQ4ZDQ0MTE3YmFjMTc3MGQ4NDRlOTU5MThlODc5YzUxNGM2Y9nOg8I=: 00:17:24.857 11:28:20 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@82 -- # nvme disconnect -n nqn.2024-03.io.spdk:cnode0 00:17:24.857 NQN:nqn.2024-03.io.spdk:cnode0 disconnected 1 controller(s) 00:17:24.857 11:28:20 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@83 -- # rpc_cmd nvmf_subsystem_remove_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:c758a4ed-f09f-4c82-9afb-3d096f035464 00:17:24.857 11:28:20 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:17:24.857 11:28:20 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:17:24.857 11:28:20 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:17:24.857 11:28:20 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@120 -- # for keyid in "${!keys[@]}" 00:17:24.857 11:28:20 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@121 -- # hostrpc bdev_nvme_set_options --dhchap-digests sha384 --dhchap-dhgroups ffdhe3072 00:17:24.857 11:28:20 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_set_options --dhchap-digests sha384 --dhchap-dhgroups ffdhe3072 00:17:25.115 11:28:20 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@123 -- # connect_authenticate sha384 ffdhe3072 1 00:17:25.115 11:28:20 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@65 -- # local digest dhgroup key ckey qpairs 00:17:25.115 11:28:20 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # digest=sha384 00:17:25.115 11:28:20 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # dhgroup=ffdhe3072 00:17:25.115 11:28:20 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # key=key1 00:17:25.115 11:28:20 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@68 -- # ckey=(${ckeys[$3]:+--dhchap-ctrlr-key "ckey$3"}) 00:17:25.115 11:28:20 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@70 -- # rpc_cmd nvmf_subsystem_add_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:c758a4ed-f09f-4c82-9afb-3d096f035464 --dhchap-key key1 --dhchap-ctrlr-key ckey1 00:17:25.115 11:28:20 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:17:25.115 11:28:20 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:17:25.115 11:28:20 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:17:25.115 11:28:20 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@71 -- # bdev_connect -b nvme0 --dhchap-key key1 --dhchap-ctrlr-key ckey1 00:17:25.115 11:28:20 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@60 -- # hostrpc bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.3 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:c758a4ed-f09f-4c82-9afb-3d096f035464 -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key1 --dhchap-ctrlr-key ckey1 00:17:25.115 11:28:20 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.3 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:c758a4ed-f09f-4c82-9afb-3d096f035464 -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key1 --dhchap-ctrlr-key ckey1 00:17:25.728 00:17:25.728 11:28:20 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # jq -r '.[].name' 00:17:25.728 11:28:20 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # hostrpc bdev_nvme_get_controllers 00:17:25.728 11:28:20 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_get_controllers 00:17:25.728 11:28:21 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:17:25.728 11:28:21 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@74 -- # rpc_cmd nvmf_subsystem_get_qpairs nqn.2024-03.io.spdk:cnode0 00:17:25.728 11:28:21 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:17:25.728 11:28:21 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:17:25.728 11:28:21 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:17:25.728 11:28:21 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@74 -- # qpairs='[ 00:17:25.728 { 00:17:25.728 "auth": { 00:17:25.728 "dhgroup": "ffdhe3072", 00:17:25.728 "digest": "sha384", 00:17:25.728 "state": "completed" 00:17:25.728 }, 00:17:25.728 "cntlid": 67, 00:17:25.728 "hostnqn": "nqn.2014-08.org.nvmexpress:uuid:c758a4ed-f09f-4c82-9afb-3d096f035464", 00:17:25.728 "listen_address": { 00:17:25.728 "adrfam": "IPv4", 00:17:25.728 "traddr": "10.0.0.3", 00:17:25.728 "trsvcid": "4420", 00:17:25.728 "trtype": "TCP" 00:17:25.728 }, 00:17:25.728 "peer_address": { 00:17:25.728 "adrfam": "IPv4", 00:17:25.728 "traddr": "10.0.0.1", 00:17:25.728 "trsvcid": "50976", 00:17:25.728 "trtype": "TCP" 00:17:25.728 }, 00:17:25.728 "qid": 0, 00:17:25.728 "state": "enabled", 00:17:25.728 "thread": "nvmf_tgt_poll_group_000" 00:17:25.728 } 00:17:25.728 ]' 00:17:25.986 11:28:21 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@75 -- # jq -r '.[0].auth.digest' 00:17:25.986 11:28:21 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@75 -- # [[ sha384 == \s\h\a\3\8\4 ]] 00:17:25.986 11:28:21 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@76 -- # jq -r '.[0].auth.dhgroup' 00:17:25.986 11:28:21 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@76 -- # [[ ffdhe3072 == \f\f\d\h\e\3\0\7\2 ]] 00:17:25.986 11:28:21 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@77 -- # jq -r '.[0].auth.state' 00:17:25.986 11:28:21 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@77 -- # [[ completed == \c\o\m\p\l\e\t\e\d ]] 00:17:25.986 11:28:21 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@78 -- # hostrpc bdev_nvme_detach_controller nvme0 00:17:25.986 11:28:21 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_detach_controller nvme0 00:17:26.244 11:28:21 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@80 -- # nvme_connect --dhchap-secret DHHC-1:01:YTU2ZTRiMDFkMzNiMjFmN2QwNTBiYjliMGJkYjQwZTTsDgGm: --dhchap-ctrl-secret DHHC-1:02:ZjZjOWFiZGJhYjc3NzkxOGQwNGZmNTA0MTE0MjkzYmVkODZmYTJjNzcyZDM2NjYxWbIiww==: 00:17:26.244 11:28:21 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@36 -- # nvme connect -t tcp -a 10.0.0.3 -n nqn.2024-03.io.spdk:cnode0 -i 1 -q nqn.2014-08.org.nvmexpress:uuid:c758a4ed-f09f-4c82-9afb-3d096f035464 --hostid c758a4ed-f09f-4c82-9afb-3d096f035464 -l 0 --dhchap-secret DHHC-1:01:YTU2ZTRiMDFkMzNiMjFmN2QwNTBiYjliMGJkYjQwZTTsDgGm: --dhchap-ctrl-secret DHHC-1:02:ZjZjOWFiZGJhYjc3NzkxOGQwNGZmNTA0MTE0MjkzYmVkODZmYTJjNzcyZDM2NjYxWbIiww==: 00:17:27.180 11:28:22 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@82 -- # nvme disconnect -n nqn.2024-03.io.spdk:cnode0 00:17:27.180 NQN:nqn.2024-03.io.spdk:cnode0 disconnected 1 controller(s) 00:17:27.180 11:28:22 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@83 -- # rpc_cmd nvmf_subsystem_remove_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:c758a4ed-f09f-4c82-9afb-3d096f035464 00:17:27.180 11:28:22 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:17:27.180 11:28:22 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:17:27.180 11:28:22 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:17:27.180 11:28:22 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@120 -- # for keyid in "${!keys[@]}" 00:17:27.180 11:28:22 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@121 -- # hostrpc bdev_nvme_set_options --dhchap-digests sha384 --dhchap-dhgroups ffdhe3072 00:17:27.180 11:28:22 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_set_options --dhchap-digests sha384 --dhchap-dhgroups ffdhe3072 00:17:27.439 11:28:22 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@123 -- # connect_authenticate sha384 ffdhe3072 2 00:17:27.439 11:28:22 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@65 -- # local digest dhgroup key ckey qpairs 00:17:27.439 11:28:22 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # digest=sha384 00:17:27.439 11:28:22 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # dhgroup=ffdhe3072 00:17:27.439 11:28:22 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # key=key2 00:17:27.439 11:28:22 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@68 -- # ckey=(${ckeys[$3]:+--dhchap-ctrlr-key "ckey$3"}) 00:17:27.439 11:28:22 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@70 -- # rpc_cmd nvmf_subsystem_add_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:c758a4ed-f09f-4c82-9afb-3d096f035464 --dhchap-key key2 --dhchap-ctrlr-key ckey2 00:17:27.439 11:28:22 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:17:27.439 11:28:22 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:17:27.439 11:28:22 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:17:27.439 11:28:22 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@71 -- # bdev_connect -b nvme0 --dhchap-key key2 --dhchap-ctrlr-key ckey2 00:17:27.439 11:28:22 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@60 -- # hostrpc bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.3 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:c758a4ed-f09f-4c82-9afb-3d096f035464 -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key2 --dhchap-ctrlr-key ckey2 00:17:27.439 11:28:22 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.3 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:c758a4ed-f09f-4c82-9afb-3d096f035464 -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key2 --dhchap-ctrlr-key ckey2 00:17:27.697 00:17:27.697 11:28:23 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # hostrpc bdev_nvme_get_controllers 00:17:27.697 11:28:23 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # jq -r '.[].name' 00:17:27.697 11:28:23 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_get_controllers 00:17:27.955 11:28:23 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:17:27.955 11:28:23 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@74 -- # rpc_cmd nvmf_subsystem_get_qpairs nqn.2024-03.io.spdk:cnode0 00:17:27.955 11:28:23 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:17:27.955 11:28:23 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:17:28.214 11:28:23 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:17:28.214 11:28:23 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@74 -- # qpairs='[ 00:17:28.214 { 00:17:28.214 "auth": { 00:17:28.214 "dhgroup": "ffdhe3072", 00:17:28.214 "digest": "sha384", 00:17:28.214 "state": "completed" 00:17:28.214 }, 00:17:28.214 "cntlid": 69, 00:17:28.214 "hostnqn": "nqn.2014-08.org.nvmexpress:uuid:c758a4ed-f09f-4c82-9afb-3d096f035464", 00:17:28.214 "listen_address": { 00:17:28.214 "adrfam": "IPv4", 00:17:28.214 "traddr": "10.0.0.3", 00:17:28.214 "trsvcid": "4420", 00:17:28.214 "trtype": "TCP" 00:17:28.214 }, 00:17:28.214 "peer_address": { 00:17:28.214 "adrfam": "IPv4", 00:17:28.214 "traddr": "10.0.0.1", 00:17:28.214 "trsvcid": "38602", 00:17:28.214 "trtype": "TCP" 00:17:28.214 }, 00:17:28.214 "qid": 0, 00:17:28.214 "state": "enabled", 00:17:28.214 "thread": "nvmf_tgt_poll_group_000" 00:17:28.214 } 00:17:28.214 ]' 00:17:28.214 11:28:23 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@75 -- # jq -r '.[0].auth.digest' 00:17:28.214 11:28:23 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@75 -- # [[ sha384 == \s\h\a\3\8\4 ]] 00:17:28.214 11:28:23 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@76 -- # jq -r '.[0].auth.dhgroup' 00:17:28.214 11:28:23 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@76 -- # [[ ffdhe3072 == \f\f\d\h\e\3\0\7\2 ]] 00:17:28.214 11:28:23 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@77 -- # jq -r '.[0].auth.state' 00:17:28.214 11:28:23 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@77 -- # [[ completed == \c\o\m\p\l\e\t\e\d ]] 00:17:28.214 11:28:23 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@78 -- # hostrpc bdev_nvme_detach_controller nvme0 00:17:28.214 11:28:23 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_detach_controller nvme0 00:17:28.472 11:28:23 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@80 -- # nvme_connect --dhchap-secret DHHC-1:02:YjZiMDU3YTg1ZTA0NWQzMGY1ZWM0YzNmYzc1NDY1OWNkZmQ3NmU2YWM2ZDE3ZmVmgTRtHQ==: --dhchap-ctrl-secret DHHC-1:01:YmQ3ZDA4NWFiYjI3YjdjNWVjMzc4NDNiZTM4ZTU3N2a6gUZi: 00:17:28.472 11:28:23 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@36 -- # nvme connect -t tcp -a 10.0.0.3 -n nqn.2024-03.io.spdk:cnode0 -i 1 -q nqn.2014-08.org.nvmexpress:uuid:c758a4ed-f09f-4c82-9afb-3d096f035464 --hostid c758a4ed-f09f-4c82-9afb-3d096f035464 -l 0 --dhchap-secret DHHC-1:02:YjZiMDU3YTg1ZTA0NWQzMGY1ZWM0YzNmYzc1NDY1OWNkZmQ3NmU2YWM2ZDE3ZmVmgTRtHQ==: --dhchap-ctrl-secret DHHC-1:01:YmQ3ZDA4NWFiYjI3YjdjNWVjMzc4NDNiZTM4ZTU3N2a6gUZi: 00:17:29.038 11:28:24 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@82 -- # nvme disconnect -n nqn.2024-03.io.spdk:cnode0 00:17:29.308 NQN:nqn.2024-03.io.spdk:cnode0 disconnected 1 controller(s) 00:17:29.308 11:28:24 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@83 -- # rpc_cmd nvmf_subsystem_remove_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:c758a4ed-f09f-4c82-9afb-3d096f035464 00:17:29.308 11:28:24 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:17:29.308 11:28:24 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:17:29.308 11:28:24 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:17:29.308 11:28:24 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@120 -- # for keyid in "${!keys[@]}" 00:17:29.308 11:28:24 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@121 -- # hostrpc bdev_nvme_set_options --dhchap-digests sha384 --dhchap-dhgroups ffdhe3072 00:17:29.308 11:28:24 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_set_options --dhchap-digests sha384 --dhchap-dhgroups ffdhe3072 00:17:29.566 11:28:24 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@123 -- # connect_authenticate sha384 ffdhe3072 3 00:17:29.566 11:28:24 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@65 -- # local digest dhgroup key ckey qpairs 00:17:29.566 11:28:24 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # digest=sha384 00:17:29.567 11:28:24 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # dhgroup=ffdhe3072 00:17:29.567 11:28:24 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # key=key3 00:17:29.567 11:28:24 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@68 -- # ckey=(${ckeys[$3]:+--dhchap-ctrlr-key "ckey$3"}) 00:17:29.567 11:28:24 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@70 -- # rpc_cmd nvmf_subsystem_add_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:c758a4ed-f09f-4c82-9afb-3d096f035464 --dhchap-key key3 00:17:29.567 11:28:24 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:17:29.567 11:28:24 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:17:29.567 11:28:24 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:17:29.567 11:28:24 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@71 -- # bdev_connect -b nvme0 --dhchap-key key3 00:17:29.567 11:28:24 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@60 -- # hostrpc bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.3 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:c758a4ed-f09f-4c82-9afb-3d096f035464 -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key3 00:17:29.567 11:28:24 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.3 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:c758a4ed-f09f-4c82-9afb-3d096f035464 -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key3 00:17:29.824 00:17:29.824 11:28:25 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # hostrpc bdev_nvme_get_controllers 00:17:29.824 11:28:25 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_get_controllers 00:17:29.824 11:28:25 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # jq -r '.[].name' 00:17:30.390 11:28:25 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:17:30.390 11:28:25 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@74 -- # rpc_cmd nvmf_subsystem_get_qpairs nqn.2024-03.io.spdk:cnode0 00:17:30.390 11:28:25 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:17:30.390 11:28:25 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:17:30.390 11:28:25 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:17:30.390 11:28:25 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@74 -- # qpairs='[ 00:17:30.390 { 00:17:30.390 "auth": { 00:17:30.390 "dhgroup": "ffdhe3072", 00:17:30.390 "digest": "sha384", 00:17:30.390 "state": "completed" 00:17:30.390 }, 00:17:30.390 "cntlid": 71, 00:17:30.390 "hostnqn": "nqn.2014-08.org.nvmexpress:uuid:c758a4ed-f09f-4c82-9afb-3d096f035464", 00:17:30.390 "listen_address": { 00:17:30.390 "adrfam": "IPv4", 00:17:30.390 "traddr": "10.0.0.3", 00:17:30.390 "trsvcid": "4420", 00:17:30.390 "trtype": "TCP" 00:17:30.390 }, 00:17:30.390 "peer_address": { 00:17:30.390 "adrfam": "IPv4", 00:17:30.390 "traddr": "10.0.0.1", 00:17:30.390 "trsvcid": "38622", 00:17:30.390 "trtype": "TCP" 00:17:30.390 }, 00:17:30.390 "qid": 0, 00:17:30.390 "state": "enabled", 00:17:30.390 "thread": "nvmf_tgt_poll_group_000" 00:17:30.390 } 00:17:30.390 ]' 00:17:30.390 11:28:25 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@75 -- # jq -r '.[0].auth.digest' 00:17:30.390 11:28:25 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@75 -- # [[ sha384 == \s\h\a\3\8\4 ]] 00:17:30.390 11:28:25 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@76 -- # jq -r '.[0].auth.dhgroup' 00:17:30.390 11:28:25 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@76 -- # [[ ffdhe3072 == \f\f\d\h\e\3\0\7\2 ]] 00:17:30.390 11:28:25 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@77 -- # jq -r '.[0].auth.state' 00:17:30.390 11:28:25 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@77 -- # [[ completed == \c\o\m\p\l\e\t\e\d ]] 00:17:30.390 11:28:25 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@78 -- # hostrpc bdev_nvme_detach_controller nvme0 00:17:30.390 11:28:25 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_detach_controller nvme0 00:17:30.649 11:28:26 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@80 -- # nvme_connect --dhchap-secret DHHC-1:03:YjUzYzRlNjQ2N2QwNDQ3ZGZhN2VhODUzYjlkY2I2OWViZWM1NzZiOTJiM2MwNzIxZWVkMmMxOTIzNWE5M2Q4MDbs9Og=: 00:17:30.649 11:28:26 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@36 -- # nvme connect -t tcp -a 10.0.0.3 -n nqn.2024-03.io.spdk:cnode0 -i 1 -q nqn.2014-08.org.nvmexpress:uuid:c758a4ed-f09f-4c82-9afb-3d096f035464 --hostid c758a4ed-f09f-4c82-9afb-3d096f035464 -l 0 --dhchap-secret DHHC-1:03:YjUzYzRlNjQ2N2QwNDQ3ZGZhN2VhODUzYjlkY2I2OWViZWM1NzZiOTJiM2MwNzIxZWVkMmMxOTIzNWE5M2Q4MDbs9Og=: 00:17:31.584 11:28:26 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@82 -- # nvme disconnect -n nqn.2024-03.io.spdk:cnode0 00:17:31.584 NQN:nqn.2024-03.io.spdk:cnode0 disconnected 1 controller(s) 00:17:31.584 11:28:26 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@83 -- # rpc_cmd nvmf_subsystem_remove_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:c758a4ed-f09f-4c82-9afb-3d096f035464 00:17:31.584 11:28:26 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:17:31.584 11:28:26 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:17:31.584 11:28:26 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:17:31.584 11:28:26 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@119 -- # for dhgroup in "${dhgroups[@]}" 00:17:31.584 11:28:26 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@120 -- # for keyid in "${!keys[@]}" 00:17:31.584 11:28:26 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@121 -- # hostrpc bdev_nvme_set_options --dhchap-digests sha384 --dhchap-dhgroups ffdhe4096 00:17:31.584 11:28:26 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_set_options --dhchap-digests sha384 --dhchap-dhgroups ffdhe4096 00:17:31.842 11:28:27 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@123 -- # connect_authenticate sha384 ffdhe4096 0 00:17:31.842 11:28:27 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@65 -- # local digest dhgroup key ckey qpairs 00:17:31.842 11:28:27 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # digest=sha384 00:17:31.842 11:28:27 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # dhgroup=ffdhe4096 00:17:31.842 11:28:27 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # key=key0 00:17:31.842 11:28:27 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@68 -- # ckey=(${ckeys[$3]:+--dhchap-ctrlr-key "ckey$3"}) 00:17:31.842 11:28:27 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@70 -- # rpc_cmd nvmf_subsystem_add_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:c758a4ed-f09f-4c82-9afb-3d096f035464 --dhchap-key key0 --dhchap-ctrlr-key ckey0 00:17:31.842 11:28:27 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:17:31.842 11:28:27 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:17:31.842 11:28:27 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:17:31.842 11:28:27 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@71 -- # bdev_connect -b nvme0 --dhchap-key key0 --dhchap-ctrlr-key ckey0 00:17:31.842 11:28:27 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@60 -- # hostrpc bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.3 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:c758a4ed-f09f-4c82-9afb-3d096f035464 -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key0 --dhchap-ctrlr-key ckey0 00:17:31.842 11:28:27 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.3 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:c758a4ed-f09f-4c82-9afb-3d096f035464 -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key0 --dhchap-ctrlr-key ckey0 00:17:32.145 00:17:32.145 11:28:27 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # hostrpc bdev_nvme_get_controllers 00:17:32.145 11:28:27 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # jq -r '.[].name' 00:17:32.145 11:28:27 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_get_controllers 00:17:32.403 11:28:27 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:17:32.403 11:28:27 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@74 -- # rpc_cmd nvmf_subsystem_get_qpairs nqn.2024-03.io.spdk:cnode0 00:17:32.403 11:28:27 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:17:32.403 11:28:27 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:17:32.403 11:28:27 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:17:32.403 11:28:27 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@74 -- # qpairs='[ 00:17:32.403 { 00:17:32.403 "auth": { 00:17:32.403 "dhgroup": "ffdhe4096", 00:17:32.403 "digest": "sha384", 00:17:32.403 "state": "completed" 00:17:32.403 }, 00:17:32.403 "cntlid": 73, 00:17:32.403 "hostnqn": "nqn.2014-08.org.nvmexpress:uuid:c758a4ed-f09f-4c82-9afb-3d096f035464", 00:17:32.403 "listen_address": { 00:17:32.403 "adrfam": "IPv4", 00:17:32.403 "traddr": "10.0.0.3", 00:17:32.403 "trsvcid": "4420", 00:17:32.403 "trtype": "TCP" 00:17:32.403 }, 00:17:32.403 "peer_address": { 00:17:32.403 "adrfam": "IPv4", 00:17:32.403 "traddr": "10.0.0.1", 00:17:32.403 "trsvcid": "38644", 00:17:32.403 "trtype": "TCP" 00:17:32.403 }, 00:17:32.403 "qid": 0, 00:17:32.403 "state": "enabled", 00:17:32.403 "thread": "nvmf_tgt_poll_group_000" 00:17:32.403 } 00:17:32.403 ]' 00:17:32.403 11:28:27 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@75 -- # jq -r '.[0].auth.digest' 00:17:32.403 11:28:27 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@75 -- # [[ sha384 == \s\h\a\3\8\4 ]] 00:17:32.403 11:28:27 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@76 -- # jq -r '.[0].auth.dhgroup' 00:17:32.661 11:28:27 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@76 -- # [[ ffdhe4096 == \f\f\d\h\e\4\0\9\6 ]] 00:17:32.661 11:28:27 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@77 -- # jq -r '.[0].auth.state' 00:17:32.661 11:28:27 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@77 -- # [[ completed == \c\o\m\p\l\e\t\e\d ]] 00:17:32.661 11:28:27 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@78 -- # hostrpc bdev_nvme_detach_controller nvme0 00:17:32.661 11:28:27 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_detach_controller nvme0 00:17:32.918 11:28:28 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@80 -- # nvme_connect --dhchap-secret DHHC-1:00:YTQ3MDY2OWMxZDcwN2QyZmRhNGVmYjYzYTczYTM4NzAwYjdiNTBmZmE2ZDBlZTc28YG94Q==: --dhchap-ctrl-secret DHHC-1:03:YmY1NDQyMjdhMGU5ZDk3NGFiYTIyMTE1OTgzNGQ4ZDQ0MTE3YmFjMTc3MGQ4NDRlOTU5MThlODc5YzUxNGM2Y9nOg8I=: 00:17:32.918 11:28:28 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@36 -- # nvme connect -t tcp -a 10.0.0.3 -n nqn.2024-03.io.spdk:cnode0 -i 1 -q nqn.2014-08.org.nvmexpress:uuid:c758a4ed-f09f-4c82-9afb-3d096f035464 --hostid c758a4ed-f09f-4c82-9afb-3d096f035464 -l 0 --dhchap-secret DHHC-1:00:YTQ3MDY2OWMxZDcwN2QyZmRhNGVmYjYzYTczYTM4NzAwYjdiNTBmZmE2ZDBlZTc28YG94Q==: --dhchap-ctrl-secret DHHC-1:03:YmY1NDQyMjdhMGU5ZDk3NGFiYTIyMTE1OTgzNGQ4ZDQ0MTE3YmFjMTc3MGQ4NDRlOTU5MThlODc5YzUxNGM2Y9nOg8I=: 00:17:33.480 11:28:28 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@82 -- # nvme disconnect -n nqn.2024-03.io.spdk:cnode0 00:17:33.480 NQN:nqn.2024-03.io.spdk:cnode0 disconnected 1 controller(s) 00:17:33.480 11:28:28 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@83 -- # rpc_cmd nvmf_subsystem_remove_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:c758a4ed-f09f-4c82-9afb-3d096f035464 00:17:33.480 11:28:28 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:17:33.480 11:28:28 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:17:33.480 11:28:28 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:17:33.480 11:28:28 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@120 -- # for keyid in "${!keys[@]}" 00:17:33.480 11:28:28 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@121 -- # hostrpc bdev_nvme_set_options --dhchap-digests sha384 --dhchap-dhgroups ffdhe4096 00:17:33.480 11:28:28 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_set_options --dhchap-digests sha384 --dhchap-dhgroups ffdhe4096 00:17:33.737 11:28:29 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@123 -- # connect_authenticate sha384 ffdhe4096 1 00:17:33.737 11:28:29 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@65 -- # local digest dhgroup key ckey qpairs 00:17:33.737 11:28:29 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # digest=sha384 00:17:33.737 11:28:29 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # dhgroup=ffdhe4096 00:17:33.737 11:28:29 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # key=key1 00:17:33.737 11:28:29 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@68 -- # ckey=(${ckeys[$3]:+--dhchap-ctrlr-key "ckey$3"}) 00:17:33.737 11:28:29 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@70 -- # rpc_cmd nvmf_subsystem_add_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:c758a4ed-f09f-4c82-9afb-3d096f035464 --dhchap-key key1 --dhchap-ctrlr-key ckey1 00:17:33.737 11:28:29 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:17:33.737 11:28:29 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:17:33.737 11:28:29 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:17:33.737 11:28:29 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@71 -- # bdev_connect -b nvme0 --dhchap-key key1 --dhchap-ctrlr-key ckey1 00:17:33.737 11:28:29 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@60 -- # hostrpc bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.3 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:c758a4ed-f09f-4c82-9afb-3d096f035464 -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key1 --dhchap-ctrlr-key ckey1 00:17:33.737 11:28:29 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.3 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:c758a4ed-f09f-4c82-9afb-3d096f035464 -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key1 --dhchap-ctrlr-key ckey1 00:17:34.301 00:17:34.302 11:28:29 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # hostrpc bdev_nvme_get_controllers 00:17:34.302 11:28:29 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # jq -r '.[].name' 00:17:34.302 11:28:29 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_get_controllers 00:17:34.559 11:28:29 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:17:34.559 11:28:29 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@74 -- # rpc_cmd nvmf_subsystem_get_qpairs nqn.2024-03.io.spdk:cnode0 00:17:34.559 11:28:29 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:17:34.559 11:28:29 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:17:34.559 11:28:29 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:17:34.559 11:28:29 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@74 -- # qpairs='[ 00:17:34.559 { 00:17:34.559 "auth": { 00:17:34.559 "dhgroup": "ffdhe4096", 00:17:34.559 "digest": "sha384", 00:17:34.559 "state": "completed" 00:17:34.559 }, 00:17:34.559 "cntlid": 75, 00:17:34.559 "hostnqn": "nqn.2014-08.org.nvmexpress:uuid:c758a4ed-f09f-4c82-9afb-3d096f035464", 00:17:34.559 "listen_address": { 00:17:34.559 "adrfam": "IPv4", 00:17:34.559 "traddr": "10.0.0.3", 00:17:34.559 "trsvcid": "4420", 00:17:34.559 "trtype": "TCP" 00:17:34.559 }, 00:17:34.559 "peer_address": { 00:17:34.559 "adrfam": "IPv4", 00:17:34.559 "traddr": "10.0.0.1", 00:17:34.559 "trsvcid": "38676", 00:17:34.559 "trtype": "TCP" 00:17:34.559 }, 00:17:34.559 "qid": 0, 00:17:34.559 "state": "enabled", 00:17:34.559 "thread": "nvmf_tgt_poll_group_000" 00:17:34.559 } 00:17:34.559 ]' 00:17:34.559 11:28:29 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@75 -- # jq -r '.[0].auth.digest' 00:17:34.559 11:28:30 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@75 -- # [[ sha384 == \s\h\a\3\8\4 ]] 00:17:34.559 11:28:30 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@76 -- # jq -r '.[0].auth.dhgroup' 00:17:34.559 11:28:30 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@76 -- # [[ ffdhe4096 == \f\f\d\h\e\4\0\9\6 ]] 00:17:34.559 11:28:30 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@77 -- # jq -r '.[0].auth.state' 00:17:34.817 11:28:30 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@77 -- # [[ completed == \c\o\m\p\l\e\t\e\d ]] 00:17:34.817 11:28:30 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@78 -- # hostrpc bdev_nvme_detach_controller nvme0 00:17:34.817 11:28:30 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_detach_controller nvme0 00:17:35.074 11:28:30 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@80 -- # nvme_connect --dhchap-secret DHHC-1:01:YTU2ZTRiMDFkMzNiMjFmN2QwNTBiYjliMGJkYjQwZTTsDgGm: --dhchap-ctrl-secret DHHC-1:02:ZjZjOWFiZGJhYjc3NzkxOGQwNGZmNTA0MTE0MjkzYmVkODZmYTJjNzcyZDM2NjYxWbIiww==: 00:17:35.074 11:28:30 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@36 -- # nvme connect -t tcp -a 10.0.0.3 -n nqn.2024-03.io.spdk:cnode0 -i 1 -q nqn.2014-08.org.nvmexpress:uuid:c758a4ed-f09f-4c82-9afb-3d096f035464 --hostid c758a4ed-f09f-4c82-9afb-3d096f035464 -l 0 --dhchap-secret DHHC-1:01:YTU2ZTRiMDFkMzNiMjFmN2QwNTBiYjliMGJkYjQwZTTsDgGm: --dhchap-ctrl-secret DHHC-1:02:ZjZjOWFiZGJhYjc3NzkxOGQwNGZmNTA0MTE0MjkzYmVkODZmYTJjNzcyZDM2NjYxWbIiww==: 00:17:35.639 11:28:31 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@82 -- # nvme disconnect -n nqn.2024-03.io.spdk:cnode0 00:17:35.639 NQN:nqn.2024-03.io.spdk:cnode0 disconnected 1 controller(s) 00:17:35.639 11:28:31 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@83 -- # rpc_cmd nvmf_subsystem_remove_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:c758a4ed-f09f-4c82-9afb-3d096f035464 00:17:35.639 11:28:31 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:17:35.639 11:28:31 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:17:35.639 11:28:31 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:17:35.639 11:28:31 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@120 -- # for keyid in "${!keys[@]}" 00:17:35.639 11:28:31 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@121 -- # hostrpc bdev_nvme_set_options --dhchap-digests sha384 --dhchap-dhgroups ffdhe4096 00:17:35.639 11:28:31 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_set_options --dhchap-digests sha384 --dhchap-dhgroups ffdhe4096 00:17:36.205 11:28:31 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@123 -- # connect_authenticate sha384 ffdhe4096 2 00:17:36.205 11:28:31 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@65 -- # local digest dhgroup key ckey qpairs 00:17:36.206 11:28:31 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # digest=sha384 00:17:36.206 11:28:31 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # dhgroup=ffdhe4096 00:17:36.206 11:28:31 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # key=key2 00:17:36.206 11:28:31 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@68 -- # ckey=(${ckeys[$3]:+--dhchap-ctrlr-key "ckey$3"}) 00:17:36.206 11:28:31 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@70 -- # rpc_cmd nvmf_subsystem_add_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:c758a4ed-f09f-4c82-9afb-3d096f035464 --dhchap-key key2 --dhchap-ctrlr-key ckey2 00:17:36.206 11:28:31 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:17:36.206 11:28:31 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:17:36.206 11:28:31 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:17:36.206 11:28:31 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@71 -- # bdev_connect -b nvme0 --dhchap-key key2 --dhchap-ctrlr-key ckey2 00:17:36.206 11:28:31 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@60 -- # hostrpc bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.3 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:c758a4ed-f09f-4c82-9afb-3d096f035464 -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key2 --dhchap-ctrlr-key ckey2 00:17:36.206 11:28:31 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.3 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:c758a4ed-f09f-4c82-9afb-3d096f035464 -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key2 --dhchap-ctrlr-key ckey2 00:17:36.463 00:17:36.463 11:28:31 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # jq -r '.[].name' 00:17:36.463 11:28:31 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # hostrpc bdev_nvme_get_controllers 00:17:36.463 11:28:31 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_get_controllers 00:17:36.721 11:28:32 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:17:36.721 11:28:32 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@74 -- # rpc_cmd nvmf_subsystem_get_qpairs nqn.2024-03.io.spdk:cnode0 00:17:36.721 11:28:32 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:17:36.721 11:28:32 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:17:36.721 11:28:32 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:17:36.721 11:28:32 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@74 -- # qpairs='[ 00:17:36.721 { 00:17:36.721 "auth": { 00:17:36.721 "dhgroup": "ffdhe4096", 00:17:36.721 "digest": "sha384", 00:17:36.721 "state": "completed" 00:17:36.721 }, 00:17:36.721 "cntlid": 77, 00:17:36.721 "hostnqn": "nqn.2014-08.org.nvmexpress:uuid:c758a4ed-f09f-4c82-9afb-3d096f035464", 00:17:36.721 "listen_address": { 00:17:36.721 "adrfam": "IPv4", 00:17:36.721 "traddr": "10.0.0.3", 00:17:36.721 "trsvcid": "4420", 00:17:36.721 "trtype": "TCP" 00:17:36.721 }, 00:17:36.721 "peer_address": { 00:17:36.721 "adrfam": "IPv4", 00:17:36.721 "traddr": "10.0.0.1", 00:17:36.721 "trsvcid": "51738", 00:17:36.721 "trtype": "TCP" 00:17:36.721 }, 00:17:36.721 "qid": 0, 00:17:36.721 "state": "enabled", 00:17:36.721 "thread": "nvmf_tgt_poll_group_000" 00:17:36.721 } 00:17:36.721 ]' 00:17:36.721 11:28:32 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@75 -- # jq -r '.[0].auth.digest' 00:17:36.721 11:28:32 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@75 -- # [[ sha384 == \s\h\a\3\8\4 ]] 00:17:36.721 11:28:32 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@76 -- # jq -r '.[0].auth.dhgroup' 00:17:36.721 11:28:32 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@76 -- # [[ ffdhe4096 == \f\f\d\h\e\4\0\9\6 ]] 00:17:36.721 11:28:32 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@77 -- # jq -r '.[0].auth.state' 00:17:36.978 11:28:32 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@77 -- # [[ completed == \c\o\m\p\l\e\t\e\d ]] 00:17:36.978 11:28:32 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@78 -- # hostrpc bdev_nvme_detach_controller nvme0 00:17:36.978 11:28:32 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_detach_controller nvme0 00:17:37.236 11:28:32 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@80 -- # nvme_connect --dhchap-secret DHHC-1:02:YjZiMDU3YTg1ZTA0NWQzMGY1ZWM0YzNmYzc1NDY1OWNkZmQ3NmU2YWM2ZDE3ZmVmgTRtHQ==: --dhchap-ctrl-secret DHHC-1:01:YmQ3ZDA4NWFiYjI3YjdjNWVjMzc4NDNiZTM4ZTU3N2a6gUZi: 00:17:37.236 11:28:32 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@36 -- # nvme connect -t tcp -a 10.0.0.3 -n nqn.2024-03.io.spdk:cnode0 -i 1 -q nqn.2014-08.org.nvmexpress:uuid:c758a4ed-f09f-4c82-9afb-3d096f035464 --hostid c758a4ed-f09f-4c82-9afb-3d096f035464 -l 0 --dhchap-secret DHHC-1:02:YjZiMDU3YTg1ZTA0NWQzMGY1ZWM0YzNmYzc1NDY1OWNkZmQ3NmU2YWM2ZDE3ZmVmgTRtHQ==: --dhchap-ctrl-secret DHHC-1:01:YmQ3ZDA4NWFiYjI3YjdjNWVjMzc4NDNiZTM4ZTU3N2a6gUZi: 00:17:37.836 11:28:33 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@82 -- # nvme disconnect -n nqn.2024-03.io.spdk:cnode0 00:17:37.836 NQN:nqn.2024-03.io.spdk:cnode0 disconnected 1 controller(s) 00:17:37.836 11:28:33 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@83 -- # rpc_cmd nvmf_subsystem_remove_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:c758a4ed-f09f-4c82-9afb-3d096f035464 00:17:37.836 11:28:33 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:17:37.836 11:28:33 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:17:37.836 11:28:33 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:17:37.836 11:28:33 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@120 -- # for keyid in "${!keys[@]}" 00:17:37.836 11:28:33 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@121 -- # hostrpc bdev_nvme_set_options --dhchap-digests sha384 --dhchap-dhgroups ffdhe4096 00:17:37.836 11:28:33 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_set_options --dhchap-digests sha384 --dhchap-dhgroups ffdhe4096 00:17:38.094 11:28:33 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@123 -- # connect_authenticate sha384 ffdhe4096 3 00:17:38.094 11:28:33 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@65 -- # local digest dhgroup key ckey qpairs 00:17:38.094 11:28:33 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # digest=sha384 00:17:38.094 11:28:33 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # dhgroup=ffdhe4096 00:17:38.094 11:28:33 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # key=key3 00:17:38.094 11:28:33 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@68 -- # ckey=(${ckeys[$3]:+--dhchap-ctrlr-key "ckey$3"}) 00:17:38.094 11:28:33 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@70 -- # rpc_cmd nvmf_subsystem_add_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:c758a4ed-f09f-4c82-9afb-3d096f035464 --dhchap-key key3 00:17:38.094 11:28:33 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:17:38.094 11:28:33 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:17:38.352 11:28:33 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:17:38.352 11:28:33 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@71 -- # bdev_connect -b nvme0 --dhchap-key key3 00:17:38.352 11:28:33 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@60 -- # hostrpc bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.3 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:c758a4ed-f09f-4c82-9afb-3d096f035464 -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key3 00:17:38.352 11:28:33 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.3 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:c758a4ed-f09f-4c82-9afb-3d096f035464 -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key3 00:17:38.610 00:17:38.610 11:28:34 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # jq -r '.[].name' 00:17:38.610 11:28:34 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # hostrpc bdev_nvme_get_controllers 00:17:38.610 11:28:34 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_get_controllers 00:17:38.868 11:28:34 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:17:38.868 11:28:34 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@74 -- # rpc_cmd nvmf_subsystem_get_qpairs nqn.2024-03.io.spdk:cnode0 00:17:38.868 11:28:34 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:17:38.868 11:28:34 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:17:38.868 11:28:34 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:17:38.868 11:28:34 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@74 -- # qpairs='[ 00:17:38.868 { 00:17:38.868 "auth": { 00:17:38.868 "dhgroup": "ffdhe4096", 00:17:38.868 "digest": "sha384", 00:17:38.868 "state": "completed" 00:17:38.868 }, 00:17:38.868 "cntlid": 79, 00:17:38.868 "hostnqn": "nqn.2014-08.org.nvmexpress:uuid:c758a4ed-f09f-4c82-9afb-3d096f035464", 00:17:38.868 "listen_address": { 00:17:38.868 "adrfam": "IPv4", 00:17:38.868 "traddr": "10.0.0.3", 00:17:38.868 "trsvcid": "4420", 00:17:38.868 "trtype": "TCP" 00:17:38.868 }, 00:17:38.868 "peer_address": { 00:17:38.868 "adrfam": "IPv4", 00:17:38.868 "traddr": "10.0.0.1", 00:17:38.868 "trsvcid": "51770", 00:17:38.868 "trtype": "TCP" 00:17:38.868 }, 00:17:38.868 "qid": 0, 00:17:38.868 "state": "enabled", 00:17:38.868 "thread": "nvmf_tgt_poll_group_000" 00:17:38.868 } 00:17:38.868 ]' 00:17:38.868 11:28:34 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@75 -- # jq -r '.[0].auth.digest' 00:17:38.868 11:28:34 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@75 -- # [[ sha384 == \s\h\a\3\8\4 ]] 00:17:38.868 11:28:34 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@76 -- # jq -r '.[0].auth.dhgroup' 00:17:39.126 11:28:34 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@76 -- # [[ ffdhe4096 == \f\f\d\h\e\4\0\9\6 ]] 00:17:39.126 11:28:34 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@77 -- # jq -r '.[0].auth.state' 00:17:39.126 11:28:34 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@77 -- # [[ completed == \c\o\m\p\l\e\t\e\d ]] 00:17:39.126 11:28:34 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@78 -- # hostrpc bdev_nvme_detach_controller nvme0 00:17:39.126 11:28:34 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_detach_controller nvme0 00:17:39.383 11:28:34 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@80 -- # nvme_connect --dhchap-secret DHHC-1:03:YjUzYzRlNjQ2N2QwNDQ3ZGZhN2VhODUzYjlkY2I2OWViZWM1NzZiOTJiM2MwNzIxZWVkMmMxOTIzNWE5M2Q4MDbs9Og=: 00:17:39.383 11:28:34 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@36 -- # nvme connect -t tcp -a 10.0.0.3 -n nqn.2024-03.io.spdk:cnode0 -i 1 -q nqn.2014-08.org.nvmexpress:uuid:c758a4ed-f09f-4c82-9afb-3d096f035464 --hostid c758a4ed-f09f-4c82-9afb-3d096f035464 -l 0 --dhchap-secret DHHC-1:03:YjUzYzRlNjQ2N2QwNDQ3ZGZhN2VhODUzYjlkY2I2OWViZWM1NzZiOTJiM2MwNzIxZWVkMmMxOTIzNWE5M2Q4MDbs9Og=: 00:17:39.947 11:28:35 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@82 -- # nvme disconnect -n nqn.2024-03.io.spdk:cnode0 00:17:39.947 NQN:nqn.2024-03.io.spdk:cnode0 disconnected 1 controller(s) 00:17:39.947 11:28:35 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@83 -- # rpc_cmd nvmf_subsystem_remove_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:c758a4ed-f09f-4c82-9afb-3d096f035464 00:17:39.947 11:28:35 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:17:39.947 11:28:35 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:17:39.947 11:28:35 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:17:39.947 11:28:35 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@119 -- # for dhgroup in "${dhgroups[@]}" 00:17:39.948 11:28:35 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@120 -- # for keyid in "${!keys[@]}" 00:17:39.948 11:28:35 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@121 -- # hostrpc bdev_nvme_set_options --dhchap-digests sha384 --dhchap-dhgroups ffdhe6144 00:17:39.948 11:28:35 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_set_options --dhchap-digests sha384 --dhchap-dhgroups ffdhe6144 00:17:40.530 11:28:35 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@123 -- # connect_authenticate sha384 ffdhe6144 0 00:17:40.530 11:28:35 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@65 -- # local digest dhgroup key ckey qpairs 00:17:40.530 11:28:35 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # digest=sha384 00:17:40.530 11:28:35 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # dhgroup=ffdhe6144 00:17:40.530 11:28:35 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # key=key0 00:17:40.530 11:28:35 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@68 -- # ckey=(${ckeys[$3]:+--dhchap-ctrlr-key "ckey$3"}) 00:17:40.530 11:28:35 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@70 -- # rpc_cmd nvmf_subsystem_add_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:c758a4ed-f09f-4c82-9afb-3d096f035464 --dhchap-key key0 --dhchap-ctrlr-key ckey0 00:17:40.530 11:28:35 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:17:40.530 11:28:35 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:17:40.530 11:28:35 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:17:40.530 11:28:35 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@71 -- # bdev_connect -b nvme0 --dhchap-key key0 --dhchap-ctrlr-key ckey0 00:17:40.530 11:28:35 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@60 -- # hostrpc bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.3 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:c758a4ed-f09f-4c82-9afb-3d096f035464 -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key0 --dhchap-ctrlr-key ckey0 00:17:40.530 11:28:35 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.3 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:c758a4ed-f09f-4c82-9afb-3d096f035464 -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key0 --dhchap-ctrlr-key ckey0 00:17:40.788 00:17:40.788 11:28:36 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # jq -r '.[].name' 00:17:40.788 11:28:36 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # hostrpc bdev_nvme_get_controllers 00:17:40.788 11:28:36 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_get_controllers 00:17:41.046 11:28:36 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:17:41.046 11:28:36 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@74 -- # rpc_cmd nvmf_subsystem_get_qpairs nqn.2024-03.io.spdk:cnode0 00:17:41.046 11:28:36 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:17:41.046 11:28:36 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:17:41.046 11:28:36 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:17:41.046 11:28:36 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@74 -- # qpairs='[ 00:17:41.046 { 00:17:41.046 "auth": { 00:17:41.046 "dhgroup": "ffdhe6144", 00:17:41.046 "digest": "sha384", 00:17:41.046 "state": "completed" 00:17:41.046 }, 00:17:41.046 "cntlid": 81, 00:17:41.046 "hostnqn": "nqn.2014-08.org.nvmexpress:uuid:c758a4ed-f09f-4c82-9afb-3d096f035464", 00:17:41.046 "listen_address": { 00:17:41.046 "adrfam": "IPv4", 00:17:41.046 "traddr": "10.0.0.3", 00:17:41.046 "trsvcid": "4420", 00:17:41.046 "trtype": "TCP" 00:17:41.046 }, 00:17:41.046 "peer_address": { 00:17:41.046 "adrfam": "IPv4", 00:17:41.046 "traddr": "10.0.0.1", 00:17:41.046 "trsvcid": "51810", 00:17:41.046 "trtype": "TCP" 00:17:41.046 }, 00:17:41.046 "qid": 0, 00:17:41.046 "state": "enabled", 00:17:41.046 "thread": "nvmf_tgt_poll_group_000" 00:17:41.046 } 00:17:41.046 ]' 00:17:41.046 11:28:36 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@75 -- # jq -r '.[0].auth.digest' 00:17:41.304 11:28:36 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@75 -- # [[ sha384 == \s\h\a\3\8\4 ]] 00:17:41.304 11:28:36 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@76 -- # jq -r '.[0].auth.dhgroup' 00:17:41.304 11:28:36 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@76 -- # [[ ffdhe6144 == \f\f\d\h\e\6\1\4\4 ]] 00:17:41.304 11:28:36 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@77 -- # jq -r '.[0].auth.state' 00:17:41.304 11:28:36 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@77 -- # [[ completed == \c\o\m\p\l\e\t\e\d ]] 00:17:41.304 11:28:36 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@78 -- # hostrpc bdev_nvme_detach_controller nvme0 00:17:41.304 11:28:36 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_detach_controller nvme0 00:17:41.562 11:28:37 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@80 -- # nvme_connect --dhchap-secret DHHC-1:00:YTQ3MDY2OWMxZDcwN2QyZmRhNGVmYjYzYTczYTM4NzAwYjdiNTBmZmE2ZDBlZTc28YG94Q==: --dhchap-ctrl-secret DHHC-1:03:YmY1NDQyMjdhMGU5ZDk3NGFiYTIyMTE1OTgzNGQ4ZDQ0MTE3YmFjMTc3MGQ4NDRlOTU5MThlODc5YzUxNGM2Y9nOg8I=: 00:17:41.562 11:28:37 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@36 -- # nvme connect -t tcp -a 10.0.0.3 -n nqn.2024-03.io.spdk:cnode0 -i 1 -q nqn.2014-08.org.nvmexpress:uuid:c758a4ed-f09f-4c82-9afb-3d096f035464 --hostid c758a4ed-f09f-4c82-9afb-3d096f035464 -l 0 --dhchap-secret DHHC-1:00:YTQ3MDY2OWMxZDcwN2QyZmRhNGVmYjYzYTczYTM4NzAwYjdiNTBmZmE2ZDBlZTc28YG94Q==: --dhchap-ctrl-secret DHHC-1:03:YmY1NDQyMjdhMGU5ZDk3NGFiYTIyMTE1OTgzNGQ4ZDQ0MTE3YmFjMTc3MGQ4NDRlOTU5MThlODc5YzUxNGM2Y9nOg8I=: 00:17:42.495 11:28:37 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@82 -- # nvme disconnect -n nqn.2024-03.io.spdk:cnode0 00:17:42.495 NQN:nqn.2024-03.io.spdk:cnode0 disconnected 1 controller(s) 00:17:42.495 11:28:37 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@83 -- # rpc_cmd nvmf_subsystem_remove_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:c758a4ed-f09f-4c82-9afb-3d096f035464 00:17:42.495 11:28:37 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:17:42.495 11:28:37 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:17:42.495 11:28:37 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:17:42.495 11:28:37 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@120 -- # for keyid in "${!keys[@]}" 00:17:42.495 11:28:37 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@121 -- # hostrpc bdev_nvme_set_options --dhchap-digests sha384 --dhchap-dhgroups ffdhe6144 00:17:42.495 11:28:37 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_set_options --dhchap-digests sha384 --dhchap-dhgroups ffdhe6144 00:17:42.495 11:28:37 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@123 -- # connect_authenticate sha384 ffdhe6144 1 00:17:42.495 11:28:37 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@65 -- # local digest dhgroup key ckey qpairs 00:17:42.495 11:28:37 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # digest=sha384 00:17:42.495 11:28:37 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # dhgroup=ffdhe6144 00:17:42.495 11:28:37 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # key=key1 00:17:42.495 11:28:37 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@68 -- # ckey=(${ckeys[$3]:+--dhchap-ctrlr-key "ckey$3"}) 00:17:42.496 11:28:37 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@70 -- # rpc_cmd nvmf_subsystem_add_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:c758a4ed-f09f-4c82-9afb-3d096f035464 --dhchap-key key1 --dhchap-ctrlr-key ckey1 00:17:42.496 11:28:37 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:17:42.496 11:28:37 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:17:42.496 11:28:37 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:17:42.496 11:28:37 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@71 -- # bdev_connect -b nvme0 --dhchap-key key1 --dhchap-ctrlr-key ckey1 00:17:42.496 11:28:37 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@60 -- # hostrpc bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.3 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:c758a4ed-f09f-4c82-9afb-3d096f035464 -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key1 --dhchap-ctrlr-key ckey1 00:17:42.496 11:28:37 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.3 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:c758a4ed-f09f-4c82-9afb-3d096f035464 -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key1 --dhchap-ctrlr-key ckey1 00:17:43.062 00:17:43.062 11:28:38 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # jq -r '.[].name' 00:17:43.062 11:28:38 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # hostrpc bdev_nvme_get_controllers 00:17:43.062 11:28:38 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_get_controllers 00:17:43.319 11:28:38 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:17:43.319 11:28:38 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@74 -- # rpc_cmd nvmf_subsystem_get_qpairs nqn.2024-03.io.spdk:cnode0 00:17:43.319 11:28:38 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:17:43.319 11:28:38 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:17:43.319 11:28:38 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:17:43.319 11:28:38 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@74 -- # qpairs='[ 00:17:43.319 { 00:17:43.319 "auth": { 00:17:43.319 "dhgroup": "ffdhe6144", 00:17:43.319 "digest": "sha384", 00:17:43.319 "state": "completed" 00:17:43.319 }, 00:17:43.319 "cntlid": 83, 00:17:43.319 "hostnqn": "nqn.2014-08.org.nvmexpress:uuid:c758a4ed-f09f-4c82-9afb-3d096f035464", 00:17:43.319 "listen_address": { 00:17:43.319 "adrfam": "IPv4", 00:17:43.319 "traddr": "10.0.0.3", 00:17:43.319 "trsvcid": "4420", 00:17:43.319 "trtype": "TCP" 00:17:43.319 }, 00:17:43.319 "peer_address": { 00:17:43.319 "adrfam": "IPv4", 00:17:43.319 "traddr": "10.0.0.1", 00:17:43.319 "trsvcid": "51826", 00:17:43.319 "trtype": "TCP" 00:17:43.319 }, 00:17:43.319 "qid": 0, 00:17:43.319 "state": "enabled", 00:17:43.319 "thread": "nvmf_tgt_poll_group_000" 00:17:43.319 } 00:17:43.319 ]' 00:17:43.319 11:28:38 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@75 -- # jq -r '.[0].auth.digest' 00:17:43.319 11:28:38 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@75 -- # [[ sha384 == \s\h\a\3\8\4 ]] 00:17:43.319 11:28:38 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@76 -- # jq -r '.[0].auth.dhgroup' 00:17:43.578 11:28:38 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@76 -- # [[ ffdhe6144 == \f\f\d\h\e\6\1\4\4 ]] 00:17:43.578 11:28:38 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@77 -- # jq -r '.[0].auth.state' 00:17:43.578 11:28:38 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@77 -- # [[ completed == \c\o\m\p\l\e\t\e\d ]] 00:17:43.578 11:28:38 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@78 -- # hostrpc bdev_nvme_detach_controller nvme0 00:17:43.578 11:28:38 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_detach_controller nvme0 00:17:43.836 11:28:39 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@80 -- # nvme_connect --dhchap-secret DHHC-1:01:YTU2ZTRiMDFkMzNiMjFmN2QwNTBiYjliMGJkYjQwZTTsDgGm: --dhchap-ctrl-secret DHHC-1:02:ZjZjOWFiZGJhYjc3NzkxOGQwNGZmNTA0MTE0MjkzYmVkODZmYTJjNzcyZDM2NjYxWbIiww==: 00:17:43.836 11:28:39 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@36 -- # nvme connect -t tcp -a 10.0.0.3 -n nqn.2024-03.io.spdk:cnode0 -i 1 -q nqn.2014-08.org.nvmexpress:uuid:c758a4ed-f09f-4c82-9afb-3d096f035464 --hostid c758a4ed-f09f-4c82-9afb-3d096f035464 -l 0 --dhchap-secret DHHC-1:01:YTU2ZTRiMDFkMzNiMjFmN2QwNTBiYjliMGJkYjQwZTTsDgGm: --dhchap-ctrl-secret DHHC-1:02:ZjZjOWFiZGJhYjc3NzkxOGQwNGZmNTA0MTE0MjkzYmVkODZmYTJjNzcyZDM2NjYxWbIiww==: 00:17:44.402 11:28:39 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@82 -- # nvme disconnect -n nqn.2024-03.io.spdk:cnode0 00:17:44.660 NQN:nqn.2024-03.io.spdk:cnode0 disconnected 1 controller(s) 00:17:44.660 11:28:39 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@83 -- # rpc_cmd nvmf_subsystem_remove_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:c758a4ed-f09f-4c82-9afb-3d096f035464 00:17:44.660 11:28:39 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:17:44.660 11:28:39 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:17:44.660 11:28:39 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:17:44.660 11:28:39 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@120 -- # for keyid in "${!keys[@]}" 00:17:44.660 11:28:39 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@121 -- # hostrpc bdev_nvme_set_options --dhchap-digests sha384 --dhchap-dhgroups ffdhe6144 00:17:44.660 11:28:39 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_set_options --dhchap-digests sha384 --dhchap-dhgroups ffdhe6144 00:17:44.918 11:28:40 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@123 -- # connect_authenticate sha384 ffdhe6144 2 00:17:44.918 11:28:40 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@65 -- # local digest dhgroup key ckey qpairs 00:17:44.918 11:28:40 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # digest=sha384 00:17:44.918 11:28:40 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # dhgroup=ffdhe6144 00:17:44.918 11:28:40 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # key=key2 00:17:44.918 11:28:40 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@68 -- # ckey=(${ckeys[$3]:+--dhchap-ctrlr-key "ckey$3"}) 00:17:44.918 11:28:40 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@70 -- # rpc_cmd nvmf_subsystem_add_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:c758a4ed-f09f-4c82-9afb-3d096f035464 --dhchap-key key2 --dhchap-ctrlr-key ckey2 00:17:44.918 11:28:40 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:17:44.918 11:28:40 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:17:44.918 11:28:40 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:17:44.918 11:28:40 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@71 -- # bdev_connect -b nvme0 --dhchap-key key2 --dhchap-ctrlr-key ckey2 00:17:44.918 11:28:40 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@60 -- # hostrpc bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.3 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:c758a4ed-f09f-4c82-9afb-3d096f035464 -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key2 --dhchap-ctrlr-key ckey2 00:17:44.919 11:28:40 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.3 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:c758a4ed-f09f-4c82-9afb-3d096f035464 -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key2 --dhchap-ctrlr-key ckey2 00:17:45.484 00:17:45.484 11:28:40 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # hostrpc bdev_nvme_get_controllers 00:17:45.484 11:28:40 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_get_controllers 00:17:45.484 11:28:40 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # jq -r '.[].name' 00:17:45.742 11:28:41 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:17:45.742 11:28:41 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@74 -- # rpc_cmd nvmf_subsystem_get_qpairs nqn.2024-03.io.spdk:cnode0 00:17:45.742 11:28:41 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:17:45.742 11:28:41 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:17:45.742 11:28:41 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:17:45.742 11:28:41 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@74 -- # qpairs='[ 00:17:45.742 { 00:17:45.742 "auth": { 00:17:45.742 "dhgroup": "ffdhe6144", 00:17:45.742 "digest": "sha384", 00:17:45.742 "state": "completed" 00:17:45.742 }, 00:17:45.742 "cntlid": 85, 00:17:45.742 "hostnqn": "nqn.2014-08.org.nvmexpress:uuid:c758a4ed-f09f-4c82-9afb-3d096f035464", 00:17:45.742 "listen_address": { 00:17:45.742 "adrfam": "IPv4", 00:17:45.742 "traddr": "10.0.0.3", 00:17:45.742 "trsvcid": "4420", 00:17:45.742 "trtype": "TCP" 00:17:45.742 }, 00:17:45.742 "peer_address": { 00:17:45.742 "adrfam": "IPv4", 00:17:45.742 "traddr": "10.0.0.1", 00:17:45.742 "trsvcid": "51854", 00:17:45.742 "trtype": "TCP" 00:17:45.742 }, 00:17:45.742 "qid": 0, 00:17:45.742 "state": "enabled", 00:17:45.742 "thread": "nvmf_tgt_poll_group_000" 00:17:45.742 } 00:17:45.742 ]' 00:17:45.742 11:28:41 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@75 -- # jq -r '.[0].auth.digest' 00:17:45.742 11:28:41 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@75 -- # [[ sha384 == \s\h\a\3\8\4 ]] 00:17:45.742 11:28:41 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@76 -- # jq -r '.[0].auth.dhgroup' 00:17:45.742 11:28:41 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@76 -- # [[ ffdhe6144 == \f\f\d\h\e\6\1\4\4 ]] 00:17:45.742 11:28:41 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@77 -- # jq -r '.[0].auth.state' 00:17:46.000 11:28:41 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@77 -- # [[ completed == \c\o\m\p\l\e\t\e\d ]] 00:17:46.000 11:28:41 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@78 -- # hostrpc bdev_nvme_detach_controller nvme0 00:17:46.000 11:28:41 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_detach_controller nvme0 00:17:46.258 11:28:41 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@80 -- # nvme_connect --dhchap-secret DHHC-1:02:YjZiMDU3YTg1ZTA0NWQzMGY1ZWM0YzNmYzc1NDY1OWNkZmQ3NmU2YWM2ZDE3ZmVmgTRtHQ==: --dhchap-ctrl-secret DHHC-1:01:YmQ3ZDA4NWFiYjI3YjdjNWVjMzc4NDNiZTM4ZTU3N2a6gUZi: 00:17:46.258 11:28:41 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@36 -- # nvme connect -t tcp -a 10.0.0.3 -n nqn.2024-03.io.spdk:cnode0 -i 1 -q nqn.2014-08.org.nvmexpress:uuid:c758a4ed-f09f-4c82-9afb-3d096f035464 --hostid c758a4ed-f09f-4c82-9afb-3d096f035464 -l 0 --dhchap-secret DHHC-1:02:YjZiMDU3YTg1ZTA0NWQzMGY1ZWM0YzNmYzc1NDY1OWNkZmQ3NmU2YWM2ZDE3ZmVmgTRtHQ==: --dhchap-ctrl-secret DHHC-1:01:YmQ3ZDA4NWFiYjI3YjdjNWVjMzc4NDNiZTM4ZTU3N2a6gUZi: 00:17:46.823 11:28:42 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@82 -- # nvme disconnect -n nqn.2024-03.io.spdk:cnode0 00:17:46.823 NQN:nqn.2024-03.io.spdk:cnode0 disconnected 1 controller(s) 00:17:46.823 11:28:42 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@83 -- # rpc_cmd nvmf_subsystem_remove_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:c758a4ed-f09f-4c82-9afb-3d096f035464 00:17:46.823 11:28:42 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:17:46.823 11:28:42 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:17:46.823 11:28:42 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:17:46.823 11:28:42 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@120 -- # for keyid in "${!keys[@]}" 00:17:46.823 11:28:42 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@121 -- # hostrpc bdev_nvme_set_options --dhchap-digests sha384 --dhchap-dhgroups ffdhe6144 00:17:46.823 11:28:42 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_set_options --dhchap-digests sha384 --dhchap-dhgroups ffdhe6144 00:17:47.081 11:28:42 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@123 -- # connect_authenticate sha384 ffdhe6144 3 00:17:47.081 11:28:42 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@65 -- # local digest dhgroup key ckey qpairs 00:17:47.081 11:28:42 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # digest=sha384 00:17:47.081 11:28:42 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # dhgroup=ffdhe6144 00:17:47.081 11:28:42 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # key=key3 00:17:47.081 11:28:42 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@68 -- # ckey=(${ckeys[$3]:+--dhchap-ctrlr-key "ckey$3"}) 00:17:47.081 11:28:42 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@70 -- # rpc_cmd nvmf_subsystem_add_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:c758a4ed-f09f-4c82-9afb-3d096f035464 --dhchap-key key3 00:17:47.081 11:28:42 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:17:47.081 11:28:42 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:17:47.081 11:28:42 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:17:47.082 11:28:42 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@71 -- # bdev_connect -b nvme0 --dhchap-key key3 00:17:47.082 11:28:42 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@60 -- # hostrpc bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.3 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:c758a4ed-f09f-4c82-9afb-3d096f035464 -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key3 00:17:47.082 11:28:42 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.3 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:c758a4ed-f09f-4c82-9afb-3d096f035464 -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key3 00:17:47.647 00:17:47.647 11:28:43 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # hostrpc bdev_nvme_get_controllers 00:17:47.647 11:28:43 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_get_controllers 00:17:47.647 11:28:43 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # jq -r '.[].name' 00:17:47.904 11:28:43 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:17:48.162 11:28:43 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@74 -- # rpc_cmd nvmf_subsystem_get_qpairs nqn.2024-03.io.spdk:cnode0 00:17:48.162 11:28:43 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:17:48.162 11:28:43 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:17:48.162 11:28:43 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:17:48.162 11:28:43 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@74 -- # qpairs='[ 00:17:48.162 { 00:17:48.162 "auth": { 00:17:48.162 "dhgroup": "ffdhe6144", 00:17:48.162 "digest": "sha384", 00:17:48.162 "state": "completed" 00:17:48.162 }, 00:17:48.162 "cntlid": 87, 00:17:48.162 "hostnqn": "nqn.2014-08.org.nvmexpress:uuid:c758a4ed-f09f-4c82-9afb-3d096f035464", 00:17:48.162 "listen_address": { 00:17:48.162 "adrfam": "IPv4", 00:17:48.162 "traddr": "10.0.0.3", 00:17:48.162 "trsvcid": "4420", 00:17:48.162 "trtype": "TCP" 00:17:48.162 }, 00:17:48.162 "peer_address": { 00:17:48.162 "adrfam": "IPv4", 00:17:48.162 "traddr": "10.0.0.1", 00:17:48.162 "trsvcid": "37976", 00:17:48.162 "trtype": "TCP" 00:17:48.162 }, 00:17:48.162 "qid": 0, 00:17:48.162 "state": "enabled", 00:17:48.162 "thread": "nvmf_tgt_poll_group_000" 00:17:48.162 } 00:17:48.162 ]' 00:17:48.162 11:28:43 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@75 -- # jq -r '.[0].auth.digest' 00:17:48.162 11:28:43 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@75 -- # [[ sha384 == \s\h\a\3\8\4 ]] 00:17:48.162 11:28:43 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@76 -- # jq -r '.[0].auth.dhgroup' 00:17:48.162 11:28:43 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@76 -- # [[ ffdhe6144 == \f\f\d\h\e\6\1\4\4 ]] 00:17:48.162 11:28:43 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@77 -- # jq -r '.[0].auth.state' 00:17:48.162 11:28:43 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@77 -- # [[ completed == \c\o\m\p\l\e\t\e\d ]] 00:17:48.162 11:28:43 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@78 -- # hostrpc bdev_nvme_detach_controller nvme0 00:17:48.162 11:28:43 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_detach_controller nvme0 00:17:48.420 11:28:43 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@80 -- # nvme_connect --dhchap-secret DHHC-1:03:YjUzYzRlNjQ2N2QwNDQ3ZGZhN2VhODUzYjlkY2I2OWViZWM1NzZiOTJiM2MwNzIxZWVkMmMxOTIzNWE5M2Q4MDbs9Og=: 00:17:48.420 11:28:43 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@36 -- # nvme connect -t tcp -a 10.0.0.3 -n nqn.2024-03.io.spdk:cnode0 -i 1 -q nqn.2014-08.org.nvmexpress:uuid:c758a4ed-f09f-4c82-9afb-3d096f035464 --hostid c758a4ed-f09f-4c82-9afb-3d096f035464 -l 0 --dhchap-secret DHHC-1:03:YjUzYzRlNjQ2N2QwNDQ3ZGZhN2VhODUzYjlkY2I2OWViZWM1NzZiOTJiM2MwNzIxZWVkMmMxOTIzNWE5M2Q4MDbs9Og=: 00:17:49.352 11:28:44 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@82 -- # nvme disconnect -n nqn.2024-03.io.spdk:cnode0 00:17:49.352 NQN:nqn.2024-03.io.spdk:cnode0 disconnected 1 controller(s) 00:17:49.352 11:28:44 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@83 -- # rpc_cmd nvmf_subsystem_remove_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:c758a4ed-f09f-4c82-9afb-3d096f035464 00:17:49.352 11:28:44 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:17:49.352 11:28:44 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:17:49.352 11:28:44 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:17:49.352 11:28:44 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@119 -- # for dhgroup in "${dhgroups[@]}" 00:17:49.352 11:28:44 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@120 -- # for keyid in "${!keys[@]}" 00:17:49.352 11:28:44 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@121 -- # hostrpc bdev_nvme_set_options --dhchap-digests sha384 --dhchap-dhgroups ffdhe8192 00:17:49.352 11:28:44 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_set_options --dhchap-digests sha384 --dhchap-dhgroups ffdhe8192 00:17:49.627 11:28:44 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@123 -- # connect_authenticate sha384 ffdhe8192 0 00:17:49.627 11:28:44 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@65 -- # local digest dhgroup key ckey qpairs 00:17:49.627 11:28:44 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # digest=sha384 00:17:49.627 11:28:44 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # dhgroup=ffdhe8192 00:17:49.627 11:28:44 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # key=key0 00:17:49.627 11:28:44 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@68 -- # ckey=(${ckeys[$3]:+--dhchap-ctrlr-key "ckey$3"}) 00:17:49.627 11:28:44 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@70 -- # rpc_cmd nvmf_subsystem_add_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:c758a4ed-f09f-4c82-9afb-3d096f035464 --dhchap-key key0 --dhchap-ctrlr-key ckey0 00:17:49.627 11:28:44 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:17:49.627 11:28:44 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:17:49.627 11:28:44 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:17:49.627 11:28:44 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@71 -- # bdev_connect -b nvme0 --dhchap-key key0 --dhchap-ctrlr-key ckey0 00:17:49.627 11:28:44 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@60 -- # hostrpc bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.3 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:c758a4ed-f09f-4c82-9afb-3d096f035464 -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key0 --dhchap-ctrlr-key ckey0 00:17:49.627 11:28:44 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.3 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:c758a4ed-f09f-4c82-9afb-3d096f035464 -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key0 --dhchap-ctrlr-key ckey0 00:17:50.201 00:17:50.201 11:28:45 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # hostrpc bdev_nvme_get_controllers 00:17:50.201 11:28:45 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_get_controllers 00:17:50.201 11:28:45 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # jq -r '.[].name' 00:17:50.766 11:28:46 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:17:50.766 11:28:46 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@74 -- # rpc_cmd nvmf_subsystem_get_qpairs nqn.2024-03.io.spdk:cnode0 00:17:50.766 11:28:46 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:17:50.766 11:28:46 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:17:50.766 11:28:46 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:17:50.766 11:28:46 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@74 -- # qpairs='[ 00:17:50.766 { 00:17:50.766 "auth": { 00:17:50.766 "dhgroup": "ffdhe8192", 00:17:50.766 "digest": "sha384", 00:17:50.766 "state": "completed" 00:17:50.766 }, 00:17:50.766 "cntlid": 89, 00:17:50.766 "hostnqn": "nqn.2014-08.org.nvmexpress:uuid:c758a4ed-f09f-4c82-9afb-3d096f035464", 00:17:50.766 "listen_address": { 00:17:50.766 "adrfam": "IPv4", 00:17:50.766 "traddr": "10.0.0.3", 00:17:50.766 "trsvcid": "4420", 00:17:50.766 "trtype": "TCP" 00:17:50.766 }, 00:17:50.766 "peer_address": { 00:17:50.766 "adrfam": "IPv4", 00:17:50.766 "traddr": "10.0.0.1", 00:17:50.766 "trsvcid": "37992", 00:17:50.766 "trtype": "TCP" 00:17:50.766 }, 00:17:50.766 "qid": 0, 00:17:50.766 "state": "enabled", 00:17:50.766 "thread": "nvmf_tgt_poll_group_000" 00:17:50.766 } 00:17:50.766 ]' 00:17:50.766 11:28:46 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@75 -- # jq -r '.[0].auth.digest' 00:17:50.766 11:28:46 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@75 -- # [[ sha384 == \s\h\a\3\8\4 ]] 00:17:50.766 11:28:46 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@76 -- # jq -r '.[0].auth.dhgroup' 00:17:50.766 11:28:46 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@76 -- # [[ ffdhe8192 == \f\f\d\h\e\8\1\9\2 ]] 00:17:50.766 11:28:46 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@77 -- # jq -r '.[0].auth.state' 00:17:50.766 11:28:46 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@77 -- # [[ completed == \c\o\m\p\l\e\t\e\d ]] 00:17:50.766 11:28:46 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@78 -- # hostrpc bdev_nvme_detach_controller nvme0 00:17:50.766 11:28:46 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_detach_controller nvme0 00:17:51.024 11:28:46 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@80 -- # nvme_connect --dhchap-secret DHHC-1:00:YTQ3MDY2OWMxZDcwN2QyZmRhNGVmYjYzYTczYTM4NzAwYjdiNTBmZmE2ZDBlZTc28YG94Q==: --dhchap-ctrl-secret DHHC-1:03:YmY1NDQyMjdhMGU5ZDk3NGFiYTIyMTE1OTgzNGQ4ZDQ0MTE3YmFjMTc3MGQ4NDRlOTU5MThlODc5YzUxNGM2Y9nOg8I=: 00:17:51.024 11:28:46 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@36 -- # nvme connect -t tcp -a 10.0.0.3 -n nqn.2024-03.io.spdk:cnode0 -i 1 -q nqn.2014-08.org.nvmexpress:uuid:c758a4ed-f09f-4c82-9afb-3d096f035464 --hostid c758a4ed-f09f-4c82-9afb-3d096f035464 -l 0 --dhchap-secret DHHC-1:00:YTQ3MDY2OWMxZDcwN2QyZmRhNGVmYjYzYTczYTM4NzAwYjdiNTBmZmE2ZDBlZTc28YG94Q==: --dhchap-ctrl-secret DHHC-1:03:YmY1NDQyMjdhMGU5ZDk3NGFiYTIyMTE1OTgzNGQ4ZDQ0MTE3YmFjMTc3MGQ4NDRlOTU5MThlODc5YzUxNGM2Y9nOg8I=: 00:17:51.957 11:28:47 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@82 -- # nvme disconnect -n nqn.2024-03.io.spdk:cnode0 00:17:51.957 NQN:nqn.2024-03.io.spdk:cnode0 disconnected 1 controller(s) 00:17:51.957 11:28:47 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@83 -- # rpc_cmd nvmf_subsystem_remove_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:c758a4ed-f09f-4c82-9afb-3d096f035464 00:17:51.957 11:28:47 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:17:51.957 11:28:47 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:17:51.957 11:28:47 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:17:51.957 11:28:47 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@120 -- # for keyid in "${!keys[@]}" 00:17:51.957 11:28:47 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@121 -- # hostrpc bdev_nvme_set_options --dhchap-digests sha384 --dhchap-dhgroups ffdhe8192 00:17:51.957 11:28:47 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_set_options --dhchap-digests sha384 --dhchap-dhgroups ffdhe8192 00:17:52.216 11:28:47 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@123 -- # connect_authenticate sha384 ffdhe8192 1 00:17:52.216 11:28:47 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@65 -- # local digest dhgroup key ckey qpairs 00:17:52.216 11:28:47 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # digest=sha384 00:17:52.216 11:28:47 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # dhgroup=ffdhe8192 00:17:52.216 11:28:47 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # key=key1 00:17:52.216 11:28:47 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@68 -- # ckey=(${ckeys[$3]:+--dhchap-ctrlr-key "ckey$3"}) 00:17:52.216 11:28:47 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@70 -- # rpc_cmd nvmf_subsystem_add_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:c758a4ed-f09f-4c82-9afb-3d096f035464 --dhchap-key key1 --dhchap-ctrlr-key ckey1 00:17:52.216 11:28:47 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:17:52.216 11:28:47 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:17:52.216 11:28:47 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:17:52.216 11:28:47 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@71 -- # bdev_connect -b nvme0 --dhchap-key key1 --dhchap-ctrlr-key ckey1 00:17:52.216 11:28:47 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@60 -- # hostrpc bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.3 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:c758a4ed-f09f-4c82-9afb-3d096f035464 -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key1 --dhchap-ctrlr-key ckey1 00:17:52.216 11:28:47 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.3 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:c758a4ed-f09f-4c82-9afb-3d096f035464 -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key1 --dhchap-ctrlr-key ckey1 00:17:53.150 00:17:53.150 11:28:48 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # hostrpc bdev_nvme_get_controllers 00:17:53.150 11:28:48 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # jq -r '.[].name' 00:17:53.150 11:28:48 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_get_controllers 00:17:53.409 11:28:48 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:17:53.409 11:28:48 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@74 -- # rpc_cmd nvmf_subsystem_get_qpairs nqn.2024-03.io.spdk:cnode0 00:17:53.409 11:28:48 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:17:53.409 11:28:48 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:17:53.409 11:28:48 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:17:53.409 11:28:48 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@74 -- # qpairs='[ 00:17:53.409 { 00:17:53.409 "auth": { 00:17:53.409 "dhgroup": "ffdhe8192", 00:17:53.409 "digest": "sha384", 00:17:53.409 "state": "completed" 00:17:53.409 }, 00:17:53.409 "cntlid": 91, 00:17:53.409 "hostnqn": "nqn.2014-08.org.nvmexpress:uuid:c758a4ed-f09f-4c82-9afb-3d096f035464", 00:17:53.409 "listen_address": { 00:17:53.409 "adrfam": "IPv4", 00:17:53.409 "traddr": "10.0.0.3", 00:17:53.409 "trsvcid": "4420", 00:17:53.409 "trtype": "TCP" 00:17:53.409 }, 00:17:53.409 "peer_address": { 00:17:53.409 "adrfam": "IPv4", 00:17:53.409 "traddr": "10.0.0.1", 00:17:53.409 "trsvcid": "38024", 00:17:53.409 "trtype": "TCP" 00:17:53.409 }, 00:17:53.409 "qid": 0, 00:17:53.409 "state": "enabled", 00:17:53.409 "thread": "nvmf_tgt_poll_group_000" 00:17:53.409 } 00:17:53.409 ]' 00:17:53.409 11:28:48 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@75 -- # jq -r '.[0].auth.digest' 00:17:53.409 11:28:48 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@75 -- # [[ sha384 == \s\h\a\3\8\4 ]] 00:17:53.409 11:28:48 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@76 -- # jq -r '.[0].auth.dhgroup' 00:17:53.409 11:28:48 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@76 -- # [[ ffdhe8192 == \f\f\d\h\e\8\1\9\2 ]] 00:17:53.409 11:28:48 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@77 -- # jq -r '.[0].auth.state' 00:17:53.409 11:28:48 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@77 -- # [[ completed == \c\o\m\p\l\e\t\e\d ]] 00:17:53.409 11:28:48 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@78 -- # hostrpc bdev_nvme_detach_controller nvme0 00:17:53.409 11:28:48 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_detach_controller nvme0 00:17:53.974 11:28:49 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@80 -- # nvme_connect --dhchap-secret DHHC-1:01:YTU2ZTRiMDFkMzNiMjFmN2QwNTBiYjliMGJkYjQwZTTsDgGm: --dhchap-ctrl-secret DHHC-1:02:ZjZjOWFiZGJhYjc3NzkxOGQwNGZmNTA0MTE0MjkzYmVkODZmYTJjNzcyZDM2NjYxWbIiww==: 00:17:53.974 11:28:49 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@36 -- # nvme connect -t tcp -a 10.0.0.3 -n nqn.2024-03.io.spdk:cnode0 -i 1 -q nqn.2014-08.org.nvmexpress:uuid:c758a4ed-f09f-4c82-9afb-3d096f035464 --hostid c758a4ed-f09f-4c82-9afb-3d096f035464 -l 0 --dhchap-secret DHHC-1:01:YTU2ZTRiMDFkMzNiMjFmN2QwNTBiYjliMGJkYjQwZTTsDgGm: --dhchap-ctrl-secret DHHC-1:02:ZjZjOWFiZGJhYjc3NzkxOGQwNGZmNTA0MTE0MjkzYmVkODZmYTJjNzcyZDM2NjYxWbIiww==: 00:17:54.540 11:28:49 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@82 -- # nvme disconnect -n nqn.2024-03.io.spdk:cnode0 00:17:54.540 NQN:nqn.2024-03.io.spdk:cnode0 disconnected 1 controller(s) 00:17:54.540 11:28:49 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@83 -- # rpc_cmd nvmf_subsystem_remove_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:c758a4ed-f09f-4c82-9afb-3d096f035464 00:17:54.540 11:28:49 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:17:54.540 11:28:49 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:17:54.540 11:28:49 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:17:54.540 11:28:49 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@120 -- # for keyid in "${!keys[@]}" 00:17:54.540 11:28:49 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@121 -- # hostrpc bdev_nvme_set_options --dhchap-digests sha384 --dhchap-dhgroups ffdhe8192 00:17:54.540 11:28:49 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_set_options --dhchap-digests sha384 --dhchap-dhgroups ffdhe8192 00:17:55.105 11:28:50 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@123 -- # connect_authenticate sha384 ffdhe8192 2 00:17:55.106 11:28:50 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@65 -- # local digest dhgroup key ckey qpairs 00:17:55.106 11:28:50 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # digest=sha384 00:17:55.106 11:28:50 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # dhgroup=ffdhe8192 00:17:55.106 11:28:50 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # key=key2 00:17:55.106 11:28:50 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@68 -- # ckey=(${ckeys[$3]:+--dhchap-ctrlr-key "ckey$3"}) 00:17:55.106 11:28:50 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@70 -- # rpc_cmd nvmf_subsystem_add_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:c758a4ed-f09f-4c82-9afb-3d096f035464 --dhchap-key key2 --dhchap-ctrlr-key ckey2 00:17:55.106 11:28:50 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:17:55.106 11:28:50 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:17:55.106 11:28:50 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:17:55.106 11:28:50 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@71 -- # bdev_connect -b nvme0 --dhchap-key key2 --dhchap-ctrlr-key ckey2 00:17:55.106 11:28:50 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@60 -- # hostrpc bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.3 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:c758a4ed-f09f-4c82-9afb-3d096f035464 -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key2 --dhchap-ctrlr-key ckey2 00:17:55.106 11:28:50 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.3 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:c758a4ed-f09f-4c82-9afb-3d096f035464 -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key2 --dhchap-ctrlr-key ckey2 00:17:55.672 00:17:55.672 11:28:51 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # hostrpc bdev_nvme_get_controllers 00:17:55.672 11:28:51 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # jq -r '.[].name' 00:17:55.672 11:28:51 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_get_controllers 00:17:55.930 11:28:51 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:17:55.930 11:28:51 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@74 -- # rpc_cmd nvmf_subsystem_get_qpairs nqn.2024-03.io.spdk:cnode0 00:17:55.931 11:28:51 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:17:55.931 11:28:51 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:17:55.931 11:28:51 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:17:55.931 11:28:51 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@74 -- # qpairs='[ 00:17:55.931 { 00:17:55.931 "auth": { 00:17:55.931 "dhgroup": "ffdhe8192", 00:17:55.931 "digest": "sha384", 00:17:55.931 "state": "completed" 00:17:55.931 }, 00:17:55.931 "cntlid": 93, 00:17:55.931 "hostnqn": "nqn.2014-08.org.nvmexpress:uuid:c758a4ed-f09f-4c82-9afb-3d096f035464", 00:17:55.931 "listen_address": { 00:17:55.931 "adrfam": "IPv4", 00:17:55.931 "traddr": "10.0.0.3", 00:17:55.931 "trsvcid": "4420", 00:17:55.931 "trtype": "TCP" 00:17:55.931 }, 00:17:55.931 "peer_address": { 00:17:55.931 "adrfam": "IPv4", 00:17:55.931 "traddr": "10.0.0.1", 00:17:55.931 "trsvcid": "38056", 00:17:55.931 "trtype": "TCP" 00:17:55.931 }, 00:17:55.931 "qid": 0, 00:17:55.931 "state": "enabled", 00:17:55.931 "thread": "nvmf_tgt_poll_group_000" 00:17:55.931 } 00:17:55.931 ]' 00:17:55.931 11:28:51 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@75 -- # jq -r '.[0].auth.digest' 00:17:56.191 11:28:51 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@75 -- # [[ sha384 == \s\h\a\3\8\4 ]] 00:17:56.191 11:28:51 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@76 -- # jq -r '.[0].auth.dhgroup' 00:17:56.191 11:28:51 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@76 -- # [[ ffdhe8192 == \f\f\d\h\e\8\1\9\2 ]] 00:17:56.191 11:28:51 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@77 -- # jq -r '.[0].auth.state' 00:17:56.191 11:28:51 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@77 -- # [[ completed == \c\o\m\p\l\e\t\e\d ]] 00:17:56.191 11:28:51 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@78 -- # hostrpc bdev_nvme_detach_controller nvme0 00:17:56.191 11:28:51 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_detach_controller nvme0 00:17:56.449 11:28:51 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@80 -- # nvme_connect --dhchap-secret DHHC-1:02:YjZiMDU3YTg1ZTA0NWQzMGY1ZWM0YzNmYzc1NDY1OWNkZmQ3NmU2YWM2ZDE3ZmVmgTRtHQ==: --dhchap-ctrl-secret DHHC-1:01:YmQ3ZDA4NWFiYjI3YjdjNWVjMzc4NDNiZTM4ZTU3N2a6gUZi: 00:17:56.450 11:28:51 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@36 -- # nvme connect -t tcp -a 10.0.0.3 -n nqn.2024-03.io.spdk:cnode0 -i 1 -q nqn.2014-08.org.nvmexpress:uuid:c758a4ed-f09f-4c82-9afb-3d096f035464 --hostid c758a4ed-f09f-4c82-9afb-3d096f035464 -l 0 --dhchap-secret DHHC-1:02:YjZiMDU3YTg1ZTA0NWQzMGY1ZWM0YzNmYzc1NDY1OWNkZmQ3NmU2YWM2ZDE3ZmVmgTRtHQ==: --dhchap-ctrl-secret DHHC-1:01:YmQ3ZDA4NWFiYjI3YjdjNWVjMzc4NDNiZTM4ZTU3N2a6gUZi: 00:17:57.385 11:28:52 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@82 -- # nvme disconnect -n nqn.2024-03.io.spdk:cnode0 00:17:57.385 NQN:nqn.2024-03.io.spdk:cnode0 disconnected 1 controller(s) 00:17:57.385 11:28:52 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@83 -- # rpc_cmd nvmf_subsystem_remove_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:c758a4ed-f09f-4c82-9afb-3d096f035464 00:17:57.385 11:28:52 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:17:57.385 11:28:52 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:17:57.385 11:28:52 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:17:57.385 11:28:52 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@120 -- # for keyid in "${!keys[@]}" 00:17:57.385 11:28:52 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@121 -- # hostrpc bdev_nvme_set_options --dhchap-digests sha384 --dhchap-dhgroups ffdhe8192 00:17:57.385 11:28:52 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_set_options --dhchap-digests sha384 --dhchap-dhgroups ffdhe8192 00:17:57.643 11:28:52 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@123 -- # connect_authenticate sha384 ffdhe8192 3 00:17:57.643 11:28:52 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@65 -- # local digest dhgroup key ckey qpairs 00:17:57.643 11:28:52 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # digest=sha384 00:17:57.643 11:28:52 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # dhgroup=ffdhe8192 00:17:57.643 11:28:52 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # key=key3 00:17:57.643 11:28:52 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@68 -- # ckey=(${ckeys[$3]:+--dhchap-ctrlr-key "ckey$3"}) 00:17:57.643 11:28:52 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@70 -- # rpc_cmd nvmf_subsystem_add_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:c758a4ed-f09f-4c82-9afb-3d096f035464 --dhchap-key key3 00:17:57.643 11:28:52 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:17:57.643 11:28:52 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:17:57.643 11:28:53 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:17:57.643 11:28:53 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@71 -- # bdev_connect -b nvme0 --dhchap-key key3 00:17:57.643 11:28:53 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@60 -- # hostrpc bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.3 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:c758a4ed-f09f-4c82-9afb-3d096f035464 -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key3 00:17:57.643 11:28:53 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.3 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:c758a4ed-f09f-4c82-9afb-3d096f035464 -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key3 00:17:58.208 00:17:58.208 11:28:53 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # jq -r '.[].name' 00:17:58.208 11:28:53 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # hostrpc bdev_nvme_get_controllers 00:17:58.208 11:28:53 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_get_controllers 00:17:58.774 11:28:54 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:17:58.774 11:28:54 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@74 -- # rpc_cmd nvmf_subsystem_get_qpairs nqn.2024-03.io.spdk:cnode0 00:17:58.774 11:28:54 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:17:58.774 11:28:54 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:17:58.774 11:28:54 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:17:58.774 11:28:54 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@74 -- # qpairs='[ 00:17:58.774 { 00:17:58.774 "auth": { 00:17:58.774 "dhgroup": "ffdhe8192", 00:17:58.774 "digest": "sha384", 00:17:58.774 "state": "completed" 00:17:58.774 }, 00:17:58.774 "cntlid": 95, 00:17:58.774 "hostnqn": "nqn.2014-08.org.nvmexpress:uuid:c758a4ed-f09f-4c82-9afb-3d096f035464", 00:17:58.774 "listen_address": { 00:17:58.774 "adrfam": "IPv4", 00:17:58.774 "traddr": "10.0.0.3", 00:17:58.774 "trsvcid": "4420", 00:17:58.774 "trtype": "TCP" 00:17:58.774 }, 00:17:58.774 "peer_address": { 00:17:58.774 "adrfam": "IPv4", 00:17:58.774 "traddr": "10.0.0.1", 00:17:58.774 "trsvcid": "54678", 00:17:58.774 "trtype": "TCP" 00:17:58.774 }, 00:17:58.774 "qid": 0, 00:17:58.774 "state": "enabled", 00:17:58.774 "thread": "nvmf_tgt_poll_group_000" 00:17:58.774 } 00:17:58.774 ]' 00:17:58.774 11:28:54 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@75 -- # jq -r '.[0].auth.digest' 00:17:58.774 11:28:54 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@75 -- # [[ sha384 == \s\h\a\3\8\4 ]] 00:17:58.774 11:28:54 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@76 -- # jq -r '.[0].auth.dhgroup' 00:17:58.774 11:28:54 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@76 -- # [[ ffdhe8192 == \f\f\d\h\e\8\1\9\2 ]] 00:17:58.774 11:28:54 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@77 -- # jq -r '.[0].auth.state' 00:17:58.774 11:28:54 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@77 -- # [[ completed == \c\o\m\p\l\e\t\e\d ]] 00:17:58.774 11:28:54 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@78 -- # hostrpc bdev_nvme_detach_controller nvme0 00:17:58.774 11:28:54 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_detach_controller nvme0 00:17:59.032 11:28:54 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@80 -- # nvme_connect --dhchap-secret DHHC-1:03:YjUzYzRlNjQ2N2QwNDQ3ZGZhN2VhODUzYjlkY2I2OWViZWM1NzZiOTJiM2MwNzIxZWVkMmMxOTIzNWE5M2Q4MDbs9Og=: 00:17:59.032 11:28:54 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@36 -- # nvme connect -t tcp -a 10.0.0.3 -n nqn.2024-03.io.spdk:cnode0 -i 1 -q nqn.2014-08.org.nvmexpress:uuid:c758a4ed-f09f-4c82-9afb-3d096f035464 --hostid c758a4ed-f09f-4c82-9afb-3d096f035464 -l 0 --dhchap-secret DHHC-1:03:YjUzYzRlNjQ2N2QwNDQ3ZGZhN2VhODUzYjlkY2I2OWViZWM1NzZiOTJiM2MwNzIxZWVkMmMxOTIzNWE5M2Q4MDbs9Og=: 00:17:59.967 11:28:55 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@82 -- # nvme disconnect -n nqn.2024-03.io.spdk:cnode0 00:17:59.967 NQN:nqn.2024-03.io.spdk:cnode0 disconnected 1 controller(s) 00:17:59.967 11:28:55 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@83 -- # rpc_cmd nvmf_subsystem_remove_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:c758a4ed-f09f-4c82-9afb-3d096f035464 00:17:59.967 11:28:55 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:17:59.967 11:28:55 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:17:59.967 11:28:55 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:17:59.967 11:28:55 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@118 -- # for digest in "${digests[@]}" 00:17:59.967 11:28:55 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@119 -- # for dhgroup in "${dhgroups[@]}" 00:17:59.967 11:28:55 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@120 -- # for keyid in "${!keys[@]}" 00:17:59.967 11:28:55 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@121 -- # hostrpc bdev_nvme_set_options --dhchap-digests sha512 --dhchap-dhgroups null 00:17:59.967 11:28:55 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_set_options --dhchap-digests sha512 --dhchap-dhgroups null 00:18:00.225 11:28:55 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@123 -- # connect_authenticate sha512 null 0 00:18:00.225 11:28:55 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@65 -- # local digest dhgroup key ckey qpairs 00:18:00.225 11:28:55 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # digest=sha512 00:18:00.225 11:28:55 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # dhgroup=null 00:18:00.225 11:28:55 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # key=key0 00:18:00.226 11:28:55 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@68 -- # ckey=(${ckeys[$3]:+--dhchap-ctrlr-key "ckey$3"}) 00:18:00.226 11:28:55 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@70 -- # rpc_cmd nvmf_subsystem_add_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:c758a4ed-f09f-4c82-9afb-3d096f035464 --dhchap-key key0 --dhchap-ctrlr-key ckey0 00:18:00.226 11:28:55 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:00.226 11:28:55 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:18:00.226 11:28:55 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:00.226 11:28:55 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@71 -- # bdev_connect -b nvme0 --dhchap-key key0 --dhchap-ctrlr-key ckey0 00:18:00.226 11:28:55 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@60 -- # hostrpc bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.3 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:c758a4ed-f09f-4c82-9afb-3d096f035464 -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key0 --dhchap-ctrlr-key ckey0 00:18:00.226 11:28:55 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.3 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:c758a4ed-f09f-4c82-9afb-3d096f035464 -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key0 --dhchap-ctrlr-key ckey0 00:18:00.489 00:18:00.489 11:28:55 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # hostrpc bdev_nvme_get_controllers 00:18:00.489 11:28:55 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_get_controllers 00:18:00.489 11:28:55 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # jq -r '.[].name' 00:18:01.060 11:28:56 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:18:01.060 11:28:56 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@74 -- # rpc_cmd nvmf_subsystem_get_qpairs nqn.2024-03.io.spdk:cnode0 00:18:01.060 11:28:56 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:01.060 11:28:56 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:18:01.060 11:28:56 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:01.060 11:28:56 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@74 -- # qpairs='[ 00:18:01.060 { 00:18:01.060 "auth": { 00:18:01.060 "dhgroup": "null", 00:18:01.060 "digest": "sha512", 00:18:01.060 "state": "completed" 00:18:01.060 }, 00:18:01.060 "cntlid": 97, 00:18:01.060 "hostnqn": "nqn.2014-08.org.nvmexpress:uuid:c758a4ed-f09f-4c82-9afb-3d096f035464", 00:18:01.060 "listen_address": { 00:18:01.060 "adrfam": "IPv4", 00:18:01.060 "traddr": "10.0.0.3", 00:18:01.060 "trsvcid": "4420", 00:18:01.060 "trtype": "TCP" 00:18:01.060 }, 00:18:01.060 "peer_address": { 00:18:01.060 "adrfam": "IPv4", 00:18:01.060 "traddr": "10.0.0.1", 00:18:01.060 "trsvcid": "54694", 00:18:01.060 "trtype": "TCP" 00:18:01.060 }, 00:18:01.060 "qid": 0, 00:18:01.060 "state": "enabled", 00:18:01.060 "thread": "nvmf_tgt_poll_group_000" 00:18:01.060 } 00:18:01.060 ]' 00:18:01.060 11:28:56 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@75 -- # jq -r '.[0].auth.digest' 00:18:01.060 11:28:56 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@75 -- # [[ sha512 == \s\h\a\5\1\2 ]] 00:18:01.060 11:28:56 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@76 -- # jq -r '.[0].auth.dhgroup' 00:18:01.060 11:28:56 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@76 -- # [[ null == \n\u\l\l ]] 00:18:01.060 11:28:56 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@77 -- # jq -r '.[0].auth.state' 00:18:01.060 11:28:56 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@77 -- # [[ completed == \c\o\m\p\l\e\t\e\d ]] 00:18:01.060 11:28:56 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@78 -- # hostrpc bdev_nvme_detach_controller nvme0 00:18:01.060 11:28:56 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_detach_controller nvme0 00:18:01.318 11:28:56 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@80 -- # nvme_connect --dhchap-secret DHHC-1:00:YTQ3MDY2OWMxZDcwN2QyZmRhNGVmYjYzYTczYTM4NzAwYjdiNTBmZmE2ZDBlZTc28YG94Q==: --dhchap-ctrl-secret DHHC-1:03:YmY1NDQyMjdhMGU5ZDk3NGFiYTIyMTE1OTgzNGQ4ZDQ0MTE3YmFjMTc3MGQ4NDRlOTU5MThlODc5YzUxNGM2Y9nOg8I=: 00:18:01.318 11:28:56 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@36 -- # nvme connect -t tcp -a 10.0.0.3 -n nqn.2024-03.io.spdk:cnode0 -i 1 -q nqn.2014-08.org.nvmexpress:uuid:c758a4ed-f09f-4c82-9afb-3d096f035464 --hostid c758a4ed-f09f-4c82-9afb-3d096f035464 -l 0 --dhchap-secret DHHC-1:00:YTQ3MDY2OWMxZDcwN2QyZmRhNGVmYjYzYTczYTM4NzAwYjdiNTBmZmE2ZDBlZTc28YG94Q==: --dhchap-ctrl-secret DHHC-1:03:YmY1NDQyMjdhMGU5ZDk3NGFiYTIyMTE1OTgzNGQ4ZDQ0MTE3YmFjMTc3MGQ4NDRlOTU5MThlODc5YzUxNGM2Y9nOg8I=: 00:18:02.251 11:28:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@82 -- # nvme disconnect -n nqn.2024-03.io.spdk:cnode0 00:18:02.251 NQN:nqn.2024-03.io.spdk:cnode0 disconnected 1 controller(s) 00:18:02.251 11:28:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@83 -- # rpc_cmd nvmf_subsystem_remove_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:c758a4ed-f09f-4c82-9afb-3d096f035464 00:18:02.251 11:28:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:02.251 11:28:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:18:02.251 11:28:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:02.251 11:28:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@120 -- # for keyid in "${!keys[@]}" 00:18:02.251 11:28:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@121 -- # hostrpc bdev_nvme_set_options --dhchap-digests sha512 --dhchap-dhgroups null 00:18:02.251 11:28:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_set_options --dhchap-digests sha512 --dhchap-dhgroups null 00:18:02.509 11:28:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@123 -- # connect_authenticate sha512 null 1 00:18:02.509 11:28:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@65 -- # local digest dhgroup key ckey qpairs 00:18:02.509 11:28:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # digest=sha512 00:18:02.509 11:28:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # dhgroup=null 00:18:02.509 11:28:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # key=key1 00:18:02.509 11:28:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@68 -- # ckey=(${ckeys[$3]:+--dhchap-ctrlr-key "ckey$3"}) 00:18:02.509 11:28:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@70 -- # rpc_cmd nvmf_subsystem_add_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:c758a4ed-f09f-4c82-9afb-3d096f035464 --dhchap-key key1 --dhchap-ctrlr-key ckey1 00:18:02.509 11:28:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:02.509 11:28:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:18:02.509 11:28:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:02.509 11:28:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@71 -- # bdev_connect -b nvme0 --dhchap-key key1 --dhchap-ctrlr-key ckey1 00:18:02.509 11:28:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@60 -- # hostrpc bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.3 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:c758a4ed-f09f-4c82-9afb-3d096f035464 -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key1 --dhchap-ctrlr-key ckey1 00:18:02.509 11:28:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.3 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:c758a4ed-f09f-4c82-9afb-3d096f035464 -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key1 --dhchap-ctrlr-key ckey1 00:18:02.768 00:18:02.768 11:28:58 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # jq -r '.[].name' 00:18:02.768 11:28:58 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # hostrpc bdev_nvme_get_controllers 00:18:02.768 11:28:58 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_get_controllers 00:18:03.025 11:28:58 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:18:03.025 11:28:58 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@74 -- # rpc_cmd nvmf_subsystem_get_qpairs nqn.2024-03.io.spdk:cnode0 00:18:03.025 11:28:58 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:03.025 11:28:58 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:18:03.025 11:28:58 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:03.025 11:28:58 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@74 -- # qpairs='[ 00:18:03.025 { 00:18:03.025 "auth": { 00:18:03.025 "dhgroup": "null", 00:18:03.025 "digest": "sha512", 00:18:03.025 "state": "completed" 00:18:03.025 }, 00:18:03.025 "cntlid": 99, 00:18:03.025 "hostnqn": "nqn.2014-08.org.nvmexpress:uuid:c758a4ed-f09f-4c82-9afb-3d096f035464", 00:18:03.025 "listen_address": { 00:18:03.025 "adrfam": "IPv4", 00:18:03.025 "traddr": "10.0.0.3", 00:18:03.025 "trsvcid": "4420", 00:18:03.025 "trtype": "TCP" 00:18:03.025 }, 00:18:03.025 "peer_address": { 00:18:03.025 "adrfam": "IPv4", 00:18:03.025 "traddr": "10.0.0.1", 00:18:03.025 "trsvcid": "54708", 00:18:03.025 "trtype": "TCP" 00:18:03.025 }, 00:18:03.025 "qid": 0, 00:18:03.025 "state": "enabled", 00:18:03.025 "thread": "nvmf_tgt_poll_group_000" 00:18:03.025 } 00:18:03.025 ]' 00:18:03.283 11:28:58 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@75 -- # jq -r '.[0].auth.digest' 00:18:03.283 11:28:58 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@75 -- # [[ sha512 == \s\h\a\5\1\2 ]] 00:18:03.283 11:28:58 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@76 -- # jq -r '.[0].auth.dhgroup' 00:18:03.283 11:28:58 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@76 -- # [[ null == \n\u\l\l ]] 00:18:03.283 11:28:58 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@77 -- # jq -r '.[0].auth.state' 00:18:03.283 11:28:58 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@77 -- # [[ completed == \c\o\m\p\l\e\t\e\d ]] 00:18:03.283 11:28:58 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@78 -- # hostrpc bdev_nvme_detach_controller nvme0 00:18:03.283 11:28:58 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_detach_controller nvme0 00:18:03.542 11:28:59 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@80 -- # nvme_connect --dhchap-secret DHHC-1:01:YTU2ZTRiMDFkMzNiMjFmN2QwNTBiYjliMGJkYjQwZTTsDgGm: --dhchap-ctrl-secret DHHC-1:02:ZjZjOWFiZGJhYjc3NzkxOGQwNGZmNTA0MTE0MjkzYmVkODZmYTJjNzcyZDM2NjYxWbIiww==: 00:18:03.542 11:28:59 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@36 -- # nvme connect -t tcp -a 10.0.0.3 -n nqn.2024-03.io.spdk:cnode0 -i 1 -q nqn.2014-08.org.nvmexpress:uuid:c758a4ed-f09f-4c82-9afb-3d096f035464 --hostid c758a4ed-f09f-4c82-9afb-3d096f035464 -l 0 --dhchap-secret DHHC-1:01:YTU2ZTRiMDFkMzNiMjFmN2QwNTBiYjliMGJkYjQwZTTsDgGm: --dhchap-ctrl-secret DHHC-1:02:ZjZjOWFiZGJhYjc3NzkxOGQwNGZmNTA0MTE0MjkzYmVkODZmYTJjNzcyZDM2NjYxWbIiww==: 00:18:04.476 11:28:59 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@82 -- # nvme disconnect -n nqn.2024-03.io.spdk:cnode0 00:18:04.476 NQN:nqn.2024-03.io.spdk:cnode0 disconnected 1 controller(s) 00:18:04.476 11:28:59 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@83 -- # rpc_cmd nvmf_subsystem_remove_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:c758a4ed-f09f-4c82-9afb-3d096f035464 00:18:04.476 11:28:59 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:04.476 11:28:59 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:18:04.476 11:28:59 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:04.476 11:28:59 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@120 -- # for keyid in "${!keys[@]}" 00:18:04.476 11:28:59 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@121 -- # hostrpc bdev_nvme_set_options --dhchap-digests sha512 --dhchap-dhgroups null 00:18:04.476 11:28:59 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_set_options --dhchap-digests sha512 --dhchap-dhgroups null 00:18:04.735 11:29:00 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@123 -- # connect_authenticate sha512 null 2 00:18:04.735 11:29:00 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@65 -- # local digest dhgroup key ckey qpairs 00:18:04.735 11:29:00 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # digest=sha512 00:18:04.735 11:29:00 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # dhgroup=null 00:18:04.735 11:29:00 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # key=key2 00:18:04.735 11:29:00 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@68 -- # ckey=(${ckeys[$3]:+--dhchap-ctrlr-key "ckey$3"}) 00:18:04.735 11:29:00 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@70 -- # rpc_cmd nvmf_subsystem_add_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:c758a4ed-f09f-4c82-9afb-3d096f035464 --dhchap-key key2 --dhchap-ctrlr-key ckey2 00:18:04.735 11:29:00 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:04.735 11:29:00 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:18:04.735 11:29:00 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:04.735 11:29:00 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@71 -- # bdev_connect -b nvme0 --dhchap-key key2 --dhchap-ctrlr-key ckey2 00:18:04.735 11:29:00 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@60 -- # hostrpc bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.3 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:c758a4ed-f09f-4c82-9afb-3d096f035464 -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key2 --dhchap-ctrlr-key ckey2 00:18:04.735 11:29:00 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.3 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:c758a4ed-f09f-4c82-9afb-3d096f035464 -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key2 --dhchap-ctrlr-key ckey2 00:18:04.993 00:18:04.993 11:29:00 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # hostrpc bdev_nvme_get_controllers 00:18:04.993 11:29:00 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_get_controllers 00:18:04.993 11:29:00 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # jq -r '.[].name' 00:18:05.251 11:29:00 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:18:05.251 11:29:00 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@74 -- # rpc_cmd nvmf_subsystem_get_qpairs nqn.2024-03.io.spdk:cnode0 00:18:05.251 11:29:00 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:05.251 11:29:00 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:18:05.509 11:29:00 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:05.509 11:29:00 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@74 -- # qpairs='[ 00:18:05.509 { 00:18:05.509 "auth": { 00:18:05.509 "dhgroup": "null", 00:18:05.509 "digest": "sha512", 00:18:05.509 "state": "completed" 00:18:05.509 }, 00:18:05.509 "cntlid": 101, 00:18:05.509 "hostnqn": "nqn.2014-08.org.nvmexpress:uuid:c758a4ed-f09f-4c82-9afb-3d096f035464", 00:18:05.509 "listen_address": { 00:18:05.509 "adrfam": "IPv4", 00:18:05.509 "traddr": "10.0.0.3", 00:18:05.509 "trsvcid": "4420", 00:18:05.509 "trtype": "TCP" 00:18:05.509 }, 00:18:05.509 "peer_address": { 00:18:05.509 "adrfam": "IPv4", 00:18:05.509 "traddr": "10.0.0.1", 00:18:05.509 "trsvcid": "54730", 00:18:05.509 "trtype": "TCP" 00:18:05.509 }, 00:18:05.509 "qid": 0, 00:18:05.509 "state": "enabled", 00:18:05.509 "thread": "nvmf_tgt_poll_group_000" 00:18:05.509 } 00:18:05.509 ]' 00:18:05.509 11:29:00 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@75 -- # jq -r '.[0].auth.digest' 00:18:05.509 11:29:00 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@75 -- # [[ sha512 == \s\h\a\5\1\2 ]] 00:18:05.509 11:29:00 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@76 -- # jq -r '.[0].auth.dhgroup' 00:18:05.509 11:29:00 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@76 -- # [[ null == \n\u\l\l ]] 00:18:05.509 11:29:00 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@77 -- # jq -r '.[0].auth.state' 00:18:05.509 11:29:00 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@77 -- # [[ completed == \c\o\m\p\l\e\t\e\d ]] 00:18:05.509 11:29:00 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@78 -- # hostrpc bdev_nvme_detach_controller nvme0 00:18:05.509 11:29:00 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_detach_controller nvme0 00:18:05.790 11:29:01 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@80 -- # nvme_connect --dhchap-secret DHHC-1:02:YjZiMDU3YTg1ZTA0NWQzMGY1ZWM0YzNmYzc1NDY1OWNkZmQ3NmU2YWM2ZDE3ZmVmgTRtHQ==: --dhchap-ctrl-secret DHHC-1:01:YmQ3ZDA4NWFiYjI3YjdjNWVjMzc4NDNiZTM4ZTU3N2a6gUZi: 00:18:05.790 11:29:01 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@36 -- # nvme connect -t tcp -a 10.0.0.3 -n nqn.2024-03.io.spdk:cnode0 -i 1 -q nqn.2014-08.org.nvmexpress:uuid:c758a4ed-f09f-4c82-9afb-3d096f035464 --hostid c758a4ed-f09f-4c82-9afb-3d096f035464 -l 0 --dhchap-secret DHHC-1:02:YjZiMDU3YTg1ZTA0NWQzMGY1ZWM0YzNmYzc1NDY1OWNkZmQ3NmU2YWM2ZDE3ZmVmgTRtHQ==: --dhchap-ctrl-secret DHHC-1:01:YmQ3ZDA4NWFiYjI3YjdjNWVjMzc4NDNiZTM4ZTU3N2a6gUZi: 00:18:06.723 11:29:01 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@82 -- # nvme disconnect -n nqn.2024-03.io.spdk:cnode0 00:18:06.723 NQN:nqn.2024-03.io.spdk:cnode0 disconnected 1 controller(s) 00:18:06.723 11:29:01 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@83 -- # rpc_cmd nvmf_subsystem_remove_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:c758a4ed-f09f-4c82-9afb-3d096f035464 00:18:06.723 11:29:01 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:06.723 11:29:01 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:18:06.723 11:29:01 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:06.723 11:29:01 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@120 -- # for keyid in "${!keys[@]}" 00:18:06.723 11:29:01 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@121 -- # hostrpc bdev_nvme_set_options --dhchap-digests sha512 --dhchap-dhgroups null 00:18:06.723 11:29:01 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_set_options --dhchap-digests sha512 --dhchap-dhgroups null 00:18:06.980 11:29:02 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@123 -- # connect_authenticate sha512 null 3 00:18:06.980 11:29:02 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@65 -- # local digest dhgroup key ckey qpairs 00:18:06.980 11:29:02 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # digest=sha512 00:18:06.980 11:29:02 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # dhgroup=null 00:18:06.980 11:29:02 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # key=key3 00:18:06.980 11:29:02 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@68 -- # ckey=(${ckeys[$3]:+--dhchap-ctrlr-key "ckey$3"}) 00:18:06.980 11:29:02 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@70 -- # rpc_cmd nvmf_subsystem_add_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:c758a4ed-f09f-4c82-9afb-3d096f035464 --dhchap-key key3 00:18:06.980 11:29:02 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:06.980 11:29:02 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:18:06.980 11:29:02 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:06.980 11:29:02 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@71 -- # bdev_connect -b nvme0 --dhchap-key key3 00:18:06.980 11:29:02 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@60 -- # hostrpc bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.3 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:c758a4ed-f09f-4c82-9afb-3d096f035464 -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key3 00:18:06.980 11:29:02 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.3 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:c758a4ed-f09f-4c82-9afb-3d096f035464 -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key3 00:18:07.238 00:18:07.238 11:29:02 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # hostrpc bdev_nvme_get_controllers 00:18:07.238 11:29:02 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # jq -r '.[].name' 00:18:07.239 11:29:02 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_get_controllers 00:18:07.497 11:29:02 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:18:07.497 11:29:02 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@74 -- # rpc_cmd nvmf_subsystem_get_qpairs nqn.2024-03.io.spdk:cnode0 00:18:07.497 11:29:02 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:07.497 11:29:02 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:18:07.497 11:29:02 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:07.497 11:29:02 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@74 -- # qpairs='[ 00:18:07.497 { 00:18:07.497 "auth": { 00:18:07.497 "dhgroup": "null", 00:18:07.497 "digest": "sha512", 00:18:07.497 "state": "completed" 00:18:07.497 }, 00:18:07.497 "cntlid": 103, 00:18:07.497 "hostnqn": "nqn.2014-08.org.nvmexpress:uuid:c758a4ed-f09f-4c82-9afb-3d096f035464", 00:18:07.497 "listen_address": { 00:18:07.497 "adrfam": "IPv4", 00:18:07.497 "traddr": "10.0.0.3", 00:18:07.497 "trsvcid": "4420", 00:18:07.497 "trtype": "TCP" 00:18:07.497 }, 00:18:07.497 "peer_address": { 00:18:07.497 "adrfam": "IPv4", 00:18:07.497 "traddr": "10.0.0.1", 00:18:07.497 "trsvcid": "37782", 00:18:07.497 "trtype": "TCP" 00:18:07.497 }, 00:18:07.497 "qid": 0, 00:18:07.497 "state": "enabled", 00:18:07.497 "thread": "nvmf_tgt_poll_group_000" 00:18:07.497 } 00:18:07.497 ]' 00:18:07.497 11:29:02 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@75 -- # jq -r '.[0].auth.digest' 00:18:07.497 11:29:02 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@75 -- # [[ sha512 == \s\h\a\5\1\2 ]] 00:18:07.497 11:29:02 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@76 -- # jq -r '.[0].auth.dhgroup' 00:18:07.755 11:29:03 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@76 -- # [[ null == \n\u\l\l ]] 00:18:07.755 11:29:03 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@77 -- # jq -r '.[0].auth.state' 00:18:07.755 11:29:03 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@77 -- # [[ completed == \c\o\m\p\l\e\t\e\d ]] 00:18:07.755 11:29:03 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@78 -- # hostrpc bdev_nvme_detach_controller nvme0 00:18:07.755 11:29:03 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_detach_controller nvme0 00:18:08.015 11:29:03 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@80 -- # nvme_connect --dhchap-secret DHHC-1:03:YjUzYzRlNjQ2N2QwNDQ3ZGZhN2VhODUzYjlkY2I2OWViZWM1NzZiOTJiM2MwNzIxZWVkMmMxOTIzNWE5M2Q4MDbs9Og=: 00:18:08.015 11:29:03 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@36 -- # nvme connect -t tcp -a 10.0.0.3 -n nqn.2024-03.io.spdk:cnode0 -i 1 -q nqn.2014-08.org.nvmexpress:uuid:c758a4ed-f09f-4c82-9afb-3d096f035464 --hostid c758a4ed-f09f-4c82-9afb-3d096f035464 -l 0 --dhchap-secret DHHC-1:03:YjUzYzRlNjQ2N2QwNDQ3ZGZhN2VhODUzYjlkY2I2OWViZWM1NzZiOTJiM2MwNzIxZWVkMmMxOTIzNWE5M2Q4MDbs9Og=: 00:18:08.953 11:29:04 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@82 -- # nvme disconnect -n nqn.2024-03.io.spdk:cnode0 00:18:08.953 NQN:nqn.2024-03.io.spdk:cnode0 disconnected 1 controller(s) 00:18:08.953 11:29:04 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@83 -- # rpc_cmd nvmf_subsystem_remove_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:c758a4ed-f09f-4c82-9afb-3d096f035464 00:18:08.953 11:29:04 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:08.953 11:29:04 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:18:08.953 11:29:04 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:08.953 11:29:04 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@119 -- # for dhgroup in "${dhgroups[@]}" 00:18:08.953 11:29:04 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@120 -- # for keyid in "${!keys[@]}" 00:18:08.953 11:29:04 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@121 -- # hostrpc bdev_nvme_set_options --dhchap-digests sha512 --dhchap-dhgroups ffdhe2048 00:18:08.953 11:29:04 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_set_options --dhchap-digests sha512 --dhchap-dhgroups ffdhe2048 00:18:09.211 11:29:04 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@123 -- # connect_authenticate sha512 ffdhe2048 0 00:18:09.211 11:29:04 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@65 -- # local digest dhgroup key ckey qpairs 00:18:09.211 11:29:04 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # digest=sha512 00:18:09.211 11:29:04 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # dhgroup=ffdhe2048 00:18:09.211 11:29:04 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # key=key0 00:18:09.211 11:29:04 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@68 -- # ckey=(${ckeys[$3]:+--dhchap-ctrlr-key "ckey$3"}) 00:18:09.211 11:29:04 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@70 -- # rpc_cmd nvmf_subsystem_add_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:c758a4ed-f09f-4c82-9afb-3d096f035464 --dhchap-key key0 --dhchap-ctrlr-key ckey0 00:18:09.211 11:29:04 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:09.211 11:29:04 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:18:09.211 11:29:04 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:09.211 11:29:04 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@71 -- # bdev_connect -b nvme0 --dhchap-key key0 --dhchap-ctrlr-key ckey0 00:18:09.211 11:29:04 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@60 -- # hostrpc bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.3 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:c758a4ed-f09f-4c82-9afb-3d096f035464 -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key0 --dhchap-ctrlr-key ckey0 00:18:09.211 11:29:04 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.3 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:c758a4ed-f09f-4c82-9afb-3d096f035464 -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key0 --dhchap-ctrlr-key ckey0 00:18:09.777 00:18:09.777 11:29:05 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # hostrpc bdev_nvme_get_controllers 00:18:09.777 11:29:05 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # jq -r '.[].name' 00:18:09.777 11:29:05 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_get_controllers 00:18:10.035 11:29:05 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:18:10.035 11:29:05 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@74 -- # rpc_cmd nvmf_subsystem_get_qpairs nqn.2024-03.io.spdk:cnode0 00:18:10.035 11:29:05 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:10.035 11:29:05 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:18:10.035 11:29:05 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:10.035 11:29:05 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@74 -- # qpairs='[ 00:18:10.035 { 00:18:10.035 "auth": { 00:18:10.035 "dhgroup": "ffdhe2048", 00:18:10.035 "digest": "sha512", 00:18:10.035 "state": "completed" 00:18:10.035 }, 00:18:10.035 "cntlid": 105, 00:18:10.035 "hostnqn": "nqn.2014-08.org.nvmexpress:uuid:c758a4ed-f09f-4c82-9afb-3d096f035464", 00:18:10.035 "listen_address": { 00:18:10.035 "adrfam": "IPv4", 00:18:10.035 "traddr": "10.0.0.3", 00:18:10.035 "trsvcid": "4420", 00:18:10.035 "trtype": "TCP" 00:18:10.035 }, 00:18:10.035 "peer_address": { 00:18:10.035 "adrfam": "IPv4", 00:18:10.035 "traddr": "10.0.0.1", 00:18:10.035 "trsvcid": "37806", 00:18:10.035 "trtype": "TCP" 00:18:10.035 }, 00:18:10.035 "qid": 0, 00:18:10.035 "state": "enabled", 00:18:10.035 "thread": "nvmf_tgt_poll_group_000" 00:18:10.035 } 00:18:10.035 ]' 00:18:10.036 11:29:05 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@75 -- # jq -r '.[0].auth.digest' 00:18:10.036 11:29:05 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@75 -- # [[ sha512 == \s\h\a\5\1\2 ]] 00:18:10.036 11:29:05 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@76 -- # jq -r '.[0].auth.dhgroup' 00:18:10.036 11:29:05 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@76 -- # [[ ffdhe2048 == \f\f\d\h\e\2\0\4\8 ]] 00:18:10.036 11:29:05 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@77 -- # jq -r '.[0].auth.state' 00:18:10.036 11:29:05 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@77 -- # [[ completed == \c\o\m\p\l\e\t\e\d ]] 00:18:10.036 11:29:05 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@78 -- # hostrpc bdev_nvme_detach_controller nvme0 00:18:10.036 11:29:05 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_detach_controller nvme0 00:18:10.294 11:29:05 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@80 -- # nvme_connect --dhchap-secret DHHC-1:00:YTQ3MDY2OWMxZDcwN2QyZmRhNGVmYjYzYTczYTM4NzAwYjdiNTBmZmE2ZDBlZTc28YG94Q==: --dhchap-ctrl-secret DHHC-1:03:YmY1NDQyMjdhMGU5ZDk3NGFiYTIyMTE1OTgzNGQ4ZDQ0MTE3YmFjMTc3MGQ4NDRlOTU5MThlODc5YzUxNGM2Y9nOg8I=: 00:18:10.294 11:29:05 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@36 -- # nvme connect -t tcp -a 10.0.0.3 -n nqn.2024-03.io.spdk:cnode0 -i 1 -q nqn.2014-08.org.nvmexpress:uuid:c758a4ed-f09f-4c82-9afb-3d096f035464 --hostid c758a4ed-f09f-4c82-9afb-3d096f035464 -l 0 --dhchap-secret DHHC-1:00:YTQ3MDY2OWMxZDcwN2QyZmRhNGVmYjYzYTczYTM4NzAwYjdiNTBmZmE2ZDBlZTc28YG94Q==: --dhchap-ctrl-secret DHHC-1:03:YmY1NDQyMjdhMGU5ZDk3NGFiYTIyMTE1OTgzNGQ4ZDQ0MTE3YmFjMTc3MGQ4NDRlOTU5MThlODc5YzUxNGM2Y9nOg8I=: 00:18:11.229 11:29:06 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@82 -- # nvme disconnect -n nqn.2024-03.io.spdk:cnode0 00:18:11.229 NQN:nqn.2024-03.io.spdk:cnode0 disconnected 1 controller(s) 00:18:11.229 11:29:06 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@83 -- # rpc_cmd nvmf_subsystem_remove_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:c758a4ed-f09f-4c82-9afb-3d096f035464 00:18:11.229 11:29:06 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:11.229 11:29:06 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:18:11.229 11:29:06 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:11.229 11:29:06 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@120 -- # for keyid in "${!keys[@]}" 00:18:11.229 11:29:06 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@121 -- # hostrpc bdev_nvme_set_options --dhchap-digests sha512 --dhchap-dhgroups ffdhe2048 00:18:11.229 11:29:06 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_set_options --dhchap-digests sha512 --dhchap-dhgroups ffdhe2048 00:18:11.487 11:29:06 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@123 -- # connect_authenticate sha512 ffdhe2048 1 00:18:11.487 11:29:06 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@65 -- # local digest dhgroup key ckey qpairs 00:18:11.487 11:29:06 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # digest=sha512 00:18:11.487 11:29:06 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # dhgroup=ffdhe2048 00:18:11.487 11:29:06 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # key=key1 00:18:11.487 11:29:06 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@68 -- # ckey=(${ckeys[$3]:+--dhchap-ctrlr-key "ckey$3"}) 00:18:11.487 11:29:06 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@70 -- # rpc_cmd nvmf_subsystem_add_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:c758a4ed-f09f-4c82-9afb-3d096f035464 --dhchap-key key1 --dhchap-ctrlr-key ckey1 00:18:11.487 11:29:06 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:11.487 11:29:06 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:18:11.487 11:29:06 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:11.487 11:29:06 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@71 -- # bdev_connect -b nvme0 --dhchap-key key1 --dhchap-ctrlr-key ckey1 00:18:11.487 11:29:06 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@60 -- # hostrpc bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.3 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:c758a4ed-f09f-4c82-9afb-3d096f035464 -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key1 --dhchap-ctrlr-key ckey1 00:18:11.487 11:29:06 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.3 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:c758a4ed-f09f-4c82-9afb-3d096f035464 -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key1 --dhchap-ctrlr-key ckey1 00:18:11.745 00:18:12.003 11:29:07 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # hostrpc bdev_nvme_get_controllers 00:18:12.003 11:29:07 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_get_controllers 00:18:12.003 11:29:07 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # jq -r '.[].name' 00:18:12.262 11:29:07 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:18:12.262 11:29:07 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@74 -- # rpc_cmd nvmf_subsystem_get_qpairs nqn.2024-03.io.spdk:cnode0 00:18:12.262 11:29:07 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:12.262 11:29:07 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:18:12.262 11:29:07 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:12.262 11:29:07 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@74 -- # qpairs='[ 00:18:12.262 { 00:18:12.262 "auth": { 00:18:12.262 "dhgroup": "ffdhe2048", 00:18:12.262 "digest": "sha512", 00:18:12.262 "state": "completed" 00:18:12.262 }, 00:18:12.262 "cntlid": 107, 00:18:12.262 "hostnqn": "nqn.2014-08.org.nvmexpress:uuid:c758a4ed-f09f-4c82-9afb-3d096f035464", 00:18:12.262 "listen_address": { 00:18:12.262 "adrfam": "IPv4", 00:18:12.262 "traddr": "10.0.0.3", 00:18:12.262 "trsvcid": "4420", 00:18:12.262 "trtype": "TCP" 00:18:12.262 }, 00:18:12.262 "peer_address": { 00:18:12.262 "adrfam": "IPv4", 00:18:12.262 "traddr": "10.0.0.1", 00:18:12.262 "trsvcid": "37844", 00:18:12.262 "trtype": "TCP" 00:18:12.262 }, 00:18:12.262 "qid": 0, 00:18:12.262 "state": "enabled", 00:18:12.262 "thread": "nvmf_tgt_poll_group_000" 00:18:12.262 } 00:18:12.262 ]' 00:18:12.262 11:29:07 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@75 -- # jq -r '.[0].auth.digest' 00:18:12.262 11:29:07 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@75 -- # [[ sha512 == \s\h\a\5\1\2 ]] 00:18:12.262 11:29:07 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@76 -- # jq -r '.[0].auth.dhgroup' 00:18:12.262 11:29:07 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@76 -- # [[ ffdhe2048 == \f\f\d\h\e\2\0\4\8 ]] 00:18:12.262 11:29:07 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@77 -- # jq -r '.[0].auth.state' 00:18:12.262 11:29:07 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@77 -- # [[ completed == \c\o\m\p\l\e\t\e\d ]] 00:18:12.262 11:29:07 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@78 -- # hostrpc bdev_nvme_detach_controller nvme0 00:18:12.262 11:29:07 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_detach_controller nvme0 00:18:12.526 11:29:08 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@80 -- # nvme_connect --dhchap-secret DHHC-1:01:YTU2ZTRiMDFkMzNiMjFmN2QwNTBiYjliMGJkYjQwZTTsDgGm: --dhchap-ctrl-secret DHHC-1:02:ZjZjOWFiZGJhYjc3NzkxOGQwNGZmNTA0MTE0MjkzYmVkODZmYTJjNzcyZDM2NjYxWbIiww==: 00:18:12.526 11:29:08 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@36 -- # nvme connect -t tcp -a 10.0.0.3 -n nqn.2024-03.io.spdk:cnode0 -i 1 -q nqn.2014-08.org.nvmexpress:uuid:c758a4ed-f09f-4c82-9afb-3d096f035464 --hostid c758a4ed-f09f-4c82-9afb-3d096f035464 -l 0 --dhchap-secret DHHC-1:01:YTU2ZTRiMDFkMzNiMjFmN2QwNTBiYjliMGJkYjQwZTTsDgGm: --dhchap-ctrl-secret DHHC-1:02:ZjZjOWFiZGJhYjc3NzkxOGQwNGZmNTA0MTE0MjkzYmVkODZmYTJjNzcyZDM2NjYxWbIiww==: 00:18:13.482 11:29:08 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@82 -- # nvme disconnect -n nqn.2024-03.io.spdk:cnode0 00:18:13.482 NQN:nqn.2024-03.io.spdk:cnode0 disconnected 1 controller(s) 00:18:13.482 11:29:08 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@83 -- # rpc_cmd nvmf_subsystem_remove_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:c758a4ed-f09f-4c82-9afb-3d096f035464 00:18:13.482 11:29:08 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:13.482 11:29:08 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:18:13.482 11:29:08 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:13.482 11:29:08 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@120 -- # for keyid in "${!keys[@]}" 00:18:13.482 11:29:08 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@121 -- # hostrpc bdev_nvme_set_options --dhchap-digests sha512 --dhchap-dhgroups ffdhe2048 00:18:13.482 11:29:08 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_set_options --dhchap-digests sha512 --dhchap-dhgroups ffdhe2048 00:18:13.740 11:29:09 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@123 -- # connect_authenticate sha512 ffdhe2048 2 00:18:13.740 11:29:09 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@65 -- # local digest dhgroup key ckey qpairs 00:18:13.740 11:29:09 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # digest=sha512 00:18:13.740 11:29:09 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # dhgroup=ffdhe2048 00:18:13.740 11:29:09 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # key=key2 00:18:13.740 11:29:09 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@68 -- # ckey=(${ckeys[$3]:+--dhchap-ctrlr-key "ckey$3"}) 00:18:13.740 11:29:09 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@70 -- # rpc_cmd nvmf_subsystem_add_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:c758a4ed-f09f-4c82-9afb-3d096f035464 --dhchap-key key2 --dhchap-ctrlr-key ckey2 00:18:13.740 11:29:09 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:13.740 11:29:09 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:18:13.740 11:29:09 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:13.740 11:29:09 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@71 -- # bdev_connect -b nvme0 --dhchap-key key2 --dhchap-ctrlr-key ckey2 00:18:13.740 11:29:09 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@60 -- # hostrpc bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.3 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:c758a4ed-f09f-4c82-9afb-3d096f035464 -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key2 --dhchap-ctrlr-key ckey2 00:18:13.740 11:29:09 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.3 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:c758a4ed-f09f-4c82-9afb-3d096f035464 -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key2 --dhchap-ctrlr-key ckey2 00:18:13.997 00:18:13.997 11:29:09 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # hostrpc bdev_nvme_get_controllers 00:18:13.997 11:29:09 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_get_controllers 00:18:13.997 11:29:09 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # jq -r '.[].name' 00:18:14.563 11:29:09 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:18:14.563 11:29:09 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@74 -- # rpc_cmd nvmf_subsystem_get_qpairs nqn.2024-03.io.spdk:cnode0 00:18:14.563 11:29:09 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:14.563 11:29:09 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:18:14.563 11:29:09 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:14.563 11:29:09 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@74 -- # qpairs='[ 00:18:14.563 { 00:18:14.563 "auth": { 00:18:14.563 "dhgroup": "ffdhe2048", 00:18:14.563 "digest": "sha512", 00:18:14.563 "state": "completed" 00:18:14.563 }, 00:18:14.563 "cntlid": 109, 00:18:14.563 "hostnqn": "nqn.2014-08.org.nvmexpress:uuid:c758a4ed-f09f-4c82-9afb-3d096f035464", 00:18:14.563 "listen_address": { 00:18:14.563 "adrfam": "IPv4", 00:18:14.563 "traddr": "10.0.0.3", 00:18:14.563 "trsvcid": "4420", 00:18:14.563 "trtype": "TCP" 00:18:14.563 }, 00:18:14.563 "peer_address": { 00:18:14.563 "adrfam": "IPv4", 00:18:14.563 "traddr": "10.0.0.1", 00:18:14.563 "trsvcid": "37876", 00:18:14.563 "trtype": "TCP" 00:18:14.563 }, 00:18:14.563 "qid": 0, 00:18:14.563 "state": "enabled", 00:18:14.563 "thread": "nvmf_tgt_poll_group_000" 00:18:14.563 } 00:18:14.563 ]' 00:18:14.563 11:29:09 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@75 -- # jq -r '.[0].auth.digest' 00:18:14.563 11:29:09 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@75 -- # [[ sha512 == \s\h\a\5\1\2 ]] 00:18:14.563 11:29:09 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@76 -- # jq -r '.[0].auth.dhgroup' 00:18:14.563 11:29:09 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@76 -- # [[ ffdhe2048 == \f\f\d\h\e\2\0\4\8 ]] 00:18:14.563 11:29:09 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@77 -- # jq -r '.[0].auth.state' 00:18:14.563 11:29:10 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@77 -- # [[ completed == \c\o\m\p\l\e\t\e\d ]] 00:18:14.563 11:29:10 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@78 -- # hostrpc bdev_nvme_detach_controller nvme0 00:18:14.563 11:29:10 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_detach_controller nvme0 00:18:15.129 11:29:10 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@80 -- # nvme_connect --dhchap-secret DHHC-1:02:YjZiMDU3YTg1ZTA0NWQzMGY1ZWM0YzNmYzc1NDY1OWNkZmQ3NmU2YWM2ZDE3ZmVmgTRtHQ==: --dhchap-ctrl-secret DHHC-1:01:YmQ3ZDA4NWFiYjI3YjdjNWVjMzc4NDNiZTM4ZTU3N2a6gUZi: 00:18:15.129 11:29:10 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@36 -- # nvme connect -t tcp -a 10.0.0.3 -n nqn.2024-03.io.spdk:cnode0 -i 1 -q nqn.2014-08.org.nvmexpress:uuid:c758a4ed-f09f-4c82-9afb-3d096f035464 --hostid c758a4ed-f09f-4c82-9afb-3d096f035464 -l 0 --dhchap-secret DHHC-1:02:YjZiMDU3YTg1ZTA0NWQzMGY1ZWM0YzNmYzc1NDY1OWNkZmQ3NmU2YWM2ZDE3ZmVmgTRtHQ==: --dhchap-ctrl-secret DHHC-1:01:YmQ3ZDA4NWFiYjI3YjdjNWVjMzc4NDNiZTM4ZTU3N2a6gUZi: 00:18:15.696 11:29:11 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@82 -- # nvme disconnect -n nqn.2024-03.io.spdk:cnode0 00:18:15.696 NQN:nqn.2024-03.io.spdk:cnode0 disconnected 1 controller(s) 00:18:15.696 11:29:11 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@83 -- # rpc_cmd nvmf_subsystem_remove_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:c758a4ed-f09f-4c82-9afb-3d096f035464 00:18:15.696 11:29:11 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:15.696 11:29:11 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:18:15.696 11:29:11 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:15.696 11:29:11 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@120 -- # for keyid in "${!keys[@]}" 00:18:15.696 11:29:11 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@121 -- # hostrpc bdev_nvme_set_options --dhchap-digests sha512 --dhchap-dhgroups ffdhe2048 00:18:15.696 11:29:11 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_set_options --dhchap-digests sha512 --dhchap-dhgroups ffdhe2048 00:18:15.953 11:29:11 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@123 -- # connect_authenticate sha512 ffdhe2048 3 00:18:15.953 11:29:11 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@65 -- # local digest dhgroup key ckey qpairs 00:18:15.953 11:29:11 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # digest=sha512 00:18:15.953 11:29:11 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # dhgroup=ffdhe2048 00:18:15.953 11:29:11 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # key=key3 00:18:15.953 11:29:11 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@68 -- # ckey=(${ckeys[$3]:+--dhchap-ctrlr-key "ckey$3"}) 00:18:15.954 11:29:11 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@70 -- # rpc_cmd nvmf_subsystem_add_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:c758a4ed-f09f-4c82-9afb-3d096f035464 --dhchap-key key3 00:18:15.954 11:29:11 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:15.954 11:29:11 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:18:15.954 11:29:11 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:15.954 11:29:11 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@71 -- # bdev_connect -b nvme0 --dhchap-key key3 00:18:15.954 11:29:11 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@60 -- # hostrpc bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.3 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:c758a4ed-f09f-4c82-9afb-3d096f035464 -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key3 00:18:15.954 11:29:11 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.3 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:c758a4ed-f09f-4c82-9afb-3d096f035464 -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key3 00:18:16.576 00:18:16.576 11:29:11 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # hostrpc bdev_nvme_get_controllers 00:18:16.576 11:29:11 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # jq -r '.[].name' 00:18:16.576 11:29:11 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_get_controllers 00:18:16.833 11:29:12 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:18:16.833 11:29:12 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@74 -- # rpc_cmd nvmf_subsystem_get_qpairs nqn.2024-03.io.spdk:cnode0 00:18:16.833 11:29:12 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:16.833 11:29:12 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:18:16.833 11:29:12 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:16.834 11:29:12 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@74 -- # qpairs='[ 00:18:16.834 { 00:18:16.834 "auth": { 00:18:16.834 "dhgroup": "ffdhe2048", 00:18:16.834 "digest": "sha512", 00:18:16.834 "state": "completed" 00:18:16.834 }, 00:18:16.834 "cntlid": 111, 00:18:16.834 "hostnqn": "nqn.2014-08.org.nvmexpress:uuid:c758a4ed-f09f-4c82-9afb-3d096f035464", 00:18:16.834 "listen_address": { 00:18:16.834 "adrfam": "IPv4", 00:18:16.834 "traddr": "10.0.0.3", 00:18:16.834 "trsvcid": "4420", 00:18:16.834 "trtype": "TCP" 00:18:16.834 }, 00:18:16.834 "peer_address": { 00:18:16.834 "adrfam": "IPv4", 00:18:16.834 "traddr": "10.0.0.1", 00:18:16.834 "trsvcid": "42042", 00:18:16.834 "trtype": "TCP" 00:18:16.834 }, 00:18:16.834 "qid": 0, 00:18:16.834 "state": "enabled", 00:18:16.834 "thread": "nvmf_tgt_poll_group_000" 00:18:16.834 } 00:18:16.834 ]' 00:18:16.834 11:29:12 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@75 -- # jq -r '.[0].auth.digest' 00:18:16.834 11:29:12 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@75 -- # [[ sha512 == \s\h\a\5\1\2 ]] 00:18:16.834 11:29:12 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@76 -- # jq -r '.[0].auth.dhgroup' 00:18:16.834 11:29:12 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@76 -- # [[ ffdhe2048 == \f\f\d\h\e\2\0\4\8 ]] 00:18:16.834 11:29:12 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@77 -- # jq -r '.[0].auth.state' 00:18:16.834 11:29:12 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@77 -- # [[ completed == \c\o\m\p\l\e\t\e\d ]] 00:18:16.834 11:29:12 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@78 -- # hostrpc bdev_nvme_detach_controller nvme0 00:18:16.834 11:29:12 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_detach_controller nvme0 00:18:17.400 11:29:12 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@80 -- # nvme_connect --dhchap-secret DHHC-1:03:YjUzYzRlNjQ2N2QwNDQ3ZGZhN2VhODUzYjlkY2I2OWViZWM1NzZiOTJiM2MwNzIxZWVkMmMxOTIzNWE5M2Q4MDbs9Og=: 00:18:17.400 11:29:12 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@36 -- # nvme connect -t tcp -a 10.0.0.3 -n nqn.2024-03.io.spdk:cnode0 -i 1 -q nqn.2014-08.org.nvmexpress:uuid:c758a4ed-f09f-4c82-9afb-3d096f035464 --hostid c758a4ed-f09f-4c82-9afb-3d096f035464 -l 0 --dhchap-secret DHHC-1:03:YjUzYzRlNjQ2N2QwNDQ3ZGZhN2VhODUzYjlkY2I2OWViZWM1NzZiOTJiM2MwNzIxZWVkMmMxOTIzNWE5M2Q4MDbs9Og=: 00:18:17.964 11:29:13 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@82 -- # nvme disconnect -n nqn.2024-03.io.spdk:cnode0 00:18:17.964 NQN:nqn.2024-03.io.spdk:cnode0 disconnected 1 controller(s) 00:18:17.964 11:29:13 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@83 -- # rpc_cmd nvmf_subsystem_remove_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:c758a4ed-f09f-4c82-9afb-3d096f035464 00:18:17.964 11:29:13 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:17.964 11:29:13 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:18:17.964 11:29:13 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:17.964 11:29:13 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@119 -- # for dhgroup in "${dhgroups[@]}" 00:18:17.964 11:29:13 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@120 -- # for keyid in "${!keys[@]}" 00:18:17.964 11:29:13 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@121 -- # hostrpc bdev_nvme_set_options --dhchap-digests sha512 --dhchap-dhgroups ffdhe3072 00:18:17.964 11:29:13 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_set_options --dhchap-digests sha512 --dhchap-dhgroups ffdhe3072 00:18:18.223 11:29:13 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@123 -- # connect_authenticate sha512 ffdhe3072 0 00:18:18.223 11:29:13 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@65 -- # local digest dhgroup key ckey qpairs 00:18:18.223 11:29:13 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # digest=sha512 00:18:18.223 11:29:13 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # dhgroup=ffdhe3072 00:18:18.223 11:29:13 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # key=key0 00:18:18.223 11:29:13 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@68 -- # ckey=(${ckeys[$3]:+--dhchap-ctrlr-key "ckey$3"}) 00:18:18.223 11:29:13 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@70 -- # rpc_cmd nvmf_subsystem_add_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:c758a4ed-f09f-4c82-9afb-3d096f035464 --dhchap-key key0 --dhchap-ctrlr-key ckey0 00:18:18.223 11:29:13 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:18.223 11:29:13 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:18:18.223 11:29:13 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:18.223 11:29:13 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@71 -- # bdev_connect -b nvme0 --dhchap-key key0 --dhchap-ctrlr-key ckey0 00:18:18.223 11:29:13 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@60 -- # hostrpc bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.3 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:c758a4ed-f09f-4c82-9afb-3d096f035464 -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key0 --dhchap-ctrlr-key ckey0 00:18:18.223 11:29:13 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.3 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:c758a4ed-f09f-4c82-9afb-3d096f035464 -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key0 --dhchap-ctrlr-key ckey0 00:18:18.786 00:18:18.786 11:29:14 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # hostrpc bdev_nvme_get_controllers 00:18:18.786 11:29:14 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # jq -r '.[].name' 00:18:18.786 11:29:14 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_get_controllers 00:18:19.042 11:29:14 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:18:19.042 11:29:14 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@74 -- # rpc_cmd nvmf_subsystem_get_qpairs nqn.2024-03.io.spdk:cnode0 00:18:19.042 11:29:14 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:19.042 11:29:14 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:18:19.042 11:29:14 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:19.042 11:29:14 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@74 -- # qpairs='[ 00:18:19.042 { 00:18:19.042 "auth": { 00:18:19.042 "dhgroup": "ffdhe3072", 00:18:19.042 "digest": "sha512", 00:18:19.042 "state": "completed" 00:18:19.042 }, 00:18:19.042 "cntlid": 113, 00:18:19.042 "hostnqn": "nqn.2014-08.org.nvmexpress:uuid:c758a4ed-f09f-4c82-9afb-3d096f035464", 00:18:19.042 "listen_address": { 00:18:19.042 "adrfam": "IPv4", 00:18:19.042 "traddr": "10.0.0.3", 00:18:19.042 "trsvcid": "4420", 00:18:19.042 "trtype": "TCP" 00:18:19.042 }, 00:18:19.042 "peer_address": { 00:18:19.042 "adrfam": "IPv4", 00:18:19.042 "traddr": "10.0.0.1", 00:18:19.042 "trsvcid": "42060", 00:18:19.042 "trtype": "TCP" 00:18:19.042 }, 00:18:19.042 "qid": 0, 00:18:19.042 "state": "enabled", 00:18:19.042 "thread": "nvmf_tgt_poll_group_000" 00:18:19.042 } 00:18:19.042 ]' 00:18:19.042 11:29:14 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@75 -- # jq -r '.[0].auth.digest' 00:18:19.042 11:29:14 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@75 -- # [[ sha512 == \s\h\a\5\1\2 ]] 00:18:19.042 11:29:14 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@76 -- # jq -r '.[0].auth.dhgroup' 00:18:19.328 11:29:14 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@76 -- # [[ ffdhe3072 == \f\f\d\h\e\3\0\7\2 ]] 00:18:19.328 11:29:14 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@77 -- # jq -r '.[0].auth.state' 00:18:19.328 11:29:14 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@77 -- # [[ completed == \c\o\m\p\l\e\t\e\d ]] 00:18:19.328 11:29:14 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@78 -- # hostrpc bdev_nvme_detach_controller nvme0 00:18:19.328 11:29:14 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_detach_controller nvme0 00:18:19.585 11:29:14 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@80 -- # nvme_connect --dhchap-secret DHHC-1:00:YTQ3MDY2OWMxZDcwN2QyZmRhNGVmYjYzYTczYTM4NzAwYjdiNTBmZmE2ZDBlZTc28YG94Q==: --dhchap-ctrl-secret DHHC-1:03:YmY1NDQyMjdhMGU5ZDk3NGFiYTIyMTE1OTgzNGQ4ZDQ0MTE3YmFjMTc3MGQ4NDRlOTU5MThlODc5YzUxNGM2Y9nOg8I=: 00:18:19.585 11:29:14 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@36 -- # nvme connect -t tcp -a 10.0.0.3 -n nqn.2024-03.io.spdk:cnode0 -i 1 -q nqn.2014-08.org.nvmexpress:uuid:c758a4ed-f09f-4c82-9afb-3d096f035464 --hostid c758a4ed-f09f-4c82-9afb-3d096f035464 -l 0 --dhchap-secret DHHC-1:00:YTQ3MDY2OWMxZDcwN2QyZmRhNGVmYjYzYTczYTM4NzAwYjdiNTBmZmE2ZDBlZTc28YG94Q==: --dhchap-ctrl-secret DHHC-1:03:YmY1NDQyMjdhMGU5ZDk3NGFiYTIyMTE1OTgzNGQ4ZDQ0MTE3YmFjMTc3MGQ4NDRlOTU5MThlODc5YzUxNGM2Y9nOg8I=: 00:18:20.219 11:29:15 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@82 -- # nvme disconnect -n nqn.2024-03.io.spdk:cnode0 00:18:20.219 NQN:nqn.2024-03.io.spdk:cnode0 disconnected 1 controller(s) 00:18:20.219 11:29:15 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@83 -- # rpc_cmd nvmf_subsystem_remove_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:c758a4ed-f09f-4c82-9afb-3d096f035464 00:18:20.219 11:29:15 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:20.219 11:29:15 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:18:20.219 11:29:15 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:20.219 11:29:15 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@120 -- # for keyid in "${!keys[@]}" 00:18:20.219 11:29:15 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@121 -- # hostrpc bdev_nvme_set_options --dhchap-digests sha512 --dhchap-dhgroups ffdhe3072 00:18:20.219 11:29:15 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_set_options --dhchap-digests sha512 --dhchap-dhgroups ffdhe3072 00:18:20.524 11:29:15 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@123 -- # connect_authenticate sha512 ffdhe3072 1 00:18:20.524 11:29:15 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@65 -- # local digest dhgroup key ckey qpairs 00:18:20.524 11:29:15 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # digest=sha512 00:18:20.524 11:29:15 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # dhgroup=ffdhe3072 00:18:20.524 11:29:15 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # key=key1 00:18:20.524 11:29:15 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@68 -- # ckey=(${ckeys[$3]:+--dhchap-ctrlr-key "ckey$3"}) 00:18:20.524 11:29:15 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@70 -- # rpc_cmd nvmf_subsystem_add_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:c758a4ed-f09f-4c82-9afb-3d096f035464 --dhchap-key key1 --dhchap-ctrlr-key ckey1 00:18:20.524 11:29:15 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:20.524 11:29:15 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:18:20.524 11:29:15 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:20.524 11:29:15 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@71 -- # bdev_connect -b nvme0 --dhchap-key key1 --dhchap-ctrlr-key ckey1 00:18:20.524 11:29:15 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@60 -- # hostrpc bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.3 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:c758a4ed-f09f-4c82-9afb-3d096f035464 -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key1 --dhchap-ctrlr-key ckey1 00:18:20.524 11:29:15 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.3 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:c758a4ed-f09f-4c82-9afb-3d096f035464 -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key1 --dhchap-ctrlr-key ckey1 00:18:21.097 00:18:21.097 11:29:16 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # hostrpc bdev_nvme_get_controllers 00:18:21.097 11:29:16 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_get_controllers 00:18:21.097 11:29:16 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # jq -r '.[].name' 00:18:21.353 11:29:16 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:18:21.353 11:29:16 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@74 -- # rpc_cmd nvmf_subsystem_get_qpairs nqn.2024-03.io.spdk:cnode0 00:18:21.353 11:29:16 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:21.353 11:29:16 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:18:21.354 11:29:16 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:21.354 11:29:16 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@74 -- # qpairs='[ 00:18:21.354 { 00:18:21.354 "auth": { 00:18:21.354 "dhgroup": "ffdhe3072", 00:18:21.354 "digest": "sha512", 00:18:21.354 "state": "completed" 00:18:21.354 }, 00:18:21.354 "cntlid": 115, 00:18:21.354 "hostnqn": "nqn.2014-08.org.nvmexpress:uuid:c758a4ed-f09f-4c82-9afb-3d096f035464", 00:18:21.354 "listen_address": { 00:18:21.354 "adrfam": "IPv4", 00:18:21.354 "traddr": "10.0.0.3", 00:18:21.354 "trsvcid": "4420", 00:18:21.354 "trtype": "TCP" 00:18:21.354 }, 00:18:21.354 "peer_address": { 00:18:21.354 "adrfam": "IPv4", 00:18:21.354 "traddr": "10.0.0.1", 00:18:21.354 "trsvcid": "42086", 00:18:21.354 "trtype": "TCP" 00:18:21.354 }, 00:18:21.354 "qid": 0, 00:18:21.354 "state": "enabled", 00:18:21.354 "thread": "nvmf_tgt_poll_group_000" 00:18:21.354 } 00:18:21.354 ]' 00:18:21.354 11:29:16 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@75 -- # jq -r '.[0].auth.digest' 00:18:21.354 11:29:16 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@75 -- # [[ sha512 == \s\h\a\5\1\2 ]] 00:18:21.354 11:29:16 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@76 -- # jq -r '.[0].auth.dhgroup' 00:18:21.354 11:29:16 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@76 -- # [[ ffdhe3072 == \f\f\d\h\e\3\0\7\2 ]] 00:18:21.354 11:29:16 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@77 -- # jq -r '.[0].auth.state' 00:18:21.354 11:29:16 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@77 -- # [[ completed == \c\o\m\p\l\e\t\e\d ]] 00:18:21.354 11:29:16 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@78 -- # hostrpc bdev_nvme_detach_controller nvme0 00:18:21.354 11:29:16 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_detach_controller nvme0 00:18:21.918 11:29:17 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@80 -- # nvme_connect --dhchap-secret DHHC-1:01:YTU2ZTRiMDFkMzNiMjFmN2QwNTBiYjliMGJkYjQwZTTsDgGm: --dhchap-ctrl-secret DHHC-1:02:ZjZjOWFiZGJhYjc3NzkxOGQwNGZmNTA0MTE0MjkzYmVkODZmYTJjNzcyZDM2NjYxWbIiww==: 00:18:21.918 11:29:17 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@36 -- # nvme connect -t tcp -a 10.0.0.3 -n nqn.2024-03.io.spdk:cnode0 -i 1 -q nqn.2014-08.org.nvmexpress:uuid:c758a4ed-f09f-4c82-9afb-3d096f035464 --hostid c758a4ed-f09f-4c82-9afb-3d096f035464 -l 0 --dhchap-secret DHHC-1:01:YTU2ZTRiMDFkMzNiMjFmN2QwNTBiYjliMGJkYjQwZTTsDgGm: --dhchap-ctrl-secret DHHC-1:02:ZjZjOWFiZGJhYjc3NzkxOGQwNGZmNTA0MTE0MjkzYmVkODZmYTJjNzcyZDM2NjYxWbIiww==: 00:18:22.488 11:29:17 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@82 -- # nvme disconnect -n nqn.2024-03.io.spdk:cnode0 00:18:22.488 NQN:nqn.2024-03.io.spdk:cnode0 disconnected 1 controller(s) 00:18:22.489 11:29:17 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@83 -- # rpc_cmd nvmf_subsystem_remove_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:c758a4ed-f09f-4c82-9afb-3d096f035464 00:18:22.489 11:29:17 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:22.489 11:29:17 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:18:22.489 11:29:17 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:22.489 11:29:17 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@120 -- # for keyid in "${!keys[@]}" 00:18:22.489 11:29:17 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@121 -- # hostrpc bdev_nvme_set_options --dhchap-digests sha512 --dhchap-dhgroups ffdhe3072 00:18:22.489 11:29:17 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_set_options --dhchap-digests sha512 --dhchap-dhgroups ffdhe3072 00:18:22.746 11:29:18 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@123 -- # connect_authenticate sha512 ffdhe3072 2 00:18:22.746 11:29:18 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@65 -- # local digest dhgroup key ckey qpairs 00:18:22.746 11:29:18 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # digest=sha512 00:18:22.746 11:29:18 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # dhgroup=ffdhe3072 00:18:22.746 11:29:18 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # key=key2 00:18:22.746 11:29:18 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@68 -- # ckey=(${ckeys[$3]:+--dhchap-ctrlr-key "ckey$3"}) 00:18:22.746 11:29:18 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@70 -- # rpc_cmd nvmf_subsystem_add_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:c758a4ed-f09f-4c82-9afb-3d096f035464 --dhchap-key key2 --dhchap-ctrlr-key ckey2 00:18:22.746 11:29:18 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:22.746 11:29:18 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:18:22.746 11:29:18 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:22.746 11:29:18 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@71 -- # bdev_connect -b nvme0 --dhchap-key key2 --dhchap-ctrlr-key ckey2 00:18:22.746 11:29:18 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@60 -- # hostrpc bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.3 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:c758a4ed-f09f-4c82-9afb-3d096f035464 -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key2 --dhchap-ctrlr-key ckey2 00:18:22.746 11:29:18 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.3 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:c758a4ed-f09f-4c82-9afb-3d096f035464 -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key2 --dhchap-ctrlr-key ckey2 00:18:23.006 00:18:23.263 11:29:18 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # hostrpc bdev_nvme_get_controllers 00:18:23.263 11:29:18 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # jq -r '.[].name' 00:18:23.263 11:29:18 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_get_controllers 00:18:23.521 11:29:18 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:18:23.521 11:29:18 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@74 -- # rpc_cmd nvmf_subsystem_get_qpairs nqn.2024-03.io.spdk:cnode0 00:18:23.521 11:29:18 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:23.521 11:29:18 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:18:23.521 11:29:18 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:23.521 11:29:18 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@74 -- # qpairs='[ 00:18:23.521 { 00:18:23.521 "auth": { 00:18:23.521 "dhgroup": "ffdhe3072", 00:18:23.521 "digest": "sha512", 00:18:23.521 "state": "completed" 00:18:23.521 }, 00:18:23.521 "cntlid": 117, 00:18:23.521 "hostnqn": "nqn.2014-08.org.nvmexpress:uuid:c758a4ed-f09f-4c82-9afb-3d096f035464", 00:18:23.521 "listen_address": { 00:18:23.521 "adrfam": "IPv4", 00:18:23.521 "traddr": "10.0.0.3", 00:18:23.521 "trsvcid": "4420", 00:18:23.521 "trtype": "TCP" 00:18:23.521 }, 00:18:23.521 "peer_address": { 00:18:23.521 "adrfam": "IPv4", 00:18:23.521 "traddr": "10.0.0.1", 00:18:23.521 "trsvcid": "42122", 00:18:23.521 "trtype": "TCP" 00:18:23.521 }, 00:18:23.521 "qid": 0, 00:18:23.521 "state": "enabled", 00:18:23.521 "thread": "nvmf_tgt_poll_group_000" 00:18:23.521 } 00:18:23.521 ]' 00:18:23.521 11:29:18 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@75 -- # jq -r '.[0].auth.digest' 00:18:23.521 11:29:18 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@75 -- # [[ sha512 == \s\h\a\5\1\2 ]] 00:18:23.521 11:29:18 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@76 -- # jq -r '.[0].auth.dhgroup' 00:18:23.521 11:29:18 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@76 -- # [[ ffdhe3072 == \f\f\d\h\e\3\0\7\2 ]] 00:18:23.521 11:29:18 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@77 -- # jq -r '.[0].auth.state' 00:18:23.779 11:29:19 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@77 -- # [[ completed == \c\o\m\p\l\e\t\e\d ]] 00:18:23.779 11:29:19 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@78 -- # hostrpc bdev_nvme_detach_controller nvme0 00:18:23.779 11:29:19 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_detach_controller nvme0 00:18:24.037 11:29:19 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@80 -- # nvme_connect --dhchap-secret DHHC-1:02:YjZiMDU3YTg1ZTA0NWQzMGY1ZWM0YzNmYzc1NDY1OWNkZmQ3NmU2YWM2ZDE3ZmVmgTRtHQ==: --dhchap-ctrl-secret DHHC-1:01:YmQ3ZDA4NWFiYjI3YjdjNWVjMzc4NDNiZTM4ZTU3N2a6gUZi: 00:18:24.037 11:29:19 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@36 -- # nvme connect -t tcp -a 10.0.0.3 -n nqn.2024-03.io.spdk:cnode0 -i 1 -q nqn.2014-08.org.nvmexpress:uuid:c758a4ed-f09f-4c82-9afb-3d096f035464 --hostid c758a4ed-f09f-4c82-9afb-3d096f035464 -l 0 --dhchap-secret DHHC-1:02:YjZiMDU3YTg1ZTA0NWQzMGY1ZWM0YzNmYzc1NDY1OWNkZmQ3NmU2YWM2ZDE3ZmVmgTRtHQ==: --dhchap-ctrl-secret DHHC-1:01:YmQ3ZDA4NWFiYjI3YjdjNWVjMzc4NDNiZTM4ZTU3N2a6gUZi: 00:18:24.604 11:29:20 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@82 -- # nvme disconnect -n nqn.2024-03.io.spdk:cnode0 00:18:24.604 NQN:nqn.2024-03.io.spdk:cnode0 disconnected 1 controller(s) 00:18:24.604 11:29:20 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@83 -- # rpc_cmd nvmf_subsystem_remove_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:c758a4ed-f09f-4c82-9afb-3d096f035464 00:18:24.604 11:29:20 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:24.604 11:29:20 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:18:24.604 11:29:20 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:24.604 11:29:20 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@120 -- # for keyid in "${!keys[@]}" 00:18:24.604 11:29:20 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@121 -- # hostrpc bdev_nvme_set_options --dhchap-digests sha512 --dhchap-dhgroups ffdhe3072 00:18:24.604 11:29:20 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_set_options --dhchap-digests sha512 --dhchap-dhgroups ffdhe3072 00:18:25.169 11:29:20 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@123 -- # connect_authenticate sha512 ffdhe3072 3 00:18:25.169 11:29:20 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@65 -- # local digest dhgroup key ckey qpairs 00:18:25.169 11:29:20 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # digest=sha512 00:18:25.169 11:29:20 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # dhgroup=ffdhe3072 00:18:25.169 11:29:20 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # key=key3 00:18:25.169 11:29:20 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@68 -- # ckey=(${ckeys[$3]:+--dhchap-ctrlr-key "ckey$3"}) 00:18:25.169 11:29:20 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@70 -- # rpc_cmd nvmf_subsystem_add_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:c758a4ed-f09f-4c82-9afb-3d096f035464 --dhchap-key key3 00:18:25.169 11:29:20 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:25.169 11:29:20 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:18:25.169 11:29:20 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:25.169 11:29:20 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@71 -- # bdev_connect -b nvme0 --dhchap-key key3 00:18:25.169 11:29:20 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@60 -- # hostrpc bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.3 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:c758a4ed-f09f-4c82-9afb-3d096f035464 -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key3 00:18:25.169 11:29:20 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.3 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:c758a4ed-f09f-4c82-9afb-3d096f035464 -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key3 00:18:25.427 00:18:25.427 11:29:20 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # hostrpc bdev_nvme_get_controllers 00:18:25.427 11:29:20 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_get_controllers 00:18:25.427 11:29:20 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # jq -r '.[].name' 00:18:25.684 11:29:21 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:18:25.684 11:29:21 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@74 -- # rpc_cmd nvmf_subsystem_get_qpairs nqn.2024-03.io.spdk:cnode0 00:18:25.684 11:29:21 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:25.684 11:29:21 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:18:25.685 11:29:21 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:25.685 11:29:21 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@74 -- # qpairs='[ 00:18:25.685 { 00:18:25.685 "auth": { 00:18:25.685 "dhgroup": "ffdhe3072", 00:18:25.685 "digest": "sha512", 00:18:25.685 "state": "completed" 00:18:25.685 }, 00:18:25.685 "cntlid": 119, 00:18:25.685 "hostnqn": "nqn.2014-08.org.nvmexpress:uuid:c758a4ed-f09f-4c82-9afb-3d096f035464", 00:18:25.685 "listen_address": { 00:18:25.685 "adrfam": "IPv4", 00:18:25.685 "traddr": "10.0.0.3", 00:18:25.685 "trsvcid": "4420", 00:18:25.685 "trtype": "TCP" 00:18:25.685 }, 00:18:25.685 "peer_address": { 00:18:25.685 "adrfam": "IPv4", 00:18:25.685 "traddr": "10.0.0.1", 00:18:25.685 "trsvcid": "42158", 00:18:25.685 "trtype": "TCP" 00:18:25.685 }, 00:18:25.685 "qid": 0, 00:18:25.685 "state": "enabled", 00:18:25.685 "thread": "nvmf_tgt_poll_group_000" 00:18:25.685 } 00:18:25.685 ]' 00:18:25.685 11:29:21 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@75 -- # jq -r '.[0].auth.digest' 00:18:25.685 11:29:21 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@75 -- # [[ sha512 == \s\h\a\5\1\2 ]] 00:18:25.685 11:29:21 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@76 -- # jq -r '.[0].auth.dhgroup' 00:18:25.941 11:29:21 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@76 -- # [[ ffdhe3072 == \f\f\d\h\e\3\0\7\2 ]] 00:18:25.941 11:29:21 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@77 -- # jq -r '.[0].auth.state' 00:18:25.941 11:29:21 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@77 -- # [[ completed == \c\o\m\p\l\e\t\e\d ]] 00:18:25.941 11:29:21 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@78 -- # hostrpc bdev_nvme_detach_controller nvme0 00:18:25.941 11:29:21 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_detach_controller nvme0 00:18:26.199 11:29:21 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@80 -- # nvme_connect --dhchap-secret DHHC-1:03:YjUzYzRlNjQ2N2QwNDQ3ZGZhN2VhODUzYjlkY2I2OWViZWM1NzZiOTJiM2MwNzIxZWVkMmMxOTIzNWE5M2Q4MDbs9Og=: 00:18:26.199 11:29:21 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@36 -- # nvme connect -t tcp -a 10.0.0.3 -n nqn.2024-03.io.spdk:cnode0 -i 1 -q nqn.2014-08.org.nvmexpress:uuid:c758a4ed-f09f-4c82-9afb-3d096f035464 --hostid c758a4ed-f09f-4c82-9afb-3d096f035464 -l 0 --dhchap-secret DHHC-1:03:YjUzYzRlNjQ2N2QwNDQ3ZGZhN2VhODUzYjlkY2I2OWViZWM1NzZiOTJiM2MwNzIxZWVkMmMxOTIzNWE5M2Q4MDbs9Og=: 00:18:27.143 11:29:22 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@82 -- # nvme disconnect -n nqn.2024-03.io.spdk:cnode0 00:18:27.143 NQN:nqn.2024-03.io.spdk:cnode0 disconnected 1 controller(s) 00:18:27.143 11:29:22 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@83 -- # rpc_cmd nvmf_subsystem_remove_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:c758a4ed-f09f-4c82-9afb-3d096f035464 00:18:27.143 11:29:22 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:27.143 11:29:22 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:18:27.143 11:29:22 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:27.143 11:29:22 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@119 -- # for dhgroup in "${dhgroups[@]}" 00:18:27.143 11:29:22 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@120 -- # for keyid in "${!keys[@]}" 00:18:27.143 11:29:22 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@121 -- # hostrpc bdev_nvme_set_options --dhchap-digests sha512 --dhchap-dhgroups ffdhe4096 00:18:27.143 11:29:22 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_set_options --dhchap-digests sha512 --dhchap-dhgroups ffdhe4096 00:18:27.401 11:29:22 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@123 -- # connect_authenticate sha512 ffdhe4096 0 00:18:27.401 11:29:22 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@65 -- # local digest dhgroup key ckey qpairs 00:18:27.401 11:29:22 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # digest=sha512 00:18:27.401 11:29:22 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # dhgroup=ffdhe4096 00:18:27.401 11:29:22 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # key=key0 00:18:27.401 11:29:22 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@68 -- # ckey=(${ckeys[$3]:+--dhchap-ctrlr-key "ckey$3"}) 00:18:27.401 11:29:22 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@70 -- # rpc_cmd nvmf_subsystem_add_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:c758a4ed-f09f-4c82-9afb-3d096f035464 --dhchap-key key0 --dhchap-ctrlr-key ckey0 00:18:27.401 11:29:22 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:27.401 11:29:22 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:18:27.401 11:29:22 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:27.401 11:29:22 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@71 -- # bdev_connect -b nvme0 --dhchap-key key0 --dhchap-ctrlr-key ckey0 00:18:27.401 11:29:22 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@60 -- # hostrpc bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.3 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:c758a4ed-f09f-4c82-9afb-3d096f035464 -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key0 --dhchap-ctrlr-key ckey0 00:18:27.401 11:29:22 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.3 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:c758a4ed-f09f-4c82-9afb-3d096f035464 -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key0 --dhchap-ctrlr-key ckey0 00:18:27.659 00:18:27.659 11:29:23 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # hostrpc bdev_nvme_get_controllers 00:18:27.659 11:29:23 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # jq -r '.[].name' 00:18:27.659 11:29:23 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_get_controllers 00:18:28.226 11:29:23 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:18:28.226 11:29:23 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@74 -- # rpc_cmd nvmf_subsystem_get_qpairs nqn.2024-03.io.spdk:cnode0 00:18:28.226 11:29:23 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:28.226 11:29:23 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:18:28.226 11:29:23 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:28.226 11:29:23 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@74 -- # qpairs='[ 00:18:28.226 { 00:18:28.226 "auth": { 00:18:28.226 "dhgroup": "ffdhe4096", 00:18:28.226 "digest": "sha512", 00:18:28.226 "state": "completed" 00:18:28.226 }, 00:18:28.226 "cntlid": 121, 00:18:28.226 "hostnqn": "nqn.2014-08.org.nvmexpress:uuid:c758a4ed-f09f-4c82-9afb-3d096f035464", 00:18:28.226 "listen_address": { 00:18:28.226 "adrfam": "IPv4", 00:18:28.226 "traddr": "10.0.0.3", 00:18:28.226 "trsvcid": "4420", 00:18:28.226 "trtype": "TCP" 00:18:28.226 }, 00:18:28.226 "peer_address": { 00:18:28.226 "adrfam": "IPv4", 00:18:28.226 "traddr": "10.0.0.1", 00:18:28.226 "trsvcid": "55312", 00:18:28.226 "trtype": "TCP" 00:18:28.226 }, 00:18:28.226 "qid": 0, 00:18:28.226 "state": "enabled", 00:18:28.226 "thread": "nvmf_tgt_poll_group_000" 00:18:28.226 } 00:18:28.226 ]' 00:18:28.226 11:29:23 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@75 -- # jq -r '.[0].auth.digest' 00:18:28.226 11:29:23 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@75 -- # [[ sha512 == \s\h\a\5\1\2 ]] 00:18:28.226 11:29:23 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@76 -- # jq -r '.[0].auth.dhgroup' 00:18:28.226 11:29:23 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@76 -- # [[ ffdhe4096 == \f\f\d\h\e\4\0\9\6 ]] 00:18:28.226 11:29:23 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@77 -- # jq -r '.[0].auth.state' 00:18:28.226 11:29:23 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@77 -- # [[ completed == \c\o\m\p\l\e\t\e\d ]] 00:18:28.226 11:29:23 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@78 -- # hostrpc bdev_nvme_detach_controller nvme0 00:18:28.226 11:29:23 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_detach_controller nvme0 00:18:28.484 11:29:23 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@80 -- # nvme_connect --dhchap-secret DHHC-1:00:YTQ3MDY2OWMxZDcwN2QyZmRhNGVmYjYzYTczYTM4NzAwYjdiNTBmZmE2ZDBlZTc28YG94Q==: --dhchap-ctrl-secret DHHC-1:03:YmY1NDQyMjdhMGU5ZDk3NGFiYTIyMTE1OTgzNGQ4ZDQ0MTE3YmFjMTc3MGQ4NDRlOTU5MThlODc5YzUxNGM2Y9nOg8I=: 00:18:28.484 11:29:23 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@36 -- # nvme connect -t tcp -a 10.0.0.3 -n nqn.2024-03.io.spdk:cnode0 -i 1 -q nqn.2014-08.org.nvmexpress:uuid:c758a4ed-f09f-4c82-9afb-3d096f035464 --hostid c758a4ed-f09f-4c82-9afb-3d096f035464 -l 0 --dhchap-secret DHHC-1:00:YTQ3MDY2OWMxZDcwN2QyZmRhNGVmYjYzYTczYTM4NzAwYjdiNTBmZmE2ZDBlZTc28YG94Q==: --dhchap-ctrl-secret DHHC-1:03:YmY1NDQyMjdhMGU5ZDk3NGFiYTIyMTE1OTgzNGQ4ZDQ0MTE3YmFjMTc3MGQ4NDRlOTU5MThlODc5YzUxNGM2Y9nOg8I=: 00:18:29.418 11:29:24 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@82 -- # nvme disconnect -n nqn.2024-03.io.spdk:cnode0 00:18:29.418 NQN:nqn.2024-03.io.spdk:cnode0 disconnected 1 controller(s) 00:18:29.418 11:29:24 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@83 -- # rpc_cmd nvmf_subsystem_remove_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:c758a4ed-f09f-4c82-9afb-3d096f035464 00:18:29.418 11:29:24 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:29.418 11:29:24 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:18:29.418 11:29:24 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:29.418 11:29:24 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@120 -- # for keyid in "${!keys[@]}" 00:18:29.418 11:29:24 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@121 -- # hostrpc bdev_nvme_set_options --dhchap-digests sha512 --dhchap-dhgroups ffdhe4096 00:18:29.418 11:29:24 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_set_options --dhchap-digests sha512 --dhchap-dhgroups ffdhe4096 00:18:29.418 11:29:24 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@123 -- # connect_authenticate sha512 ffdhe4096 1 00:18:29.418 11:29:24 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@65 -- # local digest dhgroup key ckey qpairs 00:18:29.418 11:29:24 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # digest=sha512 00:18:29.418 11:29:24 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # dhgroup=ffdhe4096 00:18:29.418 11:29:24 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # key=key1 00:18:29.418 11:29:24 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@68 -- # ckey=(${ckeys[$3]:+--dhchap-ctrlr-key "ckey$3"}) 00:18:29.418 11:29:24 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@70 -- # rpc_cmd nvmf_subsystem_add_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:c758a4ed-f09f-4c82-9afb-3d096f035464 --dhchap-key key1 --dhchap-ctrlr-key ckey1 00:18:29.418 11:29:24 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:29.418 11:29:24 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:18:29.418 11:29:24 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:29.418 11:29:24 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@71 -- # bdev_connect -b nvme0 --dhchap-key key1 --dhchap-ctrlr-key ckey1 00:18:29.418 11:29:24 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@60 -- # hostrpc bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.3 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:c758a4ed-f09f-4c82-9afb-3d096f035464 -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key1 --dhchap-ctrlr-key ckey1 00:18:29.418 11:29:24 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.3 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:c758a4ed-f09f-4c82-9afb-3d096f035464 -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key1 --dhchap-ctrlr-key ckey1 00:18:29.984 00:18:29.984 11:29:25 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # jq -r '.[].name' 00:18:29.984 11:29:25 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # hostrpc bdev_nvme_get_controllers 00:18:29.984 11:29:25 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_get_controllers 00:18:30.242 11:29:25 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:18:30.242 11:29:25 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@74 -- # rpc_cmd nvmf_subsystem_get_qpairs nqn.2024-03.io.spdk:cnode0 00:18:30.242 11:29:25 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:30.242 11:29:25 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:18:30.242 11:29:25 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:30.242 11:29:25 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@74 -- # qpairs='[ 00:18:30.242 { 00:18:30.242 "auth": { 00:18:30.242 "dhgroup": "ffdhe4096", 00:18:30.242 "digest": "sha512", 00:18:30.242 "state": "completed" 00:18:30.242 }, 00:18:30.242 "cntlid": 123, 00:18:30.242 "hostnqn": "nqn.2014-08.org.nvmexpress:uuid:c758a4ed-f09f-4c82-9afb-3d096f035464", 00:18:30.242 "listen_address": { 00:18:30.242 "adrfam": "IPv4", 00:18:30.242 "traddr": "10.0.0.3", 00:18:30.242 "trsvcid": "4420", 00:18:30.242 "trtype": "TCP" 00:18:30.242 }, 00:18:30.242 "peer_address": { 00:18:30.242 "adrfam": "IPv4", 00:18:30.242 "traddr": "10.0.0.1", 00:18:30.242 "trsvcid": "55334", 00:18:30.242 "trtype": "TCP" 00:18:30.242 }, 00:18:30.242 "qid": 0, 00:18:30.242 "state": "enabled", 00:18:30.242 "thread": "nvmf_tgt_poll_group_000" 00:18:30.242 } 00:18:30.242 ]' 00:18:30.242 11:29:25 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@75 -- # jq -r '.[0].auth.digest' 00:18:30.242 11:29:25 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@75 -- # [[ sha512 == \s\h\a\5\1\2 ]] 00:18:30.242 11:29:25 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@76 -- # jq -r '.[0].auth.dhgroup' 00:18:30.500 11:29:25 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@76 -- # [[ ffdhe4096 == \f\f\d\h\e\4\0\9\6 ]] 00:18:30.500 11:29:25 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@77 -- # jq -r '.[0].auth.state' 00:18:30.500 11:29:25 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@77 -- # [[ completed == \c\o\m\p\l\e\t\e\d ]] 00:18:30.500 11:29:25 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@78 -- # hostrpc bdev_nvme_detach_controller nvme0 00:18:30.500 11:29:25 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_detach_controller nvme0 00:18:30.758 11:29:26 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@80 -- # nvme_connect --dhchap-secret DHHC-1:01:YTU2ZTRiMDFkMzNiMjFmN2QwNTBiYjliMGJkYjQwZTTsDgGm: --dhchap-ctrl-secret DHHC-1:02:ZjZjOWFiZGJhYjc3NzkxOGQwNGZmNTA0MTE0MjkzYmVkODZmYTJjNzcyZDM2NjYxWbIiww==: 00:18:30.758 11:29:26 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@36 -- # nvme connect -t tcp -a 10.0.0.3 -n nqn.2024-03.io.spdk:cnode0 -i 1 -q nqn.2014-08.org.nvmexpress:uuid:c758a4ed-f09f-4c82-9afb-3d096f035464 --hostid c758a4ed-f09f-4c82-9afb-3d096f035464 -l 0 --dhchap-secret DHHC-1:01:YTU2ZTRiMDFkMzNiMjFmN2QwNTBiYjliMGJkYjQwZTTsDgGm: --dhchap-ctrl-secret DHHC-1:02:ZjZjOWFiZGJhYjc3NzkxOGQwNGZmNTA0MTE0MjkzYmVkODZmYTJjNzcyZDM2NjYxWbIiww==: 00:18:31.709 11:29:26 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@82 -- # nvme disconnect -n nqn.2024-03.io.spdk:cnode0 00:18:31.709 NQN:nqn.2024-03.io.spdk:cnode0 disconnected 1 controller(s) 00:18:31.709 11:29:26 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@83 -- # rpc_cmd nvmf_subsystem_remove_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:c758a4ed-f09f-4c82-9afb-3d096f035464 00:18:31.710 11:29:26 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:31.710 11:29:26 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:18:31.710 11:29:26 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:31.710 11:29:26 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@120 -- # for keyid in "${!keys[@]}" 00:18:31.710 11:29:26 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@121 -- # hostrpc bdev_nvme_set_options --dhchap-digests sha512 --dhchap-dhgroups ffdhe4096 00:18:31.710 11:29:26 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_set_options --dhchap-digests sha512 --dhchap-dhgroups ffdhe4096 00:18:31.967 11:29:27 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@123 -- # connect_authenticate sha512 ffdhe4096 2 00:18:31.967 11:29:27 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@65 -- # local digest dhgroup key ckey qpairs 00:18:31.967 11:29:27 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # digest=sha512 00:18:31.967 11:29:27 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # dhgroup=ffdhe4096 00:18:31.967 11:29:27 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # key=key2 00:18:31.967 11:29:27 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@68 -- # ckey=(${ckeys[$3]:+--dhchap-ctrlr-key "ckey$3"}) 00:18:31.967 11:29:27 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@70 -- # rpc_cmd nvmf_subsystem_add_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:c758a4ed-f09f-4c82-9afb-3d096f035464 --dhchap-key key2 --dhchap-ctrlr-key ckey2 00:18:31.967 11:29:27 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:31.967 11:29:27 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:18:31.967 11:29:27 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:31.967 11:29:27 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@71 -- # bdev_connect -b nvme0 --dhchap-key key2 --dhchap-ctrlr-key ckey2 00:18:31.968 11:29:27 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@60 -- # hostrpc bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.3 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:c758a4ed-f09f-4c82-9afb-3d096f035464 -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key2 --dhchap-ctrlr-key ckey2 00:18:31.968 11:29:27 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.3 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:c758a4ed-f09f-4c82-9afb-3d096f035464 -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key2 --dhchap-ctrlr-key ckey2 00:18:32.225 00:18:32.225 11:29:27 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # hostrpc bdev_nvme_get_controllers 00:18:32.225 11:29:27 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # jq -r '.[].name' 00:18:32.225 11:29:27 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_get_controllers 00:18:32.792 11:29:28 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:18:32.792 11:29:28 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@74 -- # rpc_cmd nvmf_subsystem_get_qpairs nqn.2024-03.io.spdk:cnode0 00:18:32.792 11:29:28 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:32.792 11:29:28 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:18:32.792 11:29:28 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:32.792 11:29:28 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@74 -- # qpairs='[ 00:18:32.792 { 00:18:32.792 "auth": { 00:18:32.792 "dhgroup": "ffdhe4096", 00:18:32.792 "digest": "sha512", 00:18:32.792 "state": "completed" 00:18:32.792 }, 00:18:32.792 "cntlid": 125, 00:18:32.792 "hostnqn": "nqn.2014-08.org.nvmexpress:uuid:c758a4ed-f09f-4c82-9afb-3d096f035464", 00:18:32.792 "listen_address": { 00:18:32.792 "adrfam": "IPv4", 00:18:32.792 "traddr": "10.0.0.3", 00:18:32.792 "trsvcid": "4420", 00:18:32.792 "trtype": "TCP" 00:18:32.792 }, 00:18:32.792 "peer_address": { 00:18:32.792 "adrfam": "IPv4", 00:18:32.792 "traddr": "10.0.0.1", 00:18:32.792 "trsvcid": "55360", 00:18:32.792 "trtype": "TCP" 00:18:32.792 }, 00:18:32.792 "qid": 0, 00:18:32.792 "state": "enabled", 00:18:32.792 "thread": "nvmf_tgt_poll_group_000" 00:18:32.792 } 00:18:32.792 ]' 00:18:32.792 11:29:28 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@75 -- # jq -r '.[0].auth.digest' 00:18:32.792 11:29:28 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@75 -- # [[ sha512 == \s\h\a\5\1\2 ]] 00:18:32.792 11:29:28 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@76 -- # jq -r '.[0].auth.dhgroup' 00:18:32.792 11:29:28 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@76 -- # [[ ffdhe4096 == \f\f\d\h\e\4\0\9\6 ]] 00:18:32.792 11:29:28 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@77 -- # jq -r '.[0].auth.state' 00:18:32.792 11:29:28 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@77 -- # [[ completed == \c\o\m\p\l\e\t\e\d ]] 00:18:32.792 11:29:28 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@78 -- # hostrpc bdev_nvme_detach_controller nvme0 00:18:32.792 11:29:28 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_detach_controller nvme0 00:18:33.050 11:29:28 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@80 -- # nvme_connect --dhchap-secret DHHC-1:02:YjZiMDU3YTg1ZTA0NWQzMGY1ZWM0YzNmYzc1NDY1OWNkZmQ3NmU2YWM2ZDE3ZmVmgTRtHQ==: --dhchap-ctrl-secret DHHC-1:01:YmQ3ZDA4NWFiYjI3YjdjNWVjMzc4NDNiZTM4ZTU3N2a6gUZi: 00:18:33.050 11:29:28 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@36 -- # nvme connect -t tcp -a 10.0.0.3 -n nqn.2024-03.io.spdk:cnode0 -i 1 -q nqn.2014-08.org.nvmexpress:uuid:c758a4ed-f09f-4c82-9afb-3d096f035464 --hostid c758a4ed-f09f-4c82-9afb-3d096f035464 -l 0 --dhchap-secret DHHC-1:02:YjZiMDU3YTg1ZTA0NWQzMGY1ZWM0YzNmYzc1NDY1OWNkZmQ3NmU2YWM2ZDE3ZmVmgTRtHQ==: --dhchap-ctrl-secret DHHC-1:01:YmQ3ZDA4NWFiYjI3YjdjNWVjMzc4NDNiZTM4ZTU3N2a6gUZi: 00:18:33.983 11:29:29 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@82 -- # nvme disconnect -n nqn.2024-03.io.spdk:cnode0 00:18:33.983 NQN:nqn.2024-03.io.spdk:cnode0 disconnected 1 controller(s) 00:18:33.983 11:29:29 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@83 -- # rpc_cmd nvmf_subsystem_remove_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:c758a4ed-f09f-4c82-9afb-3d096f035464 00:18:33.983 11:29:29 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:33.983 11:29:29 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:18:33.983 11:29:29 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:33.983 11:29:29 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@120 -- # for keyid in "${!keys[@]}" 00:18:33.983 11:29:29 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@121 -- # hostrpc bdev_nvme_set_options --dhchap-digests sha512 --dhchap-dhgroups ffdhe4096 00:18:33.983 11:29:29 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_set_options --dhchap-digests sha512 --dhchap-dhgroups ffdhe4096 00:18:34.240 11:29:29 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@123 -- # connect_authenticate sha512 ffdhe4096 3 00:18:34.240 11:29:29 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@65 -- # local digest dhgroup key ckey qpairs 00:18:34.240 11:29:29 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # digest=sha512 00:18:34.240 11:29:29 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # dhgroup=ffdhe4096 00:18:34.240 11:29:29 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # key=key3 00:18:34.240 11:29:29 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@68 -- # ckey=(${ckeys[$3]:+--dhchap-ctrlr-key "ckey$3"}) 00:18:34.241 11:29:29 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@70 -- # rpc_cmd nvmf_subsystem_add_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:c758a4ed-f09f-4c82-9afb-3d096f035464 --dhchap-key key3 00:18:34.241 11:29:29 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:34.241 11:29:29 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:18:34.241 11:29:29 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:34.241 11:29:29 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@71 -- # bdev_connect -b nvme0 --dhchap-key key3 00:18:34.241 11:29:29 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@60 -- # hostrpc bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.3 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:c758a4ed-f09f-4c82-9afb-3d096f035464 -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key3 00:18:34.241 11:29:29 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.3 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:c758a4ed-f09f-4c82-9afb-3d096f035464 -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key3 00:18:34.807 00:18:34.807 11:29:30 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # jq -r '.[].name' 00:18:34.807 11:29:30 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # hostrpc bdev_nvme_get_controllers 00:18:34.807 11:29:30 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_get_controllers 00:18:35.064 11:29:30 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:18:35.064 11:29:30 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@74 -- # rpc_cmd nvmf_subsystem_get_qpairs nqn.2024-03.io.spdk:cnode0 00:18:35.064 11:29:30 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:35.064 11:29:30 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:18:35.064 11:29:30 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:35.064 11:29:30 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@74 -- # qpairs='[ 00:18:35.064 { 00:18:35.064 "auth": { 00:18:35.064 "dhgroup": "ffdhe4096", 00:18:35.064 "digest": "sha512", 00:18:35.064 "state": "completed" 00:18:35.064 }, 00:18:35.064 "cntlid": 127, 00:18:35.064 "hostnqn": "nqn.2014-08.org.nvmexpress:uuid:c758a4ed-f09f-4c82-9afb-3d096f035464", 00:18:35.064 "listen_address": { 00:18:35.064 "adrfam": "IPv4", 00:18:35.064 "traddr": "10.0.0.3", 00:18:35.064 "trsvcid": "4420", 00:18:35.064 "trtype": "TCP" 00:18:35.064 }, 00:18:35.064 "peer_address": { 00:18:35.064 "adrfam": "IPv4", 00:18:35.064 "traddr": "10.0.0.1", 00:18:35.064 "trsvcid": "55384", 00:18:35.064 "trtype": "TCP" 00:18:35.064 }, 00:18:35.064 "qid": 0, 00:18:35.064 "state": "enabled", 00:18:35.064 "thread": "nvmf_tgt_poll_group_000" 00:18:35.064 } 00:18:35.064 ]' 00:18:35.064 11:29:30 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@75 -- # jq -r '.[0].auth.digest' 00:18:35.064 11:29:30 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@75 -- # [[ sha512 == \s\h\a\5\1\2 ]] 00:18:35.064 11:29:30 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@76 -- # jq -r '.[0].auth.dhgroup' 00:18:35.064 11:29:30 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@76 -- # [[ ffdhe4096 == \f\f\d\h\e\4\0\9\6 ]] 00:18:35.064 11:29:30 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@77 -- # jq -r '.[0].auth.state' 00:18:35.064 11:29:30 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@77 -- # [[ completed == \c\o\m\p\l\e\t\e\d ]] 00:18:35.064 11:29:30 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@78 -- # hostrpc bdev_nvme_detach_controller nvme0 00:18:35.064 11:29:30 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_detach_controller nvme0 00:18:35.627 11:29:30 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@80 -- # nvme_connect --dhchap-secret DHHC-1:03:YjUzYzRlNjQ2N2QwNDQ3ZGZhN2VhODUzYjlkY2I2OWViZWM1NzZiOTJiM2MwNzIxZWVkMmMxOTIzNWE5M2Q4MDbs9Og=: 00:18:35.627 11:29:30 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@36 -- # nvme connect -t tcp -a 10.0.0.3 -n nqn.2024-03.io.spdk:cnode0 -i 1 -q nqn.2014-08.org.nvmexpress:uuid:c758a4ed-f09f-4c82-9afb-3d096f035464 --hostid c758a4ed-f09f-4c82-9afb-3d096f035464 -l 0 --dhchap-secret DHHC-1:03:YjUzYzRlNjQ2N2QwNDQ3ZGZhN2VhODUzYjlkY2I2OWViZWM1NzZiOTJiM2MwNzIxZWVkMmMxOTIzNWE5M2Q4MDbs9Og=: 00:18:36.195 11:29:31 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@82 -- # nvme disconnect -n nqn.2024-03.io.spdk:cnode0 00:18:36.195 NQN:nqn.2024-03.io.spdk:cnode0 disconnected 1 controller(s) 00:18:36.195 11:29:31 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@83 -- # rpc_cmd nvmf_subsystem_remove_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:c758a4ed-f09f-4c82-9afb-3d096f035464 00:18:36.195 11:29:31 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:36.195 11:29:31 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:18:36.195 11:29:31 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:36.195 11:29:31 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@119 -- # for dhgroup in "${dhgroups[@]}" 00:18:36.195 11:29:31 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@120 -- # for keyid in "${!keys[@]}" 00:18:36.195 11:29:31 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@121 -- # hostrpc bdev_nvme_set_options --dhchap-digests sha512 --dhchap-dhgroups ffdhe6144 00:18:36.195 11:29:31 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_set_options --dhchap-digests sha512 --dhchap-dhgroups ffdhe6144 00:18:36.768 11:29:31 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@123 -- # connect_authenticate sha512 ffdhe6144 0 00:18:36.768 11:29:31 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@65 -- # local digest dhgroup key ckey qpairs 00:18:36.768 11:29:31 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # digest=sha512 00:18:36.768 11:29:31 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # dhgroup=ffdhe6144 00:18:36.768 11:29:31 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # key=key0 00:18:36.768 11:29:31 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@68 -- # ckey=(${ckeys[$3]:+--dhchap-ctrlr-key "ckey$3"}) 00:18:36.768 11:29:31 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@70 -- # rpc_cmd nvmf_subsystem_add_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:c758a4ed-f09f-4c82-9afb-3d096f035464 --dhchap-key key0 --dhchap-ctrlr-key ckey0 00:18:36.768 11:29:31 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:36.768 11:29:31 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:18:36.768 11:29:31 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:36.768 11:29:31 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@71 -- # bdev_connect -b nvme0 --dhchap-key key0 --dhchap-ctrlr-key ckey0 00:18:36.768 11:29:31 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@60 -- # hostrpc bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.3 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:c758a4ed-f09f-4c82-9afb-3d096f035464 -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key0 --dhchap-ctrlr-key ckey0 00:18:36.768 11:29:31 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.3 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:c758a4ed-f09f-4c82-9afb-3d096f035464 -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key0 --dhchap-ctrlr-key ckey0 00:18:37.026 00:18:37.026 11:29:32 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # hostrpc bdev_nvme_get_controllers 00:18:37.026 11:29:32 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_get_controllers 00:18:37.026 11:29:32 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # jq -r '.[].name' 00:18:37.592 11:29:32 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:18:37.592 11:29:32 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@74 -- # rpc_cmd nvmf_subsystem_get_qpairs nqn.2024-03.io.spdk:cnode0 00:18:37.592 11:29:32 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:37.592 11:29:32 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:18:37.592 11:29:32 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:37.592 11:29:32 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@74 -- # qpairs='[ 00:18:37.592 { 00:18:37.592 "auth": { 00:18:37.592 "dhgroup": "ffdhe6144", 00:18:37.592 "digest": "sha512", 00:18:37.592 "state": "completed" 00:18:37.592 }, 00:18:37.592 "cntlid": 129, 00:18:37.592 "hostnqn": "nqn.2014-08.org.nvmexpress:uuid:c758a4ed-f09f-4c82-9afb-3d096f035464", 00:18:37.592 "listen_address": { 00:18:37.592 "adrfam": "IPv4", 00:18:37.592 "traddr": "10.0.0.3", 00:18:37.592 "trsvcid": "4420", 00:18:37.592 "trtype": "TCP" 00:18:37.592 }, 00:18:37.592 "peer_address": { 00:18:37.592 "adrfam": "IPv4", 00:18:37.592 "traddr": "10.0.0.1", 00:18:37.592 "trsvcid": "50306", 00:18:37.592 "trtype": "TCP" 00:18:37.592 }, 00:18:37.592 "qid": 0, 00:18:37.592 "state": "enabled", 00:18:37.592 "thread": "nvmf_tgt_poll_group_000" 00:18:37.592 } 00:18:37.592 ]' 00:18:37.592 11:29:32 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@75 -- # jq -r '.[0].auth.digest' 00:18:37.592 11:29:32 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@75 -- # [[ sha512 == \s\h\a\5\1\2 ]] 00:18:37.592 11:29:32 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@76 -- # jq -r '.[0].auth.dhgroup' 00:18:37.592 11:29:32 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@76 -- # [[ ffdhe6144 == \f\f\d\h\e\6\1\4\4 ]] 00:18:37.592 11:29:32 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@77 -- # jq -r '.[0].auth.state' 00:18:37.592 11:29:32 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@77 -- # [[ completed == \c\o\m\p\l\e\t\e\d ]] 00:18:37.592 11:29:32 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@78 -- # hostrpc bdev_nvme_detach_controller nvme0 00:18:37.592 11:29:32 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_detach_controller nvme0 00:18:37.850 11:29:33 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@80 -- # nvme_connect --dhchap-secret DHHC-1:00:YTQ3MDY2OWMxZDcwN2QyZmRhNGVmYjYzYTczYTM4NzAwYjdiNTBmZmE2ZDBlZTc28YG94Q==: --dhchap-ctrl-secret DHHC-1:03:YmY1NDQyMjdhMGU5ZDk3NGFiYTIyMTE1OTgzNGQ4ZDQ0MTE3YmFjMTc3MGQ4NDRlOTU5MThlODc5YzUxNGM2Y9nOg8I=: 00:18:37.850 11:29:33 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@36 -- # nvme connect -t tcp -a 10.0.0.3 -n nqn.2024-03.io.spdk:cnode0 -i 1 -q nqn.2014-08.org.nvmexpress:uuid:c758a4ed-f09f-4c82-9afb-3d096f035464 --hostid c758a4ed-f09f-4c82-9afb-3d096f035464 -l 0 --dhchap-secret DHHC-1:00:YTQ3MDY2OWMxZDcwN2QyZmRhNGVmYjYzYTczYTM4NzAwYjdiNTBmZmE2ZDBlZTc28YG94Q==: --dhchap-ctrl-secret DHHC-1:03:YmY1NDQyMjdhMGU5ZDk3NGFiYTIyMTE1OTgzNGQ4ZDQ0MTE3YmFjMTc3MGQ4NDRlOTU5MThlODc5YzUxNGM2Y9nOg8I=: 00:18:38.782 11:29:33 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@82 -- # nvme disconnect -n nqn.2024-03.io.spdk:cnode0 00:18:38.782 NQN:nqn.2024-03.io.spdk:cnode0 disconnected 1 controller(s) 00:18:38.782 11:29:33 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@83 -- # rpc_cmd nvmf_subsystem_remove_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:c758a4ed-f09f-4c82-9afb-3d096f035464 00:18:38.782 11:29:33 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:38.782 11:29:33 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:18:38.782 11:29:34 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:38.782 11:29:34 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@120 -- # for keyid in "${!keys[@]}" 00:18:38.782 11:29:34 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@121 -- # hostrpc bdev_nvme_set_options --dhchap-digests sha512 --dhchap-dhgroups ffdhe6144 00:18:38.782 11:29:34 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_set_options --dhchap-digests sha512 --dhchap-dhgroups ffdhe6144 00:18:39.040 11:29:34 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@123 -- # connect_authenticate sha512 ffdhe6144 1 00:18:39.040 11:29:34 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@65 -- # local digest dhgroup key ckey qpairs 00:18:39.040 11:29:34 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # digest=sha512 00:18:39.040 11:29:34 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # dhgroup=ffdhe6144 00:18:39.040 11:29:34 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # key=key1 00:18:39.040 11:29:34 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@68 -- # ckey=(${ckeys[$3]:+--dhchap-ctrlr-key "ckey$3"}) 00:18:39.040 11:29:34 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@70 -- # rpc_cmd nvmf_subsystem_add_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:c758a4ed-f09f-4c82-9afb-3d096f035464 --dhchap-key key1 --dhchap-ctrlr-key ckey1 00:18:39.040 11:29:34 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:39.040 11:29:34 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:18:39.040 11:29:34 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:39.040 11:29:34 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@71 -- # bdev_connect -b nvme0 --dhchap-key key1 --dhchap-ctrlr-key ckey1 00:18:39.040 11:29:34 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@60 -- # hostrpc bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.3 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:c758a4ed-f09f-4c82-9afb-3d096f035464 -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key1 --dhchap-ctrlr-key ckey1 00:18:39.040 11:29:34 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.3 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:c758a4ed-f09f-4c82-9afb-3d096f035464 -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key1 --dhchap-ctrlr-key ckey1 00:18:39.607 00:18:39.607 11:29:34 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # hostrpc bdev_nvme_get_controllers 00:18:39.607 11:29:34 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # jq -r '.[].name' 00:18:39.607 11:29:34 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_get_controllers 00:18:39.607 11:29:35 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:18:39.607 11:29:35 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@74 -- # rpc_cmd nvmf_subsystem_get_qpairs nqn.2024-03.io.spdk:cnode0 00:18:39.607 11:29:35 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:39.607 11:29:35 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:18:39.866 11:29:35 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:39.866 11:29:35 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@74 -- # qpairs='[ 00:18:39.866 { 00:18:39.866 "auth": { 00:18:39.866 "dhgroup": "ffdhe6144", 00:18:39.866 "digest": "sha512", 00:18:39.866 "state": "completed" 00:18:39.866 }, 00:18:39.866 "cntlid": 131, 00:18:39.866 "hostnqn": "nqn.2014-08.org.nvmexpress:uuid:c758a4ed-f09f-4c82-9afb-3d096f035464", 00:18:39.866 "listen_address": { 00:18:39.866 "adrfam": "IPv4", 00:18:39.866 "traddr": "10.0.0.3", 00:18:39.866 "trsvcid": "4420", 00:18:39.866 "trtype": "TCP" 00:18:39.866 }, 00:18:39.866 "peer_address": { 00:18:39.866 "adrfam": "IPv4", 00:18:39.866 "traddr": "10.0.0.1", 00:18:39.866 "trsvcid": "50336", 00:18:39.866 "trtype": "TCP" 00:18:39.866 }, 00:18:39.866 "qid": 0, 00:18:39.866 "state": "enabled", 00:18:39.866 "thread": "nvmf_tgt_poll_group_000" 00:18:39.866 } 00:18:39.866 ]' 00:18:39.866 11:29:35 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@75 -- # jq -r '.[0].auth.digest' 00:18:39.866 11:29:35 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@75 -- # [[ sha512 == \s\h\a\5\1\2 ]] 00:18:39.866 11:29:35 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@76 -- # jq -r '.[0].auth.dhgroup' 00:18:39.866 11:29:35 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@76 -- # [[ ffdhe6144 == \f\f\d\h\e\6\1\4\4 ]] 00:18:39.866 11:29:35 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@77 -- # jq -r '.[0].auth.state' 00:18:39.866 11:29:35 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@77 -- # [[ completed == \c\o\m\p\l\e\t\e\d ]] 00:18:39.866 11:29:35 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@78 -- # hostrpc bdev_nvme_detach_controller nvme0 00:18:39.866 11:29:35 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_detach_controller nvme0 00:18:40.124 11:29:35 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@80 -- # nvme_connect --dhchap-secret DHHC-1:01:YTU2ZTRiMDFkMzNiMjFmN2QwNTBiYjliMGJkYjQwZTTsDgGm: --dhchap-ctrl-secret DHHC-1:02:ZjZjOWFiZGJhYjc3NzkxOGQwNGZmNTA0MTE0MjkzYmVkODZmYTJjNzcyZDM2NjYxWbIiww==: 00:18:40.124 11:29:35 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@36 -- # nvme connect -t tcp -a 10.0.0.3 -n nqn.2024-03.io.spdk:cnode0 -i 1 -q nqn.2014-08.org.nvmexpress:uuid:c758a4ed-f09f-4c82-9afb-3d096f035464 --hostid c758a4ed-f09f-4c82-9afb-3d096f035464 -l 0 --dhchap-secret DHHC-1:01:YTU2ZTRiMDFkMzNiMjFmN2QwNTBiYjliMGJkYjQwZTTsDgGm: --dhchap-ctrl-secret DHHC-1:02:ZjZjOWFiZGJhYjc3NzkxOGQwNGZmNTA0MTE0MjkzYmVkODZmYTJjNzcyZDM2NjYxWbIiww==: 00:18:41.057 11:29:36 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@82 -- # nvme disconnect -n nqn.2024-03.io.spdk:cnode0 00:18:41.057 NQN:nqn.2024-03.io.spdk:cnode0 disconnected 1 controller(s) 00:18:41.057 11:29:36 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@83 -- # rpc_cmd nvmf_subsystem_remove_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:c758a4ed-f09f-4c82-9afb-3d096f035464 00:18:41.057 11:29:36 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:41.057 11:29:36 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:18:41.057 11:29:36 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:41.057 11:29:36 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@120 -- # for keyid in "${!keys[@]}" 00:18:41.057 11:29:36 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@121 -- # hostrpc bdev_nvme_set_options --dhchap-digests sha512 --dhchap-dhgroups ffdhe6144 00:18:41.057 11:29:36 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_set_options --dhchap-digests sha512 --dhchap-dhgroups ffdhe6144 00:18:41.315 11:29:36 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@123 -- # connect_authenticate sha512 ffdhe6144 2 00:18:41.315 11:29:36 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@65 -- # local digest dhgroup key ckey qpairs 00:18:41.315 11:29:36 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # digest=sha512 00:18:41.315 11:29:36 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # dhgroup=ffdhe6144 00:18:41.315 11:29:36 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # key=key2 00:18:41.315 11:29:36 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@68 -- # ckey=(${ckeys[$3]:+--dhchap-ctrlr-key "ckey$3"}) 00:18:41.315 11:29:36 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@70 -- # rpc_cmd nvmf_subsystem_add_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:c758a4ed-f09f-4c82-9afb-3d096f035464 --dhchap-key key2 --dhchap-ctrlr-key ckey2 00:18:41.315 11:29:36 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:41.315 11:29:36 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:18:41.315 11:29:36 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:41.315 11:29:36 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@71 -- # bdev_connect -b nvme0 --dhchap-key key2 --dhchap-ctrlr-key ckey2 00:18:41.315 11:29:36 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@60 -- # hostrpc bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.3 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:c758a4ed-f09f-4c82-9afb-3d096f035464 -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key2 --dhchap-ctrlr-key ckey2 00:18:41.315 11:29:36 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.3 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:c758a4ed-f09f-4c82-9afb-3d096f035464 -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key2 --dhchap-ctrlr-key ckey2 00:18:41.881 00:18:41.881 11:29:37 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # hostrpc bdev_nvme_get_controllers 00:18:41.881 11:29:37 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_get_controllers 00:18:41.881 11:29:37 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # jq -r '.[].name' 00:18:42.139 11:29:37 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:18:42.139 11:29:37 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@74 -- # rpc_cmd nvmf_subsystem_get_qpairs nqn.2024-03.io.spdk:cnode0 00:18:42.139 11:29:37 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:42.139 11:29:37 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:18:42.139 11:29:37 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:42.139 11:29:37 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@74 -- # qpairs='[ 00:18:42.139 { 00:18:42.139 "auth": { 00:18:42.139 "dhgroup": "ffdhe6144", 00:18:42.139 "digest": "sha512", 00:18:42.139 "state": "completed" 00:18:42.139 }, 00:18:42.139 "cntlid": 133, 00:18:42.139 "hostnqn": "nqn.2014-08.org.nvmexpress:uuid:c758a4ed-f09f-4c82-9afb-3d096f035464", 00:18:42.139 "listen_address": { 00:18:42.139 "adrfam": "IPv4", 00:18:42.139 "traddr": "10.0.0.3", 00:18:42.139 "trsvcid": "4420", 00:18:42.139 "trtype": "TCP" 00:18:42.139 }, 00:18:42.140 "peer_address": { 00:18:42.140 "adrfam": "IPv4", 00:18:42.140 "traddr": "10.0.0.1", 00:18:42.140 "trsvcid": "50362", 00:18:42.140 "trtype": "TCP" 00:18:42.140 }, 00:18:42.140 "qid": 0, 00:18:42.140 "state": "enabled", 00:18:42.140 "thread": "nvmf_tgt_poll_group_000" 00:18:42.140 } 00:18:42.140 ]' 00:18:42.140 11:29:37 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@75 -- # jq -r '.[0].auth.digest' 00:18:42.140 11:29:37 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@75 -- # [[ sha512 == \s\h\a\5\1\2 ]] 00:18:42.140 11:29:37 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@76 -- # jq -r '.[0].auth.dhgroup' 00:18:42.140 11:29:37 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@76 -- # [[ ffdhe6144 == \f\f\d\h\e\6\1\4\4 ]] 00:18:42.140 11:29:37 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@77 -- # jq -r '.[0].auth.state' 00:18:42.398 11:29:37 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@77 -- # [[ completed == \c\o\m\p\l\e\t\e\d ]] 00:18:42.398 11:29:37 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@78 -- # hostrpc bdev_nvme_detach_controller nvme0 00:18:42.398 11:29:37 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_detach_controller nvme0 00:18:42.656 11:29:37 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@80 -- # nvme_connect --dhchap-secret DHHC-1:02:YjZiMDU3YTg1ZTA0NWQzMGY1ZWM0YzNmYzc1NDY1OWNkZmQ3NmU2YWM2ZDE3ZmVmgTRtHQ==: --dhchap-ctrl-secret DHHC-1:01:YmQ3ZDA4NWFiYjI3YjdjNWVjMzc4NDNiZTM4ZTU3N2a6gUZi: 00:18:42.656 11:29:37 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@36 -- # nvme connect -t tcp -a 10.0.0.3 -n nqn.2024-03.io.spdk:cnode0 -i 1 -q nqn.2014-08.org.nvmexpress:uuid:c758a4ed-f09f-4c82-9afb-3d096f035464 --hostid c758a4ed-f09f-4c82-9afb-3d096f035464 -l 0 --dhchap-secret DHHC-1:02:YjZiMDU3YTg1ZTA0NWQzMGY1ZWM0YzNmYzc1NDY1OWNkZmQ3NmU2YWM2ZDE3ZmVmgTRtHQ==: --dhchap-ctrl-secret DHHC-1:01:YmQ3ZDA4NWFiYjI3YjdjNWVjMzc4NDNiZTM4ZTU3N2a6gUZi: 00:18:43.224 11:29:38 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@82 -- # nvme disconnect -n nqn.2024-03.io.spdk:cnode0 00:18:43.224 NQN:nqn.2024-03.io.spdk:cnode0 disconnected 1 controller(s) 00:18:43.224 11:29:38 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@83 -- # rpc_cmd nvmf_subsystem_remove_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:c758a4ed-f09f-4c82-9afb-3d096f035464 00:18:43.224 11:29:38 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:43.224 11:29:38 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:18:43.224 11:29:38 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:43.224 11:29:38 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@120 -- # for keyid in "${!keys[@]}" 00:18:43.224 11:29:38 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@121 -- # hostrpc bdev_nvme_set_options --dhchap-digests sha512 --dhchap-dhgroups ffdhe6144 00:18:43.224 11:29:38 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_set_options --dhchap-digests sha512 --dhchap-dhgroups ffdhe6144 00:18:43.482 11:29:38 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@123 -- # connect_authenticate sha512 ffdhe6144 3 00:18:43.482 11:29:38 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@65 -- # local digest dhgroup key ckey qpairs 00:18:43.482 11:29:38 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # digest=sha512 00:18:43.482 11:29:38 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # dhgroup=ffdhe6144 00:18:43.482 11:29:38 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # key=key3 00:18:43.482 11:29:38 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@68 -- # ckey=(${ckeys[$3]:+--dhchap-ctrlr-key "ckey$3"}) 00:18:43.482 11:29:38 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@70 -- # rpc_cmd nvmf_subsystem_add_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:c758a4ed-f09f-4c82-9afb-3d096f035464 --dhchap-key key3 00:18:43.482 11:29:38 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:43.482 11:29:38 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:18:43.482 11:29:38 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:43.482 11:29:38 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@71 -- # bdev_connect -b nvme0 --dhchap-key key3 00:18:43.482 11:29:38 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@60 -- # hostrpc bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.3 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:c758a4ed-f09f-4c82-9afb-3d096f035464 -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key3 00:18:43.482 11:29:38 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.3 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:c758a4ed-f09f-4c82-9afb-3d096f035464 -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key3 00:18:44.048 00:18:44.048 11:29:39 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # hostrpc bdev_nvme_get_controllers 00:18:44.048 11:29:39 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_get_controllers 00:18:44.048 11:29:39 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # jq -r '.[].name' 00:18:44.306 11:29:39 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:18:44.306 11:29:39 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@74 -- # rpc_cmd nvmf_subsystem_get_qpairs nqn.2024-03.io.spdk:cnode0 00:18:44.306 11:29:39 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:44.306 11:29:39 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:18:44.306 11:29:39 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:44.306 11:29:39 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@74 -- # qpairs='[ 00:18:44.306 { 00:18:44.306 "auth": { 00:18:44.306 "dhgroup": "ffdhe6144", 00:18:44.306 "digest": "sha512", 00:18:44.306 "state": "completed" 00:18:44.306 }, 00:18:44.306 "cntlid": 135, 00:18:44.306 "hostnqn": "nqn.2014-08.org.nvmexpress:uuid:c758a4ed-f09f-4c82-9afb-3d096f035464", 00:18:44.306 "listen_address": { 00:18:44.306 "adrfam": "IPv4", 00:18:44.306 "traddr": "10.0.0.3", 00:18:44.306 "trsvcid": "4420", 00:18:44.306 "trtype": "TCP" 00:18:44.306 }, 00:18:44.306 "peer_address": { 00:18:44.306 "adrfam": "IPv4", 00:18:44.306 "traddr": "10.0.0.1", 00:18:44.306 "trsvcid": "50380", 00:18:44.306 "trtype": "TCP" 00:18:44.306 }, 00:18:44.306 "qid": 0, 00:18:44.306 "state": "enabled", 00:18:44.306 "thread": "nvmf_tgt_poll_group_000" 00:18:44.306 } 00:18:44.306 ]' 00:18:44.306 11:29:39 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@75 -- # jq -r '.[0].auth.digest' 00:18:44.564 11:29:39 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@75 -- # [[ sha512 == \s\h\a\5\1\2 ]] 00:18:44.564 11:29:39 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@76 -- # jq -r '.[0].auth.dhgroup' 00:18:44.564 11:29:39 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@76 -- # [[ ffdhe6144 == \f\f\d\h\e\6\1\4\4 ]] 00:18:44.564 11:29:39 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@77 -- # jq -r '.[0].auth.state' 00:18:44.564 11:29:39 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@77 -- # [[ completed == \c\o\m\p\l\e\t\e\d ]] 00:18:44.564 11:29:39 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@78 -- # hostrpc bdev_nvme_detach_controller nvme0 00:18:44.564 11:29:39 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_detach_controller nvme0 00:18:45.131 11:29:40 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@80 -- # nvme_connect --dhchap-secret DHHC-1:03:YjUzYzRlNjQ2N2QwNDQ3ZGZhN2VhODUzYjlkY2I2OWViZWM1NzZiOTJiM2MwNzIxZWVkMmMxOTIzNWE5M2Q4MDbs9Og=: 00:18:45.131 11:29:40 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@36 -- # nvme connect -t tcp -a 10.0.0.3 -n nqn.2024-03.io.spdk:cnode0 -i 1 -q nqn.2014-08.org.nvmexpress:uuid:c758a4ed-f09f-4c82-9afb-3d096f035464 --hostid c758a4ed-f09f-4c82-9afb-3d096f035464 -l 0 --dhchap-secret DHHC-1:03:YjUzYzRlNjQ2N2QwNDQ3ZGZhN2VhODUzYjlkY2I2OWViZWM1NzZiOTJiM2MwNzIxZWVkMmMxOTIzNWE5M2Q4MDbs9Og=: 00:18:45.698 11:29:41 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@82 -- # nvme disconnect -n nqn.2024-03.io.spdk:cnode0 00:18:45.698 NQN:nqn.2024-03.io.spdk:cnode0 disconnected 1 controller(s) 00:18:45.698 11:29:41 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@83 -- # rpc_cmd nvmf_subsystem_remove_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:c758a4ed-f09f-4c82-9afb-3d096f035464 00:18:45.698 11:29:41 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:45.698 11:29:41 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:18:45.698 11:29:41 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:45.698 11:29:41 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@119 -- # for dhgroup in "${dhgroups[@]}" 00:18:45.698 11:29:41 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@120 -- # for keyid in "${!keys[@]}" 00:18:45.698 11:29:41 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@121 -- # hostrpc bdev_nvme_set_options --dhchap-digests sha512 --dhchap-dhgroups ffdhe8192 00:18:45.698 11:29:41 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_set_options --dhchap-digests sha512 --dhchap-dhgroups ffdhe8192 00:18:45.956 11:29:41 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@123 -- # connect_authenticate sha512 ffdhe8192 0 00:18:45.956 11:29:41 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@65 -- # local digest dhgroup key ckey qpairs 00:18:45.956 11:29:41 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # digest=sha512 00:18:45.956 11:29:41 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # dhgroup=ffdhe8192 00:18:45.956 11:29:41 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # key=key0 00:18:45.956 11:29:41 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@68 -- # ckey=(${ckeys[$3]:+--dhchap-ctrlr-key "ckey$3"}) 00:18:45.956 11:29:41 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@70 -- # rpc_cmd nvmf_subsystem_add_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:c758a4ed-f09f-4c82-9afb-3d096f035464 --dhchap-key key0 --dhchap-ctrlr-key ckey0 00:18:45.956 11:29:41 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:45.956 11:29:41 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:18:45.956 11:29:41 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:45.956 11:29:41 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@71 -- # bdev_connect -b nvme0 --dhchap-key key0 --dhchap-ctrlr-key ckey0 00:18:45.956 11:29:41 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@60 -- # hostrpc bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.3 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:c758a4ed-f09f-4c82-9afb-3d096f035464 -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key0 --dhchap-ctrlr-key ckey0 00:18:45.956 11:29:41 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.3 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:c758a4ed-f09f-4c82-9afb-3d096f035464 -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key0 --dhchap-ctrlr-key ckey0 00:18:46.901 00:18:46.901 11:29:42 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # hostrpc bdev_nvme_get_controllers 00:18:46.901 11:29:42 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # jq -r '.[].name' 00:18:46.901 11:29:42 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_get_controllers 00:18:46.901 11:29:42 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:18:46.901 11:29:42 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@74 -- # rpc_cmd nvmf_subsystem_get_qpairs nqn.2024-03.io.spdk:cnode0 00:18:46.901 11:29:42 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:46.901 11:29:42 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:18:46.901 11:29:42 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:46.901 11:29:42 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@74 -- # qpairs='[ 00:18:46.901 { 00:18:46.901 "auth": { 00:18:46.901 "dhgroup": "ffdhe8192", 00:18:46.901 "digest": "sha512", 00:18:46.901 "state": "completed" 00:18:46.901 }, 00:18:46.901 "cntlid": 137, 00:18:46.901 "hostnqn": "nqn.2014-08.org.nvmexpress:uuid:c758a4ed-f09f-4c82-9afb-3d096f035464", 00:18:46.901 "listen_address": { 00:18:46.901 "adrfam": "IPv4", 00:18:46.901 "traddr": "10.0.0.3", 00:18:46.901 "trsvcid": "4420", 00:18:46.901 "trtype": "TCP" 00:18:46.901 }, 00:18:46.901 "peer_address": { 00:18:46.901 "adrfam": "IPv4", 00:18:46.901 "traddr": "10.0.0.1", 00:18:46.901 "trsvcid": "57986", 00:18:46.901 "trtype": "TCP" 00:18:46.901 }, 00:18:46.901 "qid": 0, 00:18:46.901 "state": "enabled", 00:18:46.901 "thread": "nvmf_tgt_poll_group_000" 00:18:46.901 } 00:18:46.901 ]' 00:18:46.901 11:29:42 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@75 -- # jq -r '.[0].auth.digest' 00:18:47.159 11:29:42 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@75 -- # [[ sha512 == \s\h\a\5\1\2 ]] 00:18:47.159 11:29:42 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@76 -- # jq -r '.[0].auth.dhgroup' 00:18:47.159 11:29:42 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@76 -- # [[ ffdhe8192 == \f\f\d\h\e\8\1\9\2 ]] 00:18:47.159 11:29:42 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@77 -- # jq -r '.[0].auth.state' 00:18:47.159 11:29:42 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@77 -- # [[ completed == \c\o\m\p\l\e\t\e\d ]] 00:18:47.159 11:29:42 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@78 -- # hostrpc bdev_nvme_detach_controller nvme0 00:18:47.159 11:29:42 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_detach_controller nvme0 00:18:47.417 11:29:42 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@80 -- # nvme_connect --dhchap-secret DHHC-1:00:YTQ3MDY2OWMxZDcwN2QyZmRhNGVmYjYzYTczYTM4NzAwYjdiNTBmZmE2ZDBlZTc28YG94Q==: --dhchap-ctrl-secret DHHC-1:03:YmY1NDQyMjdhMGU5ZDk3NGFiYTIyMTE1OTgzNGQ4ZDQ0MTE3YmFjMTc3MGQ4NDRlOTU5MThlODc5YzUxNGM2Y9nOg8I=: 00:18:47.417 11:29:42 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@36 -- # nvme connect -t tcp -a 10.0.0.3 -n nqn.2024-03.io.spdk:cnode0 -i 1 -q nqn.2014-08.org.nvmexpress:uuid:c758a4ed-f09f-4c82-9afb-3d096f035464 --hostid c758a4ed-f09f-4c82-9afb-3d096f035464 -l 0 --dhchap-secret DHHC-1:00:YTQ3MDY2OWMxZDcwN2QyZmRhNGVmYjYzYTczYTM4NzAwYjdiNTBmZmE2ZDBlZTc28YG94Q==: --dhchap-ctrl-secret DHHC-1:03:YmY1NDQyMjdhMGU5ZDk3NGFiYTIyMTE1OTgzNGQ4ZDQ0MTE3YmFjMTc3MGQ4NDRlOTU5MThlODc5YzUxNGM2Y9nOg8I=: 00:18:48.350 11:29:43 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@82 -- # nvme disconnect -n nqn.2024-03.io.spdk:cnode0 00:18:48.350 NQN:nqn.2024-03.io.spdk:cnode0 disconnected 1 controller(s) 00:18:48.350 11:29:43 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@83 -- # rpc_cmd nvmf_subsystem_remove_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:c758a4ed-f09f-4c82-9afb-3d096f035464 00:18:48.350 11:29:43 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:48.350 11:29:43 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:18:48.350 11:29:43 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:48.350 11:29:43 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@120 -- # for keyid in "${!keys[@]}" 00:18:48.350 11:29:43 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@121 -- # hostrpc bdev_nvme_set_options --dhchap-digests sha512 --dhchap-dhgroups ffdhe8192 00:18:48.350 11:29:43 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_set_options --dhchap-digests sha512 --dhchap-dhgroups ffdhe8192 00:18:48.609 11:29:43 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@123 -- # connect_authenticate sha512 ffdhe8192 1 00:18:48.609 11:29:43 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@65 -- # local digest dhgroup key ckey qpairs 00:18:48.609 11:29:43 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # digest=sha512 00:18:48.609 11:29:43 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # dhgroup=ffdhe8192 00:18:48.609 11:29:43 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # key=key1 00:18:48.609 11:29:43 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@68 -- # ckey=(${ckeys[$3]:+--dhchap-ctrlr-key "ckey$3"}) 00:18:48.609 11:29:43 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@70 -- # rpc_cmd nvmf_subsystem_add_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:c758a4ed-f09f-4c82-9afb-3d096f035464 --dhchap-key key1 --dhchap-ctrlr-key ckey1 00:18:48.609 11:29:43 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:48.609 11:29:43 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:18:48.609 11:29:43 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:48.609 11:29:43 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@71 -- # bdev_connect -b nvme0 --dhchap-key key1 --dhchap-ctrlr-key ckey1 00:18:48.609 11:29:43 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@60 -- # hostrpc bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.3 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:c758a4ed-f09f-4c82-9afb-3d096f035464 -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key1 --dhchap-ctrlr-key ckey1 00:18:48.609 11:29:43 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.3 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:c758a4ed-f09f-4c82-9afb-3d096f035464 -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key1 --dhchap-ctrlr-key ckey1 00:18:49.195 00:18:49.195 11:29:44 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # jq -r '.[].name' 00:18:49.195 11:29:44 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # hostrpc bdev_nvme_get_controllers 00:18:49.195 11:29:44 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_get_controllers 00:18:49.453 11:29:44 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:18:49.453 11:29:44 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@74 -- # rpc_cmd nvmf_subsystem_get_qpairs nqn.2024-03.io.spdk:cnode0 00:18:49.453 11:29:44 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:49.453 11:29:44 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:18:49.453 11:29:44 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:49.453 11:29:44 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@74 -- # qpairs='[ 00:18:49.453 { 00:18:49.453 "auth": { 00:18:49.453 "dhgroup": "ffdhe8192", 00:18:49.453 "digest": "sha512", 00:18:49.453 "state": "completed" 00:18:49.453 }, 00:18:49.453 "cntlid": 139, 00:18:49.453 "hostnqn": "nqn.2014-08.org.nvmexpress:uuid:c758a4ed-f09f-4c82-9afb-3d096f035464", 00:18:49.453 "listen_address": { 00:18:49.453 "adrfam": "IPv4", 00:18:49.453 "traddr": "10.0.0.3", 00:18:49.453 "trsvcid": "4420", 00:18:49.453 "trtype": "TCP" 00:18:49.453 }, 00:18:49.453 "peer_address": { 00:18:49.453 "adrfam": "IPv4", 00:18:49.453 "traddr": "10.0.0.1", 00:18:49.453 "trsvcid": "58022", 00:18:49.453 "trtype": "TCP" 00:18:49.453 }, 00:18:49.453 "qid": 0, 00:18:49.453 "state": "enabled", 00:18:49.453 "thread": "nvmf_tgt_poll_group_000" 00:18:49.453 } 00:18:49.453 ]' 00:18:49.453 11:29:44 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@75 -- # jq -r '.[0].auth.digest' 00:18:49.710 11:29:44 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@75 -- # [[ sha512 == \s\h\a\5\1\2 ]] 00:18:49.710 11:29:44 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@76 -- # jq -r '.[0].auth.dhgroup' 00:18:49.710 11:29:45 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@76 -- # [[ ffdhe8192 == \f\f\d\h\e\8\1\9\2 ]] 00:18:49.710 11:29:45 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@77 -- # jq -r '.[0].auth.state' 00:18:49.710 11:29:45 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@77 -- # [[ completed == \c\o\m\p\l\e\t\e\d ]] 00:18:49.710 11:29:45 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@78 -- # hostrpc bdev_nvme_detach_controller nvme0 00:18:49.710 11:29:45 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_detach_controller nvme0 00:18:49.967 11:29:45 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@80 -- # nvme_connect --dhchap-secret DHHC-1:01:YTU2ZTRiMDFkMzNiMjFmN2QwNTBiYjliMGJkYjQwZTTsDgGm: --dhchap-ctrl-secret DHHC-1:02:ZjZjOWFiZGJhYjc3NzkxOGQwNGZmNTA0MTE0MjkzYmVkODZmYTJjNzcyZDM2NjYxWbIiww==: 00:18:49.967 11:29:45 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@36 -- # nvme connect -t tcp -a 10.0.0.3 -n nqn.2024-03.io.spdk:cnode0 -i 1 -q nqn.2014-08.org.nvmexpress:uuid:c758a4ed-f09f-4c82-9afb-3d096f035464 --hostid c758a4ed-f09f-4c82-9afb-3d096f035464 -l 0 --dhchap-secret DHHC-1:01:YTU2ZTRiMDFkMzNiMjFmN2QwNTBiYjliMGJkYjQwZTTsDgGm: --dhchap-ctrl-secret DHHC-1:02:ZjZjOWFiZGJhYjc3NzkxOGQwNGZmNTA0MTE0MjkzYmVkODZmYTJjNzcyZDM2NjYxWbIiww==: 00:18:50.533 11:29:46 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@82 -- # nvme disconnect -n nqn.2024-03.io.spdk:cnode0 00:18:50.533 NQN:nqn.2024-03.io.spdk:cnode0 disconnected 1 controller(s) 00:18:50.533 11:29:46 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@83 -- # rpc_cmd nvmf_subsystem_remove_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:c758a4ed-f09f-4c82-9afb-3d096f035464 00:18:50.533 11:29:46 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:50.533 11:29:46 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:18:50.533 11:29:46 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:50.533 11:29:46 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@120 -- # for keyid in "${!keys[@]}" 00:18:50.533 11:29:46 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@121 -- # hostrpc bdev_nvme_set_options --dhchap-digests sha512 --dhchap-dhgroups ffdhe8192 00:18:50.533 11:29:46 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_set_options --dhchap-digests sha512 --dhchap-dhgroups ffdhe8192 00:18:51.099 11:29:46 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@123 -- # connect_authenticate sha512 ffdhe8192 2 00:18:51.099 11:29:46 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@65 -- # local digest dhgroup key ckey qpairs 00:18:51.099 11:29:46 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # digest=sha512 00:18:51.099 11:29:46 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # dhgroup=ffdhe8192 00:18:51.099 11:29:46 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # key=key2 00:18:51.099 11:29:46 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@68 -- # ckey=(${ckeys[$3]:+--dhchap-ctrlr-key "ckey$3"}) 00:18:51.099 11:29:46 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@70 -- # rpc_cmd nvmf_subsystem_add_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:c758a4ed-f09f-4c82-9afb-3d096f035464 --dhchap-key key2 --dhchap-ctrlr-key ckey2 00:18:51.099 11:29:46 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:51.099 11:29:46 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:18:51.099 11:29:46 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:51.099 11:29:46 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@71 -- # bdev_connect -b nvme0 --dhchap-key key2 --dhchap-ctrlr-key ckey2 00:18:51.099 11:29:46 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@60 -- # hostrpc bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.3 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:c758a4ed-f09f-4c82-9afb-3d096f035464 -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key2 --dhchap-ctrlr-key ckey2 00:18:51.099 11:29:46 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.3 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:c758a4ed-f09f-4c82-9afb-3d096f035464 -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key2 --dhchap-ctrlr-key ckey2 00:18:51.664 00:18:51.664 11:29:47 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # jq -r '.[].name' 00:18:51.664 11:29:47 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # hostrpc bdev_nvme_get_controllers 00:18:51.664 11:29:47 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_get_controllers 00:18:51.923 11:29:47 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:18:51.923 11:29:47 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@74 -- # rpc_cmd nvmf_subsystem_get_qpairs nqn.2024-03.io.spdk:cnode0 00:18:51.923 11:29:47 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:51.923 11:29:47 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:18:51.923 11:29:47 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:51.923 11:29:47 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@74 -- # qpairs='[ 00:18:51.923 { 00:18:51.923 "auth": { 00:18:51.923 "dhgroup": "ffdhe8192", 00:18:51.923 "digest": "sha512", 00:18:51.923 "state": "completed" 00:18:51.923 }, 00:18:51.923 "cntlid": 141, 00:18:51.923 "hostnqn": "nqn.2014-08.org.nvmexpress:uuid:c758a4ed-f09f-4c82-9afb-3d096f035464", 00:18:51.923 "listen_address": { 00:18:51.923 "adrfam": "IPv4", 00:18:51.923 "traddr": "10.0.0.3", 00:18:51.923 "trsvcid": "4420", 00:18:51.923 "trtype": "TCP" 00:18:51.923 }, 00:18:51.923 "peer_address": { 00:18:51.923 "adrfam": "IPv4", 00:18:51.923 "traddr": "10.0.0.1", 00:18:51.923 "trsvcid": "58054", 00:18:51.923 "trtype": "TCP" 00:18:51.923 }, 00:18:51.923 "qid": 0, 00:18:51.923 "state": "enabled", 00:18:51.923 "thread": "nvmf_tgt_poll_group_000" 00:18:51.923 } 00:18:51.923 ]' 00:18:51.923 11:29:47 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@75 -- # jq -r '.[0].auth.digest' 00:18:51.923 11:29:47 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@75 -- # [[ sha512 == \s\h\a\5\1\2 ]] 00:18:51.923 11:29:47 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@76 -- # jq -r '.[0].auth.dhgroup' 00:18:52.181 11:29:47 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@76 -- # [[ ffdhe8192 == \f\f\d\h\e\8\1\9\2 ]] 00:18:52.181 11:29:47 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@77 -- # jq -r '.[0].auth.state' 00:18:52.181 11:29:47 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@77 -- # [[ completed == \c\o\m\p\l\e\t\e\d ]] 00:18:52.181 11:29:47 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@78 -- # hostrpc bdev_nvme_detach_controller nvme0 00:18:52.181 11:29:47 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_detach_controller nvme0 00:18:52.439 11:29:47 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@80 -- # nvme_connect --dhchap-secret DHHC-1:02:YjZiMDU3YTg1ZTA0NWQzMGY1ZWM0YzNmYzc1NDY1OWNkZmQ3NmU2YWM2ZDE3ZmVmgTRtHQ==: --dhchap-ctrl-secret DHHC-1:01:YmQ3ZDA4NWFiYjI3YjdjNWVjMzc4NDNiZTM4ZTU3N2a6gUZi: 00:18:52.439 11:29:47 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@36 -- # nvme connect -t tcp -a 10.0.0.3 -n nqn.2024-03.io.spdk:cnode0 -i 1 -q nqn.2014-08.org.nvmexpress:uuid:c758a4ed-f09f-4c82-9afb-3d096f035464 --hostid c758a4ed-f09f-4c82-9afb-3d096f035464 -l 0 --dhchap-secret DHHC-1:02:YjZiMDU3YTg1ZTA0NWQzMGY1ZWM0YzNmYzc1NDY1OWNkZmQ3NmU2YWM2ZDE3ZmVmgTRtHQ==: --dhchap-ctrl-secret DHHC-1:01:YmQ3ZDA4NWFiYjI3YjdjNWVjMzc4NDNiZTM4ZTU3N2a6gUZi: 00:18:53.372 11:29:48 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@82 -- # nvme disconnect -n nqn.2024-03.io.spdk:cnode0 00:18:53.372 NQN:nqn.2024-03.io.spdk:cnode0 disconnected 1 controller(s) 00:18:53.372 11:29:48 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@83 -- # rpc_cmd nvmf_subsystem_remove_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:c758a4ed-f09f-4c82-9afb-3d096f035464 00:18:53.372 11:29:48 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:53.372 11:29:48 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:18:53.372 11:29:48 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:53.372 11:29:48 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@120 -- # for keyid in "${!keys[@]}" 00:18:53.372 11:29:48 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@121 -- # hostrpc bdev_nvme_set_options --dhchap-digests sha512 --dhchap-dhgroups ffdhe8192 00:18:53.372 11:29:48 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_set_options --dhchap-digests sha512 --dhchap-dhgroups ffdhe8192 00:18:53.372 11:29:48 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@123 -- # connect_authenticate sha512 ffdhe8192 3 00:18:53.372 11:29:48 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@65 -- # local digest dhgroup key ckey qpairs 00:18:53.372 11:29:48 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # digest=sha512 00:18:53.372 11:29:48 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # dhgroup=ffdhe8192 00:18:53.372 11:29:48 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # key=key3 00:18:53.372 11:29:48 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@68 -- # ckey=(${ckeys[$3]:+--dhchap-ctrlr-key "ckey$3"}) 00:18:53.372 11:29:48 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@70 -- # rpc_cmd nvmf_subsystem_add_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:c758a4ed-f09f-4c82-9afb-3d096f035464 --dhchap-key key3 00:18:53.372 11:29:48 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:53.372 11:29:48 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:18:53.372 11:29:48 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:53.372 11:29:48 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@71 -- # bdev_connect -b nvme0 --dhchap-key key3 00:18:53.372 11:29:48 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@60 -- # hostrpc bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.3 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:c758a4ed-f09f-4c82-9afb-3d096f035464 -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key3 00:18:53.372 11:29:48 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.3 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:c758a4ed-f09f-4c82-9afb-3d096f035464 -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key3 00:18:54.306 00:18:54.306 11:29:49 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # jq -r '.[].name' 00:18:54.306 11:29:49 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # hostrpc bdev_nvme_get_controllers 00:18:54.306 11:29:49 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_get_controllers 00:18:54.564 11:29:49 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:18:54.564 11:29:49 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@74 -- # rpc_cmd nvmf_subsystem_get_qpairs nqn.2024-03.io.spdk:cnode0 00:18:54.564 11:29:49 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:54.564 11:29:49 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:18:54.564 11:29:49 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:54.564 11:29:49 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@74 -- # qpairs='[ 00:18:54.564 { 00:18:54.564 "auth": { 00:18:54.564 "dhgroup": "ffdhe8192", 00:18:54.564 "digest": "sha512", 00:18:54.564 "state": "completed" 00:18:54.564 }, 00:18:54.564 "cntlid": 143, 00:18:54.564 "hostnqn": "nqn.2014-08.org.nvmexpress:uuid:c758a4ed-f09f-4c82-9afb-3d096f035464", 00:18:54.564 "listen_address": { 00:18:54.564 "adrfam": "IPv4", 00:18:54.564 "traddr": "10.0.0.3", 00:18:54.564 "trsvcid": "4420", 00:18:54.564 "trtype": "TCP" 00:18:54.564 }, 00:18:54.564 "peer_address": { 00:18:54.564 "adrfam": "IPv4", 00:18:54.564 "traddr": "10.0.0.1", 00:18:54.564 "trsvcid": "58072", 00:18:54.564 "trtype": "TCP" 00:18:54.564 }, 00:18:54.564 "qid": 0, 00:18:54.564 "state": "enabled", 00:18:54.564 "thread": "nvmf_tgt_poll_group_000" 00:18:54.564 } 00:18:54.564 ]' 00:18:54.564 11:29:49 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@75 -- # jq -r '.[0].auth.digest' 00:18:54.564 11:29:49 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@75 -- # [[ sha512 == \s\h\a\5\1\2 ]] 00:18:54.564 11:29:49 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@76 -- # jq -r '.[0].auth.dhgroup' 00:18:54.564 11:29:49 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@76 -- # [[ ffdhe8192 == \f\f\d\h\e\8\1\9\2 ]] 00:18:54.564 11:29:50 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@77 -- # jq -r '.[0].auth.state' 00:18:54.564 11:29:50 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@77 -- # [[ completed == \c\o\m\p\l\e\t\e\d ]] 00:18:54.564 11:29:50 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@78 -- # hostrpc bdev_nvme_detach_controller nvme0 00:18:54.564 11:29:50 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_detach_controller nvme0 00:18:55.139 11:29:50 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@80 -- # nvme_connect --dhchap-secret DHHC-1:03:YjUzYzRlNjQ2N2QwNDQ3ZGZhN2VhODUzYjlkY2I2OWViZWM1NzZiOTJiM2MwNzIxZWVkMmMxOTIzNWE5M2Q4MDbs9Og=: 00:18:55.139 11:29:50 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@36 -- # nvme connect -t tcp -a 10.0.0.3 -n nqn.2024-03.io.spdk:cnode0 -i 1 -q nqn.2014-08.org.nvmexpress:uuid:c758a4ed-f09f-4c82-9afb-3d096f035464 --hostid c758a4ed-f09f-4c82-9afb-3d096f035464 -l 0 --dhchap-secret DHHC-1:03:YjUzYzRlNjQ2N2QwNDQ3ZGZhN2VhODUzYjlkY2I2OWViZWM1NzZiOTJiM2MwNzIxZWVkMmMxOTIzNWE5M2Q4MDbs9Og=: 00:18:55.706 11:29:51 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@82 -- # nvme disconnect -n nqn.2024-03.io.spdk:cnode0 00:18:55.706 NQN:nqn.2024-03.io.spdk:cnode0 disconnected 1 controller(s) 00:18:55.706 11:29:51 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@83 -- # rpc_cmd nvmf_subsystem_remove_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:c758a4ed-f09f-4c82-9afb-3d096f035464 00:18:55.706 11:29:51 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:55.706 11:29:51 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:18:55.706 11:29:51 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:55.706 11:29:51 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@129 -- # IFS=, 00:18:55.706 11:29:51 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@130 -- # printf %s sha256,sha384,sha512 00:18:55.706 11:29:51 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@129 -- # IFS=, 00:18:55.706 11:29:51 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@130 -- # printf %s null,ffdhe2048,ffdhe3072,ffdhe4096,ffdhe6144,ffdhe8192 00:18:55.706 11:29:51 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@129 -- # hostrpc bdev_nvme_set_options --dhchap-digests sha256,sha384,sha512 --dhchap-dhgroups null,ffdhe2048,ffdhe3072,ffdhe4096,ffdhe6144,ffdhe8192 00:18:55.706 11:29:51 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_set_options --dhchap-digests sha256,sha384,sha512 --dhchap-dhgroups null,ffdhe2048,ffdhe3072,ffdhe4096,ffdhe6144,ffdhe8192 00:18:55.964 11:29:51 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@141 -- # connect_authenticate sha512 ffdhe8192 0 00:18:55.964 11:29:51 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@65 -- # local digest dhgroup key ckey qpairs 00:18:55.964 11:29:51 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # digest=sha512 00:18:55.964 11:29:51 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # dhgroup=ffdhe8192 00:18:55.964 11:29:51 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # key=key0 00:18:55.964 11:29:51 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@68 -- # ckey=(${ckeys[$3]:+--dhchap-ctrlr-key "ckey$3"}) 00:18:55.964 11:29:51 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@70 -- # rpc_cmd nvmf_subsystem_add_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:c758a4ed-f09f-4c82-9afb-3d096f035464 --dhchap-key key0 --dhchap-ctrlr-key ckey0 00:18:55.964 11:29:51 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:55.964 11:29:51 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:18:55.964 11:29:51 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:55.964 11:29:51 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@71 -- # bdev_connect -b nvme0 --dhchap-key key0 --dhchap-ctrlr-key ckey0 00:18:55.964 11:29:51 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@60 -- # hostrpc bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.3 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:c758a4ed-f09f-4c82-9afb-3d096f035464 -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key0 --dhchap-ctrlr-key ckey0 00:18:55.964 11:29:51 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.3 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:c758a4ed-f09f-4c82-9afb-3d096f035464 -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key0 --dhchap-ctrlr-key ckey0 00:18:56.909 00:18:56.909 11:29:52 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # hostrpc bdev_nvme_get_controllers 00:18:56.909 11:29:52 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_get_controllers 00:18:56.909 11:29:52 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # jq -r '.[].name' 00:18:57.167 11:29:52 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:18:57.167 11:29:52 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@74 -- # rpc_cmd nvmf_subsystem_get_qpairs nqn.2024-03.io.spdk:cnode0 00:18:57.167 11:29:52 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:57.167 11:29:52 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:18:57.167 11:29:52 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:57.167 11:29:52 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@74 -- # qpairs='[ 00:18:57.167 { 00:18:57.167 "auth": { 00:18:57.167 "dhgroup": "ffdhe8192", 00:18:57.167 "digest": "sha512", 00:18:57.167 "state": "completed" 00:18:57.167 }, 00:18:57.167 "cntlid": 145, 00:18:57.167 "hostnqn": "nqn.2014-08.org.nvmexpress:uuid:c758a4ed-f09f-4c82-9afb-3d096f035464", 00:18:57.167 "listen_address": { 00:18:57.167 "adrfam": "IPv4", 00:18:57.167 "traddr": "10.0.0.3", 00:18:57.167 "trsvcid": "4420", 00:18:57.167 "trtype": "TCP" 00:18:57.167 }, 00:18:57.167 "peer_address": { 00:18:57.167 "adrfam": "IPv4", 00:18:57.167 "traddr": "10.0.0.1", 00:18:57.167 "trsvcid": "48568", 00:18:57.167 "trtype": "TCP" 00:18:57.167 }, 00:18:57.167 "qid": 0, 00:18:57.167 "state": "enabled", 00:18:57.167 "thread": "nvmf_tgt_poll_group_000" 00:18:57.167 } 00:18:57.167 ]' 00:18:57.167 11:29:52 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@75 -- # jq -r '.[0].auth.digest' 00:18:57.167 11:29:52 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@75 -- # [[ sha512 == \s\h\a\5\1\2 ]] 00:18:57.167 11:29:52 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@76 -- # jq -r '.[0].auth.dhgroup' 00:18:57.167 11:29:52 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@76 -- # [[ ffdhe8192 == \f\f\d\h\e\8\1\9\2 ]] 00:18:57.167 11:29:52 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@77 -- # jq -r '.[0].auth.state' 00:18:57.167 11:29:52 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@77 -- # [[ completed == \c\o\m\p\l\e\t\e\d ]] 00:18:57.167 11:29:52 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@78 -- # hostrpc bdev_nvme_detach_controller nvme0 00:18:57.167 11:29:52 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_detach_controller nvme0 00:18:57.427 11:29:52 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@80 -- # nvme_connect --dhchap-secret DHHC-1:00:YTQ3MDY2OWMxZDcwN2QyZmRhNGVmYjYzYTczYTM4NzAwYjdiNTBmZmE2ZDBlZTc28YG94Q==: --dhchap-ctrl-secret DHHC-1:03:YmY1NDQyMjdhMGU5ZDk3NGFiYTIyMTE1OTgzNGQ4ZDQ0MTE3YmFjMTc3MGQ4NDRlOTU5MThlODc5YzUxNGM2Y9nOg8I=: 00:18:57.427 11:29:52 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@36 -- # nvme connect -t tcp -a 10.0.0.3 -n nqn.2024-03.io.spdk:cnode0 -i 1 -q nqn.2014-08.org.nvmexpress:uuid:c758a4ed-f09f-4c82-9afb-3d096f035464 --hostid c758a4ed-f09f-4c82-9afb-3d096f035464 -l 0 --dhchap-secret DHHC-1:00:YTQ3MDY2OWMxZDcwN2QyZmRhNGVmYjYzYTczYTM4NzAwYjdiNTBmZmE2ZDBlZTc28YG94Q==: --dhchap-ctrl-secret DHHC-1:03:YmY1NDQyMjdhMGU5ZDk3NGFiYTIyMTE1OTgzNGQ4ZDQ0MTE3YmFjMTc3MGQ4NDRlOTU5MThlODc5YzUxNGM2Y9nOg8I=: 00:18:58.368 11:29:53 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@82 -- # nvme disconnect -n nqn.2024-03.io.spdk:cnode0 00:18:58.368 NQN:nqn.2024-03.io.spdk:cnode0 disconnected 1 controller(s) 00:18:58.368 11:29:53 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@83 -- # rpc_cmd nvmf_subsystem_remove_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:c758a4ed-f09f-4c82-9afb-3d096f035464 00:18:58.368 11:29:53 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:58.368 11:29:53 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:18:58.368 11:29:53 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:58.368 11:29:53 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@144 -- # rpc_cmd nvmf_subsystem_add_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:c758a4ed-f09f-4c82-9afb-3d096f035464 --dhchap-key key1 00:18:58.368 11:29:53 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:58.368 11:29:53 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:18:58.368 11:29:53 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:58.368 11:29:53 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@145 -- # NOT bdev_connect -b nvme0 --dhchap-key key2 00:18:58.368 11:29:53 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@650 -- # local es=0 00:18:58.368 11:29:53 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@652 -- # valid_exec_arg bdev_connect -b nvme0 --dhchap-key key2 00:18:58.368 11:29:53 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@638 -- # local arg=bdev_connect 00:18:58.368 11:29:53 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:18:58.368 11:29:53 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@642 -- # type -t bdev_connect 00:18:58.368 11:29:53 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:18:58.368 11:29:53 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@653 -- # bdev_connect -b nvme0 --dhchap-key key2 00:18:58.368 11:29:53 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@60 -- # hostrpc bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.3 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:c758a4ed-f09f-4c82-9afb-3d096f035464 -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key2 00:18:58.368 11:29:53 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.3 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:c758a4ed-f09f-4c82-9afb-3d096f035464 -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key2 00:18:58.946 2024/10/07 11:29:54 error on JSON-RPC call, method: bdev_nvme_attach_controller, params: map[adrfam:ipv4 allow_unrecognized_csi:%!s(bool=false) ddgst:%!s(bool=false) dhchap_key:key2 hdgst:%!s(bool=false) hostnqn:nqn.2014-08.org.nvmexpress:uuid:c758a4ed-f09f-4c82-9afb-3d096f035464 name:nvme0 prchk_guard:%!s(bool=false) prchk_reftag:%!s(bool=false) subnqn:nqn.2024-03.io.spdk:cnode0 traddr:10.0.0.3 trsvcid:4420 trtype:tcp], err: error received for bdev_nvme_attach_controller method, err: Code=-5 Msg=Input/output error 00:18:58.946 request: 00:18:58.946 { 00:18:58.946 "method": "bdev_nvme_attach_controller", 00:18:58.946 "params": { 00:18:58.946 "name": "nvme0", 00:18:58.946 "trtype": "tcp", 00:18:58.946 "traddr": "10.0.0.3", 00:18:58.946 "adrfam": "ipv4", 00:18:58.946 "trsvcid": "4420", 00:18:58.946 "subnqn": "nqn.2024-03.io.spdk:cnode0", 00:18:58.946 "hostnqn": "nqn.2014-08.org.nvmexpress:uuid:c758a4ed-f09f-4c82-9afb-3d096f035464", 00:18:58.946 "prchk_reftag": false, 00:18:58.946 "prchk_guard": false, 00:18:58.946 "hdgst": false, 00:18:58.946 "ddgst": false, 00:18:58.946 "dhchap_key": "key2", 00:18:58.946 "allow_unrecognized_csi": false 00:18:58.946 } 00:18:58.946 } 00:18:58.946 Got JSON-RPC error response 00:18:58.946 GoRPCClient: error on JSON-RPC call 00:18:58.946 11:29:54 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@653 -- # es=1 00:18:58.946 11:29:54 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:18:58.946 11:29:54 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:18:58.946 11:29:54 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:18:58.946 11:29:54 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@146 -- # rpc_cmd nvmf_subsystem_remove_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:c758a4ed-f09f-4c82-9afb-3d096f035464 00:18:58.947 11:29:54 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:58.947 11:29:54 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:18:58.947 11:29:54 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:58.947 11:29:54 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@149 -- # rpc_cmd nvmf_subsystem_add_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:c758a4ed-f09f-4c82-9afb-3d096f035464 --dhchap-key key1 --dhchap-ctrlr-key ckey1 00:18:58.947 11:29:54 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:58.947 11:29:54 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:18:58.947 11:29:54 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:58.947 11:29:54 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@150 -- # NOT bdev_connect -b nvme0 --dhchap-key key1 --dhchap-ctrlr-key ckey2 00:18:58.947 11:29:54 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@650 -- # local es=0 00:18:58.947 11:29:54 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@652 -- # valid_exec_arg bdev_connect -b nvme0 --dhchap-key key1 --dhchap-ctrlr-key ckey2 00:18:58.947 11:29:54 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@638 -- # local arg=bdev_connect 00:18:58.947 11:29:54 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:18:58.947 11:29:54 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@642 -- # type -t bdev_connect 00:18:58.947 11:29:54 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:18:58.947 11:29:54 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@653 -- # bdev_connect -b nvme0 --dhchap-key key1 --dhchap-ctrlr-key ckey2 00:18:58.947 11:29:54 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@60 -- # hostrpc bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.3 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:c758a4ed-f09f-4c82-9afb-3d096f035464 -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key1 --dhchap-ctrlr-key ckey2 00:18:58.947 11:29:54 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.3 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:c758a4ed-f09f-4c82-9afb-3d096f035464 -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key1 --dhchap-ctrlr-key ckey2 00:18:59.512 2024/10/07 11:29:54 error on JSON-RPC call, method: bdev_nvme_attach_controller, params: map[adrfam:ipv4 allow_unrecognized_csi:%!s(bool=false) ddgst:%!s(bool=false) dhchap_ctrlr_key:ckey2 dhchap_key:key1 hdgst:%!s(bool=false) hostnqn:nqn.2014-08.org.nvmexpress:uuid:c758a4ed-f09f-4c82-9afb-3d096f035464 name:nvme0 prchk_guard:%!s(bool=false) prchk_reftag:%!s(bool=false) subnqn:nqn.2024-03.io.spdk:cnode0 traddr:10.0.0.3 trsvcid:4420 trtype:tcp], err: error received for bdev_nvme_attach_controller method, err: Code=-5 Msg=Input/output error 00:18:59.512 request: 00:18:59.512 { 00:18:59.512 "method": "bdev_nvme_attach_controller", 00:18:59.512 "params": { 00:18:59.512 "name": "nvme0", 00:18:59.512 "trtype": "tcp", 00:18:59.512 "traddr": "10.0.0.3", 00:18:59.512 "adrfam": "ipv4", 00:18:59.512 "trsvcid": "4420", 00:18:59.512 "subnqn": "nqn.2024-03.io.spdk:cnode0", 00:18:59.512 "hostnqn": "nqn.2014-08.org.nvmexpress:uuid:c758a4ed-f09f-4c82-9afb-3d096f035464", 00:18:59.512 "prchk_reftag": false, 00:18:59.512 "prchk_guard": false, 00:18:59.512 "hdgst": false, 00:18:59.512 "ddgst": false, 00:18:59.512 "dhchap_key": "key1", 00:18:59.512 "dhchap_ctrlr_key": "ckey2", 00:18:59.512 "allow_unrecognized_csi": false 00:18:59.512 } 00:18:59.512 } 00:18:59.512 Got JSON-RPC error response 00:18:59.512 GoRPCClient: error on JSON-RPC call 00:18:59.512 11:29:54 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@653 -- # es=1 00:18:59.512 11:29:54 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:18:59.512 11:29:54 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:18:59.512 11:29:54 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:18:59.512 11:29:54 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@151 -- # rpc_cmd nvmf_subsystem_remove_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:c758a4ed-f09f-4c82-9afb-3d096f035464 00:18:59.512 11:29:54 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:59.512 11:29:54 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:18:59.512 11:29:54 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:59.512 11:29:54 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@154 -- # rpc_cmd nvmf_subsystem_add_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:c758a4ed-f09f-4c82-9afb-3d096f035464 --dhchap-key key1 00:18:59.512 11:29:54 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:59.512 11:29:54 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:18:59.512 11:29:54 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:59.512 11:29:54 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@155 -- # NOT bdev_connect -b nvme0 --dhchap-key key1 --dhchap-ctrlr-key ckey1 00:18:59.512 11:29:54 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@650 -- # local es=0 00:18:59.512 11:29:54 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@652 -- # valid_exec_arg bdev_connect -b nvme0 --dhchap-key key1 --dhchap-ctrlr-key ckey1 00:18:59.512 11:29:54 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@638 -- # local arg=bdev_connect 00:18:59.512 11:29:54 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:18:59.512 11:29:54 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@642 -- # type -t bdev_connect 00:18:59.512 11:29:54 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:18:59.512 11:29:54 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@653 -- # bdev_connect -b nvme0 --dhchap-key key1 --dhchap-ctrlr-key ckey1 00:18:59.512 11:29:54 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@60 -- # hostrpc bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.3 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:c758a4ed-f09f-4c82-9afb-3d096f035464 -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key1 --dhchap-ctrlr-key ckey1 00:18:59.512 11:29:54 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.3 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:c758a4ed-f09f-4c82-9afb-3d096f035464 -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key1 --dhchap-ctrlr-key ckey1 00:19:00.445 2024/10/07 11:29:55 error on JSON-RPC call, method: bdev_nvme_attach_controller, params: map[adrfam:ipv4 allow_unrecognized_csi:%!s(bool=false) ddgst:%!s(bool=false) dhchap_ctrlr_key:ckey1 dhchap_key:key1 hdgst:%!s(bool=false) hostnqn:nqn.2014-08.org.nvmexpress:uuid:c758a4ed-f09f-4c82-9afb-3d096f035464 name:nvme0 prchk_guard:%!s(bool=false) prchk_reftag:%!s(bool=false) subnqn:nqn.2024-03.io.spdk:cnode0 traddr:10.0.0.3 trsvcid:4420 trtype:tcp], err: error received for bdev_nvme_attach_controller method, err: Code=-5 Msg=Input/output error 00:19:00.445 request: 00:19:00.445 { 00:19:00.445 "method": "bdev_nvme_attach_controller", 00:19:00.445 "params": { 00:19:00.445 "name": "nvme0", 00:19:00.445 "trtype": "tcp", 00:19:00.445 "traddr": "10.0.0.3", 00:19:00.445 "adrfam": "ipv4", 00:19:00.445 "trsvcid": "4420", 00:19:00.445 "subnqn": "nqn.2024-03.io.spdk:cnode0", 00:19:00.445 "hostnqn": "nqn.2014-08.org.nvmexpress:uuid:c758a4ed-f09f-4c82-9afb-3d096f035464", 00:19:00.445 "prchk_reftag": false, 00:19:00.445 "prchk_guard": false, 00:19:00.445 "hdgst": false, 00:19:00.445 "ddgst": false, 00:19:00.445 "dhchap_key": "key1", 00:19:00.445 "dhchap_ctrlr_key": "ckey1", 00:19:00.445 "allow_unrecognized_csi": false 00:19:00.445 } 00:19:00.445 } 00:19:00.445 Got JSON-RPC error response 00:19:00.445 GoRPCClient: error on JSON-RPC call 00:19:00.445 11:29:55 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@653 -- # es=1 00:19:00.445 11:29:55 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:19:00.445 11:29:55 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:19:00.445 11:29:55 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:19:00.445 11:29:55 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@156 -- # rpc_cmd nvmf_subsystem_remove_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:c758a4ed-f09f-4c82-9afb-3d096f035464 00:19:00.445 11:29:55 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:00.445 11:29:55 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:19:00.446 11:29:55 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:00.446 11:29:55 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@159 -- # killprocess 77018 00:19:00.446 11:29:55 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@950 -- # '[' -z 77018 ']' 00:19:00.446 11:29:55 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@954 -- # kill -0 77018 00:19:00.446 11:29:55 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@955 -- # uname 00:19:00.446 11:29:55 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@955 -- # '[' Linux = Linux ']' 00:19:00.446 11:29:55 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@956 -- # ps --no-headers -o comm= 77018 00:19:00.446 11:29:55 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@956 -- # process_name=reactor_0 00:19:00.446 11:29:55 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@960 -- # '[' reactor_0 = sudo ']' 00:19:00.446 killing process with pid 77018 00:19:00.446 11:29:55 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@968 -- # echo 'killing process with pid 77018' 00:19:00.446 11:29:55 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@969 -- # kill 77018 00:19:00.446 11:29:55 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@974 -- # wait 77018 00:19:00.446 11:29:55 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@160 -- # nvmfappstart --wait-for-rpc -L nvmf_auth 00:19:00.446 11:29:55 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@505 -- # timing_enter start_nvmf_tgt 00:19:00.446 11:29:55 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@724 -- # xtrace_disable 00:19:00.446 11:29:55 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:19:00.446 11:29:55 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@507 -- # nvmfpid=82041 00:19:00.446 11:29:55 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@506 -- # ip netns exec nvmf_tgt_ns_spdk /home/vagrant/spdk_repo/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF --wait-for-rpc -L nvmf_auth 00:19:00.446 11:29:55 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@508 -- # waitforlisten 82041 00:19:00.446 11:29:55 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@831 -- # '[' -z 82041 ']' 00:19:00.446 11:29:55 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@835 -- # local rpc_addr=/var/tmp/spdk.sock 00:19:00.446 11:29:55 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@836 -- # local max_retries=100 00:19:00.446 11:29:55 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@838 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:19:00.446 11:29:55 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@840 -- # xtrace_disable 00:19:00.446 11:29:55 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:19:01.820 11:29:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@860 -- # (( i == 0 )) 00:19:01.820 11:29:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@864 -- # return 0 00:19:01.820 11:29:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@509 -- # timing_exit start_nvmf_tgt 00:19:01.820 11:29:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@730 -- # xtrace_disable 00:19:01.820 11:29:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:19:01.820 11:29:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@510 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:19:01.820 11:29:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@161 -- # trap 'dumplogs; cleanup' SIGINT SIGTERM EXIT 00:19:01.820 11:29:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@163 -- # waitforlisten 82041 00:19:01.820 11:29:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@831 -- # '[' -z 82041 ']' 00:19:01.820 11:29:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@835 -- # local rpc_addr=/var/tmp/spdk.sock 00:19:01.820 11:29:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@836 -- # local max_retries=100 00:19:01.820 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:19:01.820 11:29:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@838 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:19:01.820 11:29:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@840 -- # xtrace_disable 00:19:01.820 11:29:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:19:02.079 11:29:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@860 -- # (( i == 0 )) 00:19:02.079 11:29:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@864 -- # return 0 00:19:02.079 11:29:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@164 -- # rpc_cmd 00:19:02.079 11:29:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:02.079 11:29:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:19:02.079 null0 00:19:02.079 11:29:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:02.079 11:29:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@174 -- # for i in "${!keys[@]}" 00:19:02.079 11:29:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@175 -- # rpc_cmd keyring_file_add_key key0 /tmp/spdk.key-null.kDS 00:19:02.079 11:29:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:02.079 11:29:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:19:02.079 11:29:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:02.079 11:29:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@176 -- # [[ -n /tmp/spdk.key-sha512.vjU ]] 00:19:02.079 11:29:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@176 -- # rpc_cmd keyring_file_add_key ckey0 /tmp/spdk.key-sha512.vjU 00:19:02.079 11:29:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:02.079 11:29:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:19:02.079 11:29:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:02.079 11:29:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@174 -- # for i in "${!keys[@]}" 00:19:02.079 11:29:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@175 -- # rpc_cmd keyring_file_add_key key1 /tmp/spdk.key-sha256.9hE 00:19:02.079 11:29:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:02.079 11:29:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:19:02.079 11:29:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:02.079 11:29:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@176 -- # [[ -n /tmp/spdk.key-sha384.KLI ]] 00:19:02.079 11:29:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@176 -- # rpc_cmd keyring_file_add_key ckey1 /tmp/spdk.key-sha384.KLI 00:19:02.079 11:29:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:02.079 11:29:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:19:02.079 11:29:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:02.079 11:29:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@174 -- # for i in "${!keys[@]}" 00:19:02.079 11:29:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@175 -- # rpc_cmd keyring_file_add_key key2 /tmp/spdk.key-sha384.0e0 00:19:02.079 11:29:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:02.079 11:29:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:19:02.079 11:29:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:02.079 11:29:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@176 -- # [[ -n /tmp/spdk.key-sha256.BpF ]] 00:19:02.079 11:29:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@176 -- # rpc_cmd keyring_file_add_key ckey2 /tmp/spdk.key-sha256.BpF 00:19:02.079 11:29:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:02.079 11:29:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:19:02.337 11:29:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:02.337 11:29:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@174 -- # for i in "${!keys[@]}" 00:19:02.337 11:29:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@175 -- # rpc_cmd keyring_file_add_key key3 /tmp/spdk.key-sha512.eJX 00:19:02.337 11:29:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:02.337 11:29:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:19:02.337 11:29:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:02.337 11:29:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@176 -- # [[ -n '' ]] 00:19:02.337 11:29:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@179 -- # connect_authenticate sha512 ffdhe8192 3 00:19:02.337 11:29:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@65 -- # local digest dhgroup key ckey qpairs 00:19:02.337 11:29:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # digest=sha512 00:19:02.337 11:29:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # dhgroup=ffdhe8192 00:19:02.337 11:29:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # key=key3 00:19:02.337 11:29:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@68 -- # ckey=(${ckeys[$3]:+--dhchap-ctrlr-key "ckey$3"}) 00:19:02.337 11:29:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@70 -- # rpc_cmd nvmf_subsystem_add_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:c758a4ed-f09f-4c82-9afb-3d096f035464 --dhchap-key key3 00:19:02.337 11:29:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:02.337 11:29:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:19:02.337 11:29:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:02.337 11:29:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@71 -- # bdev_connect -b nvme0 --dhchap-key key3 00:19:02.337 11:29:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@60 -- # hostrpc bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.3 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:c758a4ed-f09f-4c82-9afb-3d096f035464 -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key3 00:19:02.337 11:29:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.3 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:c758a4ed-f09f-4c82-9afb-3d096f035464 -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key3 00:19:03.313 nvme0n1 00:19:03.313 11:29:58 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # jq -r '.[].name' 00:19:03.313 11:29:58 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # hostrpc bdev_nvme_get_controllers 00:19:03.313 11:29:58 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_get_controllers 00:19:03.572 11:29:58 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:19:03.572 11:29:58 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@74 -- # rpc_cmd nvmf_subsystem_get_qpairs nqn.2024-03.io.spdk:cnode0 00:19:03.572 11:29:58 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:03.572 11:29:58 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:19:03.572 11:29:58 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:03.572 11:29:58 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@74 -- # qpairs='[ 00:19:03.572 { 00:19:03.572 "auth": { 00:19:03.572 "dhgroup": "ffdhe8192", 00:19:03.572 "digest": "sha512", 00:19:03.572 "state": "completed" 00:19:03.572 }, 00:19:03.572 "cntlid": 1, 00:19:03.572 "hostnqn": "nqn.2014-08.org.nvmexpress:uuid:c758a4ed-f09f-4c82-9afb-3d096f035464", 00:19:03.572 "listen_address": { 00:19:03.572 "adrfam": "IPv4", 00:19:03.572 "traddr": "10.0.0.3", 00:19:03.572 "trsvcid": "4420", 00:19:03.572 "trtype": "TCP" 00:19:03.572 }, 00:19:03.572 "peer_address": { 00:19:03.572 "adrfam": "IPv4", 00:19:03.572 "traddr": "10.0.0.1", 00:19:03.572 "trsvcid": "48634", 00:19:03.572 "trtype": "TCP" 00:19:03.572 }, 00:19:03.572 "qid": 0, 00:19:03.572 "state": "enabled", 00:19:03.572 "thread": "nvmf_tgt_poll_group_000" 00:19:03.572 } 00:19:03.572 ]' 00:19:03.572 11:29:58 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@75 -- # jq -r '.[0].auth.digest' 00:19:03.572 11:29:59 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@75 -- # [[ sha512 == \s\h\a\5\1\2 ]] 00:19:03.572 11:29:59 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@76 -- # jq -r '.[0].auth.dhgroup' 00:19:03.572 11:29:59 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@76 -- # [[ ffdhe8192 == \f\f\d\h\e\8\1\9\2 ]] 00:19:03.572 11:29:59 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@77 -- # jq -r '.[0].auth.state' 00:19:03.830 11:29:59 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@77 -- # [[ completed == \c\o\m\p\l\e\t\e\d ]] 00:19:03.830 11:29:59 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@78 -- # hostrpc bdev_nvme_detach_controller nvme0 00:19:03.830 11:29:59 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_detach_controller nvme0 00:19:04.088 11:29:59 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@80 -- # nvme_connect --dhchap-secret DHHC-1:03:YjUzYzRlNjQ2N2QwNDQ3ZGZhN2VhODUzYjlkY2I2OWViZWM1NzZiOTJiM2MwNzIxZWVkMmMxOTIzNWE5M2Q4MDbs9Og=: 00:19:04.088 11:29:59 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@36 -- # nvme connect -t tcp -a 10.0.0.3 -n nqn.2024-03.io.spdk:cnode0 -i 1 -q nqn.2014-08.org.nvmexpress:uuid:c758a4ed-f09f-4c82-9afb-3d096f035464 --hostid c758a4ed-f09f-4c82-9afb-3d096f035464 -l 0 --dhchap-secret DHHC-1:03:YjUzYzRlNjQ2N2QwNDQ3ZGZhN2VhODUzYjlkY2I2OWViZWM1NzZiOTJiM2MwNzIxZWVkMmMxOTIzNWE5M2Q4MDbs9Og=: 00:19:04.656 11:30:00 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@82 -- # nvme disconnect -n nqn.2024-03.io.spdk:cnode0 00:19:04.656 NQN:nqn.2024-03.io.spdk:cnode0 disconnected 1 controller(s) 00:19:04.656 11:30:00 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@83 -- # rpc_cmd nvmf_subsystem_remove_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:c758a4ed-f09f-4c82-9afb-3d096f035464 00:19:04.656 11:30:00 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:04.656 11:30:00 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:19:04.656 11:30:00 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:04.657 11:30:00 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@182 -- # rpc_cmd nvmf_subsystem_add_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:c758a4ed-f09f-4c82-9afb-3d096f035464 --dhchap-key key3 00:19:04.657 11:30:00 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:04.657 11:30:00 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:19:04.657 11:30:00 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:04.657 11:30:00 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@183 -- # hostrpc bdev_nvme_set_options --dhchap-digests sha256 00:19:04.657 11:30:00 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_set_options --dhchap-digests sha256 00:19:04.916 11:30:00 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@184 -- # NOT bdev_connect -b nvme0 --dhchap-key key3 00:19:04.916 11:30:00 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@650 -- # local es=0 00:19:04.916 11:30:00 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@652 -- # valid_exec_arg bdev_connect -b nvme0 --dhchap-key key3 00:19:04.916 11:30:00 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@638 -- # local arg=bdev_connect 00:19:04.916 11:30:00 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:19:04.916 11:30:00 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@642 -- # type -t bdev_connect 00:19:05.174 11:30:00 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:19:05.174 11:30:00 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@653 -- # bdev_connect -b nvme0 --dhchap-key key3 00:19:05.174 11:30:00 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@60 -- # hostrpc bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.3 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:c758a4ed-f09f-4c82-9afb-3d096f035464 -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key3 00:19:05.174 11:30:00 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.3 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:c758a4ed-f09f-4c82-9afb-3d096f035464 -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key3 00:19:05.433 2024/10/07 11:30:00 error on JSON-RPC call, method: bdev_nvme_attach_controller, params: map[adrfam:ipv4 allow_unrecognized_csi:%!s(bool=false) ddgst:%!s(bool=false) dhchap_key:key3 hdgst:%!s(bool=false) hostnqn:nqn.2014-08.org.nvmexpress:uuid:c758a4ed-f09f-4c82-9afb-3d096f035464 name:nvme0 prchk_guard:%!s(bool=false) prchk_reftag:%!s(bool=false) subnqn:nqn.2024-03.io.spdk:cnode0 traddr:10.0.0.3 trsvcid:4420 trtype:tcp], err: error received for bdev_nvme_attach_controller method, err: Code=-5 Msg=Input/output error 00:19:05.433 request: 00:19:05.433 { 00:19:05.433 "method": "bdev_nvme_attach_controller", 00:19:05.433 "params": { 00:19:05.433 "name": "nvme0", 00:19:05.433 "trtype": "tcp", 00:19:05.433 "traddr": "10.0.0.3", 00:19:05.433 "adrfam": "ipv4", 00:19:05.433 "trsvcid": "4420", 00:19:05.433 "subnqn": "nqn.2024-03.io.spdk:cnode0", 00:19:05.433 "hostnqn": "nqn.2014-08.org.nvmexpress:uuid:c758a4ed-f09f-4c82-9afb-3d096f035464", 00:19:05.433 "prchk_reftag": false, 00:19:05.433 "prchk_guard": false, 00:19:05.433 "hdgst": false, 00:19:05.433 "ddgst": false, 00:19:05.433 "dhchap_key": "key3", 00:19:05.433 "allow_unrecognized_csi": false 00:19:05.433 } 00:19:05.433 } 00:19:05.433 Got JSON-RPC error response 00:19:05.433 GoRPCClient: error on JSON-RPC call 00:19:05.433 11:30:00 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@653 -- # es=1 00:19:05.433 11:30:00 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:19:05.433 11:30:00 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:19:05.433 11:30:00 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:19:05.433 11:30:00 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@187 -- # IFS=, 00:19:05.433 11:30:00 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@188 -- # printf %s sha256,sha384,sha512 00:19:05.433 11:30:00 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@187 -- # hostrpc bdev_nvme_set_options --dhchap-dhgroups ffdhe2048 --dhchap-digests sha256,sha384,sha512 00:19:05.433 11:30:00 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_set_options --dhchap-dhgroups ffdhe2048 --dhchap-digests sha256,sha384,sha512 00:19:05.691 11:30:01 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@193 -- # NOT bdev_connect -b nvme0 --dhchap-key key3 00:19:05.691 11:30:01 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@650 -- # local es=0 00:19:05.691 11:30:01 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@652 -- # valid_exec_arg bdev_connect -b nvme0 --dhchap-key key3 00:19:05.691 11:30:01 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@638 -- # local arg=bdev_connect 00:19:05.691 11:30:01 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:19:05.691 11:30:01 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@642 -- # type -t bdev_connect 00:19:05.691 11:30:01 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:19:05.691 11:30:01 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@653 -- # bdev_connect -b nvme0 --dhchap-key key3 00:19:05.691 11:30:01 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@60 -- # hostrpc bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.3 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:c758a4ed-f09f-4c82-9afb-3d096f035464 -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key3 00:19:05.691 11:30:01 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.3 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:c758a4ed-f09f-4c82-9afb-3d096f035464 -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key3 00:19:05.950 2024/10/07 11:30:01 error on JSON-RPC call, method: bdev_nvme_attach_controller, params: map[adrfam:ipv4 allow_unrecognized_csi:%!s(bool=false) ddgst:%!s(bool=false) dhchap_key:key3 hdgst:%!s(bool=false) hostnqn:nqn.2014-08.org.nvmexpress:uuid:c758a4ed-f09f-4c82-9afb-3d096f035464 name:nvme0 prchk_guard:%!s(bool=false) prchk_reftag:%!s(bool=false) subnqn:nqn.2024-03.io.spdk:cnode0 traddr:10.0.0.3 trsvcid:4420 trtype:tcp], err: error received for bdev_nvme_attach_controller method, err: Code=-5 Msg=Input/output error 00:19:05.950 request: 00:19:05.950 { 00:19:05.950 "method": "bdev_nvme_attach_controller", 00:19:05.950 "params": { 00:19:05.950 "name": "nvme0", 00:19:05.950 "trtype": "tcp", 00:19:05.950 "traddr": "10.0.0.3", 00:19:05.950 "adrfam": "ipv4", 00:19:05.950 "trsvcid": "4420", 00:19:05.950 "subnqn": "nqn.2024-03.io.spdk:cnode0", 00:19:05.950 "hostnqn": "nqn.2014-08.org.nvmexpress:uuid:c758a4ed-f09f-4c82-9afb-3d096f035464", 00:19:05.950 "prchk_reftag": false, 00:19:05.950 "prchk_guard": false, 00:19:05.950 "hdgst": false, 00:19:05.950 "ddgst": false, 00:19:05.950 "dhchap_key": "key3", 00:19:05.950 "allow_unrecognized_csi": false 00:19:05.950 } 00:19:05.950 } 00:19:05.950 Got JSON-RPC error response 00:19:05.950 GoRPCClient: error on JSON-RPC call 00:19:05.950 11:30:01 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@653 -- # es=1 00:19:05.950 11:30:01 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:19:05.950 11:30:01 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:19:05.950 11:30:01 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:19:05.950 11:30:01 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@197 -- # IFS=, 00:19:05.950 11:30:01 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@198 -- # printf %s sha256,sha384,sha512 00:19:05.950 11:30:01 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@197 -- # IFS=, 00:19:05.950 11:30:01 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@198 -- # printf %s null,ffdhe2048,ffdhe3072,ffdhe4096,ffdhe6144,ffdhe8192 00:19:05.950 11:30:01 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@197 -- # hostrpc bdev_nvme_set_options --dhchap-digests sha256,sha384,sha512 --dhchap-dhgroups null,ffdhe2048,ffdhe3072,ffdhe4096,ffdhe6144,ffdhe8192 00:19:05.950 11:30:01 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_set_options --dhchap-digests sha256,sha384,sha512 --dhchap-dhgroups null,ffdhe2048,ffdhe3072,ffdhe4096,ffdhe6144,ffdhe8192 00:19:06.209 11:30:01 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@208 -- # rpc_cmd nvmf_subsystem_remove_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:c758a4ed-f09f-4c82-9afb-3d096f035464 00:19:06.209 11:30:01 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:06.209 11:30:01 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:19:06.209 11:30:01 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:06.209 11:30:01 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@209 -- # rpc_cmd nvmf_subsystem_add_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:c758a4ed-f09f-4c82-9afb-3d096f035464 00:19:06.209 11:30:01 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:06.209 11:30:01 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:19:06.209 11:30:01 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:06.209 11:30:01 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@210 -- # NOT bdev_connect -b nvme0 --dhchap-key key0 --dhchap-ctrlr-key key1 00:19:06.209 11:30:01 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@650 -- # local es=0 00:19:06.209 11:30:01 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@652 -- # valid_exec_arg bdev_connect -b nvme0 --dhchap-key key0 --dhchap-ctrlr-key key1 00:19:06.209 11:30:01 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@638 -- # local arg=bdev_connect 00:19:06.209 11:30:01 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:19:06.209 11:30:01 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@642 -- # type -t bdev_connect 00:19:06.209 11:30:01 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:19:06.209 11:30:01 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@653 -- # bdev_connect -b nvme0 --dhchap-key key0 --dhchap-ctrlr-key key1 00:19:06.209 11:30:01 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@60 -- # hostrpc bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.3 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:c758a4ed-f09f-4c82-9afb-3d096f035464 -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key0 --dhchap-ctrlr-key key1 00:19:06.209 11:30:01 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.3 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:c758a4ed-f09f-4c82-9afb-3d096f035464 -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key0 --dhchap-ctrlr-key key1 00:19:06.775 2024/10/07 11:30:02 error on JSON-RPC call, method: bdev_nvme_attach_controller, params: map[adrfam:ipv4 allow_unrecognized_csi:%!s(bool=false) ddgst:%!s(bool=false) dhchap_ctrlr_key:key1 dhchap_key:key0 hdgst:%!s(bool=false) hostnqn:nqn.2014-08.org.nvmexpress:uuid:c758a4ed-f09f-4c82-9afb-3d096f035464 name:nvme0 prchk_guard:%!s(bool=false) prchk_reftag:%!s(bool=false) subnqn:nqn.2024-03.io.spdk:cnode0 traddr:10.0.0.3 trsvcid:4420 trtype:tcp], err: error received for bdev_nvme_attach_controller method, err: Code=-5 Msg=Input/output error 00:19:06.775 request: 00:19:06.775 { 00:19:06.775 "method": "bdev_nvme_attach_controller", 00:19:06.775 "params": { 00:19:06.775 "name": "nvme0", 00:19:06.775 "trtype": "tcp", 00:19:06.775 "traddr": "10.0.0.3", 00:19:06.775 "adrfam": "ipv4", 00:19:06.775 "trsvcid": "4420", 00:19:06.775 "subnqn": "nqn.2024-03.io.spdk:cnode0", 00:19:06.775 "hostnqn": "nqn.2014-08.org.nvmexpress:uuid:c758a4ed-f09f-4c82-9afb-3d096f035464", 00:19:06.775 "prchk_reftag": false, 00:19:06.775 "prchk_guard": false, 00:19:06.775 "hdgst": false, 00:19:06.775 "ddgst": false, 00:19:06.775 "dhchap_key": "key0", 00:19:06.775 "dhchap_ctrlr_key": "key1", 00:19:06.775 "allow_unrecognized_csi": false 00:19:06.775 } 00:19:06.775 } 00:19:06.775 Got JSON-RPC error response 00:19:06.775 GoRPCClient: error on JSON-RPC call 00:19:06.775 11:30:02 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@653 -- # es=1 00:19:06.775 11:30:02 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:19:06.775 11:30:02 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:19:06.775 11:30:02 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:19:06.775 11:30:02 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@213 -- # bdev_connect -b nvme0 --dhchap-key key0 00:19:06.776 11:30:02 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@60 -- # hostrpc bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.3 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:c758a4ed-f09f-4c82-9afb-3d096f035464 -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key0 00:19:06.776 11:30:02 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.3 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:c758a4ed-f09f-4c82-9afb-3d096f035464 -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key0 00:19:07.033 nvme0n1 00:19:07.291 11:30:02 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@214 -- # jq -r '.[].name' 00:19:07.291 11:30:02 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@214 -- # hostrpc bdev_nvme_get_controllers 00:19:07.291 11:30:02 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_get_controllers 00:19:07.548 11:30:02 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@214 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:19:07.548 11:30:02 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@215 -- # hostrpc bdev_nvme_detach_controller nvme0 00:19:07.548 11:30:02 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_detach_controller nvme0 00:19:07.804 11:30:03 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@218 -- # rpc_cmd nvmf_subsystem_set_keys nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:c758a4ed-f09f-4c82-9afb-3d096f035464 --dhchap-key key1 00:19:07.804 11:30:03 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:07.804 11:30:03 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:19:07.804 11:30:03 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:07.804 11:30:03 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@219 -- # bdev_connect -b nvme0 --dhchap-key key1 00:19:07.805 11:30:03 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@60 -- # hostrpc bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.3 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:c758a4ed-f09f-4c82-9afb-3d096f035464 -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key1 00:19:07.805 11:30:03 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.3 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:c758a4ed-f09f-4c82-9afb-3d096f035464 -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key1 00:19:08.736 nvme0n1 00:19:08.737 11:30:04 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@220 -- # hostrpc bdev_nvme_get_controllers 00:19:08.737 11:30:04 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@220 -- # jq -r '.[].name' 00:19:08.737 11:30:04 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_get_controllers 00:19:09.302 11:30:04 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@220 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:19:09.302 11:30:04 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@222 -- # rpc_cmd nvmf_subsystem_set_keys nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:c758a4ed-f09f-4c82-9afb-3d096f035464 --dhchap-key key2 --dhchap-ctrlr-key key3 00:19:09.302 11:30:04 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:09.302 11:30:04 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:19:09.302 11:30:04 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:09.302 11:30:04 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@223 -- # hostrpc bdev_nvme_get_controllers 00:19:09.302 11:30:04 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@223 -- # jq -r '.[].name' 00:19:09.302 11:30:04 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_get_controllers 00:19:09.560 11:30:04 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@223 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:19:09.560 11:30:04 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@225 -- # nvme_connect --dhchap-secret DHHC-1:02:YjZiMDU3YTg1ZTA0NWQzMGY1ZWM0YzNmYzc1NDY1OWNkZmQ3NmU2YWM2ZDE3ZmVmgTRtHQ==: --dhchap-ctrl-secret DHHC-1:03:YjUzYzRlNjQ2N2QwNDQ3ZGZhN2VhODUzYjlkY2I2OWViZWM1NzZiOTJiM2MwNzIxZWVkMmMxOTIzNWE5M2Q4MDbs9Og=: 00:19:09.560 11:30:04 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@36 -- # nvme connect -t tcp -a 10.0.0.3 -n nqn.2024-03.io.spdk:cnode0 -i 1 -q nqn.2014-08.org.nvmexpress:uuid:c758a4ed-f09f-4c82-9afb-3d096f035464 --hostid c758a4ed-f09f-4c82-9afb-3d096f035464 -l 0 --dhchap-secret DHHC-1:02:YjZiMDU3YTg1ZTA0NWQzMGY1ZWM0YzNmYzc1NDY1OWNkZmQ3NmU2YWM2ZDE3ZmVmgTRtHQ==: --dhchap-ctrl-secret DHHC-1:03:YjUzYzRlNjQ2N2QwNDQ3ZGZhN2VhODUzYjlkY2I2OWViZWM1NzZiOTJiM2MwNzIxZWVkMmMxOTIzNWE5M2Q4MDbs9Og=: 00:19:10.126 11:30:05 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@226 -- # nvme_get_ctrlr 00:19:10.126 11:30:05 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@41 -- # local dev 00:19:10.126 11:30:05 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@43 -- # for dev in /sys/devices/virtual/nvme-fabrics/ctl/nvme* 00:19:10.126 11:30:05 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@44 -- # [[ nqn.2024-03.io.spdk:cnode0 == \n\q\n\.\2\0\2\4\-\0\3\.\i\o\.\s\p\d\k\:\c\n\o\d\e\0 ]] 00:19:10.126 11:30:05 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@44 -- # echo nvme0 00:19:10.126 11:30:05 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@44 -- # break 00:19:10.126 11:30:05 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@226 -- # nctrlr=nvme0 00:19:10.126 11:30:05 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@227 -- # hostrpc bdev_nvme_detach_controller nvme0 00:19:10.126 11:30:05 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_detach_controller nvme0 00:19:10.383 11:30:05 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@228 -- # NOT bdev_connect -b nvme0 --dhchap-key key1 00:19:10.383 11:30:05 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@650 -- # local es=0 00:19:10.383 11:30:05 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@652 -- # valid_exec_arg bdev_connect -b nvme0 --dhchap-key key1 00:19:10.383 11:30:05 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@638 -- # local arg=bdev_connect 00:19:10.383 11:30:05 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:19:10.383 11:30:05 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@642 -- # type -t bdev_connect 00:19:10.383 11:30:05 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:19:10.383 11:30:05 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@653 -- # bdev_connect -b nvme0 --dhchap-key key1 00:19:10.383 11:30:05 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@60 -- # hostrpc bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.3 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:c758a4ed-f09f-4c82-9afb-3d096f035464 -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key1 00:19:10.383 11:30:05 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.3 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:c758a4ed-f09f-4c82-9afb-3d096f035464 -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key1 00:19:11.317 2024/10/07 11:30:06 error on JSON-RPC call, method: bdev_nvme_attach_controller, params: map[adrfam:ipv4 allow_unrecognized_csi:%!s(bool=false) ddgst:%!s(bool=false) dhchap_key:key1 hdgst:%!s(bool=false) hostnqn:nqn.2014-08.org.nvmexpress:uuid:c758a4ed-f09f-4c82-9afb-3d096f035464 name:nvme0 prchk_guard:%!s(bool=false) prchk_reftag:%!s(bool=false) subnqn:nqn.2024-03.io.spdk:cnode0 traddr:10.0.0.3 trsvcid:4420 trtype:tcp], err: error received for bdev_nvme_attach_controller method, err: Code=-5 Msg=Input/output error 00:19:11.317 request: 00:19:11.317 { 00:19:11.317 "method": "bdev_nvme_attach_controller", 00:19:11.317 "params": { 00:19:11.317 "name": "nvme0", 00:19:11.317 "trtype": "tcp", 00:19:11.317 "traddr": "10.0.0.3", 00:19:11.317 "adrfam": "ipv4", 00:19:11.317 "trsvcid": "4420", 00:19:11.317 "subnqn": "nqn.2024-03.io.spdk:cnode0", 00:19:11.317 "hostnqn": "nqn.2014-08.org.nvmexpress:uuid:c758a4ed-f09f-4c82-9afb-3d096f035464", 00:19:11.317 "prchk_reftag": false, 00:19:11.317 "prchk_guard": false, 00:19:11.317 "hdgst": false, 00:19:11.317 "ddgst": false, 00:19:11.317 "dhchap_key": "key1", 00:19:11.317 "allow_unrecognized_csi": false 00:19:11.317 } 00:19:11.317 } 00:19:11.317 Got JSON-RPC error response 00:19:11.317 GoRPCClient: error on JSON-RPC call 00:19:11.317 11:30:06 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@653 -- # es=1 00:19:11.317 11:30:06 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:19:11.317 11:30:06 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:19:11.317 11:30:06 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:19:11.317 11:30:06 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@229 -- # bdev_connect -b nvme0 --dhchap-key key2 --dhchap-ctrlr-key key3 00:19:11.317 11:30:06 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@60 -- # hostrpc bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.3 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:c758a4ed-f09f-4c82-9afb-3d096f035464 -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key2 --dhchap-ctrlr-key key3 00:19:11.317 11:30:06 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.3 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:c758a4ed-f09f-4c82-9afb-3d096f035464 -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key2 --dhchap-ctrlr-key key3 00:19:12.251 nvme0n1 00:19:12.251 11:30:07 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@230 -- # jq -r '.[].name' 00:19:12.251 11:30:07 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@230 -- # hostrpc bdev_nvme_get_controllers 00:19:12.251 11:30:07 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_get_controllers 00:19:12.509 11:30:07 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@230 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:19:12.509 11:30:07 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@231 -- # hostrpc bdev_nvme_detach_controller nvme0 00:19:12.509 11:30:07 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_detach_controller nvme0 00:19:12.767 11:30:08 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@233 -- # rpc_cmd nvmf_subsystem_set_keys nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:c758a4ed-f09f-4c82-9afb-3d096f035464 00:19:12.767 11:30:08 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:12.767 11:30:08 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:19:12.767 11:30:08 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:12.767 11:30:08 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@234 -- # bdev_connect -b nvme0 00:19:12.767 11:30:08 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@60 -- # hostrpc bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.3 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:c758a4ed-f09f-4c82-9afb-3d096f035464 -n nqn.2024-03.io.spdk:cnode0 -b nvme0 00:19:12.767 11:30:08 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.3 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:c758a4ed-f09f-4c82-9afb-3d096f035464 -n nqn.2024-03.io.spdk:cnode0 -b nvme0 00:19:13.024 nvme0n1 00:19:13.024 11:30:08 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@235 -- # hostrpc bdev_nvme_get_controllers 00:19:13.024 11:30:08 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_get_controllers 00:19:13.024 11:30:08 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@235 -- # jq -r '.[].name' 00:19:13.589 11:30:08 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@235 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:19:13.589 11:30:08 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@236 -- # hostrpc bdev_nvme_detach_controller nvme0 00:19:13.589 11:30:08 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_detach_controller nvme0 00:19:13.849 11:30:09 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@239 -- # rpc_cmd nvmf_subsystem_set_keys nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:c758a4ed-f09f-4c82-9afb-3d096f035464 --dhchap-key key1 --dhchap-ctrlr-key key3 00:19:13.849 11:30:09 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:13.849 11:30:09 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:19:13.849 11:30:09 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:13.849 11:30:09 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@240 -- # nvme_set_keys nvme0 DHHC-1:01:YTU2ZTRiMDFkMzNiMjFmN2QwNTBiYjliMGJkYjQwZTTsDgGm: '' 2s 00:19:13.849 11:30:09 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@49 -- # local ctl key ckey dev timeout 00:19:13.849 11:30:09 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@51 -- # ctl=nvme0 00:19:13.849 11:30:09 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@51 -- # key=DHHC-1:01:YTU2ZTRiMDFkMzNiMjFmN2QwNTBiYjliMGJkYjQwZTTsDgGm: 00:19:13.849 11:30:09 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@51 -- # ckey= 00:19:13.849 11:30:09 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@51 -- # timeout=2s 00:19:13.849 11:30:09 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@52 -- # dev=/sys/devices/virtual/nvme-fabrics/ctl/nvme0 00:19:13.849 11:30:09 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@54 -- # [[ -z DHHC-1:01:YTU2ZTRiMDFkMzNiMjFmN2QwNTBiYjliMGJkYjQwZTTsDgGm: ]] 00:19:13.849 11:30:09 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@54 -- # echo DHHC-1:01:YTU2ZTRiMDFkMzNiMjFmN2QwNTBiYjliMGJkYjQwZTTsDgGm: 00:19:13.849 11:30:09 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@55 -- # [[ -z '' ]] 00:19:13.849 11:30:09 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@56 -- # [[ -z 2s ]] 00:19:13.849 11:30:09 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@56 -- # sleep 2s 00:19:15.749 11:30:11 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@241 -- # waitforblk nvme0n1 00:19:15.749 11:30:11 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@1235 -- # local i=0 00:19:15.749 11:30:11 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@1236 -- # lsblk -l -o NAME 00:19:15.749 11:30:11 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@1236 -- # grep -q -w nvme0n1 00:19:15.749 11:30:11 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@1242 -- # lsblk -l -o NAME 00:19:15.749 11:30:11 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@1242 -- # grep -q -w nvme0n1 00:19:15.749 11:30:11 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@1246 -- # return 0 00:19:15.749 11:30:11 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@243 -- # rpc_cmd nvmf_subsystem_set_keys nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:c758a4ed-f09f-4c82-9afb-3d096f035464 --dhchap-key key1 --dhchap-ctrlr-key key2 00:19:15.749 11:30:11 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:15.749 11:30:11 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:19:15.749 11:30:11 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:15.749 11:30:11 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@244 -- # nvme_set_keys nvme0 '' DHHC-1:02:YjZiMDU3YTg1ZTA0NWQzMGY1ZWM0YzNmYzc1NDY1OWNkZmQ3NmU2YWM2ZDE3ZmVmgTRtHQ==: 2s 00:19:15.749 11:30:11 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@49 -- # local ctl key ckey dev timeout 00:19:15.749 11:30:11 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@51 -- # ctl=nvme0 00:19:15.749 11:30:11 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@51 -- # key= 00:19:15.749 11:30:11 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@51 -- # ckey=DHHC-1:02:YjZiMDU3YTg1ZTA0NWQzMGY1ZWM0YzNmYzc1NDY1OWNkZmQ3NmU2YWM2ZDE3ZmVmgTRtHQ==: 00:19:15.749 11:30:11 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@51 -- # timeout=2s 00:19:15.749 11:30:11 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@52 -- # dev=/sys/devices/virtual/nvme-fabrics/ctl/nvme0 00:19:15.749 11:30:11 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@54 -- # [[ -z '' ]] 00:19:15.750 11:30:11 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@55 -- # [[ -z DHHC-1:02:YjZiMDU3YTg1ZTA0NWQzMGY1ZWM0YzNmYzc1NDY1OWNkZmQ3NmU2YWM2ZDE3ZmVmgTRtHQ==: ]] 00:19:15.750 11:30:11 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@55 -- # echo DHHC-1:02:YjZiMDU3YTg1ZTA0NWQzMGY1ZWM0YzNmYzc1NDY1OWNkZmQ3NmU2YWM2ZDE3ZmVmgTRtHQ==: 00:19:15.750 11:30:11 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@56 -- # [[ -z 2s ]] 00:19:15.750 11:30:11 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@56 -- # sleep 2s 00:19:18.279 11:30:13 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@245 -- # waitforblk nvme0n1 00:19:18.279 11:30:13 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@1235 -- # local i=0 00:19:18.279 11:30:13 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@1236 -- # lsblk -l -o NAME 00:19:18.279 11:30:13 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@1236 -- # grep -q -w nvme0n1 00:19:18.279 11:30:13 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@1242 -- # lsblk -l -o NAME 00:19:18.279 11:30:13 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@1242 -- # grep -q -w nvme0n1 00:19:18.279 11:30:13 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@1246 -- # return 0 00:19:18.279 11:30:13 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@246 -- # nvme disconnect -n nqn.2024-03.io.spdk:cnode0 00:19:18.279 NQN:nqn.2024-03.io.spdk:cnode0 disconnected 1 controller(s) 00:19:18.279 11:30:13 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@249 -- # rpc_cmd nvmf_subsystem_set_keys nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:c758a4ed-f09f-4c82-9afb-3d096f035464 --dhchap-key key0 --dhchap-ctrlr-key key1 00:19:18.279 11:30:13 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:18.279 11:30:13 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:19:18.279 11:30:13 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:18.279 11:30:13 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@250 -- # bdev_connect -b nvme0 --dhchap-key key0 --dhchap-ctrlr-key key1 --ctrlr-loss-timeout-sec 1 --reconnect-delay-sec 1 00:19:18.279 11:30:13 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@60 -- # hostrpc bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.3 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:c758a4ed-f09f-4c82-9afb-3d096f035464 -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key0 --dhchap-ctrlr-key key1 --ctrlr-loss-timeout-sec 1 --reconnect-delay-sec 1 00:19:18.279 11:30:13 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.3 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:c758a4ed-f09f-4c82-9afb-3d096f035464 -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key0 --dhchap-ctrlr-key key1 --ctrlr-loss-timeout-sec 1 --reconnect-delay-sec 1 00:19:18.844 nvme0n1 00:19:18.844 11:30:14 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@252 -- # rpc_cmd nvmf_subsystem_set_keys nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:c758a4ed-f09f-4c82-9afb-3d096f035464 --dhchap-key key2 --dhchap-ctrlr-key key3 00:19:18.844 11:30:14 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:18.844 11:30:14 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:19:18.844 11:30:14 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:18.844 11:30:14 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@253 -- # hostrpc bdev_nvme_set_keys nvme0 --dhchap-key key2 --dhchap-ctrlr-key key3 00:19:18.844 11:30:14 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_set_keys nvme0 --dhchap-key key2 --dhchap-ctrlr-key key3 00:19:19.778 11:30:15 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@254 -- # jq -r '.[].name' 00:19:19.778 11:30:15 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@254 -- # hostrpc bdev_nvme_get_controllers 00:19:19.778 11:30:15 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_get_controllers 00:19:20.036 11:30:15 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@254 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:19:20.036 11:30:15 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@256 -- # rpc_cmd nvmf_subsystem_set_keys nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:c758a4ed-f09f-4c82-9afb-3d096f035464 00:19:20.036 11:30:15 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:20.036 11:30:15 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:19:20.036 11:30:15 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:20.036 11:30:15 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@257 -- # hostrpc bdev_nvme_set_keys nvme0 00:19:20.036 11:30:15 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_set_keys nvme0 00:19:20.292 11:30:15 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@258 -- # hostrpc bdev_nvme_get_controllers 00:19:20.292 11:30:15 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@258 -- # jq -r '.[].name' 00:19:20.292 11:30:15 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_get_controllers 00:19:20.550 11:30:15 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@258 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:19:20.550 11:30:15 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@260 -- # rpc_cmd nvmf_subsystem_set_keys nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:c758a4ed-f09f-4c82-9afb-3d096f035464 --dhchap-key key2 --dhchap-ctrlr-key key3 00:19:20.550 11:30:15 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:20.550 11:30:15 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:19:20.550 11:30:15 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:20.550 11:30:15 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@261 -- # NOT hostrpc bdev_nvme_set_keys nvme0 --dhchap-key key1 --dhchap-ctrlr-key key3 00:19:20.550 11:30:15 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@650 -- # local es=0 00:19:20.550 11:30:15 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@652 -- # valid_exec_arg hostrpc bdev_nvme_set_keys nvme0 --dhchap-key key1 --dhchap-ctrlr-key key3 00:19:20.550 11:30:15 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@638 -- # local arg=hostrpc 00:19:20.550 11:30:15 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:19:20.550 11:30:15 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@642 -- # type -t hostrpc 00:19:20.550 11:30:15 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:19:20.550 11:30:15 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@653 -- # hostrpc bdev_nvme_set_keys nvme0 --dhchap-key key1 --dhchap-ctrlr-key key3 00:19:20.550 11:30:15 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_set_keys nvme0 --dhchap-key key1 --dhchap-ctrlr-key key3 00:19:21.115 2024/10/07 11:30:16 error on JSON-RPC call, method: bdev_nvme_set_keys, params: map[dhchap_ctrlr_key:key3 dhchap_key:key1 name:nvme0], err: error received for bdev_nvme_set_keys method, err: Code=-13 Msg=Permission denied 00:19:21.115 request: 00:19:21.115 { 00:19:21.115 "method": "bdev_nvme_set_keys", 00:19:21.115 "params": { 00:19:21.115 "name": "nvme0", 00:19:21.115 "dhchap_key": "key1", 00:19:21.115 "dhchap_ctrlr_key": "key3" 00:19:21.115 } 00:19:21.115 } 00:19:21.115 Got JSON-RPC error response 00:19:21.115 GoRPCClient: error on JSON-RPC call 00:19:21.384 11:30:16 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@653 -- # es=1 00:19:21.384 11:30:16 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:19:21.384 11:30:16 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:19:21.384 11:30:16 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:19:21.384 11:30:16 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@262 -- # hostrpc bdev_nvme_get_controllers 00:19:21.384 11:30:16 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@262 -- # jq length 00:19:21.384 11:30:16 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_get_controllers 00:19:21.656 11:30:16 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@262 -- # (( 1 != 0 )) 00:19:21.656 11:30:16 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@263 -- # sleep 1s 00:19:22.590 11:30:17 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@262 -- # jq length 00:19:22.590 11:30:17 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@262 -- # hostrpc bdev_nvme_get_controllers 00:19:22.590 11:30:17 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_get_controllers 00:19:22.849 11:30:18 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@262 -- # (( 0 != 0 )) 00:19:22.849 11:30:18 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@267 -- # rpc_cmd nvmf_subsystem_set_keys nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:c758a4ed-f09f-4c82-9afb-3d096f035464 --dhchap-key key0 --dhchap-ctrlr-key key1 00:19:22.849 11:30:18 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:22.849 11:30:18 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:19:22.849 11:30:18 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:22.849 11:30:18 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@268 -- # bdev_connect -b nvme0 --dhchap-key key0 --dhchap-ctrlr-key key1 --ctrlr-loss-timeout-sec 1 --reconnect-delay-sec 1 00:19:22.849 11:30:18 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@60 -- # hostrpc bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.3 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:c758a4ed-f09f-4c82-9afb-3d096f035464 -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key0 --dhchap-ctrlr-key key1 --ctrlr-loss-timeout-sec 1 --reconnect-delay-sec 1 00:19:22.849 11:30:18 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.3 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:c758a4ed-f09f-4c82-9afb-3d096f035464 -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key0 --dhchap-ctrlr-key key1 --ctrlr-loss-timeout-sec 1 --reconnect-delay-sec 1 00:19:24.222 nvme0n1 00:19:24.222 11:30:19 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@270 -- # rpc_cmd nvmf_subsystem_set_keys nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:c758a4ed-f09f-4c82-9afb-3d096f035464 --dhchap-key key2 --dhchap-ctrlr-key key3 00:19:24.222 11:30:19 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:24.222 11:30:19 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:19:24.222 11:30:19 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:24.222 11:30:19 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@271 -- # NOT hostrpc bdev_nvme_set_keys nvme0 --dhchap-key key2 --dhchap-ctrlr-key key0 00:19:24.222 11:30:19 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@650 -- # local es=0 00:19:24.222 11:30:19 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@652 -- # valid_exec_arg hostrpc bdev_nvme_set_keys nvme0 --dhchap-key key2 --dhchap-ctrlr-key key0 00:19:24.222 11:30:19 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@638 -- # local arg=hostrpc 00:19:24.222 11:30:19 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:19:24.222 11:30:19 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@642 -- # type -t hostrpc 00:19:24.222 11:30:19 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:19:24.222 11:30:19 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@653 -- # hostrpc bdev_nvme_set_keys nvme0 --dhchap-key key2 --dhchap-ctrlr-key key0 00:19:24.222 11:30:19 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_set_keys nvme0 --dhchap-key key2 --dhchap-ctrlr-key key0 00:19:24.481 2024/10/07 11:30:19 error on JSON-RPC call, method: bdev_nvme_set_keys, params: map[dhchap_ctrlr_key:key0 dhchap_key:key2 name:nvme0], err: error received for bdev_nvme_set_keys method, err: Code=-13 Msg=Permission denied 00:19:24.481 request: 00:19:24.481 { 00:19:24.481 "method": "bdev_nvme_set_keys", 00:19:24.481 "params": { 00:19:24.481 "name": "nvme0", 00:19:24.481 "dhchap_key": "key2", 00:19:24.481 "dhchap_ctrlr_key": "key0" 00:19:24.481 } 00:19:24.481 } 00:19:24.481 Got JSON-RPC error response 00:19:24.481 GoRPCClient: error on JSON-RPC call 00:19:24.739 11:30:20 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@653 -- # es=1 00:19:24.739 11:30:20 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:19:24.739 11:30:20 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:19:24.739 11:30:20 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:19:24.739 11:30:20 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@272 -- # hostrpc bdev_nvme_get_controllers 00:19:24.739 11:30:20 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@272 -- # jq length 00:19:24.739 11:30:20 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_get_controllers 00:19:24.997 11:30:20 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@272 -- # (( 1 != 0 )) 00:19:24.997 11:30:20 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@273 -- # sleep 1s 00:19:25.934 11:30:21 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@272 -- # jq length 00:19:25.934 11:30:21 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@272 -- # hostrpc bdev_nvme_get_controllers 00:19:25.934 11:30:21 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_get_controllers 00:19:26.192 11:30:21 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@272 -- # (( 0 != 0 )) 00:19:26.192 11:30:21 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@276 -- # trap - SIGINT SIGTERM EXIT 00:19:26.192 11:30:21 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@277 -- # cleanup 00:19:26.192 11:30:21 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@21 -- # killprocess 77062 00:19:26.192 11:30:21 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@950 -- # '[' -z 77062 ']' 00:19:26.192 11:30:21 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@954 -- # kill -0 77062 00:19:26.192 11:30:21 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@955 -- # uname 00:19:26.192 11:30:21 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@955 -- # '[' Linux = Linux ']' 00:19:26.192 11:30:21 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@956 -- # ps --no-headers -o comm= 77062 00:19:26.192 11:30:21 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@956 -- # process_name=reactor_1 00:19:26.192 11:30:21 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@960 -- # '[' reactor_1 = sudo ']' 00:19:26.192 killing process with pid 77062 00:19:26.192 11:30:21 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@968 -- # echo 'killing process with pid 77062' 00:19:26.192 11:30:21 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@969 -- # kill 77062 00:19:26.192 11:30:21 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@974 -- # wait 77062 00:19:26.759 11:30:22 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@22 -- # nvmftestfini 00:19:26.759 11:30:22 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@514 -- # nvmfcleanup 00:19:26.759 11:30:22 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@121 -- # sync 00:19:26.759 11:30:22 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@123 -- # '[' tcp == tcp ']' 00:19:26.759 11:30:22 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@124 -- # set +e 00:19:26.759 11:30:22 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@125 -- # for i in {1..20} 00:19:26.759 11:30:22 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@126 -- # modprobe -v -r nvme-tcp 00:19:26.759 rmmod nvme_tcp 00:19:26.759 rmmod nvme_fabrics 00:19:26.759 rmmod nvme_keyring 00:19:26.759 11:30:22 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@127 -- # modprobe -v -r nvme-fabrics 00:19:26.759 11:30:22 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@128 -- # set -e 00:19:26.759 11:30:22 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@129 -- # return 0 00:19:26.759 11:30:22 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@515 -- # '[' -n 82041 ']' 00:19:26.759 11:30:22 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@516 -- # killprocess 82041 00:19:26.759 11:30:22 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@950 -- # '[' -z 82041 ']' 00:19:26.759 11:30:22 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@954 -- # kill -0 82041 00:19:26.759 11:30:22 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@955 -- # uname 00:19:26.759 11:30:22 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@955 -- # '[' Linux = Linux ']' 00:19:26.759 11:30:22 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@956 -- # ps --no-headers -o comm= 82041 00:19:26.759 11:30:22 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@956 -- # process_name=reactor_0 00:19:26.759 11:30:22 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@960 -- # '[' reactor_0 = sudo ']' 00:19:26.759 killing process with pid 82041 00:19:26.759 11:30:22 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@968 -- # echo 'killing process with pid 82041' 00:19:26.759 11:30:22 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@969 -- # kill 82041 00:19:26.759 11:30:22 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@974 -- # wait 82041 00:19:27.353 11:30:22 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@518 -- # '[' '' == iso ']' 00:19:27.353 11:30:22 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@521 -- # [[ tcp == \t\c\p ]] 00:19:27.353 11:30:22 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@522 -- # nvmf_tcp_fini 00:19:27.353 11:30:22 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@297 -- # iptr 00:19:27.353 11:30:22 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@789 -- # iptables-save 00:19:27.353 11:30:22 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@789 -- # grep -v SPDK_NVMF 00:19:27.353 11:30:22 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@789 -- # iptables-restore 00:19:27.353 11:30:22 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@298 -- # [[ nvmf_tgt_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s\_\s\p\d\k ]] 00:19:27.353 11:30:22 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@299 -- # nvmf_veth_fini 00:19:27.353 11:30:22 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@233 -- # ip link set nvmf_init_br nomaster 00:19:27.353 11:30:22 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@234 -- # ip link set nvmf_init_br2 nomaster 00:19:27.353 11:30:22 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@235 -- # ip link set nvmf_tgt_br nomaster 00:19:27.353 11:30:22 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@236 -- # ip link set nvmf_tgt_br2 nomaster 00:19:27.353 11:30:22 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@237 -- # ip link set nvmf_init_br down 00:19:27.353 11:30:22 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@238 -- # ip link set nvmf_init_br2 down 00:19:27.353 11:30:22 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@239 -- # ip link set nvmf_tgt_br down 00:19:27.353 11:30:22 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@240 -- # ip link set nvmf_tgt_br2 down 00:19:27.353 11:30:22 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@241 -- # ip link delete nvmf_br type bridge 00:19:27.353 11:30:22 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@242 -- # ip link delete nvmf_init_if 00:19:27.353 11:30:22 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@243 -- # ip link delete nvmf_init_if2 00:19:27.353 11:30:22 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@244 -- # ip netns exec nvmf_tgt_ns_spdk ip link delete nvmf_tgt_if 00:19:27.353 11:30:22 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@245 -- # ip netns exec nvmf_tgt_ns_spdk ip link delete nvmf_tgt_if2 00:19:27.353 11:30:22 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@246 -- # remove_spdk_ns 00:19:27.353 11:30:22 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@654 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:19:27.353 11:30:22 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 15> /dev/null' 00:19:27.353 11:30:22 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:19:27.353 11:30:22 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@300 -- # return 0 00:19:27.353 11:30:22 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@23 -- # rm -f /tmp/spdk.key-null.kDS /tmp/spdk.key-sha256.9hE /tmp/spdk.key-sha384.0e0 /tmp/spdk.key-sha512.eJX /tmp/spdk.key-sha512.vjU /tmp/spdk.key-sha384.KLI /tmp/spdk.key-sha256.BpF '' /home/vagrant/spdk_repo/spdk/../output/nvme-auth.log /home/vagrant/spdk_repo/spdk/../output/nvmf-auth.log 00:19:27.353 00:19:27.353 real 3m25.298s 00:19:27.353 user 8m19.145s 00:19:27.353 sys 0m25.190s 00:19:27.353 11:30:22 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@1126 -- # xtrace_disable 00:19:27.353 11:30:22 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:19:27.353 ************************************ 00:19:27.353 END TEST nvmf_auth_target 00:19:27.353 ************************************ 00:19:27.612 11:30:22 nvmf_tcp.nvmf_target_extra -- nvmf/nvmf_target_extra.sh@39 -- # '[' tcp = tcp ']' 00:19:27.612 11:30:22 nvmf_tcp.nvmf_target_extra -- nvmf/nvmf_target_extra.sh@40 -- # run_test nvmf_bdevio_no_huge /home/vagrant/spdk_repo/spdk/test/nvmf/target/bdevio.sh --transport=tcp --no-hugepages 00:19:27.612 11:30:22 nvmf_tcp.nvmf_target_extra -- common/autotest_common.sh@1101 -- # '[' 4 -le 1 ']' 00:19:27.612 11:30:22 nvmf_tcp.nvmf_target_extra -- common/autotest_common.sh@1107 -- # xtrace_disable 00:19:27.612 11:30:22 nvmf_tcp.nvmf_target_extra -- common/autotest_common.sh@10 -- # set +x 00:19:27.612 ************************************ 00:19:27.612 START TEST nvmf_bdevio_no_huge 00:19:27.612 ************************************ 00:19:27.612 11:30:22 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- common/autotest_common.sh@1125 -- # /home/vagrant/spdk_repo/spdk/test/nvmf/target/bdevio.sh --transport=tcp --no-hugepages 00:19:27.612 * Looking for test storage... 00:19:27.612 * Found test storage at /home/vagrant/spdk_repo/spdk/test/nvmf/target 00:19:27.612 11:30:22 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- common/autotest_common.sh@1680 -- # [[ y == y ]] 00:19:27.612 11:30:22 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- common/autotest_common.sh@1681 -- # lcov --version 00:19:27.612 11:30:22 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- common/autotest_common.sh@1681 -- # awk '{print $NF}' 00:19:27.612 11:30:23 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- common/autotest_common.sh@1681 -- # lt 1.15 2 00:19:27.612 11:30:23 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- scripts/common.sh@373 -- # cmp_versions 1.15 '<' 2 00:19:27.612 11:30:23 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- scripts/common.sh@333 -- # local ver1 ver1_l 00:19:27.612 11:30:23 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- scripts/common.sh@334 -- # local ver2 ver2_l 00:19:27.612 11:30:23 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- scripts/common.sh@336 -- # IFS=.-: 00:19:27.612 11:30:23 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- scripts/common.sh@336 -- # read -ra ver1 00:19:27.612 11:30:23 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- scripts/common.sh@337 -- # IFS=.-: 00:19:27.612 11:30:23 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- scripts/common.sh@337 -- # read -ra ver2 00:19:27.612 11:30:23 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- scripts/common.sh@338 -- # local 'op=<' 00:19:27.612 11:30:23 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- scripts/common.sh@340 -- # ver1_l=2 00:19:27.612 11:30:23 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- scripts/common.sh@341 -- # ver2_l=1 00:19:27.612 11:30:23 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- scripts/common.sh@343 -- # local lt=0 gt=0 eq=0 v 00:19:27.612 11:30:23 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- scripts/common.sh@344 -- # case "$op" in 00:19:27.612 11:30:23 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- scripts/common.sh@345 -- # : 1 00:19:27.612 11:30:23 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- scripts/common.sh@364 -- # (( v = 0 )) 00:19:27.612 11:30:23 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- scripts/common.sh@364 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:19:27.612 11:30:23 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- scripts/common.sh@365 -- # decimal 1 00:19:27.612 11:30:23 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- scripts/common.sh@353 -- # local d=1 00:19:27.612 11:30:23 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- scripts/common.sh@354 -- # [[ 1 =~ ^[0-9]+$ ]] 00:19:27.612 11:30:23 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- scripts/common.sh@355 -- # echo 1 00:19:27.612 11:30:23 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- scripts/common.sh@365 -- # ver1[v]=1 00:19:27.612 11:30:23 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- scripts/common.sh@366 -- # decimal 2 00:19:27.612 11:30:23 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- scripts/common.sh@353 -- # local d=2 00:19:27.612 11:30:23 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- scripts/common.sh@354 -- # [[ 2 =~ ^[0-9]+$ ]] 00:19:27.612 11:30:23 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- scripts/common.sh@355 -- # echo 2 00:19:27.612 11:30:23 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- scripts/common.sh@366 -- # ver2[v]=2 00:19:27.612 11:30:23 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- scripts/common.sh@367 -- # (( ver1[v] > ver2[v] )) 00:19:27.612 11:30:23 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- scripts/common.sh@368 -- # (( ver1[v] < ver2[v] )) 00:19:27.612 11:30:23 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- scripts/common.sh@368 -- # return 0 00:19:27.612 11:30:23 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- common/autotest_common.sh@1682 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:19:27.612 11:30:23 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- common/autotest_common.sh@1694 -- # export 'LCOV_OPTS= 00:19:27.612 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:19:27.612 --rc genhtml_branch_coverage=1 00:19:27.612 --rc genhtml_function_coverage=1 00:19:27.612 --rc genhtml_legend=1 00:19:27.612 --rc geninfo_all_blocks=1 00:19:27.612 --rc geninfo_unexecuted_blocks=1 00:19:27.612 00:19:27.612 ' 00:19:27.612 11:30:23 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- common/autotest_common.sh@1694 -- # LCOV_OPTS=' 00:19:27.612 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:19:27.612 --rc genhtml_branch_coverage=1 00:19:27.612 --rc genhtml_function_coverage=1 00:19:27.612 --rc genhtml_legend=1 00:19:27.612 --rc geninfo_all_blocks=1 00:19:27.612 --rc geninfo_unexecuted_blocks=1 00:19:27.612 00:19:27.612 ' 00:19:27.612 11:30:23 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- common/autotest_common.sh@1695 -- # export 'LCOV=lcov 00:19:27.612 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:19:27.612 --rc genhtml_branch_coverage=1 00:19:27.612 --rc genhtml_function_coverage=1 00:19:27.613 --rc genhtml_legend=1 00:19:27.613 --rc geninfo_all_blocks=1 00:19:27.613 --rc geninfo_unexecuted_blocks=1 00:19:27.613 00:19:27.613 ' 00:19:27.613 11:30:23 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- common/autotest_common.sh@1695 -- # LCOV='lcov 00:19:27.613 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:19:27.613 --rc genhtml_branch_coverage=1 00:19:27.613 --rc genhtml_function_coverage=1 00:19:27.613 --rc genhtml_legend=1 00:19:27.613 --rc geninfo_all_blocks=1 00:19:27.613 --rc geninfo_unexecuted_blocks=1 00:19:27.613 00:19:27.613 ' 00:19:27.613 11:30:23 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- target/bdevio.sh@9 -- # source /home/vagrant/spdk_repo/spdk/test/nvmf/common.sh 00:19:27.613 11:30:23 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@7 -- # uname -s 00:19:27.613 11:30:23 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:19:27.613 11:30:23 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:19:27.613 11:30:23 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:19:27.613 11:30:23 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:19:27.613 11:30:23 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:19:27.613 11:30:23 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:19:27.613 11:30:23 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:19:27.613 11:30:23 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:19:27.613 11:30:23 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:19:27.613 11:30:23 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:19:27.613 11:30:23 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:c758a4ed-f09f-4c82-9afb-3d096f035464 00:19:27.613 11:30:23 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@18 -- # NVME_HOSTID=c758a4ed-f09f-4c82-9afb-3d096f035464 00:19:27.613 11:30:23 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:19:27.613 11:30:23 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:19:27.613 11:30:23 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@21 -- # NET_TYPE=virt 00:19:27.613 11:30:23 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:19:27.613 11:30:23 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@49 -- # source /home/vagrant/spdk_repo/spdk/scripts/common.sh 00:19:27.613 11:30:23 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- scripts/common.sh@15 -- # shopt -s extglob 00:19:27.613 11:30:23 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- scripts/common.sh@544 -- # [[ -e /bin/wpdk_common.sh ]] 00:19:27.613 11:30:23 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- scripts/common.sh@552 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:19:27.613 11:30:23 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- scripts/common.sh@553 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:19:27.613 11:30:23 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:19:27.613 11:30:23 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:19:27.613 11:30:23 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:19:27.613 11:30:23 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- paths/export.sh@5 -- # export PATH 00:19:27.613 11:30:23 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:19:27.613 11:30:23 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@51 -- # : 0 00:19:27.613 11:30:23 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@52 -- # export NVMF_APP_SHM_ID 00:19:27.613 11:30:23 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@53 -- # build_nvmf_app_args 00:19:27.613 11:30:23 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:19:27.613 11:30:23 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:19:27.613 11:30:23 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:19:27.613 11:30:23 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@33 -- # '[' '' -eq 1 ']' 00:19:27.613 /home/vagrant/spdk_repo/spdk/test/nvmf/common.sh: line 33: [: : integer expression expected 00:19:27.613 11:30:23 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@37 -- # '[' -n '' ']' 00:19:27.613 11:30:23 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@39 -- # '[' 0 -eq 1 ']' 00:19:27.613 11:30:23 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@55 -- # have_pci_nics=0 00:19:27.613 11:30:23 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- target/bdevio.sh@11 -- # MALLOC_BDEV_SIZE=64 00:19:27.613 11:30:23 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- target/bdevio.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:19:27.613 11:30:23 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- target/bdevio.sh@14 -- # nvmftestinit 00:19:27.613 11:30:23 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@467 -- # '[' -z tcp ']' 00:19:27.613 11:30:23 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@472 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:19:27.613 11:30:23 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@474 -- # prepare_net_devs 00:19:27.613 11:30:23 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@436 -- # local -g is_hw=no 00:19:27.613 11:30:23 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@438 -- # remove_spdk_ns 00:19:27.613 11:30:23 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@654 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:19:27.613 11:30:23 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 15> /dev/null' 00:19:27.613 11:30:23 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:19:27.872 11:30:23 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@440 -- # [[ virt != virt ]] 00:19:27.872 11:30:23 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@442 -- # [[ no == yes ]] 00:19:27.872 11:30:23 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@449 -- # [[ virt == phy ]] 00:19:27.872 11:30:23 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@452 -- # [[ virt == phy-fallback ]] 00:19:27.872 11:30:23 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@457 -- # [[ tcp == tcp ]] 00:19:27.872 11:30:23 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@458 -- # nvmf_veth_init 00:19:27.872 11:30:23 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@145 -- # NVMF_FIRST_INITIATOR_IP=10.0.0.1 00:19:27.872 11:30:23 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@146 -- # NVMF_SECOND_INITIATOR_IP=10.0.0.2 00:19:27.872 11:30:23 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@147 -- # NVMF_FIRST_TARGET_IP=10.0.0.3 00:19:27.872 11:30:23 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@148 -- # NVMF_SECOND_TARGET_IP=10.0.0.4 00:19:27.872 11:30:23 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@149 -- # NVMF_INITIATOR_IP=10.0.0.1 00:19:27.872 11:30:23 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@150 -- # NVMF_BRIDGE=nvmf_br 00:19:27.872 11:30:23 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@151 -- # NVMF_INITIATOR_INTERFACE=nvmf_init_if 00:19:27.872 11:30:23 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@152 -- # NVMF_INITIATOR_INTERFACE2=nvmf_init_if2 00:19:27.872 11:30:23 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@153 -- # NVMF_INITIATOR_BRIDGE=nvmf_init_br 00:19:27.873 11:30:23 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@154 -- # NVMF_INITIATOR_BRIDGE2=nvmf_init_br2 00:19:27.873 11:30:23 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@155 -- # NVMF_TARGET_NAMESPACE=nvmf_tgt_ns_spdk 00:19:27.873 11:30:23 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@156 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:19:27.873 11:30:23 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@157 -- # NVMF_TARGET_INTERFACE=nvmf_tgt_if 00:19:27.873 11:30:23 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@158 -- # NVMF_TARGET_INTERFACE2=nvmf_tgt_if2 00:19:27.873 11:30:23 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@159 -- # NVMF_TARGET_BRIDGE=nvmf_tgt_br 00:19:27.873 11:30:23 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@160 -- # NVMF_TARGET_BRIDGE2=nvmf_tgt_br2 00:19:27.873 11:30:23 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@162 -- # ip link set nvmf_init_br nomaster 00:19:27.873 Cannot find device "nvmf_init_br" 00:19:27.873 11:30:23 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@162 -- # true 00:19:27.873 11:30:23 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@163 -- # ip link set nvmf_init_br2 nomaster 00:19:27.873 Cannot find device "nvmf_init_br2" 00:19:27.873 11:30:23 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@163 -- # true 00:19:27.873 11:30:23 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@164 -- # ip link set nvmf_tgt_br nomaster 00:19:27.873 Cannot find device "nvmf_tgt_br" 00:19:27.873 11:30:23 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@164 -- # true 00:19:27.873 11:30:23 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@165 -- # ip link set nvmf_tgt_br2 nomaster 00:19:27.873 Cannot find device "nvmf_tgt_br2" 00:19:27.873 11:30:23 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@165 -- # true 00:19:27.873 11:30:23 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@166 -- # ip link set nvmf_init_br down 00:19:27.873 Cannot find device "nvmf_init_br" 00:19:27.873 11:30:23 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@166 -- # true 00:19:27.873 11:30:23 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@167 -- # ip link set nvmf_init_br2 down 00:19:27.873 Cannot find device "nvmf_init_br2" 00:19:27.873 11:30:23 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@167 -- # true 00:19:27.873 11:30:23 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@168 -- # ip link set nvmf_tgt_br down 00:19:27.873 Cannot find device "nvmf_tgt_br" 00:19:27.873 11:30:23 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@168 -- # true 00:19:27.873 11:30:23 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@169 -- # ip link set nvmf_tgt_br2 down 00:19:27.873 Cannot find device "nvmf_tgt_br2" 00:19:27.873 11:30:23 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@169 -- # true 00:19:27.873 11:30:23 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@170 -- # ip link delete nvmf_br type bridge 00:19:27.873 Cannot find device "nvmf_br" 00:19:27.873 11:30:23 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@170 -- # true 00:19:27.873 11:30:23 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@171 -- # ip link delete nvmf_init_if 00:19:27.873 Cannot find device "nvmf_init_if" 00:19:27.873 11:30:23 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@171 -- # true 00:19:27.873 11:30:23 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@172 -- # ip link delete nvmf_init_if2 00:19:27.873 Cannot find device "nvmf_init_if2" 00:19:27.873 11:30:23 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@172 -- # true 00:19:27.873 11:30:23 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@173 -- # ip netns exec nvmf_tgt_ns_spdk ip link delete nvmf_tgt_if 00:19:27.873 Cannot open network namespace "nvmf_tgt_ns_spdk": No such file or directory 00:19:27.873 11:30:23 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@173 -- # true 00:19:27.873 11:30:23 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@174 -- # ip netns exec nvmf_tgt_ns_spdk ip link delete nvmf_tgt_if2 00:19:27.873 Cannot open network namespace "nvmf_tgt_ns_spdk": No such file or directory 00:19:27.873 11:30:23 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@174 -- # true 00:19:27.873 11:30:23 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@177 -- # ip netns add nvmf_tgt_ns_spdk 00:19:27.873 11:30:23 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@180 -- # ip link add nvmf_init_if type veth peer name nvmf_init_br 00:19:27.873 11:30:23 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@181 -- # ip link add nvmf_init_if2 type veth peer name nvmf_init_br2 00:19:27.873 11:30:23 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@182 -- # ip link add nvmf_tgt_if type veth peer name nvmf_tgt_br 00:19:27.873 11:30:23 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@183 -- # ip link add nvmf_tgt_if2 type veth peer name nvmf_tgt_br2 00:19:27.873 11:30:23 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@186 -- # ip link set nvmf_tgt_if netns nvmf_tgt_ns_spdk 00:19:27.873 11:30:23 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@187 -- # ip link set nvmf_tgt_if2 netns nvmf_tgt_ns_spdk 00:19:27.873 11:30:23 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@190 -- # ip addr add 10.0.0.1/24 dev nvmf_init_if 00:19:27.873 11:30:23 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@191 -- # ip addr add 10.0.0.2/24 dev nvmf_init_if2 00:19:27.873 11:30:23 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@192 -- # ip netns exec nvmf_tgt_ns_spdk ip addr add 10.0.0.3/24 dev nvmf_tgt_if 00:19:27.873 11:30:23 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@193 -- # ip netns exec nvmf_tgt_ns_spdk ip addr add 10.0.0.4/24 dev nvmf_tgt_if2 00:19:27.873 11:30:23 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@196 -- # ip link set nvmf_init_if up 00:19:27.873 11:30:23 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@197 -- # ip link set nvmf_init_if2 up 00:19:27.873 11:30:23 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@198 -- # ip link set nvmf_init_br up 00:19:27.873 11:30:23 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@199 -- # ip link set nvmf_init_br2 up 00:19:27.873 11:30:23 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@200 -- # ip link set nvmf_tgt_br up 00:19:27.873 11:30:23 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@201 -- # ip link set nvmf_tgt_br2 up 00:19:27.873 11:30:23 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@202 -- # ip netns exec nvmf_tgt_ns_spdk ip link set nvmf_tgt_if up 00:19:28.132 11:30:23 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@203 -- # ip netns exec nvmf_tgt_ns_spdk ip link set nvmf_tgt_if2 up 00:19:28.132 11:30:23 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@204 -- # ip netns exec nvmf_tgt_ns_spdk ip link set lo up 00:19:28.132 11:30:23 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@207 -- # ip link add nvmf_br type bridge 00:19:28.132 11:30:23 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@208 -- # ip link set nvmf_br up 00:19:28.132 11:30:23 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@211 -- # ip link set nvmf_init_br master nvmf_br 00:19:28.132 11:30:23 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@212 -- # ip link set nvmf_init_br2 master nvmf_br 00:19:28.132 11:30:23 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@213 -- # ip link set nvmf_tgt_br master nvmf_br 00:19:28.132 11:30:23 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@214 -- # ip link set nvmf_tgt_br2 master nvmf_br 00:19:28.132 11:30:23 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@217 -- # ipts -I INPUT 1 -i nvmf_init_if -p tcp --dport 4420 -j ACCEPT 00:19:28.132 11:30:23 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@788 -- # iptables -I INPUT 1 -i nvmf_init_if -p tcp --dport 4420 -j ACCEPT -m comment --comment 'SPDK_NVMF:-I INPUT 1 -i nvmf_init_if -p tcp --dport 4420 -j ACCEPT' 00:19:28.132 11:30:23 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@218 -- # ipts -I INPUT 1 -i nvmf_init_if2 -p tcp --dport 4420 -j ACCEPT 00:19:28.132 11:30:23 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@788 -- # iptables -I INPUT 1 -i nvmf_init_if2 -p tcp --dport 4420 -j ACCEPT -m comment --comment 'SPDK_NVMF:-I INPUT 1 -i nvmf_init_if2 -p tcp --dport 4420 -j ACCEPT' 00:19:28.132 11:30:23 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@219 -- # ipts -A FORWARD -i nvmf_br -o nvmf_br -j ACCEPT 00:19:28.132 11:30:23 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@788 -- # iptables -A FORWARD -i nvmf_br -o nvmf_br -j ACCEPT -m comment --comment 'SPDK_NVMF:-A FORWARD -i nvmf_br -o nvmf_br -j ACCEPT' 00:19:28.132 11:30:23 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@222 -- # ping -c 1 10.0.0.3 00:19:28.132 PING 10.0.0.3 (10.0.0.3) 56(84) bytes of data. 00:19:28.132 64 bytes from 10.0.0.3: icmp_seq=1 ttl=64 time=0.055 ms 00:19:28.132 00:19:28.132 --- 10.0.0.3 ping statistics --- 00:19:28.132 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:19:28.132 rtt min/avg/max/mdev = 0.055/0.055/0.055/0.000 ms 00:19:28.132 11:30:23 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@223 -- # ping -c 1 10.0.0.4 00:19:28.132 PING 10.0.0.4 (10.0.0.4) 56(84) bytes of data. 00:19:28.132 64 bytes from 10.0.0.4: icmp_seq=1 ttl=64 time=0.043 ms 00:19:28.132 00:19:28.132 --- 10.0.0.4 ping statistics --- 00:19:28.132 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:19:28.132 rtt min/avg/max/mdev = 0.043/0.043/0.043/0.000 ms 00:19:28.132 11:30:23 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@224 -- # ip netns exec nvmf_tgt_ns_spdk ping -c 1 10.0.0.1 00:19:28.132 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:19:28.132 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.035 ms 00:19:28.132 00:19:28.132 --- 10.0.0.1 ping statistics --- 00:19:28.132 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:19:28.132 rtt min/avg/max/mdev = 0.035/0.035/0.035/0.000 ms 00:19:28.132 11:30:23 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@225 -- # ip netns exec nvmf_tgt_ns_spdk ping -c 1 10.0.0.2 00:19:28.132 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:19:28.132 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.043 ms 00:19:28.132 00:19:28.132 --- 10.0.0.2 ping statistics --- 00:19:28.132 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:19:28.132 rtt min/avg/max/mdev = 0.043/0.043/0.043/0.000 ms 00:19:28.132 11:30:23 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@227 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:19:28.132 11:30:23 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@459 -- # return 0 00:19:28.132 11:30:23 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@476 -- # '[' '' == iso ']' 00:19:28.132 11:30:23 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@480 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:19:28.132 11:30:23 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@481 -- # [[ tcp == \r\d\m\a ]] 00:19:28.132 11:30:23 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@490 -- # [[ tcp == \t\c\p ]] 00:19:28.132 11:30:23 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@491 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:19:28.132 11:30:23 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@494 -- # '[' tcp == tcp ']' 00:19:28.132 11:30:23 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@500 -- # modprobe nvme-tcp 00:19:28.133 11:30:23 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- target/bdevio.sh@16 -- # nvmfappstart -m 0x78 00:19:28.133 11:30:23 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@505 -- # timing_enter start_nvmf_tgt 00:19:28.133 11:30:23 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- common/autotest_common.sh@724 -- # xtrace_disable 00:19:28.133 11:30:23 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- common/autotest_common.sh@10 -- # set +x 00:19:28.133 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:19:28.133 11:30:23 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@507 -- # nvmfpid=82934 00:19:28.133 11:30:23 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@506 -- # ip netns exec nvmf_tgt_ns_spdk /home/vagrant/spdk_repo/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF --no-huge -s 1024 -m 0x78 00:19:28.133 11:30:23 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@508 -- # waitforlisten 82934 00:19:28.133 11:30:23 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- common/autotest_common.sh@831 -- # '[' -z 82934 ']' 00:19:28.133 11:30:23 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- common/autotest_common.sh@835 -- # local rpc_addr=/var/tmp/spdk.sock 00:19:28.133 11:30:23 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- common/autotest_common.sh@836 -- # local max_retries=100 00:19:28.133 11:30:23 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- common/autotest_common.sh@838 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:19:28.133 11:30:23 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- common/autotest_common.sh@840 -- # xtrace_disable 00:19:28.133 11:30:23 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- common/autotest_common.sh@10 -- # set +x 00:19:28.133 [2024-10-07 11:30:23.618794] Starting SPDK v25.01-pre git sha1 2a4f56c54 / DPDK 24.03.0 initialization... 00:19:28.133 [2024-10-07 11:30:23.619161] [ DPDK EAL parameters: nvmf -c 0x78 -m 1024 --no-huge --iova-mode=va --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --file-prefix=spdk0 --proc-type=auto ] 00:19:28.391 [2024-10-07 11:30:23.774515] app.c: 917:spdk_app_start: *NOTICE*: Total cores available: 4 00:19:28.649 [2024-10-07 11:30:23.932157] app.c: 610:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:19:28.649 [2024-10-07 11:30:23.932751] app.c: 611:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:19:28.649 [2024-10-07 11:30:23.933400] app.c: 616:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:19:28.649 [2024-10-07 11:30:23.934011] app.c: 617:app_setup_trace: *NOTICE*: SPDK application currently running. 00:19:28.649 [2024-10-07 11:30:23.934344] app.c: 618:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:19:28.649 [2024-10-07 11:30:23.935468] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 4 00:19:28.649 [2024-10-07 11:30:23.935595] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 5 00:19:28.649 [2024-10-07 11:30:23.935703] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 6 00:19:28.649 [2024-10-07 11:30:23.936189] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 3 00:19:29.216 11:30:24 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- common/autotest_common.sh@860 -- # (( i == 0 )) 00:19:29.216 11:30:24 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- common/autotest_common.sh@864 -- # return 0 00:19:29.216 11:30:24 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@509 -- # timing_exit start_nvmf_tgt 00:19:29.216 11:30:24 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- common/autotest_common.sh@730 -- # xtrace_disable 00:19:29.216 11:30:24 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- common/autotest_common.sh@10 -- # set +x 00:19:29.216 11:30:24 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@510 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:19:29.216 11:30:24 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- target/bdevio.sh@18 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:19:29.216 11:30:24 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:29.216 11:30:24 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- common/autotest_common.sh@10 -- # set +x 00:19:29.216 [2024-10-07 11:30:24.718835] tcp.c: 738:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:19:29.216 11:30:24 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:29.216 11:30:24 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- target/bdevio.sh@19 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:19:29.216 11:30:24 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:29.216 11:30:24 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- common/autotest_common.sh@10 -- # set +x 00:19:29.474 Malloc0 00:19:29.474 11:30:24 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:29.474 11:30:24 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- target/bdevio.sh@20 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:19:29.474 11:30:24 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:29.474 11:30:24 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- common/autotest_common.sh@10 -- # set +x 00:19:29.474 11:30:24 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:29.474 11:30:24 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- target/bdevio.sh@21 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:19:29.474 11:30:24 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:29.474 11:30:24 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- common/autotest_common.sh@10 -- # set +x 00:19:29.474 11:30:24 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:29.474 11:30:24 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- target/bdevio.sh@22 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.3 -s 4420 00:19:29.474 11:30:24 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:29.474 11:30:24 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- common/autotest_common.sh@10 -- # set +x 00:19:29.474 [2024-10-07 11:30:24.766993] tcp.c:1081:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.3 port 4420 *** 00:19:29.474 11:30:24 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:29.474 11:30:24 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- target/bdevio.sh@24 -- # /home/vagrant/spdk_repo/spdk/test/bdev/bdevio/bdevio --json /dev/fd/62 --no-huge -s 1024 00:19:29.474 11:30:24 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- target/bdevio.sh@24 -- # gen_nvmf_target_json 00:19:29.474 11:30:24 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@558 -- # config=() 00:19:29.474 11:30:24 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@558 -- # local subsystem config 00:19:29.474 11:30:24 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@560 -- # for subsystem in "${@:-1}" 00:19:29.474 11:30:24 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@580 -- # config+=("$(cat <<-EOF 00:19:29.474 { 00:19:29.474 "params": { 00:19:29.474 "name": "Nvme$subsystem", 00:19:29.474 "trtype": "$TEST_TRANSPORT", 00:19:29.474 "traddr": "$NVMF_FIRST_TARGET_IP", 00:19:29.474 "adrfam": "ipv4", 00:19:29.474 "trsvcid": "$NVMF_PORT", 00:19:29.474 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:19:29.474 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:19:29.474 "hdgst": ${hdgst:-false}, 00:19:29.474 "ddgst": ${ddgst:-false} 00:19:29.474 }, 00:19:29.474 "method": "bdev_nvme_attach_controller" 00:19:29.474 } 00:19:29.474 EOF 00:19:29.474 )") 00:19:29.474 11:30:24 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@580 -- # cat 00:19:29.474 11:30:24 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@582 -- # jq . 00:19:29.474 11:30:24 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@583 -- # IFS=, 00:19:29.474 11:30:24 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@584 -- # printf '%s\n' '{ 00:19:29.474 "params": { 00:19:29.474 "name": "Nvme1", 00:19:29.474 "trtype": "tcp", 00:19:29.474 "traddr": "10.0.0.3", 00:19:29.474 "adrfam": "ipv4", 00:19:29.474 "trsvcid": "4420", 00:19:29.474 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:19:29.474 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:19:29.474 "hdgst": false, 00:19:29.474 "ddgst": false 00:19:29.474 }, 00:19:29.474 "method": "bdev_nvme_attach_controller" 00:19:29.474 }' 00:19:29.474 [2024-10-07 11:30:24.836562] Starting SPDK v25.01-pre git sha1 2a4f56c54 / DPDK 24.03.0 initialization... 00:19:29.474 [2024-10-07 11:30:24.836718] [ DPDK EAL parameters: bdevio --no-shconf -c 0x7 -m 1024 --no-huge --iova-mode=va --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --file-prefix=spdk_pid82988 ] 00:19:29.731 [2024-10-07 11:30:24.998898] app.c: 917:spdk_app_start: *NOTICE*: Total cores available: 3 00:19:29.731 [2024-10-07 11:30:25.157491] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 1 00:19:29.732 [2024-10-07 11:30:25.157640] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 2 00:19:29.732 [2024-10-07 11:30:25.157646] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 0 00:19:29.989 I/O targets: 00:19:29.989 Nvme1n1: 131072 blocks of 512 bytes (64 MiB) 00:19:29.989 00:19:29.989 00:19:29.989 CUnit - A unit testing framework for C - Version 2.1-3 00:19:29.989 http://cunit.sourceforge.net/ 00:19:29.989 00:19:29.989 00:19:29.989 Suite: bdevio tests on: Nvme1n1 00:19:29.989 Test: blockdev write read block ...passed 00:19:29.989 Test: blockdev write zeroes read block ...passed 00:19:29.989 Test: blockdev write zeroes read no split ...passed 00:19:30.247 Test: blockdev write zeroes read split ...passed 00:19:30.247 Test: blockdev write zeroes read split partial ...passed 00:19:30.247 Test: blockdev reset ...[2024-10-07 11:30:25.542909] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:19:30.247 [2024-10-07 11:30:25.543013] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x22cd450 (9): Bad file descriptor 00:19:30.247 [2024-10-07 11:30:25.563065] bdev_nvme.c:2183:_bdev_nvme_reset_ctrlr_complete: *NOTICE*: Resetting controller successful. 00:19:30.247 passed 00:19:30.247 Test: blockdev write read 8 blocks ...passed 00:19:30.247 Test: blockdev write read size > 128k ...passed 00:19:30.247 Test: blockdev write read invalid size ...passed 00:19:30.247 Test: blockdev write read offset + nbytes == size of blockdev ...passed 00:19:30.247 Test: blockdev write read offset + nbytes > size of blockdev ...passed 00:19:30.247 Test: blockdev write read max offset ...passed 00:19:30.247 Test: blockdev write read 2 blocks on overlapped address offset ...passed 00:19:30.247 Test: blockdev writev readv 8 blocks ...passed 00:19:30.247 Test: blockdev writev readv 30 x 1block ...passed 00:19:30.247 Test: blockdev writev readv block ...passed 00:19:30.247 Test: blockdev writev readv size > 128k ...passed 00:19:30.247 Test: blockdev writev readv size > 128k in two iovs ...passed 00:19:30.247 Test: blockdev comparev and writev ...[2024-10-07 11:30:25.735251] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: COMPARE sqid:1 cid:0 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:19:30.247 [2024-10-07 11:30:25.735307] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMPARE FAILURE (02/85) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:19:30.247 [2024-10-07 11:30:25.735335] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:19:30.247 [2024-10-07 11:30:25.735348] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - FAILED FUSED (00/09) qid:1 cid:1 cdw0:0 sqhd:0022 p:0 m:0 dnr:0 00:19:30.247 [2024-10-07 11:30:25.735840] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: COMPARE sqid:1 cid:1 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:19:30.247 [2024-10-07 11:30:25.735870] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMPARE FAILURE (02/85) qid:1 cid:1 cdw0:0 sqhd:0023 p:0 m:0 dnr:0 00:19:30.247 [2024-10-07 11:30:25.735888] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:19:30.247 [2024-10-07 11:30:25.735898] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - FAILED FUSED (00/09) qid:1 cid:0 cdw0:0 sqhd:0024 p:0 m:0 dnr:0 00:19:30.247 [2024-10-07 11:30:25.736270] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: COMPARE sqid:1 cid:0 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:19:30.247 [2024-10-07 11:30:25.736295] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMPARE FAILURE (02/85) qid:1 cid:0 cdw0:0 sqhd:0025 p:0 m:0 dnr:0 00:19:30.247 [2024-10-07 11:30:25.736312] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:19:30.247 [2024-10-07 11:30:25.736322] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - FAILED FUSED (00/09) qid:1 cid:1 cdw0:0 sqhd:0026 p:0 m:0 dnr:0 00:19:30.247 [2024-10-07 11:30:25.736681] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: COMPARE sqid:1 cid:1 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:19:30.247 [2024-10-07 11:30:25.736704] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMPARE FAILURE (02/85) qid:1 cid:1 cdw0:0 sqhd:0027 p:0 m:0 dnr:0 00:19:30.247 [2024-10-07 11:30:25.736722] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:19:30.247 [2024-10-07 11:30:25.736732] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - FAILED FUSED (00/09) qid:1 cid:0 cdw0:0 sqhd:0028 p:0 m:0 dnr:0 00:19:30.506 passed 00:19:30.506 Test: blockdev nvme passthru rw ...passed 00:19:30.506 Test: blockdev nvme passthru vendor specific ...[2024-10-07 11:30:25.820004] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC CONNECT qid:1 cid:0 SGL DATA BLOCK OFFSET 0x0 len:0x0 00:19:30.506 [2024-10-07 11:30:25.820033] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: INVALID OPCODE (00/01) qid:1 cid:0 cdw0:0 sqhd:002c p:0 m:0 dnr:0 00:19:30.506 [2024-10-07 11:30:25.820155] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC CONNECT qid:1 cid:0 SGL DATA BLOCK OFFSET 0x0 len:0x0 00:19:30.506 [2024-10-07 11:30:25.820171] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: INVALID OPCODE (00/01) qid:1 cid:0 cdw0:0 sqhd:002d p:0 m:0 dnr:0 00:19:30.506 [2024-10-07 11:30:25.820283] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC CONNECT qid:1 cid:0 SGL DATA BLOCK OFFSET 0x0 len:0x0 00:19:30.506 [2024-10-07 11:30:25.820298] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: INVALID OPCODE (00/01) qid:1 cid:0 cdw0:0 sqhd:002e p:0 m:0 dnr:0 00:19:30.506 [2024-10-07 11:30:25.820408] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC CONNECT qid:1 cid:0 SGL DATA BLOCK OFFSET 0x0 len:0x0 00:19:30.506 [2024-10-07 11:30:25.820422] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: INVALID OPCODE (00/01) qid:1 cid:0 cdw0:0 sqhd:002f p:0 m:0 dnr:0 00:19:30.506 passed 00:19:30.506 Test: blockdev nvme admin passthru ...passed 00:19:30.506 Test: blockdev copy ...passed 00:19:30.506 00:19:30.506 Run Summary: Type Total Ran Passed Failed Inactive 00:19:30.506 suites 1 1 n/a 0 0 00:19:30.506 tests 23 23 23 0 0 00:19:30.506 asserts 152 152 152 0 n/a 00:19:30.506 00:19:30.506 Elapsed time = 0.920 seconds 00:19:31.073 11:30:26 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- target/bdevio.sh@26 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:19:31.073 11:30:26 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:31.073 11:30:26 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- common/autotest_common.sh@10 -- # set +x 00:19:31.073 11:30:26 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:31.073 11:30:26 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- target/bdevio.sh@28 -- # trap - SIGINT SIGTERM EXIT 00:19:31.073 11:30:26 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- target/bdevio.sh@30 -- # nvmftestfini 00:19:31.073 11:30:26 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@514 -- # nvmfcleanup 00:19:31.073 11:30:26 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@121 -- # sync 00:19:31.073 11:30:26 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@123 -- # '[' tcp == tcp ']' 00:19:31.073 11:30:26 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@124 -- # set +e 00:19:31.073 11:30:26 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@125 -- # for i in {1..20} 00:19:31.073 11:30:26 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@126 -- # modprobe -v -r nvme-tcp 00:19:31.073 rmmod nvme_tcp 00:19:31.073 rmmod nvme_fabrics 00:19:31.073 rmmod nvme_keyring 00:19:31.073 11:30:26 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@127 -- # modprobe -v -r nvme-fabrics 00:19:31.073 11:30:26 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@128 -- # set -e 00:19:31.073 11:30:26 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@129 -- # return 0 00:19:31.073 11:30:26 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@515 -- # '[' -n 82934 ']' 00:19:31.073 11:30:26 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@516 -- # killprocess 82934 00:19:31.073 11:30:26 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- common/autotest_common.sh@950 -- # '[' -z 82934 ']' 00:19:31.073 11:30:26 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- common/autotest_common.sh@954 -- # kill -0 82934 00:19:31.073 11:30:26 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- common/autotest_common.sh@955 -- # uname 00:19:31.073 11:30:26 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- common/autotest_common.sh@955 -- # '[' Linux = Linux ']' 00:19:31.073 11:30:26 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- common/autotest_common.sh@956 -- # ps --no-headers -o comm= 82934 00:19:31.073 killing process with pid 82934 00:19:31.073 11:30:26 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- common/autotest_common.sh@956 -- # process_name=reactor_3 00:19:31.073 11:30:26 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- common/autotest_common.sh@960 -- # '[' reactor_3 = sudo ']' 00:19:31.073 11:30:26 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- common/autotest_common.sh@968 -- # echo 'killing process with pid 82934' 00:19:31.073 11:30:26 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- common/autotest_common.sh@969 -- # kill 82934 00:19:31.073 11:30:26 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- common/autotest_common.sh@974 -- # wait 82934 00:19:31.640 11:30:26 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@518 -- # '[' '' == iso ']' 00:19:31.640 11:30:26 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@521 -- # [[ tcp == \t\c\p ]] 00:19:31.640 11:30:26 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@522 -- # nvmf_tcp_fini 00:19:31.640 11:30:26 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@297 -- # iptr 00:19:31.640 11:30:26 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@789 -- # iptables-save 00:19:31.640 11:30:26 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@789 -- # grep -v SPDK_NVMF 00:19:31.640 11:30:26 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@789 -- # iptables-restore 00:19:31.640 11:30:26 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@298 -- # [[ nvmf_tgt_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s\_\s\p\d\k ]] 00:19:31.640 11:30:26 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@299 -- # nvmf_veth_fini 00:19:31.640 11:30:26 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@233 -- # ip link set nvmf_init_br nomaster 00:19:31.640 11:30:26 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@234 -- # ip link set nvmf_init_br2 nomaster 00:19:31.640 11:30:26 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@235 -- # ip link set nvmf_tgt_br nomaster 00:19:31.640 11:30:26 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@236 -- # ip link set nvmf_tgt_br2 nomaster 00:19:31.640 11:30:27 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@237 -- # ip link set nvmf_init_br down 00:19:31.640 11:30:27 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@238 -- # ip link set nvmf_init_br2 down 00:19:31.640 11:30:27 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@239 -- # ip link set nvmf_tgt_br down 00:19:31.640 11:30:27 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@240 -- # ip link set nvmf_tgt_br2 down 00:19:31.640 11:30:27 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@241 -- # ip link delete nvmf_br type bridge 00:19:31.640 11:30:27 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@242 -- # ip link delete nvmf_init_if 00:19:31.640 11:30:27 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@243 -- # ip link delete nvmf_init_if2 00:19:31.640 11:30:27 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@244 -- # ip netns exec nvmf_tgt_ns_spdk ip link delete nvmf_tgt_if 00:19:31.640 11:30:27 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@245 -- # ip netns exec nvmf_tgt_ns_spdk ip link delete nvmf_tgt_if2 00:19:31.640 11:30:27 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@246 -- # remove_spdk_ns 00:19:31.640 11:30:27 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@654 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:19:31.640 11:30:27 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 15> /dev/null' 00:19:31.640 11:30:27 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:19:31.898 11:30:27 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@300 -- # return 0 00:19:31.898 00:19:31.898 real 0m4.288s 00:19:31.898 user 0m14.308s 00:19:31.898 sys 0m1.696s 00:19:31.898 11:30:27 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- common/autotest_common.sh@1126 -- # xtrace_disable 00:19:31.898 11:30:27 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- common/autotest_common.sh@10 -- # set +x 00:19:31.898 ************************************ 00:19:31.898 END TEST nvmf_bdevio_no_huge 00:19:31.898 ************************************ 00:19:31.898 11:30:27 nvmf_tcp.nvmf_target_extra -- nvmf/nvmf_target_extra.sh@41 -- # run_test nvmf_tls /home/vagrant/spdk_repo/spdk/test/nvmf/target/tls.sh --transport=tcp 00:19:31.898 11:30:27 nvmf_tcp.nvmf_target_extra -- common/autotest_common.sh@1101 -- # '[' 3 -le 1 ']' 00:19:31.898 11:30:27 nvmf_tcp.nvmf_target_extra -- common/autotest_common.sh@1107 -- # xtrace_disable 00:19:31.898 11:30:27 nvmf_tcp.nvmf_target_extra -- common/autotest_common.sh@10 -- # set +x 00:19:31.898 ************************************ 00:19:31.898 START TEST nvmf_tls 00:19:31.898 ************************************ 00:19:31.898 11:30:27 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@1125 -- # /home/vagrant/spdk_repo/spdk/test/nvmf/target/tls.sh --transport=tcp 00:19:31.898 * Looking for test storage... 00:19:31.898 * Found test storage at /home/vagrant/spdk_repo/spdk/test/nvmf/target 00:19:31.898 11:30:27 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@1680 -- # [[ y == y ]] 00:19:31.898 11:30:27 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@1681 -- # lcov --version 00:19:31.898 11:30:27 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@1681 -- # awk '{print $NF}' 00:19:32.157 11:30:27 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@1681 -- # lt 1.15 2 00:19:32.157 11:30:27 nvmf_tcp.nvmf_target_extra.nvmf_tls -- scripts/common.sh@373 -- # cmp_versions 1.15 '<' 2 00:19:32.157 11:30:27 nvmf_tcp.nvmf_target_extra.nvmf_tls -- scripts/common.sh@333 -- # local ver1 ver1_l 00:19:32.157 11:30:27 nvmf_tcp.nvmf_target_extra.nvmf_tls -- scripts/common.sh@334 -- # local ver2 ver2_l 00:19:32.157 11:30:27 nvmf_tcp.nvmf_target_extra.nvmf_tls -- scripts/common.sh@336 -- # IFS=.-: 00:19:32.157 11:30:27 nvmf_tcp.nvmf_target_extra.nvmf_tls -- scripts/common.sh@336 -- # read -ra ver1 00:19:32.157 11:30:27 nvmf_tcp.nvmf_target_extra.nvmf_tls -- scripts/common.sh@337 -- # IFS=.-: 00:19:32.157 11:30:27 nvmf_tcp.nvmf_target_extra.nvmf_tls -- scripts/common.sh@337 -- # read -ra ver2 00:19:32.157 11:30:27 nvmf_tcp.nvmf_target_extra.nvmf_tls -- scripts/common.sh@338 -- # local 'op=<' 00:19:32.157 11:30:27 nvmf_tcp.nvmf_target_extra.nvmf_tls -- scripts/common.sh@340 -- # ver1_l=2 00:19:32.157 11:30:27 nvmf_tcp.nvmf_target_extra.nvmf_tls -- scripts/common.sh@341 -- # ver2_l=1 00:19:32.157 11:30:27 nvmf_tcp.nvmf_target_extra.nvmf_tls -- scripts/common.sh@343 -- # local lt=0 gt=0 eq=0 v 00:19:32.157 11:30:27 nvmf_tcp.nvmf_target_extra.nvmf_tls -- scripts/common.sh@344 -- # case "$op" in 00:19:32.157 11:30:27 nvmf_tcp.nvmf_target_extra.nvmf_tls -- scripts/common.sh@345 -- # : 1 00:19:32.157 11:30:27 nvmf_tcp.nvmf_target_extra.nvmf_tls -- scripts/common.sh@364 -- # (( v = 0 )) 00:19:32.157 11:30:27 nvmf_tcp.nvmf_target_extra.nvmf_tls -- scripts/common.sh@364 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:19:32.157 11:30:27 nvmf_tcp.nvmf_target_extra.nvmf_tls -- scripts/common.sh@365 -- # decimal 1 00:19:32.157 11:30:27 nvmf_tcp.nvmf_target_extra.nvmf_tls -- scripts/common.sh@353 -- # local d=1 00:19:32.157 11:30:27 nvmf_tcp.nvmf_target_extra.nvmf_tls -- scripts/common.sh@354 -- # [[ 1 =~ ^[0-9]+$ ]] 00:19:32.157 11:30:27 nvmf_tcp.nvmf_target_extra.nvmf_tls -- scripts/common.sh@355 -- # echo 1 00:19:32.157 11:30:27 nvmf_tcp.nvmf_target_extra.nvmf_tls -- scripts/common.sh@365 -- # ver1[v]=1 00:19:32.157 11:30:27 nvmf_tcp.nvmf_target_extra.nvmf_tls -- scripts/common.sh@366 -- # decimal 2 00:19:32.157 11:30:27 nvmf_tcp.nvmf_target_extra.nvmf_tls -- scripts/common.sh@353 -- # local d=2 00:19:32.157 11:30:27 nvmf_tcp.nvmf_target_extra.nvmf_tls -- scripts/common.sh@354 -- # [[ 2 =~ ^[0-9]+$ ]] 00:19:32.157 11:30:27 nvmf_tcp.nvmf_target_extra.nvmf_tls -- scripts/common.sh@355 -- # echo 2 00:19:32.157 11:30:27 nvmf_tcp.nvmf_target_extra.nvmf_tls -- scripts/common.sh@366 -- # ver2[v]=2 00:19:32.157 11:30:27 nvmf_tcp.nvmf_target_extra.nvmf_tls -- scripts/common.sh@367 -- # (( ver1[v] > ver2[v] )) 00:19:32.158 11:30:27 nvmf_tcp.nvmf_target_extra.nvmf_tls -- scripts/common.sh@368 -- # (( ver1[v] < ver2[v] )) 00:19:32.158 11:30:27 nvmf_tcp.nvmf_target_extra.nvmf_tls -- scripts/common.sh@368 -- # return 0 00:19:32.158 11:30:27 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@1682 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:19:32.158 11:30:27 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@1694 -- # export 'LCOV_OPTS= 00:19:32.158 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:19:32.158 --rc genhtml_branch_coverage=1 00:19:32.158 --rc genhtml_function_coverage=1 00:19:32.158 --rc genhtml_legend=1 00:19:32.158 --rc geninfo_all_blocks=1 00:19:32.158 --rc geninfo_unexecuted_blocks=1 00:19:32.158 00:19:32.158 ' 00:19:32.158 11:30:27 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@1694 -- # LCOV_OPTS=' 00:19:32.158 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:19:32.158 --rc genhtml_branch_coverage=1 00:19:32.158 --rc genhtml_function_coverage=1 00:19:32.158 --rc genhtml_legend=1 00:19:32.158 --rc geninfo_all_blocks=1 00:19:32.158 --rc geninfo_unexecuted_blocks=1 00:19:32.158 00:19:32.158 ' 00:19:32.158 11:30:27 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@1695 -- # export 'LCOV=lcov 00:19:32.158 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:19:32.158 --rc genhtml_branch_coverage=1 00:19:32.158 --rc genhtml_function_coverage=1 00:19:32.158 --rc genhtml_legend=1 00:19:32.158 --rc geninfo_all_blocks=1 00:19:32.158 --rc geninfo_unexecuted_blocks=1 00:19:32.158 00:19:32.158 ' 00:19:32.158 11:30:27 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@1695 -- # LCOV='lcov 00:19:32.158 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:19:32.158 --rc genhtml_branch_coverage=1 00:19:32.158 --rc genhtml_function_coverage=1 00:19:32.158 --rc genhtml_legend=1 00:19:32.158 --rc geninfo_all_blocks=1 00:19:32.158 --rc geninfo_unexecuted_blocks=1 00:19:32.158 00:19:32.158 ' 00:19:32.158 11:30:27 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@10 -- # source /home/vagrant/spdk_repo/spdk/test/nvmf/common.sh 00:19:32.158 11:30:27 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@7 -- # uname -s 00:19:32.158 11:30:27 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:19:32.158 11:30:27 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:19:32.158 11:30:27 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:19:32.158 11:30:27 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:19:32.158 11:30:27 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:19:32.158 11:30:27 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:19:32.158 11:30:27 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:19:32.158 11:30:27 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:19:32.158 11:30:27 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:19:32.158 11:30:27 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:19:32.158 11:30:27 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:c758a4ed-f09f-4c82-9afb-3d096f035464 00:19:32.158 11:30:27 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@18 -- # NVME_HOSTID=c758a4ed-f09f-4c82-9afb-3d096f035464 00:19:32.158 11:30:27 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:19:32.158 11:30:27 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:19:32.158 11:30:27 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@21 -- # NET_TYPE=virt 00:19:32.158 11:30:27 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:19:32.158 11:30:27 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@49 -- # source /home/vagrant/spdk_repo/spdk/scripts/common.sh 00:19:32.158 11:30:27 nvmf_tcp.nvmf_target_extra.nvmf_tls -- scripts/common.sh@15 -- # shopt -s extglob 00:19:32.158 11:30:27 nvmf_tcp.nvmf_target_extra.nvmf_tls -- scripts/common.sh@544 -- # [[ -e /bin/wpdk_common.sh ]] 00:19:32.158 11:30:27 nvmf_tcp.nvmf_target_extra.nvmf_tls -- scripts/common.sh@552 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:19:32.158 11:30:27 nvmf_tcp.nvmf_target_extra.nvmf_tls -- scripts/common.sh@553 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:19:32.158 11:30:27 nvmf_tcp.nvmf_target_extra.nvmf_tls -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:19:32.158 11:30:27 nvmf_tcp.nvmf_target_extra.nvmf_tls -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:19:32.158 11:30:27 nvmf_tcp.nvmf_target_extra.nvmf_tls -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:19:32.158 11:30:27 nvmf_tcp.nvmf_target_extra.nvmf_tls -- paths/export.sh@5 -- # export PATH 00:19:32.158 11:30:27 nvmf_tcp.nvmf_target_extra.nvmf_tls -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:19:32.158 11:30:27 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@51 -- # : 0 00:19:32.158 11:30:27 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@52 -- # export NVMF_APP_SHM_ID 00:19:32.158 11:30:27 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@53 -- # build_nvmf_app_args 00:19:32.158 11:30:27 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:19:32.158 11:30:27 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:19:32.158 11:30:27 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:19:32.158 11:30:27 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@33 -- # '[' '' -eq 1 ']' 00:19:32.158 /home/vagrant/spdk_repo/spdk/test/nvmf/common.sh: line 33: [: : integer expression expected 00:19:32.158 11:30:27 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@37 -- # '[' -n '' ']' 00:19:32.158 11:30:27 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@39 -- # '[' 0 -eq 1 ']' 00:19:32.158 11:30:27 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@55 -- # have_pci_nics=0 00:19:32.158 11:30:27 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@12 -- # rpc_py=/home/vagrant/spdk_repo/spdk/scripts/rpc.py 00:19:32.158 11:30:27 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@63 -- # nvmftestinit 00:19:32.158 11:30:27 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@467 -- # '[' -z tcp ']' 00:19:32.158 11:30:27 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@472 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:19:32.158 11:30:27 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@474 -- # prepare_net_devs 00:19:32.158 11:30:27 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@436 -- # local -g is_hw=no 00:19:32.158 11:30:27 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@438 -- # remove_spdk_ns 00:19:32.158 11:30:27 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@654 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:19:32.158 11:30:27 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 15> /dev/null' 00:19:32.158 11:30:27 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:19:32.158 11:30:27 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@440 -- # [[ virt != virt ]] 00:19:32.158 11:30:27 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@442 -- # [[ no == yes ]] 00:19:32.158 11:30:27 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@449 -- # [[ virt == phy ]] 00:19:32.158 11:30:27 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@452 -- # [[ virt == phy-fallback ]] 00:19:32.158 11:30:27 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@457 -- # [[ tcp == tcp ]] 00:19:32.158 11:30:27 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@458 -- # nvmf_veth_init 00:19:32.158 11:30:27 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@145 -- # NVMF_FIRST_INITIATOR_IP=10.0.0.1 00:19:32.158 11:30:27 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@146 -- # NVMF_SECOND_INITIATOR_IP=10.0.0.2 00:19:32.158 11:30:27 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@147 -- # NVMF_FIRST_TARGET_IP=10.0.0.3 00:19:32.158 11:30:27 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@148 -- # NVMF_SECOND_TARGET_IP=10.0.0.4 00:19:32.158 11:30:27 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@149 -- # NVMF_INITIATOR_IP=10.0.0.1 00:19:32.158 11:30:27 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@150 -- # NVMF_BRIDGE=nvmf_br 00:19:32.158 11:30:27 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@151 -- # NVMF_INITIATOR_INTERFACE=nvmf_init_if 00:19:32.158 11:30:27 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@152 -- # NVMF_INITIATOR_INTERFACE2=nvmf_init_if2 00:19:32.158 11:30:27 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@153 -- # NVMF_INITIATOR_BRIDGE=nvmf_init_br 00:19:32.158 11:30:27 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@154 -- # NVMF_INITIATOR_BRIDGE2=nvmf_init_br2 00:19:32.158 11:30:27 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@155 -- # NVMF_TARGET_NAMESPACE=nvmf_tgt_ns_spdk 00:19:32.158 11:30:27 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@156 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:19:32.158 11:30:27 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@157 -- # NVMF_TARGET_INTERFACE=nvmf_tgt_if 00:19:32.158 11:30:27 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@158 -- # NVMF_TARGET_INTERFACE2=nvmf_tgt_if2 00:19:32.158 11:30:27 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@159 -- # NVMF_TARGET_BRIDGE=nvmf_tgt_br 00:19:32.158 11:30:27 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@160 -- # NVMF_TARGET_BRIDGE2=nvmf_tgt_br2 00:19:32.158 11:30:27 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@162 -- # ip link set nvmf_init_br nomaster 00:19:32.158 Cannot find device "nvmf_init_br" 00:19:32.158 11:30:27 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@162 -- # true 00:19:32.158 11:30:27 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@163 -- # ip link set nvmf_init_br2 nomaster 00:19:32.158 Cannot find device "nvmf_init_br2" 00:19:32.158 11:30:27 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@163 -- # true 00:19:32.158 11:30:27 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@164 -- # ip link set nvmf_tgt_br nomaster 00:19:32.158 Cannot find device "nvmf_tgt_br" 00:19:32.158 11:30:27 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@164 -- # true 00:19:32.158 11:30:27 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@165 -- # ip link set nvmf_tgt_br2 nomaster 00:19:32.158 Cannot find device "nvmf_tgt_br2" 00:19:32.158 11:30:27 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@165 -- # true 00:19:32.159 11:30:27 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@166 -- # ip link set nvmf_init_br down 00:19:32.159 Cannot find device "nvmf_init_br" 00:19:32.159 11:30:27 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@166 -- # true 00:19:32.159 11:30:27 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@167 -- # ip link set nvmf_init_br2 down 00:19:32.159 Cannot find device "nvmf_init_br2" 00:19:32.159 11:30:27 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@167 -- # true 00:19:32.159 11:30:27 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@168 -- # ip link set nvmf_tgt_br down 00:19:32.159 Cannot find device "nvmf_tgt_br" 00:19:32.159 11:30:27 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@168 -- # true 00:19:32.159 11:30:27 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@169 -- # ip link set nvmf_tgt_br2 down 00:19:32.159 Cannot find device "nvmf_tgt_br2" 00:19:32.159 11:30:27 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@169 -- # true 00:19:32.159 11:30:27 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@170 -- # ip link delete nvmf_br type bridge 00:19:32.159 Cannot find device "nvmf_br" 00:19:32.159 11:30:27 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@170 -- # true 00:19:32.159 11:30:27 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@171 -- # ip link delete nvmf_init_if 00:19:32.159 Cannot find device "nvmf_init_if" 00:19:32.159 11:30:27 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@171 -- # true 00:19:32.159 11:30:27 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@172 -- # ip link delete nvmf_init_if2 00:19:32.159 Cannot find device "nvmf_init_if2" 00:19:32.159 11:30:27 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@172 -- # true 00:19:32.159 11:30:27 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@173 -- # ip netns exec nvmf_tgt_ns_spdk ip link delete nvmf_tgt_if 00:19:32.159 Cannot open network namespace "nvmf_tgt_ns_spdk": No such file or directory 00:19:32.159 11:30:27 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@173 -- # true 00:19:32.159 11:30:27 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@174 -- # ip netns exec nvmf_tgt_ns_spdk ip link delete nvmf_tgt_if2 00:19:32.159 Cannot open network namespace "nvmf_tgt_ns_spdk": No such file or directory 00:19:32.159 11:30:27 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@174 -- # true 00:19:32.159 11:30:27 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@177 -- # ip netns add nvmf_tgt_ns_spdk 00:19:32.159 11:30:27 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@180 -- # ip link add nvmf_init_if type veth peer name nvmf_init_br 00:19:32.159 11:30:27 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@181 -- # ip link add nvmf_init_if2 type veth peer name nvmf_init_br2 00:19:32.159 11:30:27 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@182 -- # ip link add nvmf_tgt_if type veth peer name nvmf_tgt_br 00:19:32.159 11:30:27 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@183 -- # ip link add nvmf_tgt_if2 type veth peer name nvmf_tgt_br2 00:19:32.417 11:30:27 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@186 -- # ip link set nvmf_tgt_if netns nvmf_tgt_ns_spdk 00:19:32.417 11:30:27 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@187 -- # ip link set nvmf_tgt_if2 netns nvmf_tgt_ns_spdk 00:19:32.417 11:30:27 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@190 -- # ip addr add 10.0.0.1/24 dev nvmf_init_if 00:19:32.417 11:30:27 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@191 -- # ip addr add 10.0.0.2/24 dev nvmf_init_if2 00:19:32.417 11:30:27 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@192 -- # ip netns exec nvmf_tgt_ns_spdk ip addr add 10.0.0.3/24 dev nvmf_tgt_if 00:19:32.417 11:30:27 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@193 -- # ip netns exec nvmf_tgt_ns_spdk ip addr add 10.0.0.4/24 dev nvmf_tgt_if2 00:19:32.417 11:30:27 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@196 -- # ip link set nvmf_init_if up 00:19:32.417 11:30:27 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@197 -- # ip link set nvmf_init_if2 up 00:19:32.418 11:30:27 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@198 -- # ip link set nvmf_init_br up 00:19:32.418 11:30:27 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@199 -- # ip link set nvmf_init_br2 up 00:19:32.418 11:30:27 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@200 -- # ip link set nvmf_tgt_br up 00:19:32.418 11:30:27 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@201 -- # ip link set nvmf_tgt_br2 up 00:19:32.418 11:30:27 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@202 -- # ip netns exec nvmf_tgt_ns_spdk ip link set nvmf_tgt_if up 00:19:32.418 11:30:27 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@203 -- # ip netns exec nvmf_tgt_ns_spdk ip link set nvmf_tgt_if2 up 00:19:32.418 11:30:27 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@204 -- # ip netns exec nvmf_tgt_ns_spdk ip link set lo up 00:19:32.418 11:30:27 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@207 -- # ip link add nvmf_br type bridge 00:19:32.418 11:30:27 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@208 -- # ip link set nvmf_br up 00:19:32.418 11:30:27 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@211 -- # ip link set nvmf_init_br master nvmf_br 00:19:32.418 11:30:27 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@212 -- # ip link set nvmf_init_br2 master nvmf_br 00:19:32.418 11:30:27 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@213 -- # ip link set nvmf_tgt_br master nvmf_br 00:19:32.418 11:30:27 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@214 -- # ip link set nvmf_tgt_br2 master nvmf_br 00:19:32.418 11:30:27 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@217 -- # ipts -I INPUT 1 -i nvmf_init_if -p tcp --dport 4420 -j ACCEPT 00:19:32.418 11:30:27 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@788 -- # iptables -I INPUT 1 -i nvmf_init_if -p tcp --dport 4420 -j ACCEPT -m comment --comment 'SPDK_NVMF:-I INPUT 1 -i nvmf_init_if -p tcp --dport 4420 -j ACCEPT' 00:19:32.418 11:30:27 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@218 -- # ipts -I INPUT 1 -i nvmf_init_if2 -p tcp --dport 4420 -j ACCEPT 00:19:32.418 11:30:27 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@788 -- # iptables -I INPUT 1 -i nvmf_init_if2 -p tcp --dport 4420 -j ACCEPT -m comment --comment 'SPDK_NVMF:-I INPUT 1 -i nvmf_init_if2 -p tcp --dport 4420 -j ACCEPT' 00:19:32.418 11:30:27 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@219 -- # ipts -A FORWARD -i nvmf_br -o nvmf_br -j ACCEPT 00:19:32.418 11:30:27 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@788 -- # iptables -A FORWARD -i nvmf_br -o nvmf_br -j ACCEPT -m comment --comment 'SPDK_NVMF:-A FORWARD -i nvmf_br -o nvmf_br -j ACCEPT' 00:19:32.418 11:30:27 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@222 -- # ping -c 1 10.0.0.3 00:19:32.418 PING 10.0.0.3 (10.0.0.3) 56(84) bytes of data. 00:19:32.418 64 bytes from 10.0.0.3: icmp_seq=1 ttl=64 time=0.071 ms 00:19:32.418 00:19:32.418 --- 10.0.0.3 ping statistics --- 00:19:32.418 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:19:32.418 rtt min/avg/max/mdev = 0.071/0.071/0.071/0.000 ms 00:19:32.418 11:30:27 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@223 -- # ping -c 1 10.0.0.4 00:19:32.418 PING 10.0.0.4 (10.0.0.4) 56(84) bytes of data. 00:19:32.418 64 bytes from 10.0.0.4: icmp_seq=1 ttl=64 time=0.065 ms 00:19:32.418 00:19:32.418 --- 10.0.0.4 ping statistics --- 00:19:32.418 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:19:32.418 rtt min/avg/max/mdev = 0.065/0.065/0.065/0.000 ms 00:19:32.418 11:30:27 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@224 -- # ip netns exec nvmf_tgt_ns_spdk ping -c 1 10.0.0.1 00:19:32.418 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:19:32.418 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.033 ms 00:19:32.418 00:19:32.418 --- 10.0.0.1 ping statistics --- 00:19:32.418 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:19:32.418 rtt min/avg/max/mdev = 0.033/0.033/0.033/0.000 ms 00:19:32.418 11:30:27 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@225 -- # ip netns exec nvmf_tgt_ns_spdk ping -c 1 10.0.0.2 00:19:32.418 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:19:32.418 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.051 ms 00:19:32.418 00:19:32.418 --- 10.0.0.2 ping statistics --- 00:19:32.418 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:19:32.418 rtt min/avg/max/mdev = 0.051/0.051/0.051/0.000 ms 00:19:32.418 11:30:27 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@227 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:19:32.418 11:30:27 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@459 -- # return 0 00:19:32.418 11:30:27 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@476 -- # '[' '' == iso ']' 00:19:32.418 11:30:27 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@480 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:19:32.418 11:30:27 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@481 -- # [[ tcp == \r\d\m\a ]] 00:19:32.418 11:30:27 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@490 -- # [[ tcp == \t\c\p ]] 00:19:32.418 11:30:27 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@491 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:19:32.418 11:30:27 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@494 -- # '[' tcp == tcp ']' 00:19:32.418 11:30:27 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@500 -- # modprobe nvme-tcp 00:19:32.418 11:30:27 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@64 -- # nvmfappstart -m 0x2 --wait-for-rpc 00:19:32.418 11:30:27 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@505 -- # timing_enter start_nvmf_tgt 00:19:32.418 11:30:27 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@724 -- # xtrace_disable 00:19:32.418 11:30:27 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@10 -- # set +x 00:19:32.418 11:30:27 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@507 -- # nvmfpid=83231 00:19:32.418 11:30:27 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@508 -- # waitforlisten 83231 00:19:32.418 11:30:27 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@506 -- # ip netns exec nvmf_tgt_ns_spdk /home/vagrant/spdk_repo/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x2 --wait-for-rpc 00:19:32.418 11:30:27 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@831 -- # '[' -z 83231 ']' 00:19:32.418 11:30:27 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@835 -- # local rpc_addr=/var/tmp/spdk.sock 00:19:32.418 11:30:27 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@836 -- # local max_retries=100 00:19:32.418 11:30:27 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@838 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:19:32.418 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:19:32.418 11:30:27 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@840 -- # xtrace_disable 00:19:32.418 11:30:27 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@10 -- # set +x 00:19:32.677 [2024-10-07 11:30:27.991744] Starting SPDK v25.01-pre git sha1 2a4f56c54 / DPDK 24.03.0 initialization... 00:19:32.677 [2024-10-07 11:30:27.991846] [ DPDK EAL parameters: nvmf -c 0x2 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --iova-mode=pa --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:19:32.677 [2024-10-07 11:30:28.140185] app.c: 917:spdk_app_start: *NOTICE*: Total cores available: 1 00:19:32.936 [2024-10-07 11:30:28.270097] app.c: 610:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:19:32.936 [2024-10-07 11:30:28.270150] app.c: 611:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:19:32.936 [2024-10-07 11:30:28.270164] app.c: 616:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:19:32.936 [2024-10-07 11:30:28.270174] app.c: 617:app_setup_trace: *NOTICE*: SPDK application currently running. 00:19:32.936 [2024-10-07 11:30:28.270184] app.c: 618:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:19:32.936 [2024-10-07 11:30:28.270696] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 1 00:19:33.893 11:30:29 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@860 -- # (( i == 0 )) 00:19:33.893 11:30:29 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@864 -- # return 0 00:19:33.893 11:30:29 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@509 -- # timing_exit start_nvmf_tgt 00:19:33.893 11:30:29 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@730 -- # xtrace_disable 00:19:33.893 11:30:29 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@10 -- # set +x 00:19:33.893 11:30:29 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@510 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:19:33.893 11:30:29 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@66 -- # '[' tcp '!=' tcp ']' 00:19:33.893 11:30:29 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@71 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py sock_set_default_impl -i ssl 00:19:34.159 true 00:19:34.159 11:30:29 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@74 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py sock_impl_get_options -i ssl 00:19:34.159 11:30:29 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@74 -- # jq -r .tls_version 00:19:34.417 11:30:29 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@74 -- # version=0 00:19:34.417 11:30:29 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@75 -- # [[ 0 != \0 ]] 00:19:34.417 11:30:29 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@81 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py sock_impl_set_options -i ssl --tls-version 13 00:19:34.675 11:30:30 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@82 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py sock_impl_get_options -i ssl 00:19:34.675 11:30:30 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@82 -- # jq -r .tls_version 00:19:34.933 11:30:30 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@82 -- # version=13 00:19:34.933 11:30:30 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@83 -- # [[ 13 != \1\3 ]] 00:19:34.933 11:30:30 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@89 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py sock_impl_set_options -i ssl --tls-version 7 00:19:35.191 11:30:30 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@90 -- # jq -r .tls_version 00:19:35.191 11:30:30 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@90 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py sock_impl_get_options -i ssl 00:19:35.449 11:30:30 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@90 -- # version=7 00:19:35.449 11:30:30 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@91 -- # [[ 7 != \7 ]] 00:19:35.449 11:30:30 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@97 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py sock_impl_get_options -i ssl 00:19:35.449 11:30:30 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@97 -- # jq -r .enable_ktls 00:19:36.016 11:30:31 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@97 -- # ktls=false 00:19:36.016 11:30:31 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@98 -- # [[ false != \f\a\l\s\e ]] 00:19:36.016 11:30:31 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@104 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py sock_impl_set_options -i ssl --enable-ktls 00:19:36.016 11:30:31 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@105 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py sock_impl_get_options -i ssl 00:19:36.275 11:30:31 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@105 -- # jq -r .enable_ktls 00:19:36.533 11:30:31 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@105 -- # ktls=true 00:19:36.533 11:30:31 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@106 -- # [[ true != \t\r\u\e ]] 00:19:36.533 11:30:31 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@112 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py sock_impl_set_options -i ssl --disable-ktls 00:19:36.791 11:30:32 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@113 -- # jq -r .enable_ktls 00:19:36.791 11:30:32 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@113 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py sock_impl_get_options -i ssl 00:19:37.048 11:30:32 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@113 -- # ktls=false 00:19:37.048 11:30:32 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@114 -- # [[ false != \f\a\l\s\e ]] 00:19:37.048 11:30:32 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@119 -- # format_interchange_psk 00112233445566778899aabbccddeeff 1 00:19:37.048 11:30:32 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@741 -- # format_key NVMeTLSkey-1 00112233445566778899aabbccddeeff 1 00:19:37.048 11:30:32 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@728 -- # local prefix key digest 00:19:37.048 11:30:32 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@730 -- # prefix=NVMeTLSkey-1 00:19:37.048 11:30:32 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@730 -- # key=00112233445566778899aabbccddeeff 00:19:37.048 11:30:32 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@730 -- # digest=1 00:19:37.048 11:30:32 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@731 -- # python - 00:19:37.048 11:30:32 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@119 -- # key=NVMeTLSkey-1:01:MDAxMTIyMzM0NDU1NjY3Nzg4OTlhYWJiY2NkZGVlZmZwJEiQ: 00:19:37.048 11:30:32 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@120 -- # format_interchange_psk ffeeddccbbaa99887766554433221100 1 00:19:37.048 11:30:32 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@741 -- # format_key NVMeTLSkey-1 ffeeddccbbaa99887766554433221100 1 00:19:37.048 11:30:32 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@728 -- # local prefix key digest 00:19:37.048 11:30:32 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@730 -- # prefix=NVMeTLSkey-1 00:19:37.048 11:30:32 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@730 -- # key=ffeeddccbbaa99887766554433221100 00:19:37.048 11:30:32 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@730 -- # digest=1 00:19:37.048 11:30:32 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@731 -- # python - 00:19:37.048 11:30:32 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@120 -- # key_2=NVMeTLSkey-1:01:ZmZlZWRkY2NiYmFhOTk4ODc3NjY1NTQ0MzMyMjExMDBfBm/Y: 00:19:37.048 11:30:32 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@122 -- # mktemp 00:19:37.048 11:30:32 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@122 -- # key_path=/tmp/tmp.EP1nh5Wxgc 00:19:37.048 11:30:32 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@123 -- # mktemp 00:19:37.048 11:30:32 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@123 -- # key_2_path=/tmp/tmp.SmudStwUKo 00:19:37.048 11:30:32 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@125 -- # echo -n NVMeTLSkey-1:01:MDAxMTIyMzM0NDU1NjY3Nzg4OTlhYWJiY2NkZGVlZmZwJEiQ: 00:19:37.048 11:30:32 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@126 -- # echo -n NVMeTLSkey-1:01:ZmZlZWRkY2NiYmFhOTk4ODc3NjY1NTQ0MzMyMjExMDBfBm/Y: 00:19:37.048 11:30:32 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@128 -- # chmod 0600 /tmp/tmp.EP1nh5Wxgc 00:19:37.048 11:30:32 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@129 -- # chmod 0600 /tmp/tmp.SmudStwUKo 00:19:37.048 11:30:32 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@131 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py sock_impl_set_options -i ssl --tls-version 13 00:19:37.305 11:30:32 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@132 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py framework_start_init 00:19:37.871 11:30:33 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@134 -- # setup_nvmf_tgt /tmp/tmp.EP1nh5Wxgc 00:19:37.871 11:30:33 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@50 -- # local key=/tmp/tmp.EP1nh5Wxgc 00:19:37.871 11:30:33 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@52 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_create_transport -t tcp -o 00:19:38.129 [2024-10-07 11:30:33.591049] tcp.c: 738:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:19:38.129 11:30:33 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@53 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDK00000000000001 -m 10 00:19:38.694 11:30:33 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@54 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.3 -s 4420 -k 00:19:38.952 [2024-10-07 11:30:34.247214] tcp.c:1031:nvmf_tcp_listen: *NOTICE*: TLS support is considered experimental 00:19:38.952 [2024-10-07 11:30:34.247551] tcp.c:1081:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.3 port 4420 *** 00:19:38.952 11:30:34 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@56 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py bdev_malloc_create 32 4096 -b malloc0 00:19:39.209 malloc0 00:19:39.209 11:30:34 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@57 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 malloc0 -n 1 00:19:39.469 11:30:34 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@58 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py keyring_file_add_key key0 /tmp/tmp.EP1nh5Wxgc 00:19:39.728 11:30:35 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@59 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_add_host nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 --psk key0 00:19:39.987 11:30:35 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@138 -- # ip netns exec nvmf_tgt_ns_spdk /home/vagrant/spdk_repo/spdk/build/bin/spdk_nvme_perf -S ssl -q 64 -o 4096 -w randrw -M 30 -t 10 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.3 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 hostnqn:nqn.2016-06.io.spdk:host1' --psk-path /tmp/tmp.EP1nh5Wxgc 00:19:52.199 Initializing NVMe Controllers 00:19:52.199 Attached to NVMe over Fabrics controller at 10.0.0.3:4420: nqn.2016-06.io.spdk:cnode1 00:19:52.199 Associating TCP (addr:10.0.0.3 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:19:52.199 Initialization complete. Launching workers. 00:19:52.199 ======================================================== 00:19:52.199 Latency(us) 00:19:52.199 Device Information : IOPS MiB/s Average min max 00:19:52.199 TCP (addr:10.0.0.3 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 9492.39 37.08 6743.76 1624.82 8183.92 00:19:52.199 ======================================================== 00:19:52.199 Total : 9492.39 37.08 6743.76 1624.82 8183.92 00:19:52.199 00:19:52.199 11:30:45 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@144 -- # run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 /tmp/tmp.EP1nh5Wxgc 00:19:52.199 11:30:45 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@22 -- # local subnqn hostnqn psk 00:19:52.199 11:30:45 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@23 -- # subnqn=nqn.2016-06.io.spdk:cnode1 00:19:52.199 11:30:45 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@23 -- # hostnqn=nqn.2016-06.io.spdk:host1 00:19:52.199 11:30:45 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@23 -- # psk=/tmp/tmp.EP1nh5Wxgc 00:19:52.199 11:30:45 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@25 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:19:52.199 11:30:45 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@28 -- # bdevperf_pid=83607 00:19:52.199 11:30:45 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@27 -- # /home/vagrant/spdk_repo/spdk/build/examples/bdevperf -m 0x4 -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 10 00:19:52.199 11:30:45 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@30 -- # trap 'cleanup; exit 1' SIGINT SIGTERM EXIT 00:19:52.199 11:30:45 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@31 -- # waitforlisten 83607 /var/tmp/bdevperf.sock 00:19:52.199 11:30:45 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@831 -- # '[' -z 83607 ']' 00:19:52.199 11:30:45 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@835 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:19:52.199 11:30:45 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@836 -- # local max_retries=100 00:19:52.199 11:30:45 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@838 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:19:52.199 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:19:52.199 11:30:45 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@840 -- # xtrace_disable 00:19:52.199 11:30:45 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@10 -- # set +x 00:19:52.199 [2024-10-07 11:30:45.647604] Starting SPDK v25.01-pre git sha1 2a4f56c54 / DPDK 24.03.0 initialization... 00:19:52.199 [2024-10-07 11:30:45.648117] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x4 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --iova-mode=pa --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid83607 ] 00:19:52.199 [2024-10-07 11:30:45.779830] app.c: 917:spdk_app_start: *NOTICE*: Total cores available: 1 00:19:52.199 [2024-10-07 11:30:45.937842] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 2 00:19:52.199 11:30:46 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@860 -- # (( i == 0 )) 00:19:52.199 11:30:46 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@864 -- # return 0 00:19:52.199 11:30:46 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@33 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock keyring_file_add_key key0 /tmp/tmp.EP1nh5Wxgc 00:19:52.199 11:30:46 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@35 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b TLSTEST -t tcp -a 10.0.0.3 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -q nqn.2016-06.io.spdk:host1 --psk key0 00:19:52.199 [2024-10-07 11:30:47.228178] bdev_nvme_rpc.c: 514:rpc_bdev_nvme_attach_controller: *NOTICE*: TLS support is considered experimental 00:19:52.199 TLSTESTn1 00:19:52.199 11:30:47 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@42 -- # /home/vagrant/spdk_repo/spdk/examples/bdev/bdevperf/bdevperf.py -t 20 -s /var/tmp/bdevperf.sock perform_tests 00:19:52.199 Running I/O for 10 seconds... 00:19:54.077 4224.00 IOPS, 16.50 MiB/s [2024-10-07T11:30:50.535Z] 4303.00 IOPS, 16.81 MiB/s [2024-10-07T11:30:51.470Z] 4269.67 IOPS, 16.68 MiB/s [2024-10-07T11:30:52.845Z] 4210.75 IOPS, 16.45 MiB/s [2024-10-07T11:30:53.779Z] 4160.60 IOPS, 16.25 MiB/s [2024-10-07T11:30:54.713Z] 4154.67 IOPS, 16.23 MiB/s [2024-10-07T11:30:55.649Z] 4149.00 IOPS, 16.21 MiB/s [2024-10-07T11:30:56.584Z] 4141.25 IOPS, 16.18 MiB/s [2024-10-07T11:30:57.517Z] 4116.11 IOPS, 16.08 MiB/s [2024-10-07T11:30:57.517Z] 4106.90 IOPS, 16.04 MiB/s 00:20:01.994 Latency(us) 00:20:01.994 [2024-10-07T11:30:57.517Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:20:01.994 Job: TLSTESTn1 (Core Mask 0x4, workload: verify, depth: 128, IO size: 4096) 00:20:01.994 Verification LBA range: start 0x0 length 0x2000 00:20:01.994 TLSTESTn1 : 10.02 4112.58 16.06 0.00 0.00 31067.71 6076.97 22997.18 00:20:01.994 [2024-10-07T11:30:57.517Z] =================================================================================================================== 00:20:01.994 [2024-10-07T11:30:57.517Z] Total : 4112.58 16.06 0.00 0.00 31067.71 6076.97 22997.18 00:20:01.994 { 00:20:01.994 "results": [ 00:20:01.994 { 00:20:01.994 "job": "TLSTESTn1", 00:20:01.994 "core_mask": "0x4", 00:20:01.994 "workload": "verify", 00:20:01.994 "status": "finished", 00:20:01.994 "verify_range": { 00:20:01.994 "start": 0, 00:20:01.994 "length": 8192 00:20:01.994 }, 00:20:01.994 "queue_depth": 128, 00:20:01.994 "io_size": 4096, 00:20:01.994 "runtime": 10.017067, 00:20:01.994 "iops": 4112.581057908467, 00:20:01.994 "mibps": 16.06476975745495, 00:20:01.994 "io_failed": 0, 00:20:01.994 "io_timeout": 0, 00:20:01.994 "avg_latency_us": 31067.70787772864, 00:20:01.994 "min_latency_us": 6076.9745454545455, 00:20:01.994 "max_latency_us": 22997.17818181818 00:20:01.994 } 00:20:01.994 ], 00:20:01.994 "core_count": 1 00:20:01.994 } 00:20:01.994 11:30:57 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@45 -- # trap 'nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:20:01.994 11:30:57 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@46 -- # killprocess 83607 00:20:01.994 11:30:57 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@950 -- # '[' -z 83607 ']' 00:20:01.994 11:30:57 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@954 -- # kill -0 83607 00:20:01.994 11:30:57 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@955 -- # uname 00:20:01.994 11:30:57 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@955 -- # '[' Linux = Linux ']' 00:20:01.994 11:30:57 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@956 -- # ps --no-headers -o comm= 83607 00:20:02.252 killing process with pid 83607 00:20:02.252 Received shutdown signal, test time was about 10.000000 seconds 00:20:02.252 00:20:02.252 Latency(us) 00:20:02.252 [2024-10-07T11:30:57.775Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:20:02.252 [2024-10-07T11:30:57.775Z] =================================================================================================================== 00:20:02.252 [2024-10-07T11:30:57.775Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:20:02.252 11:30:57 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@956 -- # process_name=reactor_2 00:20:02.252 11:30:57 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@960 -- # '[' reactor_2 = sudo ']' 00:20:02.252 11:30:57 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@968 -- # echo 'killing process with pid 83607' 00:20:02.252 11:30:57 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@969 -- # kill 83607 00:20:02.252 11:30:57 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@974 -- # wait 83607 00:20:02.510 11:30:57 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@147 -- # NOT run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 /tmp/tmp.SmudStwUKo 00:20:02.510 11:30:57 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@650 -- # local es=0 00:20:02.510 11:30:57 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@652 -- # valid_exec_arg run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 /tmp/tmp.SmudStwUKo 00:20:02.510 11:30:57 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@638 -- # local arg=run_bdevperf 00:20:02.510 11:30:57 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:20:02.510 11:30:57 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@642 -- # type -t run_bdevperf 00:20:02.510 11:30:57 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:20:02.510 11:30:57 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@653 -- # run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 /tmp/tmp.SmudStwUKo 00:20:02.510 11:30:57 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@22 -- # local subnqn hostnqn psk 00:20:02.510 11:30:57 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@23 -- # subnqn=nqn.2016-06.io.spdk:cnode1 00:20:02.510 11:30:57 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@23 -- # hostnqn=nqn.2016-06.io.spdk:host1 00:20:02.510 11:30:57 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@23 -- # psk=/tmp/tmp.SmudStwUKo 00:20:02.510 11:30:57 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@25 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:20:02.510 11:30:57 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@28 -- # bdevperf_pid=83766 00:20:02.510 11:30:57 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@27 -- # /home/vagrant/spdk_repo/spdk/build/examples/bdevperf -m 0x4 -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 10 00:20:02.510 11:30:57 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@30 -- # trap 'cleanup; exit 1' SIGINT SIGTERM EXIT 00:20:02.510 11:30:57 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@31 -- # waitforlisten 83766 /var/tmp/bdevperf.sock 00:20:02.510 11:30:57 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@831 -- # '[' -z 83766 ']' 00:20:02.510 11:30:57 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@835 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:20:02.510 11:30:57 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@836 -- # local max_retries=100 00:20:02.510 11:30:57 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@838 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:20:02.510 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:20:02.510 11:30:57 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@840 -- # xtrace_disable 00:20:02.510 11:30:57 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@10 -- # set +x 00:20:02.510 [2024-10-07 11:30:57.915165] Starting SPDK v25.01-pre git sha1 2a4f56c54 / DPDK 24.03.0 initialization... 00:20:02.510 [2024-10-07 11:30:57.915705] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x4 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --iova-mode=pa --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid83766 ] 00:20:02.779 [2024-10-07 11:30:58.049014] app.c: 917:spdk_app_start: *NOTICE*: Total cores available: 1 00:20:02.779 [2024-10-07 11:30:58.205212] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 2 00:20:03.724 11:30:58 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@860 -- # (( i == 0 )) 00:20:03.724 11:30:58 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@864 -- # return 0 00:20:03.724 11:30:58 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@33 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock keyring_file_add_key key0 /tmp/tmp.SmudStwUKo 00:20:03.981 11:30:59 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@35 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b TLSTEST -t tcp -a 10.0.0.3 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -q nqn.2016-06.io.spdk:host1 --psk key0 00:20:04.240 [2024-10-07 11:30:59.587496] bdev_nvme_rpc.c: 514:rpc_bdev_nvme_attach_controller: *NOTICE*: TLS support is considered experimental 00:20:04.240 [2024-10-07 11:30:59.597465] /home/vagrant/spdk_repo/spdk/include/spdk_internal/nvme_tcp.h: 421:nvme_tcp_read_data: *ERROR*: spdk_sock_recv() failed, errno 107: Transport endpoint is not connected 00:20:04.240 [2024-10-07 11:30:59.598154] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1bfdb80 (107): Transport endpoint is not connected 00:20:04.240 [2024-10-07 11:30:59.599126] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1bfdb80 (9): Bad file descriptor 00:20:04.240 [2024-10-07 11:30:59.600123] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:20:04.240 [2024-10-07 11:30:59.600165] nvme.c: 708:nvme_ctrlr_poll_internal: *ERROR*: Failed to initialize SSD: 10.0.0.3 00:20:04.240 [2024-10-07 11:30:59.600189] nvme.c: 884:nvme_dummy_attach_fail_cb: *ERROR*: Failed to attach nvme ctrlr: trtype=TCP adrfam=IPv4 traddr=10.0.0.3 trsvcid=4420 subnqn=nqn.2016-06.io.spdk:cnode1, Operation not permitted 00:20:04.240 [2024-10-07 11:30:59.600213] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:20:04.240 2024/10/07 11:30:59 error on JSON-RPC call, method: bdev_nvme_attach_controller, params: map[adrfam:ipv4 allow_unrecognized_csi:%!s(bool=false) ddgst:%!s(bool=false) hdgst:%!s(bool=false) hostnqn:nqn.2016-06.io.spdk:host1 name:TLSTEST prchk_guard:%!s(bool=false) prchk_reftag:%!s(bool=false) psk:key0 subnqn:nqn.2016-06.io.spdk:cnode1 traddr:10.0.0.3 trsvcid:4420 trtype:tcp], err: error received for bdev_nvme_attach_controller method, err: Code=-5 Msg=Input/output error 00:20:04.240 request: 00:20:04.240 { 00:20:04.240 "method": "bdev_nvme_attach_controller", 00:20:04.240 "params": { 00:20:04.240 "name": "TLSTEST", 00:20:04.240 "trtype": "tcp", 00:20:04.240 "traddr": "10.0.0.3", 00:20:04.240 "adrfam": "ipv4", 00:20:04.240 "trsvcid": "4420", 00:20:04.240 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:20:04.240 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:20:04.240 "prchk_reftag": false, 00:20:04.240 "prchk_guard": false, 00:20:04.240 "hdgst": false, 00:20:04.240 "ddgst": false, 00:20:04.240 "psk": "key0", 00:20:04.240 "allow_unrecognized_csi": false 00:20:04.240 } 00:20:04.240 } 00:20:04.240 Got JSON-RPC error response 00:20:04.240 GoRPCClient: error on JSON-RPC call 00:20:04.240 11:30:59 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@37 -- # killprocess 83766 00:20:04.240 11:30:59 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@950 -- # '[' -z 83766 ']' 00:20:04.240 11:30:59 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@954 -- # kill -0 83766 00:20:04.240 11:30:59 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@955 -- # uname 00:20:04.240 11:30:59 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@955 -- # '[' Linux = Linux ']' 00:20:04.240 11:30:59 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@956 -- # ps --no-headers -o comm= 83766 00:20:04.240 killing process with pid 83766 00:20:04.240 Received shutdown signal, test time was about 10.000000 seconds 00:20:04.240 00:20:04.240 Latency(us) 00:20:04.240 [2024-10-07T11:30:59.763Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:20:04.240 [2024-10-07T11:30:59.763Z] =================================================================================================================== 00:20:04.240 [2024-10-07T11:30:59.763Z] Total : 0.00 0.00 0.00 0.00 0.00 18446744073709551616.00 0.00 00:20:04.240 11:30:59 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@956 -- # process_name=reactor_2 00:20:04.240 11:30:59 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@960 -- # '[' reactor_2 = sudo ']' 00:20:04.240 11:30:59 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@968 -- # echo 'killing process with pid 83766' 00:20:04.240 11:30:59 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@969 -- # kill 83766 00:20:04.240 11:30:59 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@974 -- # wait 83766 00:20:04.499 11:30:59 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@38 -- # return 1 00:20:04.499 11:30:59 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@653 -- # es=1 00:20:04.499 11:30:59 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:20:04.499 11:30:59 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:20:04.499 11:30:59 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:20:04.499 11:30:59 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@150 -- # NOT run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host2 /tmp/tmp.EP1nh5Wxgc 00:20:04.499 11:30:59 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@650 -- # local es=0 00:20:04.499 11:30:59 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@652 -- # valid_exec_arg run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host2 /tmp/tmp.EP1nh5Wxgc 00:20:04.499 11:30:59 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@638 -- # local arg=run_bdevperf 00:20:04.499 11:30:59 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:20:04.499 11:30:59 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@642 -- # type -t run_bdevperf 00:20:04.499 11:30:59 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:20:04.499 11:30:59 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@653 -- # run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host2 /tmp/tmp.EP1nh5Wxgc 00:20:04.499 11:30:59 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@22 -- # local subnqn hostnqn psk 00:20:04.499 11:30:59 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@23 -- # subnqn=nqn.2016-06.io.spdk:cnode1 00:20:04.499 11:30:59 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@23 -- # hostnqn=nqn.2016-06.io.spdk:host2 00:20:04.499 11:30:59 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@23 -- # psk=/tmp/tmp.EP1nh5Wxgc 00:20:04.499 11:30:59 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@25 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:20:04.499 11:30:59 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@28 -- # bdevperf_pid=83825 00:20:04.499 11:30:59 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@27 -- # /home/vagrant/spdk_repo/spdk/build/examples/bdevperf -m 0x4 -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 10 00:20:04.499 11:30:59 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@30 -- # trap 'cleanup; exit 1' SIGINT SIGTERM EXIT 00:20:04.499 11:30:59 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@31 -- # waitforlisten 83825 /var/tmp/bdevperf.sock 00:20:04.499 11:30:59 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@831 -- # '[' -z 83825 ']' 00:20:04.499 11:30:59 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@835 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:20:04.499 11:30:59 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@836 -- # local max_retries=100 00:20:04.499 11:30:59 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@838 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:20:04.499 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:20:04.499 11:30:59 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@840 -- # xtrace_disable 00:20:04.499 11:30:59 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@10 -- # set +x 00:20:04.757 [2024-10-07 11:31:00.041146] Starting SPDK v25.01-pre git sha1 2a4f56c54 / DPDK 24.03.0 initialization... 00:20:04.757 [2024-10-07 11:31:00.041274] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x4 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --iova-mode=pa --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid83825 ] 00:20:04.757 [2024-10-07 11:31:00.176472] app.c: 917:spdk_app_start: *NOTICE*: Total cores available: 1 00:20:05.016 [2024-10-07 11:31:00.332665] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 2 00:20:05.950 11:31:01 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@860 -- # (( i == 0 )) 00:20:05.950 11:31:01 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@864 -- # return 0 00:20:05.950 11:31:01 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@33 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock keyring_file_add_key key0 /tmp/tmp.EP1nh5Wxgc 00:20:05.950 11:31:01 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@35 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b TLSTEST -t tcp -a 10.0.0.3 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -q nqn.2016-06.io.spdk:host2 --psk key0 00:20:06.208 [2024-10-07 11:31:01.702340] bdev_nvme_rpc.c: 514:rpc_bdev_nvme_attach_controller: *NOTICE*: TLS support is considered experimental 00:20:06.208 [2024-10-07 11:31:01.707646] tcp.c: 969:tcp_sock_get_key: *ERROR*: Could not find PSK for identity: NVMe0R01 nqn.2016-06.io.spdk:host2 nqn.2016-06.io.spdk:cnode1 00:20:06.208 [2024-10-07 11:31:01.707733] posix.c: 574:posix_sock_psk_find_session_server_cb: *ERROR*: Unable to find PSK for identity: NVMe0R01 nqn.2016-06.io.spdk:host2 nqn.2016-06.io.spdk:cnode1 00:20:06.208 [2024-10-07 11:31:01.707798] /home/vagrant/spdk_repo/spdk/include/spdk_internal/nvme_tcp.h: 421:nvme_tcp_read_data: *ERROR*: spdk_sock_recv() failed, errno 107: Transport endpoint is not connected 00:20:06.208 [2024-10-07 11:31:01.708330] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1f43b80 (107): Transport endpoint is not connected 00:20:06.208 [2024-10-07 11:31:01.709314] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1f43b80 (9): Bad file descriptor 00:20:06.208 [2024-10-07 11:31:01.710310] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:20:06.208 [2024-10-07 11:31:01.710351] nvme.c: 708:nvme_ctrlr_poll_internal: *ERROR*: Failed to initialize SSD: 10.0.0.3 00:20:06.208 [2024-10-07 11:31:01.710379] nvme.c: 884:nvme_dummy_attach_fail_cb: *ERROR*: Failed to attach nvme ctrlr: trtype=TCP adrfam=IPv4 traddr=10.0.0.3 trsvcid=4420 subnqn=nqn.2016-06.io.spdk:cnode1, Operation not permitted 00:20:06.208 [2024-10-07 11:31:01.710390] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:20:06.208 2024/10/07 11:31:01 error on JSON-RPC call, method: bdev_nvme_attach_controller, params: map[adrfam:ipv4 allow_unrecognized_csi:%!s(bool=false) ddgst:%!s(bool=false) hdgst:%!s(bool=false) hostnqn:nqn.2016-06.io.spdk:host2 name:TLSTEST prchk_guard:%!s(bool=false) prchk_reftag:%!s(bool=false) psk:key0 subnqn:nqn.2016-06.io.spdk:cnode1 traddr:10.0.0.3 trsvcid:4420 trtype:tcp], err: error received for bdev_nvme_attach_controller method, err: Code=-5 Msg=Input/output error 00:20:06.208 request: 00:20:06.208 { 00:20:06.208 "method": "bdev_nvme_attach_controller", 00:20:06.208 "params": { 00:20:06.208 "name": "TLSTEST", 00:20:06.208 "trtype": "tcp", 00:20:06.208 "traddr": "10.0.0.3", 00:20:06.208 "adrfam": "ipv4", 00:20:06.208 "trsvcid": "4420", 00:20:06.208 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:20:06.208 "hostnqn": "nqn.2016-06.io.spdk:host2", 00:20:06.208 "prchk_reftag": false, 00:20:06.208 "prchk_guard": false, 00:20:06.208 "hdgst": false, 00:20:06.208 "ddgst": false, 00:20:06.208 "psk": "key0", 00:20:06.208 "allow_unrecognized_csi": false 00:20:06.208 } 00:20:06.208 } 00:20:06.208 Got JSON-RPC error response 00:20:06.208 GoRPCClient: error on JSON-RPC call 00:20:06.466 11:31:01 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@37 -- # killprocess 83825 00:20:06.466 11:31:01 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@950 -- # '[' -z 83825 ']' 00:20:06.466 11:31:01 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@954 -- # kill -0 83825 00:20:06.466 11:31:01 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@955 -- # uname 00:20:06.466 11:31:01 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@955 -- # '[' Linux = Linux ']' 00:20:06.466 11:31:01 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@956 -- # ps --no-headers -o comm= 83825 00:20:06.466 killing process with pid 83825 00:20:06.466 Received shutdown signal, test time was about 10.000000 seconds 00:20:06.466 00:20:06.466 Latency(us) 00:20:06.466 [2024-10-07T11:31:01.989Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:20:06.466 [2024-10-07T11:31:01.989Z] =================================================================================================================== 00:20:06.466 [2024-10-07T11:31:01.989Z] Total : 0.00 0.00 0.00 0.00 0.00 18446744073709551616.00 0.00 00:20:06.466 11:31:01 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@956 -- # process_name=reactor_2 00:20:06.466 11:31:01 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@960 -- # '[' reactor_2 = sudo ']' 00:20:06.466 11:31:01 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@968 -- # echo 'killing process with pid 83825' 00:20:06.466 11:31:01 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@969 -- # kill 83825 00:20:06.466 11:31:01 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@974 -- # wait 83825 00:20:06.727 11:31:02 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@38 -- # return 1 00:20:06.727 11:31:02 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@653 -- # es=1 00:20:06.727 11:31:02 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:20:06.727 11:31:02 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:20:06.727 11:31:02 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:20:06.727 11:31:02 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@153 -- # NOT run_bdevperf nqn.2016-06.io.spdk:cnode2 nqn.2016-06.io.spdk:host1 /tmp/tmp.EP1nh5Wxgc 00:20:06.727 11:31:02 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@650 -- # local es=0 00:20:06.727 11:31:02 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@652 -- # valid_exec_arg run_bdevperf nqn.2016-06.io.spdk:cnode2 nqn.2016-06.io.spdk:host1 /tmp/tmp.EP1nh5Wxgc 00:20:06.727 11:31:02 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@638 -- # local arg=run_bdevperf 00:20:06.727 11:31:02 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:20:06.727 11:31:02 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@642 -- # type -t run_bdevperf 00:20:06.727 11:31:02 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:20:06.727 11:31:02 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@653 -- # run_bdevperf nqn.2016-06.io.spdk:cnode2 nqn.2016-06.io.spdk:host1 /tmp/tmp.EP1nh5Wxgc 00:20:06.727 11:31:02 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@22 -- # local subnqn hostnqn psk 00:20:06.727 11:31:02 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@23 -- # subnqn=nqn.2016-06.io.spdk:cnode2 00:20:06.727 11:31:02 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@23 -- # hostnqn=nqn.2016-06.io.spdk:host1 00:20:06.727 11:31:02 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@23 -- # psk=/tmp/tmp.EP1nh5Wxgc 00:20:06.727 11:31:02 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@25 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:20:06.727 11:31:02 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@28 -- # bdevperf_pid=83883 00:20:06.727 11:31:02 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@27 -- # /home/vagrant/spdk_repo/spdk/build/examples/bdevperf -m 0x4 -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 10 00:20:06.727 11:31:02 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@30 -- # trap 'cleanup; exit 1' SIGINT SIGTERM EXIT 00:20:06.727 11:31:02 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@31 -- # waitforlisten 83883 /var/tmp/bdevperf.sock 00:20:06.727 11:31:02 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@831 -- # '[' -z 83883 ']' 00:20:06.727 11:31:02 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@835 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:20:06.727 11:31:02 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@836 -- # local max_retries=100 00:20:06.727 11:31:02 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@838 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:20:06.727 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:20:06.727 11:31:02 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@840 -- # xtrace_disable 00:20:06.727 11:31:02 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@10 -- # set +x 00:20:06.727 [2024-10-07 11:31:02.149097] Starting SPDK v25.01-pre git sha1 2a4f56c54 / DPDK 24.03.0 initialization... 00:20:06.727 [2024-10-07 11:31:02.149224] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x4 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --iova-mode=pa --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid83883 ] 00:20:06.992 [2024-10-07 11:31:02.285616] app.c: 917:spdk_app_start: *NOTICE*: Total cores available: 1 00:20:06.992 [2024-10-07 11:31:02.434472] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 2 00:20:07.927 11:31:03 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@860 -- # (( i == 0 )) 00:20:07.927 11:31:03 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@864 -- # return 0 00:20:07.927 11:31:03 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@33 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock keyring_file_add_key key0 /tmp/tmp.EP1nh5Wxgc 00:20:08.186 11:31:03 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@35 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b TLSTEST -t tcp -a 10.0.0.3 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode2 -q nqn.2016-06.io.spdk:host1 --psk key0 00:20:08.445 [2024-10-07 11:31:03.808316] bdev_nvme_rpc.c: 514:rpc_bdev_nvme_attach_controller: *NOTICE*: TLS support is considered experimental 00:20:08.445 [2024-10-07 11:31:03.817737] tcp.c: 969:tcp_sock_get_key: *ERROR*: Could not find PSK for identity: NVMe0R01 nqn.2016-06.io.spdk:host1 nqn.2016-06.io.spdk:cnode2 00:20:08.445 [2024-10-07 11:31:03.817793] posix.c: 574:posix_sock_psk_find_session_server_cb: *ERROR*: Unable to find PSK for identity: NVMe0R01 nqn.2016-06.io.spdk:host1 nqn.2016-06.io.spdk:cnode2 00:20:08.445 [2024-10-07 11:31:03.817847] /home/vagrant/spdk_repo/spdk/include/spdk_internal/nvme_tcp.h: 421:nvme_tcp_read_data: *ERROR*: spdk_sock_recv() failed, errno 107: Transport endpoint is not connected 00:20:08.445 [2024-10-07 11:31:03.818401] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xae0b80 (107): Transport endpoint is not connected 00:20:08.445 [2024-10-07 11:31:03.819392] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xae0b80 (9): Bad file descriptor 00:20:08.445 [2024-10-07 11:31:03.820388] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode2] Ctrlr is in error state 00:20:08.445 [2024-10-07 11:31:03.820413] nvme.c: 708:nvme_ctrlr_poll_internal: *ERROR*: Failed to initialize SSD: 10.0.0.3 00:20:08.445 [2024-10-07 11:31:03.820425] nvme.c: 884:nvme_dummy_attach_fail_cb: *ERROR*: Failed to attach nvme ctrlr: trtype=TCP adrfam=IPv4 traddr=10.0.0.3 trsvcid=4420 subnqn=nqn.2016-06.io.spdk:cnode2, Operation not permitted 00:20:08.445 [2024-10-07 11:31:03.820436] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode2] in failed state. 00:20:08.445 2024/10/07 11:31:03 error on JSON-RPC call, method: bdev_nvme_attach_controller, params: map[adrfam:ipv4 allow_unrecognized_csi:%!s(bool=false) ddgst:%!s(bool=false) hdgst:%!s(bool=false) hostnqn:nqn.2016-06.io.spdk:host1 name:TLSTEST prchk_guard:%!s(bool=false) prchk_reftag:%!s(bool=false) psk:key0 subnqn:nqn.2016-06.io.spdk:cnode2 traddr:10.0.0.3 trsvcid:4420 trtype:tcp], err: error received for bdev_nvme_attach_controller method, err: Code=-5 Msg=Input/output error 00:20:08.445 request: 00:20:08.445 { 00:20:08.445 "method": "bdev_nvme_attach_controller", 00:20:08.445 "params": { 00:20:08.445 "name": "TLSTEST", 00:20:08.445 "trtype": "tcp", 00:20:08.445 "traddr": "10.0.0.3", 00:20:08.445 "adrfam": "ipv4", 00:20:08.445 "trsvcid": "4420", 00:20:08.445 "subnqn": "nqn.2016-06.io.spdk:cnode2", 00:20:08.445 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:20:08.445 "prchk_reftag": false, 00:20:08.445 "prchk_guard": false, 00:20:08.445 "hdgst": false, 00:20:08.445 "ddgst": false, 00:20:08.445 "psk": "key0", 00:20:08.445 "allow_unrecognized_csi": false 00:20:08.445 } 00:20:08.445 } 00:20:08.445 Got JSON-RPC error response 00:20:08.445 GoRPCClient: error on JSON-RPC call 00:20:08.445 11:31:03 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@37 -- # killprocess 83883 00:20:08.445 11:31:03 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@950 -- # '[' -z 83883 ']' 00:20:08.445 11:31:03 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@954 -- # kill -0 83883 00:20:08.445 11:31:03 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@955 -- # uname 00:20:08.445 11:31:03 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@955 -- # '[' Linux = Linux ']' 00:20:08.445 11:31:03 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@956 -- # ps --no-headers -o comm= 83883 00:20:08.445 11:31:03 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@956 -- # process_name=reactor_2 00:20:08.445 11:31:03 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@960 -- # '[' reactor_2 = sudo ']' 00:20:08.445 11:31:03 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@968 -- # echo 'killing process with pid 83883' 00:20:08.445 killing process with pid 83883 00:20:08.445 Received shutdown signal, test time was about 10.000000 seconds 00:20:08.445 00:20:08.445 Latency(us) 00:20:08.445 [2024-10-07T11:31:03.968Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:20:08.445 [2024-10-07T11:31:03.968Z] =================================================================================================================== 00:20:08.445 [2024-10-07T11:31:03.968Z] Total : 0.00 0.00 0.00 0.00 0.00 18446744073709551616.00 0.00 00:20:08.445 11:31:03 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@969 -- # kill 83883 00:20:08.445 11:31:03 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@974 -- # wait 83883 00:20:08.704 11:31:04 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@38 -- # return 1 00:20:08.704 11:31:04 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@653 -- # es=1 00:20:08.704 11:31:04 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:20:08.704 11:31:04 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:20:08.704 11:31:04 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:20:08.704 11:31:04 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@156 -- # NOT run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 '' 00:20:08.704 11:31:04 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@650 -- # local es=0 00:20:08.704 11:31:04 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@652 -- # valid_exec_arg run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 '' 00:20:08.704 11:31:04 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@638 -- # local arg=run_bdevperf 00:20:08.704 11:31:04 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:20:08.704 11:31:04 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@642 -- # type -t run_bdevperf 00:20:08.704 11:31:04 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:20:08.704 11:31:04 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@653 -- # run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 '' 00:20:08.704 11:31:04 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@22 -- # local subnqn hostnqn psk 00:20:08.704 11:31:04 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@23 -- # subnqn=nqn.2016-06.io.spdk:cnode1 00:20:08.704 11:31:04 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@23 -- # hostnqn=nqn.2016-06.io.spdk:host1 00:20:08.704 11:31:04 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@23 -- # psk= 00:20:08.704 11:31:04 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@25 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:20:08.962 11:31:04 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@28 -- # bdevperf_pid=83942 00:20:08.962 11:31:04 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@27 -- # /home/vagrant/spdk_repo/spdk/build/examples/bdevperf -m 0x4 -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 10 00:20:08.962 11:31:04 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@30 -- # trap 'cleanup; exit 1' SIGINT SIGTERM EXIT 00:20:08.962 11:31:04 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@31 -- # waitforlisten 83942 /var/tmp/bdevperf.sock 00:20:08.962 11:31:04 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@831 -- # '[' -z 83942 ']' 00:20:08.962 11:31:04 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@835 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:20:08.962 11:31:04 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@836 -- # local max_retries=100 00:20:08.962 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:20:08.962 11:31:04 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@838 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:20:08.962 11:31:04 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@840 -- # xtrace_disable 00:20:08.962 11:31:04 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@10 -- # set +x 00:20:08.962 [2024-10-07 11:31:04.293001] Starting SPDK v25.01-pre git sha1 2a4f56c54 / DPDK 24.03.0 initialization... 00:20:08.962 [2024-10-07 11:31:04.293723] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x4 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --iova-mode=pa --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid83942 ] 00:20:08.962 [2024-10-07 11:31:04.434757] app.c: 917:spdk_app_start: *NOTICE*: Total cores available: 1 00:20:09.219 [2024-10-07 11:31:04.571427] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 2 00:20:09.784 11:31:05 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@860 -- # (( i == 0 )) 00:20:09.784 11:31:05 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@864 -- # return 0 00:20:09.784 11:31:05 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@33 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock keyring_file_add_key key0 '' 00:20:10.042 [2024-10-07 11:31:05.555907] keyring.c: 24:keyring_file_check_path: *ERROR*: Non-absolute paths are not allowed: 00:20:10.042 [2024-10-07 11:31:05.555959] keyring.c: 126:spdk_keyring_add_key: *ERROR*: Failed to add key 'key0' to the keyring 00:20:10.042 2024/10/07 11:31:05 error on JSON-RPC call, method: keyring_file_add_key, params: map[name:key0 path:], err: error received for keyring_file_add_key method, err: Code=-1 Msg=Operation not permitted 00:20:10.042 request: 00:20:10.042 { 00:20:10.042 "method": "keyring_file_add_key", 00:20:10.042 "params": { 00:20:10.042 "name": "key0", 00:20:10.042 "path": "" 00:20:10.042 } 00:20:10.042 } 00:20:10.042 Got JSON-RPC error response 00:20:10.042 GoRPCClient: error on JSON-RPC call 00:20:10.301 11:31:05 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@35 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b TLSTEST -t tcp -a 10.0.0.3 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -q nqn.2016-06.io.spdk:host1 --psk key0 00:20:10.561 [2024-10-07 11:31:05.844102] bdev_nvme_rpc.c: 514:rpc_bdev_nvme_attach_controller: *NOTICE*: TLS support is considered experimental 00:20:10.561 [2024-10-07 11:31:05.844181] bdev_nvme.c:6391:spdk_bdev_nvme_create: *ERROR*: Could not load PSK: key0 00:20:10.561 2024/10/07 11:31:05 error on JSON-RPC call, method: bdev_nvme_attach_controller, params: map[adrfam:ipv4 allow_unrecognized_csi:%!s(bool=false) ddgst:%!s(bool=false) hdgst:%!s(bool=false) hostnqn:nqn.2016-06.io.spdk:host1 name:TLSTEST prchk_guard:%!s(bool=false) prchk_reftag:%!s(bool=false) psk:key0 subnqn:nqn.2016-06.io.spdk:cnode1 traddr:10.0.0.3 trsvcid:4420 trtype:tcp], err: error received for bdev_nvme_attach_controller method, err: Code=-126 Msg=Required key not available 00:20:10.561 request: 00:20:10.561 { 00:20:10.561 "method": "bdev_nvme_attach_controller", 00:20:10.561 "params": { 00:20:10.561 "name": "TLSTEST", 00:20:10.561 "trtype": "tcp", 00:20:10.561 "traddr": "10.0.0.3", 00:20:10.561 "adrfam": "ipv4", 00:20:10.561 "trsvcid": "4420", 00:20:10.561 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:20:10.561 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:20:10.561 "prchk_reftag": false, 00:20:10.561 "prchk_guard": false, 00:20:10.561 "hdgst": false, 00:20:10.561 "ddgst": false, 00:20:10.561 "psk": "key0", 00:20:10.561 "allow_unrecognized_csi": false 00:20:10.561 } 00:20:10.561 } 00:20:10.561 Got JSON-RPC error response 00:20:10.561 GoRPCClient: error on JSON-RPC call 00:20:10.561 11:31:05 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@37 -- # killprocess 83942 00:20:10.561 11:31:05 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@950 -- # '[' -z 83942 ']' 00:20:10.561 11:31:05 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@954 -- # kill -0 83942 00:20:10.561 11:31:05 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@955 -- # uname 00:20:10.561 11:31:05 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@955 -- # '[' Linux = Linux ']' 00:20:10.561 11:31:05 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@956 -- # ps --no-headers -o comm= 83942 00:20:10.561 11:31:05 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@956 -- # process_name=reactor_2 00:20:10.561 11:31:05 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@960 -- # '[' reactor_2 = sudo ']' 00:20:10.561 killing process with pid 83942 00:20:10.561 11:31:05 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@968 -- # echo 'killing process with pid 83942' 00:20:10.561 11:31:05 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@969 -- # kill 83942 00:20:10.561 Received shutdown signal, test time was about 10.000000 seconds 00:20:10.561 00:20:10.561 Latency(us) 00:20:10.561 [2024-10-07T11:31:06.084Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:20:10.561 [2024-10-07T11:31:06.084Z] =================================================================================================================== 00:20:10.561 [2024-10-07T11:31:06.084Z] Total : 0.00 0.00 0.00 0.00 0.00 18446744073709551616.00 0.00 00:20:10.561 11:31:05 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@974 -- # wait 83942 00:20:10.821 11:31:06 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@38 -- # return 1 00:20:10.821 11:31:06 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@653 -- # es=1 00:20:10.821 11:31:06 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:20:10.821 11:31:06 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:20:10.821 11:31:06 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:20:10.821 11:31:06 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@159 -- # killprocess 83231 00:20:10.821 11:31:06 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@950 -- # '[' -z 83231 ']' 00:20:10.821 11:31:06 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@954 -- # kill -0 83231 00:20:10.821 11:31:06 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@955 -- # uname 00:20:10.821 11:31:06 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@955 -- # '[' Linux = Linux ']' 00:20:10.821 11:31:06 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@956 -- # ps --no-headers -o comm= 83231 00:20:10.821 11:31:06 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@956 -- # process_name=reactor_1 00:20:10.821 11:31:06 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@960 -- # '[' reactor_1 = sudo ']' 00:20:10.821 killing process with pid 83231 00:20:10.821 11:31:06 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@968 -- # echo 'killing process with pid 83231' 00:20:10.821 11:31:06 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@969 -- # kill 83231 00:20:10.821 11:31:06 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@974 -- # wait 83231 00:20:11.389 11:31:06 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@160 -- # format_interchange_psk 00112233445566778899aabbccddeeff0011223344556677 2 00:20:11.389 11:31:06 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@741 -- # format_key NVMeTLSkey-1 00112233445566778899aabbccddeeff0011223344556677 2 00:20:11.389 11:31:06 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@728 -- # local prefix key digest 00:20:11.389 11:31:06 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@730 -- # prefix=NVMeTLSkey-1 00:20:11.389 11:31:06 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@730 -- # key=00112233445566778899aabbccddeeff0011223344556677 00:20:11.389 11:31:06 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@730 -- # digest=2 00:20:11.389 11:31:06 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@731 -- # python - 00:20:11.389 11:31:06 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@160 -- # key_long=NVMeTLSkey-1:02:MDAxMTIyMzM0NDU1NjY3Nzg4OTlhYWJiY2NkZGVlZmYwMDExMjIzMzQ0NTU2Njc3wWXNJw==: 00:20:11.389 11:31:06 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@161 -- # mktemp 00:20:11.389 11:31:06 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@161 -- # key_long_path=/tmp/tmp.ca2SZhyGHH 00:20:11.389 11:31:06 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@162 -- # echo -n NVMeTLSkey-1:02:MDAxMTIyMzM0NDU1NjY3Nzg4OTlhYWJiY2NkZGVlZmYwMDExMjIzMzQ0NTU2Njc3wWXNJw==: 00:20:11.389 11:31:06 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@163 -- # chmod 0600 /tmp/tmp.ca2SZhyGHH 00:20:11.389 11:31:06 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@164 -- # nvmfappstart -m 0x2 00:20:11.389 11:31:06 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@505 -- # timing_enter start_nvmf_tgt 00:20:11.389 11:31:06 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@724 -- # xtrace_disable 00:20:11.389 11:31:06 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@10 -- # set +x 00:20:11.389 11:31:06 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@507 -- # nvmfpid=84016 00:20:11.389 11:31:06 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@506 -- # ip netns exec nvmf_tgt_ns_spdk /home/vagrant/spdk_repo/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x2 00:20:11.389 11:31:06 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@508 -- # waitforlisten 84016 00:20:11.389 11:31:06 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@831 -- # '[' -z 84016 ']' 00:20:11.389 11:31:06 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@835 -- # local rpc_addr=/var/tmp/spdk.sock 00:20:11.389 11:31:06 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@836 -- # local max_retries=100 00:20:11.389 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:20:11.389 11:31:06 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@838 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:20:11.389 11:31:06 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@840 -- # xtrace_disable 00:20:11.389 11:31:06 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@10 -- # set +x 00:20:11.389 [2024-10-07 11:31:06.783452] Starting SPDK v25.01-pre git sha1 2a4f56c54 / DPDK 24.03.0 initialization... 00:20:11.389 [2024-10-07 11:31:06.783583] [ DPDK EAL parameters: nvmf -c 0x2 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --iova-mode=pa --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:20:11.648 [2024-10-07 11:31:06.923632] app.c: 917:spdk_app_start: *NOTICE*: Total cores available: 1 00:20:11.648 [2024-10-07 11:31:07.059593] app.c: 610:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:20:11.648 [2024-10-07 11:31:07.059690] app.c: 611:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:20:11.648 [2024-10-07 11:31:07.059704] app.c: 616:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:20:11.648 [2024-10-07 11:31:07.059713] app.c: 617:app_setup_trace: *NOTICE*: SPDK application currently running. 00:20:11.648 [2024-10-07 11:31:07.059721] app.c: 618:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:20:11.648 [2024-10-07 11:31:07.060246] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 1 00:20:12.583 11:31:07 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@860 -- # (( i == 0 )) 00:20:12.583 11:31:07 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@864 -- # return 0 00:20:12.583 11:31:07 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@509 -- # timing_exit start_nvmf_tgt 00:20:12.583 11:31:07 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@730 -- # xtrace_disable 00:20:12.583 11:31:07 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@10 -- # set +x 00:20:12.583 11:31:07 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@510 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:20:12.583 11:31:07 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@166 -- # setup_nvmf_tgt /tmp/tmp.ca2SZhyGHH 00:20:12.583 11:31:07 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@50 -- # local key=/tmp/tmp.ca2SZhyGHH 00:20:12.583 11:31:07 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@52 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_create_transport -t tcp -o 00:20:12.841 [2024-10-07 11:31:08.167485] tcp.c: 738:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:20:12.841 11:31:08 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@53 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDK00000000000001 -m 10 00:20:13.098 11:31:08 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@54 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.3 -s 4420 -k 00:20:13.356 [2024-10-07 11:31:08.751634] tcp.c:1031:nvmf_tcp_listen: *NOTICE*: TLS support is considered experimental 00:20:13.356 [2024-10-07 11:31:08.751925] tcp.c:1081:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.3 port 4420 *** 00:20:13.356 11:31:08 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@56 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py bdev_malloc_create 32 4096 -b malloc0 00:20:13.613 malloc0 00:20:13.613 11:31:09 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@57 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 malloc0 -n 1 00:20:13.871 11:31:09 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@58 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py keyring_file_add_key key0 /tmp/tmp.ca2SZhyGHH 00:20:14.128 11:31:09 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@59 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_add_host nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 --psk key0 00:20:14.693 11:31:09 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@168 -- # run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 /tmp/tmp.ca2SZhyGHH 00:20:14.693 11:31:09 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@22 -- # local subnqn hostnqn psk 00:20:14.693 11:31:09 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@23 -- # subnqn=nqn.2016-06.io.spdk:cnode1 00:20:14.693 11:31:09 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@23 -- # hostnqn=nqn.2016-06.io.spdk:host1 00:20:14.693 11:31:09 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@23 -- # psk=/tmp/tmp.ca2SZhyGHH 00:20:14.693 11:31:09 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@25 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:20:14.693 11:31:09 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@28 -- # bdevperf_pid=84135 00:20:14.693 11:31:09 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@27 -- # /home/vagrant/spdk_repo/spdk/build/examples/bdevperf -m 0x4 -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 10 00:20:14.693 11:31:09 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@30 -- # trap 'cleanup; exit 1' SIGINT SIGTERM EXIT 00:20:14.693 11:31:09 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@31 -- # waitforlisten 84135 /var/tmp/bdevperf.sock 00:20:14.693 11:31:09 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@831 -- # '[' -z 84135 ']' 00:20:14.693 11:31:09 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@835 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:20:14.693 11:31:09 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@836 -- # local max_retries=100 00:20:14.693 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:20:14.693 11:31:09 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@838 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:20:14.693 11:31:09 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@840 -- # xtrace_disable 00:20:14.693 11:31:09 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@10 -- # set +x 00:20:14.693 [2024-10-07 11:31:09.966831] Starting SPDK v25.01-pre git sha1 2a4f56c54 / DPDK 24.03.0 initialization... 00:20:14.693 [2024-10-07 11:31:09.966945] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x4 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --iova-mode=pa --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid84135 ] 00:20:14.693 [2024-10-07 11:31:10.104723] app.c: 917:spdk_app_start: *NOTICE*: Total cores available: 1 00:20:14.951 [2024-10-07 11:31:10.248512] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 2 00:20:15.884 11:31:11 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@860 -- # (( i == 0 )) 00:20:15.884 11:31:11 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@864 -- # return 0 00:20:15.884 11:31:11 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@33 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock keyring_file_add_key key0 /tmp/tmp.ca2SZhyGHH 00:20:15.884 11:31:11 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@35 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b TLSTEST -t tcp -a 10.0.0.3 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -q nqn.2016-06.io.spdk:host1 --psk key0 00:20:16.451 [2024-10-07 11:31:11.675743] bdev_nvme_rpc.c: 514:rpc_bdev_nvme_attach_controller: *NOTICE*: TLS support is considered experimental 00:20:16.451 TLSTESTn1 00:20:16.451 11:31:11 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@42 -- # /home/vagrant/spdk_repo/spdk/examples/bdev/bdevperf/bdevperf.py -t 20 -s /var/tmp/bdevperf.sock perform_tests 00:20:16.451 Running I/O for 10 seconds... 00:20:18.814 4010.00 IOPS, 15.66 MiB/s [2024-10-07T11:31:14.902Z] 3996.50 IOPS, 15.61 MiB/s [2024-10-07T11:31:16.277Z] 4117.67 IOPS, 16.08 MiB/s [2024-10-07T11:31:17.212Z] 4198.00 IOPS, 16.40 MiB/s [2024-10-07T11:31:18.152Z] 4249.60 IOPS, 16.60 MiB/s [2024-10-07T11:31:19.085Z] 4266.67 IOPS, 16.67 MiB/s [2024-10-07T11:31:20.061Z] 4278.71 IOPS, 16.71 MiB/s [2024-10-07T11:31:20.997Z] 4294.38 IOPS, 16.77 MiB/s [2024-10-07T11:31:21.931Z] 4306.11 IOPS, 16.82 MiB/s [2024-10-07T11:31:21.931Z] 4300.80 IOPS, 16.80 MiB/s 00:20:26.408 Latency(us) 00:20:26.408 [2024-10-07T11:31:21.931Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:20:26.408 Job: TLSTESTn1 (Core Mask 0x4, workload: verify, depth: 128, IO size: 4096) 00:20:26.408 Verification LBA range: start 0x0 length 0x2000 00:20:26.408 TLSTESTn1 : 10.02 4306.31 16.82 0.00 0.00 29670.46 5570.56 27882.59 00:20:26.408 [2024-10-07T11:31:21.931Z] =================================================================================================================== 00:20:26.408 [2024-10-07T11:31:21.931Z] Total : 4306.31 16.82 0.00 0.00 29670.46 5570.56 27882.59 00:20:26.408 { 00:20:26.408 "results": [ 00:20:26.408 { 00:20:26.408 "job": "TLSTESTn1", 00:20:26.408 "core_mask": "0x4", 00:20:26.408 "workload": "verify", 00:20:26.408 "status": "finished", 00:20:26.409 "verify_range": { 00:20:26.409 "start": 0, 00:20:26.409 "length": 8192 00:20:26.409 }, 00:20:26.409 "queue_depth": 128, 00:20:26.409 "io_size": 4096, 00:20:26.409 "runtime": 10.016933, 00:20:26.409 "iops": 4306.308128446102, 00:20:26.409 "mibps": 16.821516126742587, 00:20:26.409 "io_failed": 0, 00:20:26.409 "io_timeout": 0, 00:20:26.409 "avg_latency_us": 29670.458699757215, 00:20:26.409 "min_latency_us": 5570.56, 00:20:26.409 "max_latency_us": 27882.589090909092 00:20:26.409 } 00:20:26.409 ], 00:20:26.409 "core_count": 1 00:20:26.409 } 00:20:26.409 11:31:21 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@45 -- # trap 'nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:20:26.409 11:31:21 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@46 -- # killprocess 84135 00:20:26.409 11:31:21 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@950 -- # '[' -z 84135 ']' 00:20:26.409 11:31:21 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@954 -- # kill -0 84135 00:20:26.409 11:31:21 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@955 -- # uname 00:20:26.409 11:31:21 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@955 -- # '[' Linux = Linux ']' 00:20:26.409 11:31:21 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@956 -- # ps --no-headers -o comm= 84135 00:20:26.666 11:31:21 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@956 -- # process_name=reactor_2 00:20:26.666 11:31:21 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@960 -- # '[' reactor_2 = sudo ']' 00:20:26.666 killing process with pid 84135 00:20:26.666 Received shutdown signal, test time was about 10.000000 seconds 00:20:26.666 00:20:26.666 Latency(us) 00:20:26.666 [2024-10-07T11:31:22.189Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:20:26.666 [2024-10-07T11:31:22.189Z] =================================================================================================================== 00:20:26.666 [2024-10-07T11:31:22.189Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:20:26.666 11:31:21 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@968 -- # echo 'killing process with pid 84135' 00:20:26.666 11:31:21 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@969 -- # kill 84135 00:20:26.666 11:31:21 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@974 -- # wait 84135 00:20:26.924 11:31:22 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@171 -- # chmod 0666 /tmp/tmp.ca2SZhyGHH 00:20:26.924 11:31:22 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@172 -- # NOT run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 /tmp/tmp.ca2SZhyGHH 00:20:26.924 11:31:22 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@650 -- # local es=0 00:20:26.924 11:31:22 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@652 -- # valid_exec_arg run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 /tmp/tmp.ca2SZhyGHH 00:20:26.924 11:31:22 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@638 -- # local arg=run_bdevperf 00:20:26.924 11:31:22 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:20:26.924 11:31:22 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@642 -- # type -t run_bdevperf 00:20:26.924 11:31:22 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:20:26.924 11:31:22 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@653 -- # run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 /tmp/tmp.ca2SZhyGHH 00:20:26.924 11:31:22 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@22 -- # local subnqn hostnqn psk 00:20:26.924 11:31:22 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@23 -- # subnqn=nqn.2016-06.io.spdk:cnode1 00:20:26.924 11:31:22 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@23 -- # hostnqn=nqn.2016-06.io.spdk:host1 00:20:26.924 11:31:22 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@23 -- # psk=/tmp/tmp.ca2SZhyGHH 00:20:26.924 11:31:22 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@25 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:20:26.924 11:31:22 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@28 -- # bdevperf_pid=84303 00:20:26.924 11:31:22 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@30 -- # trap 'cleanup; exit 1' SIGINT SIGTERM EXIT 00:20:26.924 11:31:22 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@27 -- # /home/vagrant/spdk_repo/spdk/build/examples/bdevperf -m 0x4 -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 10 00:20:26.924 11:31:22 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@31 -- # waitforlisten 84303 /var/tmp/bdevperf.sock 00:20:26.924 11:31:22 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@831 -- # '[' -z 84303 ']' 00:20:26.924 11:31:22 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@835 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:20:26.924 11:31:22 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@836 -- # local max_retries=100 00:20:26.924 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:20:26.924 11:31:22 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@838 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:20:26.924 11:31:22 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@840 -- # xtrace_disable 00:20:26.924 11:31:22 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@10 -- # set +x 00:20:26.924 [2024-10-07 11:31:22.342102] Starting SPDK v25.01-pre git sha1 2a4f56c54 / DPDK 24.03.0 initialization... 00:20:26.924 [2024-10-07 11:31:22.342222] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x4 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --iova-mode=pa --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid84303 ] 00:20:27.182 [2024-10-07 11:31:22.480901] app.c: 917:spdk_app_start: *NOTICE*: Total cores available: 1 00:20:27.182 [2024-10-07 11:31:22.615056] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 2 00:20:28.115 11:31:23 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@860 -- # (( i == 0 )) 00:20:28.115 11:31:23 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@864 -- # return 0 00:20:28.115 11:31:23 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@33 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock keyring_file_add_key key0 /tmp/tmp.ca2SZhyGHH 00:20:28.373 [2024-10-07 11:31:23.657404] keyring.c: 36:keyring_file_check_path: *ERROR*: Invalid permissions for key file '/tmp/tmp.ca2SZhyGHH': 0100666 00:20:28.373 [2024-10-07 11:31:23.657464] keyring.c: 126:spdk_keyring_add_key: *ERROR*: Failed to add key 'key0' to the keyring 00:20:28.373 2024/10/07 11:31:23 error on JSON-RPC call, method: keyring_file_add_key, params: map[name:key0 path:/tmp/tmp.ca2SZhyGHH], err: error received for keyring_file_add_key method, err: Code=-1 Msg=Operation not permitted 00:20:28.373 request: 00:20:28.373 { 00:20:28.373 "method": "keyring_file_add_key", 00:20:28.373 "params": { 00:20:28.373 "name": "key0", 00:20:28.373 "path": "/tmp/tmp.ca2SZhyGHH" 00:20:28.373 } 00:20:28.373 } 00:20:28.373 Got JSON-RPC error response 00:20:28.373 GoRPCClient: error on JSON-RPC call 00:20:28.373 11:31:23 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@35 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b TLSTEST -t tcp -a 10.0.0.3 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -q nqn.2016-06.io.spdk:host1 --psk key0 00:20:28.630 [2024-10-07 11:31:23.977534] bdev_nvme_rpc.c: 514:rpc_bdev_nvme_attach_controller: *NOTICE*: TLS support is considered experimental 00:20:28.630 [2024-10-07 11:31:23.977601] bdev_nvme.c:6391:spdk_bdev_nvme_create: *ERROR*: Could not load PSK: key0 00:20:28.630 2024/10/07 11:31:23 error on JSON-RPC call, method: bdev_nvme_attach_controller, params: map[adrfam:ipv4 allow_unrecognized_csi:%!s(bool=false) ddgst:%!s(bool=false) hdgst:%!s(bool=false) hostnqn:nqn.2016-06.io.spdk:host1 name:TLSTEST prchk_guard:%!s(bool=false) prchk_reftag:%!s(bool=false) psk:key0 subnqn:nqn.2016-06.io.spdk:cnode1 traddr:10.0.0.3 trsvcid:4420 trtype:tcp], err: error received for bdev_nvme_attach_controller method, err: Code=-126 Msg=Required key not available 00:20:28.630 request: 00:20:28.630 { 00:20:28.630 "method": "bdev_nvme_attach_controller", 00:20:28.630 "params": { 00:20:28.630 "name": "TLSTEST", 00:20:28.630 "trtype": "tcp", 00:20:28.630 "traddr": "10.0.0.3", 00:20:28.630 "adrfam": "ipv4", 00:20:28.630 "trsvcid": "4420", 00:20:28.630 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:20:28.630 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:20:28.630 "prchk_reftag": false, 00:20:28.630 "prchk_guard": false, 00:20:28.630 "hdgst": false, 00:20:28.630 "ddgst": false, 00:20:28.630 "psk": "key0", 00:20:28.630 "allow_unrecognized_csi": false 00:20:28.630 } 00:20:28.630 } 00:20:28.630 Got JSON-RPC error response 00:20:28.630 GoRPCClient: error on JSON-RPC call 00:20:28.630 11:31:23 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@37 -- # killprocess 84303 00:20:28.630 11:31:23 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@950 -- # '[' -z 84303 ']' 00:20:28.630 11:31:24 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@954 -- # kill -0 84303 00:20:28.630 11:31:24 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@955 -- # uname 00:20:28.630 11:31:24 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@955 -- # '[' Linux = Linux ']' 00:20:28.630 11:31:24 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@956 -- # ps --no-headers -o comm= 84303 00:20:28.630 11:31:24 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@956 -- # process_name=reactor_2 00:20:28.630 11:31:24 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@960 -- # '[' reactor_2 = sudo ']' 00:20:28.630 killing process with pid 84303 00:20:28.630 11:31:24 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@968 -- # echo 'killing process with pid 84303' 00:20:28.630 11:31:24 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@969 -- # kill 84303 00:20:28.630 Received shutdown signal, test time was about 10.000000 seconds 00:20:28.630 00:20:28.630 Latency(us) 00:20:28.630 [2024-10-07T11:31:24.153Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:20:28.630 [2024-10-07T11:31:24.153Z] =================================================================================================================== 00:20:28.630 [2024-10-07T11:31:24.153Z] Total : 0.00 0.00 0.00 0.00 0.00 18446744073709551616.00 0.00 00:20:28.630 11:31:24 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@974 -- # wait 84303 00:20:28.888 11:31:24 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@38 -- # return 1 00:20:28.888 11:31:24 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@653 -- # es=1 00:20:28.888 11:31:24 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:20:28.888 11:31:24 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:20:28.888 11:31:24 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:20:28.888 11:31:24 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@175 -- # killprocess 84016 00:20:28.888 11:31:24 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@950 -- # '[' -z 84016 ']' 00:20:28.888 11:31:24 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@954 -- # kill -0 84016 00:20:28.888 11:31:24 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@955 -- # uname 00:20:28.888 11:31:24 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@955 -- # '[' Linux = Linux ']' 00:20:28.888 11:31:24 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@956 -- # ps --no-headers -o comm= 84016 00:20:28.888 11:31:24 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@956 -- # process_name=reactor_1 00:20:28.888 11:31:24 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@960 -- # '[' reactor_1 = sudo ']' 00:20:28.888 killing process with pid 84016 00:20:28.888 11:31:24 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@968 -- # echo 'killing process with pid 84016' 00:20:28.888 11:31:24 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@969 -- # kill 84016 00:20:28.888 11:31:24 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@974 -- # wait 84016 00:20:29.146 11:31:24 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@176 -- # nvmfappstart -m 0x2 00:20:29.146 11:31:24 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@505 -- # timing_enter start_nvmf_tgt 00:20:29.146 11:31:24 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@724 -- # xtrace_disable 00:20:29.146 11:31:24 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@10 -- # set +x 00:20:29.146 11:31:24 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@507 -- # nvmfpid=84367 00:20:29.146 11:31:24 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@506 -- # ip netns exec nvmf_tgt_ns_spdk /home/vagrant/spdk_repo/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x2 00:20:29.146 11:31:24 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@508 -- # waitforlisten 84367 00:20:29.146 11:31:24 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@831 -- # '[' -z 84367 ']' 00:20:29.146 11:31:24 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@835 -- # local rpc_addr=/var/tmp/spdk.sock 00:20:29.146 11:31:24 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@836 -- # local max_retries=100 00:20:29.146 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:20:29.146 11:31:24 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@838 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:20:29.146 11:31:24 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@840 -- # xtrace_disable 00:20:29.146 11:31:24 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@10 -- # set +x 00:20:29.406 [2024-10-07 11:31:24.712426] Starting SPDK v25.01-pre git sha1 2a4f56c54 / DPDK 24.03.0 initialization... 00:20:29.406 [2024-10-07 11:31:24.712564] [ DPDK EAL parameters: nvmf -c 0x2 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --iova-mode=pa --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:20:29.406 [2024-10-07 11:31:24.854376] app.c: 917:spdk_app_start: *NOTICE*: Total cores available: 1 00:20:29.665 [2024-10-07 11:31:24.978210] app.c: 610:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:20:29.665 [2024-10-07 11:31:24.978294] app.c: 611:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:20:29.665 [2024-10-07 11:31:24.978305] app.c: 616:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:20:29.665 [2024-10-07 11:31:24.978314] app.c: 617:app_setup_trace: *NOTICE*: SPDK application currently running. 00:20:29.665 [2024-10-07 11:31:24.978320] app.c: 618:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:20:29.665 [2024-10-07 11:31:24.978770] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 1 00:20:30.241 11:31:25 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@860 -- # (( i == 0 )) 00:20:30.241 11:31:25 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@864 -- # return 0 00:20:30.241 11:31:25 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@509 -- # timing_exit start_nvmf_tgt 00:20:30.241 11:31:25 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@730 -- # xtrace_disable 00:20:30.241 11:31:25 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@10 -- # set +x 00:20:30.499 11:31:25 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@510 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:20:30.500 11:31:25 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@178 -- # NOT setup_nvmf_tgt /tmp/tmp.ca2SZhyGHH 00:20:30.500 11:31:25 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@650 -- # local es=0 00:20:30.500 11:31:25 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@652 -- # valid_exec_arg setup_nvmf_tgt /tmp/tmp.ca2SZhyGHH 00:20:30.500 11:31:25 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@638 -- # local arg=setup_nvmf_tgt 00:20:30.500 11:31:25 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:20:30.500 11:31:25 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@642 -- # type -t setup_nvmf_tgt 00:20:30.500 11:31:25 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:20:30.500 11:31:25 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@653 -- # setup_nvmf_tgt /tmp/tmp.ca2SZhyGHH 00:20:30.500 11:31:25 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@50 -- # local key=/tmp/tmp.ca2SZhyGHH 00:20:30.500 11:31:25 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@52 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_create_transport -t tcp -o 00:20:30.758 [2024-10-07 11:31:26.053982] tcp.c: 738:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:20:30.758 11:31:26 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@53 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDK00000000000001 -m 10 00:20:31.017 11:31:26 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@54 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.3 -s 4420 -k 00:20:31.275 [2024-10-07 11:31:26.618268] tcp.c:1031:nvmf_tcp_listen: *NOTICE*: TLS support is considered experimental 00:20:31.275 [2024-10-07 11:31:26.618565] tcp.c:1081:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.3 port 4420 *** 00:20:31.275 11:31:26 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@56 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py bdev_malloc_create 32 4096 -b malloc0 00:20:31.535 malloc0 00:20:31.535 11:31:26 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@57 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 malloc0 -n 1 00:20:31.793 11:31:27 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@58 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py keyring_file_add_key key0 /tmp/tmp.ca2SZhyGHH 00:20:32.052 [2024-10-07 11:31:27.410612] keyring.c: 36:keyring_file_check_path: *ERROR*: Invalid permissions for key file '/tmp/tmp.ca2SZhyGHH': 0100666 00:20:32.052 [2024-10-07 11:31:27.410718] keyring.c: 126:spdk_keyring_add_key: *ERROR*: Failed to add key 'key0' to the keyring 00:20:32.052 2024/10/07 11:31:27 error on JSON-RPC call, method: keyring_file_add_key, params: map[name:key0 path:/tmp/tmp.ca2SZhyGHH], err: error received for keyring_file_add_key method, err: Code=-1 Msg=Operation not permitted 00:20:32.052 request: 00:20:32.052 { 00:20:32.052 "method": "keyring_file_add_key", 00:20:32.052 "params": { 00:20:32.052 "name": "key0", 00:20:32.052 "path": "/tmp/tmp.ca2SZhyGHH" 00:20:32.052 } 00:20:32.052 } 00:20:32.052 Got JSON-RPC error response 00:20:32.052 GoRPCClient: error on JSON-RPC call 00:20:32.052 11:31:27 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@59 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_add_host nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 --psk key0 00:20:32.312 [2024-10-07 11:31:27.674760] tcp.c:3792:nvmf_tcp_subsystem_add_host: *ERROR*: Key 'key0' does not exist 00:20:32.312 [2024-10-07 11:31:27.674832] subsystem.c:1055:spdk_nvmf_subsystem_add_host_ext: *ERROR*: Unable to add host to TCP transport 00:20:32.312 2024/10/07 11:31:27 error on JSON-RPC call, method: nvmf_subsystem_add_host, params: map[host:nqn.2016-06.io.spdk:host1 nqn:nqn.2016-06.io.spdk:cnode1 psk:key0], err: error received for nvmf_subsystem_add_host method, err: Code=-32603 Msg=Internal error 00:20:32.312 request: 00:20:32.312 { 00:20:32.312 "method": "nvmf_subsystem_add_host", 00:20:32.312 "params": { 00:20:32.312 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:20:32.312 "host": "nqn.2016-06.io.spdk:host1", 00:20:32.312 "psk": "key0" 00:20:32.312 } 00:20:32.312 } 00:20:32.312 Got JSON-RPC error response 00:20:32.312 GoRPCClient: error on JSON-RPC call 00:20:32.312 11:31:27 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@653 -- # es=1 00:20:32.312 11:31:27 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:20:32.312 11:31:27 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:20:32.312 11:31:27 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:20:32.312 11:31:27 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@181 -- # killprocess 84367 00:20:32.312 11:31:27 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@950 -- # '[' -z 84367 ']' 00:20:32.312 11:31:27 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@954 -- # kill -0 84367 00:20:32.312 11:31:27 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@955 -- # uname 00:20:32.312 11:31:27 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@955 -- # '[' Linux = Linux ']' 00:20:32.312 11:31:27 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@956 -- # ps --no-headers -o comm= 84367 00:20:32.312 11:31:27 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@956 -- # process_name=reactor_1 00:20:32.312 11:31:27 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@960 -- # '[' reactor_1 = sudo ']' 00:20:32.312 killing process with pid 84367 00:20:32.312 11:31:27 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@968 -- # echo 'killing process with pid 84367' 00:20:32.312 11:31:27 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@969 -- # kill 84367 00:20:32.312 11:31:27 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@974 -- # wait 84367 00:20:32.570 11:31:27 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@182 -- # chmod 0600 /tmp/tmp.ca2SZhyGHH 00:20:32.570 11:31:27 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@185 -- # nvmfappstart -m 0x2 00:20:32.570 11:31:27 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@505 -- # timing_enter start_nvmf_tgt 00:20:32.570 11:31:28 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@724 -- # xtrace_disable 00:20:32.570 11:31:28 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@10 -- # set +x 00:20:32.570 11:31:28 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@507 -- # nvmfpid=84491 00:20:32.570 11:31:28 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@508 -- # waitforlisten 84491 00:20:32.570 11:31:28 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@506 -- # ip netns exec nvmf_tgt_ns_spdk /home/vagrant/spdk_repo/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x2 00:20:32.570 11:31:28 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@831 -- # '[' -z 84491 ']' 00:20:32.570 11:31:28 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@835 -- # local rpc_addr=/var/tmp/spdk.sock 00:20:32.570 11:31:28 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@836 -- # local max_retries=100 00:20:32.570 11:31:28 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@838 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:20:32.570 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:20:32.570 11:31:28 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@840 -- # xtrace_disable 00:20:32.570 11:31:28 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@10 -- # set +x 00:20:32.570 [2024-10-07 11:31:28.083549] Starting SPDK v25.01-pre git sha1 2a4f56c54 / DPDK 24.03.0 initialization... 00:20:32.570 [2024-10-07 11:31:28.083694] [ DPDK EAL parameters: nvmf -c 0x2 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --iova-mode=pa --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:20:32.828 [2024-10-07 11:31:28.223708] app.c: 917:spdk_app_start: *NOTICE*: Total cores available: 1 00:20:32.828 [2024-10-07 11:31:28.344400] app.c: 610:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:20:32.828 [2024-10-07 11:31:28.344470] app.c: 611:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:20:32.828 [2024-10-07 11:31:28.344482] app.c: 616:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:20:32.828 [2024-10-07 11:31:28.344490] app.c: 617:app_setup_trace: *NOTICE*: SPDK application currently running. 00:20:32.828 [2024-10-07 11:31:28.344497] app.c: 618:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:20:32.828 [2024-10-07 11:31:28.344955] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 1 00:20:33.762 11:31:29 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@860 -- # (( i == 0 )) 00:20:33.762 11:31:29 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@864 -- # return 0 00:20:33.762 11:31:29 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@509 -- # timing_exit start_nvmf_tgt 00:20:33.762 11:31:29 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@730 -- # xtrace_disable 00:20:33.762 11:31:29 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@10 -- # set +x 00:20:33.762 11:31:29 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@510 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:20:33.762 11:31:29 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@186 -- # setup_nvmf_tgt /tmp/tmp.ca2SZhyGHH 00:20:33.762 11:31:29 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@50 -- # local key=/tmp/tmp.ca2SZhyGHH 00:20:33.762 11:31:29 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@52 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_create_transport -t tcp -o 00:20:34.023 [2024-10-07 11:31:29.518287] tcp.c: 738:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:20:34.023 11:31:29 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@53 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDK00000000000001 -m 10 00:20:34.589 11:31:29 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@54 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.3 -s 4420 -k 00:20:34.849 [2024-10-07 11:31:30.126418] tcp.c:1031:nvmf_tcp_listen: *NOTICE*: TLS support is considered experimental 00:20:34.849 [2024-10-07 11:31:30.126708] tcp.c:1081:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.3 port 4420 *** 00:20:34.849 11:31:30 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@56 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py bdev_malloc_create 32 4096 -b malloc0 00:20:35.106 malloc0 00:20:35.106 11:31:30 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@57 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 malloc0 -n 1 00:20:35.365 11:31:30 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@58 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py keyring_file_add_key key0 /tmp/tmp.ca2SZhyGHH 00:20:35.930 11:31:31 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@59 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_add_host nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 --psk key0 00:20:35.930 11:31:31 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@189 -- # bdevperf_pid=84612 00:20:35.930 11:31:31 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@188 -- # /home/vagrant/spdk_repo/spdk/build/examples/bdevperf -m 0x4 -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 10 00:20:35.930 11:31:31 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@191 -- # trap 'cleanup; exit 1' SIGINT SIGTERM EXIT 00:20:35.930 11:31:31 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@192 -- # waitforlisten 84612 /var/tmp/bdevperf.sock 00:20:35.930 11:31:31 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@831 -- # '[' -z 84612 ']' 00:20:35.930 11:31:31 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@835 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:20:35.930 11:31:31 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@836 -- # local max_retries=100 00:20:35.930 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:20:35.931 11:31:31 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@838 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:20:35.931 11:31:31 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@840 -- # xtrace_disable 00:20:35.931 11:31:31 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@10 -- # set +x 00:20:36.273 [2024-10-07 11:31:31.502327] Starting SPDK v25.01-pre git sha1 2a4f56c54 / DPDK 24.03.0 initialization... 00:20:36.273 [2024-10-07 11:31:31.502436] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x4 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --iova-mode=pa --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid84612 ] 00:20:36.273 [2024-10-07 11:31:31.652614] app.c: 917:spdk_app_start: *NOTICE*: Total cores available: 1 00:20:36.531 [2024-10-07 11:31:31.821914] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 2 00:20:37.099 11:31:32 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@860 -- # (( i == 0 )) 00:20:37.099 11:31:32 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@864 -- # return 0 00:20:37.099 11:31:32 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@193 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock keyring_file_add_key key0 /tmp/tmp.ca2SZhyGHH 00:20:37.666 11:31:32 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@194 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b TLSTEST -t tcp -a 10.0.0.3 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -q nqn.2016-06.io.spdk:host1 --psk key0 00:20:37.667 [2024-10-07 11:31:33.187245] bdev_nvme_rpc.c: 514:rpc_bdev_nvme_attach_controller: *NOTICE*: TLS support is considered experimental 00:20:37.925 TLSTESTn1 00:20:37.925 11:31:33 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@198 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py save_config 00:20:38.491 11:31:33 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@198 -- # tgtconf='{ 00:20:38.491 "subsystems": [ 00:20:38.491 { 00:20:38.491 "subsystem": "keyring", 00:20:38.491 "config": [ 00:20:38.491 { 00:20:38.491 "method": "keyring_file_add_key", 00:20:38.491 "params": { 00:20:38.491 "name": "key0", 00:20:38.491 "path": "/tmp/tmp.ca2SZhyGHH" 00:20:38.491 } 00:20:38.491 } 00:20:38.491 ] 00:20:38.491 }, 00:20:38.491 { 00:20:38.491 "subsystem": "iobuf", 00:20:38.491 "config": [ 00:20:38.491 { 00:20:38.491 "method": "iobuf_set_options", 00:20:38.491 "params": { 00:20:38.491 "large_bufsize": 135168, 00:20:38.491 "large_pool_count": 1024, 00:20:38.491 "small_bufsize": 8192, 00:20:38.491 "small_pool_count": 8192 00:20:38.491 } 00:20:38.491 } 00:20:38.491 ] 00:20:38.491 }, 00:20:38.491 { 00:20:38.491 "subsystem": "sock", 00:20:38.491 "config": [ 00:20:38.491 { 00:20:38.491 "method": "sock_set_default_impl", 00:20:38.491 "params": { 00:20:38.491 "impl_name": "posix" 00:20:38.491 } 00:20:38.491 }, 00:20:38.491 { 00:20:38.491 "method": "sock_impl_set_options", 00:20:38.491 "params": { 00:20:38.491 "enable_ktls": false, 00:20:38.491 "enable_placement_id": 0, 00:20:38.491 "enable_quickack": false, 00:20:38.491 "enable_recv_pipe": true, 00:20:38.492 "enable_zerocopy_send_client": false, 00:20:38.492 "enable_zerocopy_send_server": true, 00:20:38.492 "impl_name": "ssl", 00:20:38.492 "recv_buf_size": 4096, 00:20:38.492 "send_buf_size": 4096, 00:20:38.492 "tls_version": 0, 00:20:38.492 "zerocopy_threshold": 0 00:20:38.492 } 00:20:38.492 }, 00:20:38.492 { 00:20:38.492 "method": "sock_impl_set_options", 00:20:38.492 "params": { 00:20:38.492 "enable_ktls": false, 00:20:38.492 "enable_placement_id": 0, 00:20:38.492 "enable_quickack": false, 00:20:38.492 "enable_recv_pipe": true, 00:20:38.492 "enable_zerocopy_send_client": false, 00:20:38.492 "enable_zerocopy_send_server": true, 00:20:38.492 "impl_name": "posix", 00:20:38.492 "recv_buf_size": 2097152, 00:20:38.492 "send_buf_size": 2097152, 00:20:38.492 "tls_version": 0, 00:20:38.492 "zerocopy_threshold": 0 00:20:38.492 } 00:20:38.492 } 00:20:38.492 ] 00:20:38.492 }, 00:20:38.492 { 00:20:38.492 "subsystem": "vmd", 00:20:38.492 "config": [] 00:20:38.492 }, 00:20:38.492 { 00:20:38.492 "subsystem": "accel", 00:20:38.492 "config": [ 00:20:38.492 { 00:20:38.492 "method": "accel_set_options", 00:20:38.492 "params": { 00:20:38.492 "buf_count": 2048, 00:20:38.492 "large_cache_size": 16, 00:20:38.492 "sequence_count": 2048, 00:20:38.492 "small_cache_size": 128, 00:20:38.492 "task_count": 2048 00:20:38.492 } 00:20:38.492 } 00:20:38.492 ] 00:20:38.492 }, 00:20:38.492 { 00:20:38.492 "subsystem": "bdev", 00:20:38.492 "config": [ 00:20:38.492 { 00:20:38.492 "method": "bdev_set_options", 00:20:38.492 "params": { 00:20:38.492 "bdev_auto_examine": true, 00:20:38.492 "bdev_io_cache_size": 256, 00:20:38.492 "bdev_io_pool_size": 65535, 00:20:38.492 "iobuf_large_cache_size": 16, 00:20:38.492 "iobuf_small_cache_size": 128 00:20:38.492 } 00:20:38.492 }, 00:20:38.492 { 00:20:38.492 "method": "bdev_raid_set_options", 00:20:38.492 "params": { 00:20:38.492 "process_max_bandwidth_mb_sec": 0, 00:20:38.492 "process_window_size_kb": 1024 00:20:38.492 } 00:20:38.492 }, 00:20:38.492 { 00:20:38.492 "method": "bdev_iscsi_set_options", 00:20:38.492 "params": { 00:20:38.492 "timeout_sec": 30 00:20:38.492 } 00:20:38.492 }, 00:20:38.492 { 00:20:38.492 "method": "bdev_nvme_set_options", 00:20:38.492 "params": { 00:20:38.492 "action_on_timeout": "none", 00:20:38.492 "allow_accel_sequence": false, 00:20:38.492 "arbitration_burst": 0, 00:20:38.492 "bdev_retry_count": 3, 00:20:38.492 "ctrlr_loss_timeout_sec": 0, 00:20:38.492 "delay_cmd_submit": true, 00:20:38.492 "dhchap_dhgroups": [ 00:20:38.492 "null", 00:20:38.492 "ffdhe2048", 00:20:38.492 "ffdhe3072", 00:20:38.492 "ffdhe4096", 00:20:38.492 "ffdhe6144", 00:20:38.492 "ffdhe8192" 00:20:38.492 ], 00:20:38.492 "dhchap_digests": [ 00:20:38.492 "sha256", 00:20:38.492 "sha384", 00:20:38.492 "sha512" 00:20:38.492 ], 00:20:38.492 "disable_auto_failback": false, 00:20:38.492 "fast_io_fail_timeout_sec": 0, 00:20:38.492 "generate_uuids": false, 00:20:38.492 "high_priority_weight": 0, 00:20:38.492 "io_path_stat": false, 00:20:38.492 "io_queue_requests": 0, 00:20:38.492 "keep_alive_timeout_ms": 10000, 00:20:38.492 "low_priority_weight": 0, 00:20:38.492 "medium_priority_weight": 0, 00:20:38.492 "nvme_adminq_poll_period_us": 10000, 00:20:38.492 "nvme_error_stat": false, 00:20:38.492 "nvme_ioq_poll_period_us": 0, 00:20:38.492 "rdma_cm_event_timeout_ms": 0, 00:20:38.492 "rdma_max_cq_size": 0, 00:20:38.492 "rdma_srq_size": 0, 00:20:38.492 "reconnect_delay_sec": 0, 00:20:38.492 "timeout_admin_us": 0, 00:20:38.492 "timeout_us": 0, 00:20:38.492 "transport_ack_timeout": 0, 00:20:38.492 "transport_retry_count": 4, 00:20:38.492 "transport_tos": 0 00:20:38.492 } 00:20:38.492 }, 00:20:38.492 { 00:20:38.492 "method": "bdev_nvme_set_hotplug", 00:20:38.492 "params": { 00:20:38.492 "enable": false, 00:20:38.492 "period_us": 100000 00:20:38.492 } 00:20:38.492 }, 00:20:38.492 { 00:20:38.492 "method": "bdev_malloc_create", 00:20:38.492 "params": { 00:20:38.492 "block_size": 4096, 00:20:38.492 "dif_is_head_of_md": false, 00:20:38.492 "dif_pi_format": 0, 00:20:38.492 "dif_type": 0, 00:20:38.492 "md_size": 0, 00:20:38.492 "name": "malloc0", 00:20:38.492 "num_blocks": 8192, 00:20:38.492 "optimal_io_boundary": 0, 00:20:38.492 "physical_block_size": 4096, 00:20:38.492 "uuid": "067968fb-db78-4948-b598-7b3b089fbca0" 00:20:38.492 } 00:20:38.492 }, 00:20:38.492 { 00:20:38.492 "method": "bdev_wait_for_examine" 00:20:38.492 } 00:20:38.492 ] 00:20:38.492 }, 00:20:38.492 { 00:20:38.492 "subsystem": "nbd", 00:20:38.492 "config": [] 00:20:38.492 }, 00:20:38.492 { 00:20:38.492 "subsystem": "scheduler", 00:20:38.492 "config": [ 00:20:38.492 { 00:20:38.492 "method": "framework_set_scheduler", 00:20:38.492 "params": { 00:20:38.492 "name": "static" 00:20:38.492 } 00:20:38.492 } 00:20:38.492 ] 00:20:38.492 }, 00:20:38.492 { 00:20:38.492 "subsystem": "nvmf", 00:20:38.492 "config": [ 00:20:38.492 { 00:20:38.492 "method": "nvmf_set_config", 00:20:38.492 "params": { 00:20:38.492 "admin_cmd_passthru": { 00:20:38.492 "identify_ctrlr": false 00:20:38.492 }, 00:20:38.492 "dhchap_dhgroups": [ 00:20:38.492 "null", 00:20:38.492 "ffdhe2048", 00:20:38.492 "ffdhe3072", 00:20:38.492 "ffdhe4096", 00:20:38.492 "ffdhe6144", 00:20:38.492 "ffdhe8192" 00:20:38.492 ], 00:20:38.492 "dhchap_digests": [ 00:20:38.492 "sha256", 00:20:38.492 "sha384", 00:20:38.492 "sha512" 00:20:38.492 ], 00:20:38.492 "discovery_filter": "match_any" 00:20:38.492 } 00:20:38.492 }, 00:20:38.492 { 00:20:38.492 "method": "nvmf_set_max_subsystems", 00:20:38.492 "params": { 00:20:38.492 "max_subsystems": 1024 00:20:38.492 } 00:20:38.492 }, 00:20:38.492 { 00:20:38.492 "method": "nvmf_set_crdt", 00:20:38.492 "params": { 00:20:38.492 "crdt1": 0, 00:20:38.492 "crdt2": 0, 00:20:38.492 "crdt3": 0 00:20:38.492 } 00:20:38.492 }, 00:20:38.492 { 00:20:38.492 "method": "nvmf_create_transport", 00:20:38.492 "params": { 00:20:38.492 "abort_timeout_sec": 1, 00:20:38.492 "ack_timeout": 0, 00:20:38.492 "buf_cache_size": 4294967295, 00:20:38.492 "c2h_success": false, 00:20:38.492 "data_wr_pool_size": 0, 00:20:38.492 "dif_insert_or_strip": false, 00:20:38.492 "in_capsule_data_size": 4096, 00:20:38.492 "io_unit_size": 131072, 00:20:38.492 "max_aq_depth": 128, 00:20:38.492 "max_io_qpairs_per_ctrlr": 127, 00:20:38.492 "max_io_size": 131072, 00:20:38.492 "max_queue_depth": 128, 00:20:38.492 "num_shared_buffers": 511, 00:20:38.492 "sock_priority": 0, 00:20:38.492 "trtype": "TCP", 00:20:38.492 "zcopy": false 00:20:38.492 } 00:20:38.492 }, 00:20:38.492 { 00:20:38.492 "method": "nvmf_create_subsystem", 00:20:38.492 "params": { 00:20:38.492 "allow_any_host": false, 00:20:38.492 "ana_reporting": false, 00:20:38.492 "max_cntlid": 65519, 00:20:38.492 "max_namespaces": 10, 00:20:38.492 "min_cntlid": 1, 00:20:38.492 "model_number": "SPDK bdev Controller", 00:20:38.492 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:20:38.492 "serial_number": "SPDK00000000000001" 00:20:38.492 } 00:20:38.492 }, 00:20:38.492 { 00:20:38.492 "method": "nvmf_subsystem_add_host", 00:20:38.492 "params": { 00:20:38.492 "host": "nqn.2016-06.io.spdk:host1", 00:20:38.492 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:20:38.492 "psk": "key0" 00:20:38.492 } 00:20:38.492 }, 00:20:38.492 { 00:20:38.492 "method": "nvmf_subsystem_add_ns", 00:20:38.492 "params": { 00:20:38.492 "namespace": { 00:20:38.492 "bdev_name": "malloc0", 00:20:38.492 "nguid": "067968FBDB784948B5987B3B089FBCA0", 00:20:38.492 "no_auto_visible": false, 00:20:38.492 "nsid": 1, 00:20:38.492 "uuid": "067968fb-db78-4948-b598-7b3b089fbca0" 00:20:38.492 }, 00:20:38.492 "nqn": "nqn.2016-06.io.spdk:cnode1" 00:20:38.492 } 00:20:38.492 }, 00:20:38.493 { 00:20:38.493 "method": "nvmf_subsystem_add_listener", 00:20:38.493 "params": { 00:20:38.493 "listen_address": { 00:20:38.493 "adrfam": "IPv4", 00:20:38.493 "traddr": "10.0.0.3", 00:20:38.493 "trsvcid": "4420", 00:20:38.493 "trtype": "TCP" 00:20:38.493 }, 00:20:38.493 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:20:38.493 "secure_channel": true 00:20:38.493 } 00:20:38.493 } 00:20:38.493 ] 00:20:38.493 } 00:20:38.493 ] 00:20:38.493 }' 00:20:38.493 11:31:33 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@199 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock save_config 00:20:38.750 11:31:34 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@199 -- # bdevperfconf='{ 00:20:38.750 "subsystems": [ 00:20:38.750 { 00:20:38.750 "subsystem": "keyring", 00:20:38.750 "config": [ 00:20:38.750 { 00:20:38.750 "method": "keyring_file_add_key", 00:20:38.750 "params": { 00:20:38.750 "name": "key0", 00:20:38.750 "path": "/tmp/tmp.ca2SZhyGHH" 00:20:38.750 } 00:20:38.750 } 00:20:38.750 ] 00:20:38.750 }, 00:20:38.750 { 00:20:38.750 "subsystem": "iobuf", 00:20:38.750 "config": [ 00:20:38.750 { 00:20:38.750 "method": "iobuf_set_options", 00:20:38.750 "params": { 00:20:38.750 "large_bufsize": 135168, 00:20:38.750 "large_pool_count": 1024, 00:20:38.750 "small_bufsize": 8192, 00:20:38.750 "small_pool_count": 8192 00:20:38.750 } 00:20:38.750 } 00:20:38.750 ] 00:20:38.750 }, 00:20:38.750 { 00:20:38.750 "subsystem": "sock", 00:20:38.750 "config": [ 00:20:38.750 { 00:20:38.750 "method": "sock_set_default_impl", 00:20:38.750 "params": { 00:20:38.750 "impl_name": "posix" 00:20:38.750 } 00:20:38.750 }, 00:20:38.750 { 00:20:38.750 "method": "sock_impl_set_options", 00:20:38.750 "params": { 00:20:38.750 "enable_ktls": false, 00:20:38.750 "enable_placement_id": 0, 00:20:38.750 "enable_quickack": false, 00:20:38.750 "enable_recv_pipe": true, 00:20:38.750 "enable_zerocopy_send_client": false, 00:20:38.750 "enable_zerocopy_send_server": true, 00:20:38.750 "impl_name": "ssl", 00:20:38.750 "recv_buf_size": 4096, 00:20:38.750 "send_buf_size": 4096, 00:20:38.750 "tls_version": 0, 00:20:38.750 "zerocopy_threshold": 0 00:20:38.750 } 00:20:38.750 }, 00:20:38.750 { 00:20:38.750 "method": "sock_impl_set_options", 00:20:38.750 "params": { 00:20:38.750 "enable_ktls": false, 00:20:38.750 "enable_placement_id": 0, 00:20:38.750 "enable_quickack": false, 00:20:38.750 "enable_recv_pipe": true, 00:20:38.750 "enable_zerocopy_send_client": false, 00:20:38.750 "enable_zerocopy_send_server": true, 00:20:38.750 "impl_name": "posix", 00:20:38.750 "recv_buf_size": 2097152, 00:20:38.750 "send_buf_size": 2097152, 00:20:38.750 "tls_version": 0, 00:20:38.750 "zerocopy_threshold": 0 00:20:38.750 } 00:20:38.750 } 00:20:38.750 ] 00:20:38.750 }, 00:20:38.750 { 00:20:38.750 "subsystem": "vmd", 00:20:38.750 "config": [] 00:20:38.750 }, 00:20:38.750 { 00:20:38.750 "subsystem": "accel", 00:20:38.750 "config": [ 00:20:38.750 { 00:20:38.750 "method": "accel_set_options", 00:20:38.750 "params": { 00:20:38.750 "buf_count": 2048, 00:20:38.750 "large_cache_size": 16, 00:20:38.750 "sequence_count": 2048, 00:20:38.750 "small_cache_size": 128, 00:20:38.750 "task_count": 2048 00:20:38.750 } 00:20:38.750 } 00:20:38.750 ] 00:20:38.751 }, 00:20:38.751 { 00:20:38.751 "subsystem": "bdev", 00:20:38.751 "config": [ 00:20:38.751 { 00:20:38.751 "method": "bdev_set_options", 00:20:38.751 "params": { 00:20:38.751 "bdev_auto_examine": true, 00:20:38.751 "bdev_io_cache_size": 256, 00:20:38.751 "bdev_io_pool_size": 65535, 00:20:38.751 "iobuf_large_cache_size": 16, 00:20:38.751 "iobuf_small_cache_size": 128 00:20:38.751 } 00:20:38.751 }, 00:20:38.751 { 00:20:38.751 "method": "bdev_raid_set_options", 00:20:38.751 "params": { 00:20:38.751 "process_max_bandwidth_mb_sec": 0, 00:20:38.751 "process_window_size_kb": 1024 00:20:38.751 } 00:20:38.751 }, 00:20:38.751 { 00:20:38.751 "method": "bdev_iscsi_set_options", 00:20:38.751 "params": { 00:20:38.751 "timeout_sec": 30 00:20:38.751 } 00:20:38.751 }, 00:20:38.751 { 00:20:38.751 "method": "bdev_nvme_set_options", 00:20:38.751 "params": { 00:20:38.751 "action_on_timeout": "none", 00:20:38.751 "allow_accel_sequence": false, 00:20:38.751 "arbitration_burst": 0, 00:20:38.751 "bdev_retry_count": 3, 00:20:38.751 "ctrlr_loss_timeout_sec": 0, 00:20:38.751 "delay_cmd_submit": true, 00:20:38.751 "dhchap_dhgroups": [ 00:20:38.751 "null", 00:20:38.751 "ffdhe2048", 00:20:38.751 "ffdhe3072", 00:20:38.751 "ffdhe4096", 00:20:38.751 "ffdhe6144", 00:20:38.751 "ffdhe8192" 00:20:38.751 ], 00:20:38.751 "dhchap_digests": [ 00:20:38.751 "sha256", 00:20:38.751 "sha384", 00:20:38.751 "sha512" 00:20:38.751 ], 00:20:38.751 "disable_auto_failback": false, 00:20:38.751 "fast_io_fail_timeout_sec": 0, 00:20:38.751 "generate_uuids": false, 00:20:38.751 "high_priority_weight": 0, 00:20:38.751 "io_path_stat": false, 00:20:38.751 "io_queue_requests": 512, 00:20:38.751 "keep_alive_timeout_ms": 10000, 00:20:38.751 "low_priority_weight": 0, 00:20:38.751 "medium_priority_weight": 0, 00:20:38.751 "nvme_adminq_poll_period_us": 10000, 00:20:38.751 "nvme_error_stat": false, 00:20:38.751 "nvme_ioq_poll_period_us": 0, 00:20:38.751 "rdma_cm_event_timeout_ms": 0, 00:20:38.751 "rdma_max_cq_size": 0, 00:20:38.751 "rdma_srq_size": 0, 00:20:38.751 "reconnect_delay_sec": 0, 00:20:38.751 "timeout_admin_us": 0, 00:20:38.751 "timeout_us": 0, 00:20:38.751 "transport_ack_timeout": 0, 00:20:38.751 "transport_retry_count": 4, 00:20:38.751 "transport_tos": 0 00:20:38.751 } 00:20:38.751 }, 00:20:38.751 { 00:20:38.751 "method": "bdev_nvme_attach_controller", 00:20:38.751 "params": { 00:20:38.751 "adrfam": "IPv4", 00:20:38.751 "ctrlr_loss_timeout_sec": 0, 00:20:38.751 "ddgst": false, 00:20:38.751 "fast_io_fail_timeout_sec": 0, 00:20:38.751 "hdgst": false, 00:20:38.751 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:20:38.751 "multipath": "multipath", 00:20:38.751 "name": "TLSTEST", 00:20:38.751 "prchk_guard": false, 00:20:38.751 "prchk_reftag": false, 00:20:38.751 "psk": "key0", 00:20:38.751 "reconnect_delay_sec": 0, 00:20:38.751 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:20:38.751 "traddr": "10.0.0.3", 00:20:38.751 "trsvcid": "4420", 00:20:38.751 "trtype": "TCP" 00:20:38.751 } 00:20:38.751 }, 00:20:38.751 { 00:20:38.751 "method": "bdev_nvme_set_hotplug", 00:20:38.751 "params": { 00:20:38.751 "enable": false, 00:20:38.751 "period_us": 100000 00:20:38.751 } 00:20:38.751 }, 00:20:38.751 { 00:20:38.751 "method": "bdev_wait_for_examine" 00:20:38.751 } 00:20:38.751 ] 00:20:38.751 }, 00:20:38.751 { 00:20:38.751 "subsystem": "nbd", 00:20:38.751 "config": [] 00:20:38.751 } 00:20:38.751 ] 00:20:38.751 }' 00:20:38.751 11:31:34 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@201 -- # killprocess 84612 00:20:38.751 11:31:34 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@950 -- # '[' -z 84612 ']' 00:20:38.751 11:31:34 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@954 -- # kill -0 84612 00:20:38.751 11:31:34 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@955 -- # uname 00:20:38.751 11:31:34 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@955 -- # '[' Linux = Linux ']' 00:20:38.751 11:31:34 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@956 -- # ps --no-headers -o comm= 84612 00:20:38.751 11:31:34 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@956 -- # process_name=reactor_2 00:20:38.751 11:31:34 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@960 -- # '[' reactor_2 = sudo ']' 00:20:38.751 killing process with pid 84612 00:20:38.751 11:31:34 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@968 -- # echo 'killing process with pid 84612' 00:20:38.751 Received shutdown signal, test time was about 10.000000 seconds 00:20:38.751 00:20:38.751 Latency(us) 00:20:38.751 [2024-10-07T11:31:34.274Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:20:38.751 [2024-10-07T11:31:34.274Z] =================================================================================================================== 00:20:38.751 [2024-10-07T11:31:34.274Z] Total : 0.00 0.00 0.00 0.00 0.00 18446744073709551616.00 0.00 00:20:38.751 11:31:34 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@969 -- # kill 84612 00:20:38.751 11:31:34 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@974 -- # wait 84612 00:20:39.010 11:31:34 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@202 -- # killprocess 84491 00:20:39.010 11:31:34 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@950 -- # '[' -z 84491 ']' 00:20:39.010 11:31:34 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@954 -- # kill -0 84491 00:20:39.268 11:31:34 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@955 -- # uname 00:20:39.268 11:31:34 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@955 -- # '[' Linux = Linux ']' 00:20:39.268 11:31:34 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@956 -- # ps --no-headers -o comm= 84491 00:20:39.268 11:31:34 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@956 -- # process_name=reactor_1 00:20:39.268 11:31:34 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@960 -- # '[' reactor_1 = sudo ']' 00:20:39.268 killing process with pid 84491 00:20:39.268 11:31:34 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@968 -- # echo 'killing process with pid 84491' 00:20:39.268 11:31:34 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@969 -- # kill 84491 00:20:39.268 11:31:34 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@974 -- # wait 84491 00:20:39.527 11:31:34 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@205 -- # nvmfappstart -m 0x2 -c /dev/fd/62 00:20:39.527 11:31:34 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@505 -- # timing_enter start_nvmf_tgt 00:20:39.527 11:31:34 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@205 -- # echo '{ 00:20:39.527 "subsystems": [ 00:20:39.527 { 00:20:39.527 "subsystem": "keyring", 00:20:39.527 "config": [ 00:20:39.527 { 00:20:39.527 "method": "keyring_file_add_key", 00:20:39.527 "params": { 00:20:39.527 "name": "key0", 00:20:39.527 "path": "/tmp/tmp.ca2SZhyGHH" 00:20:39.527 } 00:20:39.527 } 00:20:39.527 ] 00:20:39.527 }, 00:20:39.527 { 00:20:39.527 "subsystem": "iobuf", 00:20:39.527 "config": [ 00:20:39.527 { 00:20:39.527 "method": "iobuf_set_options", 00:20:39.527 "params": { 00:20:39.527 "large_bufsize": 135168, 00:20:39.527 "large_pool_count": 1024, 00:20:39.527 "small_bufsize": 8192, 00:20:39.527 "small_pool_count": 8192 00:20:39.527 } 00:20:39.527 } 00:20:39.527 ] 00:20:39.527 }, 00:20:39.527 { 00:20:39.527 "subsystem": "sock", 00:20:39.527 "config": [ 00:20:39.527 { 00:20:39.527 "method": "sock_set_default_impl", 00:20:39.527 "params": { 00:20:39.527 "impl_name": "posix" 00:20:39.527 } 00:20:39.527 }, 00:20:39.527 { 00:20:39.527 "method": "sock_impl_set_options", 00:20:39.527 "params": { 00:20:39.527 "enable_ktls": false, 00:20:39.527 "enable_placement_id": 0, 00:20:39.527 "enable_quickack": false, 00:20:39.527 "enable_recv_pipe": true, 00:20:39.527 "enable_zerocopy_send_client": false, 00:20:39.527 "enable_zerocopy_send_server": true, 00:20:39.527 "impl_name": "ssl", 00:20:39.527 "recv_buf_size": 4096, 00:20:39.527 "send_buf_size": 4096, 00:20:39.527 "tls_version": 0, 00:20:39.527 "zerocopy_threshold": 0 00:20:39.527 } 00:20:39.527 }, 00:20:39.527 { 00:20:39.527 "method": "sock_impl_set_options", 00:20:39.527 "params": { 00:20:39.527 "enable_ktls": false, 00:20:39.527 "enable_placement_id": 0, 00:20:39.527 "enable_quickack": false, 00:20:39.527 "enable_recv_pipe": true, 00:20:39.527 "enable_zerocopy_send_client": false, 00:20:39.527 "enable_zerocopy_send_server": true, 00:20:39.527 "impl_name": "posix", 00:20:39.527 "recv_buf_size": 2097152, 00:20:39.527 "send_buf_size": 2097152, 00:20:39.527 "tls_version": 0, 00:20:39.527 "zerocopy_threshold": 0 00:20:39.527 } 00:20:39.527 } 00:20:39.527 ] 00:20:39.527 }, 00:20:39.527 { 00:20:39.527 "subsystem": "vmd", 00:20:39.527 "config": [] 00:20:39.527 }, 00:20:39.527 { 00:20:39.527 "subsystem": "accel", 00:20:39.527 "config": [ 00:20:39.527 { 00:20:39.527 "method": "accel_set_options", 00:20:39.527 "params": { 00:20:39.527 "buf_count": 2048, 00:20:39.527 "large_cache_size": 16, 00:20:39.527 "sequence_count": 2048, 00:20:39.527 "small_cache_size": 128, 00:20:39.527 "task_count": 2048 00:20:39.527 } 00:20:39.527 } 00:20:39.527 ] 00:20:39.527 }, 00:20:39.527 { 00:20:39.527 "subsystem": "bdev", 00:20:39.527 "config": [ 00:20:39.527 { 00:20:39.527 "method": "bdev_set_options", 00:20:39.527 "params": { 00:20:39.527 "bdev_auto_examine": true, 00:20:39.527 "bdev_io_cache_size": 256, 00:20:39.527 "bdev_io_pool_size": 65535, 00:20:39.527 "iobuf_large_cache_size": 16, 00:20:39.527 "iobuf_small_cache_size": 128 00:20:39.527 } 00:20:39.527 }, 00:20:39.527 { 00:20:39.527 "method": "bdev_raid_set_options", 00:20:39.527 "params": { 00:20:39.527 "process_max_bandwidth_mb_sec": 0, 00:20:39.527 "process_window_size_kb": 1024 00:20:39.527 } 00:20:39.527 }, 00:20:39.527 { 00:20:39.527 "method": "bdev_iscsi_set_options", 00:20:39.527 "params": { 00:20:39.527 "timeout_sec": 30 00:20:39.527 } 00:20:39.527 }, 00:20:39.527 { 00:20:39.527 "method": "bdev_nvme_set_options", 00:20:39.527 "params": { 00:20:39.527 "action_on_timeout": "none", 00:20:39.527 "allow_accel_sequence": false, 00:20:39.527 "arbitration_burst": 0, 00:20:39.527 "bdev_retry_count": 3, 00:20:39.527 "ctrlr_loss_timeout_sec": 0, 00:20:39.527 "delay_cmd_submit": true, 00:20:39.527 "dhchap_dhgroups": [ 00:20:39.527 "null", 00:20:39.527 "ffdhe2048", 00:20:39.527 "ffdhe3072", 00:20:39.527 "ffdhe4096", 00:20:39.527 "ffdhe6144", 00:20:39.527 "ffdhe8192" 00:20:39.527 ], 00:20:39.527 "dhchap_digests": [ 00:20:39.527 "sha256", 00:20:39.528 "sha384", 00:20:39.528 "sha512" 00:20:39.528 ], 00:20:39.528 "disable_auto_failback": false, 00:20:39.528 "fast_io_fail_timeout_sec": 0, 00:20:39.528 "generate_uuids": false, 00:20:39.528 "high_priority_weight": 0, 00:20:39.528 "io_path_stat": false, 00:20:39.528 "io_queue_requests": 0, 00:20:39.528 "keep_alive_timeout_ms": 10000, 00:20:39.528 "low_priority_weight": 0, 00:20:39.528 "medium_priority_weight": 0, 00:20:39.528 "nvme_adminq_poll_period_us": 10000, 00:20:39.528 "nvme_error_stat": false, 00:20:39.528 "nvme_ioq_poll_period_us": 0, 00:20:39.528 "rdma_cm_event_timeout_ms": 0, 00:20:39.528 "rdma_max_cq_size": 0, 00:20:39.528 "rdma_srq_size": 0, 00:20:39.528 "reconnect_delay_sec": 0, 00:20:39.528 "timeout_admin_us": 0, 00:20:39.528 "timeout_us": 0, 00:20:39.528 "transport_ack_timeout": 0, 00:20:39.528 "transport_retry_count": 4, 00:20:39.528 "transport_tos": 0 00:20:39.528 } 00:20:39.528 }, 00:20:39.528 { 00:20:39.528 "method": "bdev_nvme_set_hotplug", 00:20:39.528 "params": { 00:20:39.528 "enable": false, 00:20:39.528 "period_us": 100000 00:20:39.528 } 00:20:39.528 }, 00:20:39.528 { 00:20:39.528 "method": "bdev_malloc_create", 00:20:39.528 "params": { 00:20:39.528 "block_size": 4096, 00:20:39.528 "dif_is_head_of_md": false, 00:20:39.528 "dif_pi_format": 0, 00:20:39.528 "dif_type": 0, 00:20:39.528 "md_size": 0, 00:20:39.528 "name": "malloc0", 00:20:39.528 "num_blocks": 8192, 00:20:39.528 "optimal_io_boundary": 0, 00:20:39.528 "physical_block_size": 4096, 00:20:39.528 "uuid": "067968fb-db78-4948-b598-7b3b089fbca0" 00:20:39.528 } 00:20:39.528 }, 00:20:39.528 { 00:20:39.528 "method": "bdev_wait_for_examine" 00:20:39.528 } 00:20:39.528 ] 00:20:39.528 }, 00:20:39.528 { 00:20:39.528 "subsystem": "nbd", 00:20:39.528 "config": [] 00:20:39.528 }, 00:20:39.528 { 00:20:39.528 "subsystem": "scheduler", 00:20:39.528 "config": [ 00:20:39.528 { 00:20:39.528 "method": "framework_set_scheduler", 00:20:39.528 "params": { 00:20:39.528 "name": "static" 00:20:39.528 } 00:20:39.528 } 00:20:39.528 ] 00:20:39.528 }, 00:20:39.528 { 00:20:39.528 "subsystem": "nvmf", 00:20:39.528 "config": [ 00:20:39.528 { 00:20:39.528 "method": "nvmf_set_config", 00:20:39.528 "params": { 00:20:39.528 "admin_cmd_passthru": { 00:20:39.528 "identify_ctrlr": false 00:20:39.528 }, 00:20:39.528 "dhchap_dhgroups": [ 00:20:39.528 "null", 00:20:39.528 "ffdhe2048", 00:20:39.528 "ffdhe3072", 00:20:39.528 "ffdhe4096", 00:20:39.528 "ffdhe6144", 00:20:39.528 "ffdhe8192" 00:20:39.528 ], 00:20:39.528 "dhchap_digests": [ 00:20:39.528 "sha256", 00:20:39.528 "sha384", 00:20:39.528 "sha512" 00:20:39.528 ], 00:20:39.528 "discovery_filter": "match_any" 00:20:39.528 } 00:20:39.528 }, 00:20:39.528 { 00:20:39.528 "method": "nvmf_set_max_subsystems", 00:20:39.528 "params": { 00:20:39.528 "max_subsystems": 1024 00:20:39.528 } 00:20:39.528 }, 00:20:39.528 { 00:20:39.528 "method": "nvmf_set_crdt", 00:20:39.528 "params": { 00:20:39.528 "crdt1": 0, 00:20:39.528 "crdt2": 0, 00:20:39.528 "crdt3": 0 00:20:39.528 } 00:20:39.528 }, 00:20:39.528 { 00:20:39.528 "method": "nvmf_create_transport", 00:20:39.528 "params": { 00:20:39.528 "abort_timeout_sec": 1, 00:20:39.528 "ack_timeout": 0, 00:20:39.528 "buf_cache_size": 4294967295, 00:20:39.528 "c2h_success": false, 00:20:39.528 "data_wr_pool_size": 0, 00:20:39.528 "dif_insert_or_strip": false, 00:20:39.528 "in_capsule_data_size": 4096, 00:20:39.528 "io_unit_size": 131072, 00:20:39.528 "max_aq_depth": 128, 00:20:39.528 "max_io_qpairs_per_ctrlr": 127, 00:20:39.528 "max_io_size": 131072, 00:20:39.528 "max_queue_depth": 128, 00:20:39.528 "num_shared_buffers": 511, 00:20:39.528 "sock_priority": 0, 00:20:39.528 "trtype": "TCP", 00:20:39.528 "zcopy": false 00:20:39.528 } 00:20:39.528 }, 00:20:39.528 { 00:20:39.528 "method": "nvmf_create_subsystem", 00:20:39.528 "params": { 00:20:39.528 "allow_any_host": false, 00:20:39.528 "ana_reporting": false, 00:20:39.528 "max_cntlid": 65519, 00:20:39.528 "max_namespaces": 10, 00:20:39.528 "min_cntlid": 1, 00:20:39.528 "model_number": "SPDK bdev Controller", 00:20:39.528 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:20:39.528 "serial_number": "SPDK00000000000001" 00:20:39.528 } 00:20:39.528 }, 00:20:39.528 { 00:20:39.528 "method": "nvmf_subsystem_add_host", 00:20:39.528 "params": { 00:20:39.528 "host": "nqn.2016-06.io.spdk:host1", 00:20:39.528 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:20:39.528 "psk": "key0" 00:20:39.528 } 00:20:39.528 }, 00:20:39.528 { 00:20:39.528 "method": "nvmf_subsystem_add_ns", 00:20:39.528 "params": { 00:20:39.528 "namespace": { 00:20:39.528 "bdev_name": "malloc0", 00:20:39.528 "nguid": "067968FBDB784948B5987B3B089FBCA0", 00:20:39.528 "no_auto_visible": false, 00:20:39.528 "nsid": 1, 00:20:39.528 "uuid": "067968fb-db78-4948-b598-7b3b089fbca0" 00:20:39.528 }, 00:20:39.528 "nqn": "nqn.2016-06.io.spdk:cnode1" 00:20:39.528 } 00:20:39.528 }, 00:20:39.528 { 00:20:39.528 "method": "nvmf_subsystem_add_listener", 00:20:39.528 "params": { 00:20:39.528 "listen_address": { 00:20:39.528 "adrfam": "IPv4", 00:20:39.528 "traddr": "10.0.0.3", 00:20:39.528 "trsvcid": "4420", 00:20:39.528 "trtype": "TCP" 00:20:39.528 }, 00:20:39.528 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:20:39.528 "secure_channel": true 00:20:39.528 } 00:20:39.528 } 00:20:39.528 ] 00:20:39.528 } 00:20:39.528 ] 00:20:39.528 }' 00:20:39.528 11:31:34 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@724 -- # xtrace_disable 00:20:39.528 11:31:34 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@10 -- # set +x 00:20:39.528 11:31:34 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@507 -- # nvmfpid=84703 00:20:39.528 11:31:34 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@506 -- # ip netns exec nvmf_tgt_ns_spdk /home/vagrant/spdk_repo/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x2 -c /dev/fd/62 00:20:39.528 11:31:34 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@508 -- # waitforlisten 84703 00:20:39.528 11:31:34 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@831 -- # '[' -z 84703 ']' 00:20:39.528 11:31:34 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@835 -- # local rpc_addr=/var/tmp/spdk.sock 00:20:39.528 11:31:34 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@836 -- # local max_retries=100 00:20:39.528 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:20:39.528 11:31:34 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@838 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:20:39.528 11:31:34 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@840 -- # xtrace_disable 00:20:39.528 11:31:34 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@10 -- # set +x 00:20:39.528 [2024-10-07 11:31:34.913600] Starting SPDK v25.01-pre git sha1 2a4f56c54 / DPDK 24.03.0 initialization... 00:20:39.529 [2024-10-07 11:31:34.913719] [ DPDK EAL parameters: nvmf -c 0x2 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --iova-mode=pa --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:20:39.787 [2024-10-07 11:31:35.051339] app.c: 917:spdk_app_start: *NOTICE*: Total cores available: 1 00:20:39.787 [2024-10-07 11:31:35.181828] app.c: 610:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:20:39.787 [2024-10-07 11:31:35.181887] app.c: 611:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:20:39.787 [2024-10-07 11:31:35.181903] app.c: 616:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:20:39.787 [2024-10-07 11:31:35.181913] app.c: 617:app_setup_trace: *NOTICE*: SPDK application currently running. 00:20:39.787 [2024-10-07 11:31:35.181924] app.c: 618:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:20:39.787 [2024-10-07 11:31:35.182387] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 1 00:20:40.045 [2024-10-07 11:31:35.433109] tcp.c: 738:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:20:40.045 [2024-10-07 11:31:35.478136] tcp.c:1031:nvmf_tcp_listen: *NOTICE*: TLS support is considered experimental 00:20:40.045 [2024-10-07 11:31:35.478363] tcp.c:1081:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.3 port 4420 *** 00:20:40.612 11:31:35 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@860 -- # (( i == 0 )) 00:20:40.612 11:31:35 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@864 -- # return 0 00:20:40.612 11:31:35 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@509 -- # timing_exit start_nvmf_tgt 00:20:40.612 11:31:35 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@730 -- # xtrace_disable 00:20:40.612 11:31:35 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@10 -- # set +x 00:20:40.612 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:20:40.612 11:31:36 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@510 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:20:40.612 11:31:36 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@209 -- # bdevperf_pid=84747 00:20:40.612 11:31:36 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@210 -- # waitforlisten 84747 /var/tmp/bdevperf.sock 00:20:40.612 11:31:36 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@831 -- # '[' -z 84747 ']' 00:20:40.612 11:31:36 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@835 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:20:40.612 11:31:36 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@836 -- # local max_retries=100 00:20:40.612 11:31:36 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@838 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:20:40.612 11:31:36 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@840 -- # xtrace_disable 00:20:40.612 11:31:36 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@10 -- # set +x 00:20:40.612 11:31:36 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@206 -- # /home/vagrant/spdk_repo/spdk/build/examples/bdevperf -m 0x4 -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 10 -c /dev/fd/63 00:20:40.612 11:31:36 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@206 -- # echo '{ 00:20:40.612 "subsystems": [ 00:20:40.612 { 00:20:40.612 "subsystem": "keyring", 00:20:40.612 "config": [ 00:20:40.612 { 00:20:40.612 "method": "keyring_file_add_key", 00:20:40.612 "params": { 00:20:40.612 "name": "key0", 00:20:40.612 "path": "/tmp/tmp.ca2SZhyGHH" 00:20:40.612 } 00:20:40.612 } 00:20:40.612 ] 00:20:40.612 }, 00:20:40.612 { 00:20:40.612 "subsystem": "iobuf", 00:20:40.612 "config": [ 00:20:40.612 { 00:20:40.612 "method": "iobuf_set_options", 00:20:40.612 "params": { 00:20:40.612 "large_bufsize": 135168, 00:20:40.612 "large_pool_count": 1024, 00:20:40.612 "small_bufsize": 8192, 00:20:40.612 "small_pool_count": 8192 00:20:40.612 } 00:20:40.612 } 00:20:40.612 ] 00:20:40.612 }, 00:20:40.612 { 00:20:40.612 "subsystem": "sock", 00:20:40.612 "config": [ 00:20:40.613 { 00:20:40.613 "method": "sock_set_default_impl", 00:20:40.613 "params": { 00:20:40.613 "impl_name": "posix" 00:20:40.613 } 00:20:40.613 }, 00:20:40.613 { 00:20:40.613 "method": "sock_impl_set_options", 00:20:40.613 "params": { 00:20:40.613 "enable_ktls": false, 00:20:40.613 "enable_placement_id": 0, 00:20:40.613 "enable_quickack": false, 00:20:40.613 "enable_recv_pipe": true, 00:20:40.613 "enable_zerocopy_send_client": false, 00:20:40.613 "enable_zerocopy_send_server": true, 00:20:40.613 "impl_name": "ssl", 00:20:40.613 "recv_buf_size": 4096, 00:20:40.613 "send_buf_size": 4096, 00:20:40.613 "tls_version": 0, 00:20:40.613 "zerocopy_threshold": 0 00:20:40.613 } 00:20:40.613 }, 00:20:40.613 { 00:20:40.613 "method": "sock_impl_set_options", 00:20:40.613 "params": { 00:20:40.613 "enable_ktls": false, 00:20:40.613 "enable_placement_id": 0, 00:20:40.613 "enable_quickack": false, 00:20:40.613 "enable_recv_pipe": true, 00:20:40.613 "enable_zerocopy_send_client": false, 00:20:40.613 "enable_zerocopy_send_server": true, 00:20:40.613 "impl_name": "posix", 00:20:40.613 "recv_buf_size": 2097152, 00:20:40.613 "send_buf_size": 2097152, 00:20:40.613 "tls_version": 0, 00:20:40.613 "zerocopy_threshold": 0 00:20:40.613 } 00:20:40.613 } 00:20:40.613 ] 00:20:40.613 }, 00:20:40.613 { 00:20:40.613 "subsystem": "vmd", 00:20:40.613 "config": [] 00:20:40.613 }, 00:20:40.613 { 00:20:40.613 "subsystem": "accel", 00:20:40.613 "config": [ 00:20:40.613 { 00:20:40.613 "method": "accel_set_options", 00:20:40.613 "params": { 00:20:40.613 "buf_count": 2048, 00:20:40.613 "large_cache_size": 16, 00:20:40.613 "sequence_count": 2048, 00:20:40.613 "small_cache_size": 128, 00:20:40.613 "task_count": 2048 00:20:40.613 } 00:20:40.613 } 00:20:40.613 ] 00:20:40.613 }, 00:20:40.613 { 00:20:40.613 "subsystem": "bdev", 00:20:40.613 "config": [ 00:20:40.613 { 00:20:40.613 "method": "bdev_set_options", 00:20:40.613 "params": { 00:20:40.613 "bdev_auto_examine": true, 00:20:40.613 "bdev_io_cache_size": 256, 00:20:40.613 "bdev_io_pool_size": 65535, 00:20:40.613 "iobuf_large_cache_size": 16, 00:20:40.613 "iobuf_small_cache_size": 128 00:20:40.613 } 00:20:40.613 }, 00:20:40.613 { 00:20:40.613 "method": "bdev_raid_set_options", 00:20:40.613 "params": { 00:20:40.613 "process_max_bandwidth_mb_sec": 0, 00:20:40.613 "process_window_size_kb": 1024 00:20:40.613 } 00:20:40.613 }, 00:20:40.613 { 00:20:40.613 "method": "bdev_iscsi_set_options", 00:20:40.613 "params": { 00:20:40.613 "timeout_sec": 30 00:20:40.613 } 00:20:40.613 }, 00:20:40.613 { 00:20:40.613 "method": "bdev_nvme_set_options", 00:20:40.613 "params": { 00:20:40.613 "action_on_timeout": "none", 00:20:40.613 "allow_accel_sequence": false, 00:20:40.613 "arbitration_burst": 0, 00:20:40.613 "bdev_retry_count": 3, 00:20:40.613 "ctrlr_loss_timeout_sec": 0, 00:20:40.613 "delay_cmd_submit": true, 00:20:40.613 "dhchap_dhgroups": [ 00:20:40.613 "null", 00:20:40.613 "ffdhe2048", 00:20:40.613 "ffdhe3072", 00:20:40.613 "ffdhe4096", 00:20:40.613 "ffdhe6144", 00:20:40.613 "ffdhe8192" 00:20:40.613 ], 00:20:40.613 "dhchap_digests": [ 00:20:40.613 "sha256", 00:20:40.613 "sha384", 00:20:40.613 "sha512" 00:20:40.613 ], 00:20:40.613 "disable_auto_failback": false, 00:20:40.613 "fast_io_fail_timeout_sec": 0, 00:20:40.613 "generate_uuids": false, 00:20:40.613 "high_priority_weight": 0, 00:20:40.613 "io_path_stat": false, 00:20:40.613 "io_queue_requests": 512, 00:20:40.613 "keep_alive_timeout_ms": 10000, 00:20:40.613 "low_priority_weight": 0, 00:20:40.613 "medium_priority_weight": 0, 00:20:40.613 "nvme_adminq_poll_period_us": 10000, 00:20:40.613 "nvme_error_stat": false, 00:20:40.613 "nvme_ioq_poll_period_us": 0, 00:20:40.613 "rdma_cm_event_timeout_ms": 0, 00:20:40.613 "rdma_max_cq_size": 0, 00:20:40.613 "rdma_srq_size": 0, 00:20:40.613 "reconnect_delay_sec": 0, 00:20:40.613 "timeout_admin_us": 0, 00:20:40.613 "timeout_us": 0, 00:20:40.613 "transport_ack_timeout": 0, 00:20:40.613 "transport_retry_count": 4, 00:20:40.613 "transport_tos": 0 00:20:40.613 } 00:20:40.613 }, 00:20:40.613 { 00:20:40.613 "method": "bdev_nvme_attach_controller", 00:20:40.613 "params": { 00:20:40.613 "adrfam": "IPv4", 00:20:40.613 "ctrlr_loss_timeout_sec": 0, 00:20:40.613 "ddgst": false, 00:20:40.613 "fast_io_fail_timeout_sec": 0, 00:20:40.613 "hdgst": false, 00:20:40.613 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:20:40.613 "multipath": "multipath", 00:20:40.613 "name": "TLSTEST", 00:20:40.613 "prchk_guard": false, 00:20:40.613 "prchk_reftag": false, 00:20:40.613 "psk": "key0", 00:20:40.613 "reconnect_delay_sec": 0, 00:20:40.613 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:20:40.613 "traddr": "10.0.0.3", 00:20:40.613 "trsvcid": "4420", 00:20:40.613 "trtype": "TCP" 00:20:40.613 } 00:20:40.613 }, 00:20:40.613 { 00:20:40.613 "method": "bdev_nvme_set_hotplug", 00:20:40.613 "params": { 00:20:40.613 "enable": false, 00:20:40.613 "period_us": 100000 00:20:40.613 } 00:20:40.613 }, 00:20:40.613 { 00:20:40.613 "method": "bdev_wait_for_examine" 00:20:40.613 } 00:20:40.613 ] 00:20:40.613 }, 00:20:40.613 { 00:20:40.613 "subsystem": "nbd", 00:20:40.613 "config": [] 00:20:40.613 } 00:20:40.613 ] 00:20:40.613 }' 00:20:40.613 [2024-10-07 11:31:36.106615] Starting SPDK v25.01-pre git sha1 2a4f56c54 / DPDK 24.03.0 initialization... 00:20:40.613 [2024-10-07 11:31:36.106769] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x4 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --iova-mode=pa --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid84747 ] 00:20:40.872 [2024-10-07 11:31:36.248059] app.c: 917:spdk_app_start: *NOTICE*: Total cores available: 1 00:20:41.130 [2024-10-07 11:31:36.421627] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 2 00:20:41.130 [2024-10-07 11:31:36.638170] bdev_nvme_rpc.c: 514:rpc_bdev_nvme_attach_controller: *NOTICE*: TLS support is considered experimental 00:20:41.710 11:31:37 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@860 -- # (( i == 0 )) 00:20:41.710 11:31:37 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@864 -- # return 0 00:20:41.710 11:31:37 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@213 -- # /home/vagrant/spdk_repo/spdk/examples/bdev/bdevperf/bdevperf.py -t 20 -s /var/tmp/bdevperf.sock perform_tests 00:20:41.978 Running I/O for 10 seconds... 00:20:43.847 3156.00 IOPS, 12.33 MiB/s [2024-10-07T11:31:40.746Z] 3326.50 IOPS, 12.99 MiB/s [2024-10-07T11:31:41.680Z] 3391.67 IOPS, 13.25 MiB/s [2024-10-07T11:31:42.613Z] 3402.50 IOPS, 13.29 MiB/s [2024-10-07T11:31:43.547Z] 3432.00 IOPS, 13.41 MiB/s [2024-10-07T11:31:44.511Z] 3451.00 IOPS, 13.48 MiB/s [2024-10-07T11:31:45.445Z] 3466.71 IOPS, 13.54 MiB/s [2024-10-07T11:31:46.379Z] 3477.75 IOPS, 13.58 MiB/s [2024-10-07T11:31:47.752Z] 3476.89 IOPS, 13.58 MiB/s [2024-10-07T11:31:47.752Z] 3488.30 IOPS, 13.63 MiB/s 00:20:52.229 Latency(us) 00:20:52.229 [2024-10-07T11:31:47.752Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:20:52.229 Job: TLSTESTn1 (Core Mask 0x4, workload: verify, depth: 128, IO size: 4096) 00:20:52.229 Verification LBA range: start 0x0 length 0x2000 00:20:52.229 TLSTESTn1 : 10.02 3494.29 13.65 0.00 0.00 36565.64 6404.65 51475.55 00:20:52.229 [2024-10-07T11:31:47.752Z] =================================================================================================================== 00:20:52.229 [2024-10-07T11:31:47.752Z] Total : 3494.29 13.65 0.00 0.00 36565.64 6404.65 51475.55 00:20:52.229 { 00:20:52.229 "results": [ 00:20:52.229 { 00:20:52.229 "job": "TLSTESTn1", 00:20:52.229 "core_mask": "0x4", 00:20:52.229 "workload": "verify", 00:20:52.229 "status": "finished", 00:20:52.229 "verify_range": { 00:20:52.229 "start": 0, 00:20:52.229 "length": 8192 00:20:52.229 }, 00:20:52.229 "queue_depth": 128, 00:20:52.229 "io_size": 4096, 00:20:52.229 "runtime": 10.018918, 00:20:52.229 "iops": 3494.2895031180014, 00:20:52.229 "mibps": 13.649568371554693, 00:20:52.229 "io_failed": 0, 00:20:52.229 "io_timeout": 0, 00:20:52.229 "avg_latency_us": 36565.64364965892, 00:20:52.229 "min_latency_us": 6404.654545454546, 00:20:52.229 "max_latency_us": 51475.54909090909 00:20:52.229 } 00:20:52.229 ], 00:20:52.229 "core_count": 1 00:20:52.229 } 00:20:52.229 11:31:47 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@215 -- # trap 'nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:20:52.229 11:31:47 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@216 -- # killprocess 84747 00:20:52.229 11:31:47 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@950 -- # '[' -z 84747 ']' 00:20:52.229 11:31:47 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@954 -- # kill -0 84747 00:20:52.229 11:31:47 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@955 -- # uname 00:20:52.229 11:31:47 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@955 -- # '[' Linux = Linux ']' 00:20:52.229 11:31:47 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@956 -- # ps --no-headers -o comm= 84747 00:20:52.229 killing process with pid 84747 00:20:52.229 Received shutdown signal, test time was about 10.000000 seconds 00:20:52.229 00:20:52.229 Latency(us) 00:20:52.229 [2024-10-07T11:31:47.752Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:20:52.229 [2024-10-07T11:31:47.752Z] =================================================================================================================== 00:20:52.229 [2024-10-07T11:31:47.752Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:20:52.229 11:31:47 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@956 -- # process_name=reactor_2 00:20:52.229 11:31:47 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@960 -- # '[' reactor_2 = sudo ']' 00:20:52.229 11:31:47 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@968 -- # echo 'killing process with pid 84747' 00:20:52.229 11:31:47 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@969 -- # kill 84747 00:20:52.229 11:31:47 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@974 -- # wait 84747 00:20:52.487 11:31:47 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@217 -- # killprocess 84703 00:20:52.487 11:31:47 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@950 -- # '[' -z 84703 ']' 00:20:52.487 11:31:47 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@954 -- # kill -0 84703 00:20:52.487 11:31:47 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@955 -- # uname 00:20:52.487 11:31:47 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@955 -- # '[' Linux = Linux ']' 00:20:52.487 11:31:47 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@956 -- # ps --no-headers -o comm= 84703 00:20:52.487 killing process with pid 84703 00:20:52.487 11:31:47 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@956 -- # process_name=reactor_1 00:20:52.487 11:31:47 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@960 -- # '[' reactor_1 = sudo ']' 00:20:52.487 11:31:47 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@968 -- # echo 'killing process with pid 84703' 00:20:52.487 11:31:47 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@969 -- # kill 84703 00:20:52.487 11:31:47 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@974 -- # wait 84703 00:20:52.744 11:31:48 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@220 -- # nvmfappstart 00:20:52.744 11:31:48 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@505 -- # timing_enter start_nvmf_tgt 00:20:52.744 11:31:48 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@724 -- # xtrace_disable 00:20:52.744 11:31:48 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@10 -- # set +x 00:20:52.744 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:20:52.744 11:31:48 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@507 -- # nvmfpid=84898 00:20:52.744 11:31:48 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@508 -- # waitforlisten 84898 00:20:52.744 11:31:48 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@831 -- # '[' -z 84898 ']' 00:20:52.744 11:31:48 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@835 -- # local rpc_addr=/var/tmp/spdk.sock 00:20:52.744 11:31:48 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@836 -- # local max_retries=100 00:20:52.744 11:31:48 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@838 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:20:52.744 11:31:48 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@840 -- # xtrace_disable 00:20:52.744 11:31:48 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@10 -- # set +x 00:20:52.744 11:31:48 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@506 -- # ip netns exec nvmf_tgt_ns_spdk /home/vagrant/spdk_repo/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF 00:20:52.744 [2024-10-07 11:31:48.125141] Starting SPDK v25.01-pre git sha1 2a4f56c54 / DPDK 24.03.0 initialization... 00:20:52.744 [2024-10-07 11:31:48.125268] [ DPDK EAL parameters: nvmf -c 0x1 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --iova-mode=pa --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:20:53.001 [2024-10-07 11:31:48.268735] app.c: 917:spdk_app_start: *NOTICE*: Total cores available: 1 00:20:53.001 [2024-10-07 11:31:48.390502] app.c: 610:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:20:53.001 [2024-10-07 11:31:48.390570] app.c: 611:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:20:53.001 [2024-10-07 11:31:48.390586] app.c: 616:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:20:53.001 [2024-10-07 11:31:48.390597] app.c: 617:app_setup_trace: *NOTICE*: SPDK application currently running. 00:20:53.001 [2024-10-07 11:31:48.390607] app.c: 618:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:20:53.001 [2024-10-07 11:31:48.391108] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 0 00:20:53.966 11:31:49 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@860 -- # (( i == 0 )) 00:20:53.966 11:31:49 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@864 -- # return 0 00:20:53.966 11:31:49 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@509 -- # timing_exit start_nvmf_tgt 00:20:53.966 11:31:49 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@730 -- # xtrace_disable 00:20:53.966 11:31:49 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@10 -- # set +x 00:20:53.966 11:31:49 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@510 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:20:53.966 11:31:49 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@221 -- # setup_nvmf_tgt /tmp/tmp.ca2SZhyGHH 00:20:53.966 11:31:49 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@50 -- # local key=/tmp/tmp.ca2SZhyGHH 00:20:53.966 11:31:49 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@52 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_create_transport -t tcp -o 00:20:54.230 [2024-10-07 11:31:49.603645] tcp.c: 738:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:20:54.230 11:31:49 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@53 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDK00000000000001 -m 10 00:20:54.488 11:31:49 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@54 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.3 -s 4420 -k 00:20:54.746 [2024-10-07 11:31:50.207772] tcp.c:1031:nvmf_tcp_listen: *NOTICE*: TLS support is considered experimental 00:20:54.746 [2024-10-07 11:31:50.208073] tcp.c:1081:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.3 port 4420 *** 00:20:54.746 11:31:50 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@56 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py bdev_malloc_create 32 4096 -b malloc0 00:20:55.311 malloc0 00:20:55.311 11:31:50 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@57 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 malloc0 -n 1 00:20:55.569 11:31:50 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@58 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py keyring_file_add_key key0 /tmp/tmp.ca2SZhyGHH 00:20:55.827 11:31:51 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@59 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_add_host nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 --psk key0 00:20:56.085 11:31:51 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@222 -- # /home/vagrant/spdk_repo/spdk/build/examples/bdevperf -m 2 -z -r /var/tmp/bdevperf.sock -q 128 -o 4k -w verify -t 1 00:20:56.085 11:31:51 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@224 -- # bdevperf_pid=85012 00:20:56.085 11:31:51 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@226 -- # trap 'cleanup; exit 1' SIGINT SIGTERM EXIT 00:20:56.085 11:31:51 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@227 -- # waitforlisten 85012 /var/tmp/bdevperf.sock 00:20:56.085 11:31:51 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@831 -- # '[' -z 85012 ']' 00:20:56.085 11:31:51 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@835 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:20:56.085 11:31:51 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@836 -- # local max_retries=100 00:20:56.085 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:20:56.085 11:31:51 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@838 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:20:56.085 11:31:51 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@840 -- # xtrace_disable 00:20:56.085 11:31:51 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@10 -- # set +x 00:20:56.085 [2024-10-07 11:31:51.499754] Starting SPDK v25.01-pre git sha1 2a4f56c54 / DPDK 24.03.0 initialization... 00:20:56.085 [2024-10-07 11:31:51.499863] [ DPDK EAL parameters: bdevperf --no-shconf -c 2 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --iova-mode=pa --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid85012 ] 00:20:56.343 [2024-10-07 11:31:51.637742] app.c: 917:spdk_app_start: *NOTICE*: Total cores available: 1 00:20:56.343 [2024-10-07 11:31:51.759165] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 1 00:20:57.277 11:31:52 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@860 -- # (( i == 0 )) 00:20:57.277 11:31:52 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@864 -- # return 0 00:20:57.277 11:31:52 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@229 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock keyring_file_add_key key0 /tmp/tmp.ca2SZhyGHH 00:20:57.535 11:31:52 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@230 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b nvme0 -t tcp -a 10.0.0.3 -s 4420 -f ipv4 --psk key0 -n nqn.2016-06.io.spdk:cnode1 -q nqn.2016-06.io.spdk:host1 00:20:57.793 [2024-10-07 11:31:53.197308] bdev_nvme_rpc.c: 514:rpc_bdev_nvme_attach_controller: *NOTICE*: TLS support is considered experimental 00:20:57.793 nvme0n1 00:20:57.793 11:31:53 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@234 -- # /home/vagrant/spdk_repo/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bdevperf.sock perform_tests 00:20:58.051 Running I/O for 1 seconds... 00:20:59.001 3784.00 IOPS, 14.78 MiB/s 00:20:59.001 Latency(us) 00:20:59.001 [2024-10-07T11:31:54.524Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:20:59.001 Job: nvme0n1 (Core Mask 0x2, workload: verify, depth: 128, IO size: 4096) 00:20:59.001 Verification LBA range: start 0x0 length 0x2000 00:20:59.001 nvme0n1 : 1.03 3813.07 14.89 0.00 0.00 33081.27 7119.59 19422.49 00:20:59.001 [2024-10-07T11:31:54.524Z] =================================================================================================================== 00:20:59.001 [2024-10-07T11:31:54.524Z] Total : 3813.07 14.89 0.00 0.00 33081.27 7119.59 19422.49 00:20:59.001 { 00:20:59.001 "results": [ 00:20:59.001 { 00:20:59.001 "job": "nvme0n1", 00:20:59.001 "core_mask": "0x2", 00:20:59.001 "workload": "verify", 00:20:59.001 "status": "finished", 00:20:59.001 "verify_range": { 00:20:59.001 "start": 0, 00:20:59.001 "length": 8192 00:20:59.001 }, 00:20:59.001 "queue_depth": 128, 00:20:59.001 "io_size": 4096, 00:20:59.001 "runtime": 1.026207, 00:20:59.001 "iops": 3813.0708521769975, 00:20:59.001 "mibps": 14.894808016316397, 00:20:59.001 "io_failed": 0, 00:20:59.001 "io_timeout": 0, 00:20:59.001 "avg_latency_us": 33081.26506423809, 00:20:59.001 "min_latency_us": 7119.592727272728, 00:20:59.001 "max_latency_us": 19422.487272727274 00:20:59.001 } 00:20:59.001 ], 00:20:59.001 "core_count": 1 00:20:59.001 } 00:20:59.001 11:31:54 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@236 -- # killprocess 85012 00:20:59.001 11:31:54 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@950 -- # '[' -z 85012 ']' 00:20:59.001 11:31:54 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@954 -- # kill -0 85012 00:20:59.001 11:31:54 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@955 -- # uname 00:20:59.001 11:31:54 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@955 -- # '[' Linux = Linux ']' 00:20:59.001 11:31:54 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@956 -- # ps --no-headers -o comm= 85012 00:20:59.001 killing process with pid 85012 00:20:59.001 Received shutdown signal, test time was about 1.000000 seconds 00:20:59.001 00:20:59.001 Latency(us) 00:20:59.001 [2024-10-07T11:31:54.525Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:20:59.002 [2024-10-07T11:31:54.525Z] =================================================================================================================== 00:20:59.002 [2024-10-07T11:31:54.525Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:20:59.002 11:31:54 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@956 -- # process_name=reactor_1 00:20:59.002 11:31:54 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@960 -- # '[' reactor_1 = sudo ']' 00:20:59.002 11:31:54 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@968 -- # echo 'killing process with pid 85012' 00:20:59.002 11:31:54 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@969 -- # kill 85012 00:20:59.002 11:31:54 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@974 -- # wait 85012 00:20:59.259 11:31:54 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@237 -- # killprocess 84898 00:20:59.259 11:31:54 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@950 -- # '[' -z 84898 ']' 00:20:59.259 11:31:54 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@954 -- # kill -0 84898 00:20:59.259 11:31:54 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@955 -- # uname 00:20:59.259 11:31:54 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@955 -- # '[' Linux = Linux ']' 00:20:59.259 11:31:54 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@956 -- # ps --no-headers -o comm= 84898 00:20:59.526 killing process with pid 84898 00:20:59.526 11:31:54 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@956 -- # process_name=reactor_0 00:20:59.526 11:31:54 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@960 -- # '[' reactor_0 = sudo ']' 00:20:59.526 11:31:54 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@968 -- # echo 'killing process with pid 84898' 00:20:59.526 11:31:54 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@969 -- # kill 84898 00:20:59.526 11:31:54 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@974 -- # wait 84898 00:20:59.802 11:31:55 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@242 -- # nvmfappstart 00:20:59.802 11:31:55 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@505 -- # timing_enter start_nvmf_tgt 00:20:59.802 11:31:55 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@724 -- # xtrace_disable 00:20:59.802 11:31:55 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@10 -- # set +x 00:20:59.802 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:20:59.802 11:31:55 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@506 -- # ip netns exec nvmf_tgt_ns_spdk /home/vagrant/spdk_repo/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF 00:20:59.802 11:31:55 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@507 -- # nvmfpid=85093 00:20:59.802 11:31:55 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@508 -- # waitforlisten 85093 00:20:59.802 11:31:55 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@831 -- # '[' -z 85093 ']' 00:20:59.802 11:31:55 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@835 -- # local rpc_addr=/var/tmp/spdk.sock 00:20:59.802 11:31:55 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@836 -- # local max_retries=100 00:20:59.802 11:31:55 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@838 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:20:59.802 11:31:55 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@840 -- # xtrace_disable 00:20:59.802 11:31:55 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@10 -- # set +x 00:20:59.803 [2024-10-07 11:31:55.127328] Starting SPDK v25.01-pre git sha1 2a4f56c54 / DPDK 24.03.0 initialization... 00:20:59.803 [2024-10-07 11:31:55.127411] [ DPDK EAL parameters: nvmf -c 0x1 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --iova-mode=pa --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:20:59.803 [2024-10-07 11:31:55.264129] app.c: 917:spdk_app_start: *NOTICE*: Total cores available: 1 00:21:00.060 [2024-10-07 11:31:55.377925] app.c: 610:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:21:00.060 [2024-10-07 11:31:55.378010] app.c: 611:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:21:00.060 [2024-10-07 11:31:55.378021] app.c: 616:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:21:00.060 [2024-10-07 11:31:55.378030] app.c: 617:app_setup_trace: *NOTICE*: SPDK application currently running. 00:21:00.060 [2024-10-07 11:31:55.378037] app.c: 618:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:21:00.060 [2024-10-07 11:31:55.378456] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 0 00:21:00.060 11:31:55 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@860 -- # (( i == 0 )) 00:21:00.060 11:31:55 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@864 -- # return 0 00:21:00.060 11:31:55 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@509 -- # timing_exit start_nvmf_tgt 00:21:00.060 11:31:55 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@730 -- # xtrace_disable 00:21:00.060 11:31:55 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@10 -- # set +x 00:21:00.060 11:31:55 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@510 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:21:00.060 11:31:55 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@243 -- # rpc_cmd 00:21:00.060 11:31:55 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@561 -- # xtrace_disable 00:21:00.060 11:31:55 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@10 -- # set +x 00:21:00.060 [2024-10-07 11:31:55.570641] tcp.c: 738:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:21:00.318 malloc0 00:21:00.318 [2024-10-07 11:31:55.602667] tcp.c:1031:nvmf_tcp_listen: *NOTICE*: TLS support is considered experimental 00:21:00.318 [2024-10-07 11:31:55.602897] tcp.c:1081:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.3 port 4420 *** 00:21:00.318 11:31:55 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:21:00.318 11:31:55 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@256 -- # bdevperf_pid=85125 00:21:00.318 11:31:55 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@254 -- # /home/vagrant/spdk_repo/spdk/build/examples/bdevperf -m 2 -z -r /var/tmp/bdevperf.sock -q 128 -o 4k -w verify -t 1 00:21:00.318 11:31:55 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@258 -- # waitforlisten 85125 /var/tmp/bdevperf.sock 00:21:00.318 11:31:55 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@831 -- # '[' -z 85125 ']' 00:21:00.318 11:31:55 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@835 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:21:00.318 11:31:55 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@836 -- # local max_retries=100 00:21:00.319 11:31:55 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@838 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:21:00.319 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:21:00.319 11:31:55 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@840 -- # xtrace_disable 00:21:00.319 11:31:55 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@10 -- # set +x 00:21:00.319 [2024-10-07 11:31:55.698976] Starting SPDK v25.01-pre git sha1 2a4f56c54 / DPDK 24.03.0 initialization... 00:21:00.319 [2024-10-07 11:31:55.699079] [ DPDK EAL parameters: bdevperf --no-shconf -c 2 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --iova-mode=pa --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid85125 ] 00:21:00.319 [2024-10-07 11:31:55.840913] app.c: 917:spdk_app_start: *NOTICE*: Total cores available: 1 00:21:00.576 [2024-10-07 11:31:55.984384] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 1 00:21:01.516 11:31:56 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@860 -- # (( i == 0 )) 00:21:01.516 11:31:56 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@864 -- # return 0 00:21:01.516 11:31:56 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@259 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock keyring_file_add_key key0 /tmp/tmp.ca2SZhyGHH 00:21:01.774 11:31:57 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@260 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b nvme0 -t tcp -a 10.0.0.3 -s 4420 -f ipv4 --psk key0 -n nqn.2016-06.io.spdk:cnode1 -q nqn.2016-06.io.spdk:host1 00:21:01.774 [2024-10-07 11:31:57.287423] bdev_nvme_rpc.c: 514:rpc_bdev_nvme_attach_controller: *NOTICE*: TLS support is considered experimental 00:21:02.032 nvme0n1 00:21:02.032 11:31:57 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@264 -- # /home/vagrant/spdk_repo/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bdevperf.sock perform_tests 00:21:02.032 Running I/O for 1 seconds... 00:21:03.413 3751.00 IOPS, 14.65 MiB/s 00:21:03.413 Latency(us) 00:21:03.413 [2024-10-07T11:31:58.936Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:21:03.413 Job: nvme0n1 (Core Mask 0x2, workload: verify, depth: 128, IO size: 4096) 00:21:03.413 Verification LBA range: start 0x0 length 0x2000 00:21:03.413 nvme0n1 : 1.02 3810.69 14.89 0.00 0.00 33259.19 6464.23 24784.52 00:21:03.413 [2024-10-07T11:31:58.936Z] =================================================================================================================== 00:21:03.413 [2024-10-07T11:31:58.936Z] Total : 3810.69 14.89 0.00 0.00 33259.19 6464.23 24784.52 00:21:03.413 { 00:21:03.413 "results": [ 00:21:03.413 { 00:21:03.413 "job": "nvme0n1", 00:21:03.413 "core_mask": "0x2", 00:21:03.413 "workload": "verify", 00:21:03.413 "status": "finished", 00:21:03.413 "verify_range": { 00:21:03.413 "start": 0, 00:21:03.413 "length": 8192 00:21:03.413 }, 00:21:03.413 "queue_depth": 128, 00:21:03.413 "io_size": 4096, 00:21:03.413 "runtime": 1.017926, 00:21:03.413 "iops": 3810.6895786137698, 00:21:03.413 "mibps": 14.885506166460038, 00:21:03.413 "io_failed": 0, 00:21:03.413 "io_timeout": 0, 00:21:03.413 "avg_latency_us": 33259.19361784903, 00:21:03.413 "min_latency_us": 6464.232727272727, 00:21:03.413 "max_latency_us": 24784.523636363636 00:21:03.413 } 00:21:03.413 ], 00:21:03.413 "core_count": 1 00:21:03.413 } 00:21:03.413 11:31:58 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@267 -- # rpc_cmd save_config 00:21:03.413 11:31:58 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@561 -- # xtrace_disable 00:21:03.413 11:31:58 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@10 -- # set +x 00:21:03.413 11:31:58 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:21:03.413 11:31:58 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@267 -- # tgtcfg='{ 00:21:03.413 "subsystems": [ 00:21:03.413 { 00:21:03.413 "subsystem": "keyring", 00:21:03.413 "config": [ 00:21:03.413 { 00:21:03.413 "method": "keyring_file_add_key", 00:21:03.413 "params": { 00:21:03.413 "name": "key0", 00:21:03.413 "path": "/tmp/tmp.ca2SZhyGHH" 00:21:03.413 } 00:21:03.413 } 00:21:03.413 ] 00:21:03.413 }, 00:21:03.413 { 00:21:03.413 "subsystem": "iobuf", 00:21:03.413 "config": [ 00:21:03.413 { 00:21:03.413 "method": "iobuf_set_options", 00:21:03.413 "params": { 00:21:03.413 "large_bufsize": 135168, 00:21:03.413 "large_pool_count": 1024, 00:21:03.413 "small_bufsize": 8192, 00:21:03.413 "small_pool_count": 8192 00:21:03.413 } 00:21:03.413 } 00:21:03.413 ] 00:21:03.413 }, 00:21:03.413 { 00:21:03.413 "subsystem": "sock", 00:21:03.413 "config": [ 00:21:03.413 { 00:21:03.413 "method": "sock_set_default_impl", 00:21:03.413 "params": { 00:21:03.413 "impl_name": "posix" 00:21:03.413 } 00:21:03.413 }, 00:21:03.413 { 00:21:03.413 "method": "sock_impl_set_options", 00:21:03.413 "params": { 00:21:03.413 "enable_ktls": false, 00:21:03.413 "enable_placement_id": 0, 00:21:03.413 "enable_quickack": false, 00:21:03.413 "enable_recv_pipe": true, 00:21:03.413 "enable_zerocopy_send_client": false, 00:21:03.413 "enable_zerocopy_send_server": true, 00:21:03.413 "impl_name": "ssl", 00:21:03.413 "recv_buf_size": 4096, 00:21:03.413 "send_buf_size": 4096, 00:21:03.413 "tls_version": 0, 00:21:03.413 "zerocopy_threshold": 0 00:21:03.413 } 00:21:03.413 }, 00:21:03.413 { 00:21:03.413 "method": "sock_impl_set_options", 00:21:03.413 "params": { 00:21:03.413 "enable_ktls": false, 00:21:03.413 "enable_placement_id": 0, 00:21:03.413 "enable_quickack": false, 00:21:03.413 "enable_recv_pipe": true, 00:21:03.413 "enable_zerocopy_send_client": false, 00:21:03.413 "enable_zerocopy_send_server": true, 00:21:03.413 "impl_name": "posix", 00:21:03.413 "recv_buf_size": 2097152, 00:21:03.413 "send_buf_size": 2097152, 00:21:03.413 "tls_version": 0, 00:21:03.413 "zerocopy_threshold": 0 00:21:03.413 } 00:21:03.413 } 00:21:03.413 ] 00:21:03.413 }, 00:21:03.413 { 00:21:03.413 "subsystem": "vmd", 00:21:03.413 "config": [] 00:21:03.413 }, 00:21:03.413 { 00:21:03.413 "subsystem": "accel", 00:21:03.413 "config": [ 00:21:03.413 { 00:21:03.413 "method": "accel_set_options", 00:21:03.413 "params": { 00:21:03.413 "buf_count": 2048, 00:21:03.413 "large_cache_size": 16, 00:21:03.413 "sequence_count": 2048, 00:21:03.413 "small_cache_size": 128, 00:21:03.413 "task_count": 2048 00:21:03.413 } 00:21:03.413 } 00:21:03.413 ] 00:21:03.413 }, 00:21:03.413 { 00:21:03.413 "subsystem": "bdev", 00:21:03.413 "config": [ 00:21:03.413 { 00:21:03.413 "method": "bdev_set_options", 00:21:03.413 "params": { 00:21:03.413 "bdev_auto_examine": true, 00:21:03.413 "bdev_io_cache_size": 256, 00:21:03.413 "bdev_io_pool_size": 65535, 00:21:03.413 "iobuf_large_cache_size": 16, 00:21:03.413 "iobuf_small_cache_size": 128 00:21:03.413 } 00:21:03.413 }, 00:21:03.413 { 00:21:03.414 "method": "bdev_raid_set_options", 00:21:03.414 "params": { 00:21:03.414 "process_max_bandwidth_mb_sec": 0, 00:21:03.414 "process_window_size_kb": 1024 00:21:03.414 } 00:21:03.414 }, 00:21:03.414 { 00:21:03.414 "method": "bdev_iscsi_set_options", 00:21:03.414 "params": { 00:21:03.414 "timeout_sec": 30 00:21:03.414 } 00:21:03.414 }, 00:21:03.414 { 00:21:03.414 "method": "bdev_nvme_set_options", 00:21:03.414 "params": { 00:21:03.414 "action_on_timeout": "none", 00:21:03.414 "allow_accel_sequence": false, 00:21:03.414 "arbitration_burst": 0, 00:21:03.414 "bdev_retry_count": 3, 00:21:03.414 "ctrlr_loss_timeout_sec": 0, 00:21:03.414 "delay_cmd_submit": true, 00:21:03.414 "dhchap_dhgroups": [ 00:21:03.414 "null", 00:21:03.414 "ffdhe2048", 00:21:03.414 "ffdhe3072", 00:21:03.414 "ffdhe4096", 00:21:03.414 "ffdhe6144", 00:21:03.414 "ffdhe8192" 00:21:03.414 ], 00:21:03.414 "dhchap_digests": [ 00:21:03.414 "sha256", 00:21:03.414 "sha384", 00:21:03.414 "sha512" 00:21:03.414 ], 00:21:03.414 "disable_auto_failback": false, 00:21:03.414 "fast_io_fail_timeout_sec": 0, 00:21:03.414 "generate_uuids": false, 00:21:03.414 "high_priority_weight": 0, 00:21:03.414 "io_path_stat": false, 00:21:03.414 "io_queue_requests": 0, 00:21:03.414 "keep_alive_timeout_ms": 10000, 00:21:03.414 "low_priority_weight": 0, 00:21:03.414 "medium_priority_weight": 0, 00:21:03.414 "nvme_adminq_poll_period_us": 10000, 00:21:03.414 "nvme_error_stat": false, 00:21:03.414 "nvme_ioq_poll_period_us": 0, 00:21:03.414 "rdma_cm_event_timeout_ms": 0, 00:21:03.414 "rdma_max_cq_size": 0, 00:21:03.414 "rdma_srq_size": 0, 00:21:03.414 "reconnect_delay_sec": 0, 00:21:03.414 "timeout_admin_us": 0, 00:21:03.414 "timeout_us": 0, 00:21:03.414 "transport_ack_timeout": 0, 00:21:03.414 "transport_retry_count": 4, 00:21:03.414 "transport_tos": 0 00:21:03.414 } 00:21:03.414 }, 00:21:03.414 { 00:21:03.414 "method": "bdev_nvme_set_hotplug", 00:21:03.414 "params": { 00:21:03.414 "enable": false, 00:21:03.414 "period_us": 100000 00:21:03.414 } 00:21:03.414 }, 00:21:03.414 { 00:21:03.414 "method": "bdev_malloc_create", 00:21:03.414 "params": { 00:21:03.414 "block_size": 4096, 00:21:03.414 "dif_is_head_of_md": false, 00:21:03.414 "dif_pi_format": 0, 00:21:03.414 "dif_type": 0, 00:21:03.414 "md_size": 0, 00:21:03.414 "name": "malloc0", 00:21:03.414 "num_blocks": 8192, 00:21:03.414 "optimal_io_boundary": 0, 00:21:03.414 "physical_block_size": 4096, 00:21:03.414 "uuid": "c31bd3a1-8f2c-4483-8ee1-c3683a4ca970" 00:21:03.414 } 00:21:03.414 }, 00:21:03.414 { 00:21:03.414 "method": "bdev_wait_for_examine" 00:21:03.414 } 00:21:03.414 ] 00:21:03.414 }, 00:21:03.414 { 00:21:03.414 "subsystem": "nbd", 00:21:03.414 "config": [] 00:21:03.414 }, 00:21:03.414 { 00:21:03.414 "subsystem": "scheduler", 00:21:03.414 "config": [ 00:21:03.414 { 00:21:03.414 "method": "framework_set_scheduler", 00:21:03.414 "params": { 00:21:03.414 "name": "static" 00:21:03.414 } 00:21:03.414 } 00:21:03.414 ] 00:21:03.414 }, 00:21:03.414 { 00:21:03.414 "subsystem": "nvmf", 00:21:03.414 "config": [ 00:21:03.414 { 00:21:03.414 "method": "nvmf_set_config", 00:21:03.414 "params": { 00:21:03.414 "admin_cmd_passthru": { 00:21:03.414 "identify_ctrlr": false 00:21:03.414 }, 00:21:03.414 "dhchap_dhgroups": [ 00:21:03.414 "null", 00:21:03.414 "ffdhe2048", 00:21:03.414 "ffdhe3072", 00:21:03.414 "ffdhe4096", 00:21:03.414 "ffdhe6144", 00:21:03.414 "ffdhe8192" 00:21:03.414 ], 00:21:03.414 "dhchap_digests": [ 00:21:03.414 "sha256", 00:21:03.414 "sha384", 00:21:03.414 "sha512" 00:21:03.414 ], 00:21:03.414 "discovery_filter": "match_any" 00:21:03.414 } 00:21:03.414 }, 00:21:03.414 { 00:21:03.414 "method": "nvmf_set_max_subsystems", 00:21:03.414 "params": { 00:21:03.414 "max_subsystems": 1024 00:21:03.414 } 00:21:03.414 }, 00:21:03.414 { 00:21:03.414 "method": "nvmf_set_crdt", 00:21:03.414 "params": { 00:21:03.414 "crdt1": 0, 00:21:03.414 "crdt2": 0, 00:21:03.414 "crdt3": 0 00:21:03.414 } 00:21:03.414 }, 00:21:03.414 { 00:21:03.414 "method": "nvmf_create_transport", 00:21:03.414 "params": { 00:21:03.414 "abort_timeout_sec": 1, 00:21:03.414 "ack_timeout": 0, 00:21:03.414 "buf_cache_size": 4294967295, 00:21:03.414 "c2h_success": false, 00:21:03.414 "data_wr_pool_size": 0, 00:21:03.414 "dif_insert_or_strip": false, 00:21:03.414 "in_capsule_data_size": 4096, 00:21:03.414 "io_unit_size": 131072, 00:21:03.414 "max_aq_depth": 128, 00:21:03.414 "max_io_qpairs_per_ctrlr": 127, 00:21:03.414 "max_io_size": 131072, 00:21:03.414 "max_queue_depth": 128, 00:21:03.414 "num_shared_buffers": 511, 00:21:03.414 "sock_priority": 0, 00:21:03.414 "trtype": "TCP", 00:21:03.414 "zcopy": false 00:21:03.414 } 00:21:03.414 }, 00:21:03.414 { 00:21:03.414 "method": "nvmf_create_subsystem", 00:21:03.414 "params": { 00:21:03.414 "allow_any_host": false, 00:21:03.414 "ana_reporting": false, 00:21:03.414 "max_cntlid": 65519, 00:21:03.414 "max_namespaces": 32, 00:21:03.414 "min_cntlid": 1, 00:21:03.414 "model_number": "SPDK bdev Controller", 00:21:03.414 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:21:03.414 "serial_number": "00000000000000000000" 00:21:03.414 } 00:21:03.414 }, 00:21:03.414 { 00:21:03.414 "method": "nvmf_subsystem_add_host", 00:21:03.414 "params": { 00:21:03.414 "host": "nqn.2016-06.io.spdk:host1", 00:21:03.414 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:21:03.414 "psk": "key0" 00:21:03.414 } 00:21:03.414 }, 00:21:03.414 { 00:21:03.414 "method": "nvmf_subsystem_add_ns", 00:21:03.414 "params": { 00:21:03.414 "namespace": { 00:21:03.414 "bdev_name": "malloc0", 00:21:03.414 "nguid": "C31BD3A18F2C44838EE1C3683A4CA970", 00:21:03.414 "no_auto_visible": false, 00:21:03.414 "nsid": 1, 00:21:03.414 "uuid": "c31bd3a1-8f2c-4483-8ee1-c3683a4ca970" 00:21:03.414 }, 00:21:03.414 "nqn": "nqn.2016-06.io.spdk:cnode1" 00:21:03.414 } 00:21:03.414 }, 00:21:03.414 { 00:21:03.414 "method": "nvmf_subsystem_add_listener", 00:21:03.414 "params": { 00:21:03.414 "listen_address": { 00:21:03.414 "adrfam": "IPv4", 00:21:03.414 "traddr": "10.0.0.3", 00:21:03.414 "trsvcid": "4420", 00:21:03.414 "trtype": "TCP" 00:21:03.414 }, 00:21:03.414 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:21:03.414 "secure_channel": false, 00:21:03.414 "sock_impl": "ssl" 00:21:03.414 } 00:21:03.414 } 00:21:03.414 ] 00:21:03.414 } 00:21:03.414 ] 00:21:03.414 }' 00:21:03.414 11:31:58 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@268 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock save_config 00:21:03.674 11:31:59 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@268 -- # bperfcfg='{ 00:21:03.674 "subsystems": [ 00:21:03.674 { 00:21:03.674 "subsystem": "keyring", 00:21:03.674 "config": [ 00:21:03.674 { 00:21:03.674 "method": "keyring_file_add_key", 00:21:03.674 "params": { 00:21:03.674 "name": "key0", 00:21:03.674 "path": "/tmp/tmp.ca2SZhyGHH" 00:21:03.674 } 00:21:03.674 } 00:21:03.674 ] 00:21:03.674 }, 00:21:03.674 { 00:21:03.674 "subsystem": "iobuf", 00:21:03.674 "config": [ 00:21:03.674 { 00:21:03.674 "method": "iobuf_set_options", 00:21:03.674 "params": { 00:21:03.674 "large_bufsize": 135168, 00:21:03.674 "large_pool_count": 1024, 00:21:03.674 "small_bufsize": 8192, 00:21:03.674 "small_pool_count": 8192 00:21:03.674 } 00:21:03.674 } 00:21:03.674 ] 00:21:03.674 }, 00:21:03.674 { 00:21:03.674 "subsystem": "sock", 00:21:03.674 "config": [ 00:21:03.674 { 00:21:03.674 "method": "sock_set_default_impl", 00:21:03.674 "params": { 00:21:03.674 "impl_name": "posix" 00:21:03.674 } 00:21:03.674 }, 00:21:03.674 { 00:21:03.674 "method": "sock_impl_set_options", 00:21:03.674 "params": { 00:21:03.674 "enable_ktls": false, 00:21:03.674 "enable_placement_id": 0, 00:21:03.674 "enable_quickack": false, 00:21:03.674 "enable_recv_pipe": true, 00:21:03.674 "enable_zerocopy_send_client": false, 00:21:03.674 "enable_zerocopy_send_server": true, 00:21:03.674 "impl_name": "ssl", 00:21:03.674 "recv_buf_size": 4096, 00:21:03.674 "send_buf_size": 4096, 00:21:03.674 "tls_version": 0, 00:21:03.674 "zerocopy_threshold": 0 00:21:03.674 } 00:21:03.674 }, 00:21:03.674 { 00:21:03.674 "method": "sock_impl_set_options", 00:21:03.674 "params": { 00:21:03.674 "enable_ktls": false, 00:21:03.674 "enable_placement_id": 0, 00:21:03.674 "enable_quickack": false, 00:21:03.674 "enable_recv_pipe": true, 00:21:03.674 "enable_zerocopy_send_client": false, 00:21:03.674 "enable_zerocopy_send_server": true, 00:21:03.674 "impl_name": "posix", 00:21:03.674 "recv_buf_size": 2097152, 00:21:03.674 "send_buf_size": 2097152, 00:21:03.674 "tls_version": 0, 00:21:03.674 "zerocopy_threshold": 0 00:21:03.674 } 00:21:03.674 } 00:21:03.674 ] 00:21:03.674 }, 00:21:03.674 { 00:21:03.674 "subsystem": "vmd", 00:21:03.674 "config": [] 00:21:03.674 }, 00:21:03.674 { 00:21:03.674 "subsystem": "accel", 00:21:03.674 "config": [ 00:21:03.674 { 00:21:03.674 "method": "accel_set_options", 00:21:03.674 "params": { 00:21:03.674 "buf_count": 2048, 00:21:03.674 "large_cache_size": 16, 00:21:03.674 "sequence_count": 2048, 00:21:03.674 "small_cache_size": 128, 00:21:03.674 "task_count": 2048 00:21:03.674 } 00:21:03.674 } 00:21:03.674 ] 00:21:03.674 }, 00:21:03.674 { 00:21:03.674 "subsystem": "bdev", 00:21:03.674 "config": [ 00:21:03.674 { 00:21:03.674 "method": "bdev_set_options", 00:21:03.674 "params": { 00:21:03.674 "bdev_auto_examine": true, 00:21:03.674 "bdev_io_cache_size": 256, 00:21:03.674 "bdev_io_pool_size": 65535, 00:21:03.674 "iobuf_large_cache_size": 16, 00:21:03.674 "iobuf_small_cache_size": 128 00:21:03.674 } 00:21:03.674 }, 00:21:03.674 { 00:21:03.674 "method": "bdev_raid_set_options", 00:21:03.674 "params": { 00:21:03.674 "process_max_bandwidth_mb_sec": 0, 00:21:03.674 "process_window_size_kb": 1024 00:21:03.674 } 00:21:03.674 }, 00:21:03.674 { 00:21:03.674 "method": "bdev_iscsi_set_options", 00:21:03.674 "params": { 00:21:03.674 "timeout_sec": 30 00:21:03.674 } 00:21:03.674 }, 00:21:03.674 { 00:21:03.674 "method": "bdev_nvme_set_options", 00:21:03.674 "params": { 00:21:03.674 "action_on_timeout": "none", 00:21:03.675 "allow_accel_sequence": false, 00:21:03.675 "arbitration_burst": 0, 00:21:03.675 "bdev_retry_count": 3, 00:21:03.675 "ctrlr_loss_timeout_sec": 0, 00:21:03.675 "delay_cmd_submit": true, 00:21:03.675 "dhchap_dhgroups": [ 00:21:03.675 "null", 00:21:03.675 "ffdhe2048", 00:21:03.675 "ffdhe3072", 00:21:03.675 "ffdhe4096", 00:21:03.675 "ffdhe6144", 00:21:03.675 "ffdhe8192" 00:21:03.675 ], 00:21:03.675 "dhchap_digests": [ 00:21:03.675 "sha256", 00:21:03.675 "sha384", 00:21:03.675 "sha512" 00:21:03.675 ], 00:21:03.675 "disable_auto_failback": false, 00:21:03.675 "fast_io_fail_timeout_sec": 0, 00:21:03.675 "generate_uuids": false, 00:21:03.675 "high_priority_weight": 0, 00:21:03.675 "io_path_stat": false, 00:21:03.675 "io_queue_requests": 512, 00:21:03.675 "keep_alive_timeout_ms": 10000, 00:21:03.675 "low_priority_weight": 0, 00:21:03.675 "medium_priority_weight": 0, 00:21:03.675 "nvme_adminq_poll_period_us": 10000, 00:21:03.675 "nvme_error_stat": false, 00:21:03.675 "nvme_ioq_poll_period_us": 0, 00:21:03.675 "rdma_cm_event_timeout_ms": 0, 00:21:03.675 "rdma_max_cq_size": 0, 00:21:03.675 "rdma_srq_size": 0, 00:21:03.675 "reconnect_delay_sec": 0, 00:21:03.675 "timeout_admin_us": 0, 00:21:03.675 "timeout_us": 0, 00:21:03.675 "transport_ack_timeout": 0, 00:21:03.675 "transport_retry_count": 4, 00:21:03.675 "transport_tos": 0 00:21:03.675 } 00:21:03.675 }, 00:21:03.675 { 00:21:03.675 "method": "bdev_nvme_attach_controller", 00:21:03.675 "params": { 00:21:03.675 "adrfam": "IPv4", 00:21:03.675 "ctrlr_loss_timeout_sec": 0, 00:21:03.675 "ddgst": false, 00:21:03.675 "fast_io_fail_timeout_sec": 0, 00:21:03.675 "hdgst": false, 00:21:03.675 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:21:03.675 "multipath": "multipath", 00:21:03.675 "name": "nvme0", 00:21:03.675 "prchk_guard": false, 00:21:03.675 "prchk_reftag": false, 00:21:03.675 "psk": "key0", 00:21:03.675 "reconnect_delay_sec": 0, 00:21:03.675 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:21:03.675 "traddr": "10.0.0.3", 00:21:03.675 "trsvcid": "4420", 00:21:03.675 "trtype": "TCP" 00:21:03.675 } 00:21:03.675 }, 00:21:03.675 { 00:21:03.675 "method": "bdev_nvme_set_hotplug", 00:21:03.675 "params": { 00:21:03.675 "enable": false, 00:21:03.675 "period_us": 100000 00:21:03.675 } 00:21:03.675 }, 00:21:03.675 { 00:21:03.675 "method": "bdev_enable_histogram", 00:21:03.675 "params": { 00:21:03.675 "enable": true, 00:21:03.675 "name": "nvme0n1" 00:21:03.675 } 00:21:03.675 }, 00:21:03.675 { 00:21:03.675 "method": "bdev_wait_for_examine" 00:21:03.675 } 00:21:03.675 ] 00:21:03.675 }, 00:21:03.675 { 00:21:03.675 "subsystem": "nbd", 00:21:03.675 "config": [] 00:21:03.675 } 00:21:03.675 ] 00:21:03.675 }' 00:21:03.675 11:31:59 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@270 -- # killprocess 85125 00:21:03.675 11:31:59 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@950 -- # '[' -z 85125 ']' 00:21:03.675 11:31:59 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@954 -- # kill -0 85125 00:21:03.675 11:31:59 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@955 -- # uname 00:21:03.675 11:31:59 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@955 -- # '[' Linux = Linux ']' 00:21:03.675 11:31:59 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@956 -- # ps --no-headers -o comm= 85125 00:21:03.675 killing process with pid 85125 00:21:03.675 11:31:59 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@956 -- # process_name=reactor_1 00:21:03.675 11:31:59 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@960 -- # '[' reactor_1 = sudo ']' 00:21:03.675 11:31:59 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@968 -- # echo 'killing process with pid 85125' 00:21:03.675 11:31:59 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@969 -- # kill 85125 00:21:03.675 Received shutdown signal, test time was about 1.000000 seconds 00:21:03.675 00:21:03.675 Latency(us) 00:21:03.675 [2024-10-07T11:31:59.198Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:21:03.675 [2024-10-07T11:31:59.198Z] =================================================================================================================== 00:21:03.675 [2024-10-07T11:31:59.198Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:21:03.675 11:31:59 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@974 -- # wait 85125 00:21:03.934 11:31:59 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@271 -- # killprocess 85093 00:21:03.934 11:31:59 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@950 -- # '[' -z 85093 ']' 00:21:03.934 11:31:59 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@954 -- # kill -0 85093 00:21:03.934 11:31:59 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@955 -- # uname 00:21:03.934 11:31:59 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@955 -- # '[' Linux = Linux ']' 00:21:03.934 11:31:59 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@956 -- # ps --no-headers -o comm= 85093 00:21:03.934 killing process with pid 85093 00:21:03.934 11:31:59 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@956 -- # process_name=reactor_0 00:21:03.934 11:31:59 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@960 -- # '[' reactor_0 = sudo ']' 00:21:03.934 11:31:59 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@968 -- # echo 'killing process with pid 85093' 00:21:03.934 11:31:59 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@969 -- # kill 85093 00:21:03.934 11:31:59 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@974 -- # wait 85093 00:21:04.193 11:31:59 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@273 -- # nvmfappstart -c /dev/fd/62 00:21:04.193 11:31:59 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@505 -- # timing_enter start_nvmf_tgt 00:21:04.193 11:31:59 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@724 -- # xtrace_disable 00:21:04.193 11:31:59 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@10 -- # set +x 00:21:04.193 11:31:59 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@273 -- # echo '{ 00:21:04.193 "subsystems": [ 00:21:04.193 { 00:21:04.193 "subsystem": "keyring", 00:21:04.193 "config": [ 00:21:04.193 { 00:21:04.193 "method": "keyring_file_add_key", 00:21:04.193 "params": { 00:21:04.193 "name": "key0", 00:21:04.193 "path": "/tmp/tmp.ca2SZhyGHH" 00:21:04.193 } 00:21:04.193 } 00:21:04.193 ] 00:21:04.193 }, 00:21:04.193 { 00:21:04.193 "subsystem": "iobuf", 00:21:04.193 "config": [ 00:21:04.193 { 00:21:04.193 "method": "iobuf_set_options", 00:21:04.193 "params": { 00:21:04.193 "large_bufsize": 135168, 00:21:04.193 "large_pool_count": 1024, 00:21:04.193 "small_bufsize": 8192, 00:21:04.193 "small_pool_count": 8192 00:21:04.193 } 00:21:04.193 } 00:21:04.193 ] 00:21:04.193 }, 00:21:04.193 { 00:21:04.193 "subsystem": "sock", 00:21:04.193 "config": [ 00:21:04.193 { 00:21:04.193 "method": "sock_set_default_impl", 00:21:04.193 "params": { 00:21:04.193 "impl_name": "posix" 00:21:04.193 } 00:21:04.193 }, 00:21:04.193 { 00:21:04.193 "method": "sock_impl_set_options", 00:21:04.193 "params": { 00:21:04.193 "enable_ktls": false, 00:21:04.193 "enable_placement_id": 0, 00:21:04.193 "enable_quickack": false, 00:21:04.193 "enable_recv_pipe": true, 00:21:04.193 "enable_zerocopy_send_client": false, 00:21:04.193 "enable_zerocopy_send_server": true, 00:21:04.193 "impl_name": "ssl", 00:21:04.193 "recv_buf_size": 4096, 00:21:04.193 "send_buf_size": 4096, 00:21:04.193 "tls_version": 0, 00:21:04.193 "zerocopy_threshold": 0 00:21:04.193 } 00:21:04.193 }, 00:21:04.193 { 00:21:04.193 "method": "sock_impl_set_options", 00:21:04.193 "params": { 00:21:04.193 "enable_ktls": false, 00:21:04.193 "enable_placement_id": 0, 00:21:04.193 "enable_quickack": false, 00:21:04.193 "enable_recv_pipe": true, 00:21:04.193 "enable_zerocopy_send_client": false, 00:21:04.193 "enable_zerocopy_send_server": true, 00:21:04.193 "impl_name": "posix", 00:21:04.193 "recv_buf_size": 2097152, 00:21:04.193 "send_buf_size": 2097152, 00:21:04.193 "tls_version": 0, 00:21:04.193 "zerocopy_threshold": 0 00:21:04.193 } 00:21:04.193 } 00:21:04.193 ] 00:21:04.193 }, 00:21:04.193 { 00:21:04.193 "subsystem": "vmd", 00:21:04.193 "config": [] 00:21:04.193 }, 00:21:04.193 { 00:21:04.193 "subsystem": "accel", 00:21:04.193 "config": [ 00:21:04.193 { 00:21:04.193 "method": "accel_set_options", 00:21:04.193 "params": { 00:21:04.193 "buf_count": 2048, 00:21:04.193 "large_cache_size": 16, 00:21:04.193 "sequence_count": 2048, 00:21:04.193 "small_cache_size": 128, 00:21:04.193 "task_count": 2048 00:21:04.193 } 00:21:04.193 } 00:21:04.193 ] 00:21:04.193 }, 00:21:04.193 { 00:21:04.193 "subsystem": "bdev", 00:21:04.193 "config": [ 00:21:04.193 { 00:21:04.193 "method": "bdev_set_options", 00:21:04.193 "params": { 00:21:04.193 "bdev_auto_examine": true, 00:21:04.193 "bdev_io_cache_size": 256, 00:21:04.193 "bdev_io_pool_size": 65535, 00:21:04.193 "iobuf_large_cache_size": 16, 00:21:04.193 "iobuf_small_cache_size": 128 00:21:04.193 } 00:21:04.193 }, 00:21:04.193 { 00:21:04.193 "method": "bdev_raid_set_options", 00:21:04.193 "params": { 00:21:04.193 "process_max_bandwidth_mb_sec": 0, 00:21:04.193 "process_window_size_kb": 1024 00:21:04.193 } 00:21:04.193 }, 00:21:04.193 { 00:21:04.193 "method": "bdev_iscsi_set_options", 00:21:04.193 "params": { 00:21:04.193 "timeout_sec": 30 00:21:04.193 } 00:21:04.193 }, 00:21:04.193 { 00:21:04.193 "method": "bdev_nvme_set_options", 00:21:04.193 "params": { 00:21:04.193 "action_on_timeout": "none", 00:21:04.193 "allow_accel_sequence": false, 00:21:04.193 "arbitration_burst": 0, 00:21:04.193 "bdev_retry_count": 3, 00:21:04.193 "ctrlr_loss_timeout_sec": 0, 00:21:04.193 "delay_cmd_submit": true, 00:21:04.193 "dhchap_dhgroups": [ 00:21:04.193 "null", 00:21:04.193 "ffdhe2048", 00:21:04.193 "ffdhe3072", 00:21:04.193 "ffdhe4096", 00:21:04.193 "ffdhe6144", 00:21:04.193 "ffdhe8192" 00:21:04.193 ], 00:21:04.193 "dhchap_digests": [ 00:21:04.193 "sha256", 00:21:04.193 "sha384", 00:21:04.193 "sha512" 00:21:04.193 ], 00:21:04.193 "disable_auto_failback": false, 00:21:04.193 "fast_io_fail_timeout_sec": 0, 00:21:04.193 "generate_uuids": false, 00:21:04.193 "high_priority_weight": 0, 00:21:04.193 "io_path_stat": false, 00:21:04.193 "io_queue_requests": 0, 00:21:04.193 "keep_alive_timeout_ms": 10000, 00:21:04.193 "low_priority_weight": 0, 00:21:04.193 "medium_priority_weight": 0, 00:21:04.193 "nvme_adminq_poll_period_us": 10000, 00:21:04.193 "nvme_error_stat": false, 00:21:04.193 "nvme_ioq_poll_period_us": 0, 00:21:04.193 "rdma_cm_event_timeout_ms": 0, 00:21:04.193 "rdma_max_cq_size": 0, 00:21:04.193 "rdma_srq_size": 0, 00:21:04.193 "reconnect_delay_sec": 0, 00:21:04.193 "timeout_admin_us": 0, 00:21:04.193 "timeout_us": 0, 00:21:04.193 "transport_ack_timeout": 0, 00:21:04.193 "transport_retry_count": 4, 00:21:04.193 "transport_tos": 0 00:21:04.193 } 00:21:04.193 }, 00:21:04.193 { 00:21:04.193 "method": "bdev_nvme_set_hotplug", 00:21:04.193 "params": { 00:21:04.193 "enable": false, 00:21:04.193 "period_us": 100000 00:21:04.193 } 00:21:04.193 }, 00:21:04.193 { 00:21:04.193 "method": "bdev_malloc_create", 00:21:04.193 "params": { 00:21:04.193 "block_size": 4096, 00:21:04.193 "dif_is_head_of_md": false, 00:21:04.193 "dif_pi_format": 0, 00:21:04.193 "dif_type": 0, 00:21:04.193 "md_size": 0, 00:21:04.193 "name": "malloc0", 00:21:04.193 "num_blocks": 8192, 00:21:04.193 "optimal_io_boundary": 0, 00:21:04.193 "physical_block_size": 4096, 00:21:04.193 "uuid": "c31bd3a1-8f2c-4483-8ee1-c3683a4ca970" 00:21:04.193 } 00:21:04.193 }, 00:21:04.193 { 00:21:04.193 "method": "bdev_wait_for_examine" 00:21:04.193 } 00:21:04.193 ] 00:21:04.193 }, 00:21:04.193 { 00:21:04.193 "subsystem": "nbd", 00:21:04.193 "config": [] 00:21:04.193 }, 00:21:04.193 { 00:21:04.193 "subsystem": "scheduler", 00:21:04.193 "config": [ 00:21:04.193 { 00:21:04.193 "method": "framework_set_scheduler", 00:21:04.193 "params": { 00:21:04.193 "name": "static" 00:21:04.193 } 00:21:04.193 } 00:21:04.193 ] 00:21:04.193 }, 00:21:04.193 { 00:21:04.193 "subsystem": "nvmf", 00:21:04.193 "config": [ 00:21:04.193 { 00:21:04.193 "method": "nvmf_set_config", 00:21:04.193 "params": { 00:21:04.193 "admin_cmd_passthru": { 00:21:04.193 "identify_ctrlr": false 00:21:04.193 }, 00:21:04.193 "dhchap_dhgroups": [ 00:21:04.193 "null", 00:21:04.193 "ffdhe2048", 00:21:04.193 "ffdhe3072", 00:21:04.193 "ffdhe4096", 00:21:04.193 "ffdhe6144", 00:21:04.193 "ffdhe8192" 00:21:04.193 ], 00:21:04.193 "dhchap_digests": [ 00:21:04.193 "sha256", 00:21:04.193 "sha384", 00:21:04.193 "sha512" 00:21:04.193 ], 00:21:04.193 "discovery_filter": "match_any" 00:21:04.193 } 00:21:04.193 }, 00:21:04.193 { 00:21:04.193 "method": "nvmf_set_max_subsystems", 00:21:04.193 "params": { 00:21:04.193 "max_subsystems": 1024 00:21:04.193 } 00:21:04.193 }, 00:21:04.193 { 00:21:04.193 "method": "nvmf_set_crdt", 00:21:04.193 "params": { 00:21:04.193 "crdt1": 0, 00:21:04.193 "crdt2": 0, 00:21:04.193 "crdt3": 0 00:21:04.193 } 00:21:04.193 }, 00:21:04.193 { 00:21:04.193 "method": "nvmf_create_transport", 00:21:04.193 "params": { 00:21:04.193 "abort_timeout_sec": 1, 00:21:04.193 "ack_timeout": 0, 00:21:04.193 "buf_cache_size": 4294967295, 00:21:04.193 "c2h_success": false, 00:21:04.193 "data_wr_pool_size": 0, 00:21:04.193 "dif_insert_or_strip": false, 00:21:04.193 "in_capsule_data_size": 4096, 00:21:04.193 "io_unit_size": 131072, 00:21:04.193 "max_aq_depth": 128, 00:21:04.193 "max_io_qpairs_per_ctrlr": 127, 00:21:04.194 "max_io_size": 131072, 00:21:04.194 "max_queue_depth": 128, 00:21:04.194 "num_shared_buffers": 511, 00:21:04.194 "sock_priority": 0, 00:21:04.194 "trtype": "TCP", 00:21:04.194 "zcopy": false 00:21:04.194 } 00:21:04.194 }, 00:21:04.194 { 00:21:04.194 "method": "nvmf_create_subsystem", 00:21:04.194 "params": { 00:21:04.194 "allow_any_host": false, 00:21:04.194 "ana_reporting": false, 00:21:04.194 "max_cntlid": 65519, 00:21:04.194 "max_namespaces": 32, 00:21:04.194 "min_cntlid": 1, 00:21:04.194 "model_number": "SPDK bdev Controller", 00:21:04.194 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:21:04.194 "serial_number": "00000000000000000000" 00:21:04.194 } 00:21:04.194 }, 00:21:04.194 { 00:21:04.194 "method": "nvmf_subsystem_add_host", 00:21:04.194 "params": { 00:21:04.194 "host": "nqn.2016-06.io.spdk:host1", 00:21:04.194 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:21:04.194 "psk": "key0" 00:21:04.194 } 00:21:04.194 }, 00:21:04.194 { 00:21:04.194 "method": "nvmf_subsystem_add_ns", 00:21:04.194 "params": { 00:21:04.194 "namespace": { 00:21:04.194 "bdev_name": "malloc0", 00:21:04.194 "nguid": "C31BD3A18F2C44838EE1C3683A4CA970", 00:21:04.194 "no_auto_visible": false, 00:21:04.194 "nsid": 1, 00:21:04.194 "uuid": "c31bd3a1-8f2c-4483-8ee1-c3683a4ca970" 00:21:04.194 }, 00:21:04.194 "nqn": "nqn.2016-06.io.spdk:cnode1" 00:21:04.194 } 00:21:04.194 }, 00:21:04.194 { 00:21:04.194 "method": "nvmf_subsystem_add_listener", 00:21:04.194 "params": { 00:21:04.194 "listen_address": { 00:21:04.194 "adrfam": "IPv4", 00:21:04.194 "traddr": "10.0.0.3", 00:21:04.194 "trsvcid": "4420", 00:21:04.194 "trtype": "TCP" 00:21:04.194 }, 00:21:04.194 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:21:04.194 "secure_channel": false, 00:21:04.194 "sock_impl": "ssl" 00:21:04.194 } 00:21:04.194 } 00:21:04.194 ] 00:21:04.194 } 00:21:04.194 ] 00:21:04.194 }' 00:21:04.194 11:31:59 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@507 -- # nvmfpid=85216 00:21:04.194 11:31:59 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@508 -- # waitforlisten 85216 00:21:04.194 11:31:59 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@506 -- # ip netns exec nvmf_tgt_ns_spdk /home/vagrant/spdk_repo/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -c /dev/fd/62 00:21:04.194 11:31:59 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@831 -- # '[' -z 85216 ']' 00:21:04.194 11:31:59 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@835 -- # local rpc_addr=/var/tmp/spdk.sock 00:21:04.194 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:21:04.194 11:31:59 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@836 -- # local max_retries=100 00:21:04.194 11:31:59 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@838 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:21:04.194 11:31:59 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@840 -- # xtrace_disable 00:21:04.194 11:31:59 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@10 -- # set +x 00:21:04.451 [2024-10-07 11:31:59.734376] Starting SPDK v25.01-pre git sha1 2a4f56c54 / DPDK 24.03.0 initialization... 00:21:04.452 [2024-10-07 11:31:59.734700] [ DPDK EAL parameters: nvmf -c 0x1 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --iova-mode=pa --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:21:04.452 [2024-10-07 11:31:59.870341] app.c: 917:spdk_app_start: *NOTICE*: Total cores available: 1 00:21:04.708 [2024-10-07 11:32:00.009423] app.c: 610:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:21:04.708 [2024-10-07 11:32:00.009484] app.c: 611:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:21:04.708 [2024-10-07 11:32:00.009500] app.c: 616:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:21:04.708 [2024-10-07 11:32:00.009514] app.c: 617:app_setup_trace: *NOTICE*: SPDK application currently running. 00:21:04.708 [2024-10-07 11:32:00.009526] app.c: 618:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:21:04.708 [2024-10-07 11:32:00.010023] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 0 00:21:04.965 [2024-10-07 11:32:00.261241] tcp.c: 738:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:21:04.965 [2024-10-07 11:32:00.300283] tcp.c:1031:nvmf_tcp_listen: *NOTICE*: TLS support is considered experimental 00:21:04.965 [2024-10-07 11:32:00.300839] tcp.c:1081:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.3 port 4420 *** 00:21:05.552 11:32:00 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@860 -- # (( i == 0 )) 00:21:05.552 11:32:00 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@864 -- # return 0 00:21:05.552 11:32:00 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@509 -- # timing_exit start_nvmf_tgt 00:21:05.552 11:32:00 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@730 -- # xtrace_disable 00:21:05.552 11:32:00 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@10 -- # set +x 00:21:05.552 11:32:00 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@510 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:21:05.552 11:32:00 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@276 -- # bdevperf_pid=85260 00:21:05.552 11:32:00 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@277 -- # waitforlisten 85260 /var/tmp/bdevperf.sock 00:21:05.552 11:32:00 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@831 -- # '[' -z 85260 ']' 00:21:05.552 11:32:00 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@835 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:21:05.552 11:32:00 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@274 -- # /home/vagrant/spdk_repo/spdk/build/examples/bdevperf -m 2 -z -r /var/tmp/bdevperf.sock -q 128 -o 4k -w verify -t 1 -c /dev/fd/63 00:21:05.552 11:32:00 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@836 -- # local max_retries=100 00:21:05.552 11:32:00 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@274 -- # echo '{ 00:21:05.552 "subsystems": [ 00:21:05.552 { 00:21:05.552 "subsystem": "keyring", 00:21:05.552 "config": [ 00:21:05.552 { 00:21:05.552 "method": "keyring_file_add_key", 00:21:05.552 "params": { 00:21:05.552 "name": "key0", 00:21:05.552 "path": "/tmp/tmp.ca2SZhyGHH" 00:21:05.552 } 00:21:05.552 } 00:21:05.552 ] 00:21:05.552 }, 00:21:05.552 { 00:21:05.552 "subsystem": "iobuf", 00:21:05.552 "config": [ 00:21:05.552 { 00:21:05.552 "method": "iobuf_set_options", 00:21:05.552 "params": { 00:21:05.552 "large_bufsize": 135168, 00:21:05.552 "large_pool_count": 1024, 00:21:05.552 "small_bufsize": 8192, 00:21:05.552 "small_pool_count": 8192 00:21:05.552 } 00:21:05.552 } 00:21:05.552 ] 00:21:05.552 }, 00:21:05.552 { 00:21:05.552 "subsystem": "sock", 00:21:05.552 "config": [ 00:21:05.552 { 00:21:05.552 "method": "sock_set_default_impl", 00:21:05.552 "params": { 00:21:05.552 "impl_name": "posix" 00:21:05.552 } 00:21:05.552 }, 00:21:05.552 { 00:21:05.552 "method": "sock_impl_set_options", 00:21:05.552 "params": { 00:21:05.552 "enable_ktls": false, 00:21:05.552 "enable_placement_id": 0, 00:21:05.552 "enable_quickack": false, 00:21:05.552 "enable_recv_pipe": true, 00:21:05.552 "enable_zerocopy_send_client": false, 00:21:05.552 "enable_zerocopy_send_server": true, 00:21:05.552 "impl_name": "ssl", 00:21:05.552 "recv_buf_size": 4096, 00:21:05.552 "send_buf_size": 4096, 00:21:05.552 "tls_version": 0, 00:21:05.552 "zerocopy_threshold": 0 00:21:05.552 } 00:21:05.552 }, 00:21:05.552 { 00:21:05.552 "method": "sock_impl_set_options", 00:21:05.552 "params": { 00:21:05.552 "enable_ktls": false, 00:21:05.552 "enable_placement_id": 0, 00:21:05.552 "enable_quickack": false, 00:21:05.552 "enable_recv_pipe": true, 00:21:05.552 "enable_zerocopy_send_client": false, 00:21:05.552 "enable_zerocopy_send_server": true, 00:21:05.552 "impl_name": "posix", 00:21:05.552 "recv_buf_size": 2097152, 00:21:05.552 "send_buf_size": 2097152, 00:21:05.552 "tls_version": 0, 00:21:05.552 "zerocopy_threshold": 0 00:21:05.552 } 00:21:05.552 } 00:21:05.552 ] 00:21:05.552 }, 00:21:05.552 { 00:21:05.552 "subsystem": "vmd", 00:21:05.552 "config": [] 00:21:05.552 }, 00:21:05.552 { 00:21:05.552 "subsystem": "accel", 00:21:05.552 "config": [ 00:21:05.552 { 00:21:05.552 "method": "accel_set_options", 00:21:05.552 "params": { 00:21:05.552 "buf_count": 2048, 00:21:05.552 "large_cache_size": 16, 00:21:05.552 "sequence_count": 2048, 00:21:05.552 "small_cache_size": 128, 00:21:05.552 "task_count": 2048 00:21:05.552 } 00:21:05.552 } 00:21:05.552 ] 00:21:05.552 }, 00:21:05.552 { 00:21:05.552 "subsystem": "bdev", 00:21:05.552 "config": [ 00:21:05.552 { 00:21:05.552 "method": "bdev_set_options", 00:21:05.552 "params": { 00:21:05.552 "bdev_auto_examine": true, 00:21:05.552 "bdev_io_cache_size": 256, 00:21:05.552 "bdev_io_pool_size": 65535, 00:21:05.552 "iobuf_large_cache_size": 16, 00:21:05.552 "iobuf_small_cache_size": 128 00:21:05.552 } 00:21:05.552 }, 00:21:05.552 { 00:21:05.552 "method": "bdev_raid_set_options", 00:21:05.552 "params": { 00:21:05.552 "process_max_bandwidth_mb_sec": 0, 00:21:05.552 "process_window_size_kb": 1024 00:21:05.552 } 00:21:05.553 }, 00:21:05.553 { 00:21:05.553 "method": "bdev_iscsi_set_options", 00:21:05.553 "params": { 00:21:05.553 "timeout_sec": 30 00:21:05.553 } 00:21:05.553 }, 00:21:05.553 { 00:21:05.553 "method": "bdev_nvme_set_options", 00:21:05.553 "params": { 00:21:05.553 "action_on_timeout": "none", 00:21:05.553 "allow_accel_sequence": false, 00:21:05.553 "arbitration_burst": 0, 00:21:05.553 "bdev_retry_count": 3, 00:21:05.553 "ctrlr_loss_timeout_sec": 0, 00:21:05.553 "delay_cmd_submit": true, 00:21:05.553 "dhchap_dhgroups": [ 00:21:05.553 "null", 00:21:05.553 "ffdhe2048", 00:21:05.553 "ffdhe3072", 00:21:05.553 "ffdhe4096", 00:21:05.553 "ffdhe6144", 00:21:05.553 "ffdhe8192" 00:21:05.553 ], 00:21:05.553 "dhchap_digests": [ 00:21:05.553 "sha256", 00:21:05.553 "sha384", 00:21:05.553 "sha512" 00:21:05.553 ], 00:21:05.553 "disable_auto_failback": false, 00:21:05.553 "fast_io_fail_timeout_sec": 0, 00:21:05.553 "generate_uuids": false, 00:21:05.553 "high_priority_weight": 0, 00:21:05.553 "io_path_stat": false, 00:21:05.553 "io_queue_requests": 512, 00:21:05.553 "keep_alive_timeout_ms": 10000, 00:21:05.553 "low_priority_weight": 0, 00:21:05.553 "medium_priority_weight": 0, 00:21:05.553 "nvme_adminq_poll_period_us": 10000, 00:21:05.553 "nvme_error_stat": false, 00:21:05.553 "nvme_ioq_poll_period_us": 0, 00:21:05.553 "rdma_cm_event_timeoutWaiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:21:05.553 11:32:00 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@838 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:21:05.553 11:32:00 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@840 -- # xtrace_disable 00:21:05.553 11:32:00 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@10 -- # set +x 00:21:05.553 _ms": 0, 00:21:05.553 "rdma_max_cq_size": 0, 00:21:05.553 "rdma_srq_size": 0, 00:21:05.553 "reconnect_delay_sec": 0, 00:21:05.553 "timeout_admin_us": 0, 00:21:05.553 "timeout_us": 0, 00:21:05.553 "transport_ack_timeout": 0, 00:21:05.553 "transport_retry_count": 4, 00:21:05.553 "transport_tos": 0 00:21:05.553 } 00:21:05.553 }, 00:21:05.553 { 00:21:05.553 "method": "bdev_nvme_attach_controller", 00:21:05.553 "params": { 00:21:05.553 "adrfam": "IPv4", 00:21:05.553 "ctrlr_loss_timeout_sec": 0, 00:21:05.553 "ddgst": false, 00:21:05.553 "fast_io_fail_timeout_sec": 0, 00:21:05.553 "hdgst": false, 00:21:05.553 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:21:05.553 "multipath": "multipath", 00:21:05.553 "name": "nvme0", 00:21:05.553 "prchk_guard": false, 00:21:05.553 "prchk_reftag": false, 00:21:05.553 "psk": "key0", 00:21:05.553 "reconnect_delay_sec": 0, 00:21:05.553 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:21:05.553 "traddr": "10.0.0.3", 00:21:05.553 "trsvcid": "4420", 00:21:05.553 "trtype": "TCP" 00:21:05.553 } 00:21:05.553 }, 00:21:05.553 { 00:21:05.553 "method": "bdev_nvme_set_hotplug", 00:21:05.553 "params": { 00:21:05.553 "enable": false, 00:21:05.553 "period_us": 100000 00:21:05.553 } 00:21:05.553 }, 00:21:05.553 { 00:21:05.553 "method": "bdev_enable_histogram", 00:21:05.553 "params": { 00:21:05.553 "enable": true, 00:21:05.553 "name": "nvme0n1" 00:21:05.553 } 00:21:05.553 }, 00:21:05.553 { 00:21:05.553 "method": "bdev_wait_for_examine" 00:21:05.553 } 00:21:05.553 ] 00:21:05.553 }, 00:21:05.553 { 00:21:05.553 "subsystem": "nbd", 00:21:05.553 "config": [] 00:21:05.553 } 00:21:05.553 ] 00:21:05.553 }' 00:21:05.553 [2024-10-07 11:32:00.930416] Starting SPDK v25.01-pre git sha1 2a4f56c54 / DPDK 24.03.0 initialization... 00:21:05.553 [2024-10-07 11:32:00.930620] [ DPDK EAL parameters: bdevperf --no-shconf -c 2 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --iova-mode=pa --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid85260 ] 00:21:05.553 [2024-10-07 11:32:01.075762] app.c: 917:spdk_app_start: *NOTICE*: Total cores available: 1 00:21:05.810 [2024-10-07 11:32:01.208989] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 1 00:21:06.068 [2024-10-07 11:32:01.393068] bdev_nvme_rpc.c: 514:rpc_bdev_nvme_attach_controller: *NOTICE*: TLS support is considered experimental 00:21:06.633 11:32:01 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@860 -- # (( i == 0 )) 00:21:06.633 11:32:01 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@864 -- # return 0 00:21:06.633 11:32:01 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@279 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_get_controllers 00:21:06.633 11:32:01 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@279 -- # jq -r '.[].name' 00:21:06.892 11:32:02 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@279 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:21:06.892 11:32:02 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@280 -- # /home/vagrant/spdk_repo/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bdevperf.sock perform_tests 00:21:06.892 Running I/O for 1 seconds... 00:21:08.265 3858.00 IOPS, 15.07 MiB/s 00:21:08.265 Latency(us) 00:21:08.265 [2024-10-07T11:32:03.788Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:21:08.265 Job: nvme0n1 (Core Mask 0x2, workload: verify, depth: 128, IO size: 4096) 00:21:08.265 Verification LBA range: start 0x0 length 0x2000 00:21:08.265 nvme0n1 : 1.02 3910.46 15.28 0.00 0.00 32322.16 2010.76 23354.65 00:21:08.265 [2024-10-07T11:32:03.788Z] =================================================================================================================== 00:21:08.265 [2024-10-07T11:32:03.788Z] Total : 3910.46 15.28 0.00 0.00 32322.16 2010.76 23354.65 00:21:08.265 { 00:21:08.265 "results": [ 00:21:08.265 { 00:21:08.265 "job": "nvme0n1", 00:21:08.265 "core_mask": "0x2", 00:21:08.265 "workload": "verify", 00:21:08.265 "status": "finished", 00:21:08.265 "verify_range": { 00:21:08.265 "start": 0, 00:21:08.265 "length": 8192 00:21:08.265 }, 00:21:08.265 "queue_depth": 128, 00:21:08.265 "io_size": 4096, 00:21:08.265 "runtime": 1.019318, 00:21:08.265 "iops": 3910.4577766702832, 00:21:08.265 "mibps": 15.275225690118294, 00:21:08.265 "io_failed": 0, 00:21:08.265 "io_timeout": 0, 00:21:08.265 "avg_latency_us": 32322.157602517906, 00:21:08.265 "min_latency_us": 2010.7636363636364, 00:21:08.265 "max_latency_us": 23354.647272727274 00:21:08.265 } 00:21:08.265 ], 00:21:08.265 "core_count": 1 00:21:08.265 } 00:21:08.265 11:32:03 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@282 -- # trap - SIGINT SIGTERM EXIT 00:21:08.265 11:32:03 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@283 -- # cleanup 00:21:08.265 11:32:03 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@15 -- # process_shm --id 0 00:21:08.265 11:32:03 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@808 -- # type=--id 00:21:08.265 11:32:03 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@809 -- # id=0 00:21:08.265 11:32:03 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@810 -- # '[' --id = --pid ']' 00:21:08.265 11:32:03 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@814 -- # find /dev/shm -name '*.0' -printf '%f\n' 00:21:08.265 11:32:03 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@814 -- # shm_files=nvmf_trace.0 00:21:08.265 11:32:03 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@816 -- # [[ -z nvmf_trace.0 ]] 00:21:08.265 11:32:03 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@820 -- # for n in $shm_files 00:21:08.265 11:32:03 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@821 -- # tar -C /dev/shm/ -cvzf /home/vagrant/spdk_repo/spdk/../output/nvmf_trace.0_shm.tar.gz nvmf_trace.0 00:21:08.265 nvmf_trace.0 00:21:08.265 11:32:03 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@823 -- # return 0 00:21:08.265 11:32:03 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@16 -- # killprocess 85260 00:21:08.265 11:32:03 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@950 -- # '[' -z 85260 ']' 00:21:08.265 11:32:03 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@954 -- # kill -0 85260 00:21:08.265 11:32:03 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@955 -- # uname 00:21:08.265 11:32:03 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@955 -- # '[' Linux = Linux ']' 00:21:08.265 11:32:03 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@956 -- # ps --no-headers -o comm= 85260 00:21:08.265 killing process with pid 85260 00:21:08.265 Received shutdown signal, test time was about 1.000000 seconds 00:21:08.265 00:21:08.265 Latency(us) 00:21:08.265 [2024-10-07T11:32:03.788Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:21:08.265 [2024-10-07T11:32:03.788Z] =================================================================================================================== 00:21:08.265 [2024-10-07T11:32:03.788Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:21:08.265 11:32:03 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@956 -- # process_name=reactor_1 00:21:08.265 11:32:03 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@960 -- # '[' reactor_1 = sudo ']' 00:21:08.265 11:32:03 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@968 -- # echo 'killing process with pid 85260' 00:21:08.265 11:32:03 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@969 -- # kill 85260 00:21:08.265 11:32:03 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@974 -- # wait 85260 00:21:08.523 11:32:03 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@17 -- # nvmftestfini 00:21:08.523 11:32:03 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@514 -- # nvmfcleanup 00:21:08.523 11:32:03 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@121 -- # sync 00:21:08.523 11:32:03 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@123 -- # '[' tcp == tcp ']' 00:21:08.523 11:32:03 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@124 -- # set +e 00:21:08.523 11:32:03 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@125 -- # for i in {1..20} 00:21:08.523 11:32:03 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@126 -- # modprobe -v -r nvme-tcp 00:21:08.523 rmmod nvme_tcp 00:21:08.523 rmmod nvme_fabrics 00:21:08.523 rmmod nvme_keyring 00:21:08.523 11:32:03 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@127 -- # modprobe -v -r nvme-fabrics 00:21:08.523 11:32:03 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@128 -- # set -e 00:21:08.523 11:32:03 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@129 -- # return 0 00:21:08.523 11:32:03 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@515 -- # '[' -n 85216 ']' 00:21:08.523 11:32:03 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@516 -- # killprocess 85216 00:21:08.523 11:32:03 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@950 -- # '[' -z 85216 ']' 00:21:08.523 11:32:03 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@954 -- # kill -0 85216 00:21:08.523 11:32:03 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@955 -- # uname 00:21:08.523 11:32:03 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@955 -- # '[' Linux = Linux ']' 00:21:08.523 11:32:03 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@956 -- # ps --no-headers -o comm= 85216 00:21:08.523 11:32:03 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@956 -- # process_name=reactor_0 00:21:08.523 11:32:03 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@960 -- # '[' reactor_0 = sudo ']' 00:21:08.523 11:32:03 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@968 -- # echo 'killing process with pid 85216' 00:21:08.523 killing process with pid 85216 00:21:08.523 11:32:03 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@969 -- # kill 85216 00:21:08.523 11:32:03 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@974 -- # wait 85216 00:21:08.781 11:32:04 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@518 -- # '[' '' == iso ']' 00:21:08.781 11:32:04 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@521 -- # [[ tcp == \t\c\p ]] 00:21:08.781 11:32:04 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@522 -- # nvmf_tcp_fini 00:21:08.781 11:32:04 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@297 -- # iptr 00:21:08.781 11:32:04 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@789 -- # grep -v SPDK_NVMF 00:21:08.781 11:32:04 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@789 -- # iptables-save 00:21:08.781 11:32:04 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@789 -- # iptables-restore 00:21:08.781 11:32:04 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@298 -- # [[ nvmf_tgt_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s\_\s\p\d\k ]] 00:21:08.781 11:32:04 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@299 -- # nvmf_veth_fini 00:21:08.781 11:32:04 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@233 -- # ip link set nvmf_init_br nomaster 00:21:08.781 11:32:04 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@234 -- # ip link set nvmf_init_br2 nomaster 00:21:08.781 11:32:04 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@235 -- # ip link set nvmf_tgt_br nomaster 00:21:08.781 11:32:04 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@236 -- # ip link set nvmf_tgt_br2 nomaster 00:21:08.781 11:32:04 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@237 -- # ip link set nvmf_init_br down 00:21:08.781 11:32:04 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@238 -- # ip link set nvmf_init_br2 down 00:21:08.781 11:32:04 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@239 -- # ip link set nvmf_tgt_br down 00:21:09.039 11:32:04 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@240 -- # ip link set nvmf_tgt_br2 down 00:21:09.039 11:32:04 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@241 -- # ip link delete nvmf_br type bridge 00:21:09.039 11:32:04 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@242 -- # ip link delete nvmf_init_if 00:21:09.039 11:32:04 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@243 -- # ip link delete nvmf_init_if2 00:21:09.039 11:32:04 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@244 -- # ip netns exec nvmf_tgt_ns_spdk ip link delete nvmf_tgt_if 00:21:09.039 11:32:04 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@245 -- # ip netns exec nvmf_tgt_ns_spdk ip link delete nvmf_tgt_if2 00:21:09.039 11:32:04 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@246 -- # remove_spdk_ns 00:21:09.039 11:32:04 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@654 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:21:09.039 11:32:04 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 15> /dev/null' 00:21:09.039 11:32:04 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:21:09.039 11:32:04 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@300 -- # return 0 00:21:09.039 11:32:04 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@18 -- # rm -f /tmp/tmp.EP1nh5Wxgc /tmp/tmp.SmudStwUKo /tmp/tmp.ca2SZhyGHH 00:21:09.039 00:21:09.039 real 1m37.226s 00:21:09.039 user 2m39.421s 00:21:09.039 sys 0m31.278s 00:21:09.039 11:32:04 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@1126 -- # xtrace_disable 00:21:09.039 11:32:04 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@10 -- # set +x 00:21:09.039 ************************************ 00:21:09.039 END TEST nvmf_tls 00:21:09.039 ************************************ 00:21:09.039 11:32:04 nvmf_tcp.nvmf_target_extra -- nvmf/nvmf_target_extra.sh@42 -- # run_test nvmf_fips /home/vagrant/spdk_repo/spdk/test/nvmf/fips/fips.sh --transport=tcp 00:21:09.039 11:32:04 nvmf_tcp.nvmf_target_extra -- common/autotest_common.sh@1101 -- # '[' 3 -le 1 ']' 00:21:09.039 11:32:04 nvmf_tcp.nvmf_target_extra -- common/autotest_common.sh@1107 -- # xtrace_disable 00:21:09.039 11:32:04 nvmf_tcp.nvmf_target_extra -- common/autotest_common.sh@10 -- # set +x 00:21:09.039 ************************************ 00:21:09.039 START TEST nvmf_fips 00:21:09.039 ************************************ 00:21:09.039 11:32:04 nvmf_tcp.nvmf_target_extra.nvmf_fips -- common/autotest_common.sh@1125 -- # /home/vagrant/spdk_repo/spdk/test/nvmf/fips/fips.sh --transport=tcp 00:21:09.299 * Looking for test storage... 00:21:09.299 * Found test storage at /home/vagrant/spdk_repo/spdk/test/nvmf/fips 00:21:09.299 11:32:04 nvmf_tcp.nvmf_target_extra.nvmf_fips -- common/autotest_common.sh@1680 -- # [[ y == y ]] 00:21:09.299 11:32:04 nvmf_tcp.nvmf_target_extra.nvmf_fips -- common/autotest_common.sh@1681 -- # lcov --version 00:21:09.299 11:32:04 nvmf_tcp.nvmf_target_extra.nvmf_fips -- common/autotest_common.sh@1681 -- # awk '{print $NF}' 00:21:09.299 11:32:04 nvmf_tcp.nvmf_target_extra.nvmf_fips -- common/autotest_common.sh@1681 -- # lt 1.15 2 00:21:09.299 11:32:04 nvmf_tcp.nvmf_target_extra.nvmf_fips -- scripts/common.sh@373 -- # cmp_versions 1.15 '<' 2 00:21:09.299 11:32:04 nvmf_tcp.nvmf_target_extra.nvmf_fips -- scripts/common.sh@333 -- # local ver1 ver1_l 00:21:09.299 11:32:04 nvmf_tcp.nvmf_target_extra.nvmf_fips -- scripts/common.sh@334 -- # local ver2 ver2_l 00:21:09.299 11:32:04 nvmf_tcp.nvmf_target_extra.nvmf_fips -- scripts/common.sh@336 -- # IFS=.-: 00:21:09.299 11:32:04 nvmf_tcp.nvmf_target_extra.nvmf_fips -- scripts/common.sh@336 -- # read -ra ver1 00:21:09.299 11:32:04 nvmf_tcp.nvmf_target_extra.nvmf_fips -- scripts/common.sh@337 -- # IFS=.-: 00:21:09.299 11:32:04 nvmf_tcp.nvmf_target_extra.nvmf_fips -- scripts/common.sh@337 -- # read -ra ver2 00:21:09.299 11:32:04 nvmf_tcp.nvmf_target_extra.nvmf_fips -- scripts/common.sh@338 -- # local 'op=<' 00:21:09.299 11:32:04 nvmf_tcp.nvmf_target_extra.nvmf_fips -- scripts/common.sh@340 -- # ver1_l=2 00:21:09.299 11:32:04 nvmf_tcp.nvmf_target_extra.nvmf_fips -- scripts/common.sh@341 -- # ver2_l=1 00:21:09.299 11:32:04 nvmf_tcp.nvmf_target_extra.nvmf_fips -- scripts/common.sh@343 -- # local lt=0 gt=0 eq=0 v 00:21:09.299 11:32:04 nvmf_tcp.nvmf_target_extra.nvmf_fips -- scripts/common.sh@344 -- # case "$op" in 00:21:09.299 11:32:04 nvmf_tcp.nvmf_target_extra.nvmf_fips -- scripts/common.sh@345 -- # : 1 00:21:09.299 11:32:04 nvmf_tcp.nvmf_target_extra.nvmf_fips -- scripts/common.sh@364 -- # (( v = 0 )) 00:21:09.299 11:32:04 nvmf_tcp.nvmf_target_extra.nvmf_fips -- scripts/common.sh@364 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:21:09.299 11:32:04 nvmf_tcp.nvmf_target_extra.nvmf_fips -- scripts/common.sh@365 -- # decimal 1 00:21:09.299 11:32:04 nvmf_tcp.nvmf_target_extra.nvmf_fips -- scripts/common.sh@353 -- # local d=1 00:21:09.299 11:32:04 nvmf_tcp.nvmf_target_extra.nvmf_fips -- scripts/common.sh@354 -- # [[ 1 =~ ^[0-9]+$ ]] 00:21:09.299 11:32:04 nvmf_tcp.nvmf_target_extra.nvmf_fips -- scripts/common.sh@355 -- # echo 1 00:21:09.299 11:32:04 nvmf_tcp.nvmf_target_extra.nvmf_fips -- scripts/common.sh@365 -- # ver1[v]=1 00:21:09.299 11:32:04 nvmf_tcp.nvmf_target_extra.nvmf_fips -- scripts/common.sh@366 -- # decimal 2 00:21:09.299 11:32:04 nvmf_tcp.nvmf_target_extra.nvmf_fips -- scripts/common.sh@353 -- # local d=2 00:21:09.299 11:32:04 nvmf_tcp.nvmf_target_extra.nvmf_fips -- scripts/common.sh@354 -- # [[ 2 =~ ^[0-9]+$ ]] 00:21:09.299 11:32:04 nvmf_tcp.nvmf_target_extra.nvmf_fips -- scripts/common.sh@355 -- # echo 2 00:21:09.299 11:32:04 nvmf_tcp.nvmf_target_extra.nvmf_fips -- scripts/common.sh@366 -- # ver2[v]=2 00:21:09.299 11:32:04 nvmf_tcp.nvmf_target_extra.nvmf_fips -- scripts/common.sh@367 -- # (( ver1[v] > ver2[v] )) 00:21:09.299 11:32:04 nvmf_tcp.nvmf_target_extra.nvmf_fips -- scripts/common.sh@368 -- # (( ver1[v] < ver2[v] )) 00:21:09.299 11:32:04 nvmf_tcp.nvmf_target_extra.nvmf_fips -- scripts/common.sh@368 -- # return 0 00:21:09.299 11:32:04 nvmf_tcp.nvmf_target_extra.nvmf_fips -- common/autotest_common.sh@1682 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:21:09.299 11:32:04 nvmf_tcp.nvmf_target_extra.nvmf_fips -- common/autotest_common.sh@1694 -- # export 'LCOV_OPTS= 00:21:09.299 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:21:09.299 --rc genhtml_branch_coverage=1 00:21:09.299 --rc genhtml_function_coverage=1 00:21:09.299 --rc genhtml_legend=1 00:21:09.299 --rc geninfo_all_blocks=1 00:21:09.299 --rc geninfo_unexecuted_blocks=1 00:21:09.299 00:21:09.299 ' 00:21:09.299 11:32:04 nvmf_tcp.nvmf_target_extra.nvmf_fips -- common/autotest_common.sh@1694 -- # LCOV_OPTS=' 00:21:09.299 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:21:09.299 --rc genhtml_branch_coverage=1 00:21:09.299 --rc genhtml_function_coverage=1 00:21:09.299 --rc genhtml_legend=1 00:21:09.299 --rc geninfo_all_blocks=1 00:21:09.299 --rc geninfo_unexecuted_blocks=1 00:21:09.299 00:21:09.299 ' 00:21:09.299 11:32:04 nvmf_tcp.nvmf_target_extra.nvmf_fips -- common/autotest_common.sh@1695 -- # export 'LCOV=lcov 00:21:09.299 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:21:09.299 --rc genhtml_branch_coverage=1 00:21:09.299 --rc genhtml_function_coverage=1 00:21:09.299 --rc genhtml_legend=1 00:21:09.299 --rc geninfo_all_blocks=1 00:21:09.299 --rc geninfo_unexecuted_blocks=1 00:21:09.299 00:21:09.299 ' 00:21:09.299 11:32:04 nvmf_tcp.nvmf_target_extra.nvmf_fips -- common/autotest_common.sh@1695 -- # LCOV='lcov 00:21:09.299 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:21:09.299 --rc genhtml_branch_coverage=1 00:21:09.299 --rc genhtml_function_coverage=1 00:21:09.299 --rc genhtml_legend=1 00:21:09.299 --rc geninfo_all_blocks=1 00:21:09.299 --rc geninfo_unexecuted_blocks=1 00:21:09.299 00:21:09.299 ' 00:21:09.299 11:32:04 nvmf_tcp.nvmf_target_extra.nvmf_fips -- fips/fips.sh@11 -- # source /home/vagrant/spdk_repo/spdk/test/nvmf/common.sh 00:21:09.299 11:32:04 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@7 -- # uname -s 00:21:09.299 11:32:04 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:21:09.299 11:32:04 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:21:09.299 11:32:04 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:21:09.299 11:32:04 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:21:09.299 11:32:04 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:21:09.299 11:32:04 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:21:09.299 11:32:04 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:21:09.299 11:32:04 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:21:09.299 11:32:04 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:21:09.299 11:32:04 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:21:09.299 11:32:04 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:c758a4ed-f09f-4c82-9afb-3d096f035464 00:21:09.299 11:32:04 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@18 -- # NVME_HOSTID=c758a4ed-f09f-4c82-9afb-3d096f035464 00:21:09.299 11:32:04 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:21:09.299 11:32:04 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:21:09.299 11:32:04 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@21 -- # NET_TYPE=virt 00:21:09.299 11:32:04 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:21:09.299 11:32:04 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@49 -- # source /home/vagrant/spdk_repo/spdk/scripts/common.sh 00:21:09.299 11:32:04 nvmf_tcp.nvmf_target_extra.nvmf_fips -- scripts/common.sh@15 -- # shopt -s extglob 00:21:09.299 11:32:04 nvmf_tcp.nvmf_target_extra.nvmf_fips -- scripts/common.sh@544 -- # [[ -e /bin/wpdk_common.sh ]] 00:21:09.299 11:32:04 nvmf_tcp.nvmf_target_extra.nvmf_fips -- scripts/common.sh@552 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:21:09.299 11:32:04 nvmf_tcp.nvmf_target_extra.nvmf_fips -- scripts/common.sh@553 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:21:09.299 11:32:04 nvmf_tcp.nvmf_target_extra.nvmf_fips -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:21:09.299 11:32:04 nvmf_tcp.nvmf_target_extra.nvmf_fips -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:21:09.299 11:32:04 nvmf_tcp.nvmf_target_extra.nvmf_fips -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:21:09.299 11:32:04 nvmf_tcp.nvmf_target_extra.nvmf_fips -- paths/export.sh@5 -- # export PATH 00:21:09.299 11:32:04 nvmf_tcp.nvmf_target_extra.nvmf_fips -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:21:09.299 11:32:04 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@51 -- # : 0 00:21:09.299 11:32:04 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@52 -- # export NVMF_APP_SHM_ID 00:21:09.299 11:32:04 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@53 -- # build_nvmf_app_args 00:21:09.299 11:32:04 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:21:09.299 11:32:04 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:21:09.299 11:32:04 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:21:09.299 11:32:04 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@33 -- # '[' '' -eq 1 ']' 00:21:09.300 /home/vagrant/spdk_repo/spdk/test/nvmf/common.sh: line 33: [: : integer expression expected 00:21:09.300 11:32:04 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@37 -- # '[' -n '' ']' 00:21:09.300 11:32:04 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@39 -- # '[' 0 -eq 1 ']' 00:21:09.300 11:32:04 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@55 -- # have_pci_nics=0 00:21:09.300 11:32:04 nvmf_tcp.nvmf_target_extra.nvmf_fips -- fips/fips.sh@12 -- # rpc_py=/home/vagrant/spdk_repo/spdk/scripts/rpc.py 00:21:09.300 11:32:04 nvmf_tcp.nvmf_target_extra.nvmf_fips -- fips/fips.sh@90 -- # check_openssl_version 00:21:09.300 11:32:04 nvmf_tcp.nvmf_target_extra.nvmf_fips -- fips/fips.sh@84 -- # local target=3.0.0 00:21:09.300 11:32:04 nvmf_tcp.nvmf_target_extra.nvmf_fips -- fips/fips.sh@86 -- # openssl version 00:21:09.300 11:32:04 nvmf_tcp.nvmf_target_extra.nvmf_fips -- fips/fips.sh@86 -- # awk '{print $2}' 00:21:09.300 11:32:04 nvmf_tcp.nvmf_target_extra.nvmf_fips -- fips/fips.sh@86 -- # ge 3.1.1 3.0.0 00:21:09.300 11:32:04 nvmf_tcp.nvmf_target_extra.nvmf_fips -- scripts/common.sh@376 -- # cmp_versions 3.1.1 '>=' 3.0.0 00:21:09.300 11:32:04 nvmf_tcp.nvmf_target_extra.nvmf_fips -- scripts/common.sh@333 -- # local ver1 ver1_l 00:21:09.300 11:32:04 nvmf_tcp.nvmf_target_extra.nvmf_fips -- scripts/common.sh@334 -- # local ver2 ver2_l 00:21:09.300 11:32:04 nvmf_tcp.nvmf_target_extra.nvmf_fips -- scripts/common.sh@336 -- # IFS=.-: 00:21:09.300 11:32:04 nvmf_tcp.nvmf_target_extra.nvmf_fips -- scripts/common.sh@336 -- # read -ra ver1 00:21:09.300 11:32:04 nvmf_tcp.nvmf_target_extra.nvmf_fips -- scripts/common.sh@337 -- # IFS=.-: 00:21:09.300 11:32:04 nvmf_tcp.nvmf_target_extra.nvmf_fips -- scripts/common.sh@337 -- # read -ra ver2 00:21:09.300 11:32:04 nvmf_tcp.nvmf_target_extra.nvmf_fips -- scripts/common.sh@338 -- # local 'op=>=' 00:21:09.300 11:32:04 nvmf_tcp.nvmf_target_extra.nvmf_fips -- scripts/common.sh@340 -- # ver1_l=3 00:21:09.300 11:32:04 nvmf_tcp.nvmf_target_extra.nvmf_fips -- scripts/common.sh@341 -- # ver2_l=3 00:21:09.300 11:32:04 nvmf_tcp.nvmf_target_extra.nvmf_fips -- scripts/common.sh@343 -- # local lt=0 gt=0 eq=0 v 00:21:09.300 11:32:04 nvmf_tcp.nvmf_target_extra.nvmf_fips -- scripts/common.sh@344 -- # case "$op" in 00:21:09.300 11:32:04 nvmf_tcp.nvmf_target_extra.nvmf_fips -- scripts/common.sh@348 -- # : 1 00:21:09.300 11:32:04 nvmf_tcp.nvmf_target_extra.nvmf_fips -- scripts/common.sh@364 -- # (( v = 0 )) 00:21:09.300 11:32:04 nvmf_tcp.nvmf_target_extra.nvmf_fips -- scripts/common.sh@364 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:21:09.300 11:32:04 nvmf_tcp.nvmf_target_extra.nvmf_fips -- scripts/common.sh@365 -- # decimal 3 00:21:09.300 11:32:04 nvmf_tcp.nvmf_target_extra.nvmf_fips -- scripts/common.sh@353 -- # local d=3 00:21:09.300 11:32:04 nvmf_tcp.nvmf_target_extra.nvmf_fips -- scripts/common.sh@354 -- # [[ 3 =~ ^[0-9]+$ ]] 00:21:09.300 11:32:04 nvmf_tcp.nvmf_target_extra.nvmf_fips -- scripts/common.sh@355 -- # echo 3 00:21:09.300 11:32:04 nvmf_tcp.nvmf_target_extra.nvmf_fips -- scripts/common.sh@365 -- # ver1[v]=3 00:21:09.300 11:32:04 nvmf_tcp.nvmf_target_extra.nvmf_fips -- scripts/common.sh@366 -- # decimal 3 00:21:09.300 11:32:04 nvmf_tcp.nvmf_target_extra.nvmf_fips -- scripts/common.sh@353 -- # local d=3 00:21:09.300 11:32:04 nvmf_tcp.nvmf_target_extra.nvmf_fips -- scripts/common.sh@354 -- # [[ 3 =~ ^[0-9]+$ ]] 00:21:09.300 11:32:04 nvmf_tcp.nvmf_target_extra.nvmf_fips -- scripts/common.sh@355 -- # echo 3 00:21:09.300 11:32:04 nvmf_tcp.nvmf_target_extra.nvmf_fips -- scripts/common.sh@366 -- # ver2[v]=3 00:21:09.300 11:32:04 nvmf_tcp.nvmf_target_extra.nvmf_fips -- scripts/common.sh@367 -- # (( ver1[v] > ver2[v] )) 00:21:09.300 11:32:04 nvmf_tcp.nvmf_target_extra.nvmf_fips -- scripts/common.sh@368 -- # (( ver1[v] < ver2[v] )) 00:21:09.300 11:32:04 nvmf_tcp.nvmf_target_extra.nvmf_fips -- scripts/common.sh@364 -- # (( v++ )) 00:21:09.300 11:32:04 nvmf_tcp.nvmf_target_extra.nvmf_fips -- scripts/common.sh@364 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:21:09.300 11:32:04 nvmf_tcp.nvmf_target_extra.nvmf_fips -- scripts/common.sh@365 -- # decimal 1 00:21:09.300 11:32:04 nvmf_tcp.nvmf_target_extra.nvmf_fips -- scripts/common.sh@353 -- # local d=1 00:21:09.300 11:32:04 nvmf_tcp.nvmf_target_extra.nvmf_fips -- scripts/common.sh@354 -- # [[ 1 =~ ^[0-9]+$ ]] 00:21:09.300 11:32:04 nvmf_tcp.nvmf_target_extra.nvmf_fips -- scripts/common.sh@355 -- # echo 1 00:21:09.300 11:32:04 nvmf_tcp.nvmf_target_extra.nvmf_fips -- scripts/common.sh@365 -- # ver1[v]=1 00:21:09.300 11:32:04 nvmf_tcp.nvmf_target_extra.nvmf_fips -- scripts/common.sh@366 -- # decimal 0 00:21:09.300 11:32:04 nvmf_tcp.nvmf_target_extra.nvmf_fips -- scripts/common.sh@353 -- # local d=0 00:21:09.300 11:32:04 nvmf_tcp.nvmf_target_extra.nvmf_fips -- scripts/common.sh@354 -- # [[ 0 =~ ^[0-9]+$ ]] 00:21:09.300 11:32:04 nvmf_tcp.nvmf_target_extra.nvmf_fips -- scripts/common.sh@355 -- # echo 0 00:21:09.300 11:32:04 nvmf_tcp.nvmf_target_extra.nvmf_fips -- scripts/common.sh@366 -- # ver2[v]=0 00:21:09.300 11:32:04 nvmf_tcp.nvmf_target_extra.nvmf_fips -- scripts/common.sh@367 -- # (( ver1[v] > ver2[v] )) 00:21:09.300 11:32:04 nvmf_tcp.nvmf_target_extra.nvmf_fips -- scripts/common.sh@367 -- # return 0 00:21:09.300 11:32:04 nvmf_tcp.nvmf_target_extra.nvmf_fips -- fips/fips.sh@96 -- # openssl info -modulesdir 00:21:09.300 11:32:04 nvmf_tcp.nvmf_target_extra.nvmf_fips -- fips/fips.sh@96 -- # [[ ! -f /usr/lib64/ossl-modules/fips.so ]] 00:21:09.300 11:32:04 nvmf_tcp.nvmf_target_extra.nvmf_fips -- fips/fips.sh@101 -- # openssl fipsinstall -help 00:21:09.300 11:32:04 nvmf_tcp.nvmf_target_extra.nvmf_fips -- fips/fips.sh@101 -- # warn='This command is not enabled in the Red Hat Enterprise Linux OpenSSL build, please consult Red Hat documentation to learn how to enable FIPS mode' 00:21:09.300 11:32:04 nvmf_tcp.nvmf_target_extra.nvmf_fips -- fips/fips.sh@102 -- # [[ This command is not enabled in the Red Hat Enterprise Linux OpenSSL build, please consult Red Hat documentation to learn how to enable FIPS mode == \T\h\i\s\ \c\o\m\m\a\n\d\ \i\s\ \n\o\t\ \e\n\a\b\l\e\d* ]] 00:21:09.300 11:32:04 nvmf_tcp.nvmf_target_extra.nvmf_fips -- fips/fips.sh@105 -- # export callback=build_openssl_config 00:21:09.300 11:32:04 nvmf_tcp.nvmf_target_extra.nvmf_fips -- fips/fips.sh@105 -- # callback=build_openssl_config 00:21:09.300 11:32:04 nvmf_tcp.nvmf_target_extra.nvmf_fips -- fips/fips.sh@114 -- # build_openssl_config 00:21:09.300 11:32:04 nvmf_tcp.nvmf_target_extra.nvmf_fips -- fips/fips.sh@38 -- # cat 00:21:09.300 11:32:04 nvmf_tcp.nvmf_target_extra.nvmf_fips -- fips/fips.sh@58 -- # [[ ! -t 0 ]] 00:21:09.300 11:32:04 nvmf_tcp.nvmf_target_extra.nvmf_fips -- fips/fips.sh@59 -- # cat - 00:21:09.300 11:32:04 nvmf_tcp.nvmf_target_extra.nvmf_fips -- fips/fips.sh@115 -- # export OPENSSL_CONF=spdk_fips.conf 00:21:09.300 11:32:04 nvmf_tcp.nvmf_target_extra.nvmf_fips -- fips/fips.sh@115 -- # OPENSSL_CONF=spdk_fips.conf 00:21:09.300 11:32:04 nvmf_tcp.nvmf_target_extra.nvmf_fips -- fips/fips.sh@117 -- # mapfile -t providers 00:21:09.300 11:32:04 nvmf_tcp.nvmf_target_extra.nvmf_fips -- fips/fips.sh@117 -- # openssl list -providers 00:21:09.300 11:32:04 nvmf_tcp.nvmf_target_extra.nvmf_fips -- fips/fips.sh@117 -- # grep name 00:21:09.559 11:32:04 nvmf_tcp.nvmf_target_extra.nvmf_fips -- fips/fips.sh@121 -- # (( 2 != 2 )) 00:21:09.559 11:32:04 nvmf_tcp.nvmf_target_extra.nvmf_fips -- fips/fips.sh@121 -- # [[ name: openssl base provider != *base* ]] 00:21:09.559 11:32:04 nvmf_tcp.nvmf_target_extra.nvmf_fips -- fips/fips.sh@121 -- # [[ name: red hat enterprise linux 9 - openssl fips provider != *fips* ]] 00:21:09.559 11:32:04 nvmf_tcp.nvmf_target_extra.nvmf_fips -- fips/fips.sh@128 -- # NOT openssl md5 /dev/fd/62 00:21:09.559 11:32:04 nvmf_tcp.nvmf_target_extra.nvmf_fips -- fips/fips.sh@128 -- # : 00:21:09.559 11:32:04 nvmf_tcp.nvmf_target_extra.nvmf_fips -- common/autotest_common.sh@650 -- # local es=0 00:21:09.559 11:32:04 nvmf_tcp.nvmf_target_extra.nvmf_fips -- common/autotest_common.sh@652 -- # valid_exec_arg openssl md5 /dev/fd/62 00:21:09.559 11:32:04 nvmf_tcp.nvmf_target_extra.nvmf_fips -- common/autotest_common.sh@638 -- # local arg=openssl 00:21:09.559 11:32:04 nvmf_tcp.nvmf_target_extra.nvmf_fips -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:21:09.559 11:32:04 nvmf_tcp.nvmf_target_extra.nvmf_fips -- common/autotest_common.sh@642 -- # type -t openssl 00:21:09.559 11:32:04 nvmf_tcp.nvmf_target_extra.nvmf_fips -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:21:09.559 11:32:04 nvmf_tcp.nvmf_target_extra.nvmf_fips -- common/autotest_common.sh@644 -- # type -P openssl 00:21:09.559 11:32:04 nvmf_tcp.nvmf_target_extra.nvmf_fips -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:21:09.559 11:32:04 nvmf_tcp.nvmf_target_extra.nvmf_fips -- common/autotest_common.sh@644 -- # arg=/usr/bin/openssl 00:21:09.559 11:32:04 nvmf_tcp.nvmf_target_extra.nvmf_fips -- common/autotest_common.sh@644 -- # [[ -x /usr/bin/openssl ]] 00:21:09.559 11:32:04 nvmf_tcp.nvmf_target_extra.nvmf_fips -- common/autotest_common.sh@653 -- # openssl md5 /dev/fd/62 00:21:09.559 Error setting digest 00:21:09.559 40021F25207F0000:error:0308010C:digital envelope routines:inner_evp_generic_fetch:unsupported:crypto/evp/evp_fetch.c:341:Global default library context, Algorithm (MD5 : 95), Properties () 00:21:09.560 40021F25207F0000:error:03000086:digital envelope routines:evp_md_init_internal:initialization error:crypto/evp/digest.c:272: 00:21:09.560 11:32:04 nvmf_tcp.nvmf_target_extra.nvmf_fips -- common/autotest_common.sh@653 -- # es=1 00:21:09.560 11:32:04 nvmf_tcp.nvmf_target_extra.nvmf_fips -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:21:09.560 11:32:04 nvmf_tcp.nvmf_target_extra.nvmf_fips -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:21:09.560 11:32:04 nvmf_tcp.nvmf_target_extra.nvmf_fips -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:21:09.560 11:32:04 nvmf_tcp.nvmf_target_extra.nvmf_fips -- fips/fips.sh@131 -- # nvmftestinit 00:21:09.560 11:32:04 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@467 -- # '[' -z tcp ']' 00:21:09.560 11:32:04 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@472 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:21:09.560 11:32:04 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@474 -- # prepare_net_devs 00:21:09.560 11:32:04 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@436 -- # local -g is_hw=no 00:21:09.560 11:32:04 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@438 -- # remove_spdk_ns 00:21:09.560 11:32:04 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@654 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:21:09.560 11:32:04 nvmf_tcp.nvmf_target_extra.nvmf_fips -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 15> /dev/null' 00:21:09.560 11:32:04 nvmf_tcp.nvmf_target_extra.nvmf_fips -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:21:09.560 11:32:04 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@440 -- # [[ virt != virt ]] 00:21:09.560 11:32:04 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@442 -- # [[ no == yes ]] 00:21:09.560 11:32:04 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@449 -- # [[ virt == phy ]] 00:21:09.560 11:32:04 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@452 -- # [[ virt == phy-fallback ]] 00:21:09.560 11:32:04 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@457 -- # [[ tcp == tcp ]] 00:21:09.560 11:32:04 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@458 -- # nvmf_veth_init 00:21:09.560 11:32:04 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@145 -- # NVMF_FIRST_INITIATOR_IP=10.0.0.1 00:21:09.560 11:32:04 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@146 -- # NVMF_SECOND_INITIATOR_IP=10.0.0.2 00:21:09.560 11:32:04 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@147 -- # NVMF_FIRST_TARGET_IP=10.0.0.3 00:21:09.560 11:32:04 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@148 -- # NVMF_SECOND_TARGET_IP=10.0.0.4 00:21:09.560 11:32:04 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@149 -- # NVMF_INITIATOR_IP=10.0.0.1 00:21:09.560 11:32:04 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@150 -- # NVMF_BRIDGE=nvmf_br 00:21:09.560 11:32:04 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@151 -- # NVMF_INITIATOR_INTERFACE=nvmf_init_if 00:21:09.560 11:32:04 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@152 -- # NVMF_INITIATOR_INTERFACE2=nvmf_init_if2 00:21:09.560 11:32:04 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@153 -- # NVMF_INITIATOR_BRIDGE=nvmf_init_br 00:21:09.560 11:32:04 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@154 -- # NVMF_INITIATOR_BRIDGE2=nvmf_init_br2 00:21:09.560 11:32:04 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@155 -- # NVMF_TARGET_NAMESPACE=nvmf_tgt_ns_spdk 00:21:09.560 11:32:04 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@156 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:21:09.560 11:32:04 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@157 -- # NVMF_TARGET_INTERFACE=nvmf_tgt_if 00:21:09.560 11:32:04 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@158 -- # NVMF_TARGET_INTERFACE2=nvmf_tgt_if2 00:21:09.560 11:32:04 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@159 -- # NVMF_TARGET_BRIDGE=nvmf_tgt_br 00:21:09.560 11:32:04 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@160 -- # NVMF_TARGET_BRIDGE2=nvmf_tgt_br2 00:21:09.560 11:32:04 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@162 -- # ip link set nvmf_init_br nomaster 00:21:09.560 Cannot find device "nvmf_init_br" 00:21:09.560 11:32:04 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@162 -- # true 00:21:09.560 11:32:04 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@163 -- # ip link set nvmf_init_br2 nomaster 00:21:09.560 Cannot find device "nvmf_init_br2" 00:21:09.560 11:32:04 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@163 -- # true 00:21:09.560 11:32:04 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@164 -- # ip link set nvmf_tgt_br nomaster 00:21:09.560 Cannot find device "nvmf_tgt_br" 00:21:09.560 11:32:04 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@164 -- # true 00:21:09.560 11:32:04 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@165 -- # ip link set nvmf_tgt_br2 nomaster 00:21:09.560 Cannot find device "nvmf_tgt_br2" 00:21:09.560 11:32:04 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@165 -- # true 00:21:09.560 11:32:04 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@166 -- # ip link set nvmf_init_br down 00:21:09.560 Cannot find device "nvmf_init_br" 00:21:09.560 11:32:04 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@166 -- # true 00:21:09.560 11:32:04 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@167 -- # ip link set nvmf_init_br2 down 00:21:09.560 Cannot find device "nvmf_init_br2" 00:21:09.560 11:32:05 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@167 -- # true 00:21:09.560 11:32:05 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@168 -- # ip link set nvmf_tgt_br down 00:21:09.560 Cannot find device "nvmf_tgt_br" 00:21:09.560 11:32:05 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@168 -- # true 00:21:09.560 11:32:05 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@169 -- # ip link set nvmf_tgt_br2 down 00:21:09.560 Cannot find device "nvmf_tgt_br2" 00:21:09.560 11:32:05 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@169 -- # true 00:21:09.560 11:32:05 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@170 -- # ip link delete nvmf_br type bridge 00:21:09.560 Cannot find device "nvmf_br" 00:21:09.560 11:32:05 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@170 -- # true 00:21:09.560 11:32:05 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@171 -- # ip link delete nvmf_init_if 00:21:09.560 Cannot find device "nvmf_init_if" 00:21:09.560 11:32:05 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@171 -- # true 00:21:09.560 11:32:05 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@172 -- # ip link delete nvmf_init_if2 00:21:09.560 Cannot find device "nvmf_init_if2" 00:21:09.560 11:32:05 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@172 -- # true 00:21:09.560 11:32:05 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@173 -- # ip netns exec nvmf_tgt_ns_spdk ip link delete nvmf_tgt_if 00:21:09.560 Cannot open network namespace "nvmf_tgt_ns_spdk": No such file or directory 00:21:09.560 11:32:05 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@173 -- # true 00:21:09.560 11:32:05 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@174 -- # ip netns exec nvmf_tgt_ns_spdk ip link delete nvmf_tgt_if2 00:21:09.560 Cannot open network namespace "nvmf_tgt_ns_spdk": No such file or directory 00:21:09.560 11:32:05 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@174 -- # true 00:21:09.560 11:32:05 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@177 -- # ip netns add nvmf_tgt_ns_spdk 00:21:09.560 11:32:05 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@180 -- # ip link add nvmf_init_if type veth peer name nvmf_init_br 00:21:09.820 11:32:05 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@181 -- # ip link add nvmf_init_if2 type veth peer name nvmf_init_br2 00:21:09.820 11:32:05 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@182 -- # ip link add nvmf_tgt_if type veth peer name nvmf_tgt_br 00:21:09.820 11:32:05 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@183 -- # ip link add nvmf_tgt_if2 type veth peer name nvmf_tgt_br2 00:21:09.820 11:32:05 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@186 -- # ip link set nvmf_tgt_if netns nvmf_tgt_ns_spdk 00:21:09.820 11:32:05 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@187 -- # ip link set nvmf_tgt_if2 netns nvmf_tgt_ns_spdk 00:21:09.820 11:32:05 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@190 -- # ip addr add 10.0.0.1/24 dev nvmf_init_if 00:21:09.820 11:32:05 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@191 -- # ip addr add 10.0.0.2/24 dev nvmf_init_if2 00:21:09.820 11:32:05 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@192 -- # ip netns exec nvmf_tgt_ns_spdk ip addr add 10.0.0.3/24 dev nvmf_tgt_if 00:21:09.820 11:32:05 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@193 -- # ip netns exec nvmf_tgt_ns_spdk ip addr add 10.0.0.4/24 dev nvmf_tgt_if2 00:21:09.820 11:32:05 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@196 -- # ip link set nvmf_init_if up 00:21:09.820 11:32:05 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@197 -- # ip link set nvmf_init_if2 up 00:21:09.820 11:32:05 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@198 -- # ip link set nvmf_init_br up 00:21:09.820 11:32:05 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@199 -- # ip link set nvmf_init_br2 up 00:21:09.820 11:32:05 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@200 -- # ip link set nvmf_tgt_br up 00:21:09.820 11:32:05 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@201 -- # ip link set nvmf_tgt_br2 up 00:21:09.820 11:32:05 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@202 -- # ip netns exec nvmf_tgt_ns_spdk ip link set nvmf_tgt_if up 00:21:09.820 11:32:05 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@203 -- # ip netns exec nvmf_tgt_ns_spdk ip link set nvmf_tgt_if2 up 00:21:09.820 11:32:05 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@204 -- # ip netns exec nvmf_tgt_ns_spdk ip link set lo up 00:21:09.820 11:32:05 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@207 -- # ip link add nvmf_br type bridge 00:21:09.820 11:32:05 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@208 -- # ip link set nvmf_br up 00:21:09.820 11:32:05 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@211 -- # ip link set nvmf_init_br master nvmf_br 00:21:09.820 11:32:05 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@212 -- # ip link set nvmf_init_br2 master nvmf_br 00:21:09.820 11:32:05 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@213 -- # ip link set nvmf_tgt_br master nvmf_br 00:21:09.820 11:32:05 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@214 -- # ip link set nvmf_tgt_br2 master nvmf_br 00:21:09.820 11:32:05 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@217 -- # ipts -I INPUT 1 -i nvmf_init_if -p tcp --dport 4420 -j ACCEPT 00:21:09.820 11:32:05 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@788 -- # iptables -I INPUT 1 -i nvmf_init_if -p tcp --dport 4420 -j ACCEPT -m comment --comment 'SPDK_NVMF:-I INPUT 1 -i nvmf_init_if -p tcp --dport 4420 -j ACCEPT' 00:21:09.820 11:32:05 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@218 -- # ipts -I INPUT 1 -i nvmf_init_if2 -p tcp --dport 4420 -j ACCEPT 00:21:09.820 11:32:05 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@788 -- # iptables -I INPUT 1 -i nvmf_init_if2 -p tcp --dport 4420 -j ACCEPT -m comment --comment 'SPDK_NVMF:-I INPUT 1 -i nvmf_init_if2 -p tcp --dport 4420 -j ACCEPT' 00:21:09.820 11:32:05 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@219 -- # ipts -A FORWARD -i nvmf_br -o nvmf_br -j ACCEPT 00:21:09.820 11:32:05 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@788 -- # iptables -A FORWARD -i nvmf_br -o nvmf_br -j ACCEPT -m comment --comment 'SPDK_NVMF:-A FORWARD -i nvmf_br -o nvmf_br -j ACCEPT' 00:21:09.820 11:32:05 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@222 -- # ping -c 1 10.0.0.3 00:21:09.820 PING 10.0.0.3 (10.0.0.3) 56(84) bytes of data. 00:21:09.820 64 bytes from 10.0.0.3: icmp_seq=1 ttl=64 time=0.074 ms 00:21:09.820 00:21:09.820 --- 10.0.0.3 ping statistics --- 00:21:09.820 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:21:09.820 rtt min/avg/max/mdev = 0.074/0.074/0.074/0.000 ms 00:21:09.820 11:32:05 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@223 -- # ping -c 1 10.0.0.4 00:21:09.820 PING 10.0.0.4 (10.0.0.4) 56(84) bytes of data. 00:21:09.820 64 bytes from 10.0.0.4: icmp_seq=1 ttl=64 time=0.054 ms 00:21:09.820 00:21:09.820 --- 10.0.0.4 ping statistics --- 00:21:09.820 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:21:09.820 rtt min/avg/max/mdev = 0.054/0.054/0.054/0.000 ms 00:21:09.820 11:32:05 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@224 -- # ip netns exec nvmf_tgt_ns_spdk ping -c 1 10.0.0.1 00:21:09.820 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:21:09.820 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.026 ms 00:21:09.820 00:21:09.820 --- 10.0.0.1 ping statistics --- 00:21:09.820 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:21:09.820 rtt min/avg/max/mdev = 0.026/0.026/0.026/0.000 ms 00:21:09.820 11:32:05 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@225 -- # ip netns exec nvmf_tgt_ns_spdk ping -c 1 10.0.0.2 00:21:09.820 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:21:09.820 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.049 ms 00:21:09.820 00:21:09.820 --- 10.0.0.2 ping statistics --- 00:21:09.820 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:21:09.820 rtt min/avg/max/mdev = 0.049/0.049/0.049/0.000 ms 00:21:09.820 11:32:05 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@227 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:21:09.821 11:32:05 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@459 -- # return 0 00:21:09.821 11:32:05 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@476 -- # '[' '' == iso ']' 00:21:09.821 11:32:05 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@480 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:21:09.821 11:32:05 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@481 -- # [[ tcp == \r\d\m\a ]] 00:21:09.821 11:32:05 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@490 -- # [[ tcp == \t\c\p ]] 00:21:09.821 11:32:05 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@491 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:21:09.821 11:32:05 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@494 -- # '[' tcp == tcp ']' 00:21:09.821 11:32:05 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@500 -- # modprobe nvme-tcp 00:21:09.821 11:32:05 nvmf_tcp.nvmf_target_extra.nvmf_fips -- fips/fips.sh@132 -- # nvmfappstart -m 0x2 00:21:09.821 11:32:05 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@505 -- # timing_enter start_nvmf_tgt 00:21:09.821 11:32:05 nvmf_tcp.nvmf_target_extra.nvmf_fips -- common/autotest_common.sh@724 -- # xtrace_disable 00:21:09.821 11:32:05 nvmf_tcp.nvmf_target_extra.nvmf_fips -- common/autotest_common.sh@10 -- # set +x 00:21:10.078 11:32:05 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@507 -- # nvmfpid=85614 00:21:10.078 11:32:05 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@506 -- # ip netns exec nvmf_tgt_ns_spdk /home/vagrant/spdk_repo/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x2 00:21:10.078 11:32:05 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@508 -- # waitforlisten 85614 00:21:10.078 11:32:05 nvmf_tcp.nvmf_target_extra.nvmf_fips -- common/autotest_common.sh@831 -- # '[' -z 85614 ']' 00:21:10.078 11:32:05 nvmf_tcp.nvmf_target_extra.nvmf_fips -- common/autotest_common.sh@835 -- # local rpc_addr=/var/tmp/spdk.sock 00:21:10.078 11:32:05 nvmf_tcp.nvmf_target_extra.nvmf_fips -- common/autotest_common.sh@836 -- # local max_retries=100 00:21:10.079 11:32:05 nvmf_tcp.nvmf_target_extra.nvmf_fips -- common/autotest_common.sh@838 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:21:10.079 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:21:10.079 11:32:05 nvmf_tcp.nvmf_target_extra.nvmf_fips -- common/autotest_common.sh@840 -- # xtrace_disable 00:21:10.079 11:32:05 nvmf_tcp.nvmf_target_extra.nvmf_fips -- common/autotest_common.sh@10 -- # set +x 00:21:10.079 [2024-10-07 11:32:05.443947] Starting SPDK v25.01-pre git sha1 2a4f56c54 / DPDK 24.03.0 initialization... 00:21:10.079 [2024-10-07 11:32:05.444056] [ DPDK EAL parameters: nvmf -c 0x2 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --iova-mode=pa --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:21:10.079 [2024-10-07 11:32:05.587417] app.c: 917:spdk_app_start: *NOTICE*: Total cores available: 1 00:21:10.336 [2024-10-07 11:32:05.717823] app.c: 610:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:21:10.336 [2024-10-07 11:32:05.717884] app.c: 611:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:21:10.336 [2024-10-07 11:32:05.717898] app.c: 616:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:21:10.336 [2024-10-07 11:32:05.717909] app.c: 617:app_setup_trace: *NOTICE*: SPDK application currently running. 00:21:10.336 [2024-10-07 11:32:05.717919] app.c: 618:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:21:10.336 [2024-10-07 11:32:05.718452] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 1 00:21:11.268 11:32:06 nvmf_tcp.nvmf_target_extra.nvmf_fips -- common/autotest_common.sh@860 -- # (( i == 0 )) 00:21:11.268 11:32:06 nvmf_tcp.nvmf_target_extra.nvmf_fips -- common/autotest_common.sh@864 -- # return 0 00:21:11.268 11:32:06 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@509 -- # timing_exit start_nvmf_tgt 00:21:11.268 11:32:06 nvmf_tcp.nvmf_target_extra.nvmf_fips -- common/autotest_common.sh@730 -- # xtrace_disable 00:21:11.268 11:32:06 nvmf_tcp.nvmf_target_extra.nvmf_fips -- common/autotest_common.sh@10 -- # set +x 00:21:11.268 11:32:06 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@510 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:21:11.268 11:32:06 nvmf_tcp.nvmf_target_extra.nvmf_fips -- fips/fips.sh@134 -- # trap cleanup EXIT 00:21:11.268 11:32:06 nvmf_tcp.nvmf_target_extra.nvmf_fips -- fips/fips.sh@137 -- # key=NVMeTLSkey-1:01:VRLbtnN9AQb2WXW3c9+wEf/DRLz0QuLdbYvEhwtdWwNf9LrZ: 00:21:11.268 11:32:06 nvmf_tcp.nvmf_target_extra.nvmf_fips -- fips/fips.sh@138 -- # mktemp -t spdk-psk.XXX 00:21:11.268 11:32:06 nvmf_tcp.nvmf_target_extra.nvmf_fips -- fips/fips.sh@138 -- # key_path=/tmp/spdk-psk.zOi 00:21:11.268 11:32:06 nvmf_tcp.nvmf_target_extra.nvmf_fips -- fips/fips.sh@139 -- # echo -n NVMeTLSkey-1:01:VRLbtnN9AQb2WXW3c9+wEf/DRLz0QuLdbYvEhwtdWwNf9LrZ: 00:21:11.268 11:32:06 nvmf_tcp.nvmf_target_extra.nvmf_fips -- fips/fips.sh@140 -- # chmod 0600 /tmp/spdk-psk.zOi 00:21:11.268 11:32:06 nvmf_tcp.nvmf_target_extra.nvmf_fips -- fips/fips.sh@142 -- # setup_nvmf_tgt_conf /tmp/spdk-psk.zOi 00:21:11.268 11:32:06 nvmf_tcp.nvmf_target_extra.nvmf_fips -- fips/fips.sh@22 -- # local key=/tmp/spdk-psk.zOi 00:21:11.268 11:32:06 nvmf_tcp.nvmf_target_extra.nvmf_fips -- fips/fips.sh@24 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py 00:21:11.526 [2024-10-07 11:32:06.854013] tcp.c: 738:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:21:11.526 [2024-10-07 11:32:06.869940] tcp.c:1031:nvmf_tcp_listen: *NOTICE*: TLS support is considered experimental 00:21:11.526 [2024-10-07 11:32:06.870166] tcp.c:1081:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.3 port 4420 *** 00:21:11.526 malloc0 00:21:11.526 11:32:06 nvmf_tcp.nvmf_target_extra.nvmf_fips -- fips/fips.sh@145 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:21:11.526 11:32:06 nvmf_tcp.nvmf_target_extra.nvmf_fips -- fips/fips.sh@148 -- # bdevperf_pid=85672 00:21:11.526 11:32:06 nvmf_tcp.nvmf_target_extra.nvmf_fips -- fips/fips.sh@149 -- # waitforlisten 85672 /var/tmp/bdevperf.sock 00:21:11.526 11:32:06 nvmf_tcp.nvmf_target_extra.nvmf_fips -- common/autotest_common.sh@831 -- # '[' -z 85672 ']' 00:21:11.526 11:32:06 nvmf_tcp.nvmf_target_extra.nvmf_fips -- common/autotest_common.sh@835 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:21:11.526 11:32:06 nvmf_tcp.nvmf_target_extra.nvmf_fips -- common/autotest_common.sh@836 -- # local max_retries=100 00:21:11.526 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:21:11.526 11:32:06 nvmf_tcp.nvmf_target_extra.nvmf_fips -- common/autotest_common.sh@838 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:21:11.526 11:32:06 nvmf_tcp.nvmf_target_extra.nvmf_fips -- common/autotest_common.sh@840 -- # xtrace_disable 00:21:11.526 11:32:06 nvmf_tcp.nvmf_target_extra.nvmf_fips -- common/autotest_common.sh@10 -- # set +x 00:21:11.526 11:32:06 nvmf_tcp.nvmf_target_extra.nvmf_fips -- fips/fips.sh@146 -- # /home/vagrant/spdk_repo/spdk/build/examples/bdevperf -m 0x4 -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 10 00:21:11.784 [2024-10-07 11:32:07.078907] Starting SPDK v25.01-pre git sha1 2a4f56c54 / DPDK 24.03.0 initialization... 00:21:11.784 [2024-10-07 11:32:07.079032] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x4 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --iova-mode=pa --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid85672 ] 00:21:11.784 [2024-10-07 11:32:07.218951] app.c: 917:spdk_app_start: *NOTICE*: Total cores available: 1 00:21:12.042 [2024-10-07 11:32:07.368160] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 2 00:21:12.978 11:32:08 nvmf_tcp.nvmf_target_extra.nvmf_fips -- common/autotest_common.sh@860 -- # (( i == 0 )) 00:21:12.978 11:32:08 nvmf_tcp.nvmf_target_extra.nvmf_fips -- common/autotest_common.sh@864 -- # return 0 00:21:12.978 11:32:08 nvmf_tcp.nvmf_target_extra.nvmf_fips -- fips/fips.sh@151 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock keyring_file_add_key key0 /tmp/spdk-psk.zOi 00:21:12.978 11:32:08 nvmf_tcp.nvmf_target_extra.nvmf_fips -- fips/fips.sh@152 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b TLSTEST -t tcp -a 10.0.0.3 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -q nqn.2016-06.io.spdk:host1 --psk key0 00:21:13.236 [2024-10-07 11:32:08.736235] bdev_nvme_rpc.c: 514:rpc_bdev_nvme_attach_controller: *NOTICE*: TLS support is considered experimental 00:21:13.494 TLSTESTn1 00:21:13.494 11:32:08 nvmf_tcp.nvmf_target_extra.nvmf_fips -- fips/fips.sh@156 -- # /home/vagrant/spdk_repo/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bdevperf.sock perform_tests 00:21:13.494 Running I/O for 10 seconds... 00:21:15.457 3569.00 IOPS, 13.94 MiB/s [2024-10-07T11:32:12.353Z] 3688.00 IOPS, 14.41 MiB/s [2024-10-07T11:32:13.286Z] 3671.67 IOPS, 14.34 MiB/s [2024-10-07T11:32:14.219Z] 3714.25 IOPS, 14.51 MiB/s [2024-10-07T11:32:15.155Z] 3743.40 IOPS, 14.62 MiB/s [2024-10-07T11:32:16.089Z] 3763.00 IOPS, 14.70 MiB/s [2024-10-07T11:32:17.023Z] 3772.29 IOPS, 14.74 MiB/s [2024-10-07T11:32:18.396Z] 3770.88 IOPS, 14.73 MiB/s [2024-10-07T11:32:18.987Z] 3774.11 IOPS, 14.74 MiB/s [2024-10-07T11:32:19.245Z] 3778.10 IOPS, 14.76 MiB/s 00:21:23.722 Latency(us) 00:21:23.722 [2024-10-07T11:32:19.245Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:21:23.722 Job: TLSTESTn1 (Core Mask 0x4, workload: verify, depth: 128, IO size: 4096) 00:21:23.722 Verification LBA range: start 0x0 length 0x2000 00:21:23.722 TLSTESTn1 : 10.02 3783.58 14.78 0.00 0.00 33765.59 7089.80 29550.78 00:21:23.722 [2024-10-07T11:32:19.245Z] =================================================================================================================== 00:21:23.722 [2024-10-07T11:32:19.245Z] Total : 3783.58 14.78 0.00 0.00 33765.59 7089.80 29550.78 00:21:23.722 { 00:21:23.722 "results": [ 00:21:23.722 { 00:21:23.722 "job": "TLSTESTn1", 00:21:23.722 "core_mask": "0x4", 00:21:23.722 "workload": "verify", 00:21:23.722 "status": "finished", 00:21:23.722 "verify_range": { 00:21:23.722 "start": 0, 00:21:23.722 "length": 8192 00:21:23.722 }, 00:21:23.722 "queue_depth": 128, 00:21:23.722 "io_size": 4096, 00:21:23.722 "runtime": 10.019352, 00:21:23.722 "iops": 3783.578019816052, 00:21:23.722 "mibps": 14.779601639906453, 00:21:23.722 "io_failed": 0, 00:21:23.722 "io_timeout": 0, 00:21:23.722 "avg_latency_us": 33765.58957695342, 00:21:23.722 "min_latency_us": 7089.8036363636365, 00:21:23.722 "max_latency_us": 29550.778181818183 00:21:23.722 } 00:21:23.722 ], 00:21:23.722 "core_count": 1 00:21:23.722 } 00:21:23.722 11:32:19 nvmf_tcp.nvmf_target_extra.nvmf_fips -- fips/fips.sh@1 -- # cleanup 00:21:23.722 11:32:19 nvmf_tcp.nvmf_target_extra.nvmf_fips -- fips/fips.sh@15 -- # process_shm --id 0 00:21:23.722 11:32:19 nvmf_tcp.nvmf_target_extra.nvmf_fips -- common/autotest_common.sh@808 -- # type=--id 00:21:23.722 11:32:19 nvmf_tcp.nvmf_target_extra.nvmf_fips -- common/autotest_common.sh@809 -- # id=0 00:21:23.722 11:32:19 nvmf_tcp.nvmf_target_extra.nvmf_fips -- common/autotest_common.sh@810 -- # '[' --id = --pid ']' 00:21:23.722 11:32:19 nvmf_tcp.nvmf_target_extra.nvmf_fips -- common/autotest_common.sh@814 -- # find /dev/shm -name '*.0' -printf '%f\n' 00:21:23.722 11:32:19 nvmf_tcp.nvmf_target_extra.nvmf_fips -- common/autotest_common.sh@814 -- # shm_files=nvmf_trace.0 00:21:23.722 11:32:19 nvmf_tcp.nvmf_target_extra.nvmf_fips -- common/autotest_common.sh@816 -- # [[ -z nvmf_trace.0 ]] 00:21:23.722 11:32:19 nvmf_tcp.nvmf_target_extra.nvmf_fips -- common/autotest_common.sh@820 -- # for n in $shm_files 00:21:23.722 11:32:19 nvmf_tcp.nvmf_target_extra.nvmf_fips -- common/autotest_common.sh@821 -- # tar -C /dev/shm/ -cvzf /home/vagrant/spdk_repo/spdk/../output/nvmf_trace.0_shm.tar.gz nvmf_trace.0 00:21:23.722 nvmf_trace.0 00:21:23.722 11:32:19 nvmf_tcp.nvmf_target_extra.nvmf_fips -- common/autotest_common.sh@823 -- # return 0 00:21:23.722 11:32:19 nvmf_tcp.nvmf_target_extra.nvmf_fips -- fips/fips.sh@16 -- # killprocess 85672 00:21:23.722 11:32:19 nvmf_tcp.nvmf_target_extra.nvmf_fips -- common/autotest_common.sh@950 -- # '[' -z 85672 ']' 00:21:23.722 11:32:19 nvmf_tcp.nvmf_target_extra.nvmf_fips -- common/autotest_common.sh@954 -- # kill -0 85672 00:21:23.722 11:32:19 nvmf_tcp.nvmf_target_extra.nvmf_fips -- common/autotest_common.sh@955 -- # uname 00:21:23.722 11:32:19 nvmf_tcp.nvmf_target_extra.nvmf_fips -- common/autotest_common.sh@955 -- # '[' Linux = Linux ']' 00:21:23.722 11:32:19 nvmf_tcp.nvmf_target_extra.nvmf_fips -- common/autotest_common.sh@956 -- # ps --no-headers -o comm= 85672 00:21:23.722 11:32:19 nvmf_tcp.nvmf_target_extra.nvmf_fips -- common/autotest_common.sh@956 -- # process_name=reactor_2 00:21:23.722 killing process with pid 85672 00:21:23.722 11:32:19 nvmf_tcp.nvmf_target_extra.nvmf_fips -- common/autotest_common.sh@960 -- # '[' reactor_2 = sudo ']' 00:21:23.722 11:32:19 nvmf_tcp.nvmf_target_extra.nvmf_fips -- common/autotest_common.sh@968 -- # echo 'killing process with pid 85672' 00:21:23.722 Received shutdown signal, test time was about 10.000000 seconds 00:21:23.722 00:21:23.722 Latency(us) 00:21:23.722 [2024-10-07T11:32:19.246Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:21:23.723 [2024-10-07T11:32:19.246Z] =================================================================================================================== 00:21:23.723 [2024-10-07T11:32:19.246Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:21:23.723 11:32:19 nvmf_tcp.nvmf_target_extra.nvmf_fips -- common/autotest_common.sh@969 -- # kill 85672 00:21:23.723 11:32:19 nvmf_tcp.nvmf_target_extra.nvmf_fips -- common/autotest_common.sh@974 -- # wait 85672 00:21:23.981 11:32:19 nvmf_tcp.nvmf_target_extra.nvmf_fips -- fips/fips.sh@17 -- # nvmftestfini 00:21:23.981 11:32:19 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@514 -- # nvmfcleanup 00:21:23.981 11:32:19 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@121 -- # sync 00:21:24.243 11:32:19 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@123 -- # '[' tcp == tcp ']' 00:21:24.243 11:32:19 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@124 -- # set +e 00:21:24.243 11:32:19 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@125 -- # for i in {1..20} 00:21:24.243 11:32:19 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@126 -- # modprobe -v -r nvme-tcp 00:21:24.243 rmmod nvme_tcp 00:21:24.243 rmmod nvme_fabrics 00:21:24.243 rmmod nvme_keyring 00:21:24.243 11:32:19 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@127 -- # modprobe -v -r nvme-fabrics 00:21:24.243 11:32:19 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@128 -- # set -e 00:21:24.243 11:32:19 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@129 -- # return 0 00:21:24.243 11:32:19 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@515 -- # '[' -n 85614 ']' 00:21:24.243 11:32:19 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@516 -- # killprocess 85614 00:21:24.243 11:32:19 nvmf_tcp.nvmf_target_extra.nvmf_fips -- common/autotest_common.sh@950 -- # '[' -z 85614 ']' 00:21:24.243 11:32:19 nvmf_tcp.nvmf_target_extra.nvmf_fips -- common/autotest_common.sh@954 -- # kill -0 85614 00:21:24.243 11:32:19 nvmf_tcp.nvmf_target_extra.nvmf_fips -- common/autotest_common.sh@955 -- # uname 00:21:24.243 11:32:19 nvmf_tcp.nvmf_target_extra.nvmf_fips -- common/autotest_common.sh@955 -- # '[' Linux = Linux ']' 00:21:24.243 11:32:19 nvmf_tcp.nvmf_target_extra.nvmf_fips -- common/autotest_common.sh@956 -- # ps --no-headers -o comm= 85614 00:21:24.243 11:32:19 nvmf_tcp.nvmf_target_extra.nvmf_fips -- common/autotest_common.sh@956 -- # process_name=reactor_1 00:21:24.243 killing process with pid 85614 00:21:24.243 11:32:19 nvmf_tcp.nvmf_target_extra.nvmf_fips -- common/autotest_common.sh@960 -- # '[' reactor_1 = sudo ']' 00:21:24.243 11:32:19 nvmf_tcp.nvmf_target_extra.nvmf_fips -- common/autotest_common.sh@968 -- # echo 'killing process with pid 85614' 00:21:24.243 11:32:19 nvmf_tcp.nvmf_target_extra.nvmf_fips -- common/autotest_common.sh@969 -- # kill 85614 00:21:24.243 11:32:19 nvmf_tcp.nvmf_target_extra.nvmf_fips -- common/autotest_common.sh@974 -- # wait 85614 00:21:24.502 11:32:19 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@518 -- # '[' '' == iso ']' 00:21:24.502 11:32:19 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@521 -- # [[ tcp == \t\c\p ]] 00:21:24.502 11:32:19 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@522 -- # nvmf_tcp_fini 00:21:24.502 11:32:19 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@297 -- # iptr 00:21:24.502 11:32:19 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@789 -- # iptables-save 00:21:24.502 11:32:19 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@789 -- # grep -v SPDK_NVMF 00:21:24.502 11:32:19 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@789 -- # iptables-restore 00:21:24.502 11:32:19 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@298 -- # [[ nvmf_tgt_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s\_\s\p\d\k ]] 00:21:24.502 11:32:19 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@299 -- # nvmf_veth_fini 00:21:24.502 11:32:19 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@233 -- # ip link set nvmf_init_br nomaster 00:21:24.502 11:32:19 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@234 -- # ip link set nvmf_init_br2 nomaster 00:21:24.502 11:32:19 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@235 -- # ip link set nvmf_tgt_br nomaster 00:21:24.502 11:32:19 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@236 -- # ip link set nvmf_tgt_br2 nomaster 00:21:24.502 11:32:19 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@237 -- # ip link set nvmf_init_br down 00:21:24.502 11:32:19 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@238 -- # ip link set nvmf_init_br2 down 00:21:24.502 11:32:19 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@239 -- # ip link set nvmf_tgt_br down 00:21:24.502 11:32:19 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@240 -- # ip link set nvmf_tgt_br2 down 00:21:24.502 11:32:19 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@241 -- # ip link delete nvmf_br type bridge 00:21:24.502 11:32:20 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@242 -- # ip link delete nvmf_init_if 00:21:24.760 11:32:20 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@243 -- # ip link delete nvmf_init_if2 00:21:24.760 11:32:20 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@244 -- # ip netns exec nvmf_tgt_ns_spdk ip link delete nvmf_tgt_if 00:21:24.760 11:32:20 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@245 -- # ip netns exec nvmf_tgt_ns_spdk ip link delete nvmf_tgt_if2 00:21:24.760 11:32:20 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@246 -- # remove_spdk_ns 00:21:24.760 11:32:20 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@654 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:21:24.760 11:32:20 nvmf_tcp.nvmf_target_extra.nvmf_fips -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 15> /dev/null' 00:21:24.760 11:32:20 nvmf_tcp.nvmf_target_extra.nvmf_fips -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:21:24.760 11:32:20 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@300 -- # return 0 00:21:24.760 11:32:20 nvmf_tcp.nvmf_target_extra.nvmf_fips -- fips/fips.sh@18 -- # rm -f /tmp/spdk-psk.zOi 00:21:24.760 00:21:24.760 real 0m15.610s 00:21:24.760 user 0m21.531s 00:21:24.760 sys 0m6.326s 00:21:24.760 11:32:20 nvmf_tcp.nvmf_target_extra.nvmf_fips -- common/autotest_common.sh@1126 -- # xtrace_disable 00:21:24.760 11:32:20 nvmf_tcp.nvmf_target_extra.nvmf_fips -- common/autotest_common.sh@10 -- # set +x 00:21:24.760 ************************************ 00:21:24.760 END TEST nvmf_fips 00:21:24.760 ************************************ 00:21:24.760 11:32:20 nvmf_tcp.nvmf_target_extra -- nvmf/nvmf_target_extra.sh@43 -- # run_test nvmf_control_msg_list /home/vagrant/spdk_repo/spdk/test/nvmf/target/control_msg_list.sh --transport=tcp 00:21:24.760 11:32:20 nvmf_tcp.nvmf_target_extra -- common/autotest_common.sh@1101 -- # '[' 3 -le 1 ']' 00:21:24.760 11:32:20 nvmf_tcp.nvmf_target_extra -- common/autotest_common.sh@1107 -- # xtrace_disable 00:21:24.760 11:32:20 nvmf_tcp.nvmf_target_extra -- common/autotest_common.sh@10 -- # set +x 00:21:24.760 ************************************ 00:21:24.760 START TEST nvmf_control_msg_list 00:21:24.760 ************************************ 00:21:24.760 11:32:20 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- common/autotest_common.sh@1125 -- # /home/vagrant/spdk_repo/spdk/test/nvmf/target/control_msg_list.sh --transport=tcp 00:21:24.760 * Looking for test storage... 00:21:24.760 * Found test storage at /home/vagrant/spdk_repo/spdk/test/nvmf/target 00:21:24.760 11:32:20 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- common/autotest_common.sh@1680 -- # [[ y == y ]] 00:21:24.760 11:32:20 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- common/autotest_common.sh@1681 -- # lcov --version 00:21:24.760 11:32:20 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- common/autotest_common.sh@1681 -- # awk '{print $NF}' 00:21:25.020 11:32:20 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- common/autotest_common.sh@1681 -- # lt 1.15 2 00:21:25.020 11:32:20 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- scripts/common.sh@373 -- # cmp_versions 1.15 '<' 2 00:21:25.020 11:32:20 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- scripts/common.sh@333 -- # local ver1 ver1_l 00:21:25.020 11:32:20 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- scripts/common.sh@334 -- # local ver2 ver2_l 00:21:25.020 11:32:20 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- scripts/common.sh@336 -- # IFS=.-: 00:21:25.020 11:32:20 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- scripts/common.sh@336 -- # read -ra ver1 00:21:25.020 11:32:20 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- scripts/common.sh@337 -- # IFS=.-: 00:21:25.020 11:32:20 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- scripts/common.sh@337 -- # read -ra ver2 00:21:25.020 11:32:20 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- scripts/common.sh@338 -- # local 'op=<' 00:21:25.020 11:32:20 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- scripts/common.sh@340 -- # ver1_l=2 00:21:25.020 11:32:20 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- scripts/common.sh@341 -- # ver2_l=1 00:21:25.020 11:32:20 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- scripts/common.sh@343 -- # local lt=0 gt=0 eq=0 v 00:21:25.020 11:32:20 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- scripts/common.sh@344 -- # case "$op" in 00:21:25.020 11:32:20 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- scripts/common.sh@345 -- # : 1 00:21:25.020 11:32:20 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- scripts/common.sh@364 -- # (( v = 0 )) 00:21:25.020 11:32:20 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- scripts/common.sh@364 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:21:25.020 11:32:20 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- scripts/common.sh@365 -- # decimal 1 00:21:25.020 11:32:20 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- scripts/common.sh@353 -- # local d=1 00:21:25.020 11:32:20 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- scripts/common.sh@354 -- # [[ 1 =~ ^[0-9]+$ ]] 00:21:25.020 11:32:20 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- scripts/common.sh@355 -- # echo 1 00:21:25.020 11:32:20 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- scripts/common.sh@365 -- # ver1[v]=1 00:21:25.020 11:32:20 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- scripts/common.sh@366 -- # decimal 2 00:21:25.020 11:32:20 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- scripts/common.sh@353 -- # local d=2 00:21:25.020 11:32:20 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- scripts/common.sh@354 -- # [[ 2 =~ ^[0-9]+$ ]] 00:21:25.020 11:32:20 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- scripts/common.sh@355 -- # echo 2 00:21:25.020 11:32:20 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- scripts/common.sh@366 -- # ver2[v]=2 00:21:25.020 11:32:20 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- scripts/common.sh@367 -- # (( ver1[v] > ver2[v] )) 00:21:25.020 11:32:20 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- scripts/common.sh@368 -- # (( ver1[v] < ver2[v] )) 00:21:25.020 11:32:20 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- scripts/common.sh@368 -- # return 0 00:21:25.020 11:32:20 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- common/autotest_common.sh@1682 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:21:25.020 11:32:20 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- common/autotest_common.sh@1694 -- # export 'LCOV_OPTS= 00:21:25.020 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:21:25.020 --rc genhtml_branch_coverage=1 00:21:25.020 --rc genhtml_function_coverage=1 00:21:25.020 --rc genhtml_legend=1 00:21:25.020 --rc geninfo_all_blocks=1 00:21:25.020 --rc geninfo_unexecuted_blocks=1 00:21:25.020 00:21:25.020 ' 00:21:25.020 11:32:20 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- common/autotest_common.sh@1694 -- # LCOV_OPTS=' 00:21:25.020 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:21:25.020 --rc genhtml_branch_coverage=1 00:21:25.020 --rc genhtml_function_coverage=1 00:21:25.020 --rc genhtml_legend=1 00:21:25.020 --rc geninfo_all_blocks=1 00:21:25.020 --rc geninfo_unexecuted_blocks=1 00:21:25.020 00:21:25.020 ' 00:21:25.020 11:32:20 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- common/autotest_common.sh@1695 -- # export 'LCOV=lcov 00:21:25.020 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:21:25.020 --rc genhtml_branch_coverage=1 00:21:25.020 --rc genhtml_function_coverage=1 00:21:25.020 --rc genhtml_legend=1 00:21:25.020 --rc geninfo_all_blocks=1 00:21:25.020 --rc geninfo_unexecuted_blocks=1 00:21:25.020 00:21:25.020 ' 00:21:25.020 11:32:20 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- common/autotest_common.sh@1695 -- # LCOV='lcov 00:21:25.020 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:21:25.020 --rc genhtml_branch_coverage=1 00:21:25.020 --rc genhtml_function_coverage=1 00:21:25.020 --rc genhtml_legend=1 00:21:25.020 --rc geninfo_all_blocks=1 00:21:25.020 --rc geninfo_unexecuted_blocks=1 00:21:25.020 00:21:25.020 ' 00:21:25.020 11:32:20 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- target/control_msg_list.sh@10 -- # source /home/vagrant/spdk_repo/spdk/test/nvmf/common.sh 00:21:25.020 11:32:20 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@7 -- # uname -s 00:21:25.020 11:32:20 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:21:25.020 11:32:20 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:21:25.020 11:32:20 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:21:25.020 11:32:20 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:21:25.020 11:32:20 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:21:25.020 11:32:20 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:21:25.020 11:32:20 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:21:25.020 11:32:20 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:21:25.020 11:32:20 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:21:25.020 11:32:20 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:21:25.020 11:32:20 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:c758a4ed-f09f-4c82-9afb-3d096f035464 00:21:25.020 11:32:20 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@18 -- # NVME_HOSTID=c758a4ed-f09f-4c82-9afb-3d096f035464 00:21:25.020 11:32:20 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:21:25.020 11:32:20 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:21:25.020 11:32:20 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@21 -- # NET_TYPE=virt 00:21:25.020 11:32:20 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:21:25.020 11:32:20 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@49 -- # source /home/vagrant/spdk_repo/spdk/scripts/common.sh 00:21:25.020 11:32:20 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- scripts/common.sh@15 -- # shopt -s extglob 00:21:25.020 11:32:20 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- scripts/common.sh@544 -- # [[ -e /bin/wpdk_common.sh ]] 00:21:25.020 11:32:20 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- scripts/common.sh@552 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:21:25.020 11:32:20 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- scripts/common.sh@553 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:21:25.020 11:32:20 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:21:25.020 11:32:20 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:21:25.021 11:32:20 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:21:25.021 11:32:20 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- paths/export.sh@5 -- # export PATH 00:21:25.021 11:32:20 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:21:25.021 11:32:20 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@51 -- # : 0 00:21:25.021 11:32:20 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@52 -- # export NVMF_APP_SHM_ID 00:21:25.021 11:32:20 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@53 -- # build_nvmf_app_args 00:21:25.021 11:32:20 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:21:25.021 11:32:20 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:21:25.021 11:32:20 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:21:25.021 11:32:20 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@33 -- # '[' '' -eq 1 ']' 00:21:25.021 /home/vagrant/spdk_repo/spdk/test/nvmf/common.sh: line 33: [: : integer expression expected 00:21:25.021 11:32:20 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@37 -- # '[' -n '' ']' 00:21:25.021 11:32:20 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@39 -- # '[' 0 -eq 1 ']' 00:21:25.021 11:32:20 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@55 -- # have_pci_nics=0 00:21:25.021 11:32:20 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- target/control_msg_list.sh@12 -- # nvmftestinit 00:21:25.021 11:32:20 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@467 -- # '[' -z tcp ']' 00:21:25.021 11:32:20 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@472 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:21:25.021 11:32:20 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@474 -- # prepare_net_devs 00:21:25.021 11:32:20 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@436 -- # local -g is_hw=no 00:21:25.021 11:32:20 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@438 -- # remove_spdk_ns 00:21:25.021 11:32:20 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@654 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:21:25.021 11:32:20 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 15> /dev/null' 00:21:25.021 11:32:20 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:21:25.021 11:32:20 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@440 -- # [[ virt != virt ]] 00:21:25.021 11:32:20 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@442 -- # [[ no == yes ]] 00:21:25.021 11:32:20 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@449 -- # [[ virt == phy ]] 00:21:25.021 11:32:20 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@452 -- # [[ virt == phy-fallback ]] 00:21:25.021 11:32:20 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@457 -- # [[ tcp == tcp ]] 00:21:25.021 11:32:20 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@458 -- # nvmf_veth_init 00:21:25.021 11:32:20 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@145 -- # NVMF_FIRST_INITIATOR_IP=10.0.0.1 00:21:25.021 11:32:20 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@146 -- # NVMF_SECOND_INITIATOR_IP=10.0.0.2 00:21:25.021 11:32:20 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@147 -- # NVMF_FIRST_TARGET_IP=10.0.0.3 00:21:25.021 11:32:20 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@148 -- # NVMF_SECOND_TARGET_IP=10.0.0.4 00:21:25.021 11:32:20 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@149 -- # NVMF_INITIATOR_IP=10.0.0.1 00:21:25.021 11:32:20 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@150 -- # NVMF_BRIDGE=nvmf_br 00:21:25.021 11:32:20 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@151 -- # NVMF_INITIATOR_INTERFACE=nvmf_init_if 00:21:25.021 11:32:20 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@152 -- # NVMF_INITIATOR_INTERFACE2=nvmf_init_if2 00:21:25.021 11:32:20 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@153 -- # NVMF_INITIATOR_BRIDGE=nvmf_init_br 00:21:25.021 11:32:20 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@154 -- # NVMF_INITIATOR_BRIDGE2=nvmf_init_br2 00:21:25.021 11:32:20 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@155 -- # NVMF_TARGET_NAMESPACE=nvmf_tgt_ns_spdk 00:21:25.021 11:32:20 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@156 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:21:25.021 11:32:20 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@157 -- # NVMF_TARGET_INTERFACE=nvmf_tgt_if 00:21:25.021 11:32:20 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@158 -- # NVMF_TARGET_INTERFACE2=nvmf_tgt_if2 00:21:25.021 11:32:20 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@159 -- # NVMF_TARGET_BRIDGE=nvmf_tgt_br 00:21:25.021 11:32:20 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@160 -- # NVMF_TARGET_BRIDGE2=nvmf_tgt_br2 00:21:25.021 11:32:20 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@162 -- # ip link set nvmf_init_br nomaster 00:21:25.021 Cannot find device "nvmf_init_br" 00:21:25.021 11:32:20 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@162 -- # true 00:21:25.021 11:32:20 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@163 -- # ip link set nvmf_init_br2 nomaster 00:21:25.021 Cannot find device "nvmf_init_br2" 00:21:25.021 11:32:20 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@163 -- # true 00:21:25.021 11:32:20 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@164 -- # ip link set nvmf_tgt_br nomaster 00:21:25.021 Cannot find device "nvmf_tgt_br" 00:21:25.021 11:32:20 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@164 -- # true 00:21:25.021 11:32:20 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@165 -- # ip link set nvmf_tgt_br2 nomaster 00:21:25.021 Cannot find device "nvmf_tgt_br2" 00:21:25.021 11:32:20 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@165 -- # true 00:21:25.021 11:32:20 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@166 -- # ip link set nvmf_init_br down 00:21:25.021 Cannot find device "nvmf_init_br" 00:21:25.021 11:32:20 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@166 -- # true 00:21:25.021 11:32:20 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@167 -- # ip link set nvmf_init_br2 down 00:21:25.021 Cannot find device "nvmf_init_br2" 00:21:25.021 11:32:20 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@167 -- # true 00:21:25.021 11:32:20 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@168 -- # ip link set nvmf_tgt_br down 00:21:25.021 Cannot find device "nvmf_tgt_br" 00:21:25.021 11:32:20 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@168 -- # true 00:21:25.021 11:32:20 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@169 -- # ip link set nvmf_tgt_br2 down 00:21:25.021 Cannot find device "nvmf_tgt_br2" 00:21:25.021 11:32:20 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@169 -- # true 00:21:25.021 11:32:20 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@170 -- # ip link delete nvmf_br type bridge 00:21:25.021 Cannot find device "nvmf_br" 00:21:25.021 11:32:20 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@170 -- # true 00:21:25.021 11:32:20 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@171 -- # ip link delete nvmf_init_if 00:21:25.021 Cannot find device "nvmf_init_if" 00:21:25.021 11:32:20 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@171 -- # true 00:21:25.021 11:32:20 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@172 -- # ip link delete nvmf_init_if2 00:21:25.279 Cannot find device "nvmf_init_if2" 00:21:25.279 11:32:20 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@172 -- # true 00:21:25.279 11:32:20 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@173 -- # ip netns exec nvmf_tgt_ns_spdk ip link delete nvmf_tgt_if 00:21:25.279 Cannot open network namespace "nvmf_tgt_ns_spdk": No such file or directory 00:21:25.279 11:32:20 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@173 -- # true 00:21:25.279 11:32:20 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@174 -- # ip netns exec nvmf_tgt_ns_spdk ip link delete nvmf_tgt_if2 00:21:25.279 Cannot open network namespace "nvmf_tgt_ns_spdk": No such file or directory 00:21:25.279 11:32:20 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@174 -- # true 00:21:25.279 11:32:20 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@177 -- # ip netns add nvmf_tgt_ns_spdk 00:21:25.279 11:32:20 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@180 -- # ip link add nvmf_init_if type veth peer name nvmf_init_br 00:21:25.279 11:32:20 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@181 -- # ip link add nvmf_init_if2 type veth peer name nvmf_init_br2 00:21:25.279 11:32:20 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@182 -- # ip link add nvmf_tgt_if type veth peer name nvmf_tgt_br 00:21:25.279 11:32:20 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@183 -- # ip link add nvmf_tgt_if2 type veth peer name nvmf_tgt_br2 00:21:25.279 11:32:20 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@186 -- # ip link set nvmf_tgt_if netns nvmf_tgt_ns_spdk 00:21:25.279 11:32:20 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@187 -- # ip link set nvmf_tgt_if2 netns nvmf_tgt_ns_spdk 00:21:25.279 11:32:20 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@190 -- # ip addr add 10.0.0.1/24 dev nvmf_init_if 00:21:25.279 11:32:20 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@191 -- # ip addr add 10.0.0.2/24 dev nvmf_init_if2 00:21:25.279 11:32:20 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@192 -- # ip netns exec nvmf_tgt_ns_spdk ip addr add 10.0.0.3/24 dev nvmf_tgt_if 00:21:25.279 11:32:20 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@193 -- # ip netns exec nvmf_tgt_ns_spdk ip addr add 10.0.0.4/24 dev nvmf_tgt_if2 00:21:25.279 11:32:20 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@196 -- # ip link set nvmf_init_if up 00:21:25.279 11:32:20 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@197 -- # ip link set nvmf_init_if2 up 00:21:25.279 11:32:20 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@198 -- # ip link set nvmf_init_br up 00:21:25.279 11:32:20 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@199 -- # ip link set nvmf_init_br2 up 00:21:25.279 11:32:20 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@200 -- # ip link set nvmf_tgt_br up 00:21:25.279 11:32:20 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@201 -- # ip link set nvmf_tgt_br2 up 00:21:25.280 11:32:20 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@202 -- # ip netns exec nvmf_tgt_ns_spdk ip link set nvmf_tgt_if up 00:21:25.280 11:32:20 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@203 -- # ip netns exec nvmf_tgt_ns_spdk ip link set nvmf_tgt_if2 up 00:21:25.280 11:32:20 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@204 -- # ip netns exec nvmf_tgt_ns_spdk ip link set lo up 00:21:25.280 11:32:20 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@207 -- # ip link add nvmf_br type bridge 00:21:25.280 11:32:20 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@208 -- # ip link set nvmf_br up 00:21:25.280 11:32:20 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@211 -- # ip link set nvmf_init_br master nvmf_br 00:21:25.280 11:32:20 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@212 -- # ip link set nvmf_init_br2 master nvmf_br 00:21:25.280 11:32:20 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@213 -- # ip link set nvmf_tgt_br master nvmf_br 00:21:25.280 11:32:20 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@214 -- # ip link set nvmf_tgt_br2 master nvmf_br 00:21:25.280 11:32:20 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@217 -- # ipts -I INPUT 1 -i nvmf_init_if -p tcp --dport 4420 -j ACCEPT 00:21:25.280 11:32:20 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@788 -- # iptables -I INPUT 1 -i nvmf_init_if -p tcp --dport 4420 -j ACCEPT -m comment --comment 'SPDK_NVMF:-I INPUT 1 -i nvmf_init_if -p tcp --dport 4420 -j ACCEPT' 00:21:25.280 11:32:20 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@218 -- # ipts -I INPUT 1 -i nvmf_init_if2 -p tcp --dport 4420 -j ACCEPT 00:21:25.280 11:32:20 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@788 -- # iptables -I INPUT 1 -i nvmf_init_if2 -p tcp --dport 4420 -j ACCEPT -m comment --comment 'SPDK_NVMF:-I INPUT 1 -i nvmf_init_if2 -p tcp --dport 4420 -j ACCEPT' 00:21:25.280 11:32:20 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@219 -- # ipts -A FORWARD -i nvmf_br -o nvmf_br -j ACCEPT 00:21:25.280 11:32:20 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@788 -- # iptables -A FORWARD -i nvmf_br -o nvmf_br -j ACCEPT -m comment --comment 'SPDK_NVMF:-A FORWARD -i nvmf_br -o nvmf_br -j ACCEPT' 00:21:25.280 11:32:20 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@222 -- # ping -c 1 10.0.0.3 00:21:25.280 PING 10.0.0.3 (10.0.0.3) 56(84) bytes of data. 00:21:25.280 64 bytes from 10.0.0.3: icmp_seq=1 ttl=64 time=0.088 ms 00:21:25.280 00:21:25.280 --- 10.0.0.3 ping statistics --- 00:21:25.280 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:21:25.280 rtt min/avg/max/mdev = 0.088/0.088/0.088/0.000 ms 00:21:25.280 11:32:20 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@223 -- # ping -c 1 10.0.0.4 00:21:25.280 PING 10.0.0.4 (10.0.0.4) 56(84) bytes of data. 00:21:25.280 64 bytes from 10.0.0.4: icmp_seq=1 ttl=64 time=0.067 ms 00:21:25.280 00:21:25.280 --- 10.0.0.4 ping statistics --- 00:21:25.280 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:21:25.280 rtt min/avg/max/mdev = 0.067/0.067/0.067/0.000 ms 00:21:25.280 11:32:20 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@224 -- # ip netns exec nvmf_tgt_ns_spdk ping -c 1 10.0.0.1 00:21:25.280 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:21:25.280 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.032 ms 00:21:25.280 00:21:25.280 --- 10.0.0.1 ping statistics --- 00:21:25.280 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:21:25.280 rtt min/avg/max/mdev = 0.032/0.032/0.032/0.000 ms 00:21:25.280 11:32:20 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@225 -- # ip netns exec nvmf_tgt_ns_spdk ping -c 1 10.0.0.2 00:21:25.280 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:21:25.280 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.063 ms 00:21:25.280 00:21:25.280 --- 10.0.0.2 ping statistics --- 00:21:25.280 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:21:25.280 rtt min/avg/max/mdev = 0.063/0.063/0.063/0.000 ms 00:21:25.280 11:32:20 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@227 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:21:25.280 11:32:20 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@459 -- # return 0 00:21:25.280 11:32:20 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@476 -- # '[' '' == iso ']' 00:21:25.280 11:32:20 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@480 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:21:25.280 11:32:20 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@481 -- # [[ tcp == \r\d\m\a ]] 00:21:25.280 11:32:20 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@490 -- # [[ tcp == \t\c\p ]] 00:21:25.280 11:32:20 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@491 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:21:25.280 11:32:20 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@494 -- # '[' tcp == tcp ']' 00:21:25.280 11:32:20 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@500 -- # modprobe nvme-tcp 00:21:25.538 11:32:20 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- target/control_msg_list.sh@13 -- # nvmfappstart 00:21:25.538 11:32:20 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@505 -- # timing_enter start_nvmf_tgt 00:21:25.538 11:32:20 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- common/autotest_common.sh@724 -- # xtrace_disable 00:21:25.538 11:32:20 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- common/autotest_common.sh@10 -- # set +x 00:21:25.538 11:32:20 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@507 -- # nvmfpid=86097 00:21:25.538 11:32:20 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@506 -- # ip netns exec nvmf_tgt_ns_spdk /home/vagrant/spdk_repo/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF 00:21:25.538 11:32:20 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@508 -- # waitforlisten 86097 00:21:25.538 11:32:20 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- common/autotest_common.sh@831 -- # '[' -z 86097 ']' 00:21:25.538 11:32:20 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- common/autotest_common.sh@835 -- # local rpc_addr=/var/tmp/spdk.sock 00:21:25.538 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:21:25.538 11:32:20 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- common/autotest_common.sh@836 -- # local max_retries=100 00:21:25.538 11:32:20 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- common/autotest_common.sh@838 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:21:25.538 11:32:20 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- common/autotest_common.sh@840 -- # xtrace_disable 00:21:25.538 11:32:20 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- common/autotest_common.sh@10 -- # set +x 00:21:25.538 [2024-10-07 11:32:20.865998] Starting SPDK v25.01-pre git sha1 2a4f56c54 / DPDK 24.03.0 initialization... 00:21:25.538 [2024-10-07 11:32:20.866075] [ DPDK EAL parameters: nvmf -c 0x1 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --iova-mode=pa --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:21:25.538 [2024-10-07 11:32:20.999093] app.c: 917:spdk_app_start: *NOTICE*: Total cores available: 1 00:21:25.796 [2024-10-07 11:32:21.103477] app.c: 610:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:21:25.797 [2024-10-07 11:32:21.103536] app.c: 611:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:21:25.797 [2024-10-07 11:32:21.103548] app.c: 616:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:21:25.797 [2024-10-07 11:32:21.103557] app.c: 617:app_setup_trace: *NOTICE*: SPDK application currently running. 00:21:25.797 [2024-10-07 11:32:21.103565] app.c: 618:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:21:25.797 [2024-10-07 11:32:21.103998] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 0 00:21:25.797 11:32:21 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- common/autotest_common.sh@860 -- # (( i == 0 )) 00:21:25.797 11:32:21 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- common/autotest_common.sh@864 -- # return 0 00:21:25.797 11:32:21 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@509 -- # timing_exit start_nvmf_tgt 00:21:25.797 11:32:21 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- common/autotest_common.sh@730 -- # xtrace_disable 00:21:25.797 11:32:21 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- common/autotest_common.sh@10 -- # set +x 00:21:25.797 11:32:21 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@510 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:21:25.797 11:32:21 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- target/control_msg_list.sh@15 -- # subnqn=nqn.2024-07.io.spdk:cnode0 00:21:25.797 11:32:21 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- target/control_msg_list.sh@16 -- # perf=/home/vagrant/spdk_repo/spdk/build/bin/spdk_nvme_perf 00:21:25.797 11:32:21 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- target/control_msg_list.sh@19 -- # rpc_cmd nvmf_create_transport '-t tcp -o' --in-capsule-data-size 768 --control-msg-num 1 00:21:25.797 11:32:21 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- common/autotest_common.sh@561 -- # xtrace_disable 00:21:25.797 11:32:21 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- common/autotest_common.sh@10 -- # set +x 00:21:25.797 [2024-10-07 11:32:21.286329] tcp.c: 738:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:21:25.797 11:32:21 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:21:25.797 11:32:21 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- target/control_msg_list.sh@20 -- # rpc_cmd nvmf_create_subsystem nqn.2024-07.io.spdk:cnode0 -a 00:21:25.797 11:32:21 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- common/autotest_common.sh@561 -- # xtrace_disable 00:21:25.797 11:32:21 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- common/autotest_common.sh@10 -- # set +x 00:21:25.797 11:32:21 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:21:25.797 11:32:21 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- target/control_msg_list.sh@21 -- # rpc_cmd bdev_malloc_create -b Malloc0 32 512 00:21:25.797 11:32:21 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- common/autotest_common.sh@561 -- # xtrace_disable 00:21:25.797 11:32:21 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- common/autotest_common.sh@10 -- # set +x 00:21:25.797 Malloc0 00:21:25.797 11:32:21 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:21:25.797 11:32:21 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- target/control_msg_list.sh@22 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2024-07.io.spdk:cnode0 Malloc0 00:21:26.055 11:32:21 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- common/autotest_common.sh@561 -- # xtrace_disable 00:21:26.055 11:32:21 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- common/autotest_common.sh@10 -- # set +x 00:21:26.055 11:32:21 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:21:26.055 11:32:21 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- target/control_msg_list.sh@23 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2024-07.io.spdk:cnode0 -t tcp -a 10.0.0.3 -s 4420 00:21:26.055 11:32:21 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- common/autotest_common.sh@561 -- # xtrace_disable 00:21:26.055 11:32:21 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- common/autotest_common.sh@10 -- # set +x 00:21:26.055 [2024-10-07 11:32:21.333937] tcp.c:1081:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.3 port 4420 *** 00:21:26.055 11:32:21 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:21:26.055 11:32:21 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- target/control_msg_list.sh@27 -- # perf_pid1=86132 00:21:26.055 11:32:21 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- target/control_msg_list.sh@26 -- # /home/vagrant/spdk_repo/spdk/build/bin/spdk_nvme_perf -c 0x2 -q 1 -o 4096 -w randread -t 1 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.3 trsvcid:4420' 00:21:26.055 11:32:21 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- target/control_msg_list.sh@29 -- # perf_pid2=86133 00:21:26.055 11:32:21 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- target/control_msg_list.sh@28 -- # /home/vagrant/spdk_repo/spdk/build/bin/spdk_nvme_perf -c 0x4 -q 1 -o 4096 -w randread -t 1 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.3 trsvcid:4420' 00:21:26.055 11:32:21 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- target/control_msg_list.sh@31 -- # perf_pid3=86134 00:21:26.055 11:32:21 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- target/control_msg_list.sh@33 -- # wait 86132 00:21:26.055 11:32:21 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- target/control_msg_list.sh@30 -- # /home/vagrant/spdk_repo/spdk/build/bin/spdk_nvme_perf -c 0x8 -q 1 -o 4096 -w randread -t 1 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.3 trsvcid:4420' 00:21:26.055 [2024-10-07 11:32:21.508323] subsystem.c:1641:spdk_nvmf_subsystem_listener_allowed: *WARNING*: Allowing connection to discovery subsystem on TCP/10.0.0.3/4420, even though this listener was not added to the discovery subsystem. This behavior is deprecated and will be removed in a future release. 00:21:26.056 [2024-10-07 11:32:21.534539] subsystem.c:1641:spdk_nvmf_subsystem_listener_allowed: *WARNING*: Allowing connection to discovery subsystem on TCP/10.0.0.3/4420, even though this listener was not added to the discovery subsystem. This behavior is deprecated and will be removed in a future release. 00:21:26.056 [2024-10-07 11:32:21.535604] subsystem.c:1641:spdk_nvmf_subsystem_listener_allowed: *WARNING*: Allowing connection to discovery subsystem on TCP/10.0.0.3/4420, even though this listener was not added to the discovery subsystem. This behavior is deprecated and will be removed in a future release. 00:21:27.430 Initializing NVMe Controllers 00:21:27.430 Attached to NVMe over Fabrics controller at 10.0.0.3:4420: nqn.2024-07.io.spdk:cnode0 00:21:27.430 Associating TCP (addr:10.0.0.3 subnqn:nqn.2024-07.io.spdk:cnode0) NSID 1 with lcore 1 00:21:27.430 Initialization complete. Launching workers. 00:21:27.430 ======================================================== 00:21:27.430 Latency(us) 00:21:27.430 Device Information : IOPS MiB/s Average min max 00:21:27.430 TCP (addr:10.0.0.3 subnqn:nqn.2024-07.io.spdk:cnode0) NSID 1 from core 1: 3046.00 11.90 327.89 161.69 1036.65 00:21:27.430 ======================================================== 00:21:27.430 Total : 3046.00 11.90 327.89 161.69 1036.65 00:21:27.430 00:21:27.430 Initializing NVMe Controllers 00:21:27.430 Attached to NVMe over Fabrics controller at 10.0.0.3:4420: nqn.2024-07.io.spdk:cnode0 00:21:27.430 Associating TCP (addr:10.0.0.3 subnqn:nqn.2024-07.io.spdk:cnode0) NSID 1 with lcore 2 00:21:27.430 Initialization complete. Launching workers. 00:21:27.430 ======================================================== 00:21:27.430 Latency(us) 00:21:27.430 Device Information : IOPS MiB/s Average min max 00:21:27.430 TCP (addr:10.0.0.3 subnqn:nqn.2024-07.io.spdk:cnode0) NSID 1 from core 2: 3029.00 11.83 329.80 144.39 1125.64 00:21:27.430 ======================================================== 00:21:27.430 Total : 3029.00 11.83 329.80 144.39 1125.64 00:21:27.430 00:21:27.430 Initializing NVMe Controllers 00:21:27.430 Attached to NVMe over Fabrics controller at 10.0.0.3:4420: nqn.2024-07.io.spdk:cnode0 00:21:27.430 Associating TCP (addr:10.0.0.3 subnqn:nqn.2024-07.io.spdk:cnode0) NSID 1 with lcore 3 00:21:27.430 Initialization complete. Launching workers. 00:21:27.430 ======================================================== 00:21:27.430 Latency(us) 00:21:27.430 Device Information : IOPS MiB/s Average min max 00:21:27.430 TCP (addr:10.0.0.3 subnqn:nqn.2024-07.io.spdk:cnode0) NSID 1 from core 3: 3025.96 11.82 330.06 149.84 1583.32 00:21:27.430 ======================================================== 00:21:27.430 Total : 3025.96 11.82 330.06 149.84 1583.32 00:21:27.430 00:21:27.430 11:32:22 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- target/control_msg_list.sh@34 -- # wait 86133 00:21:27.430 11:32:22 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- target/control_msg_list.sh@35 -- # wait 86134 00:21:27.430 11:32:22 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- target/control_msg_list.sh@37 -- # trap - SIGINT SIGTERM EXIT 00:21:27.430 11:32:22 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- target/control_msg_list.sh@38 -- # nvmftestfini 00:21:27.430 11:32:22 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@514 -- # nvmfcleanup 00:21:27.430 11:32:22 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@121 -- # sync 00:21:27.430 11:32:22 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@123 -- # '[' tcp == tcp ']' 00:21:27.430 11:32:22 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@124 -- # set +e 00:21:27.430 11:32:22 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@125 -- # for i in {1..20} 00:21:27.430 11:32:22 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@126 -- # modprobe -v -r nvme-tcp 00:21:27.430 rmmod nvme_tcp 00:21:27.430 rmmod nvme_fabrics 00:21:27.430 rmmod nvme_keyring 00:21:27.431 11:32:22 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@127 -- # modprobe -v -r nvme-fabrics 00:21:27.431 11:32:22 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@128 -- # set -e 00:21:27.431 11:32:22 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@129 -- # return 0 00:21:27.431 11:32:22 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@515 -- # '[' -n 86097 ']' 00:21:27.431 11:32:22 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@516 -- # killprocess 86097 00:21:27.431 11:32:22 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- common/autotest_common.sh@950 -- # '[' -z 86097 ']' 00:21:27.431 11:32:22 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- common/autotest_common.sh@954 -- # kill -0 86097 00:21:27.431 11:32:22 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- common/autotest_common.sh@955 -- # uname 00:21:27.431 11:32:22 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- common/autotest_common.sh@955 -- # '[' Linux = Linux ']' 00:21:27.431 11:32:22 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- common/autotest_common.sh@956 -- # ps --no-headers -o comm= 86097 00:21:27.431 killing process with pid 86097 00:21:27.431 11:32:22 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- common/autotest_common.sh@956 -- # process_name=reactor_0 00:21:27.431 11:32:22 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- common/autotest_common.sh@960 -- # '[' reactor_0 = sudo ']' 00:21:27.431 11:32:22 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- common/autotest_common.sh@968 -- # echo 'killing process with pid 86097' 00:21:27.431 11:32:22 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- common/autotest_common.sh@969 -- # kill 86097 00:21:27.431 11:32:22 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- common/autotest_common.sh@974 -- # wait 86097 00:21:27.995 11:32:23 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@518 -- # '[' '' == iso ']' 00:21:27.995 11:32:23 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@521 -- # [[ tcp == \t\c\p ]] 00:21:27.995 11:32:23 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@522 -- # nvmf_tcp_fini 00:21:27.995 11:32:23 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@297 -- # iptr 00:21:27.995 11:32:23 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@789 -- # iptables-save 00:21:27.995 11:32:23 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@789 -- # grep -v SPDK_NVMF 00:21:27.995 11:32:23 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@789 -- # iptables-restore 00:21:27.995 11:32:23 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@298 -- # [[ nvmf_tgt_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s\_\s\p\d\k ]] 00:21:27.995 11:32:23 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@299 -- # nvmf_veth_fini 00:21:27.995 11:32:23 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@233 -- # ip link set nvmf_init_br nomaster 00:21:27.995 11:32:23 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@234 -- # ip link set nvmf_init_br2 nomaster 00:21:27.995 11:32:23 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@235 -- # ip link set nvmf_tgt_br nomaster 00:21:27.995 11:32:23 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@236 -- # ip link set nvmf_tgt_br2 nomaster 00:21:27.995 11:32:23 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@237 -- # ip link set nvmf_init_br down 00:21:27.995 11:32:23 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@238 -- # ip link set nvmf_init_br2 down 00:21:27.995 11:32:23 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@239 -- # ip link set nvmf_tgt_br down 00:21:27.995 11:32:23 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@240 -- # ip link set nvmf_tgt_br2 down 00:21:27.995 11:32:23 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@241 -- # ip link delete nvmf_br type bridge 00:21:27.995 11:32:23 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@242 -- # ip link delete nvmf_init_if 00:21:27.995 11:32:23 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@243 -- # ip link delete nvmf_init_if2 00:21:27.995 11:32:23 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@244 -- # ip netns exec nvmf_tgt_ns_spdk ip link delete nvmf_tgt_if 00:21:27.995 11:32:23 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@245 -- # ip netns exec nvmf_tgt_ns_spdk ip link delete nvmf_tgt_if2 00:21:27.995 11:32:23 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@246 -- # remove_spdk_ns 00:21:27.995 11:32:23 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@654 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:21:27.995 11:32:23 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 15> /dev/null' 00:21:27.995 11:32:23 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:21:27.995 11:32:23 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@300 -- # return 0 00:21:27.995 00:21:27.995 real 0m3.301s 00:21:27.995 user 0m4.993s 00:21:27.995 sys 0m1.485s 00:21:27.995 11:32:23 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- common/autotest_common.sh@1126 -- # xtrace_disable 00:21:27.995 11:32:23 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- common/autotest_common.sh@10 -- # set +x 00:21:27.995 ************************************ 00:21:27.995 END TEST nvmf_control_msg_list 00:21:27.995 ************************************ 00:21:28.253 11:32:23 nvmf_tcp.nvmf_target_extra -- nvmf/nvmf_target_extra.sh@44 -- # run_test nvmf_wait_for_buf /home/vagrant/spdk_repo/spdk/test/nvmf/target/wait_for_buf.sh --transport=tcp 00:21:28.253 11:32:23 nvmf_tcp.nvmf_target_extra -- common/autotest_common.sh@1101 -- # '[' 3 -le 1 ']' 00:21:28.253 11:32:23 nvmf_tcp.nvmf_target_extra -- common/autotest_common.sh@1107 -- # xtrace_disable 00:21:28.253 11:32:23 nvmf_tcp.nvmf_target_extra -- common/autotest_common.sh@10 -- # set +x 00:21:28.253 ************************************ 00:21:28.253 START TEST nvmf_wait_for_buf 00:21:28.253 ************************************ 00:21:28.253 11:32:23 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- common/autotest_common.sh@1125 -- # /home/vagrant/spdk_repo/spdk/test/nvmf/target/wait_for_buf.sh --transport=tcp 00:21:28.253 * Looking for test storage... 00:21:28.253 * Found test storage at /home/vagrant/spdk_repo/spdk/test/nvmf/target 00:21:28.253 11:32:23 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- common/autotest_common.sh@1680 -- # [[ y == y ]] 00:21:28.253 11:32:23 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- common/autotest_common.sh@1681 -- # lcov --version 00:21:28.253 11:32:23 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- common/autotest_common.sh@1681 -- # awk '{print $NF}' 00:21:28.253 11:32:23 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- common/autotest_common.sh@1681 -- # lt 1.15 2 00:21:28.253 11:32:23 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- scripts/common.sh@373 -- # cmp_versions 1.15 '<' 2 00:21:28.253 11:32:23 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- scripts/common.sh@333 -- # local ver1 ver1_l 00:21:28.253 11:32:23 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- scripts/common.sh@334 -- # local ver2 ver2_l 00:21:28.253 11:32:23 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- scripts/common.sh@336 -- # IFS=.-: 00:21:28.253 11:32:23 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- scripts/common.sh@336 -- # read -ra ver1 00:21:28.253 11:32:23 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- scripts/common.sh@337 -- # IFS=.-: 00:21:28.253 11:32:23 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- scripts/common.sh@337 -- # read -ra ver2 00:21:28.253 11:32:23 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- scripts/common.sh@338 -- # local 'op=<' 00:21:28.254 11:32:23 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- scripts/common.sh@340 -- # ver1_l=2 00:21:28.254 11:32:23 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- scripts/common.sh@341 -- # ver2_l=1 00:21:28.254 11:32:23 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- scripts/common.sh@343 -- # local lt=0 gt=0 eq=0 v 00:21:28.254 11:32:23 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- scripts/common.sh@344 -- # case "$op" in 00:21:28.254 11:32:23 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- scripts/common.sh@345 -- # : 1 00:21:28.254 11:32:23 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- scripts/common.sh@364 -- # (( v = 0 )) 00:21:28.254 11:32:23 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- scripts/common.sh@364 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:21:28.254 11:32:23 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- scripts/common.sh@365 -- # decimal 1 00:21:28.254 11:32:23 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- scripts/common.sh@353 -- # local d=1 00:21:28.254 11:32:23 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- scripts/common.sh@354 -- # [[ 1 =~ ^[0-9]+$ ]] 00:21:28.254 11:32:23 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- scripts/common.sh@355 -- # echo 1 00:21:28.254 11:32:23 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- scripts/common.sh@365 -- # ver1[v]=1 00:21:28.254 11:32:23 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- scripts/common.sh@366 -- # decimal 2 00:21:28.254 11:32:23 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- scripts/common.sh@353 -- # local d=2 00:21:28.254 11:32:23 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- scripts/common.sh@354 -- # [[ 2 =~ ^[0-9]+$ ]] 00:21:28.254 11:32:23 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- scripts/common.sh@355 -- # echo 2 00:21:28.254 11:32:23 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- scripts/common.sh@366 -- # ver2[v]=2 00:21:28.254 11:32:23 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- scripts/common.sh@367 -- # (( ver1[v] > ver2[v] )) 00:21:28.254 11:32:23 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- scripts/common.sh@368 -- # (( ver1[v] < ver2[v] )) 00:21:28.254 11:32:23 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- scripts/common.sh@368 -- # return 0 00:21:28.254 11:32:23 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- common/autotest_common.sh@1682 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:21:28.254 11:32:23 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- common/autotest_common.sh@1694 -- # export 'LCOV_OPTS= 00:21:28.254 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:21:28.254 --rc genhtml_branch_coverage=1 00:21:28.254 --rc genhtml_function_coverage=1 00:21:28.254 --rc genhtml_legend=1 00:21:28.254 --rc geninfo_all_blocks=1 00:21:28.254 --rc geninfo_unexecuted_blocks=1 00:21:28.254 00:21:28.254 ' 00:21:28.254 11:32:23 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- common/autotest_common.sh@1694 -- # LCOV_OPTS=' 00:21:28.254 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:21:28.254 --rc genhtml_branch_coverage=1 00:21:28.254 --rc genhtml_function_coverage=1 00:21:28.254 --rc genhtml_legend=1 00:21:28.254 --rc geninfo_all_blocks=1 00:21:28.254 --rc geninfo_unexecuted_blocks=1 00:21:28.254 00:21:28.254 ' 00:21:28.254 11:32:23 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- common/autotest_common.sh@1695 -- # export 'LCOV=lcov 00:21:28.254 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:21:28.254 --rc genhtml_branch_coverage=1 00:21:28.254 --rc genhtml_function_coverage=1 00:21:28.254 --rc genhtml_legend=1 00:21:28.254 --rc geninfo_all_blocks=1 00:21:28.254 --rc geninfo_unexecuted_blocks=1 00:21:28.254 00:21:28.254 ' 00:21:28.254 11:32:23 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- common/autotest_common.sh@1695 -- # LCOV='lcov 00:21:28.254 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:21:28.254 --rc genhtml_branch_coverage=1 00:21:28.254 --rc genhtml_function_coverage=1 00:21:28.254 --rc genhtml_legend=1 00:21:28.254 --rc geninfo_all_blocks=1 00:21:28.254 --rc geninfo_unexecuted_blocks=1 00:21:28.254 00:21:28.254 ' 00:21:28.254 11:32:23 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- target/wait_for_buf.sh@10 -- # source /home/vagrant/spdk_repo/spdk/test/nvmf/common.sh 00:21:28.254 11:32:23 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@7 -- # uname -s 00:21:28.254 11:32:23 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:21:28.254 11:32:23 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:21:28.254 11:32:23 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:21:28.254 11:32:23 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:21:28.254 11:32:23 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:21:28.254 11:32:23 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:21:28.254 11:32:23 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:21:28.254 11:32:23 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:21:28.254 11:32:23 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:21:28.254 11:32:23 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:21:28.254 11:32:23 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:c758a4ed-f09f-4c82-9afb-3d096f035464 00:21:28.254 11:32:23 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@18 -- # NVME_HOSTID=c758a4ed-f09f-4c82-9afb-3d096f035464 00:21:28.254 11:32:23 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:21:28.254 11:32:23 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:21:28.254 11:32:23 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@21 -- # NET_TYPE=virt 00:21:28.254 11:32:23 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:21:28.254 11:32:23 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@49 -- # source /home/vagrant/spdk_repo/spdk/scripts/common.sh 00:21:28.254 11:32:23 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- scripts/common.sh@15 -- # shopt -s extglob 00:21:28.254 11:32:23 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- scripts/common.sh@544 -- # [[ -e /bin/wpdk_common.sh ]] 00:21:28.254 11:32:23 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- scripts/common.sh@552 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:21:28.254 11:32:23 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- scripts/common.sh@553 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:21:28.254 11:32:23 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:21:28.254 11:32:23 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:21:28.254 11:32:23 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:21:28.254 11:32:23 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- paths/export.sh@5 -- # export PATH 00:21:28.254 11:32:23 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:21:28.254 11:32:23 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@51 -- # : 0 00:21:28.254 11:32:23 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@52 -- # export NVMF_APP_SHM_ID 00:21:28.254 11:32:23 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@53 -- # build_nvmf_app_args 00:21:28.254 11:32:23 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:21:28.254 11:32:23 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:21:28.254 11:32:23 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:21:28.254 11:32:23 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@33 -- # '[' '' -eq 1 ']' 00:21:28.254 /home/vagrant/spdk_repo/spdk/test/nvmf/common.sh: line 33: [: : integer expression expected 00:21:28.254 11:32:23 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@37 -- # '[' -n '' ']' 00:21:28.254 11:32:23 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@39 -- # '[' 0 -eq 1 ']' 00:21:28.254 11:32:23 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@55 -- # have_pci_nics=0 00:21:28.254 11:32:23 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- target/wait_for_buf.sh@12 -- # nvmftestinit 00:21:28.254 11:32:23 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@467 -- # '[' -z tcp ']' 00:21:28.254 11:32:23 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@472 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:21:28.254 11:32:23 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@474 -- # prepare_net_devs 00:21:28.254 11:32:23 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@436 -- # local -g is_hw=no 00:21:28.254 11:32:23 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@438 -- # remove_spdk_ns 00:21:28.254 11:32:23 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@654 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:21:28.254 11:32:23 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 15> /dev/null' 00:21:28.254 11:32:23 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:21:28.254 11:32:23 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@440 -- # [[ virt != virt ]] 00:21:28.254 11:32:23 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@442 -- # [[ no == yes ]] 00:21:28.254 11:32:23 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@449 -- # [[ virt == phy ]] 00:21:28.254 11:32:23 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@452 -- # [[ virt == phy-fallback ]] 00:21:28.254 11:32:23 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@457 -- # [[ tcp == tcp ]] 00:21:28.254 11:32:23 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@458 -- # nvmf_veth_init 00:21:28.254 11:32:23 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@145 -- # NVMF_FIRST_INITIATOR_IP=10.0.0.1 00:21:28.255 11:32:23 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@146 -- # NVMF_SECOND_INITIATOR_IP=10.0.0.2 00:21:28.255 11:32:23 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@147 -- # NVMF_FIRST_TARGET_IP=10.0.0.3 00:21:28.255 11:32:23 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@148 -- # NVMF_SECOND_TARGET_IP=10.0.0.4 00:21:28.255 11:32:23 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@149 -- # NVMF_INITIATOR_IP=10.0.0.1 00:21:28.255 11:32:23 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@150 -- # NVMF_BRIDGE=nvmf_br 00:21:28.255 11:32:23 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@151 -- # NVMF_INITIATOR_INTERFACE=nvmf_init_if 00:21:28.255 11:32:23 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@152 -- # NVMF_INITIATOR_INTERFACE2=nvmf_init_if2 00:21:28.255 11:32:23 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@153 -- # NVMF_INITIATOR_BRIDGE=nvmf_init_br 00:21:28.255 11:32:23 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@154 -- # NVMF_INITIATOR_BRIDGE2=nvmf_init_br2 00:21:28.255 11:32:23 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@155 -- # NVMF_TARGET_NAMESPACE=nvmf_tgt_ns_spdk 00:21:28.255 11:32:23 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@156 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:21:28.255 11:32:23 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@157 -- # NVMF_TARGET_INTERFACE=nvmf_tgt_if 00:21:28.255 11:32:23 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@158 -- # NVMF_TARGET_INTERFACE2=nvmf_tgt_if2 00:21:28.255 11:32:23 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@159 -- # NVMF_TARGET_BRIDGE=nvmf_tgt_br 00:21:28.255 11:32:23 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@160 -- # NVMF_TARGET_BRIDGE2=nvmf_tgt_br2 00:21:28.255 11:32:23 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@162 -- # ip link set nvmf_init_br nomaster 00:21:28.255 Cannot find device "nvmf_init_br" 00:21:28.255 11:32:23 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@162 -- # true 00:21:28.255 11:32:23 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@163 -- # ip link set nvmf_init_br2 nomaster 00:21:28.512 Cannot find device "nvmf_init_br2" 00:21:28.512 11:32:23 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@163 -- # true 00:21:28.512 11:32:23 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@164 -- # ip link set nvmf_tgt_br nomaster 00:21:28.512 Cannot find device "nvmf_tgt_br" 00:21:28.512 11:32:23 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@164 -- # true 00:21:28.512 11:32:23 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@165 -- # ip link set nvmf_tgt_br2 nomaster 00:21:28.512 Cannot find device "nvmf_tgt_br2" 00:21:28.512 11:32:23 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@165 -- # true 00:21:28.512 11:32:23 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@166 -- # ip link set nvmf_init_br down 00:21:28.512 Cannot find device "nvmf_init_br" 00:21:28.512 11:32:23 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@166 -- # true 00:21:28.512 11:32:23 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@167 -- # ip link set nvmf_init_br2 down 00:21:28.512 Cannot find device "nvmf_init_br2" 00:21:28.512 11:32:23 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@167 -- # true 00:21:28.512 11:32:23 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@168 -- # ip link set nvmf_tgt_br down 00:21:28.512 Cannot find device "nvmf_tgt_br" 00:21:28.512 11:32:23 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@168 -- # true 00:21:28.512 11:32:23 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@169 -- # ip link set nvmf_tgt_br2 down 00:21:28.512 Cannot find device "nvmf_tgt_br2" 00:21:28.512 11:32:23 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@169 -- # true 00:21:28.512 11:32:23 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@170 -- # ip link delete nvmf_br type bridge 00:21:28.512 Cannot find device "nvmf_br" 00:21:28.512 11:32:23 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@170 -- # true 00:21:28.512 11:32:23 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@171 -- # ip link delete nvmf_init_if 00:21:28.512 Cannot find device "nvmf_init_if" 00:21:28.512 11:32:23 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@171 -- # true 00:21:28.512 11:32:23 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@172 -- # ip link delete nvmf_init_if2 00:21:28.512 Cannot find device "nvmf_init_if2" 00:21:28.512 11:32:23 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@172 -- # true 00:21:28.512 11:32:23 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@173 -- # ip netns exec nvmf_tgt_ns_spdk ip link delete nvmf_tgt_if 00:21:28.512 Cannot open network namespace "nvmf_tgt_ns_spdk": No such file or directory 00:21:28.512 11:32:23 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@173 -- # true 00:21:28.512 11:32:23 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@174 -- # ip netns exec nvmf_tgt_ns_spdk ip link delete nvmf_tgt_if2 00:21:28.512 Cannot open network namespace "nvmf_tgt_ns_spdk": No such file or directory 00:21:28.512 11:32:23 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@174 -- # true 00:21:28.512 11:32:23 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@177 -- # ip netns add nvmf_tgt_ns_spdk 00:21:28.512 11:32:23 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@180 -- # ip link add nvmf_init_if type veth peer name nvmf_init_br 00:21:28.512 11:32:23 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@181 -- # ip link add nvmf_init_if2 type veth peer name nvmf_init_br2 00:21:28.512 11:32:23 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@182 -- # ip link add nvmf_tgt_if type veth peer name nvmf_tgt_br 00:21:28.512 11:32:23 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@183 -- # ip link add nvmf_tgt_if2 type veth peer name nvmf_tgt_br2 00:21:28.512 11:32:23 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@186 -- # ip link set nvmf_tgt_if netns nvmf_tgt_ns_spdk 00:21:28.512 11:32:23 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@187 -- # ip link set nvmf_tgt_if2 netns nvmf_tgt_ns_spdk 00:21:28.512 11:32:24 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@190 -- # ip addr add 10.0.0.1/24 dev nvmf_init_if 00:21:28.512 11:32:24 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@191 -- # ip addr add 10.0.0.2/24 dev nvmf_init_if2 00:21:28.512 11:32:24 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@192 -- # ip netns exec nvmf_tgt_ns_spdk ip addr add 10.0.0.3/24 dev nvmf_tgt_if 00:21:28.512 11:32:24 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@193 -- # ip netns exec nvmf_tgt_ns_spdk ip addr add 10.0.0.4/24 dev nvmf_tgt_if2 00:21:28.512 11:32:24 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@196 -- # ip link set nvmf_init_if up 00:21:28.512 11:32:24 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@197 -- # ip link set nvmf_init_if2 up 00:21:28.770 11:32:24 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@198 -- # ip link set nvmf_init_br up 00:21:28.770 11:32:24 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@199 -- # ip link set nvmf_init_br2 up 00:21:28.770 11:32:24 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@200 -- # ip link set nvmf_tgt_br up 00:21:28.770 11:32:24 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@201 -- # ip link set nvmf_tgt_br2 up 00:21:28.770 11:32:24 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@202 -- # ip netns exec nvmf_tgt_ns_spdk ip link set nvmf_tgt_if up 00:21:28.770 11:32:24 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@203 -- # ip netns exec nvmf_tgt_ns_spdk ip link set nvmf_tgt_if2 up 00:21:28.770 11:32:24 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@204 -- # ip netns exec nvmf_tgt_ns_spdk ip link set lo up 00:21:28.770 11:32:24 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@207 -- # ip link add nvmf_br type bridge 00:21:28.770 11:32:24 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@208 -- # ip link set nvmf_br up 00:21:28.770 11:32:24 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@211 -- # ip link set nvmf_init_br master nvmf_br 00:21:28.770 11:32:24 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@212 -- # ip link set nvmf_init_br2 master nvmf_br 00:21:28.770 11:32:24 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@213 -- # ip link set nvmf_tgt_br master nvmf_br 00:21:28.770 11:32:24 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@214 -- # ip link set nvmf_tgt_br2 master nvmf_br 00:21:28.770 11:32:24 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@217 -- # ipts -I INPUT 1 -i nvmf_init_if -p tcp --dport 4420 -j ACCEPT 00:21:28.770 11:32:24 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@788 -- # iptables -I INPUT 1 -i nvmf_init_if -p tcp --dport 4420 -j ACCEPT -m comment --comment 'SPDK_NVMF:-I INPUT 1 -i nvmf_init_if -p tcp --dport 4420 -j ACCEPT' 00:21:28.770 11:32:24 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@218 -- # ipts -I INPUT 1 -i nvmf_init_if2 -p tcp --dport 4420 -j ACCEPT 00:21:28.770 11:32:24 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@788 -- # iptables -I INPUT 1 -i nvmf_init_if2 -p tcp --dport 4420 -j ACCEPT -m comment --comment 'SPDK_NVMF:-I INPUT 1 -i nvmf_init_if2 -p tcp --dport 4420 -j ACCEPT' 00:21:28.770 11:32:24 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@219 -- # ipts -A FORWARD -i nvmf_br -o nvmf_br -j ACCEPT 00:21:28.770 11:32:24 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@788 -- # iptables -A FORWARD -i nvmf_br -o nvmf_br -j ACCEPT -m comment --comment 'SPDK_NVMF:-A FORWARD -i nvmf_br -o nvmf_br -j ACCEPT' 00:21:28.770 11:32:24 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@222 -- # ping -c 1 10.0.0.3 00:21:28.770 PING 10.0.0.3 (10.0.0.3) 56(84) bytes of data. 00:21:28.770 64 bytes from 10.0.0.3: icmp_seq=1 ttl=64 time=0.069 ms 00:21:28.770 00:21:28.770 --- 10.0.0.3 ping statistics --- 00:21:28.770 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:21:28.770 rtt min/avg/max/mdev = 0.069/0.069/0.069/0.000 ms 00:21:28.771 11:32:24 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@223 -- # ping -c 1 10.0.0.4 00:21:28.771 PING 10.0.0.4 (10.0.0.4) 56(84) bytes of data. 00:21:28.771 64 bytes from 10.0.0.4: icmp_seq=1 ttl=64 time=0.079 ms 00:21:28.771 00:21:28.771 --- 10.0.0.4 ping statistics --- 00:21:28.771 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:21:28.771 rtt min/avg/max/mdev = 0.079/0.079/0.079/0.000 ms 00:21:28.771 11:32:24 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@224 -- # ip netns exec nvmf_tgt_ns_spdk ping -c 1 10.0.0.1 00:21:28.771 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:21:28.771 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.034 ms 00:21:28.771 00:21:28.771 --- 10.0.0.1 ping statistics --- 00:21:28.771 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:21:28.771 rtt min/avg/max/mdev = 0.034/0.034/0.034/0.000 ms 00:21:28.771 11:32:24 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@225 -- # ip netns exec nvmf_tgt_ns_spdk ping -c 1 10.0.0.2 00:21:28.771 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:21:28.771 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.074 ms 00:21:28.771 00:21:28.771 --- 10.0.0.2 ping statistics --- 00:21:28.771 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:21:28.771 rtt min/avg/max/mdev = 0.074/0.074/0.074/0.000 ms 00:21:28.771 11:32:24 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@227 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:21:28.771 11:32:24 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@459 -- # return 0 00:21:28.771 11:32:24 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@476 -- # '[' '' == iso ']' 00:21:28.771 11:32:24 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@480 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:21:28.771 11:32:24 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@481 -- # [[ tcp == \r\d\m\a ]] 00:21:28.771 11:32:24 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@490 -- # [[ tcp == \t\c\p ]] 00:21:28.771 11:32:24 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@491 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:21:28.771 11:32:24 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@494 -- # '[' tcp == tcp ']' 00:21:28.771 11:32:24 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@500 -- # modprobe nvme-tcp 00:21:28.771 11:32:24 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- target/wait_for_buf.sh@13 -- # nvmfappstart --wait-for-rpc 00:21:28.771 11:32:24 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@505 -- # timing_enter start_nvmf_tgt 00:21:28.771 11:32:24 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- common/autotest_common.sh@724 -- # xtrace_disable 00:21:28.771 11:32:24 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- common/autotest_common.sh@10 -- # set +x 00:21:28.771 11:32:24 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@507 -- # nvmfpid=86373 00:21:28.771 11:32:24 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@508 -- # waitforlisten 86373 00:21:28.771 11:32:24 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@506 -- # ip netns exec nvmf_tgt_ns_spdk /home/vagrant/spdk_repo/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF --wait-for-rpc 00:21:28.771 11:32:24 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- common/autotest_common.sh@831 -- # '[' -z 86373 ']' 00:21:28.771 11:32:24 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- common/autotest_common.sh@835 -- # local rpc_addr=/var/tmp/spdk.sock 00:21:28.771 11:32:24 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- common/autotest_common.sh@836 -- # local max_retries=100 00:21:28.771 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:21:28.771 11:32:24 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- common/autotest_common.sh@838 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:21:28.771 11:32:24 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- common/autotest_common.sh@840 -- # xtrace_disable 00:21:28.771 11:32:24 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- common/autotest_common.sh@10 -- # set +x 00:21:28.771 [2024-10-07 11:32:24.278588] Starting SPDK v25.01-pre git sha1 2a4f56c54 / DPDK 24.03.0 initialization... 00:21:28.771 [2024-10-07 11:32:24.279325] [ DPDK EAL parameters: nvmf -c 0x1 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --iova-mode=pa --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:21:29.029 [2024-10-07 11:32:24.419932] app.c: 917:spdk_app_start: *NOTICE*: Total cores available: 1 00:21:29.287 [2024-10-07 11:32:24.586012] app.c: 610:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:21:29.287 [2024-10-07 11:32:24.586122] app.c: 611:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:21:29.287 [2024-10-07 11:32:24.586143] app.c: 616:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:21:29.287 [2024-10-07 11:32:24.586154] app.c: 617:app_setup_trace: *NOTICE*: SPDK application currently running. 00:21:29.287 [2024-10-07 11:32:24.586164] app.c: 618:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:21:29.287 [2024-10-07 11:32:24.586787] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 0 00:21:29.864 11:32:25 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- common/autotest_common.sh@860 -- # (( i == 0 )) 00:21:29.864 11:32:25 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- common/autotest_common.sh@864 -- # return 0 00:21:29.864 11:32:25 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@509 -- # timing_exit start_nvmf_tgt 00:21:29.864 11:32:25 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- common/autotest_common.sh@730 -- # xtrace_disable 00:21:29.864 11:32:25 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- common/autotest_common.sh@10 -- # set +x 00:21:29.864 11:32:25 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@510 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:21:29.864 11:32:25 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- target/wait_for_buf.sh@15 -- # subnqn=nqn.2024-07.io.spdk:cnode0 00:21:29.864 11:32:25 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- target/wait_for_buf.sh@16 -- # perf=/home/vagrant/spdk_repo/spdk/build/bin/spdk_nvme_perf 00:21:29.864 11:32:25 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- target/wait_for_buf.sh@19 -- # rpc_cmd accel_set_options --small-cache-size 0 --large-cache-size 0 00:21:29.864 11:32:25 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- common/autotest_common.sh@561 -- # xtrace_disable 00:21:29.864 11:32:25 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- common/autotest_common.sh@10 -- # set +x 00:21:29.864 11:32:25 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:21:29.864 11:32:25 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- target/wait_for_buf.sh@20 -- # rpc_cmd iobuf_set_options --small-pool-count 154 --small_bufsize=8192 00:21:29.864 11:32:25 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- common/autotest_common.sh@561 -- # xtrace_disable 00:21:29.864 11:32:25 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- common/autotest_common.sh@10 -- # set +x 00:21:29.864 11:32:25 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:21:29.864 11:32:25 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- target/wait_for_buf.sh@21 -- # rpc_cmd framework_start_init 00:21:29.864 11:32:25 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- common/autotest_common.sh@561 -- # xtrace_disable 00:21:29.864 11:32:25 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- common/autotest_common.sh@10 -- # set +x 00:21:30.121 11:32:25 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:21:30.121 11:32:25 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- target/wait_for_buf.sh@22 -- # rpc_cmd bdev_malloc_create -b Malloc0 32 512 00:21:30.121 11:32:25 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- common/autotest_common.sh@561 -- # xtrace_disable 00:21:30.121 11:32:25 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- common/autotest_common.sh@10 -- # set +x 00:21:30.121 Malloc0 00:21:30.122 11:32:25 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:21:30.122 11:32:25 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- target/wait_for_buf.sh@23 -- # rpc_cmd nvmf_create_transport '-t tcp -o' -u 8192 -n 24 -b 24 00:21:30.122 11:32:25 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- common/autotest_common.sh@561 -- # xtrace_disable 00:21:30.122 11:32:25 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- common/autotest_common.sh@10 -- # set +x 00:21:30.122 [2024-10-07 11:32:25.494196] tcp.c: 738:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:21:30.122 11:32:25 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:21:30.122 11:32:25 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- target/wait_for_buf.sh@24 -- # rpc_cmd nvmf_create_subsystem nqn.2024-07.io.spdk:cnode0 -a -s SPDK00000000000001 00:21:30.122 11:32:25 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- common/autotest_common.sh@561 -- # xtrace_disable 00:21:30.122 11:32:25 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- common/autotest_common.sh@10 -- # set +x 00:21:30.122 11:32:25 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:21:30.122 11:32:25 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- target/wait_for_buf.sh@25 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2024-07.io.spdk:cnode0 Malloc0 00:21:30.122 11:32:25 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- common/autotest_common.sh@561 -- # xtrace_disable 00:21:30.122 11:32:25 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- common/autotest_common.sh@10 -- # set +x 00:21:30.122 11:32:25 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:21:30.122 11:32:25 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- target/wait_for_buf.sh@26 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2024-07.io.spdk:cnode0 -t tcp -a 10.0.0.3 -s 4420 00:21:30.122 11:32:25 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- common/autotest_common.sh@561 -- # xtrace_disable 00:21:30.122 11:32:25 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- common/autotest_common.sh@10 -- # set +x 00:21:30.122 [2024-10-07 11:32:25.518279] tcp.c:1081:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.3 port 4420 *** 00:21:30.122 11:32:25 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:21:30.122 11:32:25 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- target/wait_for_buf.sh@30 -- # /home/vagrant/spdk_repo/spdk/build/bin/spdk_nvme_perf -q 4 -o 131072 -w randread -t 1 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.3 trsvcid:4420' 00:21:30.379 [2024-10-07 11:32:25.695796] subsystem.c:1641:spdk_nvmf_subsystem_listener_allowed: *WARNING*: Allowing connection to discovery subsystem on TCP/10.0.0.3/4420, even though this listener was not added to the discovery subsystem. This behavior is deprecated and will be removed in a future release. 00:21:31.760 Initializing NVMe Controllers 00:21:31.760 Attached to NVMe over Fabrics controller at 10.0.0.3:4420: nqn.2024-07.io.spdk:cnode0 00:21:31.760 Associating TCP (addr:10.0.0.3 subnqn:nqn.2024-07.io.spdk:cnode0) NSID 1 with lcore 0 00:21:31.760 Initialization complete. Launching workers. 00:21:31.760 ======================================================== 00:21:31.761 Latency(us) 00:21:31.761 Device Information : IOPS MiB/s Average min max 00:21:31.761 TCP (addr:10.0.0.3 subnqn:nqn.2024-07.io.spdk:cnode0) NSID 1 from core 0: 130.00 16.25 32173.23 7957.09 70593.53 00:21:31.761 ======================================================== 00:21:31.761 Total : 130.00 16.25 32173.23 7957.09 70593.53 00:21:31.761 00:21:31.761 11:32:27 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- target/wait_for_buf.sh@32 -- # rpc_cmd iobuf_get_stats 00:21:31.761 11:32:27 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- target/wait_for_buf.sh@32 -- # jq -r '.[] | select(.module == "nvmf_TCP") | .small_pool.retry' 00:21:31.761 11:32:27 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- common/autotest_common.sh@561 -- # xtrace_disable 00:21:31.761 11:32:27 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- common/autotest_common.sh@10 -- # set +x 00:21:31.761 11:32:27 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:21:31.761 11:32:27 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- target/wait_for_buf.sh@32 -- # retry_count=2054 00:21:31.761 11:32:27 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- target/wait_for_buf.sh@33 -- # [[ 2054 -eq 0 ]] 00:21:31.761 11:32:27 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- target/wait_for_buf.sh@37 -- # trap - SIGINT SIGTERM EXIT 00:21:31.761 11:32:27 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- target/wait_for_buf.sh@38 -- # nvmftestfini 00:21:31.761 11:32:27 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@514 -- # nvmfcleanup 00:21:31.761 11:32:27 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@121 -- # sync 00:21:31.761 11:32:27 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@123 -- # '[' tcp == tcp ']' 00:21:31.761 11:32:27 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@124 -- # set +e 00:21:31.761 11:32:27 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@125 -- # for i in {1..20} 00:21:31.761 11:32:27 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@126 -- # modprobe -v -r nvme-tcp 00:21:31.761 rmmod nvme_tcp 00:21:31.761 rmmod nvme_fabrics 00:21:31.761 rmmod nvme_keyring 00:21:31.761 11:32:27 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@127 -- # modprobe -v -r nvme-fabrics 00:21:31.761 11:32:27 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@128 -- # set -e 00:21:31.761 11:32:27 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@129 -- # return 0 00:21:31.761 11:32:27 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@515 -- # '[' -n 86373 ']' 00:21:31.761 11:32:27 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@516 -- # killprocess 86373 00:21:31.761 11:32:27 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- common/autotest_common.sh@950 -- # '[' -z 86373 ']' 00:21:31.761 11:32:27 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- common/autotest_common.sh@954 -- # kill -0 86373 00:21:31.761 11:32:27 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- common/autotest_common.sh@955 -- # uname 00:21:31.761 11:32:27 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- common/autotest_common.sh@955 -- # '[' Linux = Linux ']' 00:21:31.761 11:32:27 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- common/autotest_common.sh@956 -- # ps --no-headers -o comm= 86373 00:21:31.761 killing process with pid 86373 00:21:31.761 11:32:27 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- common/autotest_common.sh@956 -- # process_name=reactor_0 00:21:31.761 11:32:27 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- common/autotest_common.sh@960 -- # '[' reactor_0 = sudo ']' 00:21:31.761 11:32:27 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- common/autotest_common.sh@968 -- # echo 'killing process with pid 86373' 00:21:31.761 11:32:27 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- common/autotest_common.sh@969 -- # kill 86373 00:21:31.761 11:32:27 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- common/autotest_common.sh@974 -- # wait 86373 00:21:32.020 11:32:27 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@518 -- # '[' '' == iso ']' 00:21:32.020 11:32:27 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@521 -- # [[ tcp == \t\c\p ]] 00:21:32.020 11:32:27 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@522 -- # nvmf_tcp_fini 00:21:32.020 11:32:27 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@297 -- # iptr 00:21:32.020 11:32:27 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@789 -- # iptables-save 00:21:32.020 11:32:27 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@789 -- # grep -v SPDK_NVMF 00:21:32.020 11:32:27 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@789 -- # iptables-restore 00:21:32.020 11:32:27 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@298 -- # [[ nvmf_tgt_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s\_\s\p\d\k ]] 00:21:32.020 11:32:27 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@299 -- # nvmf_veth_fini 00:21:32.020 11:32:27 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@233 -- # ip link set nvmf_init_br nomaster 00:21:32.020 11:32:27 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@234 -- # ip link set nvmf_init_br2 nomaster 00:21:32.020 11:32:27 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@235 -- # ip link set nvmf_tgt_br nomaster 00:21:32.020 11:32:27 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@236 -- # ip link set nvmf_tgt_br2 nomaster 00:21:32.020 11:32:27 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@237 -- # ip link set nvmf_init_br down 00:21:32.278 11:32:27 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@238 -- # ip link set nvmf_init_br2 down 00:21:32.278 11:32:27 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@239 -- # ip link set nvmf_tgt_br down 00:21:32.278 11:32:27 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@240 -- # ip link set nvmf_tgt_br2 down 00:21:32.278 11:32:27 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@241 -- # ip link delete nvmf_br type bridge 00:21:32.278 11:32:27 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@242 -- # ip link delete nvmf_init_if 00:21:32.278 11:32:27 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@243 -- # ip link delete nvmf_init_if2 00:21:32.278 11:32:27 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@244 -- # ip netns exec nvmf_tgt_ns_spdk ip link delete nvmf_tgt_if 00:21:32.278 11:32:27 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@245 -- # ip netns exec nvmf_tgt_ns_spdk ip link delete nvmf_tgt_if2 00:21:32.278 11:32:27 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@246 -- # remove_spdk_ns 00:21:32.278 11:32:27 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@654 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:21:32.278 11:32:27 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 15> /dev/null' 00:21:32.278 11:32:27 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:21:32.278 11:32:27 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@300 -- # return 0 00:21:32.278 00:21:32.278 real 0m4.186s 00:21:32.278 user 0m3.720s 00:21:32.278 sys 0m0.848s 00:21:32.278 11:32:27 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- common/autotest_common.sh@1126 -- # xtrace_disable 00:21:32.278 11:32:27 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- common/autotest_common.sh@10 -- # set +x 00:21:32.278 ************************************ 00:21:32.278 END TEST nvmf_wait_for_buf 00:21:32.278 ************************************ 00:21:32.278 11:32:27 nvmf_tcp.nvmf_target_extra -- nvmf/nvmf_target_extra.sh@47 -- # '[' 0 -eq 1 ']' 00:21:32.278 11:32:27 nvmf_tcp.nvmf_target_extra -- nvmf/nvmf_target_extra.sh@53 -- # [[ virt == phy ]] 00:21:32.278 11:32:27 nvmf_tcp.nvmf_target_extra -- nvmf/nvmf_target_extra.sh@68 -- # trap - SIGINT SIGTERM EXIT 00:21:32.278 ************************************ 00:21:32.278 END TEST nvmf_target_extra 00:21:32.278 ************************************ 00:21:32.278 00:21:32.278 real 7m40.706s 00:21:32.278 user 18m31.529s 00:21:32.278 sys 1m31.187s 00:21:32.278 11:32:27 nvmf_tcp.nvmf_target_extra -- common/autotest_common.sh@1126 -- # xtrace_disable 00:21:32.278 11:32:27 nvmf_tcp.nvmf_target_extra -- common/autotest_common.sh@10 -- # set +x 00:21:32.537 11:32:27 nvmf_tcp -- nvmf/nvmf.sh@16 -- # run_test nvmf_host /home/vagrant/spdk_repo/spdk/test/nvmf/nvmf_host.sh --transport=tcp 00:21:32.537 11:32:27 nvmf_tcp -- common/autotest_common.sh@1101 -- # '[' 3 -le 1 ']' 00:21:32.537 11:32:27 nvmf_tcp -- common/autotest_common.sh@1107 -- # xtrace_disable 00:21:32.537 11:32:27 nvmf_tcp -- common/autotest_common.sh@10 -- # set +x 00:21:32.537 ************************************ 00:21:32.537 START TEST nvmf_host 00:21:32.537 ************************************ 00:21:32.537 11:32:27 nvmf_tcp.nvmf_host -- common/autotest_common.sh@1125 -- # /home/vagrant/spdk_repo/spdk/test/nvmf/nvmf_host.sh --transport=tcp 00:21:32.537 * Looking for test storage... 00:21:32.537 * Found test storage at /home/vagrant/spdk_repo/spdk/test/nvmf 00:21:32.537 11:32:27 nvmf_tcp.nvmf_host -- common/autotest_common.sh@1680 -- # [[ y == y ]] 00:21:32.537 11:32:27 nvmf_tcp.nvmf_host -- common/autotest_common.sh@1681 -- # lcov --version 00:21:32.537 11:32:27 nvmf_tcp.nvmf_host -- common/autotest_common.sh@1681 -- # awk '{print $NF}' 00:21:32.537 11:32:27 nvmf_tcp.nvmf_host -- common/autotest_common.sh@1681 -- # lt 1.15 2 00:21:32.537 11:32:27 nvmf_tcp.nvmf_host -- scripts/common.sh@373 -- # cmp_versions 1.15 '<' 2 00:21:32.537 11:32:27 nvmf_tcp.nvmf_host -- scripts/common.sh@333 -- # local ver1 ver1_l 00:21:32.537 11:32:27 nvmf_tcp.nvmf_host -- scripts/common.sh@334 -- # local ver2 ver2_l 00:21:32.537 11:32:27 nvmf_tcp.nvmf_host -- scripts/common.sh@336 -- # IFS=.-: 00:21:32.537 11:32:27 nvmf_tcp.nvmf_host -- scripts/common.sh@336 -- # read -ra ver1 00:21:32.537 11:32:27 nvmf_tcp.nvmf_host -- scripts/common.sh@337 -- # IFS=.-: 00:21:32.537 11:32:27 nvmf_tcp.nvmf_host -- scripts/common.sh@337 -- # read -ra ver2 00:21:32.537 11:32:27 nvmf_tcp.nvmf_host -- scripts/common.sh@338 -- # local 'op=<' 00:21:32.537 11:32:27 nvmf_tcp.nvmf_host -- scripts/common.sh@340 -- # ver1_l=2 00:21:32.537 11:32:27 nvmf_tcp.nvmf_host -- scripts/common.sh@341 -- # ver2_l=1 00:21:32.537 11:32:27 nvmf_tcp.nvmf_host -- scripts/common.sh@343 -- # local lt=0 gt=0 eq=0 v 00:21:32.537 11:32:27 nvmf_tcp.nvmf_host -- scripts/common.sh@344 -- # case "$op" in 00:21:32.537 11:32:27 nvmf_tcp.nvmf_host -- scripts/common.sh@345 -- # : 1 00:21:32.537 11:32:27 nvmf_tcp.nvmf_host -- scripts/common.sh@364 -- # (( v = 0 )) 00:21:32.537 11:32:27 nvmf_tcp.nvmf_host -- scripts/common.sh@364 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:21:32.537 11:32:27 nvmf_tcp.nvmf_host -- scripts/common.sh@365 -- # decimal 1 00:21:32.537 11:32:27 nvmf_tcp.nvmf_host -- scripts/common.sh@353 -- # local d=1 00:21:32.537 11:32:27 nvmf_tcp.nvmf_host -- scripts/common.sh@354 -- # [[ 1 =~ ^[0-9]+$ ]] 00:21:32.537 11:32:27 nvmf_tcp.nvmf_host -- scripts/common.sh@355 -- # echo 1 00:21:32.537 11:32:27 nvmf_tcp.nvmf_host -- scripts/common.sh@365 -- # ver1[v]=1 00:21:32.537 11:32:27 nvmf_tcp.nvmf_host -- scripts/common.sh@366 -- # decimal 2 00:21:32.537 11:32:27 nvmf_tcp.nvmf_host -- scripts/common.sh@353 -- # local d=2 00:21:32.537 11:32:27 nvmf_tcp.nvmf_host -- scripts/common.sh@354 -- # [[ 2 =~ ^[0-9]+$ ]] 00:21:32.537 11:32:27 nvmf_tcp.nvmf_host -- scripts/common.sh@355 -- # echo 2 00:21:32.537 11:32:27 nvmf_tcp.nvmf_host -- scripts/common.sh@366 -- # ver2[v]=2 00:21:32.537 11:32:27 nvmf_tcp.nvmf_host -- scripts/common.sh@367 -- # (( ver1[v] > ver2[v] )) 00:21:32.537 11:32:27 nvmf_tcp.nvmf_host -- scripts/common.sh@368 -- # (( ver1[v] < ver2[v] )) 00:21:32.537 11:32:27 nvmf_tcp.nvmf_host -- scripts/common.sh@368 -- # return 0 00:21:32.537 11:32:27 nvmf_tcp.nvmf_host -- common/autotest_common.sh@1682 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:21:32.537 11:32:27 nvmf_tcp.nvmf_host -- common/autotest_common.sh@1694 -- # export 'LCOV_OPTS= 00:21:32.537 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:21:32.537 --rc genhtml_branch_coverage=1 00:21:32.537 --rc genhtml_function_coverage=1 00:21:32.537 --rc genhtml_legend=1 00:21:32.537 --rc geninfo_all_blocks=1 00:21:32.537 --rc geninfo_unexecuted_blocks=1 00:21:32.537 00:21:32.537 ' 00:21:32.537 11:32:27 nvmf_tcp.nvmf_host -- common/autotest_common.sh@1694 -- # LCOV_OPTS=' 00:21:32.538 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:21:32.538 --rc genhtml_branch_coverage=1 00:21:32.538 --rc genhtml_function_coverage=1 00:21:32.538 --rc genhtml_legend=1 00:21:32.538 --rc geninfo_all_blocks=1 00:21:32.538 --rc geninfo_unexecuted_blocks=1 00:21:32.538 00:21:32.538 ' 00:21:32.538 11:32:27 nvmf_tcp.nvmf_host -- common/autotest_common.sh@1695 -- # export 'LCOV=lcov 00:21:32.538 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:21:32.538 --rc genhtml_branch_coverage=1 00:21:32.538 --rc genhtml_function_coverage=1 00:21:32.538 --rc genhtml_legend=1 00:21:32.538 --rc geninfo_all_blocks=1 00:21:32.538 --rc geninfo_unexecuted_blocks=1 00:21:32.538 00:21:32.538 ' 00:21:32.538 11:32:27 nvmf_tcp.nvmf_host -- common/autotest_common.sh@1695 -- # LCOV='lcov 00:21:32.538 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:21:32.538 --rc genhtml_branch_coverage=1 00:21:32.538 --rc genhtml_function_coverage=1 00:21:32.538 --rc genhtml_legend=1 00:21:32.538 --rc geninfo_all_blocks=1 00:21:32.538 --rc geninfo_unexecuted_blocks=1 00:21:32.538 00:21:32.538 ' 00:21:32.538 11:32:27 nvmf_tcp.nvmf_host -- nvmf/nvmf_host.sh@9 -- # source /home/vagrant/spdk_repo/spdk/test/nvmf/common.sh 00:21:32.538 11:32:27 nvmf_tcp.nvmf_host -- nvmf/common.sh@7 -- # uname -s 00:21:32.538 11:32:27 nvmf_tcp.nvmf_host -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:21:32.538 11:32:27 nvmf_tcp.nvmf_host -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:21:32.538 11:32:27 nvmf_tcp.nvmf_host -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:21:32.538 11:32:27 nvmf_tcp.nvmf_host -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:21:32.538 11:32:27 nvmf_tcp.nvmf_host -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:21:32.538 11:32:27 nvmf_tcp.nvmf_host -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:21:32.538 11:32:27 nvmf_tcp.nvmf_host -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:21:32.538 11:32:27 nvmf_tcp.nvmf_host -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:21:32.538 11:32:27 nvmf_tcp.nvmf_host -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:21:32.538 11:32:27 nvmf_tcp.nvmf_host -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:21:32.538 11:32:28 nvmf_tcp.nvmf_host -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:c758a4ed-f09f-4c82-9afb-3d096f035464 00:21:32.538 11:32:28 nvmf_tcp.nvmf_host -- nvmf/common.sh@18 -- # NVME_HOSTID=c758a4ed-f09f-4c82-9afb-3d096f035464 00:21:32.538 11:32:28 nvmf_tcp.nvmf_host -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:21:32.538 11:32:28 nvmf_tcp.nvmf_host -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:21:32.538 11:32:28 nvmf_tcp.nvmf_host -- nvmf/common.sh@21 -- # NET_TYPE=virt 00:21:32.538 11:32:28 nvmf_tcp.nvmf_host -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:21:32.538 11:32:28 nvmf_tcp.nvmf_host -- nvmf/common.sh@49 -- # source /home/vagrant/spdk_repo/spdk/scripts/common.sh 00:21:32.538 11:32:28 nvmf_tcp.nvmf_host -- scripts/common.sh@15 -- # shopt -s extglob 00:21:32.538 11:32:28 nvmf_tcp.nvmf_host -- scripts/common.sh@544 -- # [[ -e /bin/wpdk_common.sh ]] 00:21:32.538 11:32:28 nvmf_tcp.nvmf_host -- scripts/common.sh@552 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:21:32.538 11:32:28 nvmf_tcp.nvmf_host -- scripts/common.sh@553 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:21:32.538 11:32:28 nvmf_tcp.nvmf_host -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:21:32.538 11:32:28 nvmf_tcp.nvmf_host -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:21:32.538 11:32:28 nvmf_tcp.nvmf_host -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:21:32.538 11:32:28 nvmf_tcp.nvmf_host -- paths/export.sh@5 -- # export PATH 00:21:32.538 11:32:28 nvmf_tcp.nvmf_host -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:21:32.538 11:32:28 nvmf_tcp.nvmf_host -- nvmf/common.sh@51 -- # : 0 00:21:32.538 11:32:28 nvmf_tcp.nvmf_host -- nvmf/common.sh@52 -- # export NVMF_APP_SHM_ID 00:21:32.538 11:32:28 nvmf_tcp.nvmf_host -- nvmf/common.sh@53 -- # build_nvmf_app_args 00:21:32.538 11:32:28 nvmf_tcp.nvmf_host -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:21:32.538 11:32:28 nvmf_tcp.nvmf_host -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:21:32.538 11:32:28 nvmf_tcp.nvmf_host -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:21:32.538 11:32:28 nvmf_tcp.nvmf_host -- nvmf/common.sh@33 -- # '[' '' -eq 1 ']' 00:21:32.538 /home/vagrant/spdk_repo/spdk/test/nvmf/common.sh: line 33: [: : integer expression expected 00:21:32.538 11:32:28 nvmf_tcp.nvmf_host -- nvmf/common.sh@37 -- # '[' -n '' ']' 00:21:32.538 11:32:28 nvmf_tcp.nvmf_host -- nvmf/common.sh@39 -- # '[' 0 -eq 1 ']' 00:21:32.538 11:32:28 nvmf_tcp.nvmf_host -- nvmf/common.sh@55 -- # have_pci_nics=0 00:21:32.538 11:32:28 nvmf_tcp.nvmf_host -- nvmf/nvmf_host.sh@11 -- # trap 'exit 1' SIGINT SIGTERM EXIT 00:21:32.538 11:32:28 nvmf_tcp.nvmf_host -- nvmf/nvmf_host.sh@13 -- # TEST_ARGS=("$@") 00:21:32.538 11:32:28 nvmf_tcp.nvmf_host -- nvmf/nvmf_host.sh@15 -- # [[ 0 -eq 0 ]] 00:21:32.538 11:32:28 nvmf_tcp.nvmf_host -- nvmf/nvmf_host.sh@16 -- # run_test nvmf_multicontroller /home/vagrant/spdk_repo/spdk/test/nvmf/host/multicontroller.sh --transport=tcp 00:21:32.538 11:32:28 nvmf_tcp.nvmf_host -- common/autotest_common.sh@1101 -- # '[' 3 -le 1 ']' 00:21:32.538 11:32:28 nvmf_tcp.nvmf_host -- common/autotest_common.sh@1107 -- # xtrace_disable 00:21:32.538 11:32:28 nvmf_tcp.nvmf_host -- common/autotest_common.sh@10 -- # set +x 00:21:32.538 ************************************ 00:21:32.538 START TEST nvmf_multicontroller 00:21:32.538 ************************************ 00:21:32.538 11:32:28 nvmf_tcp.nvmf_host.nvmf_multicontroller -- common/autotest_common.sh@1125 -- # /home/vagrant/spdk_repo/spdk/test/nvmf/host/multicontroller.sh --transport=tcp 00:21:32.797 * Looking for test storage... 00:21:32.797 * Found test storage at /home/vagrant/spdk_repo/spdk/test/nvmf/host 00:21:32.798 11:32:28 nvmf_tcp.nvmf_host.nvmf_multicontroller -- common/autotest_common.sh@1680 -- # [[ y == y ]] 00:21:32.798 11:32:28 nvmf_tcp.nvmf_host.nvmf_multicontroller -- common/autotest_common.sh@1681 -- # lcov --version 00:21:32.798 11:32:28 nvmf_tcp.nvmf_host.nvmf_multicontroller -- common/autotest_common.sh@1681 -- # awk '{print $NF}' 00:21:32.798 11:32:28 nvmf_tcp.nvmf_host.nvmf_multicontroller -- common/autotest_common.sh@1681 -- # lt 1.15 2 00:21:32.798 11:32:28 nvmf_tcp.nvmf_host.nvmf_multicontroller -- scripts/common.sh@373 -- # cmp_versions 1.15 '<' 2 00:21:32.798 11:32:28 nvmf_tcp.nvmf_host.nvmf_multicontroller -- scripts/common.sh@333 -- # local ver1 ver1_l 00:21:32.798 11:32:28 nvmf_tcp.nvmf_host.nvmf_multicontroller -- scripts/common.sh@334 -- # local ver2 ver2_l 00:21:32.798 11:32:28 nvmf_tcp.nvmf_host.nvmf_multicontroller -- scripts/common.sh@336 -- # IFS=.-: 00:21:32.798 11:32:28 nvmf_tcp.nvmf_host.nvmf_multicontroller -- scripts/common.sh@336 -- # read -ra ver1 00:21:32.798 11:32:28 nvmf_tcp.nvmf_host.nvmf_multicontroller -- scripts/common.sh@337 -- # IFS=.-: 00:21:32.798 11:32:28 nvmf_tcp.nvmf_host.nvmf_multicontroller -- scripts/common.sh@337 -- # read -ra ver2 00:21:32.798 11:32:28 nvmf_tcp.nvmf_host.nvmf_multicontroller -- scripts/common.sh@338 -- # local 'op=<' 00:21:32.798 11:32:28 nvmf_tcp.nvmf_host.nvmf_multicontroller -- scripts/common.sh@340 -- # ver1_l=2 00:21:32.798 11:32:28 nvmf_tcp.nvmf_host.nvmf_multicontroller -- scripts/common.sh@341 -- # ver2_l=1 00:21:32.798 11:32:28 nvmf_tcp.nvmf_host.nvmf_multicontroller -- scripts/common.sh@343 -- # local lt=0 gt=0 eq=0 v 00:21:32.798 11:32:28 nvmf_tcp.nvmf_host.nvmf_multicontroller -- scripts/common.sh@344 -- # case "$op" in 00:21:32.798 11:32:28 nvmf_tcp.nvmf_host.nvmf_multicontroller -- scripts/common.sh@345 -- # : 1 00:21:32.798 11:32:28 nvmf_tcp.nvmf_host.nvmf_multicontroller -- scripts/common.sh@364 -- # (( v = 0 )) 00:21:32.798 11:32:28 nvmf_tcp.nvmf_host.nvmf_multicontroller -- scripts/common.sh@364 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:21:32.798 11:32:28 nvmf_tcp.nvmf_host.nvmf_multicontroller -- scripts/common.sh@365 -- # decimal 1 00:21:32.798 11:32:28 nvmf_tcp.nvmf_host.nvmf_multicontroller -- scripts/common.sh@353 -- # local d=1 00:21:32.798 11:32:28 nvmf_tcp.nvmf_host.nvmf_multicontroller -- scripts/common.sh@354 -- # [[ 1 =~ ^[0-9]+$ ]] 00:21:32.798 11:32:28 nvmf_tcp.nvmf_host.nvmf_multicontroller -- scripts/common.sh@355 -- # echo 1 00:21:32.798 11:32:28 nvmf_tcp.nvmf_host.nvmf_multicontroller -- scripts/common.sh@365 -- # ver1[v]=1 00:21:32.798 11:32:28 nvmf_tcp.nvmf_host.nvmf_multicontroller -- scripts/common.sh@366 -- # decimal 2 00:21:32.798 11:32:28 nvmf_tcp.nvmf_host.nvmf_multicontroller -- scripts/common.sh@353 -- # local d=2 00:21:32.798 11:32:28 nvmf_tcp.nvmf_host.nvmf_multicontroller -- scripts/common.sh@354 -- # [[ 2 =~ ^[0-9]+$ ]] 00:21:32.798 11:32:28 nvmf_tcp.nvmf_host.nvmf_multicontroller -- scripts/common.sh@355 -- # echo 2 00:21:32.798 11:32:28 nvmf_tcp.nvmf_host.nvmf_multicontroller -- scripts/common.sh@366 -- # ver2[v]=2 00:21:32.798 11:32:28 nvmf_tcp.nvmf_host.nvmf_multicontroller -- scripts/common.sh@367 -- # (( ver1[v] > ver2[v] )) 00:21:32.798 11:32:28 nvmf_tcp.nvmf_host.nvmf_multicontroller -- scripts/common.sh@368 -- # (( ver1[v] < ver2[v] )) 00:21:32.798 11:32:28 nvmf_tcp.nvmf_host.nvmf_multicontroller -- scripts/common.sh@368 -- # return 0 00:21:32.798 11:32:28 nvmf_tcp.nvmf_host.nvmf_multicontroller -- common/autotest_common.sh@1682 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:21:32.798 11:32:28 nvmf_tcp.nvmf_host.nvmf_multicontroller -- common/autotest_common.sh@1694 -- # export 'LCOV_OPTS= 00:21:32.798 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:21:32.798 --rc genhtml_branch_coverage=1 00:21:32.798 --rc genhtml_function_coverage=1 00:21:32.798 --rc genhtml_legend=1 00:21:32.798 --rc geninfo_all_blocks=1 00:21:32.798 --rc geninfo_unexecuted_blocks=1 00:21:32.798 00:21:32.798 ' 00:21:32.798 11:32:28 nvmf_tcp.nvmf_host.nvmf_multicontroller -- common/autotest_common.sh@1694 -- # LCOV_OPTS=' 00:21:32.798 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:21:32.798 --rc genhtml_branch_coverage=1 00:21:32.798 --rc genhtml_function_coverage=1 00:21:32.798 --rc genhtml_legend=1 00:21:32.798 --rc geninfo_all_blocks=1 00:21:32.798 --rc geninfo_unexecuted_blocks=1 00:21:32.798 00:21:32.798 ' 00:21:32.798 11:32:28 nvmf_tcp.nvmf_host.nvmf_multicontroller -- common/autotest_common.sh@1695 -- # export 'LCOV=lcov 00:21:32.798 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:21:32.798 --rc genhtml_branch_coverage=1 00:21:32.798 --rc genhtml_function_coverage=1 00:21:32.798 --rc genhtml_legend=1 00:21:32.798 --rc geninfo_all_blocks=1 00:21:32.798 --rc geninfo_unexecuted_blocks=1 00:21:32.798 00:21:32.798 ' 00:21:32.798 11:32:28 nvmf_tcp.nvmf_host.nvmf_multicontroller -- common/autotest_common.sh@1695 -- # LCOV='lcov 00:21:32.798 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:21:32.798 --rc genhtml_branch_coverage=1 00:21:32.798 --rc genhtml_function_coverage=1 00:21:32.798 --rc genhtml_legend=1 00:21:32.798 --rc geninfo_all_blocks=1 00:21:32.798 --rc geninfo_unexecuted_blocks=1 00:21:32.798 00:21:32.798 ' 00:21:32.798 11:32:28 nvmf_tcp.nvmf_host.nvmf_multicontroller -- host/multicontroller.sh@9 -- # source /home/vagrant/spdk_repo/spdk/test/nvmf/common.sh 00:21:32.798 11:32:28 nvmf_tcp.nvmf_host.nvmf_multicontroller -- nvmf/common.sh@7 -- # uname -s 00:21:32.798 11:32:28 nvmf_tcp.nvmf_host.nvmf_multicontroller -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:21:32.798 11:32:28 nvmf_tcp.nvmf_host.nvmf_multicontroller -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:21:32.798 11:32:28 nvmf_tcp.nvmf_host.nvmf_multicontroller -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:21:32.798 11:32:28 nvmf_tcp.nvmf_host.nvmf_multicontroller -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:21:32.798 11:32:28 nvmf_tcp.nvmf_host.nvmf_multicontroller -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:21:32.798 11:32:28 nvmf_tcp.nvmf_host.nvmf_multicontroller -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:21:32.798 11:32:28 nvmf_tcp.nvmf_host.nvmf_multicontroller -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:21:32.798 11:32:28 nvmf_tcp.nvmf_host.nvmf_multicontroller -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:21:32.798 11:32:28 nvmf_tcp.nvmf_host.nvmf_multicontroller -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:21:32.798 11:32:28 nvmf_tcp.nvmf_host.nvmf_multicontroller -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:21:32.798 11:32:28 nvmf_tcp.nvmf_host.nvmf_multicontroller -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:c758a4ed-f09f-4c82-9afb-3d096f035464 00:21:32.798 11:32:28 nvmf_tcp.nvmf_host.nvmf_multicontroller -- nvmf/common.sh@18 -- # NVME_HOSTID=c758a4ed-f09f-4c82-9afb-3d096f035464 00:21:32.798 11:32:28 nvmf_tcp.nvmf_host.nvmf_multicontroller -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:21:32.798 11:32:28 nvmf_tcp.nvmf_host.nvmf_multicontroller -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:21:32.798 11:32:28 nvmf_tcp.nvmf_host.nvmf_multicontroller -- nvmf/common.sh@21 -- # NET_TYPE=virt 00:21:32.798 11:32:28 nvmf_tcp.nvmf_host.nvmf_multicontroller -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:21:32.798 11:32:28 nvmf_tcp.nvmf_host.nvmf_multicontroller -- nvmf/common.sh@49 -- # source /home/vagrant/spdk_repo/spdk/scripts/common.sh 00:21:32.798 11:32:28 nvmf_tcp.nvmf_host.nvmf_multicontroller -- scripts/common.sh@15 -- # shopt -s extglob 00:21:32.798 11:32:28 nvmf_tcp.nvmf_host.nvmf_multicontroller -- scripts/common.sh@544 -- # [[ -e /bin/wpdk_common.sh ]] 00:21:32.798 11:32:28 nvmf_tcp.nvmf_host.nvmf_multicontroller -- scripts/common.sh@552 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:21:32.798 11:32:28 nvmf_tcp.nvmf_host.nvmf_multicontroller -- scripts/common.sh@553 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:21:32.798 11:32:28 nvmf_tcp.nvmf_host.nvmf_multicontroller -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:21:32.798 11:32:28 nvmf_tcp.nvmf_host.nvmf_multicontroller -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:21:32.798 11:32:28 nvmf_tcp.nvmf_host.nvmf_multicontroller -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:21:32.798 11:32:28 nvmf_tcp.nvmf_host.nvmf_multicontroller -- paths/export.sh@5 -- # export PATH 00:21:32.798 11:32:28 nvmf_tcp.nvmf_host.nvmf_multicontroller -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:21:32.798 11:32:28 nvmf_tcp.nvmf_host.nvmf_multicontroller -- nvmf/common.sh@51 -- # : 0 00:21:32.798 11:32:28 nvmf_tcp.nvmf_host.nvmf_multicontroller -- nvmf/common.sh@52 -- # export NVMF_APP_SHM_ID 00:21:32.798 11:32:28 nvmf_tcp.nvmf_host.nvmf_multicontroller -- nvmf/common.sh@53 -- # build_nvmf_app_args 00:21:32.798 11:32:28 nvmf_tcp.nvmf_host.nvmf_multicontroller -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:21:32.798 11:32:28 nvmf_tcp.nvmf_host.nvmf_multicontroller -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:21:32.798 11:32:28 nvmf_tcp.nvmf_host.nvmf_multicontroller -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:21:32.798 11:32:28 nvmf_tcp.nvmf_host.nvmf_multicontroller -- nvmf/common.sh@33 -- # '[' '' -eq 1 ']' 00:21:32.798 /home/vagrant/spdk_repo/spdk/test/nvmf/common.sh: line 33: [: : integer expression expected 00:21:32.798 11:32:28 nvmf_tcp.nvmf_host.nvmf_multicontroller -- nvmf/common.sh@37 -- # '[' -n '' ']' 00:21:32.798 11:32:28 nvmf_tcp.nvmf_host.nvmf_multicontroller -- nvmf/common.sh@39 -- # '[' 0 -eq 1 ']' 00:21:32.798 11:32:28 nvmf_tcp.nvmf_host.nvmf_multicontroller -- nvmf/common.sh@55 -- # have_pci_nics=0 00:21:32.798 11:32:28 nvmf_tcp.nvmf_host.nvmf_multicontroller -- host/multicontroller.sh@11 -- # MALLOC_BDEV_SIZE=64 00:21:32.798 11:32:28 nvmf_tcp.nvmf_host.nvmf_multicontroller -- host/multicontroller.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:21:32.798 11:32:28 nvmf_tcp.nvmf_host.nvmf_multicontroller -- host/multicontroller.sh@13 -- # NVMF_HOST_FIRST_PORT=60000 00:21:32.798 11:32:28 nvmf_tcp.nvmf_host.nvmf_multicontroller -- host/multicontroller.sh@14 -- # NVMF_HOST_SECOND_PORT=60001 00:21:32.798 11:32:28 nvmf_tcp.nvmf_host.nvmf_multicontroller -- host/multicontroller.sh@16 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:21:32.798 11:32:28 nvmf_tcp.nvmf_host.nvmf_multicontroller -- host/multicontroller.sh@18 -- # '[' tcp == rdma ']' 00:21:32.798 11:32:28 nvmf_tcp.nvmf_host.nvmf_multicontroller -- host/multicontroller.sh@23 -- # nvmftestinit 00:21:32.799 11:32:28 nvmf_tcp.nvmf_host.nvmf_multicontroller -- nvmf/common.sh@467 -- # '[' -z tcp ']' 00:21:32.799 11:32:28 nvmf_tcp.nvmf_host.nvmf_multicontroller -- nvmf/common.sh@472 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:21:32.799 11:32:28 nvmf_tcp.nvmf_host.nvmf_multicontroller -- nvmf/common.sh@474 -- # prepare_net_devs 00:21:32.799 11:32:28 nvmf_tcp.nvmf_host.nvmf_multicontroller -- nvmf/common.sh@436 -- # local -g is_hw=no 00:21:32.799 11:32:28 nvmf_tcp.nvmf_host.nvmf_multicontroller -- nvmf/common.sh@438 -- # remove_spdk_ns 00:21:32.799 11:32:28 nvmf_tcp.nvmf_host.nvmf_multicontroller -- nvmf/common.sh@654 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:21:32.799 11:32:28 nvmf_tcp.nvmf_host.nvmf_multicontroller -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 15> /dev/null' 00:21:32.799 11:32:28 nvmf_tcp.nvmf_host.nvmf_multicontroller -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:21:32.799 11:32:28 nvmf_tcp.nvmf_host.nvmf_multicontroller -- nvmf/common.sh@440 -- # [[ virt != virt ]] 00:21:32.799 11:32:28 nvmf_tcp.nvmf_host.nvmf_multicontroller -- nvmf/common.sh@442 -- # [[ no == yes ]] 00:21:32.799 11:32:28 nvmf_tcp.nvmf_host.nvmf_multicontroller -- nvmf/common.sh@449 -- # [[ virt == phy ]] 00:21:32.799 11:32:28 nvmf_tcp.nvmf_host.nvmf_multicontroller -- nvmf/common.sh@452 -- # [[ virt == phy-fallback ]] 00:21:32.799 11:32:28 nvmf_tcp.nvmf_host.nvmf_multicontroller -- nvmf/common.sh@457 -- # [[ tcp == tcp ]] 00:21:32.799 11:32:28 nvmf_tcp.nvmf_host.nvmf_multicontroller -- nvmf/common.sh@458 -- # nvmf_veth_init 00:21:32.799 11:32:28 nvmf_tcp.nvmf_host.nvmf_multicontroller -- nvmf/common.sh@145 -- # NVMF_FIRST_INITIATOR_IP=10.0.0.1 00:21:32.799 11:32:28 nvmf_tcp.nvmf_host.nvmf_multicontroller -- nvmf/common.sh@146 -- # NVMF_SECOND_INITIATOR_IP=10.0.0.2 00:21:32.799 11:32:28 nvmf_tcp.nvmf_host.nvmf_multicontroller -- nvmf/common.sh@147 -- # NVMF_FIRST_TARGET_IP=10.0.0.3 00:21:32.799 11:32:28 nvmf_tcp.nvmf_host.nvmf_multicontroller -- nvmf/common.sh@148 -- # NVMF_SECOND_TARGET_IP=10.0.0.4 00:21:32.799 11:32:28 nvmf_tcp.nvmf_host.nvmf_multicontroller -- nvmf/common.sh@149 -- # NVMF_INITIATOR_IP=10.0.0.1 00:21:32.799 11:32:28 nvmf_tcp.nvmf_host.nvmf_multicontroller -- nvmf/common.sh@150 -- # NVMF_BRIDGE=nvmf_br 00:21:32.799 11:32:28 nvmf_tcp.nvmf_host.nvmf_multicontroller -- nvmf/common.sh@151 -- # NVMF_INITIATOR_INTERFACE=nvmf_init_if 00:21:32.799 11:32:28 nvmf_tcp.nvmf_host.nvmf_multicontroller -- nvmf/common.sh@152 -- # NVMF_INITIATOR_INTERFACE2=nvmf_init_if2 00:21:32.799 11:32:28 nvmf_tcp.nvmf_host.nvmf_multicontroller -- nvmf/common.sh@153 -- # NVMF_INITIATOR_BRIDGE=nvmf_init_br 00:21:32.799 11:32:28 nvmf_tcp.nvmf_host.nvmf_multicontroller -- nvmf/common.sh@154 -- # NVMF_INITIATOR_BRIDGE2=nvmf_init_br2 00:21:32.799 11:32:28 nvmf_tcp.nvmf_host.nvmf_multicontroller -- nvmf/common.sh@155 -- # NVMF_TARGET_NAMESPACE=nvmf_tgt_ns_spdk 00:21:32.799 11:32:28 nvmf_tcp.nvmf_host.nvmf_multicontroller -- nvmf/common.sh@156 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:21:32.799 11:32:28 nvmf_tcp.nvmf_host.nvmf_multicontroller -- nvmf/common.sh@157 -- # NVMF_TARGET_INTERFACE=nvmf_tgt_if 00:21:32.799 11:32:28 nvmf_tcp.nvmf_host.nvmf_multicontroller -- nvmf/common.sh@158 -- # NVMF_TARGET_INTERFACE2=nvmf_tgt_if2 00:21:32.799 11:32:28 nvmf_tcp.nvmf_host.nvmf_multicontroller -- nvmf/common.sh@159 -- # NVMF_TARGET_BRIDGE=nvmf_tgt_br 00:21:32.799 11:32:28 nvmf_tcp.nvmf_host.nvmf_multicontroller -- nvmf/common.sh@160 -- # NVMF_TARGET_BRIDGE2=nvmf_tgt_br2 00:21:32.799 11:32:28 nvmf_tcp.nvmf_host.nvmf_multicontroller -- nvmf/common.sh@162 -- # ip link set nvmf_init_br nomaster 00:21:32.799 Cannot find device "nvmf_init_br" 00:21:32.799 11:32:28 nvmf_tcp.nvmf_host.nvmf_multicontroller -- nvmf/common.sh@162 -- # true 00:21:32.799 11:32:28 nvmf_tcp.nvmf_host.nvmf_multicontroller -- nvmf/common.sh@163 -- # ip link set nvmf_init_br2 nomaster 00:21:32.799 Cannot find device "nvmf_init_br2" 00:21:32.799 11:32:28 nvmf_tcp.nvmf_host.nvmf_multicontroller -- nvmf/common.sh@163 -- # true 00:21:32.799 11:32:28 nvmf_tcp.nvmf_host.nvmf_multicontroller -- nvmf/common.sh@164 -- # ip link set nvmf_tgt_br nomaster 00:21:32.799 Cannot find device "nvmf_tgt_br" 00:21:32.799 11:32:28 nvmf_tcp.nvmf_host.nvmf_multicontroller -- nvmf/common.sh@164 -- # true 00:21:32.799 11:32:28 nvmf_tcp.nvmf_host.nvmf_multicontroller -- nvmf/common.sh@165 -- # ip link set nvmf_tgt_br2 nomaster 00:21:32.799 Cannot find device "nvmf_tgt_br2" 00:21:33.056 11:32:28 nvmf_tcp.nvmf_host.nvmf_multicontroller -- nvmf/common.sh@165 -- # true 00:21:33.056 11:32:28 nvmf_tcp.nvmf_host.nvmf_multicontroller -- nvmf/common.sh@166 -- # ip link set nvmf_init_br down 00:21:33.056 Cannot find device "nvmf_init_br" 00:21:33.056 11:32:28 nvmf_tcp.nvmf_host.nvmf_multicontroller -- nvmf/common.sh@166 -- # true 00:21:33.056 11:32:28 nvmf_tcp.nvmf_host.nvmf_multicontroller -- nvmf/common.sh@167 -- # ip link set nvmf_init_br2 down 00:21:33.056 Cannot find device "nvmf_init_br2" 00:21:33.056 11:32:28 nvmf_tcp.nvmf_host.nvmf_multicontroller -- nvmf/common.sh@167 -- # true 00:21:33.056 11:32:28 nvmf_tcp.nvmf_host.nvmf_multicontroller -- nvmf/common.sh@168 -- # ip link set nvmf_tgt_br down 00:21:33.056 Cannot find device "nvmf_tgt_br" 00:21:33.056 11:32:28 nvmf_tcp.nvmf_host.nvmf_multicontroller -- nvmf/common.sh@168 -- # true 00:21:33.056 11:32:28 nvmf_tcp.nvmf_host.nvmf_multicontroller -- nvmf/common.sh@169 -- # ip link set nvmf_tgt_br2 down 00:21:33.056 Cannot find device "nvmf_tgt_br2" 00:21:33.056 11:32:28 nvmf_tcp.nvmf_host.nvmf_multicontroller -- nvmf/common.sh@169 -- # true 00:21:33.056 11:32:28 nvmf_tcp.nvmf_host.nvmf_multicontroller -- nvmf/common.sh@170 -- # ip link delete nvmf_br type bridge 00:21:33.056 Cannot find device "nvmf_br" 00:21:33.056 11:32:28 nvmf_tcp.nvmf_host.nvmf_multicontroller -- nvmf/common.sh@170 -- # true 00:21:33.056 11:32:28 nvmf_tcp.nvmf_host.nvmf_multicontroller -- nvmf/common.sh@171 -- # ip link delete nvmf_init_if 00:21:33.056 Cannot find device "nvmf_init_if" 00:21:33.056 11:32:28 nvmf_tcp.nvmf_host.nvmf_multicontroller -- nvmf/common.sh@171 -- # true 00:21:33.056 11:32:28 nvmf_tcp.nvmf_host.nvmf_multicontroller -- nvmf/common.sh@172 -- # ip link delete nvmf_init_if2 00:21:33.056 Cannot find device "nvmf_init_if2" 00:21:33.056 11:32:28 nvmf_tcp.nvmf_host.nvmf_multicontroller -- nvmf/common.sh@172 -- # true 00:21:33.056 11:32:28 nvmf_tcp.nvmf_host.nvmf_multicontroller -- nvmf/common.sh@173 -- # ip netns exec nvmf_tgt_ns_spdk ip link delete nvmf_tgt_if 00:21:33.056 Cannot open network namespace "nvmf_tgt_ns_spdk": No such file or directory 00:21:33.056 11:32:28 nvmf_tcp.nvmf_host.nvmf_multicontroller -- nvmf/common.sh@173 -- # true 00:21:33.056 11:32:28 nvmf_tcp.nvmf_host.nvmf_multicontroller -- nvmf/common.sh@174 -- # ip netns exec nvmf_tgt_ns_spdk ip link delete nvmf_tgt_if2 00:21:33.056 Cannot open network namespace "nvmf_tgt_ns_spdk": No such file or directory 00:21:33.056 11:32:28 nvmf_tcp.nvmf_host.nvmf_multicontroller -- nvmf/common.sh@174 -- # true 00:21:33.056 11:32:28 nvmf_tcp.nvmf_host.nvmf_multicontroller -- nvmf/common.sh@177 -- # ip netns add nvmf_tgt_ns_spdk 00:21:33.056 11:32:28 nvmf_tcp.nvmf_host.nvmf_multicontroller -- nvmf/common.sh@180 -- # ip link add nvmf_init_if type veth peer name nvmf_init_br 00:21:33.056 11:32:28 nvmf_tcp.nvmf_host.nvmf_multicontroller -- nvmf/common.sh@181 -- # ip link add nvmf_init_if2 type veth peer name nvmf_init_br2 00:21:33.056 11:32:28 nvmf_tcp.nvmf_host.nvmf_multicontroller -- nvmf/common.sh@182 -- # ip link add nvmf_tgt_if type veth peer name nvmf_tgt_br 00:21:33.056 11:32:28 nvmf_tcp.nvmf_host.nvmf_multicontroller -- nvmf/common.sh@183 -- # ip link add nvmf_tgt_if2 type veth peer name nvmf_tgt_br2 00:21:33.056 11:32:28 nvmf_tcp.nvmf_host.nvmf_multicontroller -- nvmf/common.sh@186 -- # ip link set nvmf_tgt_if netns nvmf_tgt_ns_spdk 00:21:33.056 11:32:28 nvmf_tcp.nvmf_host.nvmf_multicontroller -- nvmf/common.sh@187 -- # ip link set nvmf_tgt_if2 netns nvmf_tgt_ns_spdk 00:21:33.056 11:32:28 nvmf_tcp.nvmf_host.nvmf_multicontroller -- nvmf/common.sh@190 -- # ip addr add 10.0.0.1/24 dev nvmf_init_if 00:21:33.056 11:32:28 nvmf_tcp.nvmf_host.nvmf_multicontroller -- nvmf/common.sh@191 -- # ip addr add 10.0.0.2/24 dev nvmf_init_if2 00:21:33.056 11:32:28 nvmf_tcp.nvmf_host.nvmf_multicontroller -- nvmf/common.sh@192 -- # ip netns exec nvmf_tgt_ns_spdk ip addr add 10.0.0.3/24 dev nvmf_tgt_if 00:21:33.056 11:32:28 nvmf_tcp.nvmf_host.nvmf_multicontroller -- nvmf/common.sh@193 -- # ip netns exec nvmf_tgt_ns_spdk ip addr add 10.0.0.4/24 dev nvmf_tgt_if2 00:21:33.056 11:32:28 nvmf_tcp.nvmf_host.nvmf_multicontroller -- nvmf/common.sh@196 -- # ip link set nvmf_init_if up 00:21:33.056 11:32:28 nvmf_tcp.nvmf_host.nvmf_multicontroller -- nvmf/common.sh@197 -- # ip link set nvmf_init_if2 up 00:21:33.056 11:32:28 nvmf_tcp.nvmf_host.nvmf_multicontroller -- nvmf/common.sh@198 -- # ip link set nvmf_init_br up 00:21:33.056 11:32:28 nvmf_tcp.nvmf_host.nvmf_multicontroller -- nvmf/common.sh@199 -- # ip link set nvmf_init_br2 up 00:21:33.056 11:32:28 nvmf_tcp.nvmf_host.nvmf_multicontroller -- nvmf/common.sh@200 -- # ip link set nvmf_tgt_br up 00:21:33.056 11:32:28 nvmf_tcp.nvmf_host.nvmf_multicontroller -- nvmf/common.sh@201 -- # ip link set nvmf_tgt_br2 up 00:21:33.056 11:32:28 nvmf_tcp.nvmf_host.nvmf_multicontroller -- nvmf/common.sh@202 -- # ip netns exec nvmf_tgt_ns_spdk ip link set nvmf_tgt_if up 00:21:33.056 11:32:28 nvmf_tcp.nvmf_host.nvmf_multicontroller -- nvmf/common.sh@203 -- # ip netns exec nvmf_tgt_ns_spdk ip link set nvmf_tgt_if2 up 00:21:33.056 11:32:28 nvmf_tcp.nvmf_host.nvmf_multicontroller -- nvmf/common.sh@204 -- # ip netns exec nvmf_tgt_ns_spdk ip link set lo up 00:21:33.056 11:32:28 nvmf_tcp.nvmf_host.nvmf_multicontroller -- nvmf/common.sh@207 -- # ip link add nvmf_br type bridge 00:21:33.056 11:32:28 nvmf_tcp.nvmf_host.nvmf_multicontroller -- nvmf/common.sh@208 -- # ip link set nvmf_br up 00:21:33.056 11:32:28 nvmf_tcp.nvmf_host.nvmf_multicontroller -- nvmf/common.sh@211 -- # ip link set nvmf_init_br master nvmf_br 00:21:33.056 11:32:28 nvmf_tcp.nvmf_host.nvmf_multicontroller -- nvmf/common.sh@212 -- # ip link set nvmf_init_br2 master nvmf_br 00:21:33.314 11:32:28 nvmf_tcp.nvmf_host.nvmf_multicontroller -- nvmf/common.sh@213 -- # ip link set nvmf_tgt_br master nvmf_br 00:21:33.314 11:32:28 nvmf_tcp.nvmf_host.nvmf_multicontroller -- nvmf/common.sh@214 -- # ip link set nvmf_tgt_br2 master nvmf_br 00:21:33.314 11:32:28 nvmf_tcp.nvmf_host.nvmf_multicontroller -- nvmf/common.sh@217 -- # ipts -I INPUT 1 -i nvmf_init_if -p tcp --dport 4420 -j ACCEPT 00:21:33.314 11:32:28 nvmf_tcp.nvmf_host.nvmf_multicontroller -- nvmf/common.sh@788 -- # iptables -I INPUT 1 -i nvmf_init_if -p tcp --dport 4420 -j ACCEPT -m comment --comment 'SPDK_NVMF:-I INPUT 1 -i nvmf_init_if -p tcp --dport 4420 -j ACCEPT' 00:21:33.314 11:32:28 nvmf_tcp.nvmf_host.nvmf_multicontroller -- nvmf/common.sh@218 -- # ipts -I INPUT 1 -i nvmf_init_if2 -p tcp --dport 4420 -j ACCEPT 00:21:33.314 11:32:28 nvmf_tcp.nvmf_host.nvmf_multicontroller -- nvmf/common.sh@788 -- # iptables -I INPUT 1 -i nvmf_init_if2 -p tcp --dport 4420 -j ACCEPT -m comment --comment 'SPDK_NVMF:-I INPUT 1 -i nvmf_init_if2 -p tcp --dport 4420 -j ACCEPT' 00:21:33.314 11:32:28 nvmf_tcp.nvmf_host.nvmf_multicontroller -- nvmf/common.sh@219 -- # ipts -A FORWARD -i nvmf_br -o nvmf_br -j ACCEPT 00:21:33.314 11:32:28 nvmf_tcp.nvmf_host.nvmf_multicontroller -- nvmf/common.sh@788 -- # iptables -A FORWARD -i nvmf_br -o nvmf_br -j ACCEPT -m comment --comment 'SPDK_NVMF:-A FORWARD -i nvmf_br -o nvmf_br -j ACCEPT' 00:21:33.314 11:32:28 nvmf_tcp.nvmf_host.nvmf_multicontroller -- nvmf/common.sh@222 -- # ping -c 1 10.0.0.3 00:21:33.314 PING 10.0.0.3 (10.0.0.3) 56(84) bytes of data. 00:21:33.314 64 bytes from 10.0.0.3: icmp_seq=1 ttl=64 time=0.111 ms 00:21:33.314 00:21:33.314 --- 10.0.0.3 ping statistics --- 00:21:33.314 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:21:33.314 rtt min/avg/max/mdev = 0.111/0.111/0.111/0.000 ms 00:21:33.314 11:32:28 nvmf_tcp.nvmf_host.nvmf_multicontroller -- nvmf/common.sh@223 -- # ping -c 1 10.0.0.4 00:21:33.314 PING 10.0.0.4 (10.0.0.4) 56(84) bytes of data. 00:21:33.314 64 bytes from 10.0.0.4: icmp_seq=1 ttl=64 time=0.039 ms 00:21:33.314 00:21:33.314 --- 10.0.0.4 ping statistics --- 00:21:33.314 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:21:33.314 rtt min/avg/max/mdev = 0.039/0.039/0.039/0.000 ms 00:21:33.314 11:32:28 nvmf_tcp.nvmf_host.nvmf_multicontroller -- nvmf/common.sh@224 -- # ip netns exec nvmf_tgt_ns_spdk ping -c 1 10.0.0.1 00:21:33.314 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:21:33.314 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.024 ms 00:21:33.314 00:21:33.314 --- 10.0.0.1 ping statistics --- 00:21:33.314 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:21:33.314 rtt min/avg/max/mdev = 0.024/0.024/0.024/0.000 ms 00:21:33.314 11:32:28 nvmf_tcp.nvmf_host.nvmf_multicontroller -- nvmf/common.sh@225 -- # ip netns exec nvmf_tgt_ns_spdk ping -c 1 10.0.0.2 00:21:33.314 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:21:33.314 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.085 ms 00:21:33.314 00:21:33.314 --- 10.0.0.2 ping statistics --- 00:21:33.314 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:21:33.314 rtt min/avg/max/mdev = 0.085/0.085/0.085/0.000 ms 00:21:33.314 11:32:28 nvmf_tcp.nvmf_host.nvmf_multicontroller -- nvmf/common.sh@227 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:21:33.314 11:32:28 nvmf_tcp.nvmf_host.nvmf_multicontroller -- nvmf/common.sh@459 -- # return 0 00:21:33.314 11:32:28 nvmf_tcp.nvmf_host.nvmf_multicontroller -- nvmf/common.sh@476 -- # '[' '' == iso ']' 00:21:33.314 11:32:28 nvmf_tcp.nvmf_host.nvmf_multicontroller -- nvmf/common.sh@480 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:21:33.314 11:32:28 nvmf_tcp.nvmf_host.nvmf_multicontroller -- nvmf/common.sh@481 -- # [[ tcp == \r\d\m\a ]] 00:21:33.314 11:32:28 nvmf_tcp.nvmf_host.nvmf_multicontroller -- nvmf/common.sh@490 -- # [[ tcp == \t\c\p ]] 00:21:33.314 11:32:28 nvmf_tcp.nvmf_host.nvmf_multicontroller -- nvmf/common.sh@491 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:21:33.314 11:32:28 nvmf_tcp.nvmf_host.nvmf_multicontroller -- nvmf/common.sh@494 -- # '[' tcp == tcp ']' 00:21:33.314 11:32:28 nvmf_tcp.nvmf_host.nvmf_multicontroller -- nvmf/common.sh@500 -- # modprobe nvme-tcp 00:21:33.314 11:32:28 nvmf_tcp.nvmf_host.nvmf_multicontroller -- host/multicontroller.sh@25 -- # nvmfappstart -m 0xE 00:21:33.314 11:32:28 nvmf_tcp.nvmf_host.nvmf_multicontroller -- nvmf/common.sh@505 -- # timing_enter start_nvmf_tgt 00:21:33.314 11:32:28 nvmf_tcp.nvmf_host.nvmf_multicontroller -- common/autotest_common.sh@724 -- # xtrace_disable 00:21:33.314 11:32:28 nvmf_tcp.nvmf_host.nvmf_multicontroller -- common/autotest_common.sh@10 -- # set +x 00:21:33.314 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:21:33.314 11:32:28 nvmf_tcp.nvmf_host.nvmf_multicontroller -- nvmf/common.sh@507 -- # nvmfpid=86721 00:21:33.314 11:32:28 nvmf_tcp.nvmf_host.nvmf_multicontroller -- nvmf/common.sh@506 -- # ip netns exec nvmf_tgt_ns_spdk /home/vagrant/spdk_repo/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xE 00:21:33.314 11:32:28 nvmf_tcp.nvmf_host.nvmf_multicontroller -- nvmf/common.sh@508 -- # waitforlisten 86721 00:21:33.314 11:32:28 nvmf_tcp.nvmf_host.nvmf_multicontroller -- common/autotest_common.sh@831 -- # '[' -z 86721 ']' 00:21:33.314 11:32:28 nvmf_tcp.nvmf_host.nvmf_multicontroller -- common/autotest_common.sh@835 -- # local rpc_addr=/var/tmp/spdk.sock 00:21:33.314 11:32:28 nvmf_tcp.nvmf_host.nvmf_multicontroller -- common/autotest_common.sh@836 -- # local max_retries=100 00:21:33.314 11:32:28 nvmf_tcp.nvmf_host.nvmf_multicontroller -- common/autotest_common.sh@838 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:21:33.314 11:32:28 nvmf_tcp.nvmf_host.nvmf_multicontroller -- common/autotest_common.sh@840 -- # xtrace_disable 00:21:33.314 11:32:28 nvmf_tcp.nvmf_host.nvmf_multicontroller -- common/autotest_common.sh@10 -- # set +x 00:21:33.314 [2024-10-07 11:32:28.741404] Starting SPDK v25.01-pre git sha1 2a4f56c54 / DPDK 24.03.0 initialization... 00:21:33.314 [2024-10-07 11:32:28.741750] [ DPDK EAL parameters: nvmf -c 0xE --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --iova-mode=pa --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:21:33.573 [2024-10-07 11:32:28.881900] app.c: 917:spdk_app_start: *NOTICE*: Total cores available: 3 00:21:33.573 [2024-10-07 11:32:29.010387] app.c: 610:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:21:33.573 [2024-10-07 11:32:29.011500] app.c: 611:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:21:33.573 [2024-10-07 11:32:29.011522] app.c: 616:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:21:33.573 [2024-10-07 11:32:29.011533] app.c: 617:app_setup_trace: *NOTICE*: SPDK application currently running. 00:21:33.573 [2024-10-07 11:32:29.011552] app.c: 618:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:21:33.573 [2024-10-07 11:32:29.012373] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 2 00:21:33.573 [2024-10-07 11:32:29.012447] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 1 00:21:33.573 [2024-10-07 11:32:29.012447] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 3 00:21:34.508 11:32:29 nvmf_tcp.nvmf_host.nvmf_multicontroller -- common/autotest_common.sh@860 -- # (( i == 0 )) 00:21:34.508 11:32:29 nvmf_tcp.nvmf_host.nvmf_multicontroller -- common/autotest_common.sh@864 -- # return 0 00:21:34.508 11:32:29 nvmf_tcp.nvmf_host.nvmf_multicontroller -- nvmf/common.sh@509 -- # timing_exit start_nvmf_tgt 00:21:34.508 11:32:29 nvmf_tcp.nvmf_host.nvmf_multicontroller -- common/autotest_common.sh@730 -- # xtrace_disable 00:21:34.508 11:32:29 nvmf_tcp.nvmf_host.nvmf_multicontroller -- common/autotest_common.sh@10 -- # set +x 00:21:34.508 11:32:29 nvmf_tcp.nvmf_host.nvmf_multicontroller -- nvmf/common.sh@510 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:21:34.508 11:32:29 nvmf_tcp.nvmf_host.nvmf_multicontroller -- host/multicontroller.sh@27 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:21:34.508 11:32:29 nvmf_tcp.nvmf_host.nvmf_multicontroller -- common/autotest_common.sh@561 -- # xtrace_disable 00:21:34.508 11:32:29 nvmf_tcp.nvmf_host.nvmf_multicontroller -- common/autotest_common.sh@10 -- # set +x 00:21:34.508 [2024-10-07 11:32:29.861706] tcp.c: 738:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:21:34.508 11:32:29 nvmf_tcp.nvmf_host.nvmf_multicontroller -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:21:34.508 11:32:29 nvmf_tcp.nvmf_host.nvmf_multicontroller -- host/multicontroller.sh@29 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:21:34.508 11:32:29 nvmf_tcp.nvmf_host.nvmf_multicontroller -- common/autotest_common.sh@561 -- # xtrace_disable 00:21:34.508 11:32:29 nvmf_tcp.nvmf_host.nvmf_multicontroller -- common/autotest_common.sh@10 -- # set +x 00:21:34.508 Malloc0 00:21:34.508 11:32:29 nvmf_tcp.nvmf_host.nvmf_multicontroller -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:21:34.508 11:32:29 nvmf_tcp.nvmf_host.nvmf_multicontroller -- host/multicontroller.sh@30 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:21:34.508 11:32:29 nvmf_tcp.nvmf_host.nvmf_multicontroller -- common/autotest_common.sh@561 -- # xtrace_disable 00:21:34.508 11:32:29 nvmf_tcp.nvmf_host.nvmf_multicontroller -- common/autotest_common.sh@10 -- # set +x 00:21:34.508 11:32:29 nvmf_tcp.nvmf_host.nvmf_multicontroller -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:21:34.508 11:32:29 nvmf_tcp.nvmf_host.nvmf_multicontroller -- host/multicontroller.sh@31 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:21:34.508 11:32:29 nvmf_tcp.nvmf_host.nvmf_multicontroller -- common/autotest_common.sh@561 -- # xtrace_disable 00:21:34.508 11:32:29 nvmf_tcp.nvmf_host.nvmf_multicontroller -- common/autotest_common.sh@10 -- # set +x 00:21:34.508 11:32:29 nvmf_tcp.nvmf_host.nvmf_multicontroller -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:21:34.508 11:32:29 nvmf_tcp.nvmf_host.nvmf_multicontroller -- host/multicontroller.sh@33 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.3 -s 4420 00:21:34.508 11:32:29 nvmf_tcp.nvmf_host.nvmf_multicontroller -- common/autotest_common.sh@561 -- # xtrace_disable 00:21:34.508 11:32:29 nvmf_tcp.nvmf_host.nvmf_multicontroller -- common/autotest_common.sh@10 -- # set +x 00:21:34.508 [2024-10-07 11:32:29.936024] tcp.c:1081:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.3 port 4420 *** 00:21:34.508 11:32:29 nvmf_tcp.nvmf_host.nvmf_multicontroller -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:21:34.508 11:32:29 nvmf_tcp.nvmf_host.nvmf_multicontroller -- host/multicontroller.sh@34 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.3 -s 4421 00:21:34.508 11:32:29 nvmf_tcp.nvmf_host.nvmf_multicontroller -- common/autotest_common.sh@561 -- # xtrace_disable 00:21:34.508 11:32:29 nvmf_tcp.nvmf_host.nvmf_multicontroller -- common/autotest_common.sh@10 -- # set +x 00:21:34.508 [2024-10-07 11:32:29.943937] tcp.c:1081:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.3 port 4421 *** 00:21:34.508 11:32:29 nvmf_tcp.nvmf_host.nvmf_multicontroller -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:21:34.508 11:32:29 nvmf_tcp.nvmf_host.nvmf_multicontroller -- host/multicontroller.sh@36 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc1 00:21:34.508 11:32:29 nvmf_tcp.nvmf_host.nvmf_multicontroller -- common/autotest_common.sh@561 -- # xtrace_disable 00:21:34.508 11:32:29 nvmf_tcp.nvmf_host.nvmf_multicontroller -- common/autotest_common.sh@10 -- # set +x 00:21:34.508 Malloc1 00:21:34.508 11:32:29 nvmf_tcp.nvmf_host.nvmf_multicontroller -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:21:34.508 11:32:29 nvmf_tcp.nvmf_host.nvmf_multicontroller -- host/multicontroller.sh@37 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode2 -a -s SPDK00000000000002 00:21:34.508 11:32:29 nvmf_tcp.nvmf_host.nvmf_multicontroller -- common/autotest_common.sh@561 -- # xtrace_disable 00:21:34.508 11:32:29 nvmf_tcp.nvmf_host.nvmf_multicontroller -- common/autotest_common.sh@10 -- # set +x 00:21:34.508 11:32:29 nvmf_tcp.nvmf_host.nvmf_multicontroller -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:21:34.508 11:32:29 nvmf_tcp.nvmf_host.nvmf_multicontroller -- host/multicontroller.sh@38 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode2 Malloc1 00:21:34.508 11:32:29 nvmf_tcp.nvmf_host.nvmf_multicontroller -- common/autotest_common.sh@561 -- # xtrace_disable 00:21:34.508 11:32:29 nvmf_tcp.nvmf_host.nvmf_multicontroller -- common/autotest_common.sh@10 -- # set +x 00:21:34.508 11:32:29 nvmf_tcp.nvmf_host.nvmf_multicontroller -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:21:34.508 11:32:29 nvmf_tcp.nvmf_host.nvmf_multicontroller -- host/multicontroller.sh@40 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode2 -t tcp -a 10.0.0.3 -s 4420 00:21:34.508 11:32:29 nvmf_tcp.nvmf_host.nvmf_multicontroller -- common/autotest_common.sh@561 -- # xtrace_disable 00:21:34.508 11:32:29 nvmf_tcp.nvmf_host.nvmf_multicontroller -- common/autotest_common.sh@10 -- # set +x 00:21:34.508 11:32:29 nvmf_tcp.nvmf_host.nvmf_multicontroller -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:21:34.508 11:32:29 nvmf_tcp.nvmf_host.nvmf_multicontroller -- host/multicontroller.sh@41 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode2 -t tcp -a 10.0.0.3 -s 4421 00:21:34.508 11:32:29 nvmf_tcp.nvmf_host.nvmf_multicontroller -- common/autotest_common.sh@561 -- # xtrace_disable 00:21:34.508 11:32:30 nvmf_tcp.nvmf_host.nvmf_multicontroller -- common/autotest_common.sh@10 -- # set +x 00:21:34.508 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:21:34.508 11:32:30 nvmf_tcp.nvmf_host.nvmf_multicontroller -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:21:34.508 11:32:30 nvmf_tcp.nvmf_host.nvmf_multicontroller -- host/multicontroller.sh@44 -- # bdevperf_pid=86773 00:21:34.508 11:32:30 nvmf_tcp.nvmf_host.nvmf_multicontroller -- host/multicontroller.sh@43 -- # /home/vagrant/spdk_repo/spdk/build/examples/bdevperf -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w write -t 1 -f 00:21:34.508 11:32:30 nvmf_tcp.nvmf_host.nvmf_multicontroller -- host/multicontroller.sh@46 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; pap "$testdir/try.txt"; killprocess $bdevperf_pid; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:21:34.508 11:32:30 nvmf_tcp.nvmf_host.nvmf_multicontroller -- host/multicontroller.sh@47 -- # waitforlisten 86773 /var/tmp/bdevperf.sock 00:21:34.508 11:32:30 nvmf_tcp.nvmf_host.nvmf_multicontroller -- common/autotest_common.sh@831 -- # '[' -z 86773 ']' 00:21:34.508 11:32:30 nvmf_tcp.nvmf_host.nvmf_multicontroller -- common/autotest_common.sh@835 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:21:34.508 11:32:30 nvmf_tcp.nvmf_host.nvmf_multicontroller -- common/autotest_common.sh@836 -- # local max_retries=100 00:21:34.508 11:32:30 nvmf_tcp.nvmf_host.nvmf_multicontroller -- common/autotest_common.sh@838 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:21:34.508 11:32:30 nvmf_tcp.nvmf_host.nvmf_multicontroller -- common/autotest_common.sh@840 -- # xtrace_disable 00:21:34.508 11:32:30 nvmf_tcp.nvmf_host.nvmf_multicontroller -- common/autotest_common.sh@10 -- # set +x 00:21:35.883 11:32:31 nvmf_tcp.nvmf_host.nvmf_multicontroller -- common/autotest_common.sh@860 -- # (( i == 0 )) 00:21:35.883 11:32:31 nvmf_tcp.nvmf_host.nvmf_multicontroller -- common/autotest_common.sh@864 -- # return 0 00:21:35.883 11:32:31 nvmf_tcp.nvmf_host.nvmf_multicontroller -- host/multicontroller.sh@50 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.3 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -i 10.0.0.1 00:21:35.883 11:32:31 nvmf_tcp.nvmf_host.nvmf_multicontroller -- common/autotest_common.sh@561 -- # xtrace_disable 00:21:35.883 11:32:31 nvmf_tcp.nvmf_host.nvmf_multicontroller -- common/autotest_common.sh@10 -- # set +x 00:21:35.883 NVMe0n1 00:21:35.883 11:32:31 nvmf_tcp.nvmf_host.nvmf_multicontroller -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:21:35.883 11:32:31 nvmf_tcp.nvmf_host.nvmf_multicontroller -- host/multicontroller.sh@54 -- # grep -c NVMe 00:21:35.883 11:32:31 nvmf_tcp.nvmf_host.nvmf_multicontroller -- host/multicontroller.sh@54 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_get_controllers 00:21:35.883 11:32:31 nvmf_tcp.nvmf_host.nvmf_multicontroller -- common/autotest_common.sh@561 -- # xtrace_disable 00:21:35.883 11:32:31 nvmf_tcp.nvmf_host.nvmf_multicontroller -- common/autotest_common.sh@10 -- # set +x 00:21:35.883 11:32:31 nvmf_tcp.nvmf_host.nvmf_multicontroller -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:21:35.883 1 00:21:35.883 11:32:31 nvmf_tcp.nvmf_host.nvmf_multicontroller -- host/multicontroller.sh@60 -- # NOT rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.3 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -i 10.0.0.1 -q nqn.2021-09-7.io.spdk:00001 00:21:35.883 11:32:31 nvmf_tcp.nvmf_host.nvmf_multicontroller -- common/autotest_common.sh@650 -- # local es=0 00:21:35.883 11:32:31 nvmf_tcp.nvmf_host.nvmf_multicontroller -- common/autotest_common.sh@652 -- # valid_exec_arg rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.3 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -i 10.0.0.1 -q nqn.2021-09-7.io.spdk:00001 00:21:35.883 11:32:31 nvmf_tcp.nvmf_host.nvmf_multicontroller -- common/autotest_common.sh@638 -- # local arg=rpc_cmd 00:21:35.883 11:32:31 nvmf_tcp.nvmf_host.nvmf_multicontroller -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:21:35.883 11:32:31 nvmf_tcp.nvmf_host.nvmf_multicontroller -- common/autotest_common.sh@642 -- # type -t rpc_cmd 00:21:35.883 11:32:31 nvmf_tcp.nvmf_host.nvmf_multicontroller -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:21:35.883 11:32:31 nvmf_tcp.nvmf_host.nvmf_multicontroller -- common/autotest_common.sh@653 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.3 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -i 10.0.0.1 -q nqn.2021-09-7.io.spdk:00001 00:21:35.883 11:32:31 nvmf_tcp.nvmf_host.nvmf_multicontroller -- common/autotest_common.sh@561 -- # xtrace_disable 00:21:35.883 11:32:31 nvmf_tcp.nvmf_host.nvmf_multicontroller -- common/autotest_common.sh@10 -- # set +x 00:21:35.883 2024/10/07 11:32:31 error on JSON-RPC call, method: bdev_nvme_attach_controller, params: map[adrfam:ipv4 allow_unrecognized_csi:%!s(bool=false) ddgst:%!s(bool=false) hdgst:%!s(bool=false) hostaddr:10.0.0.1 hostnqn:nqn.2021-09-7.io.spdk:00001 name:NVMe0 prchk_guard:%!s(bool=false) prchk_reftag:%!s(bool=false) subnqn:nqn.2016-06.io.spdk:cnode1 traddr:10.0.0.3 trsvcid:4420 trtype:tcp], err: error received for bdev_nvme_attach_controller method, err: Code=-114 Msg=A controller named NVMe0 already exists with the specified network path 00:21:35.883 request: 00:21:35.883 { 00:21:35.883 "method": "bdev_nvme_attach_controller", 00:21:35.883 "params": { 00:21:35.883 "name": "NVMe0", 00:21:35.883 "trtype": "tcp", 00:21:35.883 "traddr": "10.0.0.3", 00:21:35.883 "adrfam": "ipv4", 00:21:35.883 "trsvcid": "4420", 00:21:35.884 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:21:35.884 "hostnqn": "nqn.2021-09-7.io.spdk:00001", 00:21:35.884 "hostaddr": "10.0.0.1", 00:21:35.884 "prchk_reftag": false, 00:21:35.884 "prchk_guard": false, 00:21:35.884 "hdgst": false, 00:21:35.884 "ddgst": false, 00:21:35.884 "allow_unrecognized_csi": false 00:21:35.884 } 00:21:35.884 } 00:21:35.884 Got JSON-RPC error response 00:21:35.884 GoRPCClient: error on JSON-RPC call 00:21:35.884 11:32:31 nvmf_tcp.nvmf_host.nvmf_multicontroller -- common/autotest_common.sh@589 -- # [[ 1 == 0 ]] 00:21:35.884 11:32:31 nvmf_tcp.nvmf_host.nvmf_multicontroller -- common/autotest_common.sh@653 -- # es=1 00:21:35.884 11:32:31 nvmf_tcp.nvmf_host.nvmf_multicontroller -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:21:35.884 11:32:31 nvmf_tcp.nvmf_host.nvmf_multicontroller -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:21:35.884 11:32:31 nvmf_tcp.nvmf_host.nvmf_multicontroller -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:21:35.884 11:32:31 nvmf_tcp.nvmf_host.nvmf_multicontroller -- host/multicontroller.sh@65 -- # NOT rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.3 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode2 -i 10.0.0.1 00:21:35.884 11:32:31 nvmf_tcp.nvmf_host.nvmf_multicontroller -- common/autotest_common.sh@650 -- # local es=0 00:21:35.884 11:32:31 nvmf_tcp.nvmf_host.nvmf_multicontroller -- common/autotest_common.sh@652 -- # valid_exec_arg rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.3 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode2 -i 10.0.0.1 00:21:35.884 11:32:31 nvmf_tcp.nvmf_host.nvmf_multicontroller -- common/autotest_common.sh@638 -- # local arg=rpc_cmd 00:21:35.884 11:32:31 nvmf_tcp.nvmf_host.nvmf_multicontroller -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:21:35.884 11:32:31 nvmf_tcp.nvmf_host.nvmf_multicontroller -- common/autotest_common.sh@642 -- # type -t rpc_cmd 00:21:35.884 11:32:31 nvmf_tcp.nvmf_host.nvmf_multicontroller -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:21:35.884 11:32:31 nvmf_tcp.nvmf_host.nvmf_multicontroller -- common/autotest_common.sh@653 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.3 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode2 -i 10.0.0.1 00:21:35.884 11:32:31 nvmf_tcp.nvmf_host.nvmf_multicontroller -- common/autotest_common.sh@561 -- # xtrace_disable 00:21:35.884 11:32:31 nvmf_tcp.nvmf_host.nvmf_multicontroller -- common/autotest_common.sh@10 -- # set +x 00:21:35.884 2024/10/07 11:32:31 error on JSON-RPC call, method: bdev_nvme_attach_controller, params: map[adrfam:ipv4 allow_unrecognized_csi:%!s(bool=false) ddgst:%!s(bool=false) hdgst:%!s(bool=false) hostaddr:10.0.0.1 name:NVMe0 prchk_guard:%!s(bool=false) prchk_reftag:%!s(bool=false) subnqn:nqn.2016-06.io.spdk:cnode2 traddr:10.0.0.3 trsvcid:4420 trtype:tcp], err: error received for bdev_nvme_attach_controller method, err: Code=-114 Msg=A controller named NVMe0 already exists with the specified network path 00:21:35.884 request: 00:21:35.884 { 00:21:35.884 "method": "bdev_nvme_attach_controller", 00:21:35.884 "params": { 00:21:35.884 "name": "NVMe0", 00:21:35.884 "trtype": "tcp", 00:21:35.884 "traddr": "10.0.0.3", 00:21:35.884 "adrfam": "ipv4", 00:21:35.884 "trsvcid": "4420", 00:21:35.884 "subnqn": "nqn.2016-06.io.spdk:cnode2", 00:21:35.884 "hostaddr": "10.0.0.1", 00:21:35.884 "prchk_reftag": false, 00:21:35.884 "prchk_guard": false, 00:21:35.884 "hdgst": false, 00:21:35.884 "ddgst": false, 00:21:35.884 "allow_unrecognized_csi": false 00:21:35.884 } 00:21:35.884 } 00:21:35.884 Got JSON-RPC error response 00:21:35.884 GoRPCClient: error on JSON-RPC call 00:21:35.884 11:32:31 nvmf_tcp.nvmf_host.nvmf_multicontroller -- common/autotest_common.sh@589 -- # [[ 1 == 0 ]] 00:21:35.884 11:32:31 nvmf_tcp.nvmf_host.nvmf_multicontroller -- common/autotest_common.sh@653 -- # es=1 00:21:35.884 11:32:31 nvmf_tcp.nvmf_host.nvmf_multicontroller -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:21:35.884 11:32:31 nvmf_tcp.nvmf_host.nvmf_multicontroller -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:21:35.884 11:32:31 nvmf_tcp.nvmf_host.nvmf_multicontroller -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:21:35.884 11:32:31 nvmf_tcp.nvmf_host.nvmf_multicontroller -- host/multicontroller.sh@69 -- # NOT rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.3 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -i 10.0.0.1 -x disable 00:21:35.884 11:32:31 nvmf_tcp.nvmf_host.nvmf_multicontroller -- common/autotest_common.sh@650 -- # local es=0 00:21:35.884 11:32:31 nvmf_tcp.nvmf_host.nvmf_multicontroller -- common/autotest_common.sh@652 -- # valid_exec_arg rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.3 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -i 10.0.0.1 -x disable 00:21:35.884 11:32:31 nvmf_tcp.nvmf_host.nvmf_multicontroller -- common/autotest_common.sh@638 -- # local arg=rpc_cmd 00:21:35.884 11:32:31 nvmf_tcp.nvmf_host.nvmf_multicontroller -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:21:35.884 11:32:31 nvmf_tcp.nvmf_host.nvmf_multicontroller -- common/autotest_common.sh@642 -- # type -t rpc_cmd 00:21:35.884 11:32:31 nvmf_tcp.nvmf_host.nvmf_multicontroller -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:21:35.884 11:32:31 nvmf_tcp.nvmf_host.nvmf_multicontroller -- common/autotest_common.sh@653 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.3 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -i 10.0.0.1 -x disable 00:21:35.884 11:32:31 nvmf_tcp.nvmf_host.nvmf_multicontroller -- common/autotest_common.sh@561 -- # xtrace_disable 00:21:35.884 11:32:31 nvmf_tcp.nvmf_host.nvmf_multicontroller -- common/autotest_common.sh@10 -- # set +x 00:21:35.884 2024/10/07 11:32:31 error on JSON-RPC call, method: bdev_nvme_attach_controller, params: map[adrfam:ipv4 allow_unrecognized_csi:%!s(bool=false) ddgst:%!s(bool=false) hdgst:%!s(bool=false) hostaddr:10.0.0.1 multipath:disable name:NVMe0 prchk_guard:%!s(bool=false) prchk_reftag:%!s(bool=false) subnqn:nqn.2016-06.io.spdk:cnode1 traddr:10.0.0.3 trsvcid:4420 trtype:tcp], err: error received for bdev_nvme_attach_controller method, err: Code=-114 Msg=A controller named NVMe0 already exists and multipath is disabled 00:21:35.884 request: 00:21:35.884 { 00:21:35.884 "method": "bdev_nvme_attach_controller", 00:21:35.884 "params": { 00:21:35.884 "name": "NVMe0", 00:21:35.884 "trtype": "tcp", 00:21:35.884 "traddr": "10.0.0.3", 00:21:35.884 "adrfam": "ipv4", 00:21:35.884 "trsvcid": "4420", 00:21:35.884 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:21:35.884 "hostaddr": "10.0.0.1", 00:21:35.884 "prchk_reftag": false, 00:21:35.884 "prchk_guard": false, 00:21:35.884 "hdgst": false, 00:21:35.884 "ddgst": false, 00:21:35.884 "multipath": "disable", 00:21:35.884 "allow_unrecognized_csi": false 00:21:35.884 } 00:21:35.884 } 00:21:35.884 Got JSON-RPC error response 00:21:35.884 GoRPCClient: error on JSON-RPC call 00:21:35.884 11:32:31 nvmf_tcp.nvmf_host.nvmf_multicontroller -- common/autotest_common.sh@589 -- # [[ 1 == 0 ]] 00:21:35.884 11:32:31 nvmf_tcp.nvmf_host.nvmf_multicontroller -- common/autotest_common.sh@653 -- # es=1 00:21:35.884 11:32:31 nvmf_tcp.nvmf_host.nvmf_multicontroller -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:21:35.884 11:32:31 nvmf_tcp.nvmf_host.nvmf_multicontroller -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:21:35.884 11:32:31 nvmf_tcp.nvmf_host.nvmf_multicontroller -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:21:35.884 11:32:31 nvmf_tcp.nvmf_host.nvmf_multicontroller -- host/multicontroller.sh@74 -- # NOT rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.3 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -i 10.0.0.1 -x failover 00:21:35.884 11:32:31 nvmf_tcp.nvmf_host.nvmf_multicontroller -- common/autotest_common.sh@650 -- # local es=0 00:21:35.884 11:32:31 nvmf_tcp.nvmf_host.nvmf_multicontroller -- common/autotest_common.sh@652 -- # valid_exec_arg rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.3 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -i 10.0.0.1 -x failover 00:21:35.884 11:32:31 nvmf_tcp.nvmf_host.nvmf_multicontroller -- common/autotest_common.sh@638 -- # local arg=rpc_cmd 00:21:35.884 11:32:31 nvmf_tcp.nvmf_host.nvmf_multicontroller -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:21:35.884 11:32:31 nvmf_tcp.nvmf_host.nvmf_multicontroller -- common/autotest_common.sh@642 -- # type -t rpc_cmd 00:21:35.884 11:32:31 nvmf_tcp.nvmf_host.nvmf_multicontroller -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:21:35.884 11:32:31 nvmf_tcp.nvmf_host.nvmf_multicontroller -- common/autotest_common.sh@653 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.3 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -i 10.0.0.1 -x failover 00:21:35.884 11:32:31 nvmf_tcp.nvmf_host.nvmf_multicontroller -- common/autotest_common.sh@561 -- # xtrace_disable 00:21:35.884 11:32:31 nvmf_tcp.nvmf_host.nvmf_multicontroller -- common/autotest_common.sh@10 -- # set +x 00:21:35.884 2024/10/07 11:32:31 error on JSON-RPC call, method: bdev_nvme_attach_controller, params: map[adrfam:ipv4 allow_unrecognized_csi:%!s(bool=false) ddgst:%!s(bool=false) hdgst:%!s(bool=false) hostaddr:10.0.0.1 multipath:failover name:NVMe0 prchk_guard:%!s(bool=false) prchk_reftag:%!s(bool=false) subnqn:nqn.2016-06.io.spdk:cnode1 traddr:10.0.0.3 trsvcid:4420 trtype:tcp], err: error received for bdev_nvme_attach_controller method, err: Code=-114 Msg=A controller named NVMe0 already exists with the specified network path 00:21:35.884 request: 00:21:35.884 { 00:21:35.884 "method": "bdev_nvme_attach_controller", 00:21:35.884 "params": { 00:21:35.884 "name": "NVMe0", 00:21:35.884 "trtype": "tcp", 00:21:35.884 "traddr": "10.0.0.3", 00:21:35.884 "adrfam": "ipv4", 00:21:35.884 "trsvcid": "4420", 00:21:35.884 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:21:35.884 "hostaddr": "10.0.0.1", 00:21:35.884 "prchk_reftag": false, 00:21:35.884 "prchk_guard": false, 00:21:35.884 "hdgst": false, 00:21:35.884 "ddgst": false, 00:21:35.884 "multipath": "failover", 00:21:35.884 "allow_unrecognized_csi": false 00:21:35.884 } 00:21:35.884 } 00:21:35.884 Got JSON-RPC error response 00:21:35.884 GoRPCClient: error on JSON-RPC call 00:21:35.884 11:32:31 nvmf_tcp.nvmf_host.nvmf_multicontroller -- common/autotest_common.sh@589 -- # [[ 1 == 0 ]] 00:21:35.884 11:32:31 nvmf_tcp.nvmf_host.nvmf_multicontroller -- common/autotest_common.sh@653 -- # es=1 00:21:35.884 11:32:31 nvmf_tcp.nvmf_host.nvmf_multicontroller -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:21:35.884 11:32:31 nvmf_tcp.nvmf_host.nvmf_multicontroller -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:21:35.884 11:32:31 nvmf_tcp.nvmf_host.nvmf_multicontroller -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:21:35.884 11:32:31 nvmf_tcp.nvmf_host.nvmf_multicontroller -- host/multicontroller.sh@79 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.3 -s 4421 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:21:35.884 11:32:31 nvmf_tcp.nvmf_host.nvmf_multicontroller -- common/autotest_common.sh@561 -- # xtrace_disable 00:21:35.884 11:32:31 nvmf_tcp.nvmf_host.nvmf_multicontroller -- common/autotest_common.sh@10 -- # set +x 00:21:35.884 NVMe0n1 00:21:35.884 11:32:31 nvmf_tcp.nvmf_host.nvmf_multicontroller -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:21:36.143 11:32:31 nvmf_tcp.nvmf_host.nvmf_multicontroller -- host/multicontroller.sh@83 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_detach_controller NVMe0 -t tcp -a 10.0.0.3 -s 4421 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:21:36.143 11:32:31 nvmf_tcp.nvmf_host.nvmf_multicontroller -- common/autotest_common.sh@561 -- # xtrace_disable 00:21:36.143 11:32:31 nvmf_tcp.nvmf_host.nvmf_multicontroller -- common/autotest_common.sh@10 -- # set +x 00:21:36.143 11:32:31 nvmf_tcp.nvmf_host.nvmf_multicontroller -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:21:36.143 11:32:31 nvmf_tcp.nvmf_host.nvmf_multicontroller -- host/multicontroller.sh@87 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe1 -t tcp -a 10.0.0.3 -s 4421 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -i 10.0.0.1 00:21:36.143 11:32:31 nvmf_tcp.nvmf_host.nvmf_multicontroller -- common/autotest_common.sh@561 -- # xtrace_disable 00:21:36.143 11:32:31 nvmf_tcp.nvmf_host.nvmf_multicontroller -- common/autotest_common.sh@10 -- # set +x 00:21:36.143 00:21:36.143 11:32:31 nvmf_tcp.nvmf_host.nvmf_multicontroller -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:21:36.143 11:32:31 nvmf_tcp.nvmf_host.nvmf_multicontroller -- host/multicontroller.sh@90 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_get_controllers 00:21:36.143 11:32:31 nvmf_tcp.nvmf_host.nvmf_multicontroller -- host/multicontroller.sh@90 -- # grep -c NVMe 00:21:36.143 11:32:31 nvmf_tcp.nvmf_host.nvmf_multicontroller -- common/autotest_common.sh@561 -- # xtrace_disable 00:21:36.143 11:32:31 nvmf_tcp.nvmf_host.nvmf_multicontroller -- common/autotest_common.sh@10 -- # set +x 00:21:36.143 11:32:31 nvmf_tcp.nvmf_host.nvmf_multicontroller -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:21:36.143 11:32:31 nvmf_tcp.nvmf_host.nvmf_multicontroller -- host/multicontroller.sh@90 -- # '[' 2 '!=' 2 ']' 00:21:36.143 11:32:31 nvmf_tcp.nvmf_host.nvmf_multicontroller -- host/multicontroller.sh@95 -- # /home/vagrant/spdk_repo/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bdevperf.sock perform_tests 00:21:37.529 { 00:21:37.529 "results": [ 00:21:37.529 { 00:21:37.529 "job": "NVMe0n1", 00:21:37.529 "core_mask": "0x1", 00:21:37.529 "workload": "write", 00:21:37.529 "status": "finished", 00:21:37.529 "queue_depth": 128, 00:21:37.529 "io_size": 4096, 00:21:37.529 "runtime": 1.010277, 00:21:37.529 "iops": 18486.019180878116, 00:21:37.529 "mibps": 72.21101242530514, 00:21:37.529 "io_failed": 0, 00:21:37.529 "io_timeout": 0, 00:21:37.529 "avg_latency_us": 6913.137467629822, 00:21:37.529 "min_latency_us": 2174.6036363636363, 00:21:37.529 "max_latency_us": 14596.654545454545 00:21:37.529 } 00:21:37.529 ], 00:21:37.529 "core_count": 1 00:21:37.529 } 00:21:37.529 11:32:32 nvmf_tcp.nvmf_host.nvmf_multicontroller -- host/multicontroller.sh@98 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_detach_controller NVMe1 00:21:37.529 11:32:32 nvmf_tcp.nvmf_host.nvmf_multicontroller -- common/autotest_common.sh@561 -- # xtrace_disable 00:21:37.529 11:32:32 nvmf_tcp.nvmf_host.nvmf_multicontroller -- common/autotest_common.sh@10 -- # set +x 00:21:37.529 11:32:32 nvmf_tcp.nvmf_host.nvmf_multicontroller -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:21:37.529 11:32:32 nvmf_tcp.nvmf_host.nvmf_multicontroller -- host/multicontroller.sh@100 -- # [[ -n 10.0.0.2 ]] 00:21:37.529 11:32:32 nvmf_tcp.nvmf_host.nvmf_multicontroller -- host/multicontroller.sh@102 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b nvme1 -t tcp -a 10.0.0.3 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode2 -i 10.0.0.1 00:21:37.529 11:32:32 nvmf_tcp.nvmf_host.nvmf_multicontroller -- common/autotest_common.sh@561 -- # xtrace_disable 00:21:37.529 11:32:32 nvmf_tcp.nvmf_host.nvmf_multicontroller -- common/autotest_common.sh@10 -- # set +x 00:21:37.529 nvme1n1 00:21:37.529 11:32:32 nvmf_tcp.nvmf_host.nvmf_multicontroller -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:21:37.529 11:32:32 nvmf_tcp.nvmf_host.nvmf_multicontroller -- host/multicontroller.sh@106 -- # rpc_cmd nvmf_subsystem_get_qpairs nqn.2016-06.io.spdk:cnode2 00:21:37.529 11:32:32 nvmf_tcp.nvmf_host.nvmf_multicontroller -- host/multicontroller.sh@106 -- # jq -r '.[].peer_address.traddr' 00:21:37.529 11:32:32 nvmf_tcp.nvmf_host.nvmf_multicontroller -- common/autotest_common.sh@561 -- # xtrace_disable 00:21:37.529 11:32:32 nvmf_tcp.nvmf_host.nvmf_multicontroller -- common/autotest_common.sh@10 -- # set +x 00:21:37.529 11:32:32 nvmf_tcp.nvmf_host.nvmf_multicontroller -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:21:37.529 11:32:32 nvmf_tcp.nvmf_host.nvmf_multicontroller -- host/multicontroller.sh@106 -- # [[ 10.0.0.1 == \1\0\.\0\.\0\.\1 ]] 00:21:37.529 11:32:32 nvmf_tcp.nvmf_host.nvmf_multicontroller -- host/multicontroller.sh@107 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_detach_controller nvme1 00:21:37.529 11:32:32 nvmf_tcp.nvmf_host.nvmf_multicontroller -- common/autotest_common.sh@561 -- # xtrace_disable 00:21:37.529 11:32:32 nvmf_tcp.nvmf_host.nvmf_multicontroller -- common/autotest_common.sh@10 -- # set +x 00:21:37.529 11:32:32 nvmf_tcp.nvmf_host.nvmf_multicontroller -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:21:37.529 11:32:32 nvmf_tcp.nvmf_host.nvmf_multicontroller -- host/multicontroller.sh@109 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b nvme1 -t tcp -a 10.0.0.3 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode2 -i 10.0.0.2 00:21:37.529 11:32:32 nvmf_tcp.nvmf_host.nvmf_multicontroller -- common/autotest_common.sh@561 -- # xtrace_disable 00:21:37.529 11:32:32 nvmf_tcp.nvmf_host.nvmf_multicontroller -- common/autotest_common.sh@10 -- # set +x 00:21:37.529 nvme1n1 00:21:37.529 11:32:32 nvmf_tcp.nvmf_host.nvmf_multicontroller -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:21:37.529 11:32:32 nvmf_tcp.nvmf_host.nvmf_multicontroller -- host/multicontroller.sh@113 -- # rpc_cmd nvmf_subsystem_get_qpairs nqn.2016-06.io.spdk:cnode2 00:21:37.529 11:32:32 nvmf_tcp.nvmf_host.nvmf_multicontroller -- host/multicontroller.sh@113 -- # jq -r '.[].peer_address.traddr' 00:21:37.529 11:32:32 nvmf_tcp.nvmf_host.nvmf_multicontroller -- common/autotest_common.sh@561 -- # xtrace_disable 00:21:37.529 11:32:32 nvmf_tcp.nvmf_host.nvmf_multicontroller -- common/autotest_common.sh@10 -- # set +x 00:21:37.530 11:32:32 nvmf_tcp.nvmf_host.nvmf_multicontroller -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:21:37.530 11:32:32 nvmf_tcp.nvmf_host.nvmf_multicontroller -- host/multicontroller.sh@113 -- # [[ 10.0.0.2 == \1\0\.\0\.\0\.\2 ]] 00:21:37.530 11:32:32 nvmf_tcp.nvmf_host.nvmf_multicontroller -- host/multicontroller.sh@116 -- # killprocess 86773 00:21:37.530 11:32:32 nvmf_tcp.nvmf_host.nvmf_multicontroller -- common/autotest_common.sh@950 -- # '[' -z 86773 ']' 00:21:37.530 11:32:32 nvmf_tcp.nvmf_host.nvmf_multicontroller -- common/autotest_common.sh@954 -- # kill -0 86773 00:21:37.530 11:32:32 nvmf_tcp.nvmf_host.nvmf_multicontroller -- common/autotest_common.sh@955 -- # uname 00:21:37.530 11:32:32 nvmf_tcp.nvmf_host.nvmf_multicontroller -- common/autotest_common.sh@955 -- # '[' Linux = Linux ']' 00:21:37.530 11:32:32 nvmf_tcp.nvmf_host.nvmf_multicontroller -- common/autotest_common.sh@956 -- # ps --no-headers -o comm= 86773 00:21:37.530 killing process with pid 86773 00:21:37.530 11:32:33 nvmf_tcp.nvmf_host.nvmf_multicontroller -- common/autotest_common.sh@956 -- # process_name=reactor_0 00:21:37.530 11:32:33 nvmf_tcp.nvmf_host.nvmf_multicontroller -- common/autotest_common.sh@960 -- # '[' reactor_0 = sudo ']' 00:21:37.530 11:32:33 nvmf_tcp.nvmf_host.nvmf_multicontroller -- common/autotest_common.sh@968 -- # echo 'killing process with pid 86773' 00:21:37.530 11:32:33 nvmf_tcp.nvmf_host.nvmf_multicontroller -- common/autotest_common.sh@969 -- # kill 86773 00:21:37.530 11:32:33 nvmf_tcp.nvmf_host.nvmf_multicontroller -- common/autotest_common.sh@974 -- # wait 86773 00:21:37.788 11:32:33 nvmf_tcp.nvmf_host.nvmf_multicontroller -- host/multicontroller.sh@118 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:21:37.788 11:32:33 nvmf_tcp.nvmf_host.nvmf_multicontroller -- common/autotest_common.sh@561 -- # xtrace_disable 00:21:37.788 11:32:33 nvmf_tcp.nvmf_host.nvmf_multicontroller -- common/autotest_common.sh@10 -- # set +x 00:21:37.788 11:32:33 nvmf_tcp.nvmf_host.nvmf_multicontroller -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:21:37.788 11:32:33 nvmf_tcp.nvmf_host.nvmf_multicontroller -- host/multicontroller.sh@119 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode2 00:21:37.788 11:32:33 nvmf_tcp.nvmf_host.nvmf_multicontroller -- common/autotest_common.sh@561 -- # xtrace_disable 00:21:37.788 11:32:33 nvmf_tcp.nvmf_host.nvmf_multicontroller -- common/autotest_common.sh@10 -- # set +x 00:21:37.788 11:32:33 nvmf_tcp.nvmf_host.nvmf_multicontroller -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:21:37.788 11:32:33 nvmf_tcp.nvmf_host.nvmf_multicontroller -- host/multicontroller.sh@121 -- # trap - SIGINT SIGTERM EXIT 00:21:37.788 11:32:33 nvmf_tcp.nvmf_host.nvmf_multicontroller -- host/multicontroller.sh@123 -- # pap /home/vagrant/spdk_repo/spdk/test/nvmf/host/try.txt 00:21:37.788 11:32:33 nvmf_tcp.nvmf_host.nvmf_multicontroller -- common/autotest_common.sh@1597 -- # read -r file 00:21:37.788 11:32:33 nvmf_tcp.nvmf_host.nvmf_multicontroller -- common/autotest_common.sh@1596 -- # find /home/vagrant/spdk_repo/spdk/test/nvmf/host/try.txt -type f 00:21:37.788 11:32:33 nvmf_tcp.nvmf_host.nvmf_multicontroller -- common/autotest_common.sh@1596 -- # sort -u 00:21:37.788 11:32:33 nvmf_tcp.nvmf_host.nvmf_multicontroller -- common/autotest_common.sh@1598 -- # cat 00:21:37.788 --- /home/vagrant/spdk_repo/spdk/test/nvmf/host/try.txt --- 00:21:37.788 [2024-10-07 11:32:30.064407] Starting SPDK v25.01-pre git sha1 2a4f56c54 / DPDK 24.03.0 initialization... 00:21:37.788 [2024-10-07 11:32:30.064510] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --iova-mode=pa --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid86773 ] 00:21:37.788 [2024-10-07 11:32:30.201719] app.c: 917:spdk_app_start: *NOTICE*: Total cores available: 1 00:21:37.788 [2024-10-07 11:32:30.341706] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 0 00:21:37.788 [2024-10-07 11:32:31.493424] bdev.c:4701:bdev_name_add: *ERROR*: Bdev name 492ea2f4-ee04-478d-a7bf-6bb0e298c5aa already exists 00:21:37.788 [2024-10-07 11:32:31.493484] bdev.c:7846:bdev_register: *ERROR*: Unable to add uuid:492ea2f4-ee04-478d-a7bf-6bb0e298c5aa alias for bdev NVMe1n1 00:21:37.788 [2024-10-07 11:32:31.493503] bdev_nvme.c:4483:nvme_bdev_create: *ERROR*: spdk_bdev_register() failed 00:21:37.788 Running I/O for 1 seconds... 00:21:37.788 18421.00 IOPS, 71.96 MiB/s 00:21:37.788 Latency(us) 00:21:37.788 [2024-10-07T11:32:33.311Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:21:37.788 Job: NVMe0n1 (Core Mask 0x1, workload: write, depth: 128, IO size: 4096) 00:21:37.788 NVMe0n1 : 1.01 18486.02 72.21 0.00 0.00 6913.14 2174.60 14596.65 00:21:37.788 [2024-10-07T11:32:33.311Z] =================================================================================================================== 00:21:37.788 [2024-10-07T11:32:33.311Z] Total : 18486.02 72.21 0.00 0.00 6913.14 2174.60 14596.65 00:21:37.788 Received shutdown signal, test time was about 1.000000 seconds 00:21:37.788 00:21:37.789 Latency(us) 00:21:37.789 [2024-10-07T11:32:33.312Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:21:37.789 [2024-10-07T11:32:33.312Z] =================================================================================================================== 00:21:37.789 [2024-10-07T11:32:33.312Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:21:37.789 --- /home/vagrant/spdk_repo/spdk/test/nvmf/host/try.txt --- 00:21:37.789 11:32:33 nvmf_tcp.nvmf_host.nvmf_multicontroller -- common/autotest_common.sh@1603 -- # rm -f /home/vagrant/spdk_repo/spdk/test/nvmf/host/try.txt 00:21:37.789 11:32:33 nvmf_tcp.nvmf_host.nvmf_multicontroller -- common/autotest_common.sh@1597 -- # read -r file 00:21:37.789 11:32:33 nvmf_tcp.nvmf_host.nvmf_multicontroller -- host/multicontroller.sh@124 -- # nvmftestfini 00:21:37.789 11:32:33 nvmf_tcp.nvmf_host.nvmf_multicontroller -- nvmf/common.sh@514 -- # nvmfcleanup 00:21:37.789 11:32:33 nvmf_tcp.nvmf_host.nvmf_multicontroller -- nvmf/common.sh@121 -- # sync 00:21:38.048 11:32:33 nvmf_tcp.nvmf_host.nvmf_multicontroller -- nvmf/common.sh@123 -- # '[' tcp == tcp ']' 00:21:38.048 11:32:33 nvmf_tcp.nvmf_host.nvmf_multicontroller -- nvmf/common.sh@124 -- # set +e 00:21:38.048 11:32:33 nvmf_tcp.nvmf_host.nvmf_multicontroller -- nvmf/common.sh@125 -- # for i in {1..20} 00:21:38.048 11:32:33 nvmf_tcp.nvmf_host.nvmf_multicontroller -- nvmf/common.sh@126 -- # modprobe -v -r nvme-tcp 00:21:38.048 rmmod nvme_tcp 00:21:38.048 rmmod nvme_fabrics 00:21:38.048 rmmod nvme_keyring 00:21:38.048 11:32:33 nvmf_tcp.nvmf_host.nvmf_multicontroller -- nvmf/common.sh@127 -- # modprobe -v -r nvme-fabrics 00:21:38.048 11:32:33 nvmf_tcp.nvmf_host.nvmf_multicontroller -- nvmf/common.sh@128 -- # set -e 00:21:38.048 11:32:33 nvmf_tcp.nvmf_host.nvmf_multicontroller -- nvmf/common.sh@129 -- # return 0 00:21:38.048 11:32:33 nvmf_tcp.nvmf_host.nvmf_multicontroller -- nvmf/common.sh@515 -- # '[' -n 86721 ']' 00:21:38.048 11:32:33 nvmf_tcp.nvmf_host.nvmf_multicontroller -- nvmf/common.sh@516 -- # killprocess 86721 00:21:38.048 11:32:33 nvmf_tcp.nvmf_host.nvmf_multicontroller -- common/autotest_common.sh@950 -- # '[' -z 86721 ']' 00:21:38.048 11:32:33 nvmf_tcp.nvmf_host.nvmf_multicontroller -- common/autotest_common.sh@954 -- # kill -0 86721 00:21:38.048 11:32:33 nvmf_tcp.nvmf_host.nvmf_multicontroller -- common/autotest_common.sh@955 -- # uname 00:21:38.048 11:32:33 nvmf_tcp.nvmf_host.nvmf_multicontroller -- common/autotest_common.sh@955 -- # '[' Linux = Linux ']' 00:21:38.048 11:32:33 nvmf_tcp.nvmf_host.nvmf_multicontroller -- common/autotest_common.sh@956 -- # ps --no-headers -o comm= 86721 00:21:38.048 11:32:33 nvmf_tcp.nvmf_host.nvmf_multicontroller -- common/autotest_common.sh@956 -- # process_name=reactor_1 00:21:38.048 killing process with pid 86721 00:21:38.048 11:32:33 nvmf_tcp.nvmf_host.nvmf_multicontroller -- common/autotest_common.sh@960 -- # '[' reactor_1 = sudo ']' 00:21:38.048 11:32:33 nvmf_tcp.nvmf_host.nvmf_multicontroller -- common/autotest_common.sh@968 -- # echo 'killing process with pid 86721' 00:21:38.048 11:32:33 nvmf_tcp.nvmf_host.nvmf_multicontroller -- common/autotest_common.sh@969 -- # kill 86721 00:21:38.048 11:32:33 nvmf_tcp.nvmf_host.nvmf_multicontroller -- common/autotest_common.sh@974 -- # wait 86721 00:21:38.306 11:32:33 nvmf_tcp.nvmf_host.nvmf_multicontroller -- nvmf/common.sh@518 -- # '[' '' == iso ']' 00:21:38.306 11:32:33 nvmf_tcp.nvmf_host.nvmf_multicontroller -- nvmf/common.sh@521 -- # [[ tcp == \t\c\p ]] 00:21:38.306 11:32:33 nvmf_tcp.nvmf_host.nvmf_multicontroller -- nvmf/common.sh@522 -- # nvmf_tcp_fini 00:21:38.306 11:32:33 nvmf_tcp.nvmf_host.nvmf_multicontroller -- nvmf/common.sh@297 -- # iptr 00:21:38.306 11:32:33 nvmf_tcp.nvmf_host.nvmf_multicontroller -- nvmf/common.sh@789 -- # iptables-save 00:21:38.306 11:32:33 nvmf_tcp.nvmf_host.nvmf_multicontroller -- nvmf/common.sh@789 -- # iptables-restore 00:21:38.306 11:32:33 nvmf_tcp.nvmf_host.nvmf_multicontroller -- nvmf/common.sh@789 -- # grep -v SPDK_NVMF 00:21:38.306 11:32:33 nvmf_tcp.nvmf_host.nvmf_multicontroller -- nvmf/common.sh@298 -- # [[ nvmf_tgt_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s\_\s\p\d\k ]] 00:21:38.306 11:32:33 nvmf_tcp.nvmf_host.nvmf_multicontroller -- nvmf/common.sh@299 -- # nvmf_veth_fini 00:21:38.306 11:32:33 nvmf_tcp.nvmf_host.nvmf_multicontroller -- nvmf/common.sh@233 -- # ip link set nvmf_init_br nomaster 00:21:38.306 11:32:33 nvmf_tcp.nvmf_host.nvmf_multicontroller -- nvmf/common.sh@234 -- # ip link set nvmf_init_br2 nomaster 00:21:38.306 11:32:33 nvmf_tcp.nvmf_host.nvmf_multicontroller -- nvmf/common.sh@235 -- # ip link set nvmf_tgt_br nomaster 00:21:38.306 11:32:33 nvmf_tcp.nvmf_host.nvmf_multicontroller -- nvmf/common.sh@236 -- # ip link set nvmf_tgt_br2 nomaster 00:21:38.306 11:32:33 nvmf_tcp.nvmf_host.nvmf_multicontroller -- nvmf/common.sh@237 -- # ip link set nvmf_init_br down 00:21:38.306 11:32:33 nvmf_tcp.nvmf_host.nvmf_multicontroller -- nvmf/common.sh@238 -- # ip link set nvmf_init_br2 down 00:21:38.306 11:32:33 nvmf_tcp.nvmf_host.nvmf_multicontroller -- nvmf/common.sh@239 -- # ip link set nvmf_tgt_br down 00:21:38.306 11:32:33 nvmf_tcp.nvmf_host.nvmf_multicontroller -- nvmf/common.sh@240 -- # ip link set nvmf_tgt_br2 down 00:21:38.306 11:32:33 nvmf_tcp.nvmf_host.nvmf_multicontroller -- nvmf/common.sh@241 -- # ip link delete nvmf_br type bridge 00:21:38.564 11:32:33 nvmf_tcp.nvmf_host.nvmf_multicontroller -- nvmf/common.sh@242 -- # ip link delete nvmf_init_if 00:21:38.564 11:32:33 nvmf_tcp.nvmf_host.nvmf_multicontroller -- nvmf/common.sh@243 -- # ip link delete nvmf_init_if2 00:21:38.564 11:32:33 nvmf_tcp.nvmf_host.nvmf_multicontroller -- nvmf/common.sh@244 -- # ip netns exec nvmf_tgt_ns_spdk ip link delete nvmf_tgt_if 00:21:38.564 11:32:33 nvmf_tcp.nvmf_host.nvmf_multicontroller -- nvmf/common.sh@245 -- # ip netns exec nvmf_tgt_ns_spdk ip link delete nvmf_tgt_if2 00:21:38.564 11:32:33 nvmf_tcp.nvmf_host.nvmf_multicontroller -- nvmf/common.sh@246 -- # remove_spdk_ns 00:21:38.564 11:32:33 nvmf_tcp.nvmf_host.nvmf_multicontroller -- nvmf/common.sh@654 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:21:38.564 11:32:33 nvmf_tcp.nvmf_host.nvmf_multicontroller -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 15> /dev/null' 00:21:38.564 11:32:33 nvmf_tcp.nvmf_host.nvmf_multicontroller -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:21:38.564 11:32:33 nvmf_tcp.nvmf_host.nvmf_multicontroller -- nvmf/common.sh@300 -- # return 0 00:21:38.564 00:21:38.564 real 0m5.964s 00:21:38.564 user 0m18.211s 00:21:38.564 sys 0m1.323s 00:21:38.564 11:32:33 nvmf_tcp.nvmf_host.nvmf_multicontroller -- common/autotest_common.sh@1126 -- # xtrace_disable 00:21:38.564 11:32:33 nvmf_tcp.nvmf_host.nvmf_multicontroller -- common/autotest_common.sh@10 -- # set +x 00:21:38.564 ************************************ 00:21:38.564 END TEST nvmf_multicontroller 00:21:38.564 ************************************ 00:21:38.564 11:32:34 nvmf_tcp.nvmf_host -- nvmf/nvmf_host.sh@17 -- # run_test nvmf_aer /home/vagrant/spdk_repo/spdk/test/nvmf/host/aer.sh --transport=tcp 00:21:38.564 11:32:34 nvmf_tcp.nvmf_host -- common/autotest_common.sh@1101 -- # '[' 3 -le 1 ']' 00:21:38.565 11:32:34 nvmf_tcp.nvmf_host -- common/autotest_common.sh@1107 -- # xtrace_disable 00:21:38.565 11:32:34 nvmf_tcp.nvmf_host -- common/autotest_common.sh@10 -- # set +x 00:21:38.565 ************************************ 00:21:38.565 START TEST nvmf_aer 00:21:38.565 ************************************ 00:21:38.565 11:32:34 nvmf_tcp.nvmf_host.nvmf_aer -- common/autotest_common.sh@1125 -- # /home/vagrant/spdk_repo/spdk/test/nvmf/host/aer.sh --transport=tcp 00:21:38.824 * Looking for test storage... 00:21:38.824 * Found test storage at /home/vagrant/spdk_repo/spdk/test/nvmf/host 00:21:38.824 11:32:34 nvmf_tcp.nvmf_host.nvmf_aer -- common/autotest_common.sh@1680 -- # [[ y == y ]] 00:21:38.824 11:32:34 nvmf_tcp.nvmf_host.nvmf_aer -- common/autotest_common.sh@1681 -- # lcov --version 00:21:38.824 11:32:34 nvmf_tcp.nvmf_host.nvmf_aer -- common/autotest_common.sh@1681 -- # awk '{print $NF}' 00:21:38.824 11:32:34 nvmf_tcp.nvmf_host.nvmf_aer -- common/autotest_common.sh@1681 -- # lt 1.15 2 00:21:38.824 11:32:34 nvmf_tcp.nvmf_host.nvmf_aer -- scripts/common.sh@373 -- # cmp_versions 1.15 '<' 2 00:21:38.824 11:32:34 nvmf_tcp.nvmf_host.nvmf_aer -- scripts/common.sh@333 -- # local ver1 ver1_l 00:21:38.824 11:32:34 nvmf_tcp.nvmf_host.nvmf_aer -- scripts/common.sh@334 -- # local ver2 ver2_l 00:21:38.824 11:32:34 nvmf_tcp.nvmf_host.nvmf_aer -- scripts/common.sh@336 -- # IFS=.-: 00:21:38.824 11:32:34 nvmf_tcp.nvmf_host.nvmf_aer -- scripts/common.sh@336 -- # read -ra ver1 00:21:38.824 11:32:34 nvmf_tcp.nvmf_host.nvmf_aer -- scripts/common.sh@337 -- # IFS=.-: 00:21:38.824 11:32:34 nvmf_tcp.nvmf_host.nvmf_aer -- scripts/common.sh@337 -- # read -ra ver2 00:21:38.824 11:32:34 nvmf_tcp.nvmf_host.nvmf_aer -- scripts/common.sh@338 -- # local 'op=<' 00:21:38.824 11:32:34 nvmf_tcp.nvmf_host.nvmf_aer -- scripts/common.sh@340 -- # ver1_l=2 00:21:38.824 11:32:34 nvmf_tcp.nvmf_host.nvmf_aer -- scripts/common.sh@341 -- # ver2_l=1 00:21:38.824 11:32:34 nvmf_tcp.nvmf_host.nvmf_aer -- scripts/common.sh@343 -- # local lt=0 gt=0 eq=0 v 00:21:38.824 11:32:34 nvmf_tcp.nvmf_host.nvmf_aer -- scripts/common.sh@344 -- # case "$op" in 00:21:38.824 11:32:34 nvmf_tcp.nvmf_host.nvmf_aer -- scripts/common.sh@345 -- # : 1 00:21:38.824 11:32:34 nvmf_tcp.nvmf_host.nvmf_aer -- scripts/common.sh@364 -- # (( v = 0 )) 00:21:38.824 11:32:34 nvmf_tcp.nvmf_host.nvmf_aer -- scripts/common.sh@364 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:21:38.824 11:32:34 nvmf_tcp.nvmf_host.nvmf_aer -- scripts/common.sh@365 -- # decimal 1 00:21:38.824 11:32:34 nvmf_tcp.nvmf_host.nvmf_aer -- scripts/common.sh@353 -- # local d=1 00:21:38.824 11:32:34 nvmf_tcp.nvmf_host.nvmf_aer -- scripts/common.sh@354 -- # [[ 1 =~ ^[0-9]+$ ]] 00:21:38.824 11:32:34 nvmf_tcp.nvmf_host.nvmf_aer -- scripts/common.sh@355 -- # echo 1 00:21:38.824 11:32:34 nvmf_tcp.nvmf_host.nvmf_aer -- scripts/common.sh@365 -- # ver1[v]=1 00:21:38.824 11:32:34 nvmf_tcp.nvmf_host.nvmf_aer -- scripts/common.sh@366 -- # decimal 2 00:21:38.824 11:32:34 nvmf_tcp.nvmf_host.nvmf_aer -- scripts/common.sh@353 -- # local d=2 00:21:38.824 11:32:34 nvmf_tcp.nvmf_host.nvmf_aer -- scripts/common.sh@354 -- # [[ 2 =~ ^[0-9]+$ ]] 00:21:38.824 11:32:34 nvmf_tcp.nvmf_host.nvmf_aer -- scripts/common.sh@355 -- # echo 2 00:21:38.824 11:32:34 nvmf_tcp.nvmf_host.nvmf_aer -- scripts/common.sh@366 -- # ver2[v]=2 00:21:38.824 11:32:34 nvmf_tcp.nvmf_host.nvmf_aer -- scripts/common.sh@367 -- # (( ver1[v] > ver2[v] )) 00:21:38.824 11:32:34 nvmf_tcp.nvmf_host.nvmf_aer -- scripts/common.sh@368 -- # (( ver1[v] < ver2[v] )) 00:21:38.824 11:32:34 nvmf_tcp.nvmf_host.nvmf_aer -- scripts/common.sh@368 -- # return 0 00:21:38.824 11:32:34 nvmf_tcp.nvmf_host.nvmf_aer -- common/autotest_common.sh@1682 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:21:38.824 11:32:34 nvmf_tcp.nvmf_host.nvmf_aer -- common/autotest_common.sh@1694 -- # export 'LCOV_OPTS= 00:21:38.824 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:21:38.824 --rc genhtml_branch_coverage=1 00:21:38.824 --rc genhtml_function_coverage=1 00:21:38.824 --rc genhtml_legend=1 00:21:38.824 --rc geninfo_all_blocks=1 00:21:38.824 --rc geninfo_unexecuted_blocks=1 00:21:38.824 00:21:38.824 ' 00:21:38.824 11:32:34 nvmf_tcp.nvmf_host.nvmf_aer -- common/autotest_common.sh@1694 -- # LCOV_OPTS=' 00:21:38.824 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:21:38.824 --rc genhtml_branch_coverage=1 00:21:38.824 --rc genhtml_function_coverage=1 00:21:38.824 --rc genhtml_legend=1 00:21:38.824 --rc geninfo_all_blocks=1 00:21:38.824 --rc geninfo_unexecuted_blocks=1 00:21:38.824 00:21:38.824 ' 00:21:38.824 11:32:34 nvmf_tcp.nvmf_host.nvmf_aer -- common/autotest_common.sh@1695 -- # export 'LCOV=lcov 00:21:38.824 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:21:38.824 --rc genhtml_branch_coverage=1 00:21:38.824 --rc genhtml_function_coverage=1 00:21:38.824 --rc genhtml_legend=1 00:21:38.824 --rc geninfo_all_blocks=1 00:21:38.824 --rc geninfo_unexecuted_blocks=1 00:21:38.824 00:21:38.824 ' 00:21:38.824 11:32:34 nvmf_tcp.nvmf_host.nvmf_aer -- common/autotest_common.sh@1695 -- # LCOV='lcov 00:21:38.824 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:21:38.824 --rc genhtml_branch_coverage=1 00:21:38.824 --rc genhtml_function_coverage=1 00:21:38.824 --rc genhtml_legend=1 00:21:38.824 --rc geninfo_all_blocks=1 00:21:38.824 --rc geninfo_unexecuted_blocks=1 00:21:38.824 00:21:38.824 ' 00:21:38.824 11:32:34 nvmf_tcp.nvmf_host.nvmf_aer -- host/aer.sh@9 -- # source /home/vagrant/spdk_repo/spdk/test/nvmf/common.sh 00:21:38.824 11:32:34 nvmf_tcp.nvmf_host.nvmf_aer -- nvmf/common.sh@7 -- # uname -s 00:21:38.824 11:32:34 nvmf_tcp.nvmf_host.nvmf_aer -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:21:38.824 11:32:34 nvmf_tcp.nvmf_host.nvmf_aer -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:21:38.824 11:32:34 nvmf_tcp.nvmf_host.nvmf_aer -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:21:38.824 11:32:34 nvmf_tcp.nvmf_host.nvmf_aer -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:21:38.824 11:32:34 nvmf_tcp.nvmf_host.nvmf_aer -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:21:38.824 11:32:34 nvmf_tcp.nvmf_host.nvmf_aer -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:21:38.824 11:32:34 nvmf_tcp.nvmf_host.nvmf_aer -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:21:38.824 11:32:34 nvmf_tcp.nvmf_host.nvmf_aer -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:21:38.824 11:32:34 nvmf_tcp.nvmf_host.nvmf_aer -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:21:38.824 11:32:34 nvmf_tcp.nvmf_host.nvmf_aer -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:21:38.824 11:32:34 nvmf_tcp.nvmf_host.nvmf_aer -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:c758a4ed-f09f-4c82-9afb-3d096f035464 00:21:38.824 11:32:34 nvmf_tcp.nvmf_host.nvmf_aer -- nvmf/common.sh@18 -- # NVME_HOSTID=c758a4ed-f09f-4c82-9afb-3d096f035464 00:21:38.824 11:32:34 nvmf_tcp.nvmf_host.nvmf_aer -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:21:38.824 11:32:34 nvmf_tcp.nvmf_host.nvmf_aer -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:21:38.824 11:32:34 nvmf_tcp.nvmf_host.nvmf_aer -- nvmf/common.sh@21 -- # NET_TYPE=virt 00:21:38.824 11:32:34 nvmf_tcp.nvmf_host.nvmf_aer -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:21:38.824 11:32:34 nvmf_tcp.nvmf_host.nvmf_aer -- nvmf/common.sh@49 -- # source /home/vagrant/spdk_repo/spdk/scripts/common.sh 00:21:38.824 11:32:34 nvmf_tcp.nvmf_host.nvmf_aer -- scripts/common.sh@15 -- # shopt -s extglob 00:21:38.824 11:32:34 nvmf_tcp.nvmf_host.nvmf_aer -- scripts/common.sh@544 -- # [[ -e /bin/wpdk_common.sh ]] 00:21:38.824 11:32:34 nvmf_tcp.nvmf_host.nvmf_aer -- scripts/common.sh@552 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:21:38.824 11:32:34 nvmf_tcp.nvmf_host.nvmf_aer -- scripts/common.sh@553 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:21:38.824 11:32:34 nvmf_tcp.nvmf_host.nvmf_aer -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:21:38.824 11:32:34 nvmf_tcp.nvmf_host.nvmf_aer -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:21:38.825 11:32:34 nvmf_tcp.nvmf_host.nvmf_aer -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:21:38.825 11:32:34 nvmf_tcp.nvmf_host.nvmf_aer -- paths/export.sh@5 -- # export PATH 00:21:38.825 11:32:34 nvmf_tcp.nvmf_host.nvmf_aer -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:21:38.825 11:32:34 nvmf_tcp.nvmf_host.nvmf_aer -- nvmf/common.sh@51 -- # : 0 00:21:38.825 11:32:34 nvmf_tcp.nvmf_host.nvmf_aer -- nvmf/common.sh@52 -- # export NVMF_APP_SHM_ID 00:21:38.825 11:32:34 nvmf_tcp.nvmf_host.nvmf_aer -- nvmf/common.sh@53 -- # build_nvmf_app_args 00:21:38.825 11:32:34 nvmf_tcp.nvmf_host.nvmf_aer -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:21:38.825 11:32:34 nvmf_tcp.nvmf_host.nvmf_aer -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:21:38.825 11:32:34 nvmf_tcp.nvmf_host.nvmf_aer -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:21:38.825 11:32:34 nvmf_tcp.nvmf_host.nvmf_aer -- nvmf/common.sh@33 -- # '[' '' -eq 1 ']' 00:21:38.825 /home/vagrant/spdk_repo/spdk/test/nvmf/common.sh: line 33: [: : integer expression expected 00:21:38.825 11:32:34 nvmf_tcp.nvmf_host.nvmf_aer -- nvmf/common.sh@37 -- # '[' -n '' ']' 00:21:38.825 11:32:34 nvmf_tcp.nvmf_host.nvmf_aer -- nvmf/common.sh@39 -- # '[' 0 -eq 1 ']' 00:21:38.825 11:32:34 nvmf_tcp.nvmf_host.nvmf_aer -- nvmf/common.sh@55 -- # have_pci_nics=0 00:21:38.825 11:32:34 nvmf_tcp.nvmf_host.nvmf_aer -- host/aer.sh@11 -- # nvmftestinit 00:21:38.825 11:32:34 nvmf_tcp.nvmf_host.nvmf_aer -- nvmf/common.sh@467 -- # '[' -z tcp ']' 00:21:38.825 11:32:34 nvmf_tcp.nvmf_host.nvmf_aer -- nvmf/common.sh@472 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:21:38.825 11:32:34 nvmf_tcp.nvmf_host.nvmf_aer -- nvmf/common.sh@474 -- # prepare_net_devs 00:21:38.825 11:32:34 nvmf_tcp.nvmf_host.nvmf_aer -- nvmf/common.sh@436 -- # local -g is_hw=no 00:21:38.825 11:32:34 nvmf_tcp.nvmf_host.nvmf_aer -- nvmf/common.sh@438 -- # remove_spdk_ns 00:21:38.825 11:32:34 nvmf_tcp.nvmf_host.nvmf_aer -- nvmf/common.sh@654 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:21:38.825 11:32:34 nvmf_tcp.nvmf_host.nvmf_aer -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 15> /dev/null' 00:21:38.825 11:32:34 nvmf_tcp.nvmf_host.nvmf_aer -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:21:38.825 11:32:34 nvmf_tcp.nvmf_host.nvmf_aer -- nvmf/common.sh@440 -- # [[ virt != virt ]] 00:21:38.825 11:32:34 nvmf_tcp.nvmf_host.nvmf_aer -- nvmf/common.sh@442 -- # [[ no == yes ]] 00:21:38.825 11:32:34 nvmf_tcp.nvmf_host.nvmf_aer -- nvmf/common.sh@449 -- # [[ virt == phy ]] 00:21:38.825 11:32:34 nvmf_tcp.nvmf_host.nvmf_aer -- nvmf/common.sh@452 -- # [[ virt == phy-fallback ]] 00:21:38.825 11:32:34 nvmf_tcp.nvmf_host.nvmf_aer -- nvmf/common.sh@457 -- # [[ tcp == tcp ]] 00:21:38.825 11:32:34 nvmf_tcp.nvmf_host.nvmf_aer -- nvmf/common.sh@458 -- # nvmf_veth_init 00:21:38.825 11:32:34 nvmf_tcp.nvmf_host.nvmf_aer -- nvmf/common.sh@145 -- # NVMF_FIRST_INITIATOR_IP=10.0.0.1 00:21:38.825 11:32:34 nvmf_tcp.nvmf_host.nvmf_aer -- nvmf/common.sh@146 -- # NVMF_SECOND_INITIATOR_IP=10.0.0.2 00:21:38.825 11:32:34 nvmf_tcp.nvmf_host.nvmf_aer -- nvmf/common.sh@147 -- # NVMF_FIRST_TARGET_IP=10.0.0.3 00:21:38.825 11:32:34 nvmf_tcp.nvmf_host.nvmf_aer -- nvmf/common.sh@148 -- # NVMF_SECOND_TARGET_IP=10.0.0.4 00:21:38.825 11:32:34 nvmf_tcp.nvmf_host.nvmf_aer -- nvmf/common.sh@149 -- # NVMF_INITIATOR_IP=10.0.0.1 00:21:38.825 11:32:34 nvmf_tcp.nvmf_host.nvmf_aer -- nvmf/common.sh@150 -- # NVMF_BRIDGE=nvmf_br 00:21:38.825 11:32:34 nvmf_tcp.nvmf_host.nvmf_aer -- nvmf/common.sh@151 -- # NVMF_INITIATOR_INTERFACE=nvmf_init_if 00:21:38.825 11:32:34 nvmf_tcp.nvmf_host.nvmf_aer -- nvmf/common.sh@152 -- # NVMF_INITIATOR_INTERFACE2=nvmf_init_if2 00:21:38.825 11:32:34 nvmf_tcp.nvmf_host.nvmf_aer -- nvmf/common.sh@153 -- # NVMF_INITIATOR_BRIDGE=nvmf_init_br 00:21:38.825 11:32:34 nvmf_tcp.nvmf_host.nvmf_aer -- nvmf/common.sh@154 -- # NVMF_INITIATOR_BRIDGE2=nvmf_init_br2 00:21:38.825 11:32:34 nvmf_tcp.nvmf_host.nvmf_aer -- nvmf/common.sh@155 -- # NVMF_TARGET_NAMESPACE=nvmf_tgt_ns_spdk 00:21:38.825 11:32:34 nvmf_tcp.nvmf_host.nvmf_aer -- nvmf/common.sh@156 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:21:38.825 11:32:34 nvmf_tcp.nvmf_host.nvmf_aer -- nvmf/common.sh@157 -- # NVMF_TARGET_INTERFACE=nvmf_tgt_if 00:21:38.825 11:32:34 nvmf_tcp.nvmf_host.nvmf_aer -- nvmf/common.sh@158 -- # NVMF_TARGET_INTERFACE2=nvmf_tgt_if2 00:21:38.825 11:32:34 nvmf_tcp.nvmf_host.nvmf_aer -- nvmf/common.sh@159 -- # NVMF_TARGET_BRIDGE=nvmf_tgt_br 00:21:38.825 11:32:34 nvmf_tcp.nvmf_host.nvmf_aer -- nvmf/common.sh@160 -- # NVMF_TARGET_BRIDGE2=nvmf_tgt_br2 00:21:38.825 11:32:34 nvmf_tcp.nvmf_host.nvmf_aer -- nvmf/common.sh@162 -- # ip link set nvmf_init_br nomaster 00:21:38.825 Cannot find device "nvmf_init_br" 00:21:38.825 11:32:34 nvmf_tcp.nvmf_host.nvmf_aer -- nvmf/common.sh@162 -- # true 00:21:38.825 11:32:34 nvmf_tcp.nvmf_host.nvmf_aer -- nvmf/common.sh@163 -- # ip link set nvmf_init_br2 nomaster 00:21:38.825 Cannot find device "nvmf_init_br2" 00:21:38.825 11:32:34 nvmf_tcp.nvmf_host.nvmf_aer -- nvmf/common.sh@163 -- # true 00:21:38.825 11:32:34 nvmf_tcp.nvmf_host.nvmf_aer -- nvmf/common.sh@164 -- # ip link set nvmf_tgt_br nomaster 00:21:39.083 Cannot find device "nvmf_tgt_br" 00:21:39.083 11:32:34 nvmf_tcp.nvmf_host.nvmf_aer -- nvmf/common.sh@164 -- # true 00:21:39.083 11:32:34 nvmf_tcp.nvmf_host.nvmf_aer -- nvmf/common.sh@165 -- # ip link set nvmf_tgt_br2 nomaster 00:21:39.083 Cannot find device "nvmf_tgt_br2" 00:21:39.083 11:32:34 nvmf_tcp.nvmf_host.nvmf_aer -- nvmf/common.sh@165 -- # true 00:21:39.083 11:32:34 nvmf_tcp.nvmf_host.nvmf_aer -- nvmf/common.sh@166 -- # ip link set nvmf_init_br down 00:21:39.083 Cannot find device "nvmf_init_br" 00:21:39.083 11:32:34 nvmf_tcp.nvmf_host.nvmf_aer -- nvmf/common.sh@166 -- # true 00:21:39.083 11:32:34 nvmf_tcp.nvmf_host.nvmf_aer -- nvmf/common.sh@167 -- # ip link set nvmf_init_br2 down 00:21:39.083 Cannot find device "nvmf_init_br2" 00:21:39.083 11:32:34 nvmf_tcp.nvmf_host.nvmf_aer -- nvmf/common.sh@167 -- # true 00:21:39.083 11:32:34 nvmf_tcp.nvmf_host.nvmf_aer -- nvmf/common.sh@168 -- # ip link set nvmf_tgt_br down 00:21:39.083 Cannot find device "nvmf_tgt_br" 00:21:39.083 11:32:34 nvmf_tcp.nvmf_host.nvmf_aer -- nvmf/common.sh@168 -- # true 00:21:39.083 11:32:34 nvmf_tcp.nvmf_host.nvmf_aer -- nvmf/common.sh@169 -- # ip link set nvmf_tgt_br2 down 00:21:39.083 Cannot find device "nvmf_tgt_br2" 00:21:39.083 11:32:34 nvmf_tcp.nvmf_host.nvmf_aer -- nvmf/common.sh@169 -- # true 00:21:39.083 11:32:34 nvmf_tcp.nvmf_host.nvmf_aer -- nvmf/common.sh@170 -- # ip link delete nvmf_br type bridge 00:21:39.083 Cannot find device "nvmf_br" 00:21:39.083 11:32:34 nvmf_tcp.nvmf_host.nvmf_aer -- nvmf/common.sh@170 -- # true 00:21:39.083 11:32:34 nvmf_tcp.nvmf_host.nvmf_aer -- nvmf/common.sh@171 -- # ip link delete nvmf_init_if 00:21:39.083 Cannot find device "nvmf_init_if" 00:21:39.083 11:32:34 nvmf_tcp.nvmf_host.nvmf_aer -- nvmf/common.sh@171 -- # true 00:21:39.083 11:32:34 nvmf_tcp.nvmf_host.nvmf_aer -- nvmf/common.sh@172 -- # ip link delete nvmf_init_if2 00:21:39.083 Cannot find device "nvmf_init_if2" 00:21:39.083 11:32:34 nvmf_tcp.nvmf_host.nvmf_aer -- nvmf/common.sh@172 -- # true 00:21:39.083 11:32:34 nvmf_tcp.nvmf_host.nvmf_aer -- nvmf/common.sh@173 -- # ip netns exec nvmf_tgt_ns_spdk ip link delete nvmf_tgt_if 00:21:39.083 Cannot open network namespace "nvmf_tgt_ns_spdk": No such file or directory 00:21:39.083 11:32:34 nvmf_tcp.nvmf_host.nvmf_aer -- nvmf/common.sh@173 -- # true 00:21:39.083 11:32:34 nvmf_tcp.nvmf_host.nvmf_aer -- nvmf/common.sh@174 -- # ip netns exec nvmf_tgt_ns_spdk ip link delete nvmf_tgt_if2 00:21:39.083 Cannot open network namespace "nvmf_tgt_ns_spdk": No such file or directory 00:21:39.083 11:32:34 nvmf_tcp.nvmf_host.nvmf_aer -- nvmf/common.sh@174 -- # true 00:21:39.083 11:32:34 nvmf_tcp.nvmf_host.nvmf_aer -- nvmf/common.sh@177 -- # ip netns add nvmf_tgt_ns_spdk 00:21:39.083 11:32:34 nvmf_tcp.nvmf_host.nvmf_aer -- nvmf/common.sh@180 -- # ip link add nvmf_init_if type veth peer name nvmf_init_br 00:21:39.083 11:32:34 nvmf_tcp.nvmf_host.nvmf_aer -- nvmf/common.sh@181 -- # ip link add nvmf_init_if2 type veth peer name nvmf_init_br2 00:21:39.083 11:32:34 nvmf_tcp.nvmf_host.nvmf_aer -- nvmf/common.sh@182 -- # ip link add nvmf_tgt_if type veth peer name nvmf_tgt_br 00:21:39.083 11:32:34 nvmf_tcp.nvmf_host.nvmf_aer -- nvmf/common.sh@183 -- # ip link add nvmf_tgt_if2 type veth peer name nvmf_tgt_br2 00:21:39.083 11:32:34 nvmf_tcp.nvmf_host.nvmf_aer -- nvmf/common.sh@186 -- # ip link set nvmf_tgt_if netns nvmf_tgt_ns_spdk 00:21:39.083 11:32:34 nvmf_tcp.nvmf_host.nvmf_aer -- nvmf/common.sh@187 -- # ip link set nvmf_tgt_if2 netns nvmf_tgt_ns_spdk 00:21:39.083 11:32:34 nvmf_tcp.nvmf_host.nvmf_aer -- nvmf/common.sh@190 -- # ip addr add 10.0.0.1/24 dev nvmf_init_if 00:21:39.083 11:32:34 nvmf_tcp.nvmf_host.nvmf_aer -- nvmf/common.sh@191 -- # ip addr add 10.0.0.2/24 dev nvmf_init_if2 00:21:39.083 11:32:34 nvmf_tcp.nvmf_host.nvmf_aer -- nvmf/common.sh@192 -- # ip netns exec nvmf_tgt_ns_spdk ip addr add 10.0.0.3/24 dev nvmf_tgt_if 00:21:39.083 11:32:34 nvmf_tcp.nvmf_host.nvmf_aer -- nvmf/common.sh@193 -- # ip netns exec nvmf_tgt_ns_spdk ip addr add 10.0.0.4/24 dev nvmf_tgt_if2 00:21:39.083 11:32:34 nvmf_tcp.nvmf_host.nvmf_aer -- nvmf/common.sh@196 -- # ip link set nvmf_init_if up 00:21:39.083 11:32:34 nvmf_tcp.nvmf_host.nvmf_aer -- nvmf/common.sh@197 -- # ip link set nvmf_init_if2 up 00:21:39.083 11:32:34 nvmf_tcp.nvmf_host.nvmf_aer -- nvmf/common.sh@198 -- # ip link set nvmf_init_br up 00:21:39.083 11:32:34 nvmf_tcp.nvmf_host.nvmf_aer -- nvmf/common.sh@199 -- # ip link set nvmf_init_br2 up 00:21:39.084 11:32:34 nvmf_tcp.nvmf_host.nvmf_aer -- nvmf/common.sh@200 -- # ip link set nvmf_tgt_br up 00:21:39.342 11:32:34 nvmf_tcp.nvmf_host.nvmf_aer -- nvmf/common.sh@201 -- # ip link set nvmf_tgt_br2 up 00:21:39.342 11:32:34 nvmf_tcp.nvmf_host.nvmf_aer -- nvmf/common.sh@202 -- # ip netns exec nvmf_tgt_ns_spdk ip link set nvmf_tgt_if up 00:21:39.342 11:32:34 nvmf_tcp.nvmf_host.nvmf_aer -- nvmf/common.sh@203 -- # ip netns exec nvmf_tgt_ns_spdk ip link set nvmf_tgt_if2 up 00:21:39.342 11:32:34 nvmf_tcp.nvmf_host.nvmf_aer -- nvmf/common.sh@204 -- # ip netns exec nvmf_tgt_ns_spdk ip link set lo up 00:21:39.342 11:32:34 nvmf_tcp.nvmf_host.nvmf_aer -- nvmf/common.sh@207 -- # ip link add nvmf_br type bridge 00:21:39.342 11:32:34 nvmf_tcp.nvmf_host.nvmf_aer -- nvmf/common.sh@208 -- # ip link set nvmf_br up 00:21:39.342 11:32:34 nvmf_tcp.nvmf_host.nvmf_aer -- nvmf/common.sh@211 -- # ip link set nvmf_init_br master nvmf_br 00:21:39.342 11:32:34 nvmf_tcp.nvmf_host.nvmf_aer -- nvmf/common.sh@212 -- # ip link set nvmf_init_br2 master nvmf_br 00:21:39.342 11:32:34 nvmf_tcp.nvmf_host.nvmf_aer -- nvmf/common.sh@213 -- # ip link set nvmf_tgt_br master nvmf_br 00:21:39.342 11:32:34 nvmf_tcp.nvmf_host.nvmf_aer -- nvmf/common.sh@214 -- # ip link set nvmf_tgt_br2 master nvmf_br 00:21:39.342 11:32:34 nvmf_tcp.nvmf_host.nvmf_aer -- nvmf/common.sh@217 -- # ipts -I INPUT 1 -i nvmf_init_if -p tcp --dport 4420 -j ACCEPT 00:21:39.342 11:32:34 nvmf_tcp.nvmf_host.nvmf_aer -- nvmf/common.sh@788 -- # iptables -I INPUT 1 -i nvmf_init_if -p tcp --dport 4420 -j ACCEPT -m comment --comment 'SPDK_NVMF:-I INPUT 1 -i nvmf_init_if -p tcp --dport 4420 -j ACCEPT' 00:21:39.342 11:32:34 nvmf_tcp.nvmf_host.nvmf_aer -- nvmf/common.sh@218 -- # ipts -I INPUT 1 -i nvmf_init_if2 -p tcp --dport 4420 -j ACCEPT 00:21:39.342 11:32:34 nvmf_tcp.nvmf_host.nvmf_aer -- nvmf/common.sh@788 -- # iptables -I INPUT 1 -i nvmf_init_if2 -p tcp --dport 4420 -j ACCEPT -m comment --comment 'SPDK_NVMF:-I INPUT 1 -i nvmf_init_if2 -p tcp --dport 4420 -j ACCEPT' 00:21:39.342 11:32:34 nvmf_tcp.nvmf_host.nvmf_aer -- nvmf/common.sh@219 -- # ipts -A FORWARD -i nvmf_br -o nvmf_br -j ACCEPT 00:21:39.342 11:32:34 nvmf_tcp.nvmf_host.nvmf_aer -- nvmf/common.sh@788 -- # iptables -A FORWARD -i nvmf_br -o nvmf_br -j ACCEPT -m comment --comment 'SPDK_NVMF:-A FORWARD -i nvmf_br -o nvmf_br -j ACCEPT' 00:21:39.342 11:32:34 nvmf_tcp.nvmf_host.nvmf_aer -- nvmf/common.sh@222 -- # ping -c 1 10.0.0.3 00:21:39.342 PING 10.0.0.3 (10.0.0.3) 56(84) bytes of data. 00:21:39.342 64 bytes from 10.0.0.3: icmp_seq=1 ttl=64 time=0.085 ms 00:21:39.342 00:21:39.342 --- 10.0.0.3 ping statistics --- 00:21:39.342 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:21:39.342 rtt min/avg/max/mdev = 0.085/0.085/0.085/0.000 ms 00:21:39.342 11:32:34 nvmf_tcp.nvmf_host.nvmf_aer -- nvmf/common.sh@223 -- # ping -c 1 10.0.0.4 00:21:39.342 PING 10.0.0.4 (10.0.0.4) 56(84) bytes of data. 00:21:39.342 64 bytes from 10.0.0.4: icmp_seq=1 ttl=64 time=0.068 ms 00:21:39.342 00:21:39.342 --- 10.0.0.4 ping statistics --- 00:21:39.342 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:21:39.342 rtt min/avg/max/mdev = 0.068/0.068/0.068/0.000 ms 00:21:39.342 11:32:34 nvmf_tcp.nvmf_host.nvmf_aer -- nvmf/common.sh@224 -- # ip netns exec nvmf_tgt_ns_spdk ping -c 1 10.0.0.1 00:21:39.342 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:21:39.342 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.035 ms 00:21:39.342 00:21:39.342 --- 10.0.0.1 ping statistics --- 00:21:39.342 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:21:39.342 rtt min/avg/max/mdev = 0.035/0.035/0.035/0.000 ms 00:21:39.342 11:32:34 nvmf_tcp.nvmf_host.nvmf_aer -- nvmf/common.sh@225 -- # ip netns exec nvmf_tgt_ns_spdk ping -c 1 10.0.0.2 00:21:39.342 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:21:39.342 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.068 ms 00:21:39.342 00:21:39.342 --- 10.0.0.2 ping statistics --- 00:21:39.342 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:21:39.342 rtt min/avg/max/mdev = 0.068/0.068/0.068/0.000 ms 00:21:39.342 11:32:34 nvmf_tcp.nvmf_host.nvmf_aer -- nvmf/common.sh@227 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:21:39.342 11:32:34 nvmf_tcp.nvmf_host.nvmf_aer -- nvmf/common.sh@459 -- # return 0 00:21:39.342 11:32:34 nvmf_tcp.nvmf_host.nvmf_aer -- nvmf/common.sh@476 -- # '[' '' == iso ']' 00:21:39.342 11:32:34 nvmf_tcp.nvmf_host.nvmf_aer -- nvmf/common.sh@480 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:21:39.342 11:32:34 nvmf_tcp.nvmf_host.nvmf_aer -- nvmf/common.sh@481 -- # [[ tcp == \r\d\m\a ]] 00:21:39.342 11:32:34 nvmf_tcp.nvmf_host.nvmf_aer -- nvmf/common.sh@490 -- # [[ tcp == \t\c\p ]] 00:21:39.342 11:32:34 nvmf_tcp.nvmf_host.nvmf_aer -- nvmf/common.sh@491 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:21:39.342 11:32:34 nvmf_tcp.nvmf_host.nvmf_aer -- nvmf/common.sh@494 -- # '[' tcp == tcp ']' 00:21:39.342 11:32:34 nvmf_tcp.nvmf_host.nvmf_aer -- nvmf/common.sh@500 -- # modprobe nvme-tcp 00:21:39.342 11:32:34 nvmf_tcp.nvmf_host.nvmf_aer -- host/aer.sh@12 -- # nvmfappstart -m 0xF 00:21:39.342 11:32:34 nvmf_tcp.nvmf_host.nvmf_aer -- nvmf/common.sh@505 -- # timing_enter start_nvmf_tgt 00:21:39.342 11:32:34 nvmf_tcp.nvmf_host.nvmf_aer -- common/autotest_common.sh@724 -- # xtrace_disable 00:21:39.342 11:32:34 nvmf_tcp.nvmf_host.nvmf_aer -- common/autotest_common.sh@10 -- # set +x 00:21:39.342 11:32:34 nvmf_tcp.nvmf_host.nvmf_aer -- nvmf/common.sh@507 -- # nvmfpid=87088 00:21:39.342 11:32:34 nvmf_tcp.nvmf_host.nvmf_aer -- nvmf/common.sh@506 -- # ip netns exec nvmf_tgt_ns_spdk /home/vagrant/spdk_repo/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:21:39.342 11:32:34 nvmf_tcp.nvmf_host.nvmf_aer -- nvmf/common.sh@508 -- # waitforlisten 87088 00:21:39.342 11:32:34 nvmf_tcp.nvmf_host.nvmf_aer -- common/autotest_common.sh@831 -- # '[' -z 87088 ']' 00:21:39.342 11:32:34 nvmf_tcp.nvmf_host.nvmf_aer -- common/autotest_common.sh@835 -- # local rpc_addr=/var/tmp/spdk.sock 00:21:39.342 11:32:34 nvmf_tcp.nvmf_host.nvmf_aer -- common/autotest_common.sh@836 -- # local max_retries=100 00:21:39.342 11:32:34 nvmf_tcp.nvmf_host.nvmf_aer -- common/autotest_common.sh@838 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:21:39.342 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:21:39.342 11:32:34 nvmf_tcp.nvmf_host.nvmf_aer -- common/autotest_common.sh@840 -- # xtrace_disable 00:21:39.342 11:32:34 nvmf_tcp.nvmf_host.nvmf_aer -- common/autotest_common.sh@10 -- # set +x 00:21:39.342 [2024-10-07 11:32:34.844831] Starting SPDK v25.01-pre git sha1 2a4f56c54 / DPDK 24.03.0 initialization... 00:21:39.342 [2024-10-07 11:32:34.844956] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --iova-mode=pa --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:21:39.600 [2024-10-07 11:32:34.989058] app.c: 917:spdk_app_start: *NOTICE*: Total cores available: 4 00:21:39.858 [2024-10-07 11:32:35.129896] app.c: 610:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:21:39.858 [2024-10-07 11:32:35.129958] app.c: 611:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:21:39.858 [2024-10-07 11:32:35.129971] app.c: 616:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:21:39.858 [2024-10-07 11:32:35.129982] app.c: 617:app_setup_trace: *NOTICE*: SPDK application currently running. 00:21:39.858 [2024-10-07 11:32:35.130003] app.c: 618:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:21:39.858 [2024-10-07 11:32:35.131340] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 1 00:21:39.858 [2024-10-07 11:32:35.131443] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 2 00:21:39.858 [2024-10-07 11:32:35.131529] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 0 00:21:39.858 [2024-10-07 11:32:35.131528] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 3 00:21:40.423 11:32:35 nvmf_tcp.nvmf_host.nvmf_aer -- common/autotest_common.sh@860 -- # (( i == 0 )) 00:21:40.423 11:32:35 nvmf_tcp.nvmf_host.nvmf_aer -- common/autotest_common.sh@864 -- # return 0 00:21:40.423 11:32:35 nvmf_tcp.nvmf_host.nvmf_aer -- nvmf/common.sh@509 -- # timing_exit start_nvmf_tgt 00:21:40.423 11:32:35 nvmf_tcp.nvmf_host.nvmf_aer -- common/autotest_common.sh@730 -- # xtrace_disable 00:21:40.423 11:32:35 nvmf_tcp.nvmf_host.nvmf_aer -- common/autotest_common.sh@10 -- # set +x 00:21:40.681 11:32:35 nvmf_tcp.nvmf_host.nvmf_aer -- nvmf/common.sh@510 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:21:40.681 11:32:35 nvmf_tcp.nvmf_host.nvmf_aer -- host/aer.sh@14 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:21:40.681 11:32:35 nvmf_tcp.nvmf_host.nvmf_aer -- common/autotest_common.sh@561 -- # xtrace_disable 00:21:40.681 11:32:35 nvmf_tcp.nvmf_host.nvmf_aer -- common/autotest_common.sh@10 -- # set +x 00:21:40.681 [2024-10-07 11:32:35.989620] tcp.c: 738:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:21:40.681 11:32:35 nvmf_tcp.nvmf_host.nvmf_aer -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:21:40.681 11:32:35 nvmf_tcp.nvmf_host.nvmf_aer -- host/aer.sh@16 -- # rpc_cmd bdev_malloc_create 64 512 --name Malloc0 00:21:40.681 11:32:35 nvmf_tcp.nvmf_host.nvmf_aer -- common/autotest_common.sh@561 -- # xtrace_disable 00:21:40.681 11:32:35 nvmf_tcp.nvmf_host.nvmf_aer -- common/autotest_common.sh@10 -- # set +x 00:21:40.681 Malloc0 00:21:40.681 11:32:36 nvmf_tcp.nvmf_host.nvmf_aer -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:21:40.681 11:32:36 nvmf_tcp.nvmf_host.nvmf_aer -- host/aer.sh@17 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 -m 2 00:21:40.681 11:32:36 nvmf_tcp.nvmf_host.nvmf_aer -- common/autotest_common.sh@561 -- # xtrace_disable 00:21:40.681 11:32:36 nvmf_tcp.nvmf_host.nvmf_aer -- common/autotest_common.sh@10 -- # set +x 00:21:40.681 11:32:36 nvmf_tcp.nvmf_host.nvmf_aer -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:21:40.681 11:32:36 nvmf_tcp.nvmf_host.nvmf_aer -- host/aer.sh@18 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:21:40.681 11:32:36 nvmf_tcp.nvmf_host.nvmf_aer -- common/autotest_common.sh@561 -- # xtrace_disable 00:21:40.681 11:32:36 nvmf_tcp.nvmf_host.nvmf_aer -- common/autotest_common.sh@10 -- # set +x 00:21:40.681 11:32:36 nvmf_tcp.nvmf_host.nvmf_aer -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:21:40.681 11:32:36 nvmf_tcp.nvmf_host.nvmf_aer -- host/aer.sh@19 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.3 -s 4420 00:21:40.681 11:32:36 nvmf_tcp.nvmf_host.nvmf_aer -- common/autotest_common.sh@561 -- # xtrace_disable 00:21:40.681 11:32:36 nvmf_tcp.nvmf_host.nvmf_aer -- common/autotest_common.sh@10 -- # set +x 00:21:40.681 [2024-10-07 11:32:36.042737] tcp.c:1081:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.3 port 4420 *** 00:21:40.681 11:32:36 nvmf_tcp.nvmf_host.nvmf_aer -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:21:40.681 11:32:36 nvmf_tcp.nvmf_host.nvmf_aer -- host/aer.sh@21 -- # rpc_cmd nvmf_get_subsystems 00:21:40.681 11:32:36 nvmf_tcp.nvmf_host.nvmf_aer -- common/autotest_common.sh@561 -- # xtrace_disable 00:21:40.681 11:32:36 nvmf_tcp.nvmf_host.nvmf_aer -- common/autotest_common.sh@10 -- # set +x 00:21:40.681 [ 00:21:40.681 { 00:21:40.681 "allow_any_host": true, 00:21:40.681 "hosts": [], 00:21:40.681 "listen_addresses": [], 00:21:40.681 "nqn": "nqn.2014-08.org.nvmexpress.discovery", 00:21:40.681 "subtype": "Discovery" 00:21:40.681 }, 00:21:40.681 { 00:21:40.681 "allow_any_host": true, 00:21:40.681 "hosts": [], 00:21:40.681 "listen_addresses": [ 00:21:40.681 { 00:21:40.681 "adrfam": "IPv4", 00:21:40.681 "traddr": "10.0.0.3", 00:21:40.681 "trsvcid": "4420", 00:21:40.681 "trtype": "TCP" 00:21:40.681 } 00:21:40.681 ], 00:21:40.681 "max_cntlid": 65519, 00:21:40.681 "max_namespaces": 2, 00:21:40.681 "min_cntlid": 1, 00:21:40.681 "model_number": "SPDK bdev Controller", 00:21:40.681 "namespaces": [ 00:21:40.681 { 00:21:40.681 "bdev_name": "Malloc0", 00:21:40.681 "name": "Malloc0", 00:21:40.681 "nguid": "5A3F5BEBD4894066A119EEEFF42957D6", 00:21:40.681 "nsid": 1, 00:21:40.681 "uuid": "5a3f5beb-d489-4066-a119-eeeff42957d6" 00:21:40.681 } 00:21:40.681 ], 00:21:40.681 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:21:40.681 "serial_number": "SPDK00000000000001", 00:21:40.681 "subtype": "NVMe" 00:21:40.681 } 00:21:40.681 ] 00:21:40.681 11:32:36 nvmf_tcp.nvmf_host.nvmf_aer -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:21:40.681 11:32:36 nvmf_tcp.nvmf_host.nvmf_aer -- host/aer.sh@23 -- # AER_TOUCH_FILE=/tmp/aer_touch_file 00:21:40.681 11:32:36 nvmf_tcp.nvmf_host.nvmf_aer -- host/aer.sh@24 -- # rm -f /tmp/aer_touch_file 00:21:40.681 11:32:36 nvmf_tcp.nvmf_host.nvmf_aer -- host/aer.sh@33 -- # aerpid=87142 00:21:40.681 11:32:36 nvmf_tcp.nvmf_host.nvmf_aer -- host/aer.sh@27 -- # /home/vagrant/spdk_repo/spdk/test/nvme/aer/aer -r ' trtype:tcp adrfam:IPv4 traddr:10.0.0.3 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1' -n 2 -t /tmp/aer_touch_file 00:21:40.681 11:32:36 nvmf_tcp.nvmf_host.nvmf_aer -- host/aer.sh@36 -- # waitforfile /tmp/aer_touch_file 00:21:40.681 11:32:36 nvmf_tcp.nvmf_host.nvmf_aer -- common/autotest_common.sh@1265 -- # local i=0 00:21:40.681 11:32:36 nvmf_tcp.nvmf_host.nvmf_aer -- common/autotest_common.sh@1266 -- # '[' '!' -e /tmp/aer_touch_file ']' 00:21:40.681 11:32:36 nvmf_tcp.nvmf_host.nvmf_aer -- common/autotest_common.sh@1267 -- # '[' 0 -lt 200 ']' 00:21:40.681 11:32:36 nvmf_tcp.nvmf_host.nvmf_aer -- common/autotest_common.sh@1268 -- # i=1 00:21:40.681 11:32:36 nvmf_tcp.nvmf_host.nvmf_aer -- common/autotest_common.sh@1269 -- # sleep 0.1 00:21:40.681 11:32:36 nvmf_tcp.nvmf_host.nvmf_aer -- common/autotest_common.sh@1266 -- # '[' '!' -e /tmp/aer_touch_file ']' 00:21:40.681 11:32:36 nvmf_tcp.nvmf_host.nvmf_aer -- common/autotest_common.sh@1267 -- # '[' 1 -lt 200 ']' 00:21:40.681 11:32:36 nvmf_tcp.nvmf_host.nvmf_aer -- common/autotest_common.sh@1268 -- # i=2 00:21:40.681 11:32:36 nvmf_tcp.nvmf_host.nvmf_aer -- common/autotest_common.sh@1269 -- # sleep 0.1 00:21:40.939 11:32:36 nvmf_tcp.nvmf_host.nvmf_aer -- common/autotest_common.sh@1266 -- # '[' '!' -e /tmp/aer_touch_file ']' 00:21:40.939 11:32:36 nvmf_tcp.nvmf_host.nvmf_aer -- common/autotest_common.sh@1272 -- # '[' '!' -e /tmp/aer_touch_file ']' 00:21:40.939 11:32:36 nvmf_tcp.nvmf_host.nvmf_aer -- common/autotest_common.sh@1276 -- # return 0 00:21:40.939 11:32:36 nvmf_tcp.nvmf_host.nvmf_aer -- host/aer.sh@39 -- # rpc_cmd bdev_malloc_create 64 4096 --name Malloc1 00:21:40.939 11:32:36 nvmf_tcp.nvmf_host.nvmf_aer -- common/autotest_common.sh@561 -- # xtrace_disable 00:21:40.939 11:32:36 nvmf_tcp.nvmf_host.nvmf_aer -- common/autotest_common.sh@10 -- # set +x 00:21:40.939 Malloc1 00:21:40.939 11:32:36 nvmf_tcp.nvmf_host.nvmf_aer -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:21:40.939 11:32:36 nvmf_tcp.nvmf_host.nvmf_aer -- host/aer.sh@40 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 -n 2 00:21:40.939 11:32:36 nvmf_tcp.nvmf_host.nvmf_aer -- common/autotest_common.sh@561 -- # xtrace_disable 00:21:40.939 11:32:36 nvmf_tcp.nvmf_host.nvmf_aer -- common/autotest_common.sh@10 -- # set +x 00:21:40.939 11:32:36 nvmf_tcp.nvmf_host.nvmf_aer -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:21:40.939 11:32:36 nvmf_tcp.nvmf_host.nvmf_aer -- host/aer.sh@41 -- # rpc_cmd nvmf_get_subsystems 00:21:40.939 11:32:36 nvmf_tcp.nvmf_host.nvmf_aer -- common/autotest_common.sh@561 -- # xtrace_disable 00:21:40.939 11:32:36 nvmf_tcp.nvmf_host.nvmf_aer -- common/autotest_common.sh@10 -- # set +x 00:21:40.939 [ 00:21:40.939 { 00:21:40.939 "allow_any_host": true, 00:21:40.939 "hosts": [], 00:21:40.939 "listen_addresses": [], 00:21:40.939 "nqn": "nqn.2014-08.org.nvmexpress.discovery", 00:21:40.939 "subtype": "Discovery" 00:21:40.939 }, 00:21:40.939 { 00:21:40.939 "allow_any_host": true, 00:21:40.939 "hosts": [], 00:21:40.939 "listen_addresses": [ 00:21:40.939 { 00:21:40.939 "adrfam": "IPv4", 00:21:40.939 "traddr": "10.0.0.3", 00:21:40.939 "trsvcid": "4420", 00:21:40.939 "trtype": "TCP" 00:21:40.939 } 00:21:40.939 Asynchronous Event Request test 00:21:40.939 Attaching to 10.0.0.3 00:21:40.939 Attached to 10.0.0.3 00:21:40.939 Registering asynchronous event callbacks... 00:21:40.939 Starting namespace attribute notice tests for all controllers... 00:21:40.939 10.0.0.3: aer_cb for log page 4, aen_event_type: 0x02, aen_event_info: 0x00 00:21:40.939 aer_cb - Changed Namespace 00:21:40.939 Cleaning up... 00:21:40.939 ], 00:21:40.939 "max_cntlid": 65519, 00:21:40.939 "max_namespaces": 2, 00:21:40.939 "min_cntlid": 1, 00:21:40.939 "model_number": "SPDK bdev Controller", 00:21:40.939 "namespaces": [ 00:21:40.939 { 00:21:40.939 "bdev_name": "Malloc0", 00:21:40.939 "name": "Malloc0", 00:21:40.939 "nguid": "5A3F5BEBD4894066A119EEEFF42957D6", 00:21:40.939 "nsid": 1, 00:21:40.939 "uuid": "5a3f5beb-d489-4066-a119-eeeff42957d6" 00:21:40.939 }, 00:21:40.939 { 00:21:40.939 "bdev_name": "Malloc1", 00:21:40.939 "name": "Malloc1", 00:21:40.939 "nguid": "1C383E4739874204AA4ED71CB81284FA", 00:21:40.939 "nsid": 2, 00:21:40.939 "uuid": "1c383e47-3987-4204-aa4e-d71cb81284fa" 00:21:40.939 } 00:21:40.939 ], 00:21:40.939 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:21:40.939 "serial_number": "SPDK00000000000001", 00:21:40.939 "subtype": "NVMe" 00:21:40.939 } 00:21:40.939 ] 00:21:40.939 11:32:36 nvmf_tcp.nvmf_host.nvmf_aer -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:21:40.939 11:32:36 nvmf_tcp.nvmf_host.nvmf_aer -- host/aer.sh@43 -- # wait 87142 00:21:40.939 11:32:36 nvmf_tcp.nvmf_host.nvmf_aer -- host/aer.sh@45 -- # rpc_cmd bdev_malloc_delete Malloc0 00:21:40.939 11:32:36 nvmf_tcp.nvmf_host.nvmf_aer -- common/autotest_common.sh@561 -- # xtrace_disable 00:21:40.939 11:32:36 nvmf_tcp.nvmf_host.nvmf_aer -- common/autotest_common.sh@10 -- # set +x 00:21:40.939 11:32:36 nvmf_tcp.nvmf_host.nvmf_aer -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:21:40.939 11:32:36 nvmf_tcp.nvmf_host.nvmf_aer -- host/aer.sh@46 -- # rpc_cmd bdev_malloc_delete Malloc1 00:21:40.939 11:32:36 nvmf_tcp.nvmf_host.nvmf_aer -- common/autotest_common.sh@561 -- # xtrace_disable 00:21:40.939 11:32:36 nvmf_tcp.nvmf_host.nvmf_aer -- common/autotest_common.sh@10 -- # set +x 00:21:40.939 11:32:36 nvmf_tcp.nvmf_host.nvmf_aer -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:21:40.939 11:32:36 nvmf_tcp.nvmf_host.nvmf_aer -- host/aer.sh@47 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:21:40.939 11:32:36 nvmf_tcp.nvmf_host.nvmf_aer -- common/autotest_common.sh@561 -- # xtrace_disable 00:21:40.939 11:32:36 nvmf_tcp.nvmf_host.nvmf_aer -- common/autotest_common.sh@10 -- # set +x 00:21:40.939 11:32:36 nvmf_tcp.nvmf_host.nvmf_aer -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:21:40.939 11:32:36 nvmf_tcp.nvmf_host.nvmf_aer -- host/aer.sh@49 -- # trap - SIGINT SIGTERM EXIT 00:21:40.939 11:32:36 nvmf_tcp.nvmf_host.nvmf_aer -- host/aer.sh@51 -- # nvmftestfini 00:21:40.939 11:32:36 nvmf_tcp.nvmf_host.nvmf_aer -- nvmf/common.sh@514 -- # nvmfcleanup 00:21:40.939 11:32:36 nvmf_tcp.nvmf_host.nvmf_aer -- nvmf/common.sh@121 -- # sync 00:21:41.200 11:32:36 nvmf_tcp.nvmf_host.nvmf_aer -- nvmf/common.sh@123 -- # '[' tcp == tcp ']' 00:21:41.200 11:32:36 nvmf_tcp.nvmf_host.nvmf_aer -- nvmf/common.sh@124 -- # set +e 00:21:41.200 11:32:36 nvmf_tcp.nvmf_host.nvmf_aer -- nvmf/common.sh@125 -- # for i in {1..20} 00:21:41.200 11:32:36 nvmf_tcp.nvmf_host.nvmf_aer -- nvmf/common.sh@126 -- # modprobe -v -r nvme-tcp 00:21:41.200 rmmod nvme_tcp 00:21:41.200 rmmod nvme_fabrics 00:21:41.200 rmmod nvme_keyring 00:21:41.200 11:32:36 nvmf_tcp.nvmf_host.nvmf_aer -- nvmf/common.sh@127 -- # modprobe -v -r nvme-fabrics 00:21:41.200 11:32:36 nvmf_tcp.nvmf_host.nvmf_aer -- nvmf/common.sh@128 -- # set -e 00:21:41.200 11:32:36 nvmf_tcp.nvmf_host.nvmf_aer -- nvmf/common.sh@129 -- # return 0 00:21:41.200 11:32:36 nvmf_tcp.nvmf_host.nvmf_aer -- nvmf/common.sh@515 -- # '[' -n 87088 ']' 00:21:41.200 11:32:36 nvmf_tcp.nvmf_host.nvmf_aer -- nvmf/common.sh@516 -- # killprocess 87088 00:21:41.200 11:32:36 nvmf_tcp.nvmf_host.nvmf_aer -- common/autotest_common.sh@950 -- # '[' -z 87088 ']' 00:21:41.200 11:32:36 nvmf_tcp.nvmf_host.nvmf_aer -- common/autotest_common.sh@954 -- # kill -0 87088 00:21:41.200 11:32:36 nvmf_tcp.nvmf_host.nvmf_aer -- common/autotest_common.sh@955 -- # uname 00:21:41.200 11:32:36 nvmf_tcp.nvmf_host.nvmf_aer -- common/autotest_common.sh@955 -- # '[' Linux = Linux ']' 00:21:41.200 11:32:36 nvmf_tcp.nvmf_host.nvmf_aer -- common/autotest_common.sh@956 -- # ps --no-headers -o comm= 87088 00:21:41.200 11:32:36 nvmf_tcp.nvmf_host.nvmf_aer -- common/autotest_common.sh@956 -- # process_name=reactor_0 00:21:41.200 11:32:36 nvmf_tcp.nvmf_host.nvmf_aer -- common/autotest_common.sh@960 -- # '[' reactor_0 = sudo ']' 00:21:41.200 killing process with pid 87088 00:21:41.200 11:32:36 nvmf_tcp.nvmf_host.nvmf_aer -- common/autotest_common.sh@968 -- # echo 'killing process with pid 87088' 00:21:41.200 11:32:36 nvmf_tcp.nvmf_host.nvmf_aer -- common/autotest_common.sh@969 -- # kill 87088 00:21:41.200 11:32:36 nvmf_tcp.nvmf_host.nvmf_aer -- common/autotest_common.sh@974 -- # wait 87088 00:21:41.459 11:32:36 nvmf_tcp.nvmf_host.nvmf_aer -- nvmf/common.sh@518 -- # '[' '' == iso ']' 00:21:41.459 11:32:36 nvmf_tcp.nvmf_host.nvmf_aer -- nvmf/common.sh@521 -- # [[ tcp == \t\c\p ]] 00:21:41.459 11:32:36 nvmf_tcp.nvmf_host.nvmf_aer -- nvmf/common.sh@522 -- # nvmf_tcp_fini 00:21:41.459 11:32:36 nvmf_tcp.nvmf_host.nvmf_aer -- nvmf/common.sh@297 -- # iptr 00:21:41.459 11:32:36 nvmf_tcp.nvmf_host.nvmf_aer -- nvmf/common.sh@789 -- # iptables-save 00:21:41.459 11:32:36 nvmf_tcp.nvmf_host.nvmf_aer -- nvmf/common.sh@789 -- # iptables-restore 00:21:41.459 11:32:36 nvmf_tcp.nvmf_host.nvmf_aer -- nvmf/common.sh@789 -- # grep -v SPDK_NVMF 00:21:41.459 11:32:36 nvmf_tcp.nvmf_host.nvmf_aer -- nvmf/common.sh@298 -- # [[ nvmf_tgt_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s\_\s\p\d\k ]] 00:21:41.459 11:32:36 nvmf_tcp.nvmf_host.nvmf_aer -- nvmf/common.sh@299 -- # nvmf_veth_fini 00:21:41.459 11:32:36 nvmf_tcp.nvmf_host.nvmf_aer -- nvmf/common.sh@233 -- # ip link set nvmf_init_br nomaster 00:21:41.459 11:32:36 nvmf_tcp.nvmf_host.nvmf_aer -- nvmf/common.sh@234 -- # ip link set nvmf_init_br2 nomaster 00:21:41.459 11:32:36 nvmf_tcp.nvmf_host.nvmf_aer -- nvmf/common.sh@235 -- # ip link set nvmf_tgt_br nomaster 00:21:41.459 11:32:36 nvmf_tcp.nvmf_host.nvmf_aer -- nvmf/common.sh@236 -- # ip link set nvmf_tgt_br2 nomaster 00:21:41.459 11:32:36 nvmf_tcp.nvmf_host.nvmf_aer -- nvmf/common.sh@237 -- # ip link set nvmf_init_br down 00:21:41.459 11:32:36 nvmf_tcp.nvmf_host.nvmf_aer -- nvmf/common.sh@238 -- # ip link set nvmf_init_br2 down 00:21:41.459 11:32:36 nvmf_tcp.nvmf_host.nvmf_aer -- nvmf/common.sh@239 -- # ip link set nvmf_tgt_br down 00:21:41.459 11:32:36 nvmf_tcp.nvmf_host.nvmf_aer -- nvmf/common.sh@240 -- # ip link set nvmf_tgt_br2 down 00:21:41.459 11:32:36 nvmf_tcp.nvmf_host.nvmf_aer -- nvmf/common.sh@241 -- # ip link delete nvmf_br type bridge 00:21:41.717 11:32:36 nvmf_tcp.nvmf_host.nvmf_aer -- nvmf/common.sh@242 -- # ip link delete nvmf_init_if 00:21:41.717 11:32:37 nvmf_tcp.nvmf_host.nvmf_aer -- nvmf/common.sh@243 -- # ip link delete nvmf_init_if2 00:21:41.717 11:32:37 nvmf_tcp.nvmf_host.nvmf_aer -- nvmf/common.sh@244 -- # ip netns exec nvmf_tgt_ns_spdk ip link delete nvmf_tgt_if 00:21:41.717 11:32:37 nvmf_tcp.nvmf_host.nvmf_aer -- nvmf/common.sh@245 -- # ip netns exec nvmf_tgt_ns_spdk ip link delete nvmf_tgt_if2 00:21:41.717 11:32:37 nvmf_tcp.nvmf_host.nvmf_aer -- nvmf/common.sh@246 -- # remove_spdk_ns 00:21:41.717 11:32:37 nvmf_tcp.nvmf_host.nvmf_aer -- nvmf/common.sh@654 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:21:41.717 11:32:37 nvmf_tcp.nvmf_host.nvmf_aer -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 15> /dev/null' 00:21:41.717 11:32:37 nvmf_tcp.nvmf_host.nvmf_aer -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:21:41.717 11:32:37 nvmf_tcp.nvmf_host.nvmf_aer -- nvmf/common.sh@300 -- # return 0 00:21:41.717 00:21:41.717 real 0m3.069s 00:21:41.717 user 0m7.260s 00:21:41.717 sys 0m0.893s 00:21:41.717 11:32:37 nvmf_tcp.nvmf_host.nvmf_aer -- common/autotest_common.sh@1126 -- # xtrace_disable 00:21:41.717 11:32:37 nvmf_tcp.nvmf_host.nvmf_aer -- common/autotest_common.sh@10 -- # set +x 00:21:41.717 ************************************ 00:21:41.717 END TEST nvmf_aer 00:21:41.717 ************************************ 00:21:41.717 11:32:37 nvmf_tcp.nvmf_host -- nvmf/nvmf_host.sh@18 -- # run_test nvmf_async_init /home/vagrant/spdk_repo/spdk/test/nvmf/host/async_init.sh --transport=tcp 00:21:41.717 11:32:37 nvmf_tcp.nvmf_host -- common/autotest_common.sh@1101 -- # '[' 3 -le 1 ']' 00:21:41.717 11:32:37 nvmf_tcp.nvmf_host -- common/autotest_common.sh@1107 -- # xtrace_disable 00:21:41.717 11:32:37 nvmf_tcp.nvmf_host -- common/autotest_common.sh@10 -- # set +x 00:21:41.717 ************************************ 00:21:41.717 START TEST nvmf_async_init 00:21:41.718 ************************************ 00:21:41.718 11:32:37 nvmf_tcp.nvmf_host.nvmf_async_init -- common/autotest_common.sh@1125 -- # /home/vagrant/spdk_repo/spdk/test/nvmf/host/async_init.sh --transport=tcp 00:21:41.976 * Looking for test storage... 00:21:41.976 * Found test storage at /home/vagrant/spdk_repo/spdk/test/nvmf/host 00:21:41.976 11:32:37 nvmf_tcp.nvmf_host.nvmf_async_init -- common/autotest_common.sh@1680 -- # [[ y == y ]] 00:21:41.976 11:32:37 nvmf_tcp.nvmf_host.nvmf_async_init -- common/autotest_common.sh@1681 -- # lcov --version 00:21:41.976 11:32:37 nvmf_tcp.nvmf_host.nvmf_async_init -- common/autotest_common.sh@1681 -- # awk '{print $NF}' 00:21:41.976 11:32:37 nvmf_tcp.nvmf_host.nvmf_async_init -- common/autotest_common.sh@1681 -- # lt 1.15 2 00:21:41.976 11:32:37 nvmf_tcp.nvmf_host.nvmf_async_init -- scripts/common.sh@373 -- # cmp_versions 1.15 '<' 2 00:21:41.976 11:32:37 nvmf_tcp.nvmf_host.nvmf_async_init -- scripts/common.sh@333 -- # local ver1 ver1_l 00:21:41.976 11:32:37 nvmf_tcp.nvmf_host.nvmf_async_init -- scripts/common.sh@334 -- # local ver2 ver2_l 00:21:41.976 11:32:37 nvmf_tcp.nvmf_host.nvmf_async_init -- scripts/common.sh@336 -- # IFS=.-: 00:21:41.976 11:32:37 nvmf_tcp.nvmf_host.nvmf_async_init -- scripts/common.sh@336 -- # read -ra ver1 00:21:41.976 11:32:37 nvmf_tcp.nvmf_host.nvmf_async_init -- scripts/common.sh@337 -- # IFS=.-: 00:21:41.976 11:32:37 nvmf_tcp.nvmf_host.nvmf_async_init -- scripts/common.sh@337 -- # read -ra ver2 00:21:41.976 11:32:37 nvmf_tcp.nvmf_host.nvmf_async_init -- scripts/common.sh@338 -- # local 'op=<' 00:21:41.976 11:32:37 nvmf_tcp.nvmf_host.nvmf_async_init -- scripts/common.sh@340 -- # ver1_l=2 00:21:41.976 11:32:37 nvmf_tcp.nvmf_host.nvmf_async_init -- scripts/common.sh@341 -- # ver2_l=1 00:21:41.976 11:32:37 nvmf_tcp.nvmf_host.nvmf_async_init -- scripts/common.sh@343 -- # local lt=0 gt=0 eq=0 v 00:21:41.976 11:32:37 nvmf_tcp.nvmf_host.nvmf_async_init -- scripts/common.sh@344 -- # case "$op" in 00:21:41.976 11:32:37 nvmf_tcp.nvmf_host.nvmf_async_init -- scripts/common.sh@345 -- # : 1 00:21:41.976 11:32:37 nvmf_tcp.nvmf_host.nvmf_async_init -- scripts/common.sh@364 -- # (( v = 0 )) 00:21:41.976 11:32:37 nvmf_tcp.nvmf_host.nvmf_async_init -- scripts/common.sh@364 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:21:41.976 11:32:37 nvmf_tcp.nvmf_host.nvmf_async_init -- scripts/common.sh@365 -- # decimal 1 00:21:41.976 11:32:37 nvmf_tcp.nvmf_host.nvmf_async_init -- scripts/common.sh@353 -- # local d=1 00:21:41.976 11:32:37 nvmf_tcp.nvmf_host.nvmf_async_init -- scripts/common.sh@354 -- # [[ 1 =~ ^[0-9]+$ ]] 00:21:41.976 11:32:37 nvmf_tcp.nvmf_host.nvmf_async_init -- scripts/common.sh@355 -- # echo 1 00:21:41.976 11:32:37 nvmf_tcp.nvmf_host.nvmf_async_init -- scripts/common.sh@365 -- # ver1[v]=1 00:21:41.976 11:32:37 nvmf_tcp.nvmf_host.nvmf_async_init -- scripts/common.sh@366 -- # decimal 2 00:21:41.976 11:32:37 nvmf_tcp.nvmf_host.nvmf_async_init -- scripts/common.sh@353 -- # local d=2 00:21:41.976 11:32:37 nvmf_tcp.nvmf_host.nvmf_async_init -- scripts/common.sh@354 -- # [[ 2 =~ ^[0-9]+$ ]] 00:21:41.976 11:32:37 nvmf_tcp.nvmf_host.nvmf_async_init -- scripts/common.sh@355 -- # echo 2 00:21:41.976 11:32:37 nvmf_tcp.nvmf_host.nvmf_async_init -- scripts/common.sh@366 -- # ver2[v]=2 00:21:41.976 11:32:37 nvmf_tcp.nvmf_host.nvmf_async_init -- scripts/common.sh@367 -- # (( ver1[v] > ver2[v] )) 00:21:41.976 11:32:37 nvmf_tcp.nvmf_host.nvmf_async_init -- scripts/common.sh@368 -- # (( ver1[v] < ver2[v] )) 00:21:41.976 11:32:37 nvmf_tcp.nvmf_host.nvmf_async_init -- scripts/common.sh@368 -- # return 0 00:21:41.976 11:32:37 nvmf_tcp.nvmf_host.nvmf_async_init -- common/autotest_common.sh@1682 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:21:41.976 11:32:37 nvmf_tcp.nvmf_host.nvmf_async_init -- common/autotest_common.sh@1694 -- # export 'LCOV_OPTS= 00:21:41.976 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:21:41.976 --rc genhtml_branch_coverage=1 00:21:41.976 --rc genhtml_function_coverage=1 00:21:41.976 --rc genhtml_legend=1 00:21:41.976 --rc geninfo_all_blocks=1 00:21:41.976 --rc geninfo_unexecuted_blocks=1 00:21:41.976 00:21:41.976 ' 00:21:41.976 11:32:37 nvmf_tcp.nvmf_host.nvmf_async_init -- common/autotest_common.sh@1694 -- # LCOV_OPTS=' 00:21:41.976 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:21:41.977 --rc genhtml_branch_coverage=1 00:21:41.977 --rc genhtml_function_coverage=1 00:21:41.977 --rc genhtml_legend=1 00:21:41.977 --rc geninfo_all_blocks=1 00:21:41.977 --rc geninfo_unexecuted_blocks=1 00:21:41.977 00:21:41.977 ' 00:21:41.977 11:32:37 nvmf_tcp.nvmf_host.nvmf_async_init -- common/autotest_common.sh@1695 -- # export 'LCOV=lcov 00:21:41.977 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:21:41.977 --rc genhtml_branch_coverage=1 00:21:41.977 --rc genhtml_function_coverage=1 00:21:41.977 --rc genhtml_legend=1 00:21:41.977 --rc geninfo_all_blocks=1 00:21:41.977 --rc geninfo_unexecuted_blocks=1 00:21:41.977 00:21:41.977 ' 00:21:41.977 11:32:37 nvmf_tcp.nvmf_host.nvmf_async_init -- common/autotest_common.sh@1695 -- # LCOV='lcov 00:21:41.977 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:21:41.977 --rc genhtml_branch_coverage=1 00:21:41.977 --rc genhtml_function_coverage=1 00:21:41.977 --rc genhtml_legend=1 00:21:41.977 --rc geninfo_all_blocks=1 00:21:41.977 --rc geninfo_unexecuted_blocks=1 00:21:41.977 00:21:41.977 ' 00:21:41.977 11:32:37 nvmf_tcp.nvmf_host.nvmf_async_init -- host/async_init.sh@11 -- # source /home/vagrant/spdk_repo/spdk/test/nvmf/common.sh 00:21:41.977 11:32:37 nvmf_tcp.nvmf_host.nvmf_async_init -- nvmf/common.sh@7 -- # uname -s 00:21:41.977 11:32:37 nvmf_tcp.nvmf_host.nvmf_async_init -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:21:41.977 11:32:37 nvmf_tcp.nvmf_host.nvmf_async_init -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:21:41.977 11:32:37 nvmf_tcp.nvmf_host.nvmf_async_init -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:21:41.977 11:32:37 nvmf_tcp.nvmf_host.nvmf_async_init -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:21:41.977 11:32:37 nvmf_tcp.nvmf_host.nvmf_async_init -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:21:41.977 11:32:37 nvmf_tcp.nvmf_host.nvmf_async_init -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:21:41.977 11:32:37 nvmf_tcp.nvmf_host.nvmf_async_init -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:21:41.977 11:32:37 nvmf_tcp.nvmf_host.nvmf_async_init -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:21:41.977 11:32:37 nvmf_tcp.nvmf_host.nvmf_async_init -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:21:41.977 11:32:37 nvmf_tcp.nvmf_host.nvmf_async_init -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:21:41.977 11:32:37 nvmf_tcp.nvmf_host.nvmf_async_init -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:c758a4ed-f09f-4c82-9afb-3d096f035464 00:21:41.977 11:32:37 nvmf_tcp.nvmf_host.nvmf_async_init -- nvmf/common.sh@18 -- # NVME_HOSTID=c758a4ed-f09f-4c82-9afb-3d096f035464 00:21:41.977 11:32:37 nvmf_tcp.nvmf_host.nvmf_async_init -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:21:41.977 11:32:37 nvmf_tcp.nvmf_host.nvmf_async_init -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:21:41.977 11:32:37 nvmf_tcp.nvmf_host.nvmf_async_init -- nvmf/common.sh@21 -- # NET_TYPE=virt 00:21:41.977 11:32:37 nvmf_tcp.nvmf_host.nvmf_async_init -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:21:41.977 11:32:37 nvmf_tcp.nvmf_host.nvmf_async_init -- nvmf/common.sh@49 -- # source /home/vagrant/spdk_repo/spdk/scripts/common.sh 00:21:41.977 11:32:37 nvmf_tcp.nvmf_host.nvmf_async_init -- scripts/common.sh@15 -- # shopt -s extglob 00:21:41.977 11:32:37 nvmf_tcp.nvmf_host.nvmf_async_init -- scripts/common.sh@544 -- # [[ -e /bin/wpdk_common.sh ]] 00:21:41.977 11:32:37 nvmf_tcp.nvmf_host.nvmf_async_init -- scripts/common.sh@552 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:21:41.977 11:32:37 nvmf_tcp.nvmf_host.nvmf_async_init -- scripts/common.sh@553 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:21:41.977 11:32:37 nvmf_tcp.nvmf_host.nvmf_async_init -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:21:41.977 11:32:37 nvmf_tcp.nvmf_host.nvmf_async_init -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:21:41.977 11:32:37 nvmf_tcp.nvmf_host.nvmf_async_init -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:21:41.977 11:32:37 nvmf_tcp.nvmf_host.nvmf_async_init -- paths/export.sh@5 -- # export PATH 00:21:41.977 11:32:37 nvmf_tcp.nvmf_host.nvmf_async_init -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:21:41.977 11:32:37 nvmf_tcp.nvmf_host.nvmf_async_init -- nvmf/common.sh@51 -- # : 0 00:21:41.977 11:32:37 nvmf_tcp.nvmf_host.nvmf_async_init -- nvmf/common.sh@52 -- # export NVMF_APP_SHM_ID 00:21:41.977 11:32:37 nvmf_tcp.nvmf_host.nvmf_async_init -- nvmf/common.sh@53 -- # build_nvmf_app_args 00:21:41.977 11:32:37 nvmf_tcp.nvmf_host.nvmf_async_init -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:21:41.977 11:32:37 nvmf_tcp.nvmf_host.nvmf_async_init -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:21:41.977 11:32:37 nvmf_tcp.nvmf_host.nvmf_async_init -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:21:41.977 11:32:37 nvmf_tcp.nvmf_host.nvmf_async_init -- nvmf/common.sh@33 -- # '[' '' -eq 1 ']' 00:21:41.977 /home/vagrant/spdk_repo/spdk/test/nvmf/common.sh: line 33: [: : integer expression expected 00:21:41.977 11:32:37 nvmf_tcp.nvmf_host.nvmf_async_init -- nvmf/common.sh@37 -- # '[' -n '' ']' 00:21:41.977 11:32:37 nvmf_tcp.nvmf_host.nvmf_async_init -- nvmf/common.sh@39 -- # '[' 0 -eq 1 ']' 00:21:41.977 11:32:37 nvmf_tcp.nvmf_host.nvmf_async_init -- nvmf/common.sh@55 -- # have_pci_nics=0 00:21:41.977 11:32:37 nvmf_tcp.nvmf_host.nvmf_async_init -- host/async_init.sh@13 -- # null_bdev_size=1024 00:21:41.977 11:32:37 nvmf_tcp.nvmf_host.nvmf_async_init -- host/async_init.sh@14 -- # null_block_size=512 00:21:41.977 11:32:37 nvmf_tcp.nvmf_host.nvmf_async_init -- host/async_init.sh@15 -- # null_bdev=null0 00:21:41.977 11:32:37 nvmf_tcp.nvmf_host.nvmf_async_init -- host/async_init.sh@16 -- # nvme_bdev=nvme0 00:21:41.977 11:32:37 nvmf_tcp.nvmf_host.nvmf_async_init -- host/async_init.sh@20 -- # uuidgen 00:21:41.977 11:32:37 nvmf_tcp.nvmf_host.nvmf_async_init -- host/async_init.sh@20 -- # tr -d - 00:21:41.977 11:32:37 nvmf_tcp.nvmf_host.nvmf_async_init -- host/async_init.sh@20 -- # nguid=f6b1558bdd6d47fa944cc0678c454cf7 00:21:41.977 11:32:37 nvmf_tcp.nvmf_host.nvmf_async_init -- host/async_init.sh@22 -- # nvmftestinit 00:21:41.977 11:32:37 nvmf_tcp.nvmf_host.nvmf_async_init -- nvmf/common.sh@467 -- # '[' -z tcp ']' 00:21:41.977 11:32:37 nvmf_tcp.nvmf_host.nvmf_async_init -- nvmf/common.sh@472 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:21:41.977 11:32:37 nvmf_tcp.nvmf_host.nvmf_async_init -- nvmf/common.sh@474 -- # prepare_net_devs 00:21:41.977 11:32:37 nvmf_tcp.nvmf_host.nvmf_async_init -- nvmf/common.sh@436 -- # local -g is_hw=no 00:21:41.977 11:32:37 nvmf_tcp.nvmf_host.nvmf_async_init -- nvmf/common.sh@438 -- # remove_spdk_ns 00:21:41.977 11:32:37 nvmf_tcp.nvmf_host.nvmf_async_init -- nvmf/common.sh@654 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:21:41.977 11:32:37 nvmf_tcp.nvmf_host.nvmf_async_init -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 15> /dev/null' 00:21:41.977 11:32:37 nvmf_tcp.nvmf_host.nvmf_async_init -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:21:41.977 11:32:37 nvmf_tcp.nvmf_host.nvmf_async_init -- nvmf/common.sh@440 -- # [[ virt != virt ]] 00:21:41.977 11:32:37 nvmf_tcp.nvmf_host.nvmf_async_init -- nvmf/common.sh@442 -- # [[ no == yes ]] 00:21:41.977 11:32:37 nvmf_tcp.nvmf_host.nvmf_async_init -- nvmf/common.sh@449 -- # [[ virt == phy ]] 00:21:41.977 11:32:37 nvmf_tcp.nvmf_host.nvmf_async_init -- nvmf/common.sh@452 -- # [[ virt == phy-fallback ]] 00:21:41.977 11:32:37 nvmf_tcp.nvmf_host.nvmf_async_init -- nvmf/common.sh@457 -- # [[ tcp == tcp ]] 00:21:41.977 11:32:37 nvmf_tcp.nvmf_host.nvmf_async_init -- nvmf/common.sh@458 -- # nvmf_veth_init 00:21:41.977 11:32:37 nvmf_tcp.nvmf_host.nvmf_async_init -- nvmf/common.sh@145 -- # NVMF_FIRST_INITIATOR_IP=10.0.0.1 00:21:41.977 11:32:37 nvmf_tcp.nvmf_host.nvmf_async_init -- nvmf/common.sh@146 -- # NVMF_SECOND_INITIATOR_IP=10.0.0.2 00:21:41.977 11:32:37 nvmf_tcp.nvmf_host.nvmf_async_init -- nvmf/common.sh@147 -- # NVMF_FIRST_TARGET_IP=10.0.0.3 00:21:41.977 11:32:37 nvmf_tcp.nvmf_host.nvmf_async_init -- nvmf/common.sh@148 -- # NVMF_SECOND_TARGET_IP=10.0.0.4 00:21:41.977 11:32:37 nvmf_tcp.nvmf_host.nvmf_async_init -- nvmf/common.sh@149 -- # NVMF_INITIATOR_IP=10.0.0.1 00:21:41.977 11:32:37 nvmf_tcp.nvmf_host.nvmf_async_init -- nvmf/common.sh@150 -- # NVMF_BRIDGE=nvmf_br 00:21:41.977 11:32:37 nvmf_tcp.nvmf_host.nvmf_async_init -- nvmf/common.sh@151 -- # NVMF_INITIATOR_INTERFACE=nvmf_init_if 00:21:41.977 11:32:37 nvmf_tcp.nvmf_host.nvmf_async_init -- nvmf/common.sh@152 -- # NVMF_INITIATOR_INTERFACE2=nvmf_init_if2 00:21:41.977 11:32:37 nvmf_tcp.nvmf_host.nvmf_async_init -- nvmf/common.sh@153 -- # NVMF_INITIATOR_BRIDGE=nvmf_init_br 00:21:41.977 11:32:37 nvmf_tcp.nvmf_host.nvmf_async_init -- nvmf/common.sh@154 -- # NVMF_INITIATOR_BRIDGE2=nvmf_init_br2 00:21:41.977 11:32:37 nvmf_tcp.nvmf_host.nvmf_async_init -- nvmf/common.sh@155 -- # NVMF_TARGET_NAMESPACE=nvmf_tgt_ns_spdk 00:21:41.977 11:32:37 nvmf_tcp.nvmf_host.nvmf_async_init -- nvmf/common.sh@156 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:21:41.977 11:32:37 nvmf_tcp.nvmf_host.nvmf_async_init -- nvmf/common.sh@157 -- # NVMF_TARGET_INTERFACE=nvmf_tgt_if 00:21:41.977 11:32:37 nvmf_tcp.nvmf_host.nvmf_async_init -- nvmf/common.sh@158 -- # NVMF_TARGET_INTERFACE2=nvmf_tgt_if2 00:21:41.977 11:32:37 nvmf_tcp.nvmf_host.nvmf_async_init -- nvmf/common.sh@159 -- # NVMF_TARGET_BRIDGE=nvmf_tgt_br 00:21:41.977 11:32:37 nvmf_tcp.nvmf_host.nvmf_async_init -- nvmf/common.sh@160 -- # NVMF_TARGET_BRIDGE2=nvmf_tgt_br2 00:21:41.977 11:32:37 nvmf_tcp.nvmf_host.nvmf_async_init -- nvmf/common.sh@162 -- # ip link set nvmf_init_br nomaster 00:21:41.977 Cannot find device "nvmf_init_br" 00:21:41.977 11:32:37 nvmf_tcp.nvmf_host.nvmf_async_init -- nvmf/common.sh@162 -- # true 00:21:41.977 11:32:37 nvmf_tcp.nvmf_host.nvmf_async_init -- nvmf/common.sh@163 -- # ip link set nvmf_init_br2 nomaster 00:21:41.977 Cannot find device "nvmf_init_br2" 00:21:41.977 11:32:37 nvmf_tcp.nvmf_host.nvmf_async_init -- nvmf/common.sh@163 -- # true 00:21:41.977 11:32:37 nvmf_tcp.nvmf_host.nvmf_async_init -- nvmf/common.sh@164 -- # ip link set nvmf_tgt_br nomaster 00:21:41.977 Cannot find device "nvmf_tgt_br" 00:21:41.977 11:32:37 nvmf_tcp.nvmf_host.nvmf_async_init -- nvmf/common.sh@164 -- # true 00:21:41.977 11:32:37 nvmf_tcp.nvmf_host.nvmf_async_init -- nvmf/common.sh@165 -- # ip link set nvmf_tgt_br2 nomaster 00:21:41.977 Cannot find device "nvmf_tgt_br2" 00:21:41.977 11:32:37 nvmf_tcp.nvmf_host.nvmf_async_init -- nvmf/common.sh@165 -- # true 00:21:41.977 11:32:37 nvmf_tcp.nvmf_host.nvmf_async_init -- nvmf/common.sh@166 -- # ip link set nvmf_init_br down 00:21:41.977 Cannot find device "nvmf_init_br" 00:21:41.977 11:32:37 nvmf_tcp.nvmf_host.nvmf_async_init -- nvmf/common.sh@166 -- # true 00:21:41.977 11:32:37 nvmf_tcp.nvmf_host.nvmf_async_init -- nvmf/common.sh@167 -- # ip link set nvmf_init_br2 down 00:21:41.977 Cannot find device "nvmf_init_br2" 00:21:41.977 11:32:37 nvmf_tcp.nvmf_host.nvmf_async_init -- nvmf/common.sh@167 -- # true 00:21:41.978 11:32:37 nvmf_tcp.nvmf_host.nvmf_async_init -- nvmf/common.sh@168 -- # ip link set nvmf_tgt_br down 00:21:42.235 Cannot find device "nvmf_tgt_br" 00:21:42.235 11:32:37 nvmf_tcp.nvmf_host.nvmf_async_init -- nvmf/common.sh@168 -- # true 00:21:42.235 11:32:37 nvmf_tcp.nvmf_host.nvmf_async_init -- nvmf/common.sh@169 -- # ip link set nvmf_tgt_br2 down 00:21:42.235 Cannot find device "nvmf_tgt_br2" 00:21:42.235 11:32:37 nvmf_tcp.nvmf_host.nvmf_async_init -- nvmf/common.sh@169 -- # true 00:21:42.235 11:32:37 nvmf_tcp.nvmf_host.nvmf_async_init -- nvmf/common.sh@170 -- # ip link delete nvmf_br type bridge 00:21:42.235 Cannot find device "nvmf_br" 00:21:42.235 11:32:37 nvmf_tcp.nvmf_host.nvmf_async_init -- nvmf/common.sh@170 -- # true 00:21:42.235 11:32:37 nvmf_tcp.nvmf_host.nvmf_async_init -- nvmf/common.sh@171 -- # ip link delete nvmf_init_if 00:21:42.235 Cannot find device "nvmf_init_if" 00:21:42.235 11:32:37 nvmf_tcp.nvmf_host.nvmf_async_init -- nvmf/common.sh@171 -- # true 00:21:42.235 11:32:37 nvmf_tcp.nvmf_host.nvmf_async_init -- nvmf/common.sh@172 -- # ip link delete nvmf_init_if2 00:21:42.235 Cannot find device "nvmf_init_if2" 00:21:42.235 11:32:37 nvmf_tcp.nvmf_host.nvmf_async_init -- nvmf/common.sh@172 -- # true 00:21:42.235 11:32:37 nvmf_tcp.nvmf_host.nvmf_async_init -- nvmf/common.sh@173 -- # ip netns exec nvmf_tgt_ns_spdk ip link delete nvmf_tgt_if 00:21:42.235 Cannot open network namespace "nvmf_tgt_ns_spdk": No such file or directory 00:21:42.235 11:32:37 nvmf_tcp.nvmf_host.nvmf_async_init -- nvmf/common.sh@173 -- # true 00:21:42.235 11:32:37 nvmf_tcp.nvmf_host.nvmf_async_init -- nvmf/common.sh@174 -- # ip netns exec nvmf_tgt_ns_spdk ip link delete nvmf_tgt_if2 00:21:42.235 Cannot open network namespace "nvmf_tgt_ns_spdk": No such file or directory 00:21:42.235 11:32:37 nvmf_tcp.nvmf_host.nvmf_async_init -- nvmf/common.sh@174 -- # true 00:21:42.235 11:32:37 nvmf_tcp.nvmf_host.nvmf_async_init -- nvmf/common.sh@177 -- # ip netns add nvmf_tgt_ns_spdk 00:21:42.235 11:32:37 nvmf_tcp.nvmf_host.nvmf_async_init -- nvmf/common.sh@180 -- # ip link add nvmf_init_if type veth peer name nvmf_init_br 00:21:42.235 11:32:37 nvmf_tcp.nvmf_host.nvmf_async_init -- nvmf/common.sh@181 -- # ip link add nvmf_init_if2 type veth peer name nvmf_init_br2 00:21:42.235 11:32:37 nvmf_tcp.nvmf_host.nvmf_async_init -- nvmf/common.sh@182 -- # ip link add nvmf_tgt_if type veth peer name nvmf_tgt_br 00:21:42.236 11:32:37 nvmf_tcp.nvmf_host.nvmf_async_init -- nvmf/common.sh@183 -- # ip link add nvmf_tgt_if2 type veth peer name nvmf_tgt_br2 00:21:42.236 11:32:37 nvmf_tcp.nvmf_host.nvmf_async_init -- nvmf/common.sh@186 -- # ip link set nvmf_tgt_if netns nvmf_tgt_ns_spdk 00:21:42.236 11:32:37 nvmf_tcp.nvmf_host.nvmf_async_init -- nvmf/common.sh@187 -- # ip link set nvmf_tgt_if2 netns nvmf_tgt_ns_spdk 00:21:42.236 11:32:37 nvmf_tcp.nvmf_host.nvmf_async_init -- nvmf/common.sh@190 -- # ip addr add 10.0.0.1/24 dev nvmf_init_if 00:21:42.236 11:32:37 nvmf_tcp.nvmf_host.nvmf_async_init -- nvmf/common.sh@191 -- # ip addr add 10.0.0.2/24 dev nvmf_init_if2 00:21:42.236 11:32:37 nvmf_tcp.nvmf_host.nvmf_async_init -- nvmf/common.sh@192 -- # ip netns exec nvmf_tgt_ns_spdk ip addr add 10.0.0.3/24 dev nvmf_tgt_if 00:21:42.236 11:32:37 nvmf_tcp.nvmf_host.nvmf_async_init -- nvmf/common.sh@193 -- # ip netns exec nvmf_tgt_ns_spdk ip addr add 10.0.0.4/24 dev nvmf_tgt_if2 00:21:42.236 11:32:37 nvmf_tcp.nvmf_host.nvmf_async_init -- nvmf/common.sh@196 -- # ip link set nvmf_init_if up 00:21:42.236 11:32:37 nvmf_tcp.nvmf_host.nvmf_async_init -- nvmf/common.sh@197 -- # ip link set nvmf_init_if2 up 00:21:42.236 11:32:37 nvmf_tcp.nvmf_host.nvmf_async_init -- nvmf/common.sh@198 -- # ip link set nvmf_init_br up 00:21:42.236 11:32:37 nvmf_tcp.nvmf_host.nvmf_async_init -- nvmf/common.sh@199 -- # ip link set nvmf_init_br2 up 00:21:42.236 11:32:37 nvmf_tcp.nvmf_host.nvmf_async_init -- nvmf/common.sh@200 -- # ip link set nvmf_tgt_br up 00:21:42.236 11:32:37 nvmf_tcp.nvmf_host.nvmf_async_init -- nvmf/common.sh@201 -- # ip link set nvmf_tgt_br2 up 00:21:42.236 11:32:37 nvmf_tcp.nvmf_host.nvmf_async_init -- nvmf/common.sh@202 -- # ip netns exec nvmf_tgt_ns_spdk ip link set nvmf_tgt_if up 00:21:42.236 11:32:37 nvmf_tcp.nvmf_host.nvmf_async_init -- nvmf/common.sh@203 -- # ip netns exec nvmf_tgt_ns_spdk ip link set nvmf_tgt_if2 up 00:21:42.236 11:32:37 nvmf_tcp.nvmf_host.nvmf_async_init -- nvmf/common.sh@204 -- # ip netns exec nvmf_tgt_ns_spdk ip link set lo up 00:21:42.236 11:32:37 nvmf_tcp.nvmf_host.nvmf_async_init -- nvmf/common.sh@207 -- # ip link add nvmf_br type bridge 00:21:42.236 11:32:37 nvmf_tcp.nvmf_host.nvmf_async_init -- nvmf/common.sh@208 -- # ip link set nvmf_br up 00:21:42.236 11:32:37 nvmf_tcp.nvmf_host.nvmf_async_init -- nvmf/common.sh@211 -- # ip link set nvmf_init_br master nvmf_br 00:21:42.236 11:32:37 nvmf_tcp.nvmf_host.nvmf_async_init -- nvmf/common.sh@212 -- # ip link set nvmf_init_br2 master nvmf_br 00:21:42.494 11:32:37 nvmf_tcp.nvmf_host.nvmf_async_init -- nvmf/common.sh@213 -- # ip link set nvmf_tgt_br master nvmf_br 00:21:42.494 11:32:37 nvmf_tcp.nvmf_host.nvmf_async_init -- nvmf/common.sh@214 -- # ip link set nvmf_tgt_br2 master nvmf_br 00:21:42.494 11:32:37 nvmf_tcp.nvmf_host.nvmf_async_init -- nvmf/common.sh@217 -- # ipts -I INPUT 1 -i nvmf_init_if -p tcp --dport 4420 -j ACCEPT 00:21:42.494 11:32:37 nvmf_tcp.nvmf_host.nvmf_async_init -- nvmf/common.sh@788 -- # iptables -I INPUT 1 -i nvmf_init_if -p tcp --dport 4420 -j ACCEPT -m comment --comment 'SPDK_NVMF:-I INPUT 1 -i nvmf_init_if -p tcp --dport 4420 -j ACCEPT' 00:21:42.494 11:32:37 nvmf_tcp.nvmf_host.nvmf_async_init -- nvmf/common.sh@218 -- # ipts -I INPUT 1 -i nvmf_init_if2 -p tcp --dport 4420 -j ACCEPT 00:21:42.494 11:32:37 nvmf_tcp.nvmf_host.nvmf_async_init -- nvmf/common.sh@788 -- # iptables -I INPUT 1 -i nvmf_init_if2 -p tcp --dport 4420 -j ACCEPT -m comment --comment 'SPDK_NVMF:-I INPUT 1 -i nvmf_init_if2 -p tcp --dport 4420 -j ACCEPT' 00:21:42.494 11:32:37 nvmf_tcp.nvmf_host.nvmf_async_init -- nvmf/common.sh@219 -- # ipts -A FORWARD -i nvmf_br -o nvmf_br -j ACCEPT 00:21:42.494 11:32:37 nvmf_tcp.nvmf_host.nvmf_async_init -- nvmf/common.sh@788 -- # iptables -A FORWARD -i nvmf_br -o nvmf_br -j ACCEPT -m comment --comment 'SPDK_NVMF:-A FORWARD -i nvmf_br -o nvmf_br -j ACCEPT' 00:21:42.494 11:32:37 nvmf_tcp.nvmf_host.nvmf_async_init -- nvmf/common.sh@222 -- # ping -c 1 10.0.0.3 00:21:42.494 PING 10.0.0.3 (10.0.0.3) 56(84) bytes of data. 00:21:42.494 64 bytes from 10.0.0.3: icmp_seq=1 ttl=64 time=0.109 ms 00:21:42.494 00:21:42.494 --- 10.0.0.3 ping statistics --- 00:21:42.494 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:21:42.494 rtt min/avg/max/mdev = 0.109/0.109/0.109/0.000 ms 00:21:42.494 11:32:37 nvmf_tcp.nvmf_host.nvmf_async_init -- nvmf/common.sh@223 -- # ping -c 1 10.0.0.4 00:21:42.494 PING 10.0.0.4 (10.0.0.4) 56(84) bytes of data. 00:21:42.494 64 bytes from 10.0.0.4: icmp_seq=1 ttl=64 time=0.057 ms 00:21:42.494 00:21:42.494 --- 10.0.0.4 ping statistics --- 00:21:42.494 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:21:42.494 rtt min/avg/max/mdev = 0.057/0.057/0.057/0.000 ms 00:21:42.494 11:32:37 nvmf_tcp.nvmf_host.nvmf_async_init -- nvmf/common.sh@224 -- # ip netns exec nvmf_tgt_ns_spdk ping -c 1 10.0.0.1 00:21:42.494 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:21:42.494 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.034 ms 00:21:42.494 00:21:42.494 --- 10.0.0.1 ping statistics --- 00:21:42.494 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:21:42.494 rtt min/avg/max/mdev = 0.034/0.034/0.034/0.000 ms 00:21:42.494 11:32:37 nvmf_tcp.nvmf_host.nvmf_async_init -- nvmf/common.sh@225 -- # ip netns exec nvmf_tgt_ns_spdk ping -c 1 10.0.0.2 00:21:42.494 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:21:42.494 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.149 ms 00:21:42.494 00:21:42.494 --- 10.0.0.2 ping statistics --- 00:21:42.494 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:21:42.494 rtt min/avg/max/mdev = 0.149/0.149/0.149/0.000 ms 00:21:42.494 11:32:37 nvmf_tcp.nvmf_host.nvmf_async_init -- nvmf/common.sh@227 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:21:42.494 11:32:37 nvmf_tcp.nvmf_host.nvmf_async_init -- nvmf/common.sh@459 -- # return 0 00:21:42.494 11:32:37 nvmf_tcp.nvmf_host.nvmf_async_init -- nvmf/common.sh@476 -- # '[' '' == iso ']' 00:21:42.494 11:32:37 nvmf_tcp.nvmf_host.nvmf_async_init -- nvmf/common.sh@480 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:21:42.494 11:32:37 nvmf_tcp.nvmf_host.nvmf_async_init -- nvmf/common.sh@481 -- # [[ tcp == \r\d\m\a ]] 00:21:42.494 11:32:37 nvmf_tcp.nvmf_host.nvmf_async_init -- nvmf/common.sh@490 -- # [[ tcp == \t\c\p ]] 00:21:42.494 11:32:37 nvmf_tcp.nvmf_host.nvmf_async_init -- nvmf/common.sh@491 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:21:42.494 11:32:37 nvmf_tcp.nvmf_host.nvmf_async_init -- nvmf/common.sh@494 -- # '[' tcp == tcp ']' 00:21:42.494 11:32:37 nvmf_tcp.nvmf_host.nvmf_async_init -- nvmf/common.sh@500 -- # modprobe nvme-tcp 00:21:42.494 11:32:37 nvmf_tcp.nvmf_host.nvmf_async_init -- host/async_init.sh@23 -- # nvmfappstart -m 0x1 00:21:42.494 11:32:37 nvmf_tcp.nvmf_host.nvmf_async_init -- nvmf/common.sh@505 -- # timing_enter start_nvmf_tgt 00:21:42.494 11:32:37 nvmf_tcp.nvmf_host.nvmf_async_init -- common/autotest_common.sh@724 -- # xtrace_disable 00:21:42.494 11:32:37 nvmf_tcp.nvmf_host.nvmf_async_init -- common/autotest_common.sh@10 -- # set +x 00:21:42.494 11:32:37 nvmf_tcp.nvmf_host.nvmf_async_init -- nvmf/common.sh@507 -- # nvmfpid=87369 00:21:42.494 11:32:37 nvmf_tcp.nvmf_host.nvmf_async_init -- nvmf/common.sh@508 -- # waitforlisten 87369 00:21:42.494 11:32:37 nvmf_tcp.nvmf_host.nvmf_async_init -- common/autotest_common.sh@831 -- # '[' -z 87369 ']' 00:21:42.494 11:32:37 nvmf_tcp.nvmf_host.nvmf_async_init -- common/autotest_common.sh@835 -- # local rpc_addr=/var/tmp/spdk.sock 00:21:42.494 11:32:37 nvmf_tcp.nvmf_host.nvmf_async_init -- nvmf/common.sh@506 -- # ip netns exec nvmf_tgt_ns_spdk /home/vagrant/spdk_repo/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x1 00:21:42.494 11:32:37 nvmf_tcp.nvmf_host.nvmf_async_init -- common/autotest_common.sh@836 -- # local max_retries=100 00:21:42.494 11:32:37 nvmf_tcp.nvmf_host.nvmf_async_init -- common/autotest_common.sh@838 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:21:42.494 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:21:42.494 11:32:37 nvmf_tcp.nvmf_host.nvmf_async_init -- common/autotest_common.sh@840 -- # xtrace_disable 00:21:42.494 11:32:37 nvmf_tcp.nvmf_host.nvmf_async_init -- common/autotest_common.sh@10 -- # set +x 00:21:42.494 [2024-10-07 11:32:37.964012] Starting SPDK v25.01-pre git sha1 2a4f56c54 / DPDK 24.03.0 initialization... 00:21:42.494 [2024-10-07 11:32:37.964161] [ DPDK EAL parameters: nvmf -c 0x1 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --iova-mode=pa --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:21:42.752 [2024-10-07 11:32:38.107383] app.c: 917:spdk_app_start: *NOTICE*: Total cores available: 1 00:21:42.752 [2024-10-07 11:32:38.249887] app.c: 610:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:21:42.752 [2024-10-07 11:32:38.249975] app.c: 611:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:21:42.752 [2024-10-07 11:32:38.250011] app.c: 616:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:21:42.752 [2024-10-07 11:32:38.250021] app.c: 617:app_setup_trace: *NOTICE*: SPDK application currently running. 00:21:42.752 [2024-10-07 11:32:38.250030] app.c: 618:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:21:42.752 [2024-10-07 11:32:38.250583] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 0 00:21:43.716 11:32:39 nvmf_tcp.nvmf_host.nvmf_async_init -- common/autotest_common.sh@860 -- # (( i == 0 )) 00:21:43.716 11:32:39 nvmf_tcp.nvmf_host.nvmf_async_init -- common/autotest_common.sh@864 -- # return 0 00:21:43.716 11:32:39 nvmf_tcp.nvmf_host.nvmf_async_init -- nvmf/common.sh@509 -- # timing_exit start_nvmf_tgt 00:21:43.716 11:32:39 nvmf_tcp.nvmf_host.nvmf_async_init -- common/autotest_common.sh@730 -- # xtrace_disable 00:21:43.716 11:32:39 nvmf_tcp.nvmf_host.nvmf_async_init -- common/autotest_common.sh@10 -- # set +x 00:21:43.716 11:32:39 nvmf_tcp.nvmf_host.nvmf_async_init -- nvmf/common.sh@510 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:21:43.716 11:32:39 nvmf_tcp.nvmf_host.nvmf_async_init -- host/async_init.sh@26 -- # rpc_cmd nvmf_create_transport -t tcp -o 00:21:43.716 11:32:39 nvmf_tcp.nvmf_host.nvmf_async_init -- common/autotest_common.sh@561 -- # xtrace_disable 00:21:43.716 11:32:39 nvmf_tcp.nvmf_host.nvmf_async_init -- common/autotest_common.sh@10 -- # set +x 00:21:43.716 [2024-10-07 11:32:39.197441] tcp.c: 738:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:21:43.716 11:32:39 nvmf_tcp.nvmf_host.nvmf_async_init -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:21:43.716 11:32:39 nvmf_tcp.nvmf_host.nvmf_async_init -- host/async_init.sh@27 -- # rpc_cmd bdev_null_create null0 1024 512 00:21:43.716 11:32:39 nvmf_tcp.nvmf_host.nvmf_async_init -- common/autotest_common.sh@561 -- # xtrace_disable 00:21:43.716 11:32:39 nvmf_tcp.nvmf_host.nvmf_async_init -- common/autotest_common.sh@10 -- # set +x 00:21:43.716 null0 00:21:43.716 11:32:39 nvmf_tcp.nvmf_host.nvmf_async_init -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:21:43.716 11:32:39 nvmf_tcp.nvmf_host.nvmf_async_init -- host/async_init.sh@28 -- # rpc_cmd bdev_wait_for_examine 00:21:43.716 11:32:39 nvmf_tcp.nvmf_host.nvmf_async_init -- common/autotest_common.sh@561 -- # xtrace_disable 00:21:43.716 11:32:39 nvmf_tcp.nvmf_host.nvmf_async_init -- common/autotest_common.sh@10 -- # set +x 00:21:43.716 11:32:39 nvmf_tcp.nvmf_host.nvmf_async_init -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:21:43.716 11:32:39 nvmf_tcp.nvmf_host.nvmf_async_init -- host/async_init.sh@29 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 -a 00:21:43.716 11:32:39 nvmf_tcp.nvmf_host.nvmf_async_init -- common/autotest_common.sh@561 -- # xtrace_disable 00:21:43.716 11:32:39 nvmf_tcp.nvmf_host.nvmf_async_init -- common/autotest_common.sh@10 -- # set +x 00:21:43.716 11:32:39 nvmf_tcp.nvmf_host.nvmf_async_init -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:21:43.716 11:32:39 nvmf_tcp.nvmf_host.nvmf_async_init -- host/async_init.sh@30 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 null0 -g f6b1558bdd6d47fa944cc0678c454cf7 00:21:43.716 11:32:39 nvmf_tcp.nvmf_host.nvmf_async_init -- common/autotest_common.sh@561 -- # xtrace_disable 00:21:43.716 11:32:39 nvmf_tcp.nvmf_host.nvmf_async_init -- common/autotest_common.sh@10 -- # set +x 00:21:43.974 11:32:39 nvmf_tcp.nvmf_host.nvmf_async_init -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:21:43.974 11:32:39 nvmf_tcp.nvmf_host.nvmf_async_init -- host/async_init.sh@31 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.3 -s 4420 00:21:43.974 11:32:39 nvmf_tcp.nvmf_host.nvmf_async_init -- common/autotest_common.sh@561 -- # xtrace_disable 00:21:43.974 11:32:39 nvmf_tcp.nvmf_host.nvmf_async_init -- common/autotest_common.sh@10 -- # set +x 00:21:43.974 [2024-10-07 11:32:39.245766] tcp.c:1081:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.3 port 4420 *** 00:21:43.974 11:32:39 nvmf_tcp.nvmf_host.nvmf_async_init -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:21:43.974 11:32:39 nvmf_tcp.nvmf_host.nvmf_async_init -- host/async_init.sh@37 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t tcp -a 10.0.0.3 -f ipv4 -s 4420 -n nqn.2016-06.io.spdk:cnode0 00:21:43.975 11:32:39 nvmf_tcp.nvmf_host.nvmf_async_init -- common/autotest_common.sh@561 -- # xtrace_disable 00:21:43.975 11:32:39 nvmf_tcp.nvmf_host.nvmf_async_init -- common/autotest_common.sh@10 -- # set +x 00:21:43.975 nvme0n1 00:21:43.975 11:32:39 nvmf_tcp.nvmf_host.nvmf_async_init -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:21:43.975 11:32:39 nvmf_tcp.nvmf_host.nvmf_async_init -- host/async_init.sh@41 -- # rpc_cmd bdev_get_bdevs -b nvme0n1 00:21:43.975 11:32:39 nvmf_tcp.nvmf_host.nvmf_async_init -- common/autotest_common.sh@561 -- # xtrace_disable 00:21:43.975 11:32:39 nvmf_tcp.nvmf_host.nvmf_async_init -- common/autotest_common.sh@10 -- # set +x 00:21:44.233 [ 00:21:44.233 { 00:21:44.233 "aliases": [ 00:21:44.233 "f6b1558b-dd6d-47fa-944c-c0678c454cf7" 00:21:44.233 ], 00:21:44.233 "assigned_rate_limits": { 00:21:44.233 "r_mbytes_per_sec": 0, 00:21:44.233 "rw_ios_per_sec": 0, 00:21:44.233 "rw_mbytes_per_sec": 0, 00:21:44.233 "w_mbytes_per_sec": 0 00:21:44.233 }, 00:21:44.233 "block_size": 512, 00:21:44.233 "claimed": false, 00:21:44.233 "driver_specific": { 00:21:44.233 "mp_policy": "active_passive", 00:21:44.233 "nvme": [ 00:21:44.233 { 00:21:44.233 "ctrlr_data": { 00:21:44.233 "ana_reporting": false, 00:21:44.233 "cntlid": 1, 00:21:44.233 "firmware_revision": "25.01", 00:21:44.233 "model_number": "SPDK bdev Controller", 00:21:44.233 "multi_ctrlr": true, 00:21:44.233 "oacs": { 00:21:44.233 "firmware": 0, 00:21:44.233 "format": 0, 00:21:44.233 "ns_manage": 0, 00:21:44.233 "security": 0 00:21:44.233 }, 00:21:44.233 "serial_number": "00000000000000000000", 00:21:44.233 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:21:44.233 "vendor_id": "0x8086" 00:21:44.233 }, 00:21:44.233 "ns_data": { 00:21:44.233 "can_share": true, 00:21:44.233 "id": 1 00:21:44.233 }, 00:21:44.233 "trid": { 00:21:44.233 "adrfam": "IPv4", 00:21:44.233 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:21:44.233 "traddr": "10.0.0.3", 00:21:44.233 "trsvcid": "4420", 00:21:44.233 "trtype": "TCP" 00:21:44.233 }, 00:21:44.233 "vs": { 00:21:44.233 "nvme_version": "1.3" 00:21:44.233 } 00:21:44.233 } 00:21:44.233 ] 00:21:44.233 }, 00:21:44.233 "memory_domains": [ 00:21:44.233 { 00:21:44.233 "dma_device_id": "system", 00:21:44.233 "dma_device_type": 1 00:21:44.233 } 00:21:44.233 ], 00:21:44.233 "name": "nvme0n1", 00:21:44.233 "num_blocks": 2097152, 00:21:44.233 "numa_id": -1, 00:21:44.233 "product_name": "NVMe disk", 00:21:44.233 "supported_io_types": { 00:21:44.233 "abort": true, 00:21:44.233 "compare": true, 00:21:44.233 "compare_and_write": true, 00:21:44.233 "copy": true, 00:21:44.233 "flush": true, 00:21:44.233 "get_zone_info": false, 00:21:44.233 "nvme_admin": true, 00:21:44.233 "nvme_io": true, 00:21:44.233 "nvme_io_md": false, 00:21:44.233 "nvme_iov_md": false, 00:21:44.233 "read": true, 00:21:44.233 "reset": true, 00:21:44.233 "seek_data": false, 00:21:44.233 "seek_hole": false, 00:21:44.233 "unmap": false, 00:21:44.233 "write": true, 00:21:44.233 "write_zeroes": true, 00:21:44.233 "zcopy": false, 00:21:44.233 "zone_append": false, 00:21:44.233 "zone_management": false 00:21:44.233 }, 00:21:44.233 "uuid": "f6b1558b-dd6d-47fa-944c-c0678c454cf7", 00:21:44.233 "zoned": false 00:21:44.233 } 00:21:44.233 ] 00:21:44.233 11:32:39 nvmf_tcp.nvmf_host.nvmf_async_init -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:21:44.233 11:32:39 nvmf_tcp.nvmf_host.nvmf_async_init -- host/async_init.sh@44 -- # rpc_cmd bdev_nvme_reset_controller nvme0 00:21:44.233 11:32:39 nvmf_tcp.nvmf_host.nvmf_async_init -- common/autotest_common.sh@561 -- # xtrace_disable 00:21:44.233 11:32:39 nvmf_tcp.nvmf_host.nvmf_async_init -- common/autotest_common.sh@10 -- # set +x 00:21:44.233 [2024-10-07 11:32:39.527281] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode0] resetting controller 00:21:44.233 [2024-10-07 11:32:39.527403] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x22e5c00 (9): Bad file descriptor 00:21:44.233 [2024-10-07 11:32:39.660025] bdev_nvme.c:2183:_bdev_nvme_reset_ctrlr_complete: *NOTICE*: Resetting controller successful. 00:21:44.233 11:32:39 nvmf_tcp.nvmf_host.nvmf_async_init -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:21:44.233 11:32:39 nvmf_tcp.nvmf_host.nvmf_async_init -- host/async_init.sh@47 -- # rpc_cmd bdev_get_bdevs -b nvme0n1 00:21:44.233 11:32:39 nvmf_tcp.nvmf_host.nvmf_async_init -- common/autotest_common.sh@561 -- # xtrace_disable 00:21:44.234 11:32:39 nvmf_tcp.nvmf_host.nvmf_async_init -- common/autotest_common.sh@10 -- # set +x 00:21:44.234 [ 00:21:44.234 { 00:21:44.234 "aliases": [ 00:21:44.234 "f6b1558b-dd6d-47fa-944c-c0678c454cf7" 00:21:44.234 ], 00:21:44.234 "assigned_rate_limits": { 00:21:44.234 "r_mbytes_per_sec": 0, 00:21:44.234 "rw_ios_per_sec": 0, 00:21:44.234 "rw_mbytes_per_sec": 0, 00:21:44.234 "w_mbytes_per_sec": 0 00:21:44.234 }, 00:21:44.234 "block_size": 512, 00:21:44.234 "claimed": false, 00:21:44.234 "driver_specific": { 00:21:44.234 "mp_policy": "active_passive", 00:21:44.234 "nvme": [ 00:21:44.234 { 00:21:44.234 "ctrlr_data": { 00:21:44.234 "ana_reporting": false, 00:21:44.234 "cntlid": 2, 00:21:44.234 "firmware_revision": "25.01", 00:21:44.234 "model_number": "SPDK bdev Controller", 00:21:44.234 "multi_ctrlr": true, 00:21:44.234 "oacs": { 00:21:44.234 "firmware": 0, 00:21:44.234 "format": 0, 00:21:44.234 "ns_manage": 0, 00:21:44.234 "security": 0 00:21:44.234 }, 00:21:44.234 "serial_number": "00000000000000000000", 00:21:44.234 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:21:44.234 "vendor_id": "0x8086" 00:21:44.234 }, 00:21:44.234 "ns_data": { 00:21:44.234 "can_share": true, 00:21:44.234 "id": 1 00:21:44.234 }, 00:21:44.234 "trid": { 00:21:44.234 "adrfam": "IPv4", 00:21:44.234 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:21:44.234 "traddr": "10.0.0.3", 00:21:44.234 "trsvcid": "4420", 00:21:44.234 "trtype": "TCP" 00:21:44.234 }, 00:21:44.234 "vs": { 00:21:44.234 "nvme_version": "1.3" 00:21:44.234 } 00:21:44.234 } 00:21:44.234 ] 00:21:44.234 }, 00:21:44.234 "memory_domains": [ 00:21:44.234 { 00:21:44.234 "dma_device_id": "system", 00:21:44.234 "dma_device_type": 1 00:21:44.234 } 00:21:44.234 ], 00:21:44.234 "name": "nvme0n1", 00:21:44.234 "num_blocks": 2097152, 00:21:44.234 "numa_id": -1, 00:21:44.234 "product_name": "NVMe disk", 00:21:44.234 "supported_io_types": { 00:21:44.234 "abort": true, 00:21:44.234 "compare": true, 00:21:44.234 "compare_and_write": true, 00:21:44.234 "copy": true, 00:21:44.234 "flush": true, 00:21:44.234 "get_zone_info": false, 00:21:44.234 "nvme_admin": true, 00:21:44.234 "nvme_io": true, 00:21:44.234 "nvme_io_md": false, 00:21:44.234 "nvme_iov_md": false, 00:21:44.234 "read": true, 00:21:44.234 "reset": true, 00:21:44.234 "seek_data": false, 00:21:44.234 "seek_hole": false, 00:21:44.234 "unmap": false, 00:21:44.234 "write": true, 00:21:44.234 "write_zeroes": true, 00:21:44.234 "zcopy": false, 00:21:44.234 "zone_append": false, 00:21:44.234 "zone_management": false 00:21:44.234 }, 00:21:44.234 "uuid": "f6b1558b-dd6d-47fa-944c-c0678c454cf7", 00:21:44.234 "zoned": false 00:21:44.234 } 00:21:44.234 ] 00:21:44.234 11:32:39 nvmf_tcp.nvmf_host.nvmf_async_init -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:21:44.234 11:32:39 nvmf_tcp.nvmf_host.nvmf_async_init -- host/async_init.sh@50 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:21:44.234 11:32:39 nvmf_tcp.nvmf_host.nvmf_async_init -- common/autotest_common.sh@561 -- # xtrace_disable 00:21:44.234 11:32:39 nvmf_tcp.nvmf_host.nvmf_async_init -- common/autotest_common.sh@10 -- # set +x 00:21:44.234 11:32:39 nvmf_tcp.nvmf_host.nvmf_async_init -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:21:44.234 11:32:39 nvmf_tcp.nvmf_host.nvmf_async_init -- host/async_init.sh@53 -- # mktemp 00:21:44.234 11:32:39 nvmf_tcp.nvmf_host.nvmf_async_init -- host/async_init.sh@53 -- # key_path=/tmp/tmp.LAB3tefXsG 00:21:44.234 11:32:39 nvmf_tcp.nvmf_host.nvmf_async_init -- host/async_init.sh@54 -- # echo -n NVMeTLSkey-1:01:MDAxMTIyMzM0NDU1NjY3Nzg4OTlhYWJiY2NkZGVlZmZwJEiQ: 00:21:44.234 11:32:39 nvmf_tcp.nvmf_host.nvmf_async_init -- host/async_init.sh@55 -- # chmod 0600 /tmp/tmp.LAB3tefXsG 00:21:44.234 11:32:39 nvmf_tcp.nvmf_host.nvmf_async_init -- host/async_init.sh@56 -- # rpc_cmd keyring_file_add_key key0 /tmp/tmp.LAB3tefXsG 00:21:44.234 11:32:39 nvmf_tcp.nvmf_host.nvmf_async_init -- common/autotest_common.sh@561 -- # xtrace_disable 00:21:44.234 11:32:39 nvmf_tcp.nvmf_host.nvmf_async_init -- common/autotest_common.sh@10 -- # set +x 00:21:44.234 11:32:39 nvmf_tcp.nvmf_host.nvmf_async_init -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:21:44.234 11:32:39 nvmf_tcp.nvmf_host.nvmf_async_init -- host/async_init.sh@57 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode0 --disable 00:21:44.234 11:32:39 nvmf_tcp.nvmf_host.nvmf_async_init -- common/autotest_common.sh@561 -- # xtrace_disable 00:21:44.234 11:32:39 nvmf_tcp.nvmf_host.nvmf_async_init -- common/autotest_common.sh@10 -- # set +x 00:21:44.234 11:32:39 nvmf_tcp.nvmf_host.nvmf_async_init -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:21:44.234 11:32:39 nvmf_tcp.nvmf_host.nvmf_async_init -- host/async_init.sh@58 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.3 -s 4421 --secure-channel 00:21:44.234 11:32:39 nvmf_tcp.nvmf_host.nvmf_async_init -- common/autotest_common.sh@561 -- # xtrace_disable 00:21:44.234 11:32:39 nvmf_tcp.nvmf_host.nvmf_async_init -- common/autotest_common.sh@10 -- # set +x 00:21:44.234 [2024-10-07 11:32:39.751438] tcp.c:1031:nvmf_tcp_listen: *NOTICE*: TLS support is considered experimental 00:21:44.234 [2024-10-07 11:32:39.751605] tcp.c:1081:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.3 port 4421 *** 00:21:44.234 11:32:39 nvmf_tcp.nvmf_host.nvmf_async_init -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:21:44.234 11:32:39 nvmf_tcp.nvmf_host.nvmf_async_init -- host/async_init.sh@60 -- # rpc_cmd nvmf_subsystem_add_host nqn.2016-06.io.spdk:cnode0 nqn.2016-06.io.spdk:host1 --psk key0 00:21:44.234 11:32:39 nvmf_tcp.nvmf_host.nvmf_async_init -- common/autotest_common.sh@561 -- # xtrace_disable 00:21:44.234 11:32:39 nvmf_tcp.nvmf_host.nvmf_async_init -- common/autotest_common.sh@10 -- # set +x 00:21:44.492 11:32:39 nvmf_tcp.nvmf_host.nvmf_async_init -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:21:44.492 11:32:39 nvmf_tcp.nvmf_host.nvmf_async_init -- host/async_init.sh@66 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t tcp -a 10.0.0.3 -f ipv4 -s 4421 -n nqn.2016-06.io.spdk:cnode0 -q nqn.2016-06.io.spdk:host1 --psk key0 00:21:44.492 11:32:39 nvmf_tcp.nvmf_host.nvmf_async_init -- common/autotest_common.sh@561 -- # xtrace_disable 00:21:44.492 11:32:39 nvmf_tcp.nvmf_host.nvmf_async_init -- common/autotest_common.sh@10 -- # set +x 00:21:44.492 [2024-10-07 11:32:39.767447] bdev_nvme_rpc.c: 514:rpc_bdev_nvme_attach_controller: *NOTICE*: TLS support is considered experimental 00:21:44.492 nvme0n1 00:21:44.492 11:32:39 nvmf_tcp.nvmf_host.nvmf_async_init -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:21:44.492 11:32:39 nvmf_tcp.nvmf_host.nvmf_async_init -- host/async_init.sh@70 -- # rpc_cmd bdev_get_bdevs -b nvme0n1 00:21:44.492 11:32:39 nvmf_tcp.nvmf_host.nvmf_async_init -- common/autotest_common.sh@561 -- # xtrace_disable 00:21:44.492 11:32:39 nvmf_tcp.nvmf_host.nvmf_async_init -- common/autotest_common.sh@10 -- # set +x 00:21:44.492 [ 00:21:44.492 { 00:21:44.492 "aliases": [ 00:21:44.492 "f6b1558b-dd6d-47fa-944c-c0678c454cf7" 00:21:44.492 ], 00:21:44.492 "assigned_rate_limits": { 00:21:44.492 "r_mbytes_per_sec": 0, 00:21:44.493 "rw_ios_per_sec": 0, 00:21:44.493 "rw_mbytes_per_sec": 0, 00:21:44.493 "w_mbytes_per_sec": 0 00:21:44.493 }, 00:21:44.493 "block_size": 512, 00:21:44.493 "claimed": false, 00:21:44.493 "driver_specific": { 00:21:44.493 "mp_policy": "active_passive", 00:21:44.493 "nvme": [ 00:21:44.493 { 00:21:44.493 "ctrlr_data": { 00:21:44.493 "ana_reporting": false, 00:21:44.493 "cntlid": 3, 00:21:44.493 "firmware_revision": "25.01", 00:21:44.493 "model_number": "SPDK bdev Controller", 00:21:44.493 "multi_ctrlr": true, 00:21:44.493 "oacs": { 00:21:44.493 "firmware": 0, 00:21:44.493 "format": 0, 00:21:44.493 "ns_manage": 0, 00:21:44.493 "security": 0 00:21:44.493 }, 00:21:44.493 "serial_number": "00000000000000000000", 00:21:44.493 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:21:44.493 "vendor_id": "0x8086" 00:21:44.493 }, 00:21:44.493 "ns_data": { 00:21:44.493 "can_share": true, 00:21:44.493 "id": 1 00:21:44.493 }, 00:21:44.493 "trid": { 00:21:44.493 "adrfam": "IPv4", 00:21:44.493 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:21:44.493 "traddr": "10.0.0.3", 00:21:44.493 "trsvcid": "4421", 00:21:44.493 "trtype": "TCP" 00:21:44.493 }, 00:21:44.493 "vs": { 00:21:44.493 "nvme_version": "1.3" 00:21:44.493 } 00:21:44.493 } 00:21:44.493 ] 00:21:44.493 }, 00:21:44.493 "memory_domains": [ 00:21:44.493 { 00:21:44.493 "dma_device_id": "system", 00:21:44.493 "dma_device_type": 1 00:21:44.493 } 00:21:44.493 ], 00:21:44.493 "name": "nvme0n1", 00:21:44.493 "num_blocks": 2097152, 00:21:44.493 "numa_id": -1, 00:21:44.493 "product_name": "NVMe disk", 00:21:44.493 "supported_io_types": { 00:21:44.493 "abort": true, 00:21:44.493 "compare": true, 00:21:44.493 "compare_and_write": true, 00:21:44.493 "copy": true, 00:21:44.493 "flush": true, 00:21:44.493 "get_zone_info": false, 00:21:44.493 "nvme_admin": true, 00:21:44.493 "nvme_io": true, 00:21:44.493 "nvme_io_md": false, 00:21:44.493 "nvme_iov_md": false, 00:21:44.493 "read": true, 00:21:44.493 "reset": true, 00:21:44.493 "seek_data": false, 00:21:44.493 "seek_hole": false, 00:21:44.493 "unmap": false, 00:21:44.493 "write": true, 00:21:44.493 "write_zeroes": true, 00:21:44.493 "zcopy": false, 00:21:44.493 "zone_append": false, 00:21:44.493 "zone_management": false 00:21:44.493 }, 00:21:44.493 "uuid": "f6b1558b-dd6d-47fa-944c-c0678c454cf7", 00:21:44.493 "zoned": false 00:21:44.493 } 00:21:44.493 ] 00:21:44.493 11:32:39 nvmf_tcp.nvmf_host.nvmf_async_init -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:21:44.493 11:32:39 nvmf_tcp.nvmf_host.nvmf_async_init -- host/async_init.sh@73 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:21:44.493 11:32:39 nvmf_tcp.nvmf_host.nvmf_async_init -- common/autotest_common.sh@561 -- # xtrace_disable 00:21:44.493 11:32:39 nvmf_tcp.nvmf_host.nvmf_async_init -- common/autotest_common.sh@10 -- # set +x 00:21:44.493 11:32:39 nvmf_tcp.nvmf_host.nvmf_async_init -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:21:44.493 11:32:39 nvmf_tcp.nvmf_host.nvmf_async_init -- host/async_init.sh@76 -- # rm -f /tmp/tmp.LAB3tefXsG 00:21:44.493 11:32:39 nvmf_tcp.nvmf_host.nvmf_async_init -- host/async_init.sh@78 -- # trap - SIGINT SIGTERM EXIT 00:21:44.493 11:32:39 nvmf_tcp.nvmf_host.nvmf_async_init -- host/async_init.sh@79 -- # nvmftestfini 00:21:44.493 11:32:39 nvmf_tcp.nvmf_host.nvmf_async_init -- nvmf/common.sh@514 -- # nvmfcleanup 00:21:44.493 11:32:39 nvmf_tcp.nvmf_host.nvmf_async_init -- nvmf/common.sh@121 -- # sync 00:21:44.493 11:32:39 nvmf_tcp.nvmf_host.nvmf_async_init -- nvmf/common.sh@123 -- # '[' tcp == tcp ']' 00:21:44.493 11:32:39 nvmf_tcp.nvmf_host.nvmf_async_init -- nvmf/common.sh@124 -- # set +e 00:21:44.493 11:32:39 nvmf_tcp.nvmf_host.nvmf_async_init -- nvmf/common.sh@125 -- # for i in {1..20} 00:21:44.493 11:32:39 nvmf_tcp.nvmf_host.nvmf_async_init -- nvmf/common.sh@126 -- # modprobe -v -r nvme-tcp 00:21:44.493 rmmod nvme_tcp 00:21:44.493 rmmod nvme_fabrics 00:21:44.493 rmmod nvme_keyring 00:21:44.493 11:32:39 nvmf_tcp.nvmf_host.nvmf_async_init -- nvmf/common.sh@127 -- # modprobe -v -r nvme-fabrics 00:21:44.493 11:32:40 nvmf_tcp.nvmf_host.nvmf_async_init -- nvmf/common.sh@128 -- # set -e 00:21:44.493 11:32:40 nvmf_tcp.nvmf_host.nvmf_async_init -- nvmf/common.sh@129 -- # return 0 00:21:44.493 11:32:40 nvmf_tcp.nvmf_host.nvmf_async_init -- nvmf/common.sh@515 -- # '[' -n 87369 ']' 00:21:44.493 11:32:40 nvmf_tcp.nvmf_host.nvmf_async_init -- nvmf/common.sh@516 -- # killprocess 87369 00:21:44.493 11:32:40 nvmf_tcp.nvmf_host.nvmf_async_init -- common/autotest_common.sh@950 -- # '[' -z 87369 ']' 00:21:44.493 11:32:40 nvmf_tcp.nvmf_host.nvmf_async_init -- common/autotest_common.sh@954 -- # kill -0 87369 00:21:44.493 11:32:40 nvmf_tcp.nvmf_host.nvmf_async_init -- common/autotest_common.sh@955 -- # uname 00:21:44.493 11:32:40 nvmf_tcp.nvmf_host.nvmf_async_init -- common/autotest_common.sh@955 -- # '[' Linux = Linux ']' 00:21:44.493 11:32:40 nvmf_tcp.nvmf_host.nvmf_async_init -- common/autotest_common.sh@956 -- # ps --no-headers -o comm= 87369 00:21:44.752 11:32:40 nvmf_tcp.nvmf_host.nvmf_async_init -- common/autotest_common.sh@956 -- # process_name=reactor_0 00:21:44.752 11:32:40 nvmf_tcp.nvmf_host.nvmf_async_init -- common/autotest_common.sh@960 -- # '[' reactor_0 = sudo ']' 00:21:44.752 11:32:40 nvmf_tcp.nvmf_host.nvmf_async_init -- common/autotest_common.sh@968 -- # echo 'killing process with pid 87369' 00:21:44.752 killing process with pid 87369 00:21:44.752 11:32:40 nvmf_tcp.nvmf_host.nvmf_async_init -- common/autotest_common.sh@969 -- # kill 87369 00:21:44.752 11:32:40 nvmf_tcp.nvmf_host.nvmf_async_init -- common/autotest_common.sh@974 -- # wait 87369 00:21:45.010 11:32:40 nvmf_tcp.nvmf_host.nvmf_async_init -- nvmf/common.sh@518 -- # '[' '' == iso ']' 00:21:45.010 11:32:40 nvmf_tcp.nvmf_host.nvmf_async_init -- nvmf/common.sh@521 -- # [[ tcp == \t\c\p ]] 00:21:45.010 11:32:40 nvmf_tcp.nvmf_host.nvmf_async_init -- nvmf/common.sh@522 -- # nvmf_tcp_fini 00:21:45.010 11:32:40 nvmf_tcp.nvmf_host.nvmf_async_init -- nvmf/common.sh@297 -- # iptr 00:21:45.010 11:32:40 nvmf_tcp.nvmf_host.nvmf_async_init -- nvmf/common.sh@789 -- # iptables-save 00:21:45.010 11:32:40 nvmf_tcp.nvmf_host.nvmf_async_init -- nvmf/common.sh@789 -- # grep -v SPDK_NVMF 00:21:45.010 11:32:40 nvmf_tcp.nvmf_host.nvmf_async_init -- nvmf/common.sh@789 -- # iptables-restore 00:21:45.010 11:32:40 nvmf_tcp.nvmf_host.nvmf_async_init -- nvmf/common.sh@298 -- # [[ nvmf_tgt_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s\_\s\p\d\k ]] 00:21:45.010 11:32:40 nvmf_tcp.nvmf_host.nvmf_async_init -- nvmf/common.sh@299 -- # nvmf_veth_fini 00:21:45.010 11:32:40 nvmf_tcp.nvmf_host.nvmf_async_init -- nvmf/common.sh@233 -- # ip link set nvmf_init_br nomaster 00:21:45.010 11:32:40 nvmf_tcp.nvmf_host.nvmf_async_init -- nvmf/common.sh@234 -- # ip link set nvmf_init_br2 nomaster 00:21:45.010 11:32:40 nvmf_tcp.nvmf_host.nvmf_async_init -- nvmf/common.sh@235 -- # ip link set nvmf_tgt_br nomaster 00:21:45.010 11:32:40 nvmf_tcp.nvmf_host.nvmf_async_init -- nvmf/common.sh@236 -- # ip link set nvmf_tgt_br2 nomaster 00:21:45.010 11:32:40 nvmf_tcp.nvmf_host.nvmf_async_init -- nvmf/common.sh@237 -- # ip link set nvmf_init_br down 00:21:45.010 11:32:40 nvmf_tcp.nvmf_host.nvmf_async_init -- nvmf/common.sh@238 -- # ip link set nvmf_init_br2 down 00:21:45.010 11:32:40 nvmf_tcp.nvmf_host.nvmf_async_init -- nvmf/common.sh@239 -- # ip link set nvmf_tgt_br down 00:21:45.010 11:32:40 nvmf_tcp.nvmf_host.nvmf_async_init -- nvmf/common.sh@240 -- # ip link set nvmf_tgt_br2 down 00:21:45.010 11:32:40 nvmf_tcp.nvmf_host.nvmf_async_init -- nvmf/common.sh@241 -- # ip link delete nvmf_br type bridge 00:21:45.010 11:32:40 nvmf_tcp.nvmf_host.nvmf_async_init -- nvmf/common.sh@242 -- # ip link delete nvmf_init_if 00:21:45.010 11:32:40 nvmf_tcp.nvmf_host.nvmf_async_init -- nvmf/common.sh@243 -- # ip link delete nvmf_init_if2 00:21:45.010 11:32:40 nvmf_tcp.nvmf_host.nvmf_async_init -- nvmf/common.sh@244 -- # ip netns exec nvmf_tgt_ns_spdk ip link delete nvmf_tgt_if 00:21:45.010 11:32:40 nvmf_tcp.nvmf_host.nvmf_async_init -- nvmf/common.sh@245 -- # ip netns exec nvmf_tgt_ns_spdk ip link delete nvmf_tgt_if2 00:21:45.010 11:32:40 nvmf_tcp.nvmf_host.nvmf_async_init -- nvmf/common.sh@246 -- # remove_spdk_ns 00:21:45.010 11:32:40 nvmf_tcp.nvmf_host.nvmf_async_init -- nvmf/common.sh@654 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:21:45.010 11:32:40 nvmf_tcp.nvmf_host.nvmf_async_init -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 15> /dev/null' 00:21:45.010 11:32:40 nvmf_tcp.nvmf_host.nvmf_async_init -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:21:45.269 11:32:40 nvmf_tcp.nvmf_host.nvmf_async_init -- nvmf/common.sh@300 -- # return 0 00:21:45.269 00:21:45.269 real 0m3.371s 00:21:45.269 user 0m3.068s 00:21:45.269 sys 0m0.858s 00:21:45.269 11:32:40 nvmf_tcp.nvmf_host.nvmf_async_init -- common/autotest_common.sh@1126 -- # xtrace_disable 00:21:45.269 11:32:40 nvmf_tcp.nvmf_host.nvmf_async_init -- common/autotest_common.sh@10 -- # set +x 00:21:45.269 ************************************ 00:21:45.269 END TEST nvmf_async_init 00:21:45.269 ************************************ 00:21:45.269 11:32:40 nvmf_tcp.nvmf_host -- nvmf/nvmf_host.sh@19 -- # run_test dma /home/vagrant/spdk_repo/spdk/test/nvmf/host/dma.sh --transport=tcp 00:21:45.269 11:32:40 nvmf_tcp.nvmf_host -- common/autotest_common.sh@1101 -- # '[' 3 -le 1 ']' 00:21:45.269 11:32:40 nvmf_tcp.nvmf_host -- common/autotest_common.sh@1107 -- # xtrace_disable 00:21:45.269 11:32:40 nvmf_tcp.nvmf_host -- common/autotest_common.sh@10 -- # set +x 00:21:45.269 ************************************ 00:21:45.269 START TEST dma 00:21:45.269 ************************************ 00:21:45.269 11:32:40 nvmf_tcp.nvmf_host.dma -- common/autotest_common.sh@1125 -- # /home/vagrant/spdk_repo/spdk/test/nvmf/host/dma.sh --transport=tcp 00:21:45.269 * Looking for test storage... 00:21:45.269 * Found test storage at /home/vagrant/spdk_repo/spdk/test/nvmf/host 00:21:45.269 11:32:40 nvmf_tcp.nvmf_host.dma -- common/autotest_common.sh@1680 -- # [[ y == y ]] 00:21:45.269 11:32:40 nvmf_tcp.nvmf_host.dma -- common/autotest_common.sh@1681 -- # lcov --version 00:21:45.269 11:32:40 nvmf_tcp.nvmf_host.dma -- common/autotest_common.sh@1681 -- # awk '{print $NF}' 00:21:45.541 11:32:40 nvmf_tcp.nvmf_host.dma -- common/autotest_common.sh@1681 -- # lt 1.15 2 00:21:45.541 11:32:40 nvmf_tcp.nvmf_host.dma -- scripts/common.sh@373 -- # cmp_versions 1.15 '<' 2 00:21:45.541 11:32:40 nvmf_tcp.nvmf_host.dma -- scripts/common.sh@333 -- # local ver1 ver1_l 00:21:45.541 11:32:40 nvmf_tcp.nvmf_host.dma -- scripts/common.sh@334 -- # local ver2 ver2_l 00:21:45.541 11:32:40 nvmf_tcp.nvmf_host.dma -- scripts/common.sh@336 -- # IFS=.-: 00:21:45.541 11:32:40 nvmf_tcp.nvmf_host.dma -- scripts/common.sh@336 -- # read -ra ver1 00:21:45.541 11:32:40 nvmf_tcp.nvmf_host.dma -- scripts/common.sh@337 -- # IFS=.-: 00:21:45.541 11:32:40 nvmf_tcp.nvmf_host.dma -- scripts/common.sh@337 -- # read -ra ver2 00:21:45.541 11:32:40 nvmf_tcp.nvmf_host.dma -- scripts/common.sh@338 -- # local 'op=<' 00:21:45.541 11:32:40 nvmf_tcp.nvmf_host.dma -- scripts/common.sh@340 -- # ver1_l=2 00:21:45.541 11:32:40 nvmf_tcp.nvmf_host.dma -- scripts/common.sh@341 -- # ver2_l=1 00:21:45.541 11:32:40 nvmf_tcp.nvmf_host.dma -- scripts/common.sh@343 -- # local lt=0 gt=0 eq=0 v 00:21:45.541 11:32:40 nvmf_tcp.nvmf_host.dma -- scripts/common.sh@344 -- # case "$op" in 00:21:45.541 11:32:40 nvmf_tcp.nvmf_host.dma -- scripts/common.sh@345 -- # : 1 00:21:45.541 11:32:40 nvmf_tcp.nvmf_host.dma -- scripts/common.sh@364 -- # (( v = 0 )) 00:21:45.541 11:32:40 nvmf_tcp.nvmf_host.dma -- scripts/common.sh@364 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:21:45.541 11:32:40 nvmf_tcp.nvmf_host.dma -- scripts/common.sh@365 -- # decimal 1 00:21:45.541 11:32:40 nvmf_tcp.nvmf_host.dma -- scripts/common.sh@353 -- # local d=1 00:21:45.541 11:32:40 nvmf_tcp.nvmf_host.dma -- scripts/common.sh@354 -- # [[ 1 =~ ^[0-9]+$ ]] 00:21:45.541 11:32:40 nvmf_tcp.nvmf_host.dma -- scripts/common.sh@355 -- # echo 1 00:21:45.541 11:32:40 nvmf_tcp.nvmf_host.dma -- scripts/common.sh@365 -- # ver1[v]=1 00:21:45.541 11:32:40 nvmf_tcp.nvmf_host.dma -- scripts/common.sh@366 -- # decimal 2 00:21:45.541 11:32:40 nvmf_tcp.nvmf_host.dma -- scripts/common.sh@353 -- # local d=2 00:21:45.541 11:32:40 nvmf_tcp.nvmf_host.dma -- scripts/common.sh@354 -- # [[ 2 =~ ^[0-9]+$ ]] 00:21:45.541 11:32:40 nvmf_tcp.nvmf_host.dma -- scripts/common.sh@355 -- # echo 2 00:21:45.541 11:32:40 nvmf_tcp.nvmf_host.dma -- scripts/common.sh@366 -- # ver2[v]=2 00:21:45.541 11:32:40 nvmf_tcp.nvmf_host.dma -- scripts/common.sh@367 -- # (( ver1[v] > ver2[v] )) 00:21:45.541 11:32:40 nvmf_tcp.nvmf_host.dma -- scripts/common.sh@368 -- # (( ver1[v] < ver2[v] )) 00:21:45.541 11:32:40 nvmf_tcp.nvmf_host.dma -- scripts/common.sh@368 -- # return 0 00:21:45.541 11:32:40 nvmf_tcp.nvmf_host.dma -- common/autotest_common.sh@1682 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:21:45.541 11:32:40 nvmf_tcp.nvmf_host.dma -- common/autotest_common.sh@1694 -- # export 'LCOV_OPTS= 00:21:45.541 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:21:45.541 --rc genhtml_branch_coverage=1 00:21:45.541 --rc genhtml_function_coverage=1 00:21:45.541 --rc genhtml_legend=1 00:21:45.541 --rc geninfo_all_blocks=1 00:21:45.541 --rc geninfo_unexecuted_blocks=1 00:21:45.541 00:21:45.541 ' 00:21:45.541 11:32:40 nvmf_tcp.nvmf_host.dma -- common/autotest_common.sh@1694 -- # LCOV_OPTS=' 00:21:45.541 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:21:45.541 --rc genhtml_branch_coverage=1 00:21:45.541 --rc genhtml_function_coverage=1 00:21:45.541 --rc genhtml_legend=1 00:21:45.541 --rc geninfo_all_blocks=1 00:21:45.541 --rc geninfo_unexecuted_blocks=1 00:21:45.541 00:21:45.541 ' 00:21:45.541 11:32:40 nvmf_tcp.nvmf_host.dma -- common/autotest_common.sh@1695 -- # export 'LCOV=lcov 00:21:45.541 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:21:45.541 --rc genhtml_branch_coverage=1 00:21:45.541 --rc genhtml_function_coverage=1 00:21:45.541 --rc genhtml_legend=1 00:21:45.541 --rc geninfo_all_blocks=1 00:21:45.541 --rc geninfo_unexecuted_blocks=1 00:21:45.541 00:21:45.541 ' 00:21:45.541 11:32:40 nvmf_tcp.nvmf_host.dma -- common/autotest_common.sh@1695 -- # LCOV='lcov 00:21:45.541 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:21:45.541 --rc genhtml_branch_coverage=1 00:21:45.541 --rc genhtml_function_coverage=1 00:21:45.541 --rc genhtml_legend=1 00:21:45.541 --rc geninfo_all_blocks=1 00:21:45.541 --rc geninfo_unexecuted_blocks=1 00:21:45.541 00:21:45.541 ' 00:21:45.541 11:32:40 nvmf_tcp.nvmf_host.dma -- host/dma.sh@10 -- # source /home/vagrant/spdk_repo/spdk/test/nvmf/common.sh 00:21:45.541 11:32:40 nvmf_tcp.nvmf_host.dma -- nvmf/common.sh@7 -- # uname -s 00:21:45.541 11:32:40 nvmf_tcp.nvmf_host.dma -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:21:45.541 11:32:40 nvmf_tcp.nvmf_host.dma -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:21:45.541 11:32:40 nvmf_tcp.nvmf_host.dma -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:21:45.541 11:32:40 nvmf_tcp.nvmf_host.dma -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:21:45.541 11:32:40 nvmf_tcp.nvmf_host.dma -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:21:45.541 11:32:40 nvmf_tcp.nvmf_host.dma -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:21:45.541 11:32:40 nvmf_tcp.nvmf_host.dma -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:21:45.541 11:32:40 nvmf_tcp.nvmf_host.dma -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:21:45.541 11:32:40 nvmf_tcp.nvmf_host.dma -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:21:45.541 11:32:40 nvmf_tcp.nvmf_host.dma -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:21:45.541 11:32:40 nvmf_tcp.nvmf_host.dma -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:c758a4ed-f09f-4c82-9afb-3d096f035464 00:21:45.542 11:32:40 nvmf_tcp.nvmf_host.dma -- nvmf/common.sh@18 -- # NVME_HOSTID=c758a4ed-f09f-4c82-9afb-3d096f035464 00:21:45.542 11:32:40 nvmf_tcp.nvmf_host.dma -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:21:45.542 11:32:40 nvmf_tcp.nvmf_host.dma -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:21:45.542 11:32:40 nvmf_tcp.nvmf_host.dma -- nvmf/common.sh@21 -- # NET_TYPE=virt 00:21:45.542 11:32:40 nvmf_tcp.nvmf_host.dma -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:21:45.542 11:32:40 nvmf_tcp.nvmf_host.dma -- nvmf/common.sh@49 -- # source /home/vagrant/spdk_repo/spdk/scripts/common.sh 00:21:45.542 11:32:40 nvmf_tcp.nvmf_host.dma -- scripts/common.sh@15 -- # shopt -s extglob 00:21:45.542 11:32:40 nvmf_tcp.nvmf_host.dma -- scripts/common.sh@544 -- # [[ -e /bin/wpdk_common.sh ]] 00:21:45.542 11:32:40 nvmf_tcp.nvmf_host.dma -- scripts/common.sh@552 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:21:45.542 11:32:40 nvmf_tcp.nvmf_host.dma -- scripts/common.sh@553 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:21:45.542 11:32:40 nvmf_tcp.nvmf_host.dma -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:21:45.542 11:32:40 nvmf_tcp.nvmf_host.dma -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:21:45.542 11:32:40 nvmf_tcp.nvmf_host.dma -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:21:45.542 11:32:40 nvmf_tcp.nvmf_host.dma -- paths/export.sh@5 -- # export PATH 00:21:45.542 11:32:40 nvmf_tcp.nvmf_host.dma -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:21:45.542 11:32:40 nvmf_tcp.nvmf_host.dma -- nvmf/common.sh@51 -- # : 0 00:21:45.542 11:32:40 nvmf_tcp.nvmf_host.dma -- nvmf/common.sh@52 -- # export NVMF_APP_SHM_ID 00:21:45.542 11:32:40 nvmf_tcp.nvmf_host.dma -- nvmf/common.sh@53 -- # build_nvmf_app_args 00:21:45.542 11:32:40 nvmf_tcp.nvmf_host.dma -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:21:45.542 11:32:40 nvmf_tcp.nvmf_host.dma -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:21:45.542 11:32:40 nvmf_tcp.nvmf_host.dma -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:21:45.542 11:32:40 nvmf_tcp.nvmf_host.dma -- nvmf/common.sh@33 -- # '[' '' -eq 1 ']' 00:21:45.542 /home/vagrant/spdk_repo/spdk/test/nvmf/common.sh: line 33: [: : integer expression expected 00:21:45.542 11:32:40 nvmf_tcp.nvmf_host.dma -- nvmf/common.sh@37 -- # '[' -n '' ']' 00:21:45.542 11:32:40 nvmf_tcp.nvmf_host.dma -- nvmf/common.sh@39 -- # '[' 0 -eq 1 ']' 00:21:45.542 11:32:40 nvmf_tcp.nvmf_host.dma -- nvmf/common.sh@55 -- # have_pci_nics=0 00:21:45.542 11:32:40 nvmf_tcp.nvmf_host.dma -- host/dma.sh@12 -- # '[' tcp '!=' rdma ']' 00:21:45.542 11:32:40 nvmf_tcp.nvmf_host.dma -- host/dma.sh@13 -- # exit 0 00:21:45.542 00:21:45.542 real 0m0.240s 00:21:45.542 user 0m0.148s 00:21:45.542 sys 0m0.107s 00:21:45.542 11:32:40 nvmf_tcp.nvmf_host.dma -- common/autotest_common.sh@1126 -- # xtrace_disable 00:21:45.542 11:32:40 nvmf_tcp.nvmf_host.dma -- common/autotest_common.sh@10 -- # set +x 00:21:45.542 ************************************ 00:21:45.542 END TEST dma 00:21:45.542 ************************************ 00:21:45.542 11:32:40 nvmf_tcp.nvmf_host -- nvmf/nvmf_host.sh@22 -- # run_test nvmf_identify /home/vagrant/spdk_repo/spdk/test/nvmf/host/identify.sh --transport=tcp 00:21:45.542 11:32:40 nvmf_tcp.nvmf_host -- common/autotest_common.sh@1101 -- # '[' 3 -le 1 ']' 00:21:45.542 11:32:40 nvmf_tcp.nvmf_host -- common/autotest_common.sh@1107 -- # xtrace_disable 00:21:45.542 11:32:40 nvmf_tcp.nvmf_host -- common/autotest_common.sh@10 -- # set +x 00:21:45.542 ************************************ 00:21:45.542 START TEST nvmf_identify 00:21:45.542 ************************************ 00:21:45.542 11:32:40 nvmf_tcp.nvmf_host.nvmf_identify -- common/autotest_common.sh@1125 -- # /home/vagrant/spdk_repo/spdk/test/nvmf/host/identify.sh --transport=tcp 00:21:45.542 * Looking for test storage... 00:21:45.542 * Found test storage at /home/vagrant/spdk_repo/spdk/test/nvmf/host 00:21:45.542 11:32:40 nvmf_tcp.nvmf_host.nvmf_identify -- common/autotest_common.sh@1680 -- # [[ y == y ]] 00:21:45.542 11:32:41 nvmf_tcp.nvmf_host.nvmf_identify -- common/autotest_common.sh@1681 -- # lcov --version 00:21:45.542 11:32:41 nvmf_tcp.nvmf_host.nvmf_identify -- common/autotest_common.sh@1681 -- # awk '{print $NF}' 00:21:45.801 11:32:41 nvmf_tcp.nvmf_host.nvmf_identify -- common/autotest_common.sh@1681 -- # lt 1.15 2 00:21:45.801 11:32:41 nvmf_tcp.nvmf_host.nvmf_identify -- scripts/common.sh@373 -- # cmp_versions 1.15 '<' 2 00:21:45.801 11:32:41 nvmf_tcp.nvmf_host.nvmf_identify -- scripts/common.sh@333 -- # local ver1 ver1_l 00:21:45.801 11:32:41 nvmf_tcp.nvmf_host.nvmf_identify -- scripts/common.sh@334 -- # local ver2 ver2_l 00:21:45.801 11:32:41 nvmf_tcp.nvmf_host.nvmf_identify -- scripts/common.sh@336 -- # IFS=.-: 00:21:45.801 11:32:41 nvmf_tcp.nvmf_host.nvmf_identify -- scripts/common.sh@336 -- # read -ra ver1 00:21:45.801 11:32:41 nvmf_tcp.nvmf_host.nvmf_identify -- scripts/common.sh@337 -- # IFS=.-: 00:21:45.801 11:32:41 nvmf_tcp.nvmf_host.nvmf_identify -- scripts/common.sh@337 -- # read -ra ver2 00:21:45.801 11:32:41 nvmf_tcp.nvmf_host.nvmf_identify -- scripts/common.sh@338 -- # local 'op=<' 00:21:45.801 11:32:41 nvmf_tcp.nvmf_host.nvmf_identify -- scripts/common.sh@340 -- # ver1_l=2 00:21:45.801 11:32:41 nvmf_tcp.nvmf_host.nvmf_identify -- scripts/common.sh@341 -- # ver2_l=1 00:21:45.801 11:32:41 nvmf_tcp.nvmf_host.nvmf_identify -- scripts/common.sh@343 -- # local lt=0 gt=0 eq=0 v 00:21:45.801 11:32:41 nvmf_tcp.nvmf_host.nvmf_identify -- scripts/common.sh@344 -- # case "$op" in 00:21:45.801 11:32:41 nvmf_tcp.nvmf_host.nvmf_identify -- scripts/common.sh@345 -- # : 1 00:21:45.801 11:32:41 nvmf_tcp.nvmf_host.nvmf_identify -- scripts/common.sh@364 -- # (( v = 0 )) 00:21:45.801 11:32:41 nvmf_tcp.nvmf_host.nvmf_identify -- scripts/common.sh@364 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:21:45.801 11:32:41 nvmf_tcp.nvmf_host.nvmf_identify -- scripts/common.sh@365 -- # decimal 1 00:21:45.801 11:32:41 nvmf_tcp.nvmf_host.nvmf_identify -- scripts/common.sh@353 -- # local d=1 00:21:45.801 11:32:41 nvmf_tcp.nvmf_host.nvmf_identify -- scripts/common.sh@354 -- # [[ 1 =~ ^[0-9]+$ ]] 00:21:45.801 11:32:41 nvmf_tcp.nvmf_host.nvmf_identify -- scripts/common.sh@355 -- # echo 1 00:21:45.801 11:32:41 nvmf_tcp.nvmf_host.nvmf_identify -- scripts/common.sh@365 -- # ver1[v]=1 00:21:45.801 11:32:41 nvmf_tcp.nvmf_host.nvmf_identify -- scripts/common.sh@366 -- # decimal 2 00:21:45.801 11:32:41 nvmf_tcp.nvmf_host.nvmf_identify -- scripts/common.sh@353 -- # local d=2 00:21:45.801 11:32:41 nvmf_tcp.nvmf_host.nvmf_identify -- scripts/common.sh@354 -- # [[ 2 =~ ^[0-9]+$ ]] 00:21:45.801 11:32:41 nvmf_tcp.nvmf_host.nvmf_identify -- scripts/common.sh@355 -- # echo 2 00:21:45.801 11:32:41 nvmf_tcp.nvmf_host.nvmf_identify -- scripts/common.sh@366 -- # ver2[v]=2 00:21:45.801 11:32:41 nvmf_tcp.nvmf_host.nvmf_identify -- scripts/common.sh@367 -- # (( ver1[v] > ver2[v] )) 00:21:45.801 11:32:41 nvmf_tcp.nvmf_host.nvmf_identify -- scripts/common.sh@368 -- # (( ver1[v] < ver2[v] )) 00:21:45.801 11:32:41 nvmf_tcp.nvmf_host.nvmf_identify -- scripts/common.sh@368 -- # return 0 00:21:45.801 11:32:41 nvmf_tcp.nvmf_host.nvmf_identify -- common/autotest_common.sh@1682 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:21:45.801 11:32:41 nvmf_tcp.nvmf_host.nvmf_identify -- common/autotest_common.sh@1694 -- # export 'LCOV_OPTS= 00:21:45.801 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:21:45.801 --rc genhtml_branch_coverage=1 00:21:45.801 --rc genhtml_function_coverage=1 00:21:45.801 --rc genhtml_legend=1 00:21:45.801 --rc geninfo_all_blocks=1 00:21:45.801 --rc geninfo_unexecuted_blocks=1 00:21:45.801 00:21:45.801 ' 00:21:45.801 11:32:41 nvmf_tcp.nvmf_host.nvmf_identify -- common/autotest_common.sh@1694 -- # LCOV_OPTS=' 00:21:45.801 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:21:45.801 --rc genhtml_branch_coverage=1 00:21:45.801 --rc genhtml_function_coverage=1 00:21:45.801 --rc genhtml_legend=1 00:21:45.801 --rc geninfo_all_blocks=1 00:21:45.801 --rc geninfo_unexecuted_blocks=1 00:21:45.801 00:21:45.801 ' 00:21:45.801 11:32:41 nvmf_tcp.nvmf_host.nvmf_identify -- common/autotest_common.sh@1695 -- # export 'LCOV=lcov 00:21:45.801 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:21:45.801 --rc genhtml_branch_coverage=1 00:21:45.801 --rc genhtml_function_coverage=1 00:21:45.801 --rc genhtml_legend=1 00:21:45.801 --rc geninfo_all_blocks=1 00:21:45.801 --rc geninfo_unexecuted_blocks=1 00:21:45.801 00:21:45.801 ' 00:21:45.801 11:32:41 nvmf_tcp.nvmf_host.nvmf_identify -- common/autotest_common.sh@1695 -- # LCOV='lcov 00:21:45.801 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:21:45.801 --rc genhtml_branch_coverage=1 00:21:45.801 --rc genhtml_function_coverage=1 00:21:45.801 --rc genhtml_legend=1 00:21:45.801 --rc geninfo_all_blocks=1 00:21:45.801 --rc geninfo_unexecuted_blocks=1 00:21:45.801 00:21:45.801 ' 00:21:45.801 11:32:41 nvmf_tcp.nvmf_host.nvmf_identify -- host/identify.sh@9 -- # source /home/vagrant/spdk_repo/spdk/test/nvmf/common.sh 00:21:45.801 11:32:41 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@7 -- # uname -s 00:21:45.801 11:32:41 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:21:45.801 11:32:41 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:21:45.801 11:32:41 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:21:45.801 11:32:41 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:21:45.801 11:32:41 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:21:45.801 11:32:41 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:21:45.801 11:32:41 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:21:45.801 11:32:41 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:21:45.801 11:32:41 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:21:45.801 11:32:41 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:21:45.801 11:32:41 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:c758a4ed-f09f-4c82-9afb-3d096f035464 00:21:45.801 11:32:41 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@18 -- # NVME_HOSTID=c758a4ed-f09f-4c82-9afb-3d096f035464 00:21:45.801 11:32:41 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:21:45.801 11:32:41 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:21:45.801 11:32:41 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@21 -- # NET_TYPE=virt 00:21:45.801 11:32:41 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:21:45.801 11:32:41 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@49 -- # source /home/vagrant/spdk_repo/spdk/scripts/common.sh 00:21:45.801 11:32:41 nvmf_tcp.nvmf_host.nvmf_identify -- scripts/common.sh@15 -- # shopt -s extglob 00:21:45.801 11:32:41 nvmf_tcp.nvmf_host.nvmf_identify -- scripts/common.sh@544 -- # [[ -e /bin/wpdk_common.sh ]] 00:21:45.801 11:32:41 nvmf_tcp.nvmf_host.nvmf_identify -- scripts/common.sh@552 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:21:45.801 11:32:41 nvmf_tcp.nvmf_host.nvmf_identify -- scripts/common.sh@553 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:21:45.801 11:32:41 nvmf_tcp.nvmf_host.nvmf_identify -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:21:45.801 11:32:41 nvmf_tcp.nvmf_host.nvmf_identify -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:21:45.801 11:32:41 nvmf_tcp.nvmf_host.nvmf_identify -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:21:45.801 11:32:41 nvmf_tcp.nvmf_host.nvmf_identify -- paths/export.sh@5 -- # export PATH 00:21:45.802 11:32:41 nvmf_tcp.nvmf_host.nvmf_identify -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:21:45.802 11:32:41 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@51 -- # : 0 00:21:45.802 11:32:41 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@52 -- # export NVMF_APP_SHM_ID 00:21:45.802 11:32:41 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@53 -- # build_nvmf_app_args 00:21:45.802 11:32:41 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:21:45.802 11:32:41 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:21:45.802 11:32:41 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:21:45.802 11:32:41 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@33 -- # '[' '' -eq 1 ']' 00:21:45.802 /home/vagrant/spdk_repo/spdk/test/nvmf/common.sh: line 33: [: : integer expression expected 00:21:45.802 11:32:41 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@37 -- # '[' -n '' ']' 00:21:45.802 11:32:41 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@39 -- # '[' 0 -eq 1 ']' 00:21:45.802 11:32:41 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@55 -- # have_pci_nics=0 00:21:45.802 11:32:41 nvmf_tcp.nvmf_host.nvmf_identify -- host/identify.sh@11 -- # MALLOC_BDEV_SIZE=64 00:21:45.802 11:32:41 nvmf_tcp.nvmf_host.nvmf_identify -- host/identify.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:21:45.802 11:32:41 nvmf_tcp.nvmf_host.nvmf_identify -- host/identify.sh@14 -- # nvmftestinit 00:21:45.802 11:32:41 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@467 -- # '[' -z tcp ']' 00:21:45.802 11:32:41 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@472 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:21:45.802 11:32:41 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@474 -- # prepare_net_devs 00:21:45.802 11:32:41 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@436 -- # local -g is_hw=no 00:21:45.802 11:32:41 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@438 -- # remove_spdk_ns 00:21:45.802 11:32:41 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@654 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:21:45.802 11:32:41 nvmf_tcp.nvmf_host.nvmf_identify -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 15> /dev/null' 00:21:45.802 11:32:41 nvmf_tcp.nvmf_host.nvmf_identify -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:21:45.802 11:32:41 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@440 -- # [[ virt != virt ]] 00:21:45.802 11:32:41 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@442 -- # [[ no == yes ]] 00:21:45.802 11:32:41 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@449 -- # [[ virt == phy ]] 00:21:45.802 11:32:41 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@452 -- # [[ virt == phy-fallback ]] 00:21:45.802 11:32:41 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@457 -- # [[ tcp == tcp ]] 00:21:45.802 11:32:41 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@458 -- # nvmf_veth_init 00:21:45.802 11:32:41 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@145 -- # NVMF_FIRST_INITIATOR_IP=10.0.0.1 00:21:45.802 11:32:41 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@146 -- # NVMF_SECOND_INITIATOR_IP=10.0.0.2 00:21:45.802 11:32:41 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@147 -- # NVMF_FIRST_TARGET_IP=10.0.0.3 00:21:45.802 11:32:41 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@148 -- # NVMF_SECOND_TARGET_IP=10.0.0.4 00:21:45.802 11:32:41 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@149 -- # NVMF_INITIATOR_IP=10.0.0.1 00:21:45.802 11:32:41 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@150 -- # NVMF_BRIDGE=nvmf_br 00:21:45.802 11:32:41 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@151 -- # NVMF_INITIATOR_INTERFACE=nvmf_init_if 00:21:45.802 11:32:41 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@152 -- # NVMF_INITIATOR_INTERFACE2=nvmf_init_if2 00:21:45.802 11:32:41 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@153 -- # NVMF_INITIATOR_BRIDGE=nvmf_init_br 00:21:45.802 11:32:41 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@154 -- # NVMF_INITIATOR_BRIDGE2=nvmf_init_br2 00:21:45.802 11:32:41 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@155 -- # NVMF_TARGET_NAMESPACE=nvmf_tgt_ns_spdk 00:21:45.802 11:32:41 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@156 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:21:45.802 11:32:41 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@157 -- # NVMF_TARGET_INTERFACE=nvmf_tgt_if 00:21:45.802 11:32:41 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@158 -- # NVMF_TARGET_INTERFACE2=nvmf_tgt_if2 00:21:45.802 11:32:41 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@159 -- # NVMF_TARGET_BRIDGE=nvmf_tgt_br 00:21:45.802 11:32:41 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@160 -- # NVMF_TARGET_BRIDGE2=nvmf_tgt_br2 00:21:45.802 11:32:41 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@162 -- # ip link set nvmf_init_br nomaster 00:21:45.802 Cannot find device "nvmf_init_br" 00:21:45.802 11:32:41 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@162 -- # true 00:21:45.802 11:32:41 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@163 -- # ip link set nvmf_init_br2 nomaster 00:21:45.802 Cannot find device "nvmf_init_br2" 00:21:45.802 11:32:41 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@163 -- # true 00:21:45.802 11:32:41 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@164 -- # ip link set nvmf_tgt_br nomaster 00:21:45.802 Cannot find device "nvmf_tgt_br" 00:21:45.802 11:32:41 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@164 -- # true 00:21:45.802 11:32:41 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@165 -- # ip link set nvmf_tgt_br2 nomaster 00:21:45.802 Cannot find device "nvmf_tgt_br2" 00:21:45.802 11:32:41 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@165 -- # true 00:21:45.802 11:32:41 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@166 -- # ip link set nvmf_init_br down 00:21:45.802 Cannot find device "nvmf_init_br" 00:21:45.802 11:32:41 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@166 -- # true 00:21:45.802 11:32:41 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@167 -- # ip link set nvmf_init_br2 down 00:21:45.802 Cannot find device "nvmf_init_br2" 00:21:45.802 11:32:41 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@167 -- # true 00:21:45.802 11:32:41 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@168 -- # ip link set nvmf_tgt_br down 00:21:45.802 Cannot find device "nvmf_tgt_br" 00:21:45.802 11:32:41 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@168 -- # true 00:21:45.802 11:32:41 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@169 -- # ip link set nvmf_tgt_br2 down 00:21:45.802 Cannot find device "nvmf_tgt_br2" 00:21:45.802 11:32:41 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@169 -- # true 00:21:45.802 11:32:41 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@170 -- # ip link delete nvmf_br type bridge 00:21:45.802 Cannot find device "nvmf_br" 00:21:45.802 11:32:41 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@170 -- # true 00:21:45.802 11:32:41 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@171 -- # ip link delete nvmf_init_if 00:21:45.802 Cannot find device "nvmf_init_if" 00:21:45.802 11:32:41 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@171 -- # true 00:21:45.802 11:32:41 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@172 -- # ip link delete nvmf_init_if2 00:21:45.802 Cannot find device "nvmf_init_if2" 00:21:45.802 11:32:41 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@172 -- # true 00:21:45.802 11:32:41 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@173 -- # ip netns exec nvmf_tgt_ns_spdk ip link delete nvmf_tgt_if 00:21:45.802 Cannot open network namespace "nvmf_tgt_ns_spdk": No such file or directory 00:21:45.802 11:32:41 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@173 -- # true 00:21:45.802 11:32:41 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@174 -- # ip netns exec nvmf_tgt_ns_spdk ip link delete nvmf_tgt_if2 00:21:45.802 Cannot open network namespace "nvmf_tgt_ns_spdk": No such file or directory 00:21:45.802 11:32:41 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@174 -- # true 00:21:45.802 11:32:41 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@177 -- # ip netns add nvmf_tgt_ns_spdk 00:21:45.802 11:32:41 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@180 -- # ip link add nvmf_init_if type veth peer name nvmf_init_br 00:21:45.802 11:32:41 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@181 -- # ip link add nvmf_init_if2 type veth peer name nvmf_init_br2 00:21:45.802 11:32:41 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@182 -- # ip link add nvmf_tgt_if type veth peer name nvmf_tgt_br 00:21:46.061 11:32:41 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@183 -- # ip link add nvmf_tgt_if2 type veth peer name nvmf_tgt_br2 00:21:46.061 11:32:41 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@186 -- # ip link set nvmf_tgt_if netns nvmf_tgt_ns_spdk 00:21:46.061 11:32:41 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@187 -- # ip link set nvmf_tgt_if2 netns nvmf_tgt_ns_spdk 00:21:46.061 11:32:41 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@190 -- # ip addr add 10.0.0.1/24 dev nvmf_init_if 00:21:46.061 11:32:41 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@191 -- # ip addr add 10.0.0.2/24 dev nvmf_init_if2 00:21:46.061 11:32:41 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@192 -- # ip netns exec nvmf_tgt_ns_spdk ip addr add 10.0.0.3/24 dev nvmf_tgt_if 00:21:46.061 11:32:41 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@193 -- # ip netns exec nvmf_tgt_ns_spdk ip addr add 10.0.0.4/24 dev nvmf_tgt_if2 00:21:46.061 11:32:41 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@196 -- # ip link set nvmf_init_if up 00:21:46.061 11:32:41 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@197 -- # ip link set nvmf_init_if2 up 00:21:46.061 11:32:41 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@198 -- # ip link set nvmf_init_br up 00:21:46.061 11:32:41 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@199 -- # ip link set nvmf_init_br2 up 00:21:46.061 11:32:41 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@200 -- # ip link set nvmf_tgt_br up 00:21:46.061 11:32:41 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@201 -- # ip link set nvmf_tgt_br2 up 00:21:46.061 11:32:41 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@202 -- # ip netns exec nvmf_tgt_ns_spdk ip link set nvmf_tgt_if up 00:21:46.061 11:32:41 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@203 -- # ip netns exec nvmf_tgt_ns_spdk ip link set nvmf_tgt_if2 up 00:21:46.061 11:32:41 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@204 -- # ip netns exec nvmf_tgt_ns_spdk ip link set lo up 00:21:46.061 11:32:41 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@207 -- # ip link add nvmf_br type bridge 00:21:46.061 11:32:41 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@208 -- # ip link set nvmf_br up 00:21:46.061 11:32:41 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@211 -- # ip link set nvmf_init_br master nvmf_br 00:21:46.061 11:32:41 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@212 -- # ip link set nvmf_init_br2 master nvmf_br 00:21:46.061 11:32:41 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@213 -- # ip link set nvmf_tgt_br master nvmf_br 00:21:46.061 11:32:41 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@214 -- # ip link set nvmf_tgt_br2 master nvmf_br 00:21:46.061 11:32:41 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@217 -- # ipts -I INPUT 1 -i nvmf_init_if -p tcp --dport 4420 -j ACCEPT 00:21:46.061 11:32:41 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@788 -- # iptables -I INPUT 1 -i nvmf_init_if -p tcp --dport 4420 -j ACCEPT -m comment --comment 'SPDK_NVMF:-I INPUT 1 -i nvmf_init_if -p tcp --dport 4420 -j ACCEPT' 00:21:46.061 11:32:41 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@218 -- # ipts -I INPUT 1 -i nvmf_init_if2 -p tcp --dport 4420 -j ACCEPT 00:21:46.061 11:32:41 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@788 -- # iptables -I INPUT 1 -i nvmf_init_if2 -p tcp --dport 4420 -j ACCEPT -m comment --comment 'SPDK_NVMF:-I INPUT 1 -i nvmf_init_if2 -p tcp --dport 4420 -j ACCEPT' 00:21:46.061 11:32:41 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@219 -- # ipts -A FORWARD -i nvmf_br -o nvmf_br -j ACCEPT 00:21:46.061 11:32:41 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@788 -- # iptables -A FORWARD -i nvmf_br -o nvmf_br -j ACCEPT -m comment --comment 'SPDK_NVMF:-A FORWARD -i nvmf_br -o nvmf_br -j ACCEPT' 00:21:46.061 11:32:41 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@222 -- # ping -c 1 10.0.0.3 00:21:46.061 PING 10.0.0.3 (10.0.0.3) 56(84) bytes of data. 00:21:46.061 64 bytes from 10.0.0.3: icmp_seq=1 ttl=64 time=0.057 ms 00:21:46.061 00:21:46.061 --- 10.0.0.3 ping statistics --- 00:21:46.061 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:21:46.061 rtt min/avg/max/mdev = 0.057/0.057/0.057/0.000 ms 00:21:46.062 11:32:41 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@223 -- # ping -c 1 10.0.0.4 00:21:46.062 PING 10.0.0.4 (10.0.0.4) 56(84) bytes of data. 00:21:46.062 64 bytes from 10.0.0.4: icmp_seq=1 ttl=64 time=0.051 ms 00:21:46.062 00:21:46.062 --- 10.0.0.4 ping statistics --- 00:21:46.062 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:21:46.062 rtt min/avg/max/mdev = 0.051/0.051/0.051/0.000 ms 00:21:46.062 11:32:41 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@224 -- # ip netns exec nvmf_tgt_ns_spdk ping -c 1 10.0.0.1 00:21:46.062 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:21:46.062 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.033 ms 00:21:46.062 00:21:46.062 --- 10.0.0.1 ping statistics --- 00:21:46.062 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:21:46.062 rtt min/avg/max/mdev = 0.033/0.033/0.033/0.000 ms 00:21:46.062 11:32:41 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@225 -- # ip netns exec nvmf_tgt_ns_spdk ping -c 1 10.0.0.2 00:21:46.062 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:21:46.062 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.062 ms 00:21:46.062 00:21:46.062 --- 10.0.0.2 ping statistics --- 00:21:46.062 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:21:46.062 rtt min/avg/max/mdev = 0.062/0.062/0.062/0.000 ms 00:21:46.062 11:32:41 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@227 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:21:46.062 11:32:41 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@459 -- # return 0 00:21:46.062 11:32:41 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@476 -- # '[' '' == iso ']' 00:21:46.062 11:32:41 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@480 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:21:46.062 11:32:41 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@481 -- # [[ tcp == \r\d\m\a ]] 00:21:46.062 11:32:41 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@490 -- # [[ tcp == \t\c\p ]] 00:21:46.062 11:32:41 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@491 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:21:46.062 11:32:41 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@494 -- # '[' tcp == tcp ']' 00:21:46.062 11:32:41 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@500 -- # modprobe nvme-tcp 00:21:46.319 11:32:41 nvmf_tcp.nvmf_host.nvmf_identify -- host/identify.sh@16 -- # timing_enter start_nvmf_tgt 00:21:46.319 11:32:41 nvmf_tcp.nvmf_host.nvmf_identify -- common/autotest_common.sh@724 -- # xtrace_disable 00:21:46.319 11:32:41 nvmf_tcp.nvmf_host.nvmf_identify -- common/autotest_common.sh@10 -- # set +x 00:21:46.319 11:32:41 nvmf_tcp.nvmf_host.nvmf_identify -- host/identify.sh@19 -- # nvmfpid=87700 00:21:46.319 11:32:41 nvmf_tcp.nvmf_host.nvmf_identify -- host/identify.sh@18 -- # ip netns exec nvmf_tgt_ns_spdk /home/vagrant/spdk_repo/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:21:46.319 11:32:41 nvmf_tcp.nvmf_host.nvmf_identify -- host/identify.sh@21 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:21:46.319 11:32:41 nvmf_tcp.nvmf_host.nvmf_identify -- host/identify.sh@23 -- # waitforlisten 87700 00:21:46.319 11:32:41 nvmf_tcp.nvmf_host.nvmf_identify -- common/autotest_common.sh@831 -- # '[' -z 87700 ']' 00:21:46.319 11:32:41 nvmf_tcp.nvmf_host.nvmf_identify -- common/autotest_common.sh@835 -- # local rpc_addr=/var/tmp/spdk.sock 00:21:46.319 11:32:41 nvmf_tcp.nvmf_host.nvmf_identify -- common/autotest_common.sh@836 -- # local max_retries=100 00:21:46.319 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:21:46.319 11:32:41 nvmf_tcp.nvmf_host.nvmf_identify -- common/autotest_common.sh@838 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:21:46.319 11:32:41 nvmf_tcp.nvmf_host.nvmf_identify -- common/autotest_common.sh@840 -- # xtrace_disable 00:21:46.319 11:32:41 nvmf_tcp.nvmf_host.nvmf_identify -- common/autotest_common.sh@10 -- # set +x 00:21:46.319 [2024-10-07 11:32:41.671158] Starting SPDK v25.01-pre git sha1 2a4f56c54 / DPDK 24.03.0 initialization... 00:21:46.319 [2024-10-07 11:32:41.671337] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --iova-mode=pa --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:21:46.319 [2024-10-07 11:32:41.815485] app.c: 917:spdk_app_start: *NOTICE*: Total cores available: 4 00:21:46.577 [2024-10-07 11:32:41.945132] app.c: 610:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:21:46.577 [2024-10-07 11:32:41.945197] app.c: 611:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:21:46.577 [2024-10-07 11:32:41.945210] app.c: 616:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:21:46.577 [2024-10-07 11:32:41.945219] app.c: 617:app_setup_trace: *NOTICE*: SPDK application currently running. 00:21:46.577 [2024-10-07 11:32:41.945226] app.c: 618:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:21:46.577 [2024-10-07 11:32:41.946484] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 1 00:21:46.577 [2024-10-07 11:32:41.946604] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 2 00:21:46.577 [2024-10-07 11:32:41.946689] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 3 00:21:46.577 [2024-10-07 11:32:41.946691] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 0 00:21:47.572 11:32:42 nvmf_tcp.nvmf_host.nvmf_identify -- common/autotest_common.sh@860 -- # (( i == 0 )) 00:21:47.572 11:32:42 nvmf_tcp.nvmf_host.nvmf_identify -- common/autotest_common.sh@864 -- # return 0 00:21:47.572 11:32:42 nvmf_tcp.nvmf_host.nvmf_identify -- host/identify.sh@24 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:21:47.572 11:32:42 nvmf_tcp.nvmf_host.nvmf_identify -- common/autotest_common.sh@561 -- # xtrace_disable 00:21:47.572 11:32:42 nvmf_tcp.nvmf_host.nvmf_identify -- common/autotest_common.sh@10 -- # set +x 00:21:47.572 [2024-10-07 11:32:42.714179] tcp.c: 738:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:21:47.572 11:32:42 nvmf_tcp.nvmf_host.nvmf_identify -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:21:47.572 11:32:42 nvmf_tcp.nvmf_host.nvmf_identify -- host/identify.sh@25 -- # timing_exit start_nvmf_tgt 00:21:47.572 11:32:42 nvmf_tcp.nvmf_host.nvmf_identify -- common/autotest_common.sh@730 -- # xtrace_disable 00:21:47.572 11:32:42 nvmf_tcp.nvmf_host.nvmf_identify -- common/autotest_common.sh@10 -- # set +x 00:21:47.572 11:32:42 nvmf_tcp.nvmf_host.nvmf_identify -- host/identify.sh@27 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:21:47.572 11:32:42 nvmf_tcp.nvmf_host.nvmf_identify -- common/autotest_common.sh@561 -- # xtrace_disable 00:21:47.572 11:32:42 nvmf_tcp.nvmf_host.nvmf_identify -- common/autotest_common.sh@10 -- # set +x 00:21:47.572 Malloc0 00:21:47.572 11:32:42 nvmf_tcp.nvmf_host.nvmf_identify -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:21:47.572 11:32:42 nvmf_tcp.nvmf_host.nvmf_identify -- host/identify.sh@28 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:21:47.572 11:32:42 nvmf_tcp.nvmf_host.nvmf_identify -- common/autotest_common.sh@561 -- # xtrace_disable 00:21:47.572 11:32:42 nvmf_tcp.nvmf_host.nvmf_identify -- common/autotest_common.sh@10 -- # set +x 00:21:47.572 11:32:42 nvmf_tcp.nvmf_host.nvmf_identify -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:21:47.572 11:32:42 nvmf_tcp.nvmf_host.nvmf_identify -- host/identify.sh@31 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 --nguid ABCDEF0123456789ABCDEF0123456789 --eui64 ABCDEF0123456789 00:21:47.572 11:32:42 nvmf_tcp.nvmf_host.nvmf_identify -- common/autotest_common.sh@561 -- # xtrace_disable 00:21:47.572 11:32:42 nvmf_tcp.nvmf_host.nvmf_identify -- common/autotest_common.sh@10 -- # set +x 00:21:47.572 11:32:42 nvmf_tcp.nvmf_host.nvmf_identify -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:21:47.572 11:32:42 nvmf_tcp.nvmf_host.nvmf_identify -- host/identify.sh@34 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.3 -s 4420 00:21:47.572 11:32:42 nvmf_tcp.nvmf_host.nvmf_identify -- common/autotest_common.sh@561 -- # xtrace_disable 00:21:47.572 11:32:42 nvmf_tcp.nvmf_host.nvmf_identify -- common/autotest_common.sh@10 -- # set +x 00:21:47.572 [2024-10-07 11:32:42.814168] tcp.c:1081:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.3 port 4420 *** 00:21:47.573 11:32:42 nvmf_tcp.nvmf_host.nvmf_identify -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:21:47.573 11:32:42 nvmf_tcp.nvmf_host.nvmf_identify -- host/identify.sh@35 -- # rpc_cmd nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.3 -s 4420 00:21:47.573 11:32:42 nvmf_tcp.nvmf_host.nvmf_identify -- common/autotest_common.sh@561 -- # xtrace_disable 00:21:47.573 11:32:42 nvmf_tcp.nvmf_host.nvmf_identify -- common/autotest_common.sh@10 -- # set +x 00:21:47.573 11:32:42 nvmf_tcp.nvmf_host.nvmf_identify -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:21:47.573 11:32:42 nvmf_tcp.nvmf_host.nvmf_identify -- host/identify.sh@37 -- # rpc_cmd nvmf_get_subsystems 00:21:47.573 11:32:42 nvmf_tcp.nvmf_host.nvmf_identify -- common/autotest_common.sh@561 -- # xtrace_disable 00:21:47.573 11:32:42 nvmf_tcp.nvmf_host.nvmf_identify -- common/autotest_common.sh@10 -- # set +x 00:21:47.573 [ 00:21:47.573 { 00:21:47.573 "allow_any_host": true, 00:21:47.573 "hosts": [], 00:21:47.573 "listen_addresses": [ 00:21:47.573 { 00:21:47.573 "adrfam": "IPv4", 00:21:47.573 "traddr": "10.0.0.3", 00:21:47.573 "trsvcid": "4420", 00:21:47.573 "trtype": "TCP" 00:21:47.573 } 00:21:47.573 ], 00:21:47.573 "nqn": "nqn.2014-08.org.nvmexpress.discovery", 00:21:47.573 "subtype": "Discovery" 00:21:47.573 }, 00:21:47.573 { 00:21:47.573 "allow_any_host": true, 00:21:47.573 "hosts": [], 00:21:47.573 "listen_addresses": [ 00:21:47.573 { 00:21:47.573 "adrfam": "IPv4", 00:21:47.573 "traddr": "10.0.0.3", 00:21:47.573 "trsvcid": "4420", 00:21:47.573 "trtype": "TCP" 00:21:47.573 } 00:21:47.573 ], 00:21:47.573 "max_cntlid": 65519, 00:21:47.573 "max_namespaces": 32, 00:21:47.573 "min_cntlid": 1, 00:21:47.573 "model_number": "SPDK bdev Controller", 00:21:47.573 "namespaces": [ 00:21:47.573 { 00:21:47.573 "bdev_name": "Malloc0", 00:21:47.573 "eui64": "ABCDEF0123456789", 00:21:47.573 "name": "Malloc0", 00:21:47.573 "nguid": "ABCDEF0123456789ABCDEF0123456789", 00:21:47.573 "nsid": 1, 00:21:47.573 "uuid": "fa26896a-ce0f-4b37-93de-56d475f120e8" 00:21:47.573 } 00:21:47.573 ], 00:21:47.573 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:21:47.573 "serial_number": "SPDK00000000000001", 00:21:47.573 "subtype": "NVMe" 00:21:47.573 } 00:21:47.573 ] 00:21:47.573 11:32:42 nvmf_tcp.nvmf_host.nvmf_identify -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:21:47.573 11:32:42 nvmf_tcp.nvmf_host.nvmf_identify -- host/identify.sh@39 -- # /home/vagrant/spdk_repo/spdk/build/bin/spdk_nvme_identify -r ' trtype:tcp adrfam:IPv4 traddr:10.0.0.3 trsvcid:4420 subnqn:nqn.2014-08.org.nvmexpress.discovery' -L all 00:21:47.573 [2024-10-07 11:32:42.858820] Starting SPDK v25.01-pre git sha1 2a4f56c54 / DPDK 24.03.0 initialization... 00:21:47.573 [2024-10-07 11:32:42.858865] [ DPDK EAL parameters: identify --no-shconf -c 0x1 -n 1 -m 0 --no-pci --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --iova-mode=pa --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid87754 ] 00:21:47.573 [2024-10-07 11:32:42.997170] nvme_ctrlr.c:1563:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to connect adminq (no timeout) 00:21:47.573 [2024-10-07 11:32:42.997260] nvme_tcp.c:2349:nvme_tcp_qpair_connect_sock: *DEBUG*: adrfam 1 ai_family 2 00:21:47.573 [2024-10-07 11:32:42.997280] nvme_tcp.c:2353:nvme_tcp_qpair_connect_sock: *DEBUG*: trsvcid is 4420 00:21:47.573 [2024-10-07 11:32:42.997295] nvme_tcp.c:2374:nvme_tcp_qpair_connect_sock: *DEBUG*: sock_impl_name is (null) 00:21:47.573 [2024-10-07 11:32:42.997308] sock.c: 373:spdk_sock_connect_ext: *DEBUG*: Creating a client socket using impl posix 00:21:47.573 [2024-10-07 11:32:43.001691] nvme_ctrlr.c:1563:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to wait for connect adminq (no timeout) 00:21:47.573 [2024-10-07 11:32:43.001779] nvme_tcp.c:1566:nvme_tcp_send_icreq_complete: *DEBUG*: Complete the icreq send for tqpair=0xe5c8f0 0 00:21:47.573 [2024-10-07 11:32:43.009673] nvme_tcp.c:1198:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 1 00:21:47.573 [2024-10-07 11:32:43.009699] nvme_tcp.c:1986:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =1 00:21:47.573 [2024-10-07 11:32:43.009706] nvme_tcp.c:1612:nvme_tcp_icresp_handle: *DEBUG*: host_hdgst_enable: 0 00:21:47.573 [2024-10-07 11:32:43.009710] nvme_tcp.c:1613:nvme_tcp_icresp_handle: *DEBUG*: host_ddgst_enable: 0 00:21:47.573 [2024-10-07 11:32:43.009748] nvme_tcp.c: 800:nvme_tcp_build_contig_request: *DEBUG*: enter 00:21:47.573 [2024-10-07 11:32:43.009756] nvme_tcp.c: 977:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:21:47.573 [2024-10-07 11:32:43.009760] nvme_tcp.c: 986:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0xe5c8f0) 00:21:47.573 [2024-10-07 11:32:43.009776] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC CONNECT qid:0 cid:0 SGL DATA BLOCK OFFSET 0x0 len:0x400 00:21:47.573 [2024-10-07 11:32:43.009809] nvme_tcp.c: 951:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xe83000, cid 0, qid 0 00:21:47.573 [2024-10-07 11:32:43.017670] nvme_tcp.c:1198:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:21:47.573 [2024-10-07 11:32:43.017693] nvme_tcp.c:1986:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:21:47.573 [2024-10-07 11:32:43.017698] nvme_tcp.c:1659:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:21:47.573 [2024-10-07 11:32:43.017704] nvme_tcp.c:1079:nvme_tcp_req_complete: *DEBUG*: complete tcp_req(0xe83000) on tqpair=0xe5c8f0 00:21:47.573 [2024-10-07 11:32:43.017716] nvme_fabric.c: 621:nvme_fabric_qpair_connect_poll: *DEBUG*: CNTLID 0x0001 00:21:47.573 [2024-10-07 11:32:43.017725] nvme_ctrlr.c:1563:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to read vs (no timeout) 00:21:47.573 [2024-10-07 11:32:43.017732] nvme_ctrlr.c:1563:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to read vs wait for vs (no timeout) 00:21:47.573 [2024-10-07 11:32:43.017750] nvme_tcp.c: 800:nvme_tcp_build_contig_request: *DEBUG*: enter 00:21:47.573 [2024-10-07 11:32:43.017755] nvme_tcp.c: 977:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:21:47.573 [2024-10-07 11:32:43.017760] nvme_tcp.c: 986:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0xe5c8f0) 00:21:47.573 [2024-10-07 11:32:43.017770] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:47.573 [2024-10-07 11:32:43.017801] nvme_tcp.c: 951:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xe83000, cid 0, qid 0 00:21:47.573 [2024-10-07 11:32:43.017877] nvme_tcp.c:1198:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:21:47.573 [2024-10-07 11:32:43.017884] nvme_tcp.c:1986:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:21:47.573 [2024-10-07 11:32:43.017888] nvme_tcp.c:1659:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:21:47.573 [2024-10-07 11:32:43.017893] nvme_tcp.c:1079:nvme_tcp_req_complete: *DEBUG*: complete tcp_req(0xe83000) on tqpair=0xe5c8f0 00:21:47.573 [2024-10-07 11:32:43.017899] nvme_ctrlr.c:1563:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to read cap (no timeout) 00:21:47.573 [2024-10-07 11:32:43.017907] nvme_ctrlr.c:1563:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to read cap wait for cap (no timeout) 00:21:47.573 [2024-10-07 11:32:43.017916] nvme_tcp.c: 800:nvme_tcp_build_contig_request: *DEBUG*: enter 00:21:47.573 [2024-10-07 11:32:43.017921] nvme_tcp.c: 977:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:21:47.573 [2024-10-07 11:32:43.017925] nvme_tcp.c: 986:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0xe5c8f0) 00:21:47.573 [2024-10-07 11:32:43.017933] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:47.573 [2024-10-07 11:32:43.017953] nvme_tcp.c: 951:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xe83000, cid 0, qid 0 00:21:47.573 [2024-10-07 11:32:43.018008] nvme_tcp.c:1198:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:21:47.573 [2024-10-07 11:32:43.018016] nvme_tcp.c:1986:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:21:47.573 [2024-10-07 11:32:43.018020] nvme_tcp.c:1659:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:21:47.573 [2024-10-07 11:32:43.018024] nvme_tcp.c:1079:nvme_tcp_req_complete: *DEBUG*: complete tcp_req(0xe83000) on tqpair=0xe5c8f0 00:21:47.573 [2024-10-07 11:32:43.018031] nvme_ctrlr.c:1563:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to check en (no timeout) 00:21:47.573 [2024-10-07 11:32:43.018040] nvme_ctrlr.c:1557:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to check en wait for cc (timeout 15000 ms) 00:21:47.573 [2024-10-07 11:32:43.018048] nvme_tcp.c: 800:nvme_tcp_build_contig_request: *DEBUG*: enter 00:21:47.573 [2024-10-07 11:32:43.018052] nvme_tcp.c: 977:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:21:47.573 [2024-10-07 11:32:43.018056] nvme_tcp.c: 986:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0xe5c8f0) 00:21:47.573 [2024-10-07 11:32:43.018064] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:47.573 [2024-10-07 11:32:43.018082] nvme_tcp.c: 951:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xe83000, cid 0, qid 0 00:21:47.573 [2024-10-07 11:32:43.018145] nvme_tcp.c:1198:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:21:47.573 [2024-10-07 11:32:43.018152] nvme_tcp.c:1986:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:21:47.573 [2024-10-07 11:32:43.018156] nvme_tcp.c:1659:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:21:47.573 [2024-10-07 11:32:43.018160] nvme_tcp.c:1079:nvme_tcp_req_complete: *DEBUG*: complete tcp_req(0xe83000) on tqpair=0xe5c8f0 00:21:47.573 [2024-10-07 11:32:43.018166] nvme_ctrlr.c:1557:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to disable and wait for CSTS.RDY = 0 (timeout 15000 ms) 00:21:47.573 [2024-10-07 11:32:43.018176] nvme_tcp.c: 800:nvme_tcp_build_contig_request: *DEBUG*: enter 00:21:47.573 [2024-10-07 11:32:43.018181] nvme_tcp.c: 977:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:21:47.573 [2024-10-07 11:32:43.018185] nvme_tcp.c: 986:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0xe5c8f0) 00:21:47.573 [2024-10-07 11:32:43.018193] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:47.573 [2024-10-07 11:32:43.018211] nvme_tcp.c: 951:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xe83000, cid 0, qid 0 00:21:47.573 [2024-10-07 11:32:43.018266] nvme_tcp.c:1198:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:21:47.573 [2024-10-07 11:32:43.018273] nvme_tcp.c:1986:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:21:47.573 [2024-10-07 11:32:43.018277] nvme_tcp.c:1659:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:21:47.573 [2024-10-07 11:32:43.018281] nvme_tcp.c:1079:nvme_tcp_req_complete: *DEBUG*: complete tcp_req(0xe83000) on tqpair=0xe5c8f0 00:21:47.573 [2024-10-07 11:32:43.018287] nvme_ctrlr.c:3893:nvme_ctrlr_process_init_wait_for_ready_0: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] CC.EN = 0 && CSTS.RDY = 0 00:21:47.573 [2024-10-07 11:32:43.018292] nvme_ctrlr.c:1557:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to controller is disabled (timeout 15000 ms) 00:21:47.573 [2024-10-07 11:32:43.018300] nvme_ctrlr.c:1557:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to enable controller by writing CC.EN = 1 (timeout 15000 ms) 00:21:47.573 [2024-10-07 11:32:43.018407] nvme_ctrlr.c:4091:nvme_ctrlr_process_init: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] Setting CC.EN = 1 00:21:47.573 [2024-10-07 11:32:43.018418] nvme_ctrlr.c:1557:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to enable controller by writing CC.EN = 1 reg (timeout 15000 ms) 00:21:47.573 [2024-10-07 11:32:43.018429] nvme_tcp.c: 800:nvme_tcp_build_contig_request: *DEBUG*: enter 00:21:47.573 [2024-10-07 11:32:43.018433] nvme_tcp.c: 977:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:21:47.573 [2024-10-07 11:32:43.018437] nvme_tcp.c: 986:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0xe5c8f0) 00:21:47.574 [2024-10-07 11:32:43.018445] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY SET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:47.574 [2024-10-07 11:32:43.018465] nvme_tcp.c: 951:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xe83000, cid 0, qid 0 00:21:47.574 [2024-10-07 11:32:43.018521] nvme_tcp.c:1198:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:21:47.574 [2024-10-07 11:32:43.018528] nvme_tcp.c:1986:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:21:47.574 [2024-10-07 11:32:43.018533] nvme_tcp.c:1659:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:21:47.574 [2024-10-07 11:32:43.018538] nvme_tcp.c:1079:nvme_tcp_req_complete: *DEBUG*: complete tcp_req(0xe83000) on tqpair=0xe5c8f0 00:21:47.574 [2024-10-07 11:32:43.018543] nvme_ctrlr.c:1557:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to wait for CSTS.RDY = 1 (timeout 15000 ms) 00:21:47.574 [2024-10-07 11:32:43.018554] nvme_tcp.c: 800:nvme_tcp_build_contig_request: *DEBUG*: enter 00:21:47.574 [2024-10-07 11:32:43.018559] nvme_tcp.c: 977:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:21:47.574 [2024-10-07 11:32:43.018563] nvme_tcp.c: 986:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0xe5c8f0) 00:21:47.574 [2024-10-07 11:32:43.018571] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:47.574 [2024-10-07 11:32:43.018589] nvme_tcp.c: 951:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xe83000, cid 0, qid 0 00:21:47.574 [2024-10-07 11:32:43.018646] nvme_tcp.c:1198:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:21:47.574 [2024-10-07 11:32:43.018675] nvme_tcp.c:1986:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:21:47.574 [2024-10-07 11:32:43.018679] nvme_tcp.c:1659:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:21:47.574 [2024-10-07 11:32:43.018683] nvme_tcp.c:1079:nvme_tcp_req_complete: *DEBUG*: complete tcp_req(0xe83000) on tqpair=0xe5c8f0 00:21:47.574 [2024-10-07 11:32:43.018689] nvme_ctrlr.c:3928:nvme_ctrlr_process_init_enable_wait_for_ready_1: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] CC.EN = 1 && CSTS.RDY = 1 - controller is ready 00:21:47.574 [2024-10-07 11:32:43.018694] nvme_ctrlr.c:1557:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to reset admin queue (timeout 30000 ms) 00:21:47.574 [2024-10-07 11:32:43.018703] nvme_ctrlr.c:1563:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to identify controller (no timeout) 00:21:47.574 [2024-10-07 11:32:43.018721] nvme_ctrlr.c:1557:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to wait for identify controller (timeout 30000 ms) 00:21:47.574 [2024-10-07 11:32:43.018733] nvme_tcp.c: 977:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:21:47.574 [2024-10-07 11:32:43.018737] nvme_tcp.c: 986:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0xe5c8f0) 00:21:47.574 [2024-10-07 11:32:43.018745] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: IDENTIFY (06) qid:0 cid:0 nsid:0 cdw10:00000001 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:47.574 [2024-10-07 11:32:43.018768] nvme_tcp.c: 951:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xe83000, cid 0, qid 0 00:21:47.574 [2024-10-07 11:32:43.018863] nvme_tcp.c:1198:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:21:47.574 [2024-10-07 11:32:43.018871] nvme_tcp.c:1986:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:21:47.574 [2024-10-07 11:32:43.018885] nvme_tcp.c:1730:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:21:47.574 [2024-10-07 11:32:43.018889] nvme_tcp.c:1731:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0xe5c8f0): datao=0, datal=4096, cccid=0 00:21:47.574 [2024-10-07 11:32:43.018894] nvme_tcp.c:1742:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0xe83000) on tqpair(0xe5c8f0): expected_datao=0, payload_size=4096 00:21:47.574 [2024-10-07 11:32:43.018910] nvme_tcp.c: 800:nvme_tcp_build_contig_request: *DEBUG*: enter 00:21:47.574 [2024-10-07 11:32:43.018919] nvme_tcp.c:1532:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:21:47.574 [2024-10-07 11:32:43.018923] nvme_tcp.c:1323:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:21:47.574 [2024-10-07 11:32:43.018932] nvme_tcp.c:1198:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:21:47.574 [2024-10-07 11:32:43.018939] nvme_tcp.c:1986:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:21:47.574 [2024-10-07 11:32:43.018943] nvme_tcp.c:1659:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:21:47.574 [2024-10-07 11:32:43.018947] nvme_tcp.c:1079:nvme_tcp_req_complete: *DEBUG*: complete tcp_req(0xe83000) on tqpair=0xe5c8f0 00:21:47.574 [2024-10-07 11:32:43.018957] nvme_ctrlr.c:2077:nvme_ctrlr_identify_done: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] transport max_xfer_size 4294967295 00:21:47.574 [2024-10-07 11:32:43.018962] nvme_ctrlr.c:2081:nvme_ctrlr_identify_done: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] MDTS max_xfer_size 131072 00:21:47.574 [2024-10-07 11:32:43.018967] nvme_ctrlr.c:2084:nvme_ctrlr_identify_done: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] CNTLID 0x0001 00:21:47.574 [2024-10-07 11:32:43.018972] nvme_ctrlr.c:2108:nvme_ctrlr_identify_done: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] transport max_sges 16 00:21:47.574 [2024-10-07 11:32:43.018977] nvme_ctrlr.c:2123:nvme_ctrlr_identify_done: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] fuses compare and write: 1 00:21:47.574 [2024-10-07 11:32:43.018983] nvme_ctrlr.c:1557:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to configure AER (timeout 30000 ms) 00:21:47.574 [2024-10-07 11:32:43.018992] nvme_ctrlr.c:1557:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to wait for configure aer (timeout 30000 ms) 00:21:47.574 [2024-10-07 11:32:43.019005] nvme_tcp.c: 800:nvme_tcp_build_contig_request: *DEBUG*: enter 00:21:47.574 [2024-10-07 11:32:43.019010] nvme_tcp.c: 977:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:21:47.574 [2024-10-07 11:32:43.019014] nvme_tcp.c: 986:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0xe5c8f0) 00:21:47.574 [2024-10-07 11:32:43.019022] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: SET FEATURES ASYNC EVENT CONFIGURATION cid:0 cdw10:0000000b SGL DATA BLOCK OFFSET 0x0 len:0x0 00:21:47.574 [2024-10-07 11:32:43.019043] nvme_tcp.c: 951:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xe83000, cid 0, qid 0 00:21:47.574 [2024-10-07 11:32:43.019132] nvme_tcp.c:1198:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:21:47.574 [2024-10-07 11:32:43.019139] nvme_tcp.c:1986:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:21:47.574 [2024-10-07 11:32:43.019143] nvme_tcp.c:1659:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:21:47.574 [2024-10-07 11:32:43.019148] nvme_tcp.c:1079:nvme_tcp_req_complete: *DEBUG*: complete tcp_req(0xe83000) on tqpair=0xe5c8f0 00:21:47.574 [2024-10-07 11:32:43.019157] nvme_tcp.c: 800:nvme_tcp_build_contig_request: *DEBUG*: enter 00:21:47.574 [2024-10-07 11:32:43.019164] nvme_tcp.c: 977:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:21:47.574 [2024-10-07 11:32:43.019171] nvme_tcp.c: 986:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0xe5c8f0) 00:21:47.574 [2024-10-07 11:32:43.019181] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:21:47.574 [2024-10-07 11:32:43.019190] nvme_tcp.c: 800:nvme_tcp_build_contig_request: *DEBUG*: enter 00:21:47.574 [2024-10-07 11:32:43.019194] nvme_tcp.c: 977:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:21:47.574 [2024-10-07 11:32:43.019198] nvme_tcp.c: 986:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=1 on tqpair(0xe5c8f0) 00:21:47.574 [2024-10-07 11:32:43.019211] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:21:47.574 [2024-10-07 11:32:43.019218] nvme_tcp.c: 800:nvme_tcp_build_contig_request: *DEBUG*: enter 00:21:47.574 [2024-10-07 11:32:43.019222] nvme_tcp.c: 977:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:21:47.574 [2024-10-07 11:32:43.019236] nvme_tcp.c: 986:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=2 on tqpair(0xe5c8f0) 00:21:47.574 [2024-10-07 11:32:43.019245] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:21:47.574 [2024-10-07 11:32:43.019252] nvme_tcp.c: 800:nvme_tcp_build_contig_request: *DEBUG*: enter 00:21:47.574 [2024-10-07 11:32:43.019256] nvme_tcp.c: 977:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:21:47.574 [2024-10-07 11:32:43.019260] nvme_tcp.c: 986:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0xe5c8f0) 00:21:47.574 [2024-10-07 11:32:43.019266] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:21:47.574 [2024-10-07 11:32:43.019281] nvme_ctrlr.c:1557:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to set keep alive timeout (timeout 30000 ms) 00:21:47.574 [2024-10-07 11:32:43.019297] nvme_ctrlr.c:1557:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to wait for set keep alive timeout (timeout 30000 ms) 00:21:47.574 [2024-10-07 11:32:43.019305] nvme_tcp.c: 977:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:21:47.574 [2024-10-07 11:32:43.019310] nvme_tcp.c: 986:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0xe5c8f0) 00:21:47.574 [2024-10-07 11:32:43.019317] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES KEEP ALIVE TIMER cid:4 cdw10:0000000f SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:47.574 [2024-10-07 11:32:43.019341] nvme_tcp.c: 951:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xe83000, cid 0, qid 0 00:21:47.574 [2024-10-07 11:32:43.019349] nvme_tcp.c: 951:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xe83180, cid 1, qid 0 00:21:47.574 [2024-10-07 11:32:43.019354] nvme_tcp.c: 951:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xe83300, cid 2, qid 0 00:21:47.574 [2024-10-07 11:32:43.019359] nvme_tcp.c: 951:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xe83480, cid 3, qid 0 00:21:47.574 [2024-10-07 11:32:43.019364] nvme_tcp.c: 951:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xe83600, cid 4, qid 0 00:21:47.574 [2024-10-07 11:32:43.019458] nvme_tcp.c:1198:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:21:47.574 [2024-10-07 11:32:43.019466] nvme_tcp.c:1986:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:21:47.574 [2024-10-07 11:32:43.019470] nvme_tcp.c:1659:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:21:47.574 [2024-10-07 11:32:43.019474] nvme_tcp.c:1079:nvme_tcp_req_complete: *DEBUG*: complete tcp_req(0xe83600) on tqpair=0xe5c8f0 00:21:47.574 [2024-10-07 11:32:43.019480] nvme_ctrlr.c:3046:nvme_ctrlr_set_keep_alive_timeout_done: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] Sending keep alive every 5000000 us 00:21:47.574 [2024-10-07 11:32:43.019486] nvme_ctrlr.c:1563:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to ready (no timeout) 00:21:47.574 [2024-10-07 11:32:43.019499] nvme_tcp.c: 977:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:21:47.574 [2024-10-07 11:32:43.019504] nvme_tcp.c: 986:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0xe5c8f0) 00:21:47.574 [2024-10-07 11:32:43.019511] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: IDENTIFY (06) qid:0 cid:4 nsid:0 cdw10:00000001 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:47.574 [2024-10-07 11:32:43.019530] nvme_tcp.c: 951:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xe83600, cid 4, qid 0 00:21:47.574 [2024-10-07 11:32:43.019596] nvme_tcp.c:1198:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:21:47.574 [2024-10-07 11:32:43.019603] nvme_tcp.c:1986:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:21:47.574 [2024-10-07 11:32:43.019607] nvme_tcp.c:1730:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:21:47.574 [2024-10-07 11:32:43.019611] nvme_tcp.c:1731:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0xe5c8f0): datao=0, datal=4096, cccid=4 00:21:47.574 [2024-10-07 11:32:43.019616] nvme_tcp.c:1742:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0xe83600) on tqpair(0xe5c8f0): expected_datao=0, payload_size=4096 00:21:47.574 [2024-10-07 11:32:43.019621] nvme_tcp.c: 800:nvme_tcp_build_contig_request: *DEBUG*: enter 00:21:47.574 [2024-10-07 11:32:43.019629] nvme_tcp.c:1532:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:21:47.574 [2024-10-07 11:32:43.019633] nvme_tcp.c:1323:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:21:47.574 [2024-10-07 11:32:43.019642] nvme_tcp.c:1198:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:21:47.574 [2024-10-07 11:32:43.019661] nvme_tcp.c:1986:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:21:47.574 [2024-10-07 11:32:43.019667] nvme_tcp.c:1659:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:21:47.574 [2024-10-07 11:32:43.019672] nvme_tcp.c:1079:nvme_tcp_req_complete: *DEBUG*: complete tcp_req(0xe83600) on tqpair=0xe5c8f0 00:21:47.574 [2024-10-07 11:32:43.019688] nvme_ctrlr.c:4189:nvme_ctrlr_process_init: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] Ctrlr already in ready state 00:21:47.575 [2024-10-07 11:32:43.019740] nvme_tcp.c: 977:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:21:47.575 [2024-10-07 11:32:43.019751] nvme_tcp.c: 986:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0xe5c8f0) 00:21:47.575 [2024-10-07 11:32:43.019760] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: GET LOG PAGE (02) qid:0 cid:4 nsid:0 cdw10:00ff0070 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:47.575 [2024-10-07 11:32:43.019768] nvme_tcp.c: 800:nvme_tcp_build_contig_request: *DEBUG*: enter 00:21:47.575 [2024-10-07 11:32:43.019772] nvme_tcp.c: 977:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:21:47.575 [2024-10-07 11:32:43.019776] nvme_tcp.c: 986:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=5 on tqpair(0xe5c8f0) 00:21:47.575 [2024-10-07 11:32:43.019783] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: KEEP ALIVE (18) qid:0 cid:5 nsid:0 cdw10:00000000 cdw11:00000000 00:21:47.575 [2024-10-07 11:32:43.019816] nvme_tcp.c: 951:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xe83600, cid 4, qid 0 00:21:47.575 [2024-10-07 11:32:43.019824] nvme_tcp.c: 951:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xe83780, cid 5, qid 0 00:21:47.575 [2024-10-07 11:32:43.019946] nvme_tcp.c:1198:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:21:47.575 [2024-10-07 11:32:43.019954] nvme_tcp.c:1986:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:21:47.575 [2024-10-07 11:32:43.019958] nvme_tcp.c:1730:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:21:47.575 [2024-10-07 11:32:43.019962] nvme_tcp.c:1731:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0xe5c8f0): datao=0, datal=1024, cccid=4 00:21:47.575 [2024-10-07 11:32:43.019967] nvme_tcp.c:1742:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0xe83600) on tqpair(0xe5c8f0): expected_datao=0, payload_size=1024 00:21:47.575 [2024-10-07 11:32:43.019972] nvme_tcp.c: 800:nvme_tcp_build_contig_request: *DEBUG*: enter 00:21:47.575 [2024-10-07 11:32:43.019979] nvme_tcp.c:1532:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:21:47.575 [2024-10-07 11:32:43.019983] nvme_tcp.c:1323:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:21:47.575 [2024-10-07 11:32:43.019990] nvme_tcp.c:1198:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:21:47.575 [2024-10-07 11:32:43.019996] nvme_tcp.c:1986:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:21:47.575 [2024-10-07 11:32:43.020000] nvme_tcp.c:1659:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:21:47.575 [2024-10-07 11:32:43.020004] nvme_tcp.c:1079:nvme_tcp_req_complete: *DEBUG*: complete tcp_req(0xe83780) on tqpair=0xe5c8f0 00:21:47.575 [2024-10-07 11:32:43.065689] nvme_tcp.c:1198:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:21:47.575 [2024-10-07 11:32:43.065720] nvme_tcp.c:1986:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:21:47.575 [2024-10-07 11:32:43.065726] nvme_tcp.c:1659:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:21:47.575 [2024-10-07 11:32:43.065732] nvme_tcp.c:1079:nvme_tcp_req_complete: *DEBUG*: complete tcp_req(0xe83600) on tqpair=0xe5c8f0 00:21:47.575 [2024-10-07 11:32:43.065779] nvme_tcp.c: 977:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:21:47.575 [2024-10-07 11:32:43.065786] nvme_tcp.c: 986:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0xe5c8f0) 00:21:47.575 [2024-10-07 11:32:43.065799] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: GET LOG PAGE (02) qid:0 cid:4 nsid:0 cdw10:02ff0070 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:47.575 [2024-10-07 11:32:43.065838] nvme_tcp.c: 951:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xe83600, cid 4, qid 0 00:21:47.575 [2024-10-07 11:32:43.065981] nvme_tcp.c:1198:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:21:47.575 [2024-10-07 11:32:43.066001] nvme_tcp.c:1986:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:21:47.575 [2024-10-07 11:32:43.066005] nvme_tcp.c:1730:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:21:47.575 [2024-10-07 11:32:43.066009] nvme_tcp.c:1731:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0xe5c8f0): datao=0, datal=3072, cccid=4 00:21:47.575 [2024-10-07 11:32:43.066014] nvme_tcp.c:1742:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0xe83600) on tqpair(0xe5c8f0): expected_datao=0, payload_size=3072 00:21:47.575 [2024-10-07 11:32:43.066019] nvme_tcp.c: 800:nvme_tcp_build_contig_request: *DEBUG*: enter 00:21:47.575 [2024-10-07 11:32:43.066029] nvme_tcp.c:1532:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:21:47.575 [2024-10-07 11:32:43.066034] nvme_tcp.c:1323:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:21:47.575 [2024-10-07 11:32:43.066044] nvme_tcp.c:1198:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:21:47.575 [2024-10-07 11:32:43.066051] nvme_tcp.c:1986:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:21:47.575 [2024-10-07 11:32:43.066054] nvme_tcp.c:1659:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:21:47.575 [2024-10-07 11:32:43.066059] nvme_tcp.c:1079:nvme_tcp_req_complete: *DEBUG*: complete tcp_req(0xe83600) on tqpair=0xe5c8f0 00:21:47.575 [2024-10-07 11:32:43.066070] nvme_tcp.c: 977:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:21:47.575 [2024-10-07 11:32:43.066075] nvme_tcp.c: 986:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0xe5c8f0) 00:21:47.575 [2024-10-07 11:32:43.066083] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: GET LOG PAGE (02) qid:0 cid:4 nsid:0 cdw10:00010070 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:47.575 [2024-10-07 11:32:43.066111] nvme_tcp.c: 951:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xe83600, cid 4, qid 0 00:21:47.575 [2024-10-07 11:32:43.066184] nvme_tcp.c:1198:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:21:47.575 [2024-10-07 11:32:43.066191] nvme_tcp.c:1986:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:21:47.575 [2024-10-07 11:32:43.066195] nvme_tcp.c:1730:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:21:47.575 [2024-10-07 11:32:43.066199] nvme_tcp.c:1731:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0xe5c8f0): datao=0, datal=8, cccid=4 00:21:47.575 [2024-10-07 11:32:43.066204] nvme_tcp.c:1742:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0xe83600) on tqpair(0xe5c8f0): expected_datao=0, payload_size=8 00:21:47.575 [2024-10-07 11:32:43.066209] nvme_tcp.c: 800:nvme_tcp_build_contig_request: *DEBUG*: enter 00:21:47.575 [2024-10-07 11:32:43.066216] nvme_tcp.c:1532:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:21:47.575 [2024-10-07 11:32:43.066220] nvme_tcp.c:1323:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:21:47.840 [2024-10-07 11:32:43.108687] nvme_tcp.c:1198:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:21:47.840 [2024-10-07 11:32:43.108727] nvme_tcp.c:1986:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:21:47.840 [2024-10-07 11:32:43.108734] nvme_tcp.c:1659:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:21:47.840 [2024-10-07 11:32:43.108740] nvme_tcp.c:1079:nvme_tcp_req_complete: *DEBUG*: complete tcp_req(0xe83600) on tqpair=0xe5c8f0 00:21:47.840 ===================================================== 00:21:47.840 NVMe over Fabrics controller at 10.0.0.3:4420: nqn.2014-08.org.nvmexpress.discovery 00:21:47.840 ===================================================== 00:21:47.840 Controller Capabilities/Features 00:21:47.840 ================================ 00:21:47.840 Vendor ID: 0000 00:21:47.840 Subsystem Vendor ID: 0000 00:21:47.840 Serial Number: .................... 00:21:47.840 Model Number: ........................................ 00:21:47.840 Firmware Version: 25.01 00:21:47.840 Recommended Arb Burst: 0 00:21:47.840 IEEE OUI Identifier: 00 00 00 00:21:47.840 Multi-path I/O 00:21:47.840 May have multiple subsystem ports: No 00:21:47.840 May have multiple controllers: No 00:21:47.840 Associated with SR-IOV VF: No 00:21:47.840 Max Data Transfer Size: 131072 00:21:47.840 Max Number of Namespaces: 0 00:21:47.840 Max Number of I/O Queues: 1024 00:21:47.840 NVMe Specification Version (VS): 1.3 00:21:47.840 NVMe Specification Version (Identify): 1.3 00:21:47.840 Maximum Queue Entries: 128 00:21:47.840 Contiguous Queues Required: Yes 00:21:47.840 Arbitration Mechanisms Supported 00:21:47.840 Weighted Round Robin: Not Supported 00:21:47.840 Vendor Specific: Not Supported 00:21:47.840 Reset Timeout: 15000 ms 00:21:47.840 Doorbell Stride: 4 bytes 00:21:47.840 NVM Subsystem Reset: Not Supported 00:21:47.840 Command Sets Supported 00:21:47.840 NVM Command Set: Supported 00:21:47.840 Boot Partition: Not Supported 00:21:47.840 Memory Page Size Minimum: 4096 bytes 00:21:47.840 Memory Page Size Maximum: 4096 bytes 00:21:47.840 Persistent Memory Region: Not Supported 00:21:47.840 Optional Asynchronous Events Supported 00:21:47.840 Namespace Attribute Notices: Not Supported 00:21:47.840 Firmware Activation Notices: Not Supported 00:21:47.840 ANA Change Notices: Not Supported 00:21:47.840 PLE Aggregate Log Change Notices: Not Supported 00:21:47.840 LBA Status Info Alert Notices: Not Supported 00:21:47.840 EGE Aggregate Log Change Notices: Not Supported 00:21:47.840 Normal NVM Subsystem Shutdown event: Not Supported 00:21:47.840 Zone Descriptor Change Notices: Not Supported 00:21:47.840 Discovery Log Change Notices: Supported 00:21:47.840 Controller Attributes 00:21:47.840 128-bit Host Identifier: Not Supported 00:21:47.840 Non-Operational Permissive Mode: Not Supported 00:21:47.840 NVM Sets: Not Supported 00:21:47.840 Read Recovery Levels: Not Supported 00:21:47.840 Endurance Groups: Not Supported 00:21:47.840 Predictable Latency Mode: Not Supported 00:21:47.840 Traffic Based Keep ALive: Not Supported 00:21:47.840 Namespace Granularity: Not Supported 00:21:47.840 SQ Associations: Not Supported 00:21:47.840 UUID List: Not Supported 00:21:47.840 Multi-Domain Subsystem: Not Supported 00:21:47.840 Fixed Capacity Management: Not Supported 00:21:47.840 Variable Capacity Management: Not Supported 00:21:47.840 Delete Endurance Group: Not Supported 00:21:47.840 Delete NVM Set: Not Supported 00:21:47.840 Extended LBA Formats Supported: Not Supported 00:21:47.840 Flexible Data Placement Supported: Not Supported 00:21:47.840 00:21:47.840 Controller Memory Buffer Support 00:21:47.840 ================================ 00:21:47.840 Supported: No 00:21:47.840 00:21:47.840 Persistent Memory Region Support 00:21:47.840 ================================ 00:21:47.840 Supported: No 00:21:47.840 00:21:47.840 Admin Command Set Attributes 00:21:47.840 ============================ 00:21:47.840 Security Send/Receive: Not Supported 00:21:47.840 Format NVM: Not Supported 00:21:47.840 Firmware Activate/Download: Not Supported 00:21:47.840 Namespace Management: Not Supported 00:21:47.840 Device Self-Test: Not Supported 00:21:47.840 Directives: Not Supported 00:21:47.840 NVMe-MI: Not Supported 00:21:47.840 Virtualization Management: Not Supported 00:21:47.840 Doorbell Buffer Config: Not Supported 00:21:47.840 Get LBA Status Capability: Not Supported 00:21:47.840 Command & Feature Lockdown Capability: Not Supported 00:21:47.840 Abort Command Limit: 1 00:21:47.840 Async Event Request Limit: 4 00:21:47.840 Number of Firmware Slots: N/A 00:21:47.840 Firmware Slot 1 Read-Only: N/A 00:21:47.840 Firmware Activation Without Reset: N/A 00:21:47.840 Multiple Update Detection Support: N/A 00:21:47.840 Firmware Update Granularity: No Information Provided 00:21:47.840 Per-Namespace SMART Log: No 00:21:47.840 Asymmetric Namespace Access Log Page: Not Supported 00:21:47.840 Subsystem NQN: nqn.2014-08.org.nvmexpress.discovery 00:21:47.840 Command Effects Log Page: Not Supported 00:21:47.840 Get Log Page Extended Data: Supported 00:21:47.840 Telemetry Log Pages: Not Supported 00:21:47.840 Persistent Event Log Pages: Not Supported 00:21:47.840 Supported Log Pages Log Page: May Support 00:21:47.840 Commands Supported & Effects Log Page: Not Supported 00:21:47.840 Feature Identifiers & Effects Log Page:May Support 00:21:47.840 NVMe-MI Commands & Effects Log Page: May Support 00:21:47.840 Data Area 4 for Telemetry Log: Not Supported 00:21:47.840 Error Log Page Entries Supported: 128 00:21:47.840 Keep Alive: Not Supported 00:21:47.840 00:21:47.840 NVM Command Set Attributes 00:21:47.840 ========================== 00:21:47.840 Submission Queue Entry Size 00:21:47.840 Max: 1 00:21:47.840 Min: 1 00:21:47.840 Completion Queue Entry Size 00:21:47.840 Max: 1 00:21:47.840 Min: 1 00:21:47.840 Number of Namespaces: 0 00:21:47.840 Compare Command: Not Supported 00:21:47.840 Write Uncorrectable Command: Not Supported 00:21:47.840 Dataset Management Command: Not Supported 00:21:47.840 Write Zeroes Command: Not Supported 00:21:47.840 Set Features Save Field: Not Supported 00:21:47.840 Reservations: Not Supported 00:21:47.840 Timestamp: Not Supported 00:21:47.840 Copy: Not Supported 00:21:47.840 Volatile Write Cache: Not Present 00:21:47.840 Atomic Write Unit (Normal): 1 00:21:47.840 Atomic Write Unit (PFail): 1 00:21:47.840 Atomic Compare & Write Unit: 1 00:21:47.840 Fused Compare & Write: Supported 00:21:47.840 Scatter-Gather List 00:21:47.840 SGL Command Set: Supported 00:21:47.840 SGL Keyed: Supported 00:21:47.840 SGL Bit Bucket Descriptor: Not Supported 00:21:47.840 SGL Metadata Pointer: Not Supported 00:21:47.840 Oversized SGL: Not Supported 00:21:47.840 SGL Metadata Address: Not Supported 00:21:47.840 SGL Offset: Supported 00:21:47.840 Transport SGL Data Block: Not Supported 00:21:47.840 Replay Protected Memory Block: Not Supported 00:21:47.840 00:21:47.840 Firmware Slot Information 00:21:47.840 ========================= 00:21:47.840 Active slot: 0 00:21:47.840 00:21:47.840 00:21:47.840 Error Log 00:21:47.840 ========= 00:21:47.840 00:21:47.840 Active Namespaces 00:21:47.840 ================= 00:21:47.840 Discovery Log Page 00:21:47.840 ================== 00:21:47.840 Generation Counter: 2 00:21:47.840 Number of Records: 2 00:21:47.840 Record Format: 0 00:21:47.840 00:21:47.840 Discovery Log Entry 0 00:21:47.840 ---------------------- 00:21:47.840 Transport Type: 3 (TCP) 00:21:47.840 Address Family: 1 (IPv4) 00:21:47.840 Subsystem Type: 3 (Current Discovery Subsystem) 00:21:47.840 Entry Flags: 00:21:47.840 Duplicate Returned Information: 1 00:21:47.840 Explicit Persistent Connection Support for Discovery: 1 00:21:47.840 Transport Requirements: 00:21:47.840 Secure Channel: Not Required 00:21:47.840 Port ID: 0 (0x0000) 00:21:47.840 Controller ID: 65535 (0xffff) 00:21:47.840 Admin Max SQ Size: 128 00:21:47.840 Transport Service Identifier: 4420 00:21:47.840 NVM Subsystem Qualified Name: nqn.2014-08.org.nvmexpress.discovery 00:21:47.840 Transport Address: 10.0.0.3 00:21:47.840 Discovery Log Entry 1 00:21:47.840 ---------------------- 00:21:47.840 Transport Type: 3 (TCP) 00:21:47.840 Address Family: 1 (IPv4) 00:21:47.840 Subsystem Type: 2 (NVM Subsystem) 00:21:47.840 Entry Flags: 00:21:47.840 Duplicate Returned Information: 0 00:21:47.840 Explicit Persistent Connection Support for Discovery: 0 00:21:47.840 Transport Requirements: 00:21:47.840 Secure Channel: Not Required 00:21:47.840 Port ID: 0 (0x0000) 00:21:47.840 Controller ID: 65535 (0xffff) 00:21:47.840 Admin Max SQ Size: 128 00:21:47.840 Transport Service Identifier: 4420 00:21:47.840 NVM Subsystem Qualified Name: nqn.2016-06.io.spdk:cnode1 00:21:47.840 Transport Address: 10.0.0.3 [2024-10-07 11:32:43.108922] nvme_ctrlr.c:4386:nvme_ctrlr_destruct_async: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] Prepare to destruct SSD 00:21:47.840 [2024-10-07 11:32:43.108942] nvme_tcp.c:1079:nvme_tcp_req_complete: *DEBUG*: complete tcp_req(0xe83000) on tqpair=0xe5c8f0 00:21:47.840 [2024-10-07 11:32:43.108951] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:47.841 [2024-10-07 11:32:43.108958] nvme_tcp.c:1079:nvme_tcp_req_complete: *DEBUG*: complete tcp_req(0xe83180) on tqpair=0xe5c8f0 00:21:47.841 [2024-10-07 11:32:43.108963] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:47.841 [2024-10-07 11:32:43.108969] nvme_tcp.c:1079:nvme_tcp_req_complete: *DEBUG*: complete tcp_req(0xe83300) on tqpair=0xe5c8f0 00:21:47.841 [2024-10-07 11:32:43.108974] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:47.841 [2024-10-07 11:32:43.108979] nvme_tcp.c:1079:nvme_tcp_req_complete: *DEBUG*: complete tcp_req(0xe83480) on tqpair=0xe5c8f0 00:21:47.841 [2024-10-07 11:32:43.108984] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:47.841 [2024-10-07 11:32:43.109007] nvme_tcp.c: 800:nvme_tcp_build_contig_request: *DEBUG*: enter 00:21:47.841 [2024-10-07 11:32:43.109012] nvme_tcp.c: 977:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:21:47.841 [2024-10-07 11:32:43.109016] nvme_tcp.c: 986:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0xe5c8f0) 00:21:47.841 [2024-10-07 11:32:43.109038] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:47.841 [2024-10-07 11:32:43.109078] nvme_tcp.c: 951:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xe83480, cid 3, qid 0 00:21:47.841 [2024-10-07 11:32:43.109169] nvme_tcp.c:1198:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:21:47.841 [2024-10-07 11:32:43.109186] nvme_tcp.c:1986:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:21:47.841 [2024-10-07 11:32:43.109190] nvme_tcp.c:1659:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:21:47.841 [2024-10-07 11:32:43.109195] nvme_tcp.c:1079:nvme_tcp_req_complete: *DEBUG*: complete tcp_req(0xe83480) on tqpair=0xe5c8f0 00:21:47.841 [2024-10-07 11:32:43.109216] nvme_tcp.c: 800:nvme_tcp_build_contig_request: *DEBUG*: enter 00:21:47.841 [2024-10-07 11:32:43.109221] nvme_tcp.c: 977:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:21:47.841 [2024-10-07 11:32:43.109225] nvme_tcp.c: 986:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0xe5c8f0) 00:21:47.841 [2024-10-07 11:32:43.109232] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY SET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:47.841 [2024-10-07 11:32:43.109257] nvme_tcp.c: 951:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xe83480, cid 3, qid 0 00:21:47.841 [2024-10-07 11:32:43.109355] nvme_tcp.c:1198:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:21:47.841 [2024-10-07 11:32:43.109362] nvme_tcp.c:1986:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:21:47.841 [2024-10-07 11:32:43.109366] nvme_tcp.c:1659:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:21:47.841 [2024-10-07 11:32:43.109370] nvme_tcp.c:1079:nvme_tcp_req_complete: *DEBUG*: complete tcp_req(0xe83480) on tqpair=0xe5c8f0 00:21:47.841 [2024-10-07 11:32:43.109376] nvme_ctrlr.c:1147:nvme_ctrlr_shutdown_set_cc_done: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] RTD3E = 0 us 00:21:47.841 [2024-10-07 11:32:43.109381] nvme_ctrlr.c:1150:nvme_ctrlr_shutdown_set_cc_done: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] shutdown timeout = 10000 ms 00:21:47.841 [2024-10-07 11:32:43.109392] nvme_tcp.c: 800:nvme_tcp_build_contig_request: *DEBUG*: enter 00:21:47.841 [2024-10-07 11:32:43.109397] nvme_tcp.c: 977:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:21:47.841 [2024-10-07 11:32:43.109401] nvme_tcp.c: 986:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0xe5c8f0) 00:21:47.841 [2024-10-07 11:32:43.109409] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:47.841 [2024-10-07 11:32:43.109427] nvme_tcp.c: 951:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xe83480, cid 3, qid 0 00:21:47.841 [2024-10-07 11:32:43.109481] nvme_tcp.c:1198:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:21:47.841 [2024-10-07 11:32:43.109488] nvme_tcp.c:1986:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:21:47.841 [2024-10-07 11:32:43.109492] nvme_tcp.c:1659:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:21:47.841 [2024-10-07 11:32:43.109496] nvme_tcp.c:1079:nvme_tcp_req_complete: *DEBUG*: complete tcp_req(0xe83480) on tqpair=0xe5c8f0 00:21:47.841 [2024-10-07 11:32:43.109508] nvme_tcp.c: 800:nvme_tcp_build_contig_request: *DEBUG*: enter 00:21:47.841 [2024-10-07 11:32:43.109514] nvme_tcp.c: 977:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:21:47.841 [2024-10-07 11:32:43.109518] nvme_tcp.c: 986:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0xe5c8f0) 00:21:47.841 [2024-10-07 11:32:43.109526] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:47.841 [2024-10-07 11:32:43.109544] nvme_tcp.c: 951:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xe83480, cid 3, qid 0 00:21:47.841 [2024-10-07 11:32:43.109601] nvme_tcp.c:1198:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:21:47.841 [2024-10-07 11:32:43.109608] nvme_tcp.c:1986:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:21:47.841 [2024-10-07 11:32:43.109611] nvme_tcp.c:1659:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:21:47.841 [2024-10-07 11:32:43.109616] nvme_tcp.c:1079:nvme_tcp_req_complete: *DEBUG*: complete tcp_req(0xe83480) on tqpair=0xe5c8f0 00:21:47.841 [2024-10-07 11:32:43.109626] nvme_tcp.c: 800:nvme_tcp_build_contig_request: *DEBUG*: enter 00:21:47.841 [2024-10-07 11:32:43.109639] nvme_tcp.c: 977:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:21:47.841 [2024-10-07 11:32:43.109643] nvme_tcp.c: 986:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0xe5c8f0) 00:21:47.841 [2024-10-07 11:32:43.109667] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:47.841 [2024-10-07 11:32:43.109689] nvme_tcp.c: 951:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xe83480, cid 3, qid 0 00:21:47.841 [2024-10-07 11:32:43.109747] nvme_tcp.c:1198:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:21:47.841 [2024-10-07 11:32:43.109754] nvme_tcp.c:1986:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:21:47.841 [2024-10-07 11:32:43.109758] nvme_tcp.c:1659:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:21:47.841 [2024-10-07 11:32:43.109762] nvme_tcp.c:1079:nvme_tcp_req_complete: *DEBUG*: complete tcp_req(0xe83480) on tqpair=0xe5c8f0 00:21:47.841 [2024-10-07 11:32:43.109773] nvme_tcp.c: 800:nvme_tcp_build_contig_request: *DEBUG*: enter 00:21:47.841 [2024-10-07 11:32:43.109778] nvme_tcp.c: 977:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:21:47.841 [2024-10-07 11:32:43.109782] nvme_tcp.c: 986:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0xe5c8f0) 00:21:47.841 [2024-10-07 11:32:43.109790] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:47.841 [2024-10-07 11:32:43.109809] nvme_tcp.c: 951:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xe83480, cid 3, qid 0 00:21:47.841 [2024-10-07 11:32:43.109863] nvme_tcp.c:1198:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:21:47.841 [2024-10-07 11:32:43.109870] nvme_tcp.c:1986:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:21:47.841 [2024-10-07 11:32:43.109873] nvme_tcp.c:1659:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:21:47.841 [2024-10-07 11:32:43.109888] nvme_tcp.c:1079:nvme_tcp_req_complete: *DEBUG*: complete tcp_req(0xe83480) on tqpair=0xe5c8f0 00:21:47.841 [2024-10-07 11:32:43.109899] nvme_tcp.c: 800:nvme_tcp_build_contig_request: *DEBUG*: enter 00:21:47.841 [2024-10-07 11:32:43.109904] nvme_tcp.c: 977:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:21:47.841 [2024-10-07 11:32:43.109917] nvme_tcp.c: 986:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0xe5c8f0) 00:21:47.841 [2024-10-07 11:32:43.109925] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:47.841 [2024-10-07 11:32:43.109942] nvme_tcp.c: 951:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xe83480, cid 3, qid 0 00:21:47.841 [2024-10-07 11:32:43.110006] nvme_tcp.c:1198:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:21:47.841 [2024-10-07 11:32:43.110013] nvme_tcp.c:1986:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:21:47.841 [2024-10-07 11:32:43.110017] nvme_tcp.c:1659:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:21:47.841 [2024-10-07 11:32:43.110021] nvme_tcp.c:1079:nvme_tcp_req_complete: *DEBUG*: complete tcp_req(0xe83480) on tqpair=0xe5c8f0 00:21:47.841 [2024-10-07 11:32:43.110032] nvme_tcp.c: 800:nvme_tcp_build_contig_request: *DEBUG*: enter 00:21:47.841 [2024-10-07 11:32:43.110037] nvme_tcp.c: 977:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:21:47.841 [2024-10-07 11:32:43.110041] nvme_tcp.c: 986:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0xe5c8f0) 00:21:47.841 [2024-10-07 11:32:43.110048] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:47.841 [2024-10-07 11:32:43.110077] nvme_tcp.c: 951:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xe83480, cid 3, qid 0 00:21:47.841 [2024-10-07 11:32:43.110144] nvme_tcp.c:1198:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:21:47.841 [2024-10-07 11:32:43.110152] nvme_tcp.c:1986:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:21:47.841 [2024-10-07 11:32:43.110155] nvme_tcp.c:1659:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:21:47.841 [2024-10-07 11:32:43.110160] nvme_tcp.c:1079:nvme_tcp_req_complete: *DEBUG*: complete tcp_req(0xe83480) on tqpair=0xe5c8f0 00:21:47.841 [2024-10-07 11:32:43.110171] nvme_tcp.c: 800:nvme_tcp_build_contig_request: *DEBUG*: enter 00:21:47.841 [2024-10-07 11:32:43.110176] nvme_tcp.c: 977:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:21:47.841 [2024-10-07 11:32:43.110180] nvme_tcp.c: 986:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0xe5c8f0) 00:21:47.841 [2024-10-07 11:32:43.110187] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:47.841 [2024-10-07 11:32:43.110205] nvme_tcp.c: 951:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xe83480, cid 3, qid 0 00:21:47.841 [2024-10-07 11:32:43.110258] nvme_tcp.c:1198:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:21:47.841 [2024-10-07 11:32:43.110265] nvme_tcp.c:1986:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:21:47.841 [2024-10-07 11:32:43.110268] nvme_tcp.c:1659:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:21:47.841 [2024-10-07 11:32:43.110273] nvme_tcp.c:1079:nvme_tcp_req_complete: *DEBUG*: complete tcp_req(0xe83480) on tqpair=0xe5c8f0 00:21:47.841 [2024-10-07 11:32:43.110284] nvme_tcp.c: 800:nvme_tcp_build_contig_request: *DEBUG*: enter 00:21:47.841 [2024-10-07 11:32:43.110289] nvme_tcp.c: 977:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:21:47.841 [2024-10-07 11:32:43.110293] nvme_tcp.c: 986:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0xe5c8f0) 00:21:47.841 [2024-10-07 11:32:43.110300] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:47.841 [2024-10-07 11:32:43.110318] nvme_tcp.c: 951:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xe83480, cid 3, qid 0 00:21:47.841 [2024-10-07 11:32:43.110375] nvme_tcp.c:1198:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:21:47.841 [2024-10-07 11:32:43.110382] nvme_tcp.c:1986:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:21:47.841 [2024-10-07 11:32:43.110386] nvme_tcp.c:1659:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:21:47.841 [2024-10-07 11:32:43.110390] nvme_tcp.c:1079:nvme_tcp_req_complete: *DEBUG*: complete tcp_req(0xe83480) on tqpair=0xe5c8f0 00:21:47.841 [2024-10-07 11:32:43.110401] nvme_tcp.c: 800:nvme_tcp_build_contig_request: *DEBUG*: enter 00:21:47.841 [2024-10-07 11:32:43.110406] nvme_tcp.c: 977:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:21:47.841 [2024-10-07 11:32:43.110410] nvme_tcp.c: 986:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0xe5c8f0) 00:21:47.841 [2024-10-07 11:32:43.110417] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:47.841 [2024-10-07 11:32:43.110436] nvme_tcp.c: 951:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xe83480, cid 3, qid 0 00:21:47.841 [2024-10-07 11:32:43.110494] nvme_tcp.c:1198:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:21:47.841 [2024-10-07 11:32:43.110501] nvme_tcp.c:1986:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:21:47.842 [2024-10-07 11:32:43.110505] nvme_tcp.c:1659:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:21:47.842 [2024-10-07 11:32:43.110509] nvme_tcp.c:1079:nvme_tcp_req_complete: *DEBUG*: complete tcp_req(0xe83480) on tqpair=0xe5c8f0 00:21:47.842 [2024-10-07 11:32:43.110520] nvme_tcp.c: 800:nvme_tcp_build_contig_request: *DEBUG*: enter 00:21:47.842 [2024-10-07 11:32:43.110525] nvme_tcp.c: 977:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:21:47.842 [2024-10-07 11:32:43.110529] nvme_tcp.c: 986:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0xe5c8f0) 00:21:47.842 [2024-10-07 11:32:43.110536] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:47.842 [2024-10-07 11:32:43.110554] nvme_tcp.c: 951:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xe83480, cid 3, qid 0 00:21:47.842 [2024-10-07 11:32:43.110618] nvme_tcp.c:1198:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:21:47.842 [2024-10-07 11:32:43.110625] nvme_tcp.c:1986:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:21:47.842 [2024-10-07 11:32:43.110629] nvme_tcp.c:1659:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:21:47.842 [2024-10-07 11:32:43.110633] nvme_tcp.c:1079:nvme_tcp_req_complete: *DEBUG*: complete tcp_req(0xe83480) on tqpair=0xe5c8f0 00:21:47.842 [2024-10-07 11:32:43.110667] nvme_tcp.c: 800:nvme_tcp_build_contig_request: *DEBUG*: enter 00:21:47.842 [2024-10-07 11:32:43.110674] nvme_tcp.c: 977:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:21:47.842 [2024-10-07 11:32:43.110678] nvme_tcp.c: 986:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0xe5c8f0) 00:21:47.842 [2024-10-07 11:32:43.110685] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:47.842 [2024-10-07 11:32:43.110717] nvme_tcp.c: 951:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xe83480, cid 3, qid 0 00:21:47.842 [2024-10-07 11:32:43.110785] nvme_tcp.c:1198:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:21:47.842 [2024-10-07 11:32:43.110792] nvme_tcp.c:1986:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:21:47.842 [2024-10-07 11:32:43.110796] nvme_tcp.c:1659:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:21:47.842 [2024-10-07 11:32:43.110801] nvme_tcp.c:1079:nvme_tcp_req_complete: *DEBUG*: complete tcp_req(0xe83480) on tqpair=0xe5c8f0 00:21:47.842 [2024-10-07 11:32:43.110811] nvme_tcp.c: 800:nvme_tcp_build_contig_request: *DEBUG*: enter 00:21:47.842 [2024-10-07 11:32:43.110817] nvme_tcp.c: 977:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:21:47.842 [2024-10-07 11:32:43.110820] nvme_tcp.c: 986:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0xe5c8f0) 00:21:47.842 [2024-10-07 11:32:43.110828] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:47.842 [2024-10-07 11:32:43.110846] nvme_tcp.c: 951:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xe83480, cid 3, qid 0 00:21:47.842 [2024-10-07 11:32:43.110899] nvme_tcp.c:1198:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:21:47.842 [2024-10-07 11:32:43.110907] nvme_tcp.c:1986:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:21:47.842 [2024-10-07 11:32:43.110923] nvme_tcp.c:1659:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:21:47.842 [2024-10-07 11:32:43.110927] nvme_tcp.c:1079:nvme_tcp_req_complete: *DEBUG*: complete tcp_req(0xe83480) on tqpair=0xe5c8f0 00:21:47.842 [2024-10-07 11:32:43.110939] nvme_tcp.c: 800:nvme_tcp_build_contig_request: *DEBUG*: enter 00:21:47.842 [2024-10-07 11:32:43.110944] nvme_tcp.c: 977:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:21:47.842 [2024-10-07 11:32:43.110948] nvme_tcp.c: 986:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0xe5c8f0) 00:21:47.842 [2024-10-07 11:32:43.110955] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:47.842 [2024-10-07 11:32:43.110976] nvme_tcp.c: 951:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xe83480, cid 3, qid 0 00:21:47.842 [2024-10-07 11:32:43.111029] nvme_tcp.c:1198:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:21:47.842 [2024-10-07 11:32:43.111042] nvme_tcp.c:1986:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:21:47.842 [2024-10-07 11:32:43.111047] nvme_tcp.c:1659:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:21:47.842 [2024-10-07 11:32:43.111052] nvme_tcp.c:1079:nvme_tcp_req_complete: *DEBUG*: complete tcp_req(0xe83480) on tqpair=0xe5c8f0 00:21:47.842 [2024-10-07 11:32:43.111063] nvme_tcp.c: 800:nvme_tcp_build_contig_request: *DEBUG*: enter 00:21:47.842 [2024-10-07 11:32:43.111068] nvme_tcp.c: 977:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:21:47.842 [2024-10-07 11:32:43.111072] nvme_tcp.c: 986:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0xe5c8f0) 00:21:47.842 [2024-10-07 11:32:43.111080] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:47.842 [2024-10-07 11:32:43.111099] nvme_tcp.c: 951:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xe83480, cid 3, qid 0 00:21:47.842 [2024-10-07 11:32:43.111155] nvme_tcp.c:1198:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:21:47.842 [2024-10-07 11:32:43.111162] nvme_tcp.c:1986:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:21:47.842 [2024-10-07 11:32:43.111166] nvme_tcp.c:1659:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:21:47.842 [2024-10-07 11:32:43.111171] nvme_tcp.c:1079:nvme_tcp_req_complete: *DEBUG*: complete tcp_req(0xe83480) on tqpair=0xe5c8f0 00:21:47.842 [2024-10-07 11:32:43.111181] nvme_tcp.c: 800:nvme_tcp_build_contig_request: *DEBUG*: enter 00:21:47.842 [2024-10-07 11:32:43.111187] nvme_tcp.c: 977:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:21:47.842 [2024-10-07 11:32:43.111191] nvme_tcp.c: 986:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0xe5c8f0) 00:21:47.842 [2024-10-07 11:32:43.111198] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:47.842 [2024-10-07 11:32:43.111217] nvme_tcp.c: 951:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xe83480, cid 3, qid 0 00:21:47.842 [2024-10-07 11:32:43.111280] nvme_tcp.c:1198:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:21:47.842 [2024-10-07 11:32:43.111296] nvme_tcp.c:1986:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:21:47.842 [2024-10-07 11:32:43.111300] nvme_tcp.c:1659:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:21:47.842 [2024-10-07 11:32:43.111304] nvme_tcp.c:1079:nvme_tcp_req_complete: *DEBUG*: complete tcp_req(0xe83480) on tqpair=0xe5c8f0 00:21:47.842 [2024-10-07 11:32:43.111315] nvme_tcp.c: 800:nvme_tcp_build_contig_request: *DEBUG*: enter 00:21:47.842 [2024-10-07 11:32:43.111320] nvme_tcp.c: 977:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:21:47.842 [2024-10-07 11:32:43.111324] nvme_tcp.c: 986:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0xe5c8f0) 00:21:47.842 [2024-10-07 11:32:43.111331] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:47.842 [2024-10-07 11:32:43.111352] nvme_tcp.c: 951:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xe83480, cid 3, qid 0 00:21:47.842 [2024-10-07 11:32:43.111406] nvme_tcp.c:1198:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:21:47.842 [2024-10-07 11:32:43.111417] nvme_tcp.c:1986:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:21:47.842 [2024-10-07 11:32:43.111422] nvme_tcp.c:1659:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:21:47.842 [2024-10-07 11:32:43.111426] nvme_tcp.c:1079:nvme_tcp_req_complete: *DEBUG*: complete tcp_req(0xe83480) on tqpair=0xe5c8f0 00:21:47.842 [2024-10-07 11:32:43.111437] nvme_tcp.c: 800:nvme_tcp_build_contig_request: *DEBUG*: enter 00:21:47.842 [2024-10-07 11:32:43.111442] nvme_tcp.c: 977:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:21:47.842 [2024-10-07 11:32:43.111446] nvme_tcp.c: 986:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0xe5c8f0) 00:21:47.842 [2024-10-07 11:32:43.111454] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:47.842 [2024-10-07 11:32:43.111473] nvme_tcp.c: 951:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xe83480, cid 3, qid 0 00:21:47.842 [2024-10-07 11:32:43.111524] nvme_tcp.c:1198:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:21:47.842 [2024-10-07 11:32:43.111531] nvme_tcp.c:1986:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:21:47.842 [2024-10-07 11:32:43.111535] nvme_tcp.c:1659:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:21:47.842 [2024-10-07 11:32:43.111540] nvme_tcp.c:1079:nvme_tcp_req_complete: *DEBUG*: complete tcp_req(0xe83480) on tqpair=0xe5c8f0 00:21:47.842 [2024-10-07 11:32:43.111550] nvme_tcp.c: 800:nvme_tcp_build_contig_request: *DEBUG*: enter 00:21:47.842 [2024-10-07 11:32:43.111555] nvme_tcp.c: 977:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:21:47.842 [2024-10-07 11:32:43.111559] nvme_tcp.c: 986:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0xe5c8f0) 00:21:47.842 [2024-10-07 11:32:43.111567] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:47.842 [2024-10-07 11:32:43.111585] nvme_tcp.c: 951:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xe83480, cid 3, qid 0 00:21:47.842 [2024-10-07 11:32:43.111638] nvme_tcp.c:1198:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:21:47.842 [2024-10-07 11:32:43.111645] nvme_tcp.c:1986:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:21:47.842 [2024-10-07 11:32:43.111664] nvme_tcp.c:1659:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:21:47.842 [2024-10-07 11:32:43.111669] nvme_tcp.c:1079:nvme_tcp_req_complete: *DEBUG*: complete tcp_req(0xe83480) on tqpair=0xe5c8f0 00:21:47.842 [2024-10-07 11:32:43.111682] nvme_tcp.c: 800:nvme_tcp_build_contig_request: *DEBUG*: enter 00:21:47.842 [2024-10-07 11:32:43.111687] nvme_tcp.c: 977:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:21:47.842 [2024-10-07 11:32:43.111691] nvme_tcp.c: 986:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0xe5c8f0) 00:21:47.842 [2024-10-07 11:32:43.111699] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:47.842 [2024-10-07 11:32:43.111720] nvme_tcp.c: 951:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xe83480, cid 3, qid 0 00:21:47.842 [2024-10-07 11:32:43.111776] nvme_tcp.c:1198:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:21:47.842 [2024-10-07 11:32:43.111783] nvme_tcp.c:1986:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:21:47.842 [2024-10-07 11:32:43.111787] nvme_tcp.c:1659:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:21:47.842 [2024-10-07 11:32:43.111791] nvme_tcp.c:1079:nvme_tcp_req_complete: *DEBUG*: complete tcp_req(0xe83480) on tqpair=0xe5c8f0 00:21:47.842 [2024-10-07 11:32:43.111802] nvme_tcp.c: 800:nvme_tcp_build_contig_request: *DEBUG*: enter 00:21:47.842 [2024-10-07 11:32:43.111807] nvme_tcp.c: 977:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:21:47.842 [2024-10-07 11:32:43.111811] nvme_tcp.c: 986:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0xe5c8f0) 00:21:47.842 [2024-10-07 11:32:43.111819] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:47.842 [2024-10-07 11:32:43.111837] nvme_tcp.c: 951:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xe83480, cid 3, qid 0 00:21:47.842 [2024-10-07 11:32:43.111889] nvme_tcp.c:1198:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:21:47.842 [2024-10-07 11:32:43.111896] nvme_tcp.c:1986:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:21:47.842 [2024-10-07 11:32:43.111900] nvme_tcp.c:1659:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:21:47.842 [2024-10-07 11:32:43.111905] nvme_tcp.c:1079:nvme_tcp_req_complete: *DEBUG*: complete tcp_req(0xe83480) on tqpair=0xe5c8f0 00:21:47.842 [2024-10-07 11:32:43.111915] nvme_tcp.c: 800:nvme_tcp_build_contig_request: *DEBUG*: enter 00:21:47.842 [2024-10-07 11:32:43.111920] nvme_tcp.c: 977:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:21:47.843 [2024-10-07 11:32:43.111924] nvme_tcp.c: 986:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0xe5c8f0) 00:21:47.843 [2024-10-07 11:32:43.111932] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:47.843 [2024-10-07 11:32:43.111950] nvme_tcp.c: 951:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xe83480, cid 3, qid 0 00:21:47.843 [2024-10-07 11:32:43.112003] nvme_tcp.c:1198:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:21:47.843 [2024-10-07 11:32:43.112010] nvme_tcp.c:1986:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:21:47.843 [2024-10-07 11:32:43.112014] nvme_tcp.c:1659:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:21:47.843 [2024-10-07 11:32:43.112018] nvme_tcp.c:1079:nvme_tcp_req_complete: *DEBUG*: complete tcp_req(0xe83480) on tqpair=0xe5c8f0 00:21:47.843 [2024-10-07 11:32:43.112029] nvme_tcp.c: 800:nvme_tcp_build_contig_request: *DEBUG*: enter 00:21:47.843 [2024-10-07 11:32:43.112034] nvme_tcp.c: 977:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:21:47.843 [2024-10-07 11:32:43.112038] nvme_tcp.c: 986:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0xe5c8f0) 00:21:47.843 [2024-10-07 11:32:43.112045] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:47.843 [2024-10-07 11:32:43.112064] nvme_tcp.c: 951:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xe83480, cid 3, qid 0 00:21:47.843 [2024-10-07 11:32:43.112116] nvme_tcp.c:1198:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:21:47.843 [2024-10-07 11:32:43.112123] nvme_tcp.c:1986:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:21:47.843 [2024-10-07 11:32:43.112127] nvme_tcp.c:1659:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:21:47.843 [2024-10-07 11:32:43.112131] nvme_tcp.c:1079:nvme_tcp_req_complete: *DEBUG*: complete tcp_req(0xe83480) on tqpair=0xe5c8f0 00:21:47.843 [2024-10-07 11:32:43.112142] nvme_tcp.c: 800:nvme_tcp_build_contig_request: *DEBUG*: enter 00:21:47.843 [2024-10-07 11:32:43.112147] nvme_tcp.c: 977:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:21:47.843 [2024-10-07 11:32:43.112151] nvme_tcp.c: 986:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0xe5c8f0) 00:21:47.843 [2024-10-07 11:32:43.112159] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:47.843 [2024-10-07 11:32:43.112177] nvme_tcp.c: 951:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xe83480, cid 3, qid 0 00:21:47.843 [2024-10-07 11:32:43.112232] nvme_tcp.c:1198:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:21:47.843 [2024-10-07 11:32:43.112239] nvme_tcp.c:1986:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:21:47.843 [2024-10-07 11:32:43.112243] nvme_tcp.c:1659:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:21:47.843 [2024-10-07 11:32:43.112247] nvme_tcp.c:1079:nvme_tcp_req_complete: *DEBUG*: complete tcp_req(0xe83480) on tqpair=0xe5c8f0 00:21:47.843 [2024-10-07 11:32:43.112258] nvme_tcp.c: 800:nvme_tcp_build_contig_request: *DEBUG*: enter 00:21:47.843 [2024-10-07 11:32:43.112263] nvme_tcp.c: 977:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:21:47.843 [2024-10-07 11:32:43.112267] nvme_tcp.c: 986:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0xe5c8f0) 00:21:47.843 [2024-10-07 11:32:43.112274] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:47.843 [2024-10-07 11:32:43.112292] nvme_tcp.c: 951:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xe83480, cid 3, qid 0 00:21:47.843 [2024-10-07 11:32:43.112344] nvme_tcp.c:1198:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:21:47.843 [2024-10-07 11:32:43.112351] nvme_tcp.c:1986:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:21:47.843 [2024-10-07 11:32:43.112355] nvme_tcp.c:1659:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:21:47.843 [2024-10-07 11:32:43.112359] nvme_tcp.c:1079:nvme_tcp_req_complete: *DEBUG*: complete tcp_req(0xe83480) on tqpair=0xe5c8f0 00:21:47.843 [2024-10-07 11:32:43.112370] nvme_tcp.c: 800:nvme_tcp_build_contig_request: *DEBUG*: enter 00:21:47.843 [2024-10-07 11:32:43.112374] nvme_tcp.c: 977:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:21:47.843 [2024-10-07 11:32:43.112378] nvme_tcp.c: 986:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0xe5c8f0) 00:21:47.843 [2024-10-07 11:32:43.112386] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:47.843 [2024-10-07 11:32:43.112404] nvme_tcp.c: 951:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xe83480, cid 3, qid 0 00:21:47.843 [2024-10-07 11:32:43.112458] nvme_tcp.c:1198:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:21:47.843 [2024-10-07 11:32:43.112465] nvme_tcp.c:1986:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:21:47.843 [2024-10-07 11:32:43.112469] nvme_tcp.c:1659:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:21:47.843 [2024-10-07 11:32:43.112473] nvme_tcp.c:1079:nvme_tcp_req_complete: *DEBUG*: complete tcp_req(0xe83480) on tqpair=0xe5c8f0 00:21:47.843 [2024-10-07 11:32:43.112484] nvme_tcp.c: 800:nvme_tcp_build_contig_request: *DEBUG*: enter 00:21:47.843 [2024-10-07 11:32:43.112489] nvme_tcp.c: 977:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:21:47.843 [2024-10-07 11:32:43.112493] nvme_tcp.c: 986:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0xe5c8f0) 00:21:47.843 [2024-10-07 11:32:43.112500] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:47.843 [2024-10-07 11:32:43.112518] nvme_tcp.c: 951:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xe83480, cid 3, qid 0 00:21:47.843 [2024-10-07 11:32:43.112569] nvme_tcp.c:1198:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:21:47.843 [2024-10-07 11:32:43.112576] nvme_tcp.c:1986:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:21:47.843 [2024-10-07 11:32:43.112580] nvme_tcp.c:1659:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:21:47.843 [2024-10-07 11:32:43.112594] nvme_tcp.c:1079:nvme_tcp_req_complete: *DEBUG*: complete tcp_req(0xe83480) on tqpair=0xe5c8f0 00:21:47.843 [2024-10-07 11:32:43.112605] nvme_tcp.c: 800:nvme_tcp_build_contig_request: *DEBUG*: enter 00:21:47.843 [2024-10-07 11:32:43.112620] nvme_tcp.c: 977:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:21:47.843 [2024-10-07 11:32:43.112623] nvme_tcp.c: 986:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0xe5c8f0) 00:21:47.843 [2024-10-07 11:32:43.112631] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:47.843 [2024-10-07 11:32:43.116683] nvme_tcp.c: 951:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xe83480, cid 3, qid 0 00:21:47.843 [2024-10-07 11:32:43.116742] nvme_tcp.c:1198:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:21:47.843 [2024-10-07 11:32:43.116761] nvme_tcp.c:1986:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:21:47.843 [2024-10-07 11:32:43.116765] nvme_tcp.c:1659:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:21:47.843 [2024-10-07 11:32:43.116770] nvme_tcp.c:1079:nvme_tcp_req_complete: *DEBUG*: complete tcp_req(0xe83480) on tqpair=0xe5c8f0 00:21:47.843 [2024-10-07 11:32:43.116781] nvme_ctrlr.c:1269:nvme_ctrlr_shutdown_poll_async: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] shutdown complete in 7 milliseconds 00:21:47.843 00:21:47.843 11:32:43 nvmf_tcp.nvmf_host.nvmf_identify -- host/identify.sh@45 -- # /home/vagrant/spdk_repo/spdk/build/bin/spdk_nvme_identify -r ' trtype:tcp adrfam:IPv4 traddr:10.0.0.3 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1' -L all 00:21:47.843 [2024-10-07 11:32:43.162295] Starting SPDK v25.01-pre git sha1 2a4f56c54 / DPDK 24.03.0 initialization... 00:21:47.843 [2024-10-07 11:32:43.162364] [ DPDK EAL parameters: identify --no-shconf -c 0x1 -n 1 -m 0 --no-pci --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --iova-mode=pa --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid87766 ] 00:21:47.843 [2024-10-07 11:32:43.304161] nvme_ctrlr.c:1563:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to connect adminq (no timeout) 00:21:47.843 [2024-10-07 11:32:43.304227] nvme_tcp.c:2349:nvme_tcp_qpair_connect_sock: *DEBUG*: adrfam 1 ai_family 2 00:21:47.843 [2024-10-07 11:32:43.304234] nvme_tcp.c:2353:nvme_tcp_qpair_connect_sock: *DEBUG*: trsvcid is 4420 00:21:47.843 [2024-10-07 11:32:43.304247] nvme_tcp.c:2374:nvme_tcp_qpair_connect_sock: *DEBUG*: sock_impl_name is (null) 00:21:47.843 [2024-10-07 11:32:43.304260] sock.c: 373:spdk_sock_connect_ext: *DEBUG*: Creating a client socket using impl posix 00:21:47.843 [2024-10-07 11:32:43.304619] nvme_ctrlr.c:1563:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to wait for connect adminq (no timeout) 00:21:47.843 [2024-10-07 11:32:43.308724] nvme_tcp.c:1566:nvme_tcp_send_icreq_complete: *DEBUG*: Complete the icreq send for tqpair=0x10da8f0 0 00:21:47.843 [2024-10-07 11:32:43.316688] nvme_tcp.c:1198:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 1 00:21:47.843 [2024-10-07 11:32:43.316715] nvme_tcp.c:1986:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =1 00:21:47.843 [2024-10-07 11:32:43.316722] nvme_tcp.c:1612:nvme_tcp_icresp_handle: *DEBUG*: host_hdgst_enable: 0 00:21:47.843 [2024-10-07 11:32:43.316725] nvme_tcp.c:1613:nvme_tcp_icresp_handle: *DEBUG*: host_ddgst_enable: 0 00:21:47.843 [2024-10-07 11:32:43.316763] nvme_tcp.c: 800:nvme_tcp_build_contig_request: *DEBUG*: enter 00:21:47.843 [2024-10-07 11:32:43.316771] nvme_tcp.c: 977:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:21:47.843 [2024-10-07 11:32:43.316775] nvme_tcp.c: 986:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x10da8f0) 00:21:47.843 [2024-10-07 11:32:43.316790] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC CONNECT qid:0 cid:0 SGL DATA BLOCK OFFSET 0x0 len:0x400 00:21:47.843 [2024-10-07 11:32:43.316835] nvme_tcp.c: 951:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1101000, cid 0, qid 0 00:21:47.843 [2024-10-07 11:32:43.324667] nvme_tcp.c:1198:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:21:47.843 [2024-10-07 11:32:43.324692] nvme_tcp.c:1986:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:21:47.843 [2024-10-07 11:32:43.324697] nvme_tcp.c:1659:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:21:47.843 [2024-10-07 11:32:43.324703] nvme_tcp.c:1079:nvme_tcp_req_complete: *DEBUG*: complete tcp_req(0x1101000) on tqpair=0x10da8f0 00:21:47.843 [2024-10-07 11:32:43.324725] nvme_fabric.c: 621:nvme_fabric_qpair_connect_poll: *DEBUG*: CNTLID 0x0001 00:21:47.843 [2024-10-07 11:32:43.324734] nvme_ctrlr.c:1563:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to read vs (no timeout) 00:21:47.843 [2024-10-07 11:32:43.324741] nvme_ctrlr.c:1563:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to read vs wait for vs (no timeout) 00:21:47.843 [2024-10-07 11:32:43.324758] nvme_tcp.c: 800:nvme_tcp_build_contig_request: *DEBUG*: enter 00:21:47.843 [2024-10-07 11:32:43.324776] nvme_tcp.c: 977:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:21:47.843 [2024-10-07 11:32:43.324780] nvme_tcp.c: 986:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x10da8f0) 00:21:47.843 [2024-10-07 11:32:43.324790] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:47.843 [2024-10-07 11:32:43.324820] nvme_tcp.c: 951:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1101000, cid 0, qid 0 00:21:47.843 [2024-10-07 11:32:43.324890] nvme_tcp.c:1198:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:21:47.843 [2024-10-07 11:32:43.324898] nvme_tcp.c:1986:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:21:47.843 [2024-10-07 11:32:43.324902] nvme_tcp.c:1659:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:21:47.843 [2024-10-07 11:32:43.324906] nvme_tcp.c:1079:nvme_tcp_req_complete: *DEBUG*: complete tcp_req(0x1101000) on tqpair=0x10da8f0 00:21:47.843 [2024-10-07 11:32:43.324912] nvme_ctrlr.c:1563:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to read cap (no timeout) 00:21:47.843 [2024-10-07 11:32:43.324931] nvme_ctrlr.c:1563:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to read cap wait for cap (no timeout) 00:21:47.843 [2024-10-07 11:32:43.324939] nvme_tcp.c: 800:nvme_tcp_build_contig_request: *DEBUG*: enter 00:21:47.843 [2024-10-07 11:32:43.324943] nvme_tcp.c: 977:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:21:47.843 [2024-10-07 11:32:43.324947] nvme_tcp.c: 986:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x10da8f0) 00:21:47.844 [2024-10-07 11:32:43.324966] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:47.844 [2024-10-07 11:32:43.324986] nvme_tcp.c: 951:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1101000, cid 0, qid 0 00:21:47.844 [2024-10-07 11:32:43.325054] nvme_tcp.c:1198:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:21:47.844 [2024-10-07 11:32:43.325061] nvme_tcp.c:1986:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:21:47.844 [2024-10-07 11:32:43.325065] nvme_tcp.c:1659:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:21:47.844 [2024-10-07 11:32:43.325069] nvme_tcp.c:1079:nvme_tcp_req_complete: *DEBUG*: complete tcp_req(0x1101000) on tqpair=0x10da8f0 00:21:47.844 [2024-10-07 11:32:43.325086] nvme_ctrlr.c:1563:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to check en (no timeout) 00:21:47.844 [2024-10-07 11:32:43.325095] nvme_ctrlr.c:1557:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to check en wait for cc (timeout 15000 ms) 00:21:47.844 [2024-10-07 11:32:43.325102] nvme_tcp.c: 800:nvme_tcp_build_contig_request: *DEBUG*: enter 00:21:47.844 [2024-10-07 11:32:43.325107] nvme_tcp.c: 977:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:21:47.844 [2024-10-07 11:32:43.325111] nvme_tcp.c: 986:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x10da8f0) 00:21:47.844 [2024-10-07 11:32:43.325129] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:47.844 [2024-10-07 11:32:43.325148] nvme_tcp.c: 951:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1101000, cid 0, qid 0 00:21:47.844 [2024-10-07 11:32:43.325201] nvme_tcp.c:1198:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:21:47.844 [2024-10-07 11:32:43.325209] nvme_tcp.c:1986:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:21:47.844 [2024-10-07 11:32:43.325212] nvme_tcp.c:1659:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:21:47.844 [2024-10-07 11:32:43.325217] nvme_tcp.c:1079:nvme_tcp_req_complete: *DEBUG*: complete tcp_req(0x1101000) on tqpair=0x10da8f0 00:21:47.844 [2024-10-07 11:32:43.325222] nvme_ctrlr.c:1557:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to disable and wait for CSTS.RDY = 0 (timeout 15000 ms) 00:21:47.844 [2024-10-07 11:32:43.325233] nvme_tcp.c: 800:nvme_tcp_build_contig_request: *DEBUG*: enter 00:21:47.844 [2024-10-07 11:32:43.325238] nvme_tcp.c: 977:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:21:47.844 [2024-10-07 11:32:43.325242] nvme_tcp.c: 986:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x10da8f0) 00:21:47.844 [2024-10-07 11:32:43.325249] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:47.844 [2024-10-07 11:32:43.325267] nvme_tcp.c: 951:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1101000, cid 0, qid 0 00:21:47.844 [2024-10-07 11:32:43.325354] nvme_tcp.c:1198:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:21:47.844 [2024-10-07 11:32:43.325361] nvme_tcp.c:1986:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:21:47.844 [2024-10-07 11:32:43.325365] nvme_tcp.c:1659:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:21:47.844 [2024-10-07 11:32:43.325369] nvme_tcp.c:1079:nvme_tcp_req_complete: *DEBUG*: complete tcp_req(0x1101000) on tqpair=0x10da8f0 00:21:47.844 [2024-10-07 11:32:43.325374] nvme_ctrlr.c:3893:nvme_ctrlr_process_init_wait_for_ready_0: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] CC.EN = 0 && CSTS.RDY = 0 00:21:47.844 [2024-10-07 11:32:43.325379] nvme_ctrlr.c:1557:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to controller is disabled (timeout 15000 ms) 00:21:47.844 [2024-10-07 11:32:43.325387] nvme_ctrlr.c:1557:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to enable controller by writing CC.EN = 1 (timeout 15000 ms) 00:21:47.844 [2024-10-07 11:32:43.325493] nvme_ctrlr.c:4091:nvme_ctrlr_process_init: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] Setting CC.EN = 1 00:21:47.844 [2024-10-07 11:32:43.325498] nvme_ctrlr.c:1557:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to enable controller by writing CC.EN = 1 reg (timeout 15000 ms) 00:21:47.844 [2024-10-07 11:32:43.325508] nvme_tcp.c: 800:nvme_tcp_build_contig_request: *DEBUG*: enter 00:21:47.844 [2024-10-07 11:32:43.325513] nvme_tcp.c: 977:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:21:47.844 [2024-10-07 11:32:43.325517] nvme_tcp.c: 986:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x10da8f0) 00:21:47.844 [2024-10-07 11:32:43.325524] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY SET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:47.844 [2024-10-07 11:32:43.325555] nvme_tcp.c: 951:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1101000, cid 0, qid 0 00:21:47.844 [2024-10-07 11:32:43.325609] nvme_tcp.c:1198:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:21:47.844 [2024-10-07 11:32:43.325616] nvme_tcp.c:1986:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:21:47.844 [2024-10-07 11:32:43.325620] nvme_tcp.c:1659:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:21:47.844 [2024-10-07 11:32:43.325624] nvme_tcp.c:1079:nvme_tcp_req_complete: *DEBUG*: complete tcp_req(0x1101000) on tqpair=0x10da8f0 00:21:47.844 [2024-10-07 11:32:43.325630] nvme_ctrlr.c:1557:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to wait for CSTS.RDY = 1 (timeout 15000 ms) 00:21:47.844 [2024-10-07 11:32:43.325640] nvme_tcp.c: 800:nvme_tcp_build_contig_request: *DEBUG*: enter 00:21:47.844 [2024-10-07 11:32:43.325645] nvme_tcp.c: 977:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:21:47.844 [2024-10-07 11:32:43.325672] nvme_tcp.c: 986:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x10da8f0) 00:21:47.844 [2024-10-07 11:32:43.325681] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:47.844 [2024-10-07 11:32:43.325702] nvme_tcp.c: 951:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1101000, cid 0, qid 0 00:21:47.844 [2024-10-07 11:32:43.325771] nvme_tcp.c:1198:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:21:47.844 [2024-10-07 11:32:43.325778] nvme_tcp.c:1986:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:21:47.844 [2024-10-07 11:32:43.325782] nvme_tcp.c:1659:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:21:47.844 [2024-10-07 11:32:43.325786] nvme_tcp.c:1079:nvme_tcp_req_complete: *DEBUG*: complete tcp_req(0x1101000) on tqpair=0x10da8f0 00:21:47.844 [2024-10-07 11:32:43.325791] nvme_ctrlr.c:3928:nvme_ctrlr_process_init_enable_wait_for_ready_1: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] CC.EN = 1 && CSTS.RDY = 1 - controller is ready 00:21:47.844 [2024-10-07 11:32:43.325797] nvme_ctrlr.c:1557:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to reset admin queue (timeout 30000 ms) 00:21:47.844 [2024-10-07 11:32:43.325805] nvme_ctrlr.c:1563:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to identify controller (no timeout) 00:21:47.844 [2024-10-07 11:32:43.325823] nvme_ctrlr.c:1557:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to wait for identify controller (timeout 30000 ms) 00:21:47.844 [2024-10-07 11:32:43.325835] nvme_tcp.c: 977:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:21:47.844 [2024-10-07 11:32:43.325839] nvme_tcp.c: 986:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x10da8f0) 00:21:47.844 [2024-10-07 11:32:43.325859] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: IDENTIFY (06) qid:0 cid:0 nsid:0 cdw10:00000001 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:47.844 [2024-10-07 11:32:43.325890] nvme_tcp.c: 951:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1101000, cid 0, qid 0 00:21:47.844 [2024-10-07 11:32:43.326006] nvme_tcp.c:1198:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:21:47.844 [2024-10-07 11:32:43.326013] nvme_tcp.c:1986:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:21:47.844 [2024-10-07 11:32:43.326017] nvme_tcp.c:1730:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:21:47.844 [2024-10-07 11:32:43.326022] nvme_tcp.c:1731:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0x10da8f0): datao=0, datal=4096, cccid=0 00:21:47.844 [2024-10-07 11:32:43.326027] nvme_tcp.c:1742:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0x1101000) on tqpair(0x10da8f0): expected_datao=0, payload_size=4096 00:21:47.844 [2024-10-07 11:32:43.326032] nvme_tcp.c: 800:nvme_tcp_build_contig_request: *DEBUG*: enter 00:21:47.844 [2024-10-07 11:32:43.326041] nvme_tcp.c:1532:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:21:47.844 [2024-10-07 11:32:43.326046] nvme_tcp.c:1323:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:21:47.844 [2024-10-07 11:32:43.326055] nvme_tcp.c:1198:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:21:47.844 [2024-10-07 11:32:43.326061] nvme_tcp.c:1986:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:21:47.844 [2024-10-07 11:32:43.326065] nvme_tcp.c:1659:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:21:47.844 [2024-10-07 11:32:43.326069] nvme_tcp.c:1079:nvme_tcp_req_complete: *DEBUG*: complete tcp_req(0x1101000) on tqpair=0x10da8f0 00:21:47.844 [2024-10-07 11:32:43.326078] nvme_ctrlr.c:2077:nvme_ctrlr_identify_done: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] transport max_xfer_size 4294967295 00:21:47.844 [2024-10-07 11:32:43.326084] nvme_ctrlr.c:2081:nvme_ctrlr_identify_done: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] MDTS max_xfer_size 131072 00:21:47.844 [2024-10-07 11:32:43.326088] nvme_ctrlr.c:2084:nvme_ctrlr_identify_done: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] CNTLID 0x0001 00:21:47.844 [2024-10-07 11:32:43.326093] nvme_ctrlr.c:2108:nvme_ctrlr_identify_done: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] transport max_sges 16 00:21:47.845 [2024-10-07 11:32:43.326098] nvme_ctrlr.c:2123:nvme_ctrlr_identify_done: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] fuses compare and write: 1 00:21:47.845 [2024-10-07 11:32:43.326103] nvme_ctrlr.c:1557:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to configure AER (timeout 30000 ms) 00:21:47.845 [2024-10-07 11:32:43.326116] nvme_ctrlr.c:1557:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to wait for configure aer (timeout 30000 ms) 00:21:47.845 [2024-10-07 11:32:43.326129] nvme_tcp.c: 800:nvme_tcp_build_contig_request: *DEBUG*: enter 00:21:47.845 [2024-10-07 11:32:43.326135] nvme_tcp.c: 977:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:21:47.845 [2024-10-07 11:32:43.326139] nvme_tcp.c: 986:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x10da8f0) 00:21:47.845 [2024-10-07 11:32:43.326147] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: SET FEATURES ASYNC EVENT CONFIGURATION cid:0 cdw10:0000000b SGL DATA BLOCK OFFSET 0x0 len:0x0 00:21:47.845 [2024-10-07 11:32:43.326168] nvme_tcp.c: 951:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1101000, cid 0, qid 0 00:21:47.845 [2024-10-07 11:32:43.326227] nvme_tcp.c:1198:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:21:47.845 [2024-10-07 11:32:43.326234] nvme_tcp.c:1986:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:21:47.845 [2024-10-07 11:32:43.326238] nvme_tcp.c:1659:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:21:47.845 [2024-10-07 11:32:43.326242] nvme_tcp.c:1079:nvme_tcp_req_complete: *DEBUG*: complete tcp_req(0x1101000) on tqpair=0x10da8f0 00:21:47.845 [2024-10-07 11:32:43.326251] nvme_tcp.c: 800:nvme_tcp_build_contig_request: *DEBUG*: enter 00:21:47.845 [2024-10-07 11:32:43.326255] nvme_tcp.c: 977:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:21:47.845 [2024-10-07 11:32:43.326259] nvme_tcp.c: 986:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x10da8f0) 00:21:47.845 [2024-10-07 11:32:43.326266] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:21:47.845 [2024-10-07 11:32:43.326273] nvme_tcp.c: 800:nvme_tcp_build_contig_request: *DEBUG*: enter 00:21:47.845 [2024-10-07 11:32:43.326277] nvme_tcp.c: 977:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:21:47.845 [2024-10-07 11:32:43.326281] nvme_tcp.c: 986:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=1 on tqpair(0x10da8f0) 00:21:47.845 [2024-10-07 11:32:43.326287] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:21:47.845 [2024-10-07 11:32:43.326294] nvme_tcp.c: 800:nvme_tcp_build_contig_request: *DEBUG*: enter 00:21:47.845 [2024-10-07 11:32:43.326298] nvme_tcp.c: 977:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:21:47.845 [2024-10-07 11:32:43.326302] nvme_tcp.c: 986:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=2 on tqpair(0x10da8f0) 00:21:47.845 [2024-10-07 11:32:43.326308] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:21:47.845 [2024-10-07 11:32:43.326314] nvme_tcp.c: 800:nvme_tcp_build_contig_request: *DEBUG*: enter 00:21:47.845 [2024-10-07 11:32:43.326319] nvme_tcp.c: 977:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:21:47.845 [2024-10-07 11:32:43.326322] nvme_tcp.c: 986:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x10da8f0) 00:21:47.845 [2024-10-07 11:32:43.326328] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:21:47.845 [2024-10-07 11:32:43.326334] nvme_ctrlr.c:1557:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to set keep alive timeout (timeout 30000 ms) 00:21:47.845 [2024-10-07 11:32:43.326347] nvme_ctrlr.c:1557:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to wait for set keep alive timeout (timeout 30000 ms) 00:21:47.845 [2024-10-07 11:32:43.326355] nvme_tcp.c: 977:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:21:47.845 [2024-10-07 11:32:43.326359] nvme_tcp.c: 986:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0x10da8f0) 00:21:47.845 [2024-10-07 11:32:43.326367] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES KEEP ALIVE TIMER cid:4 cdw10:0000000f SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:47.845 [2024-10-07 11:32:43.326388] nvme_tcp.c: 951:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1101000, cid 0, qid 0 00:21:47.845 [2024-10-07 11:32:43.326403] nvme_tcp.c: 951:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1101180, cid 1, qid 0 00:21:47.845 [2024-10-07 11:32:43.326409] nvme_tcp.c: 951:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1101300, cid 2, qid 0 00:21:47.845 [2024-10-07 11:32:43.326414] nvme_tcp.c: 951:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1101480, cid 3, qid 0 00:21:47.845 [2024-10-07 11:32:43.326419] nvme_tcp.c: 951:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1101600, cid 4, qid 0 00:21:47.845 [2024-10-07 11:32:43.326511] nvme_tcp.c:1198:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:21:47.845 [2024-10-07 11:32:43.326518] nvme_tcp.c:1986:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:21:47.845 [2024-10-07 11:32:43.326522] nvme_tcp.c:1659:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:21:47.845 [2024-10-07 11:32:43.326526] nvme_tcp.c:1079:nvme_tcp_req_complete: *DEBUG*: complete tcp_req(0x1101600) on tqpair=0x10da8f0 00:21:47.845 [2024-10-07 11:32:43.326532] nvme_ctrlr.c:3046:nvme_ctrlr_set_keep_alive_timeout_done: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] Sending keep alive every 5000000 us 00:21:47.845 [2024-10-07 11:32:43.326537] nvme_ctrlr.c:1557:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to identify controller iocs specific (timeout 30000 ms) 00:21:47.845 [2024-10-07 11:32:43.326551] nvme_ctrlr.c:1557:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to set number of queues (timeout 30000 ms) 00:21:47.845 [2024-10-07 11:32:43.326558] nvme_ctrlr.c:1557:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to wait for set number of queues (timeout 30000 ms) 00:21:47.845 [2024-10-07 11:32:43.326566] nvme_tcp.c: 800:nvme_tcp_build_contig_request: *DEBUG*: enter 00:21:47.845 [2024-10-07 11:32:43.326570] nvme_tcp.c: 977:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:21:47.845 [2024-10-07 11:32:43.326574] nvme_tcp.c: 986:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0x10da8f0) 00:21:47.845 [2024-10-07 11:32:43.326582] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: SET FEATURES NUMBER OF QUEUES cid:4 cdw10:00000007 SGL DATA BLOCK OFFSET 0x0 len:0x0 00:21:47.845 [2024-10-07 11:32:43.326601] nvme_tcp.c: 951:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1101600, cid 4, qid 0 00:21:47.845 [2024-10-07 11:32:43.326678] nvme_tcp.c:1198:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:21:47.845 [2024-10-07 11:32:43.326687] nvme_tcp.c:1986:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:21:47.845 [2024-10-07 11:32:43.326691] nvme_tcp.c:1659:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:21:47.845 [2024-10-07 11:32:43.326695] nvme_tcp.c:1079:nvme_tcp_req_complete: *DEBUG*: complete tcp_req(0x1101600) on tqpair=0x10da8f0 00:21:47.845 [2024-10-07 11:32:43.326762] nvme_ctrlr.c:1557:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to identify active ns (timeout 30000 ms) 00:21:47.845 [2024-10-07 11:32:43.326774] nvme_ctrlr.c:1557:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to wait for identify active ns (timeout 30000 ms) 00:21:47.845 [2024-10-07 11:32:43.326783] nvme_tcp.c: 977:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:21:47.845 [2024-10-07 11:32:43.326787] nvme_tcp.c: 986:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0x10da8f0) 00:21:47.845 [2024-10-07 11:32:43.326795] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: IDENTIFY (06) qid:0 cid:4 nsid:0 cdw10:00000002 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:47.845 [2024-10-07 11:32:43.326817] nvme_tcp.c: 951:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1101600, cid 4, qid 0 00:21:47.845 [2024-10-07 11:32:43.326886] nvme_tcp.c:1198:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:21:47.845 [2024-10-07 11:32:43.326899] nvme_tcp.c:1986:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:21:47.845 [2024-10-07 11:32:43.326904] nvme_tcp.c:1730:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:21:47.845 [2024-10-07 11:32:43.326908] nvme_tcp.c:1731:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0x10da8f0): datao=0, datal=4096, cccid=4 00:21:47.845 [2024-10-07 11:32:43.326913] nvme_tcp.c:1742:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0x1101600) on tqpair(0x10da8f0): expected_datao=0, payload_size=4096 00:21:47.845 [2024-10-07 11:32:43.326918] nvme_tcp.c: 800:nvme_tcp_build_contig_request: *DEBUG*: enter 00:21:47.845 [2024-10-07 11:32:43.326926] nvme_tcp.c:1532:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:21:47.845 [2024-10-07 11:32:43.326930] nvme_tcp.c:1323:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:21:47.845 [2024-10-07 11:32:43.326939] nvme_tcp.c:1198:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:21:47.845 [2024-10-07 11:32:43.326945] nvme_tcp.c:1986:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:21:47.845 [2024-10-07 11:32:43.326949] nvme_tcp.c:1659:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:21:47.845 [2024-10-07 11:32:43.326953] nvme_tcp.c:1079:nvme_tcp_req_complete: *DEBUG*: complete tcp_req(0x1101600) on tqpair=0x10da8f0 00:21:47.845 [2024-10-07 11:32:43.326983] nvme_ctrlr.c:4722:spdk_nvme_ctrlr_get_ns: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] Namespace 1 was added 00:21:47.845 [2024-10-07 11:32:43.326994] nvme_ctrlr.c:1557:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to identify ns (timeout 30000 ms) 00:21:47.845 [2024-10-07 11:32:43.327005] nvme_ctrlr.c:1557:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to wait for identify ns (timeout 30000 ms) 00:21:47.845 [2024-10-07 11:32:43.327013] nvme_tcp.c: 977:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:21:47.845 [2024-10-07 11:32:43.327018] nvme_tcp.c: 986:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0x10da8f0) 00:21:47.845 [2024-10-07 11:32:43.327026] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: IDENTIFY (06) qid:0 cid:4 nsid:1 cdw10:00000000 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:47.845 [2024-10-07 11:32:43.327058] nvme_tcp.c: 951:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1101600, cid 4, qid 0 00:21:47.845 [2024-10-07 11:32:43.327260] nvme_tcp.c:1198:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:21:47.845 [2024-10-07 11:32:43.327269] nvme_tcp.c:1986:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:21:47.845 [2024-10-07 11:32:43.327282] nvme_tcp.c:1730:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:21:47.845 [2024-10-07 11:32:43.327286] nvme_tcp.c:1731:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0x10da8f0): datao=0, datal=4096, cccid=4 00:21:47.845 [2024-10-07 11:32:43.327291] nvme_tcp.c:1742:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0x1101600) on tqpair(0x10da8f0): expected_datao=0, payload_size=4096 00:21:47.845 [2024-10-07 11:32:43.327296] nvme_tcp.c: 800:nvme_tcp_build_contig_request: *DEBUG*: enter 00:21:47.845 [2024-10-07 11:32:43.327303] nvme_tcp.c:1532:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:21:47.845 [2024-10-07 11:32:43.327307] nvme_tcp.c:1323:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:21:47.845 [2024-10-07 11:32:43.327317] nvme_tcp.c:1198:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:21:47.845 [2024-10-07 11:32:43.327326] nvme_tcp.c:1986:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:21:47.845 [2024-10-07 11:32:43.327333] nvme_tcp.c:1659:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:21:47.845 [2024-10-07 11:32:43.327339] nvme_tcp.c:1079:nvme_tcp_req_complete: *DEBUG*: complete tcp_req(0x1101600) on tqpair=0x10da8f0 00:21:47.845 [2024-10-07 11:32:43.327357] nvme_ctrlr.c:1557:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to identify namespace id descriptors (timeout 30000 ms) 00:21:47.845 [2024-10-07 11:32:43.327374] nvme_ctrlr.c:1557:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to wait for identify namespace id descriptors (timeout 30000 ms) 00:21:47.845 [2024-10-07 11:32:43.327384] nvme_tcp.c: 977:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:21:47.845 [2024-10-07 11:32:43.327389] nvme_tcp.c: 986:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0x10da8f0) 00:21:47.845 [2024-10-07 11:32:43.327397] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: IDENTIFY (06) qid:0 cid:4 nsid:1 cdw10:00000003 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:47.845 [2024-10-07 11:32:43.327420] nvme_tcp.c: 951:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1101600, cid 4, qid 0 00:21:47.845 [2024-10-07 11:32:43.327488] nvme_tcp.c:1198:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:21:47.845 [2024-10-07 11:32:43.327495] nvme_tcp.c:1986:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:21:47.845 [2024-10-07 11:32:43.327499] nvme_tcp.c:1730:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:21:47.845 [2024-10-07 11:32:43.327503] nvme_tcp.c:1731:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0x10da8f0): datao=0, datal=4096, cccid=4 00:21:47.846 [2024-10-07 11:32:43.327508] nvme_tcp.c:1742:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0x1101600) on tqpair(0x10da8f0): expected_datao=0, payload_size=4096 00:21:47.846 [2024-10-07 11:32:43.327513] nvme_tcp.c: 800:nvme_tcp_build_contig_request: *DEBUG*: enter 00:21:47.846 [2024-10-07 11:32:43.327520] nvme_tcp.c:1532:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:21:47.846 [2024-10-07 11:32:43.327524] nvme_tcp.c:1323:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:21:47.846 [2024-10-07 11:32:43.327538] nvme_tcp.c:1198:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:21:47.846 [2024-10-07 11:32:43.327544] nvme_tcp.c:1986:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:21:47.846 [2024-10-07 11:32:43.327548] nvme_tcp.c:1659:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:21:47.846 [2024-10-07 11:32:43.327552] nvme_tcp.c:1079:nvme_tcp_req_complete: *DEBUG*: complete tcp_req(0x1101600) on tqpair=0x10da8f0 00:21:47.846 [2024-10-07 11:32:43.327567] nvme_ctrlr.c:1557:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to identify ns iocs specific (timeout 30000 ms) 00:21:47.846 [2024-10-07 11:32:43.327576] nvme_ctrlr.c:1557:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to set supported log pages (timeout 30000 ms) 00:21:47.846 [2024-10-07 11:32:43.327596] nvme_ctrlr.c:1557:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to set supported features (timeout 30000 ms) 00:21:47.846 [2024-10-07 11:32:43.327604] nvme_ctrlr.c:1557:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to set host behavior support feature (timeout 30000 ms) 00:21:47.846 [2024-10-07 11:32:43.327609] nvme_ctrlr.c:1557:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to set doorbell buffer config (timeout 30000 ms) 00:21:47.846 [2024-10-07 11:32:43.327615] nvme_ctrlr.c:1557:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to set host ID (timeout 30000 ms) 00:21:47.846 [2024-10-07 11:32:43.327620] nvme_ctrlr.c:3134:nvme_ctrlr_set_host_id: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] NVMe-oF transport - not sending Set Features - Host ID 00:21:47.846 [2024-10-07 11:32:43.327625] nvme_ctrlr.c:1557:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to transport ready (timeout 30000 ms) 00:21:47.846 [2024-10-07 11:32:43.327630] nvme_ctrlr.c:1563:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to ready (no timeout) 00:21:47.846 [2024-10-07 11:32:43.327682] nvme_tcp.c: 977:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:21:47.846 [2024-10-07 11:32:43.327689] nvme_tcp.c: 986:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0x10da8f0) 00:21:47.846 [2024-10-07 11:32:43.327697] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES ARBITRATION cid:4 cdw10:00000001 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:47.846 [2024-10-07 11:32:43.327705] nvme_tcp.c: 800:nvme_tcp_build_contig_request: *DEBUG*: enter 00:21:47.846 [2024-10-07 11:32:43.327709] nvme_tcp.c: 977:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:21:47.846 [2024-10-07 11:32:43.327713] nvme_tcp.c: 986:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=5 on tqpair(0x10da8f0) 00:21:47.846 [2024-10-07 11:32:43.327731] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: KEEP ALIVE (18) qid:0 cid:5 nsid:0 cdw10:00000000 cdw11:00000000 00:21:47.846 [2024-10-07 11:32:43.327760] nvme_tcp.c: 951:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1101600, cid 4, qid 0 00:21:47.846 [2024-10-07 11:32:43.327768] nvme_tcp.c: 951:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1101780, cid 5, qid 0 00:21:47.846 [2024-10-07 11:32:43.327849] nvme_tcp.c:1198:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:21:47.846 [2024-10-07 11:32:43.327856] nvme_tcp.c:1986:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:21:47.846 [2024-10-07 11:32:43.327860] nvme_tcp.c:1659:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:21:47.846 [2024-10-07 11:32:43.327864] nvme_tcp.c:1079:nvme_tcp_req_complete: *DEBUG*: complete tcp_req(0x1101600) on tqpair=0x10da8f0 00:21:47.846 [2024-10-07 11:32:43.327871] nvme_tcp.c:1198:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:21:47.846 [2024-10-07 11:32:43.327877] nvme_tcp.c:1986:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:21:47.846 [2024-10-07 11:32:43.327881] nvme_tcp.c:1659:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:21:47.846 [2024-10-07 11:32:43.327885] nvme_tcp.c:1079:nvme_tcp_req_complete: *DEBUG*: complete tcp_req(0x1101780) on tqpair=0x10da8f0 00:21:47.846 [2024-10-07 11:32:43.327896] nvme_tcp.c: 977:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:21:47.846 [2024-10-07 11:32:43.327900] nvme_tcp.c: 986:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=5 on tqpair(0x10da8f0) 00:21:47.846 [2024-10-07 11:32:43.327908] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES POWER MANAGEMENT cid:5 cdw10:00000002 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:47.846 [2024-10-07 11:32:43.327927] nvme_tcp.c: 951:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1101780, cid 5, qid 0 00:21:47.846 [2024-10-07 11:32:43.327997] nvme_tcp.c:1198:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:21:47.846 [2024-10-07 11:32:43.328015] nvme_tcp.c:1986:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:21:47.846 [2024-10-07 11:32:43.328019] nvme_tcp.c:1659:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:21:47.846 [2024-10-07 11:32:43.328023] nvme_tcp.c:1079:nvme_tcp_req_complete: *DEBUG*: complete tcp_req(0x1101780) on tqpair=0x10da8f0 00:21:47.846 [2024-10-07 11:32:43.328045] nvme_tcp.c: 977:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:21:47.846 [2024-10-07 11:32:43.328049] nvme_tcp.c: 986:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=5 on tqpair(0x10da8f0) 00:21:47.846 [2024-10-07 11:32:43.328067] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES TEMPERATURE THRESHOLD cid:5 cdw10:00000004 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:47.846 [2024-10-07 11:32:43.328085] nvme_tcp.c: 951:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1101780, cid 5, qid 0 00:21:47.846 [2024-10-07 11:32:43.328180] nvme_tcp.c:1198:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:21:47.846 [2024-10-07 11:32:43.328197] nvme_tcp.c:1986:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:21:47.846 [2024-10-07 11:32:43.328201] nvme_tcp.c:1659:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:21:47.846 [2024-10-07 11:32:43.328205] nvme_tcp.c:1079:nvme_tcp_req_complete: *DEBUG*: complete tcp_req(0x1101780) on tqpair=0x10da8f0 00:21:47.846 [2024-10-07 11:32:43.328216] nvme_tcp.c: 977:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:21:47.846 [2024-10-07 11:32:43.328221] nvme_tcp.c: 986:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=5 on tqpair(0x10da8f0) 00:21:47.846 [2024-10-07 11:32:43.328229] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES NUMBER OF QUEUES cid:5 cdw10:00000007 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:47.846 [2024-10-07 11:32:43.328251] nvme_tcp.c: 951:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1101780, cid 5, qid 0 00:21:47.846 [2024-10-07 11:32:43.328313] nvme_tcp.c:1198:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:21:47.846 [2024-10-07 11:32:43.328320] nvme_tcp.c:1986:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:21:47.846 [2024-10-07 11:32:43.328324] nvme_tcp.c:1659:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:21:47.846 [2024-10-07 11:32:43.328328] nvme_tcp.c:1079:nvme_tcp_req_complete: *DEBUG*: complete tcp_req(0x1101780) on tqpair=0x10da8f0 00:21:47.846 [2024-10-07 11:32:43.328350] nvme_tcp.c: 977:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:21:47.846 [2024-10-07 11:32:43.328356] nvme_tcp.c: 986:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=5 on tqpair(0x10da8f0) 00:21:47.846 [2024-10-07 11:32:43.328364] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: GET LOG PAGE (02) qid:0 cid:5 nsid:ffffffff cdw10:07ff0001 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:47.846 [2024-10-07 11:32:43.328372] nvme_tcp.c: 977:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:21:47.846 [2024-10-07 11:32:43.328376] nvme_tcp.c: 986:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0x10da8f0) 00:21:47.846 [2024-10-07 11:32:43.328383] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: GET LOG PAGE (02) qid:0 cid:4 nsid:ffffffff cdw10:007f0002 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:47.846 [2024-10-07 11:32:43.328391] nvme_tcp.c: 977:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:21:47.846 [2024-10-07 11:32:43.328395] nvme_tcp.c: 986:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=6 on tqpair(0x10da8f0) 00:21:47.846 [2024-10-07 11:32:43.328402] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: GET LOG PAGE (02) qid:0 cid:6 nsid:ffffffff cdw10:007f0003 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:47.846 [2024-10-07 11:32:43.328410] nvme_tcp.c: 977:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:21:47.846 [2024-10-07 11:32:43.328415] nvme_tcp.c: 986:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=7 on tqpair(0x10da8f0) 00:21:47.846 [2024-10-07 11:32:43.328421] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: GET LOG PAGE (02) qid:0 cid:7 nsid:ffffffff cdw10:03ff0005 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:47.846 [2024-10-07 11:32:43.328453] nvme_tcp.c: 951:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1101780, cid 5, qid 0 00:21:47.846 [2024-10-07 11:32:43.328460] nvme_tcp.c: 951:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1101600, cid 4, qid 0 00:21:47.846 [2024-10-07 11:32:43.328466] nvme_tcp.c: 951:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1101900, cid 6, qid 0 00:21:47.846 [2024-10-07 11:32:43.328471] nvme_tcp.c: 951:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1101a80, cid 7, qid 0 00:21:47.846 [2024-10-07 11:32:43.328633] nvme_tcp.c:1198:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:21:47.846 [2024-10-07 11:32:43.328646] nvme_tcp.c:1986:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:21:47.846 [2024-10-07 11:32:43.332672] nvme_tcp.c:1730:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:21:47.846 [2024-10-07 11:32:43.332680] nvme_tcp.c:1731:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0x10da8f0): datao=0, datal=8192, cccid=5 00:21:47.846 [2024-10-07 11:32:43.332685] nvme_tcp.c:1742:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0x1101780) on tqpair(0x10da8f0): expected_datao=0, payload_size=8192 00:21:47.846 [2024-10-07 11:32:43.332690] nvme_tcp.c: 800:nvme_tcp_build_contig_request: *DEBUG*: enter 00:21:47.846 [2024-10-07 11:32:43.332715] nvme_tcp.c:1532:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:21:47.846 [2024-10-07 11:32:43.332721] nvme_tcp.c:1323:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:21:47.846 [2024-10-07 11:32:43.332727] nvme_tcp.c:1198:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:21:47.846 [2024-10-07 11:32:43.332734] nvme_tcp.c:1986:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:21:47.846 [2024-10-07 11:32:43.332743] nvme_tcp.c:1730:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:21:47.846 [2024-10-07 11:32:43.332747] nvme_tcp.c:1731:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0x10da8f0): datao=0, datal=512, cccid=4 00:21:47.846 [2024-10-07 11:32:43.332752] nvme_tcp.c:1742:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0x1101600) on tqpair(0x10da8f0): expected_datao=0, payload_size=512 00:21:47.846 [2024-10-07 11:32:43.332757] nvme_tcp.c: 800:nvme_tcp_build_contig_request: *DEBUG*: enter 00:21:47.846 [2024-10-07 11:32:43.332764] nvme_tcp.c:1532:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:21:47.846 [2024-10-07 11:32:43.332768] nvme_tcp.c:1323:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:21:47.846 [2024-10-07 11:32:43.332773] nvme_tcp.c:1198:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:21:47.846 [2024-10-07 11:32:43.332779] nvme_tcp.c:1986:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:21:47.846 [2024-10-07 11:32:43.332783] nvme_tcp.c:1730:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:21:47.846 [2024-10-07 11:32:43.332787] nvme_tcp.c:1731:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0x10da8f0): datao=0, datal=512, cccid=6 00:21:47.846 [2024-10-07 11:32:43.332791] nvme_tcp.c:1742:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0x1101900) on tqpair(0x10da8f0): expected_datao=0, payload_size=512 00:21:47.846 [2024-10-07 11:32:43.332796] nvme_tcp.c: 800:nvme_tcp_build_contig_request: *DEBUG*: enter 00:21:47.846 [2024-10-07 11:32:43.332802] nvme_tcp.c:1532:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:21:47.846 [2024-10-07 11:32:43.332806] nvme_tcp.c:1323:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:21:47.846 [2024-10-07 11:32:43.332812] nvme_tcp.c:1198:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:21:47.846 [2024-10-07 11:32:43.332818] nvme_tcp.c:1986:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:21:47.846 [2024-10-07 11:32:43.332821] nvme_tcp.c:1730:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:21:47.846 [2024-10-07 11:32:43.332825] nvme_tcp.c:1731:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0x10da8f0): datao=0, datal=4096, cccid=7 00:21:47.846 ===================================================== 00:21:47.846 NVMe over Fabrics controller at 10.0.0.3:4420: nqn.2016-06.io.spdk:cnode1 00:21:47.846 ===================================================== 00:21:47.846 Controller Capabilities/Features 00:21:47.846 ================================ 00:21:47.846 Vendor ID: 8086 00:21:47.846 Subsystem Vendor ID: 8086 00:21:47.846 Serial Number: SPDK00000000000001 00:21:47.846 Model Number: SPDK bdev Controller 00:21:47.846 Firmware Version: 25.01 00:21:47.847 Recommended Arb Burst: 6 00:21:47.847 IEEE OUI Identifier: e4 d2 5c 00:21:47.847 Multi-path I/O 00:21:47.847 May have multiple subsystem ports: Yes 00:21:47.847 May have multiple controllers: Yes 00:21:47.847 Associated with SR-IOV VF: No 00:21:47.847 Max Data Transfer Size: 131072 00:21:47.847 Max Number of Namespaces: 32 00:21:47.847 Max Number of I/O Queues: 127 00:21:47.847 NVMe Specification Version (VS): 1.3 00:21:47.847 NVMe Specification Version (Identify): 1.3 00:21:47.847 Maximum Queue Entries: 128 00:21:47.847 Contiguous Queues Required: Yes 00:21:47.847 Arbitration Mechanisms Supported 00:21:47.847 Weighted Round Robin: Not Supported 00:21:47.847 Vendor Specific: Not Supported 00:21:47.847 Reset Timeout: 15000 ms 00:21:47.847 Doorbell Stride: 4 bytes 00:21:47.847 NVM Subsystem Reset: Not Supported 00:21:47.847 Command Sets Supported 00:21:47.847 NVM Command Set: Supported 00:21:47.847 Boot Partition: Not Supported 00:21:47.847 Memory Page Size Minimum: 4096 bytes 00:21:47.847 Memory Page Size Maximum: 4096 bytes 00:21:47.847 Persistent Memory Region: Not Supported 00:21:47.847 Optional Asynchronous Events Supported 00:21:47.847 Namespace Attribute Notices: Supported 00:21:47.847 Firmware Activation Notices: Not Supported 00:21:47.847 ANA Change Notices: Not Supported 00:21:47.847 PLE Aggregate Log Change Notices: Not Supported 00:21:47.847 LBA Status Info Alert Notices: Not Supported 00:21:47.847 EGE Aggregate Log Change Notices: Not Supported 00:21:47.847 Normal NVM Subsystem Shutdown event: Not Supported 00:21:47.847 Zone Descriptor Change Notices: Not Supported 00:21:47.847 Discovery Log Change Notices: Not Supported 00:21:47.847 Controller Attributes 00:21:47.847 128-bit Host Identifier: Supported 00:21:47.847 Non-Operational Permissive Mode: Not Supported 00:21:47.847 NVM Sets: Not Supported 00:21:47.847 Read Recovery Levels: Not Supported 00:21:47.847 Endurance Groups: Not Supported 00:21:47.847 Predictable Latency Mode: Not Supported 00:21:47.847 Traffic Based Keep ALive: Not Supported 00:21:47.847 Namespace Granularity: Not Supported 00:21:47.847 SQ Associations: Not Supported 00:21:47.847 UUID List: Not Supported 00:21:47.847 Multi-Domain Subsystem: Not Supported 00:21:47.847 Fixed Capacity Management: Not Supported 00:21:47.847 Variable Capacity Management: Not Supported 00:21:47.847 Delete Endurance Group: Not Supported 00:21:47.847 Delete NVM Set: Not Supported 00:21:47.847 Extended LBA Formats Supported: Not Supported 00:21:47.847 Flexible Data Placement Supported: Not Supported 00:21:47.847 00:21:47.847 Controller Memory Buffer Support 00:21:47.847 ================================ 00:21:47.847 Supported: No 00:21:47.847 00:21:47.847 Persistent Memory Region Support 00:21:47.847 ================================ 00:21:47.847 Supported: No 00:21:47.847 00:21:47.847 Admin Command Set Attributes 00:21:47.847 ============================ 00:21:47.847 Security Send/Receive: Not Supported 00:21:47.847 Format NVM: Not Supported 00:21:47.847 Firmware Activate/Download: Not Supported 00:21:47.847 Namespace Management: Not Supported 00:21:47.847 Device Self-Test: Not Supported 00:21:47.847 Directives: Not Supported 00:21:47.847 NVMe-MI: Not Supported 00:21:47.847 Virtualization Management: Not Supported 00:21:47.847 Doorbell Buffer Config: Not Supported 00:21:47.847 Get LBA Status Capability: Not Supported 00:21:47.847 Command & Feature Lockdown Capability: Not Supported 00:21:47.847 Abort Command Limit: 4 00:21:47.847 Async Event Request Limit: 4 00:21:47.847 Number of Firmware Slots: N/A 00:21:47.847 Firmware Slot 1 Read-Only: N/A 00:21:47.847 Firmware Activation Without Reset: [2024-10-07 11:32:43.332830] nvme_tcp.c:1742:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0x1101a80) on tqpair(0x10da8f0): expected_datao=0, payload_size=4096 00:21:47.847 [2024-10-07 11:32:43.332834] nvme_tcp.c: 800:nvme_tcp_build_contig_request: *DEBUG*: enter 00:21:47.847 [2024-10-07 11:32:43.332841] nvme_tcp.c:1532:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:21:47.847 [2024-10-07 11:32:43.332845] nvme_tcp.c:1323:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:21:47.847 [2024-10-07 11:32:43.332851] nvme_tcp.c:1198:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:21:47.847 [2024-10-07 11:32:43.332857] nvme_tcp.c:1986:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:21:47.847 [2024-10-07 11:32:43.332860] nvme_tcp.c:1659:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:21:47.847 [2024-10-07 11:32:43.332865] nvme_tcp.c:1079:nvme_tcp_req_complete: *DEBUG*: complete tcp_req(0x1101780) on tqpair=0x10da8f0 00:21:47.847 [2024-10-07 11:32:43.332886] nvme_tcp.c:1198:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:21:47.847 [2024-10-07 11:32:43.332898] nvme_tcp.c:1986:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:21:47.847 [2024-10-07 11:32:43.332901] nvme_tcp.c:1659:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:21:47.847 [2024-10-07 11:32:43.332905] nvme_tcp.c:1079:nvme_tcp_req_complete: *DEBUG*: complete tcp_req(0x1101600) on tqpair=0x10da8f0 00:21:47.847 [2024-10-07 11:32:43.332919] nvme_tcp.c:1198:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:21:47.847 [2024-10-07 11:32:43.332925] nvme_tcp.c:1986:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:21:47.847 [2024-10-07 11:32:43.332929] nvme_tcp.c:1659:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:21:47.847 [2024-10-07 11:32:43.332933] nvme_tcp.c:1079:nvme_tcp_req_complete: *DEBUG*: complete tcp_req(0x1101900) on tqpair=0x10da8f0 00:21:47.847 [2024-10-07 11:32:43.332941] nvme_tcp.c:1198:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:21:47.847 [2024-10-07 11:32:43.332946] nvme_tcp.c:1986:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:21:47.847 [2024-10-07 11:32:43.332950] nvme_tcp.c:1659:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:21:47.847 [2024-10-07 11:32:43.332954] nvme_tcp.c:1079:nvme_tcp_req_complete: *DEBUG*: complete tcp_req(0x1101a80) on tqpair=0x10da8f0 00:21:47.847 N/A 00:21:47.847 Multiple Update Detection Support: N/A 00:21:47.847 Firmware Update Granularity: No Information Provided 00:21:47.847 Per-Namespace SMART Log: No 00:21:47.847 Asymmetric Namespace Access Log Page: Not Supported 00:21:47.847 Subsystem NQN: nqn.2016-06.io.spdk:cnode1 00:21:47.847 Command Effects Log Page: Supported 00:21:47.847 Get Log Page Extended Data: Supported 00:21:47.847 Telemetry Log Pages: Not Supported 00:21:47.847 Persistent Event Log Pages: Not Supported 00:21:47.847 Supported Log Pages Log Page: May Support 00:21:47.847 Commands Supported & Effects Log Page: Not Supported 00:21:47.847 Feature Identifiers & Effects Log Page:May Support 00:21:47.847 NVMe-MI Commands & Effects Log Page: May Support 00:21:47.847 Data Area 4 for Telemetry Log: Not Supported 00:21:47.847 Error Log Page Entries Supported: 128 00:21:47.847 Keep Alive: Supported 00:21:47.847 Keep Alive Granularity: 10000 ms 00:21:47.847 00:21:47.847 NVM Command Set Attributes 00:21:47.847 ========================== 00:21:47.847 Submission Queue Entry Size 00:21:47.847 Max: 64 00:21:47.847 Min: 64 00:21:47.847 Completion Queue Entry Size 00:21:47.847 Max: 16 00:21:47.847 Min: 16 00:21:47.847 Number of Namespaces: 32 00:21:47.847 Compare Command: Supported 00:21:47.847 Write Uncorrectable Command: Not Supported 00:21:47.847 Dataset Management Command: Supported 00:21:47.847 Write Zeroes Command: Supported 00:21:47.847 Set Features Save Field: Not Supported 00:21:47.847 Reservations: Supported 00:21:47.847 Timestamp: Not Supported 00:21:47.847 Copy: Supported 00:21:47.847 Volatile Write Cache: Present 00:21:47.847 Atomic Write Unit (Normal): 1 00:21:47.847 Atomic Write Unit (PFail): 1 00:21:47.847 Atomic Compare & Write Unit: 1 00:21:47.847 Fused Compare & Write: Supported 00:21:47.847 Scatter-Gather List 00:21:47.847 SGL Command Set: Supported 00:21:47.847 SGL Keyed: Supported 00:21:47.847 SGL Bit Bucket Descriptor: Not Supported 00:21:47.847 SGL Metadata Pointer: Not Supported 00:21:47.847 Oversized SGL: Not Supported 00:21:47.847 SGL Metadata Address: Not Supported 00:21:47.847 SGL Offset: Supported 00:21:47.847 Transport SGL Data Block: Not Supported 00:21:47.847 Replay Protected Memory Block: Not Supported 00:21:47.847 00:21:47.847 Firmware Slot Information 00:21:47.847 ========================= 00:21:47.847 Active slot: 1 00:21:47.847 Slot 1 Firmware Revision: 25.01 00:21:47.847 00:21:47.847 00:21:47.847 Commands Supported and Effects 00:21:47.847 ============================== 00:21:47.847 Admin Commands 00:21:47.847 -------------- 00:21:47.847 Get Log Page (02h): Supported 00:21:47.847 Identify (06h): Supported 00:21:47.847 Abort (08h): Supported 00:21:47.847 Set Features (09h): Supported 00:21:47.847 Get Features (0Ah): Supported 00:21:47.847 Asynchronous Event Request (0Ch): Supported 00:21:47.847 Keep Alive (18h): Supported 00:21:47.847 I/O Commands 00:21:47.847 ------------ 00:21:47.847 Flush (00h): Supported LBA-Change 00:21:47.847 Write (01h): Supported LBA-Change 00:21:47.847 Read (02h): Supported 00:21:47.847 Compare (05h): Supported 00:21:47.847 Write Zeroes (08h): Supported LBA-Change 00:21:47.847 Dataset Management (09h): Supported LBA-Change 00:21:47.847 Copy (19h): Supported LBA-Change 00:21:47.847 00:21:47.847 Error Log 00:21:47.847 ========= 00:21:47.847 00:21:47.847 Arbitration 00:21:47.847 =========== 00:21:47.847 Arbitration Burst: 1 00:21:47.847 00:21:47.847 Power Management 00:21:47.847 ================ 00:21:47.847 Number of Power States: 1 00:21:47.847 Current Power State: Power State #0 00:21:47.847 Power State #0: 00:21:47.847 Max Power: 0.00 W 00:21:47.847 Non-Operational State: Operational 00:21:47.847 Entry Latency: Not Reported 00:21:47.847 Exit Latency: Not Reported 00:21:47.848 Relative Read Throughput: 0 00:21:47.848 Relative Read Latency: 0 00:21:47.848 Relative Write Throughput: 0 00:21:47.848 Relative Write Latency: 0 00:21:47.848 Idle Power: Not Reported 00:21:47.848 Active Power: Not Reported 00:21:47.848 Non-Operational Permissive Mode: Not Supported 00:21:47.848 00:21:47.848 Health Information 00:21:47.848 ================== 00:21:47.848 Critical Warnings: 00:21:47.848 Available Spare Space: OK 00:21:47.848 Temperature: OK 00:21:47.848 Device Reliability: OK 00:21:47.848 Read Only: No 00:21:47.848 Volatile Memory Backup: OK 00:21:47.848 Current Temperature: 0 Kelvin (-273 Celsius) 00:21:47.848 Temperature Threshold: 0 Kelvin (-273 Celsius) 00:21:47.848 Available Spare: 0% 00:21:47.848 Available Spare Threshold: 0% 00:21:47.848 Life Percentage Used:[2024-10-07 11:32:43.333086] nvme_tcp.c: 977:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:21:47.848 [2024-10-07 11:32:43.333094] nvme_tcp.c: 986:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=7 on tqpair(0x10da8f0) 00:21:47.848 [2024-10-07 11:32:43.333107] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES ERROR_RECOVERY cid:7 cdw10:00000005 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:47.848 [2024-10-07 11:32:43.333140] nvme_tcp.c: 951:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1101a80, cid 7, qid 0 00:21:47.848 [2024-10-07 11:32:43.333221] nvme_tcp.c:1198:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:21:47.848 [2024-10-07 11:32:43.333228] nvme_tcp.c:1986:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:21:47.848 [2024-10-07 11:32:43.333232] nvme_tcp.c:1659:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:21:47.848 [2024-10-07 11:32:43.333236] nvme_tcp.c:1079:nvme_tcp_req_complete: *DEBUG*: complete tcp_req(0x1101a80) on tqpair=0x10da8f0 00:21:47.848 [2024-10-07 11:32:43.333309] nvme_ctrlr.c:4386:nvme_ctrlr_destruct_async: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] Prepare to destruct SSD 00:21:47.848 [2024-10-07 11:32:43.333326] nvme_tcp.c:1079:nvme_tcp_req_complete: *DEBUG*: complete tcp_req(0x1101000) on tqpair=0x10da8f0 00:21:47.848 [2024-10-07 11:32:43.333334] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:47.848 [2024-10-07 11:32:43.333340] nvme_tcp.c:1079:nvme_tcp_req_complete: *DEBUG*: complete tcp_req(0x1101180) on tqpair=0x10da8f0 00:21:47.848 [2024-10-07 11:32:43.333345] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:47.848 [2024-10-07 11:32:43.333350] nvme_tcp.c:1079:nvme_tcp_req_complete: *DEBUG*: complete tcp_req(0x1101300) on tqpair=0x10da8f0 00:21:47.848 [2024-10-07 11:32:43.333355] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:47.848 [2024-10-07 11:32:43.333360] nvme_tcp.c:1079:nvme_tcp_req_complete: *DEBUG*: complete tcp_req(0x1101480) on tqpair=0x10da8f0 00:21:47.848 [2024-10-07 11:32:43.333365] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:47.848 [2024-10-07 11:32:43.333375] nvme_tcp.c: 800:nvme_tcp_build_contig_request: *DEBUG*: enter 00:21:47.848 [2024-10-07 11:32:43.333380] nvme_tcp.c: 977:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:21:47.848 [2024-10-07 11:32:43.333385] nvme_tcp.c: 986:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x10da8f0) 00:21:47.848 [2024-10-07 11:32:43.333394] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:47.848 [2024-10-07 11:32:43.333433] nvme_tcp.c: 951:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1101480, cid 3, qid 0 00:21:47.848 [2024-10-07 11:32:43.333510] nvme_tcp.c:1198:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:21:47.848 [2024-10-07 11:32:43.333517] nvme_tcp.c:1986:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:21:47.848 [2024-10-07 11:32:43.333521] nvme_tcp.c:1659:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:21:47.848 [2024-10-07 11:32:43.333525] nvme_tcp.c:1079:nvme_tcp_req_complete: *DEBUG*: complete tcp_req(0x1101480) on tqpair=0x10da8f0 00:21:47.848 [2024-10-07 11:32:43.333545] nvme_tcp.c: 800:nvme_tcp_build_contig_request: *DEBUG*: enter 00:21:47.848 [2024-10-07 11:32:43.333549] nvme_tcp.c: 977:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:21:47.848 [2024-10-07 11:32:43.333553] nvme_tcp.c: 986:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x10da8f0) 00:21:47.848 [2024-10-07 11:32:43.333561] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY SET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:47.848 [2024-10-07 11:32:43.333583] nvme_tcp.c: 951:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1101480, cid 3, qid 0 00:21:47.848 [2024-10-07 11:32:43.333687] nvme_tcp.c:1198:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:21:47.848 [2024-10-07 11:32:43.333696] nvme_tcp.c:1986:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:21:47.848 [2024-10-07 11:32:43.333700] nvme_tcp.c:1659:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:21:47.848 [2024-10-07 11:32:43.333704] nvme_tcp.c:1079:nvme_tcp_req_complete: *DEBUG*: complete tcp_req(0x1101480) on tqpair=0x10da8f0 00:21:47.848 [2024-10-07 11:32:43.333710] nvme_ctrlr.c:1147:nvme_ctrlr_shutdown_set_cc_done: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] RTD3E = 0 us 00:21:47.848 [2024-10-07 11:32:43.333715] nvme_ctrlr.c:1150:nvme_ctrlr_shutdown_set_cc_done: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] shutdown timeout = 10000 ms 00:21:47.848 [2024-10-07 11:32:43.333725] nvme_tcp.c: 800:nvme_tcp_build_contig_request: *DEBUG*: enter 00:21:47.848 [2024-10-07 11:32:43.333730] nvme_tcp.c: 977:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:21:47.848 [2024-10-07 11:32:43.333745] nvme_tcp.c: 986:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x10da8f0) 00:21:47.848 [2024-10-07 11:32:43.333752] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:47.848 [2024-10-07 11:32:43.333773] nvme_tcp.c: 951:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1101480, cid 3, qid 0 00:21:47.848 [2024-10-07 11:32:43.333829] nvme_tcp.c:1198:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:21:47.848 [2024-10-07 11:32:43.333836] nvme_tcp.c:1986:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:21:47.848 [2024-10-07 11:32:43.333840] nvme_tcp.c:1659:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:21:47.848 [2024-10-07 11:32:43.333844] nvme_tcp.c:1079:nvme_tcp_req_complete: *DEBUG*: complete tcp_req(0x1101480) on tqpair=0x10da8f0 00:21:47.848 [2024-10-07 11:32:43.333856] nvme_tcp.c: 800:nvme_tcp_build_contig_request: *DEBUG*: enter 00:21:47.848 [2024-10-07 11:32:43.333860] nvme_tcp.c: 977:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:21:47.848 [2024-10-07 11:32:43.333864] nvme_tcp.c: 986:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x10da8f0) 00:21:47.848 [2024-10-07 11:32:43.333872] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:47.848 [2024-10-07 11:32:43.333890] nvme_tcp.c: 951:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1101480, cid 3, qid 0 00:21:47.848 [2024-10-07 11:32:43.333943] nvme_tcp.c:1198:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:21:47.848 [2024-10-07 11:32:43.333950] nvme_tcp.c:1986:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:21:47.848 [2024-10-07 11:32:43.333953] nvme_tcp.c:1659:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:21:47.848 [2024-10-07 11:32:43.333958] nvme_tcp.c:1079:nvme_tcp_req_complete: *DEBUG*: complete tcp_req(0x1101480) on tqpair=0x10da8f0 00:21:47.848 [2024-10-07 11:32:43.333968] nvme_tcp.c: 800:nvme_tcp_build_contig_request: *DEBUG*: enter 00:21:47.848 [2024-10-07 11:32:43.333973] nvme_tcp.c: 977:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:21:47.848 [2024-10-07 11:32:43.333976] nvme_tcp.c: 986:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x10da8f0) 00:21:47.848 [2024-10-07 11:32:43.333984] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:47.848 [2024-10-07 11:32:43.334002] nvme_tcp.c: 951:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1101480, cid 3, qid 0 00:21:47.848 [2024-10-07 11:32:43.334054] nvme_tcp.c:1198:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:21:47.848 [2024-10-07 11:32:43.334061] nvme_tcp.c:1986:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:21:47.848 [2024-10-07 11:32:43.334065] nvme_tcp.c:1659:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:21:47.848 [2024-10-07 11:32:43.334069] nvme_tcp.c:1079:nvme_tcp_req_complete: *DEBUG*: complete tcp_req(0x1101480) on tqpair=0x10da8f0 00:21:47.848 [2024-10-07 11:32:43.334079] nvme_tcp.c: 800:nvme_tcp_build_contig_request: *DEBUG*: enter 00:21:47.848 [2024-10-07 11:32:43.334084] nvme_tcp.c: 977:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:21:47.848 [2024-10-07 11:32:43.334088] nvme_tcp.c: 986:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x10da8f0) 00:21:47.848 [2024-10-07 11:32:43.334095] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:47.848 [2024-10-07 11:32:43.334113] nvme_tcp.c: 951:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1101480, cid 3, qid 0 00:21:47.848 [2024-10-07 11:32:43.334164] nvme_tcp.c:1198:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:21:47.848 [2024-10-07 11:32:43.334171] nvme_tcp.c:1986:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:21:47.848 [2024-10-07 11:32:43.334175] nvme_tcp.c:1659:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:21:47.848 [2024-10-07 11:32:43.334179] nvme_tcp.c:1079:nvme_tcp_req_complete: *DEBUG*: complete tcp_req(0x1101480) on tqpair=0x10da8f0 00:21:47.848 [2024-10-07 11:32:43.334190] nvme_tcp.c: 800:nvme_tcp_build_contig_request: *DEBUG*: enter 00:21:47.848 [2024-10-07 11:32:43.334194] nvme_tcp.c: 977:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:21:47.848 [2024-10-07 11:32:43.334198] nvme_tcp.c: 986:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x10da8f0) 00:21:47.848 [2024-10-07 11:32:43.334205] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:47.848 [2024-10-07 11:32:43.334223] nvme_tcp.c: 951:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1101480, cid 3, qid 0 00:21:47.848 [2024-10-07 11:32:43.334296] nvme_tcp.c:1198:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:21:47.848 [2024-10-07 11:32:43.334303] nvme_tcp.c:1986:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:21:47.848 [2024-10-07 11:32:43.334306] nvme_tcp.c:1659:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:21:47.848 [2024-10-07 11:32:43.334310] nvme_tcp.c:1079:nvme_tcp_req_complete: *DEBUG*: complete tcp_req(0x1101480) on tqpair=0x10da8f0 00:21:47.848 [2024-10-07 11:32:43.334321] nvme_tcp.c: 800:nvme_tcp_build_contig_request: *DEBUG*: enter 00:21:47.848 [2024-10-07 11:32:43.334325] nvme_tcp.c: 977:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:21:47.848 [2024-10-07 11:32:43.334329] nvme_tcp.c: 986:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x10da8f0) 00:21:47.848 [2024-10-07 11:32:43.334348] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:47.848 [2024-10-07 11:32:43.334378] nvme_tcp.c: 951:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1101480, cid 3, qid 0 00:21:47.848 [2024-10-07 11:32:43.334431] nvme_tcp.c:1198:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:21:47.848 [2024-10-07 11:32:43.334438] nvme_tcp.c:1986:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:21:47.848 [2024-10-07 11:32:43.334441] nvme_tcp.c:1659:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:21:47.848 [2024-10-07 11:32:43.334445] nvme_tcp.c:1079:nvme_tcp_req_complete: *DEBUG*: complete tcp_req(0x1101480) on tqpair=0x10da8f0 00:21:47.848 [2024-10-07 11:32:43.334456] nvme_tcp.c: 800:nvme_tcp_build_contig_request: *DEBUG*: enter 00:21:47.848 [2024-10-07 11:32:43.334460] nvme_tcp.c: 977:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:21:47.848 [2024-10-07 11:32:43.334464] nvme_tcp.c: 986:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x10da8f0) 00:21:47.848 [2024-10-07 11:32:43.334472] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:47.848 [2024-10-07 11:32:43.334489] nvme_tcp.c: 951:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1101480, cid 3, qid 0 00:21:47.849 [2024-10-07 11:32:43.334542] nvme_tcp.c:1198:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:21:47.849 [2024-10-07 11:32:43.334549] nvme_tcp.c:1986:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:21:47.849 [2024-10-07 11:32:43.334553] nvme_tcp.c:1659:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:21:47.849 [2024-10-07 11:32:43.334557] nvme_tcp.c:1079:nvme_tcp_req_complete: *DEBUG*: complete tcp_req(0x1101480) on tqpair=0x10da8f0 00:21:47.849 [2024-10-07 11:32:43.334568] nvme_tcp.c: 800:nvme_tcp_build_contig_request: *DEBUG*: enter 00:21:47.849 [2024-10-07 11:32:43.334572] nvme_tcp.c: 977:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:21:47.849 [2024-10-07 11:32:43.334576] nvme_tcp.c: 986:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x10da8f0) 00:21:47.849 [2024-10-07 11:32:43.334584] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:47.849 [2024-10-07 11:32:43.334601] nvme_tcp.c: 951:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1101480, cid 3, qid 0 00:21:47.849 [2024-10-07 11:32:43.334664] nvme_tcp.c:1198:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:21:47.849 [2024-10-07 11:32:43.334674] nvme_tcp.c:1986:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:21:47.849 [2024-10-07 11:32:43.334677] nvme_tcp.c:1659:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:21:47.849 [2024-10-07 11:32:43.334682] nvme_tcp.c:1079:nvme_tcp_req_complete: *DEBUG*: complete tcp_req(0x1101480) on tqpair=0x10da8f0 00:21:47.849 [2024-10-07 11:32:43.334693] nvme_tcp.c: 800:nvme_tcp_build_contig_request: *DEBUG*: enter 00:21:47.849 [2024-10-07 11:32:43.334698] nvme_tcp.c: 977:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:21:47.849 [2024-10-07 11:32:43.334702] nvme_tcp.c: 986:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x10da8f0) 00:21:47.849 [2024-10-07 11:32:43.334709] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:47.849 [2024-10-07 11:32:43.334730] nvme_tcp.c: 951:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1101480, cid 3, qid 0 00:21:47.849 [2024-10-07 11:32:43.334781] nvme_tcp.c:1198:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:21:47.849 [2024-10-07 11:32:43.334788] nvme_tcp.c:1986:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:21:47.849 [2024-10-07 11:32:43.334792] nvme_tcp.c:1659:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:21:47.849 [2024-10-07 11:32:43.334796] nvme_tcp.c:1079:nvme_tcp_req_complete: *DEBUG*: complete tcp_req(0x1101480) on tqpair=0x10da8f0 00:21:47.849 [2024-10-07 11:32:43.334816] nvme_tcp.c: 800:nvme_tcp_build_contig_request: *DEBUG*: enter 00:21:47.849 [2024-10-07 11:32:43.334820] nvme_tcp.c: 977:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:21:47.849 [2024-10-07 11:32:43.334824] nvme_tcp.c: 986:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x10da8f0) 00:21:47.849 [2024-10-07 11:32:43.334832] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:47.849 [2024-10-07 11:32:43.334862] nvme_tcp.c: 951:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1101480, cid 3, qid 0 00:21:47.849 [2024-10-07 11:32:43.334925] nvme_tcp.c:1198:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:21:47.849 [2024-10-07 11:32:43.334932] nvme_tcp.c:1986:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:21:47.849 [2024-10-07 11:32:43.334936] nvme_tcp.c:1659:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:21:47.849 [2024-10-07 11:32:43.334940] nvme_tcp.c:1079:nvme_tcp_req_complete: *DEBUG*: complete tcp_req(0x1101480) on tqpair=0x10da8f0 00:21:47.849 [2024-10-07 11:32:43.334951] nvme_tcp.c: 800:nvme_tcp_build_contig_request: *DEBUG*: enter 00:21:47.849 [2024-10-07 11:32:43.334955] nvme_tcp.c: 977:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:21:47.849 [2024-10-07 11:32:43.334959] nvme_tcp.c: 986:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x10da8f0) 00:21:47.849 [2024-10-07 11:32:43.334966] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:47.849 [2024-10-07 11:32:43.335005] nvme_tcp.c: 951:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1101480, cid 3, qid 0 00:21:47.849 [2024-10-07 11:32:43.335060] nvme_tcp.c:1198:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:21:47.849 [2024-10-07 11:32:43.335067] nvme_tcp.c:1986:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:21:47.849 [2024-10-07 11:32:43.335071] nvme_tcp.c:1659:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:21:47.849 [2024-10-07 11:32:43.335075] nvme_tcp.c:1079:nvme_tcp_req_complete: *DEBUG*: complete tcp_req(0x1101480) on tqpair=0x10da8f0 00:21:47.849 [2024-10-07 11:32:43.335086] nvme_tcp.c: 800:nvme_tcp_build_contig_request: *DEBUG*: enter 00:21:47.849 [2024-10-07 11:32:43.335091] nvme_tcp.c: 977:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:21:47.849 [2024-10-07 11:32:43.335095] nvme_tcp.c: 986:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x10da8f0) 00:21:47.849 [2024-10-07 11:32:43.335103] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:47.849 [2024-10-07 11:32:43.335122] nvme_tcp.c: 951:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1101480, cid 3, qid 0 00:21:47.849 [2024-10-07 11:32:43.335176] nvme_tcp.c:1198:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:21:47.849 [2024-10-07 11:32:43.335183] nvme_tcp.c:1986:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:21:47.849 [2024-10-07 11:32:43.335187] nvme_tcp.c:1659:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:21:47.849 [2024-10-07 11:32:43.335191] nvme_tcp.c:1079:nvme_tcp_req_complete: *DEBUG*: complete tcp_req(0x1101480) on tqpair=0x10da8f0 00:21:47.849 [2024-10-07 11:32:43.335202] nvme_tcp.c: 800:nvme_tcp_build_contig_request: *DEBUG*: enter 00:21:47.849 [2024-10-07 11:32:43.335206] nvme_tcp.c: 977:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:21:47.849 [2024-10-07 11:32:43.335210] nvme_tcp.c: 986:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x10da8f0) 00:21:47.849 [2024-10-07 11:32:43.335218] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:47.849 [2024-10-07 11:32:43.335255] nvme_tcp.c: 951:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1101480, cid 3, qid 0 00:21:47.849 [2024-10-07 11:32:43.335308] nvme_tcp.c:1198:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:21:47.849 [2024-10-07 11:32:43.335316] nvme_tcp.c:1986:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:21:47.849 [2024-10-07 11:32:43.335319] nvme_tcp.c:1659:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:21:47.849 [2024-10-07 11:32:43.335324] nvme_tcp.c:1079:nvme_tcp_req_complete: *DEBUG*: complete tcp_req(0x1101480) on tqpair=0x10da8f0 00:21:47.849 [2024-10-07 11:32:43.335334] nvme_tcp.c: 800:nvme_tcp_build_contig_request: *DEBUG*: enter 00:21:47.849 [2024-10-07 11:32:43.335339] nvme_tcp.c: 977:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:21:47.849 [2024-10-07 11:32:43.335343] nvme_tcp.c: 986:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x10da8f0) 00:21:47.849 [2024-10-07 11:32:43.335350] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:47.849 [2024-10-07 11:32:43.335369] nvme_tcp.c: 951:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1101480, cid 3, qid 0 00:21:47.849 [2024-10-07 11:32:43.335419] nvme_tcp.c:1198:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:21:47.849 [2024-10-07 11:32:43.335426] nvme_tcp.c:1986:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:21:47.849 [2024-10-07 11:32:43.335430] nvme_tcp.c:1659:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:21:47.849 [2024-10-07 11:32:43.335434] nvme_tcp.c:1079:nvme_tcp_req_complete: *DEBUG*: complete tcp_req(0x1101480) on tqpair=0x10da8f0 00:21:47.849 [2024-10-07 11:32:43.335445] nvme_tcp.c: 800:nvme_tcp_build_contig_request: *DEBUG*: enter 00:21:47.849 [2024-10-07 11:32:43.335449] nvme_tcp.c: 977:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:21:47.849 [2024-10-07 11:32:43.335453] nvme_tcp.c: 986:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x10da8f0) 00:21:47.849 [2024-10-07 11:32:43.335461] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:47.849 [2024-10-07 11:32:43.335490] nvme_tcp.c: 951:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1101480, cid 3, qid 0 00:21:47.849 [2024-10-07 11:32:43.335540] nvme_tcp.c:1198:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:21:47.849 [2024-10-07 11:32:43.335547] nvme_tcp.c:1986:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:21:47.849 [2024-10-07 11:32:43.335550] nvme_tcp.c:1659:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:21:47.849 [2024-10-07 11:32:43.335555] nvme_tcp.c:1079:nvme_tcp_req_complete: *DEBUG*: complete tcp_req(0x1101480) on tqpair=0x10da8f0 00:21:47.849 [2024-10-07 11:32:43.335565] nvme_tcp.c: 800:nvme_tcp_build_contig_request: *DEBUG*: enter 00:21:47.849 [2024-10-07 11:32:43.335570] nvme_tcp.c: 977:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:21:47.849 [2024-10-07 11:32:43.335574] nvme_tcp.c: 986:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x10da8f0) 00:21:47.849 [2024-10-07 11:32:43.335581] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:47.849 [2024-10-07 11:32:43.335599] nvme_tcp.c: 951:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1101480, cid 3, qid 0 00:21:47.849 [2024-10-07 11:32:43.335664] nvme_tcp.c:1198:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:21:47.849 [2024-10-07 11:32:43.335673] nvme_tcp.c:1986:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:21:47.849 [2024-10-07 11:32:43.335677] nvme_tcp.c:1659:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:21:47.849 [2024-10-07 11:32:43.335681] nvme_tcp.c:1079:nvme_tcp_req_complete: *DEBUG*: complete tcp_req(0x1101480) on tqpair=0x10da8f0 00:21:47.849 [2024-10-07 11:32:43.335692] nvme_tcp.c: 800:nvme_tcp_build_contig_request: *DEBUG*: enter 00:21:47.849 [2024-10-07 11:32:43.335696] nvme_tcp.c: 977:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:21:47.849 [2024-10-07 11:32:43.335700] nvme_tcp.c: 986:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x10da8f0) 00:21:47.849 [2024-10-07 11:32:43.335708] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:47.849 [2024-10-07 11:32:43.335739] nvme_tcp.c: 951:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1101480, cid 3, qid 0 00:21:47.849 [2024-10-07 11:32:43.335794] nvme_tcp.c:1198:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:21:47.849 [2024-10-07 11:32:43.335801] nvme_tcp.c:1986:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:21:47.849 [2024-10-07 11:32:43.335805] nvme_tcp.c:1659:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:21:47.849 [2024-10-07 11:32:43.335809] nvme_tcp.c:1079:nvme_tcp_req_complete: *DEBUG*: complete tcp_req(0x1101480) on tqpair=0x10da8f0 00:21:47.849 [2024-10-07 11:32:43.335819] nvme_tcp.c: 800:nvme_tcp_build_contig_request: *DEBUG*: enter 00:21:47.849 [2024-10-07 11:32:43.335824] nvme_tcp.c: 977:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:21:47.849 [2024-10-07 11:32:43.335828] nvme_tcp.c: 986:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x10da8f0) 00:21:47.850 [2024-10-07 11:32:43.335835] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:47.850 [2024-10-07 11:32:43.335854] nvme_tcp.c: 951:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1101480, cid 3, qid 0 00:21:47.850 [2024-10-07 11:32:43.335905] nvme_tcp.c:1198:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:21:47.850 [2024-10-07 11:32:43.335914] nvme_tcp.c:1986:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:21:47.850 [2024-10-07 11:32:43.335918] nvme_tcp.c:1659:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:21:47.850 [2024-10-07 11:32:43.335922] nvme_tcp.c:1079:nvme_tcp_req_complete: *DEBUG*: complete tcp_req(0x1101480) on tqpair=0x10da8f0 00:21:47.850 [2024-10-07 11:32:43.335933] nvme_tcp.c: 800:nvme_tcp_build_contig_request: *DEBUG*: enter 00:21:47.850 [2024-10-07 11:32:43.335938] nvme_tcp.c: 977:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:21:47.850 [2024-10-07 11:32:43.335942] nvme_tcp.c: 986:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x10da8f0) 00:21:47.850 [2024-10-07 11:32:43.335950] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:47.850 [2024-10-07 11:32:43.335971] nvme_tcp.c: 951:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1101480, cid 3, qid 0 00:21:47.850 [2024-10-07 11:32:43.336027] nvme_tcp.c:1198:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:21:47.850 [2024-10-07 11:32:43.336034] nvme_tcp.c:1986:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:21:47.850 [2024-10-07 11:32:43.336048] nvme_tcp.c:1659:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:21:47.850 [2024-10-07 11:32:43.336052] nvme_tcp.c:1079:nvme_tcp_req_complete: *DEBUG*: complete tcp_req(0x1101480) on tqpair=0x10da8f0 00:21:47.850 [2024-10-07 11:32:43.336062] nvme_tcp.c: 800:nvme_tcp_build_contig_request: *DEBUG*: enter 00:21:47.850 [2024-10-07 11:32:43.336067] nvme_tcp.c: 977:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:21:47.850 [2024-10-07 11:32:43.336081] nvme_tcp.c: 986:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x10da8f0) 00:21:47.850 [2024-10-07 11:32:43.336089] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:47.850 [2024-10-07 11:32:43.336107] nvme_tcp.c: 951:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1101480, cid 3, qid 0 00:21:47.850 [2024-10-07 11:32:43.336157] nvme_tcp.c:1198:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:21:47.850 [2024-10-07 11:32:43.336164] nvme_tcp.c:1986:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:21:47.850 [2024-10-07 11:32:43.336168] nvme_tcp.c:1659:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:21:47.850 [2024-10-07 11:32:43.336172] nvme_tcp.c:1079:nvme_tcp_req_complete: *DEBUG*: complete tcp_req(0x1101480) on tqpair=0x10da8f0 00:21:47.850 [2024-10-07 11:32:43.336182] nvme_tcp.c: 800:nvme_tcp_build_contig_request: *DEBUG*: enter 00:21:47.850 [2024-10-07 11:32:43.336187] nvme_tcp.c: 977:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:21:47.850 [2024-10-07 11:32:43.336191] nvme_tcp.c: 986:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x10da8f0) 00:21:47.850 [2024-10-07 11:32:43.336198] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:47.850 [2024-10-07 11:32:43.336228] nvme_tcp.c: 951:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1101480, cid 3, qid 0 00:21:47.850 [2024-10-07 11:32:43.336292] nvme_tcp.c:1198:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:21:47.850 [2024-10-07 11:32:43.336299] nvme_tcp.c:1986:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:21:47.850 [2024-10-07 11:32:43.336312] nvme_tcp.c:1659:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:21:47.850 [2024-10-07 11:32:43.336316] nvme_tcp.c:1079:nvme_tcp_req_complete: *DEBUG*: complete tcp_req(0x1101480) on tqpair=0x10da8f0 00:21:47.850 [2024-10-07 11:32:43.336326] nvme_tcp.c: 800:nvme_tcp_build_contig_request: *DEBUG*: enter 00:21:47.850 [2024-10-07 11:32:43.336331] nvme_tcp.c: 977:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:21:47.850 [2024-10-07 11:32:43.336335] nvme_tcp.c: 986:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x10da8f0) 00:21:47.850 [2024-10-07 11:32:43.336342] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:47.850 [2024-10-07 11:32:43.336360] nvme_tcp.c: 951:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1101480, cid 3, qid 0 00:21:47.850 [2024-10-07 11:32:43.336410] nvme_tcp.c:1198:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:21:47.850 [2024-10-07 11:32:43.336417] nvme_tcp.c:1986:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:21:47.850 [2024-10-07 11:32:43.336428] nvme_tcp.c:1659:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:21:47.850 [2024-10-07 11:32:43.336432] nvme_tcp.c:1079:nvme_tcp_req_complete: *DEBUG*: complete tcp_req(0x1101480) on tqpair=0x10da8f0 00:21:47.850 [2024-10-07 11:32:43.336442] nvme_tcp.c: 800:nvme_tcp_build_contig_request: *DEBUG*: enter 00:21:47.850 [2024-10-07 11:32:43.336447] nvme_tcp.c: 977:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:21:47.850 [2024-10-07 11:32:43.336451] nvme_tcp.c: 986:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x10da8f0) 00:21:47.850 [2024-10-07 11:32:43.336458] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:47.850 [2024-10-07 11:32:43.336476] nvme_tcp.c: 951:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1101480, cid 3, qid 0 00:21:47.850 [2024-10-07 11:32:43.336541] nvme_tcp.c:1198:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:21:47.850 [2024-10-07 11:32:43.336547] nvme_tcp.c:1986:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:21:47.850 [2024-10-07 11:32:43.336551] nvme_tcp.c:1659:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:21:47.850 [2024-10-07 11:32:43.336555] nvme_tcp.c:1079:nvme_tcp_req_complete: *DEBUG*: complete tcp_req(0x1101480) on tqpair=0x10da8f0 00:21:47.850 [2024-10-07 11:32:43.336566] nvme_tcp.c: 800:nvme_tcp_build_contig_request: *DEBUG*: enter 00:21:47.850 [2024-10-07 11:32:43.336570] nvme_tcp.c: 977:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:21:47.850 [2024-10-07 11:32:43.336574] nvme_tcp.c: 986:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x10da8f0) 00:21:47.850 [2024-10-07 11:32:43.336581] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:47.850 [2024-10-07 11:32:43.336599] nvme_tcp.c: 951:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1101480, cid 3, qid 0 00:21:47.850 [2024-10-07 11:32:43.340662] nvme_tcp.c:1198:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:21:47.850 [2024-10-07 11:32:43.340685] nvme_tcp.c:1986:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:21:47.850 [2024-10-07 11:32:43.340690] nvme_tcp.c:1659:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:21:47.850 [2024-10-07 11:32:43.340695] nvme_tcp.c:1079:nvme_tcp_req_complete: *DEBUG*: complete tcp_req(0x1101480) on tqpair=0x10da8f0 00:21:47.850 [2024-10-07 11:32:43.340711] nvme_tcp.c: 800:nvme_tcp_build_contig_request: *DEBUG*: enter 00:21:47.850 [2024-10-07 11:32:43.340716] nvme_tcp.c: 977:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:21:47.850 [2024-10-07 11:32:43.340720] nvme_tcp.c: 986:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x10da8f0) 00:21:47.850 [2024-10-07 11:32:43.340729] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:21:47.850 [2024-10-07 11:32:43.340757] nvme_tcp.c: 951:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1101480, cid 3, qid 0 00:21:47.850 [2024-10-07 11:32:43.340818] nvme_tcp.c:1198:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:21:47.850 [2024-10-07 11:32:43.340825] nvme_tcp.c:1986:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:21:47.850 [2024-10-07 11:32:43.340828] nvme_tcp.c:1659:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:21:47.850 [2024-10-07 11:32:43.340833] nvme_tcp.c:1079:nvme_tcp_req_complete: *DEBUG*: complete tcp_req(0x1101480) on tqpair=0x10da8f0 00:21:47.850 [2024-10-07 11:32:43.340841] nvme_ctrlr.c:1269:nvme_ctrlr_shutdown_poll_async: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] shutdown complete in 7 milliseconds 00:21:47.850 0% 00:21:47.850 Data Units Read: 0 00:21:47.850 Data Units Written: 0 00:21:47.850 Host Read Commands: 0 00:21:47.850 Host Write Commands: 0 00:21:47.850 Controller Busy Time: 0 minutes 00:21:47.850 Power Cycles: 0 00:21:47.850 Power On Hours: 0 hours 00:21:47.850 Unsafe Shutdowns: 0 00:21:47.850 Unrecoverable Media Errors: 0 00:21:47.850 Lifetime Error Log Entries: 0 00:21:47.850 Warning Temperature Time: 0 minutes 00:21:47.850 Critical Temperature Time: 0 minutes 00:21:47.850 00:21:47.850 Number of Queues 00:21:47.850 ================ 00:21:47.850 Number of I/O Submission Queues: 127 00:21:47.850 Number of I/O Completion Queues: 127 00:21:47.850 00:21:47.850 Active Namespaces 00:21:47.850 ================= 00:21:47.850 Namespace ID:1 00:21:47.850 Error Recovery Timeout: Unlimited 00:21:47.850 Command Set Identifier: NVM (00h) 00:21:47.850 Deallocate: Supported 00:21:47.850 Deallocated/Unwritten Error: Not Supported 00:21:47.850 Deallocated Read Value: Unknown 00:21:47.850 Deallocate in Write Zeroes: Not Supported 00:21:47.850 Deallocated Guard Field: 0xFFFF 00:21:47.850 Flush: Supported 00:21:47.850 Reservation: Supported 00:21:47.850 Namespace Sharing Capabilities: Multiple Controllers 00:21:47.850 Size (in LBAs): 131072 (0GiB) 00:21:47.850 Capacity (in LBAs): 131072 (0GiB) 00:21:47.850 Utilization (in LBAs): 131072 (0GiB) 00:21:47.850 NGUID: ABCDEF0123456789ABCDEF0123456789 00:21:47.850 EUI64: ABCDEF0123456789 00:21:47.850 UUID: fa26896a-ce0f-4b37-93de-56d475f120e8 00:21:47.850 Thin Provisioning: Not Supported 00:21:47.850 Per-NS Atomic Units: Yes 00:21:47.850 Atomic Boundary Size (Normal): 0 00:21:47.850 Atomic Boundary Size (PFail): 0 00:21:47.850 Atomic Boundary Offset: 0 00:21:47.850 Maximum Single Source Range Length: 65535 00:21:47.850 Maximum Copy Length: 65535 00:21:47.850 Maximum Source Range Count: 1 00:21:47.850 NGUID/EUI64 Never Reused: No 00:21:47.850 Namespace Write Protected: No 00:21:47.850 Number of LBA Formats: 1 00:21:47.850 Current LBA Format: LBA Format #00 00:21:47.850 LBA Format #00: Data Size: 512 Metadata Size: 0 00:21:47.850 00:21:48.119 11:32:43 nvmf_tcp.nvmf_host.nvmf_identify -- host/identify.sh@51 -- # sync 00:21:48.119 11:32:43 nvmf_tcp.nvmf_host.nvmf_identify -- host/identify.sh@52 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:21:48.119 11:32:43 nvmf_tcp.nvmf_host.nvmf_identify -- common/autotest_common.sh@561 -- # xtrace_disable 00:21:48.119 11:32:43 nvmf_tcp.nvmf_host.nvmf_identify -- common/autotest_common.sh@10 -- # set +x 00:21:48.119 11:32:43 nvmf_tcp.nvmf_host.nvmf_identify -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:21:48.119 11:32:43 nvmf_tcp.nvmf_host.nvmf_identify -- host/identify.sh@54 -- # trap - SIGINT SIGTERM EXIT 00:21:48.119 11:32:43 nvmf_tcp.nvmf_host.nvmf_identify -- host/identify.sh@56 -- # nvmftestfini 00:21:48.119 11:32:43 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@514 -- # nvmfcleanup 00:21:48.119 11:32:43 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@121 -- # sync 00:21:48.119 11:32:43 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@123 -- # '[' tcp == tcp ']' 00:21:48.119 11:32:43 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@124 -- # set +e 00:21:48.119 11:32:43 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@125 -- # for i in {1..20} 00:21:48.119 11:32:43 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@126 -- # modprobe -v -r nvme-tcp 00:21:48.119 rmmod nvme_tcp 00:21:48.119 rmmod nvme_fabrics 00:21:48.119 rmmod nvme_keyring 00:21:48.119 11:32:43 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@127 -- # modprobe -v -r nvme-fabrics 00:21:48.119 11:32:43 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@128 -- # set -e 00:21:48.119 11:32:43 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@129 -- # return 0 00:21:48.119 11:32:43 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@515 -- # '[' -n 87700 ']' 00:21:48.119 11:32:43 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@516 -- # killprocess 87700 00:21:48.119 11:32:43 nvmf_tcp.nvmf_host.nvmf_identify -- common/autotest_common.sh@950 -- # '[' -z 87700 ']' 00:21:48.119 11:32:43 nvmf_tcp.nvmf_host.nvmf_identify -- common/autotest_common.sh@954 -- # kill -0 87700 00:21:48.119 11:32:43 nvmf_tcp.nvmf_host.nvmf_identify -- common/autotest_common.sh@955 -- # uname 00:21:48.119 11:32:43 nvmf_tcp.nvmf_host.nvmf_identify -- common/autotest_common.sh@955 -- # '[' Linux = Linux ']' 00:21:48.119 11:32:43 nvmf_tcp.nvmf_host.nvmf_identify -- common/autotest_common.sh@956 -- # ps --no-headers -o comm= 87700 00:21:48.119 11:32:43 nvmf_tcp.nvmf_host.nvmf_identify -- common/autotest_common.sh@956 -- # process_name=reactor_0 00:21:48.119 11:32:43 nvmf_tcp.nvmf_host.nvmf_identify -- common/autotest_common.sh@960 -- # '[' reactor_0 = sudo ']' 00:21:48.119 killing process with pid 87700 00:21:48.119 11:32:43 nvmf_tcp.nvmf_host.nvmf_identify -- common/autotest_common.sh@968 -- # echo 'killing process with pid 87700' 00:21:48.119 11:32:43 nvmf_tcp.nvmf_host.nvmf_identify -- common/autotest_common.sh@969 -- # kill 87700 00:21:48.119 11:32:43 nvmf_tcp.nvmf_host.nvmf_identify -- common/autotest_common.sh@974 -- # wait 87700 00:21:48.691 11:32:43 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@518 -- # '[' '' == iso ']' 00:21:48.691 11:32:43 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@521 -- # [[ tcp == \t\c\p ]] 00:21:48.691 11:32:43 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@522 -- # nvmf_tcp_fini 00:21:48.691 11:32:43 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@297 -- # iptr 00:21:48.691 11:32:43 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@789 -- # iptables-save 00:21:48.691 11:32:43 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@789 -- # grep -v SPDK_NVMF 00:21:48.691 11:32:43 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@789 -- # iptables-restore 00:21:48.691 11:32:43 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@298 -- # [[ nvmf_tgt_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s\_\s\p\d\k ]] 00:21:48.691 11:32:43 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@299 -- # nvmf_veth_fini 00:21:48.691 11:32:43 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@233 -- # ip link set nvmf_init_br nomaster 00:21:48.691 11:32:43 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@234 -- # ip link set nvmf_init_br2 nomaster 00:21:48.691 11:32:43 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@235 -- # ip link set nvmf_tgt_br nomaster 00:21:48.691 11:32:43 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@236 -- # ip link set nvmf_tgt_br2 nomaster 00:21:48.691 11:32:43 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@237 -- # ip link set nvmf_init_br down 00:21:48.691 11:32:44 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@238 -- # ip link set nvmf_init_br2 down 00:21:48.691 11:32:44 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@239 -- # ip link set nvmf_tgt_br down 00:21:48.691 11:32:44 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@240 -- # ip link set nvmf_tgt_br2 down 00:21:48.692 11:32:44 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@241 -- # ip link delete nvmf_br type bridge 00:21:48.692 11:32:44 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@242 -- # ip link delete nvmf_init_if 00:21:48.692 11:32:44 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@243 -- # ip link delete nvmf_init_if2 00:21:48.692 11:32:44 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@244 -- # ip netns exec nvmf_tgt_ns_spdk ip link delete nvmf_tgt_if 00:21:48.692 11:32:44 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@245 -- # ip netns exec nvmf_tgt_ns_spdk ip link delete nvmf_tgt_if2 00:21:48.692 11:32:44 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@246 -- # remove_spdk_ns 00:21:48.692 11:32:44 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@654 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:21:48.692 11:32:44 nvmf_tcp.nvmf_host.nvmf_identify -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 15> /dev/null' 00:21:48.692 11:32:44 nvmf_tcp.nvmf_host.nvmf_identify -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:21:48.692 11:32:44 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@300 -- # return 0 00:21:48.692 00:21:48.692 real 0m3.287s 00:21:48.692 user 0m8.222s 00:21:48.692 sys 0m0.861s 00:21:48.692 11:32:44 nvmf_tcp.nvmf_host.nvmf_identify -- common/autotest_common.sh@1126 -- # xtrace_disable 00:21:48.692 11:32:44 nvmf_tcp.nvmf_host.nvmf_identify -- common/autotest_common.sh@10 -- # set +x 00:21:48.692 ************************************ 00:21:48.692 END TEST nvmf_identify 00:21:48.692 ************************************ 00:21:48.952 11:32:44 nvmf_tcp.nvmf_host -- nvmf/nvmf_host.sh@23 -- # run_test nvmf_perf /home/vagrant/spdk_repo/spdk/test/nvmf/host/perf.sh --transport=tcp 00:21:48.952 11:32:44 nvmf_tcp.nvmf_host -- common/autotest_common.sh@1101 -- # '[' 3 -le 1 ']' 00:21:48.952 11:32:44 nvmf_tcp.nvmf_host -- common/autotest_common.sh@1107 -- # xtrace_disable 00:21:48.952 11:32:44 nvmf_tcp.nvmf_host -- common/autotest_common.sh@10 -- # set +x 00:21:48.952 ************************************ 00:21:48.952 START TEST nvmf_perf 00:21:48.952 ************************************ 00:21:48.952 11:32:44 nvmf_tcp.nvmf_host.nvmf_perf -- common/autotest_common.sh@1125 -- # /home/vagrant/spdk_repo/spdk/test/nvmf/host/perf.sh --transport=tcp 00:21:48.952 * Looking for test storage... 00:21:48.952 * Found test storage at /home/vagrant/spdk_repo/spdk/test/nvmf/host 00:21:48.952 11:32:44 nvmf_tcp.nvmf_host.nvmf_perf -- common/autotest_common.sh@1680 -- # [[ y == y ]] 00:21:48.952 11:32:44 nvmf_tcp.nvmf_host.nvmf_perf -- common/autotest_common.sh@1681 -- # lcov --version 00:21:48.952 11:32:44 nvmf_tcp.nvmf_host.nvmf_perf -- common/autotest_common.sh@1681 -- # awk '{print $NF}' 00:21:48.952 11:32:44 nvmf_tcp.nvmf_host.nvmf_perf -- common/autotest_common.sh@1681 -- # lt 1.15 2 00:21:48.952 11:32:44 nvmf_tcp.nvmf_host.nvmf_perf -- scripts/common.sh@373 -- # cmp_versions 1.15 '<' 2 00:21:48.952 11:32:44 nvmf_tcp.nvmf_host.nvmf_perf -- scripts/common.sh@333 -- # local ver1 ver1_l 00:21:48.952 11:32:44 nvmf_tcp.nvmf_host.nvmf_perf -- scripts/common.sh@334 -- # local ver2 ver2_l 00:21:48.952 11:32:44 nvmf_tcp.nvmf_host.nvmf_perf -- scripts/common.sh@336 -- # IFS=.-: 00:21:48.952 11:32:44 nvmf_tcp.nvmf_host.nvmf_perf -- scripts/common.sh@336 -- # read -ra ver1 00:21:48.952 11:32:44 nvmf_tcp.nvmf_host.nvmf_perf -- scripts/common.sh@337 -- # IFS=.-: 00:21:48.952 11:32:44 nvmf_tcp.nvmf_host.nvmf_perf -- scripts/common.sh@337 -- # read -ra ver2 00:21:48.952 11:32:44 nvmf_tcp.nvmf_host.nvmf_perf -- scripts/common.sh@338 -- # local 'op=<' 00:21:48.952 11:32:44 nvmf_tcp.nvmf_host.nvmf_perf -- scripts/common.sh@340 -- # ver1_l=2 00:21:48.952 11:32:44 nvmf_tcp.nvmf_host.nvmf_perf -- scripts/common.sh@341 -- # ver2_l=1 00:21:48.952 11:32:44 nvmf_tcp.nvmf_host.nvmf_perf -- scripts/common.sh@343 -- # local lt=0 gt=0 eq=0 v 00:21:48.953 11:32:44 nvmf_tcp.nvmf_host.nvmf_perf -- scripts/common.sh@344 -- # case "$op" in 00:21:48.953 11:32:44 nvmf_tcp.nvmf_host.nvmf_perf -- scripts/common.sh@345 -- # : 1 00:21:48.953 11:32:44 nvmf_tcp.nvmf_host.nvmf_perf -- scripts/common.sh@364 -- # (( v = 0 )) 00:21:48.953 11:32:44 nvmf_tcp.nvmf_host.nvmf_perf -- scripts/common.sh@364 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:21:48.953 11:32:44 nvmf_tcp.nvmf_host.nvmf_perf -- scripts/common.sh@365 -- # decimal 1 00:21:48.953 11:32:44 nvmf_tcp.nvmf_host.nvmf_perf -- scripts/common.sh@353 -- # local d=1 00:21:48.953 11:32:44 nvmf_tcp.nvmf_host.nvmf_perf -- scripts/common.sh@354 -- # [[ 1 =~ ^[0-9]+$ ]] 00:21:48.953 11:32:44 nvmf_tcp.nvmf_host.nvmf_perf -- scripts/common.sh@355 -- # echo 1 00:21:48.953 11:32:44 nvmf_tcp.nvmf_host.nvmf_perf -- scripts/common.sh@365 -- # ver1[v]=1 00:21:48.953 11:32:44 nvmf_tcp.nvmf_host.nvmf_perf -- scripts/common.sh@366 -- # decimal 2 00:21:48.953 11:32:44 nvmf_tcp.nvmf_host.nvmf_perf -- scripts/common.sh@353 -- # local d=2 00:21:48.953 11:32:44 nvmf_tcp.nvmf_host.nvmf_perf -- scripts/common.sh@354 -- # [[ 2 =~ ^[0-9]+$ ]] 00:21:48.953 11:32:44 nvmf_tcp.nvmf_host.nvmf_perf -- scripts/common.sh@355 -- # echo 2 00:21:48.953 11:32:44 nvmf_tcp.nvmf_host.nvmf_perf -- scripts/common.sh@366 -- # ver2[v]=2 00:21:48.953 11:32:44 nvmf_tcp.nvmf_host.nvmf_perf -- scripts/common.sh@367 -- # (( ver1[v] > ver2[v] )) 00:21:48.953 11:32:44 nvmf_tcp.nvmf_host.nvmf_perf -- scripts/common.sh@368 -- # (( ver1[v] < ver2[v] )) 00:21:48.953 11:32:44 nvmf_tcp.nvmf_host.nvmf_perf -- scripts/common.sh@368 -- # return 0 00:21:48.953 11:32:44 nvmf_tcp.nvmf_host.nvmf_perf -- common/autotest_common.sh@1682 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:21:48.953 11:32:44 nvmf_tcp.nvmf_host.nvmf_perf -- common/autotest_common.sh@1694 -- # export 'LCOV_OPTS= 00:21:48.953 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:21:48.953 --rc genhtml_branch_coverage=1 00:21:48.953 --rc genhtml_function_coverage=1 00:21:48.953 --rc genhtml_legend=1 00:21:48.953 --rc geninfo_all_blocks=1 00:21:48.953 --rc geninfo_unexecuted_blocks=1 00:21:48.953 00:21:48.953 ' 00:21:48.953 11:32:44 nvmf_tcp.nvmf_host.nvmf_perf -- common/autotest_common.sh@1694 -- # LCOV_OPTS=' 00:21:48.953 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:21:48.953 --rc genhtml_branch_coverage=1 00:21:48.953 --rc genhtml_function_coverage=1 00:21:48.953 --rc genhtml_legend=1 00:21:48.953 --rc geninfo_all_blocks=1 00:21:48.953 --rc geninfo_unexecuted_blocks=1 00:21:48.953 00:21:48.953 ' 00:21:48.953 11:32:44 nvmf_tcp.nvmf_host.nvmf_perf -- common/autotest_common.sh@1695 -- # export 'LCOV=lcov 00:21:48.953 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:21:48.953 --rc genhtml_branch_coverage=1 00:21:48.953 --rc genhtml_function_coverage=1 00:21:48.953 --rc genhtml_legend=1 00:21:48.953 --rc geninfo_all_blocks=1 00:21:48.953 --rc geninfo_unexecuted_blocks=1 00:21:48.953 00:21:48.953 ' 00:21:48.953 11:32:44 nvmf_tcp.nvmf_host.nvmf_perf -- common/autotest_common.sh@1695 -- # LCOV='lcov 00:21:48.953 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:21:48.953 --rc genhtml_branch_coverage=1 00:21:48.953 --rc genhtml_function_coverage=1 00:21:48.953 --rc genhtml_legend=1 00:21:48.953 --rc geninfo_all_blocks=1 00:21:48.953 --rc geninfo_unexecuted_blocks=1 00:21:48.953 00:21:48.953 ' 00:21:48.953 11:32:44 nvmf_tcp.nvmf_host.nvmf_perf -- host/perf.sh@10 -- # source /home/vagrant/spdk_repo/spdk/test/nvmf/common.sh 00:21:48.953 11:32:44 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@7 -- # uname -s 00:21:48.953 11:32:44 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:21:48.953 11:32:44 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:21:48.953 11:32:44 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:21:48.953 11:32:44 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:21:48.953 11:32:44 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:21:48.953 11:32:44 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:21:48.953 11:32:44 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:21:48.953 11:32:44 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:21:48.953 11:32:44 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:21:48.953 11:32:44 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:21:48.953 11:32:44 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:c758a4ed-f09f-4c82-9afb-3d096f035464 00:21:48.953 11:32:44 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@18 -- # NVME_HOSTID=c758a4ed-f09f-4c82-9afb-3d096f035464 00:21:48.953 11:32:44 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:21:48.953 11:32:44 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:21:48.953 11:32:44 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@21 -- # NET_TYPE=virt 00:21:48.953 11:32:44 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:21:48.953 11:32:44 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@49 -- # source /home/vagrant/spdk_repo/spdk/scripts/common.sh 00:21:48.953 11:32:44 nvmf_tcp.nvmf_host.nvmf_perf -- scripts/common.sh@15 -- # shopt -s extglob 00:21:48.953 11:32:44 nvmf_tcp.nvmf_host.nvmf_perf -- scripts/common.sh@544 -- # [[ -e /bin/wpdk_common.sh ]] 00:21:48.953 11:32:44 nvmf_tcp.nvmf_host.nvmf_perf -- scripts/common.sh@552 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:21:48.953 11:32:44 nvmf_tcp.nvmf_host.nvmf_perf -- scripts/common.sh@553 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:21:48.953 11:32:44 nvmf_tcp.nvmf_host.nvmf_perf -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:21:48.953 11:32:44 nvmf_tcp.nvmf_host.nvmf_perf -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:21:48.953 11:32:44 nvmf_tcp.nvmf_host.nvmf_perf -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:21:48.953 11:32:44 nvmf_tcp.nvmf_host.nvmf_perf -- paths/export.sh@5 -- # export PATH 00:21:48.953 11:32:44 nvmf_tcp.nvmf_host.nvmf_perf -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:21:48.953 11:32:44 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@51 -- # : 0 00:21:48.953 11:32:44 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@52 -- # export NVMF_APP_SHM_ID 00:21:48.953 11:32:44 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@53 -- # build_nvmf_app_args 00:21:48.953 11:32:44 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:21:48.953 11:32:44 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:21:48.953 11:32:44 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:21:48.953 11:32:44 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@33 -- # '[' '' -eq 1 ']' 00:21:48.953 /home/vagrant/spdk_repo/spdk/test/nvmf/common.sh: line 33: [: : integer expression expected 00:21:48.953 11:32:44 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@37 -- # '[' -n '' ']' 00:21:48.953 11:32:44 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@39 -- # '[' 0 -eq 1 ']' 00:21:48.953 11:32:44 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@55 -- # have_pci_nics=0 00:21:48.953 11:32:44 nvmf_tcp.nvmf_host.nvmf_perf -- host/perf.sh@12 -- # MALLOC_BDEV_SIZE=64 00:21:48.953 11:32:44 nvmf_tcp.nvmf_host.nvmf_perf -- host/perf.sh@13 -- # MALLOC_BLOCK_SIZE=512 00:21:48.953 11:32:44 nvmf_tcp.nvmf_host.nvmf_perf -- host/perf.sh@15 -- # rpc_py=/home/vagrant/spdk_repo/spdk/scripts/rpc.py 00:21:48.953 11:32:44 nvmf_tcp.nvmf_host.nvmf_perf -- host/perf.sh@17 -- # nvmftestinit 00:21:48.953 11:32:44 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@467 -- # '[' -z tcp ']' 00:21:48.953 11:32:44 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@472 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:21:48.953 11:32:44 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@474 -- # prepare_net_devs 00:21:48.953 11:32:44 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@436 -- # local -g is_hw=no 00:21:48.953 11:32:44 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@438 -- # remove_spdk_ns 00:21:48.953 11:32:44 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@654 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:21:48.953 11:32:44 nvmf_tcp.nvmf_host.nvmf_perf -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 15> /dev/null' 00:21:48.953 11:32:44 nvmf_tcp.nvmf_host.nvmf_perf -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:21:48.953 11:32:44 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@440 -- # [[ virt != virt ]] 00:21:48.953 11:32:44 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@442 -- # [[ no == yes ]] 00:21:48.953 11:32:44 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@449 -- # [[ virt == phy ]] 00:21:48.953 11:32:44 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@452 -- # [[ virt == phy-fallback ]] 00:21:48.953 11:32:44 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@457 -- # [[ tcp == tcp ]] 00:21:48.953 11:32:44 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@458 -- # nvmf_veth_init 00:21:48.953 11:32:44 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@145 -- # NVMF_FIRST_INITIATOR_IP=10.0.0.1 00:21:48.953 11:32:44 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@146 -- # NVMF_SECOND_INITIATOR_IP=10.0.0.2 00:21:48.953 11:32:44 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@147 -- # NVMF_FIRST_TARGET_IP=10.0.0.3 00:21:48.953 11:32:44 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@148 -- # NVMF_SECOND_TARGET_IP=10.0.0.4 00:21:48.953 11:32:44 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@149 -- # NVMF_INITIATOR_IP=10.0.0.1 00:21:48.953 11:32:44 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@150 -- # NVMF_BRIDGE=nvmf_br 00:21:48.953 11:32:44 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@151 -- # NVMF_INITIATOR_INTERFACE=nvmf_init_if 00:21:48.953 11:32:44 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@152 -- # NVMF_INITIATOR_INTERFACE2=nvmf_init_if2 00:21:48.953 11:32:44 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@153 -- # NVMF_INITIATOR_BRIDGE=nvmf_init_br 00:21:48.954 11:32:44 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@154 -- # NVMF_INITIATOR_BRIDGE2=nvmf_init_br2 00:21:48.954 11:32:44 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@155 -- # NVMF_TARGET_NAMESPACE=nvmf_tgt_ns_spdk 00:21:48.954 11:32:44 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@156 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:21:48.954 11:32:44 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@157 -- # NVMF_TARGET_INTERFACE=nvmf_tgt_if 00:21:48.954 11:32:44 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@158 -- # NVMF_TARGET_INTERFACE2=nvmf_tgt_if2 00:21:48.954 11:32:44 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@159 -- # NVMF_TARGET_BRIDGE=nvmf_tgt_br 00:21:48.954 11:32:44 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@160 -- # NVMF_TARGET_BRIDGE2=nvmf_tgt_br2 00:21:48.954 11:32:44 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@162 -- # ip link set nvmf_init_br nomaster 00:21:48.954 Cannot find device "nvmf_init_br" 00:21:48.954 11:32:44 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@162 -- # true 00:21:48.954 11:32:44 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@163 -- # ip link set nvmf_init_br2 nomaster 00:21:49.212 Cannot find device "nvmf_init_br2" 00:21:49.212 11:32:44 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@163 -- # true 00:21:49.212 11:32:44 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@164 -- # ip link set nvmf_tgt_br nomaster 00:21:49.212 Cannot find device "nvmf_tgt_br" 00:21:49.212 11:32:44 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@164 -- # true 00:21:49.212 11:32:44 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@165 -- # ip link set nvmf_tgt_br2 nomaster 00:21:49.212 Cannot find device "nvmf_tgt_br2" 00:21:49.212 11:32:44 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@165 -- # true 00:21:49.212 11:32:44 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@166 -- # ip link set nvmf_init_br down 00:21:49.212 Cannot find device "nvmf_init_br" 00:21:49.212 11:32:44 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@166 -- # true 00:21:49.212 11:32:44 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@167 -- # ip link set nvmf_init_br2 down 00:21:49.212 Cannot find device "nvmf_init_br2" 00:21:49.212 11:32:44 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@167 -- # true 00:21:49.212 11:32:44 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@168 -- # ip link set nvmf_tgt_br down 00:21:49.212 Cannot find device "nvmf_tgt_br" 00:21:49.212 11:32:44 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@168 -- # true 00:21:49.212 11:32:44 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@169 -- # ip link set nvmf_tgt_br2 down 00:21:49.212 Cannot find device "nvmf_tgt_br2" 00:21:49.212 11:32:44 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@169 -- # true 00:21:49.212 11:32:44 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@170 -- # ip link delete nvmf_br type bridge 00:21:49.212 Cannot find device "nvmf_br" 00:21:49.212 11:32:44 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@170 -- # true 00:21:49.212 11:32:44 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@171 -- # ip link delete nvmf_init_if 00:21:49.212 Cannot find device "nvmf_init_if" 00:21:49.212 11:32:44 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@171 -- # true 00:21:49.212 11:32:44 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@172 -- # ip link delete nvmf_init_if2 00:21:49.212 Cannot find device "nvmf_init_if2" 00:21:49.212 11:32:44 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@172 -- # true 00:21:49.212 11:32:44 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@173 -- # ip netns exec nvmf_tgt_ns_spdk ip link delete nvmf_tgt_if 00:21:49.212 Cannot open network namespace "nvmf_tgt_ns_spdk": No such file or directory 00:21:49.212 11:32:44 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@173 -- # true 00:21:49.212 11:32:44 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@174 -- # ip netns exec nvmf_tgt_ns_spdk ip link delete nvmf_tgt_if2 00:21:49.212 Cannot open network namespace "nvmf_tgt_ns_spdk": No such file or directory 00:21:49.212 11:32:44 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@174 -- # true 00:21:49.212 11:32:44 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@177 -- # ip netns add nvmf_tgt_ns_spdk 00:21:49.212 11:32:44 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@180 -- # ip link add nvmf_init_if type veth peer name nvmf_init_br 00:21:49.212 11:32:44 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@181 -- # ip link add nvmf_init_if2 type veth peer name nvmf_init_br2 00:21:49.212 11:32:44 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@182 -- # ip link add nvmf_tgt_if type veth peer name nvmf_tgt_br 00:21:49.212 11:32:44 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@183 -- # ip link add nvmf_tgt_if2 type veth peer name nvmf_tgt_br2 00:21:49.212 11:32:44 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@186 -- # ip link set nvmf_tgt_if netns nvmf_tgt_ns_spdk 00:21:49.212 11:32:44 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@187 -- # ip link set nvmf_tgt_if2 netns nvmf_tgt_ns_spdk 00:21:49.212 11:32:44 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@190 -- # ip addr add 10.0.0.1/24 dev nvmf_init_if 00:21:49.212 11:32:44 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@191 -- # ip addr add 10.0.0.2/24 dev nvmf_init_if2 00:21:49.212 11:32:44 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@192 -- # ip netns exec nvmf_tgt_ns_spdk ip addr add 10.0.0.3/24 dev nvmf_tgt_if 00:21:49.212 11:32:44 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@193 -- # ip netns exec nvmf_tgt_ns_spdk ip addr add 10.0.0.4/24 dev nvmf_tgt_if2 00:21:49.212 11:32:44 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@196 -- # ip link set nvmf_init_if up 00:21:49.212 11:32:44 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@197 -- # ip link set nvmf_init_if2 up 00:21:49.212 11:32:44 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@198 -- # ip link set nvmf_init_br up 00:21:49.212 11:32:44 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@199 -- # ip link set nvmf_init_br2 up 00:21:49.212 11:32:44 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@200 -- # ip link set nvmf_tgt_br up 00:21:49.212 11:32:44 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@201 -- # ip link set nvmf_tgt_br2 up 00:21:49.212 11:32:44 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@202 -- # ip netns exec nvmf_tgt_ns_spdk ip link set nvmf_tgt_if up 00:21:49.212 11:32:44 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@203 -- # ip netns exec nvmf_tgt_ns_spdk ip link set nvmf_tgt_if2 up 00:21:49.213 11:32:44 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@204 -- # ip netns exec nvmf_tgt_ns_spdk ip link set lo up 00:21:49.471 11:32:44 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@207 -- # ip link add nvmf_br type bridge 00:21:49.471 11:32:44 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@208 -- # ip link set nvmf_br up 00:21:49.471 11:32:44 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@211 -- # ip link set nvmf_init_br master nvmf_br 00:21:49.471 11:32:44 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@212 -- # ip link set nvmf_init_br2 master nvmf_br 00:21:49.471 11:32:44 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@213 -- # ip link set nvmf_tgt_br master nvmf_br 00:21:49.471 11:32:44 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@214 -- # ip link set nvmf_tgt_br2 master nvmf_br 00:21:49.471 11:32:44 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@217 -- # ipts -I INPUT 1 -i nvmf_init_if -p tcp --dport 4420 -j ACCEPT 00:21:49.471 11:32:44 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@788 -- # iptables -I INPUT 1 -i nvmf_init_if -p tcp --dport 4420 -j ACCEPT -m comment --comment 'SPDK_NVMF:-I INPUT 1 -i nvmf_init_if -p tcp --dport 4420 -j ACCEPT' 00:21:49.471 11:32:44 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@218 -- # ipts -I INPUT 1 -i nvmf_init_if2 -p tcp --dport 4420 -j ACCEPT 00:21:49.471 11:32:44 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@788 -- # iptables -I INPUT 1 -i nvmf_init_if2 -p tcp --dport 4420 -j ACCEPT -m comment --comment 'SPDK_NVMF:-I INPUT 1 -i nvmf_init_if2 -p tcp --dport 4420 -j ACCEPT' 00:21:49.471 11:32:44 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@219 -- # ipts -A FORWARD -i nvmf_br -o nvmf_br -j ACCEPT 00:21:49.471 11:32:44 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@788 -- # iptables -A FORWARD -i nvmf_br -o nvmf_br -j ACCEPT -m comment --comment 'SPDK_NVMF:-A FORWARD -i nvmf_br -o nvmf_br -j ACCEPT' 00:21:49.471 11:32:44 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@222 -- # ping -c 1 10.0.0.3 00:21:49.471 PING 10.0.0.3 (10.0.0.3) 56(84) bytes of data. 00:21:49.471 64 bytes from 10.0.0.3: icmp_seq=1 ttl=64 time=0.081 ms 00:21:49.471 00:21:49.471 --- 10.0.0.3 ping statistics --- 00:21:49.471 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:21:49.471 rtt min/avg/max/mdev = 0.081/0.081/0.081/0.000 ms 00:21:49.471 11:32:44 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@223 -- # ping -c 1 10.0.0.4 00:21:49.471 PING 10.0.0.4 (10.0.0.4) 56(84) bytes of data. 00:21:49.471 64 bytes from 10.0.0.4: icmp_seq=1 ttl=64 time=0.060 ms 00:21:49.471 00:21:49.471 --- 10.0.0.4 ping statistics --- 00:21:49.471 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:21:49.471 rtt min/avg/max/mdev = 0.060/0.060/0.060/0.000 ms 00:21:49.471 11:32:44 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@224 -- # ip netns exec nvmf_tgt_ns_spdk ping -c 1 10.0.0.1 00:21:49.471 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:21:49.471 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.031 ms 00:21:49.471 00:21:49.471 --- 10.0.0.1 ping statistics --- 00:21:49.471 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:21:49.471 rtt min/avg/max/mdev = 0.031/0.031/0.031/0.000 ms 00:21:49.471 11:32:44 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@225 -- # ip netns exec nvmf_tgt_ns_spdk ping -c 1 10.0.0.2 00:21:49.471 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:21:49.471 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.072 ms 00:21:49.471 00:21:49.471 --- 10.0.0.2 ping statistics --- 00:21:49.471 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:21:49.471 rtt min/avg/max/mdev = 0.072/0.072/0.072/0.000 ms 00:21:49.471 11:32:44 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@227 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:21:49.471 11:32:44 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@459 -- # return 0 00:21:49.471 11:32:44 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@476 -- # '[' '' == iso ']' 00:21:49.471 11:32:44 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@480 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:21:49.471 11:32:44 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@481 -- # [[ tcp == \r\d\m\a ]] 00:21:49.471 11:32:44 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@490 -- # [[ tcp == \t\c\p ]] 00:21:49.471 11:32:44 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@491 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:21:49.471 11:32:44 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@494 -- # '[' tcp == tcp ']' 00:21:49.471 11:32:44 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@500 -- # modprobe nvme-tcp 00:21:49.471 11:32:44 nvmf_tcp.nvmf_host.nvmf_perf -- host/perf.sh@18 -- # nvmfappstart -m 0xF 00:21:49.471 11:32:44 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@505 -- # timing_enter start_nvmf_tgt 00:21:49.471 11:32:44 nvmf_tcp.nvmf_host.nvmf_perf -- common/autotest_common.sh@724 -- # xtrace_disable 00:21:49.471 11:32:44 nvmf_tcp.nvmf_host.nvmf_perf -- common/autotest_common.sh@10 -- # set +x 00:21:49.471 11:32:44 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@507 -- # nvmfpid=87982 00:21:49.471 11:32:44 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@506 -- # ip netns exec nvmf_tgt_ns_spdk /home/vagrant/spdk_repo/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:21:49.471 11:32:44 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@508 -- # waitforlisten 87982 00:21:49.471 11:32:44 nvmf_tcp.nvmf_host.nvmf_perf -- common/autotest_common.sh@831 -- # '[' -z 87982 ']' 00:21:49.471 11:32:44 nvmf_tcp.nvmf_host.nvmf_perf -- common/autotest_common.sh@835 -- # local rpc_addr=/var/tmp/spdk.sock 00:21:49.471 11:32:44 nvmf_tcp.nvmf_host.nvmf_perf -- common/autotest_common.sh@836 -- # local max_retries=100 00:21:49.471 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:21:49.471 11:32:44 nvmf_tcp.nvmf_host.nvmf_perf -- common/autotest_common.sh@838 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:21:49.471 11:32:44 nvmf_tcp.nvmf_host.nvmf_perf -- common/autotest_common.sh@840 -- # xtrace_disable 00:21:49.471 11:32:44 nvmf_tcp.nvmf_host.nvmf_perf -- common/autotest_common.sh@10 -- # set +x 00:21:49.471 [2024-10-07 11:32:44.924485] Starting SPDK v25.01-pre git sha1 2a4f56c54 / DPDK 24.03.0 initialization... 00:21:49.471 [2024-10-07 11:32:44.924592] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --iova-mode=pa --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:21:49.730 [2024-10-07 11:32:45.066732] app.c: 917:spdk_app_start: *NOTICE*: Total cores available: 4 00:21:49.730 [2024-10-07 11:32:45.196409] app.c: 610:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:21:49.730 [2024-10-07 11:32:45.196498] app.c: 611:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:21:49.730 [2024-10-07 11:32:45.196510] app.c: 616:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:21:49.730 [2024-10-07 11:32:45.196518] app.c: 617:app_setup_trace: *NOTICE*: SPDK application currently running. 00:21:49.730 [2024-10-07 11:32:45.196525] app.c: 618:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:21:49.730 [2024-10-07 11:32:45.197898] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 1 00:21:49.730 [2024-10-07 11:32:45.197984] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 2 00:21:49.730 [2024-10-07 11:32:45.198064] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 3 00:21:49.730 [2024-10-07 11:32:45.198072] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 0 00:21:50.663 11:32:46 nvmf_tcp.nvmf_host.nvmf_perf -- common/autotest_common.sh@860 -- # (( i == 0 )) 00:21:50.663 11:32:46 nvmf_tcp.nvmf_host.nvmf_perf -- common/autotest_common.sh@864 -- # return 0 00:21:50.663 11:32:46 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@509 -- # timing_exit start_nvmf_tgt 00:21:50.663 11:32:46 nvmf_tcp.nvmf_host.nvmf_perf -- common/autotest_common.sh@730 -- # xtrace_disable 00:21:50.663 11:32:46 nvmf_tcp.nvmf_host.nvmf_perf -- common/autotest_common.sh@10 -- # set +x 00:21:50.663 11:32:46 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@510 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:21:50.663 11:32:46 nvmf_tcp.nvmf_host.nvmf_perf -- host/perf.sh@28 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py load_subsystem_config 00:21:50.663 11:32:46 nvmf_tcp.nvmf_host.nvmf_perf -- host/perf.sh@28 -- # /home/vagrant/spdk_repo/spdk/scripts/gen_nvme.sh 00:21:51.228 11:32:46 nvmf_tcp.nvmf_host.nvmf_perf -- host/perf.sh@30 -- # jq -r '.[].params | select(.name=="Nvme0").traddr' 00:21:51.228 11:32:46 nvmf_tcp.nvmf_host.nvmf_perf -- host/perf.sh@30 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py framework_get_config bdev 00:21:51.486 11:32:46 nvmf_tcp.nvmf_host.nvmf_perf -- host/perf.sh@30 -- # local_nvme_trid=0000:00:10.0 00:21:51.486 11:32:46 nvmf_tcp.nvmf_host.nvmf_perf -- host/perf.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py bdev_malloc_create 64 512 00:21:51.743 11:32:47 nvmf_tcp.nvmf_host.nvmf_perf -- host/perf.sh@31 -- # bdevs=' Malloc0' 00:21:51.744 11:32:47 nvmf_tcp.nvmf_host.nvmf_perf -- host/perf.sh@33 -- # '[' -n 0000:00:10.0 ']' 00:21:51.744 11:32:47 nvmf_tcp.nvmf_host.nvmf_perf -- host/perf.sh@34 -- # bdevs=' Malloc0 Nvme0n1' 00:21:51.744 11:32:47 nvmf_tcp.nvmf_host.nvmf_perf -- host/perf.sh@37 -- # '[' tcp == rdma ']' 00:21:51.744 11:32:47 nvmf_tcp.nvmf_host.nvmf_perf -- host/perf.sh@42 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_create_transport -t tcp -o 00:21:52.002 [2024-10-07 11:32:47.358394] tcp.c: 738:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:21:52.002 11:32:47 nvmf_tcp.nvmf_host.nvmf_perf -- host/perf.sh@44 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:21:52.260 11:32:47 nvmf_tcp.nvmf_host.nvmf_perf -- host/perf.sh@45 -- # for bdev in $bdevs 00:21:52.260 11:32:47 nvmf_tcp.nvmf_host.nvmf_perf -- host/perf.sh@46 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:21:52.517 11:32:48 nvmf_tcp.nvmf_host.nvmf_perf -- host/perf.sh@45 -- # for bdev in $bdevs 00:21:52.517 11:32:48 nvmf_tcp.nvmf_host.nvmf_perf -- host/perf.sh@46 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Nvme0n1 00:21:53.081 11:32:48 nvmf_tcp.nvmf_host.nvmf_perf -- host/perf.sh@48 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.3 -s 4420 00:21:53.081 [2024-10-07 11:32:48.572048] tcp.c:1081:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.3 port 4420 *** 00:21:53.081 11:32:48 nvmf_tcp.nvmf_host.nvmf_perf -- host/perf.sh@49 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.3 -s 4420 00:21:53.647 11:32:48 nvmf_tcp.nvmf_host.nvmf_perf -- host/perf.sh@52 -- # '[' -n 0000:00:10.0 ']' 00:21:53.647 11:32:48 nvmf_tcp.nvmf_host.nvmf_perf -- host/perf.sh@53 -- # perf_app -i 0 -q 32 -o 4096 -w randrw -M 50 -t 1 -r 'trtype:PCIe traddr:0000:00:10.0' 00:21:53.647 11:32:48 nvmf_tcp.nvmf_host.nvmf_perf -- host/perf.sh@21 -- # '[' 0 -eq 1 ']' 00:21:53.647 11:32:48 nvmf_tcp.nvmf_host.nvmf_perf -- host/perf.sh@24 -- # /home/vagrant/spdk_repo/spdk/build/bin/spdk_nvme_perf -i 0 -q 32 -o 4096 -w randrw -M 50 -t 1 -r 'trtype:PCIe traddr:0000:00:10.0' 00:21:54.618 Initializing NVMe Controllers 00:21:54.618 Attached to NVMe Controller at 0000:00:10.0 [1b36:0010] 00:21:54.618 Associating PCIE (0000:00:10.0) NSID 1 with lcore 0 00:21:54.618 Initialization complete. Launching workers. 00:21:54.618 ======================================================== 00:21:54.618 Latency(us) 00:21:54.618 Device Information : IOPS MiB/s Average min max 00:21:54.618 PCIE (0000:00:10.0) NSID 1 from core 0: 24770.69 96.76 1291.76 299.86 7702.49 00:21:54.618 ======================================================== 00:21:54.618 Total : 24770.69 96.76 1291.76 299.86 7702.49 00:21:54.618 00:21:54.618 11:32:50 nvmf_tcp.nvmf_host.nvmf_perf -- host/perf.sh@56 -- # /home/vagrant/spdk_repo/spdk/build/bin/spdk_nvme_perf -q 1 -o 4096 -w randrw -M 50 -t 1 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.3 trsvcid:4420' 00:21:55.990 Initializing NVMe Controllers 00:21:55.990 Attached to NVMe over Fabrics controller at 10.0.0.3:4420: nqn.2016-06.io.spdk:cnode1 00:21:55.990 Associating TCP (addr:10.0.0.3 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:21:55.990 Associating TCP (addr:10.0.0.3 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 with lcore 0 00:21:55.990 Initialization complete. Launching workers. 00:21:55.990 ======================================================== 00:21:55.990 Latency(us) 00:21:55.990 Device Information : IOPS MiB/s Average min max 00:21:55.990 TCP (addr:10.0.0.3 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 3558.91 13.90 280.66 111.70 7196.07 00:21:55.990 TCP (addr:10.0.0.3 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 from core 0: 124.00 0.48 8128.40 5025.62 12019.07 00:21:55.990 ======================================================== 00:21:55.990 Total : 3682.90 14.39 544.88 111.70 12019.07 00:21:55.990 00:21:55.990 11:32:51 nvmf_tcp.nvmf_host.nvmf_perf -- host/perf.sh@57 -- # /home/vagrant/spdk_repo/spdk/build/bin/spdk_nvme_perf -q 32 -o 4096 -w randrw -M 50 -t 1 -HI -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.3 trsvcid:4420' 00:21:57.365 Initializing NVMe Controllers 00:21:57.365 Attached to NVMe over Fabrics controller at 10.0.0.3:4420: nqn.2016-06.io.spdk:cnode1 00:21:57.365 Associating TCP (addr:10.0.0.3 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:21:57.365 Associating TCP (addr:10.0.0.3 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 with lcore 0 00:21:57.365 Initialization complete. Launching workers. 00:21:57.365 ======================================================== 00:21:57.365 Latency(us) 00:21:57.365 Device Information : IOPS MiB/s Average min max 00:21:57.365 TCP (addr:10.0.0.3 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 8449.88 33.01 3787.85 825.06 8340.73 00:21:57.365 TCP (addr:10.0.0.3 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 from core 0: 2693.37 10.52 11975.95 5617.97 23827.81 00:21:57.365 ======================================================== 00:21:57.365 Total : 11143.25 43.53 5766.95 825.06 23827.81 00:21:57.365 00:21:57.365 11:32:52 nvmf_tcp.nvmf_host.nvmf_perf -- host/perf.sh@59 -- # [[ '' == \e\8\1\0 ]] 00:21:57.365 11:32:52 nvmf_tcp.nvmf_host.nvmf_perf -- host/perf.sh@60 -- # /home/vagrant/spdk_repo/spdk/build/bin/spdk_nvme_perf -q 128 -o 262144 -O 16384 -w randrw -M 50 -t 2 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.3 trsvcid:4420' 00:21:59.949 Initializing NVMe Controllers 00:21:59.949 Attached to NVMe over Fabrics controller at 10.0.0.3:4420: nqn.2016-06.io.spdk:cnode1 00:21:59.949 Controller IO queue size 128, less than required. 00:21:59.949 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:21:59.949 Controller IO queue size 128, less than required. 00:21:59.949 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:21:59.949 Associating TCP (addr:10.0.0.3 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:21:59.949 Associating TCP (addr:10.0.0.3 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 with lcore 0 00:21:59.949 Initialization complete. Launching workers. 00:21:59.949 ======================================================== 00:21:59.949 Latency(us) 00:21:59.949 Device Information : IOPS MiB/s Average min max 00:21:59.949 TCP (addr:10.0.0.3 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 1297.87 324.47 101485.36 53900.08 207581.95 00:21:59.949 TCP (addr:10.0.0.3 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 from core 0: 540.69 135.17 245220.72 117023.77 459019.01 00:21:59.949 ======================================================== 00:21:59.949 Total : 1838.56 459.64 143755.88 53900.08 459019.01 00:21:59.949 00:21:59.949 11:32:55 nvmf_tcp.nvmf_host.nvmf_perf -- host/perf.sh@64 -- # /home/vagrant/spdk_repo/spdk/build/bin/spdk_nvme_perf -q 128 -o 36964 -O 4096 -w randrw -M 50 -t 5 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.3 trsvcid:4420' -c 0xf -P 4 00:21:59.949 Initializing NVMe Controllers 00:21:59.949 Attached to NVMe over Fabrics controller at 10.0.0.3:4420: nqn.2016-06.io.spdk:cnode1 00:21:59.949 Controller IO queue size 128, less than required. 00:21:59.949 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:21:59.949 WARNING: IO size 36964 (-o) is not a multiple of nsid 1 sector size 512. Removing this ns from test 00:21:59.949 Controller IO queue size 128, less than required. 00:21:59.949 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:21:59.949 WARNING: IO size 36964 (-o) is not a multiple of nsid 2 sector size 4096. Removing this ns from test 00:21:59.949 WARNING: Some requested NVMe devices were skipped 00:21:59.949 No valid NVMe controllers or AIO or URING devices found 00:21:59.949 11:32:55 nvmf_tcp.nvmf_host.nvmf_perf -- host/perf.sh@65 -- # /home/vagrant/spdk_repo/spdk/build/bin/spdk_nvme_perf -q 128 -o 262144 -w randrw -M 50 -t 2 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.3 trsvcid:4420' --transport-stat 00:22:02.477 Initializing NVMe Controllers 00:22:02.477 Attached to NVMe over Fabrics controller at 10.0.0.3:4420: nqn.2016-06.io.spdk:cnode1 00:22:02.477 Controller IO queue size 128, less than required. 00:22:02.477 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:22:02.477 Controller IO queue size 128, less than required. 00:22:02.477 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:22:02.477 Associating TCP (addr:10.0.0.3 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:22:02.477 Associating TCP (addr:10.0.0.3 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 with lcore 0 00:22:02.477 Initialization complete. Launching workers. 00:22:02.477 00:22:02.477 ==================== 00:22:02.478 lcore 0, ns TCP (addr:10.0.0.3 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 statistics: 00:22:02.478 TCP transport: 00:22:02.478 polls: 7242 00:22:02.478 idle_polls: 4573 00:22:02.478 sock_completions: 2669 00:22:02.478 nvme_completions: 5399 00:22:02.478 submitted_requests: 8136 00:22:02.478 queued_requests: 1 00:22:02.478 00:22:02.478 ==================== 00:22:02.478 lcore 0, ns TCP (addr:10.0.0.3 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 statistics: 00:22:02.478 TCP transport: 00:22:02.478 polls: 7472 00:22:02.478 idle_polls: 4643 00:22:02.478 sock_completions: 2829 00:22:02.478 nvme_completions: 5719 00:22:02.478 submitted_requests: 8614 00:22:02.478 queued_requests: 1 00:22:02.478 ======================================================== 00:22:02.478 Latency(us) 00:22:02.478 Device Information : IOPS MiB/s Average min max 00:22:02.478 TCP (addr:10.0.0.3 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 1346.40 336.60 98190.17 54200.00 172768.27 00:22:02.478 TCP (addr:10.0.0.3 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 from core 0: 1426.22 356.55 90393.44 55755.73 128807.19 00:22:02.478 ======================================================== 00:22:02.478 Total : 2772.62 693.15 94179.58 54200.00 172768.27 00:22:02.478 00:22:02.478 11:32:57 nvmf_tcp.nvmf_host.nvmf_perf -- host/perf.sh@66 -- # sync 00:22:02.736 11:32:58 nvmf_tcp.nvmf_host.nvmf_perf -- host/perf.sh@67 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:22:03.300 11:32:58 nvmf_tcp.nvmf_host.nvmf_perf -- host/perf.sh@69 -- # '[' 0 -eq 1 ']' 00:22:03.300 11:32:58 nvmf_tcp.nvmf_host.nvmf_perf -- host/perf.sh@112 -- # trap - SIGINT SIGTERM EXIT 00:22:03.300 11:32:58 nvmf_tcp.nvmf_host.nvmf_perf -- host/perf.sh@114 -- # nvmftestfini 00:22:03.300 11:32:58 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@514 -- # nvmfcleanup 00:22:03.300 11:32:58 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@121 -- # sync 00:22:03.301 11:32:58 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@123 -- # '[' tcp == tcp ']' 00:22:03.301 11:32:58 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@124 -- # set +e 00:22:03.301 11:32:58 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@125 -- # for i in {1..20} 00:22:03.301 11:32:58 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@126 -- # modprobe -v -r nvme-tcp 00:22:03.301 rmmod nvme_tcp 00:22:03.301 rmmod nvme_fabrics 00:22:03.301 rmmod nvme_keyring 00:22:03.301 11:32:58 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@127 -- # modprobe -v -r nvme-fabrics 00:22:03.301 11:32:58 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@128 -- # set -e 00:22:03.301 11:32:58 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@129 -- # return 0 00:22:03.301 11:32:58 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@515 -- # '[' -n 87982 ']' 00:22:03.301 11:32:58 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@516 -- # killprocess 87982 00:22:03.301 11:32:58 nvmf_tcp.nvmf_host.nvmf_perf -- common/autotest_common.sh@950 -- # '[' -z 87982 ']' 00:22:03.301 11:32:58 nvmf_tcp.nvmf_host.nvmf_perf -- common/autotest_common.sh@954 -- # kill -0 87982 00:22:03.301 11:32:58 nvmf_tcp.nvmf_host.nvmf_perf -- common/autotest_common.sh@955 -- # uname 00:22:03.301 11:32:58 nvmf_tcp.nvmf_host.nvmf_perf -- common/autotest_common.sh@955 -- # '[' Linux = Linux ']' 00:22:03.301 11:32:58 nvmf_tcp.nvmf_host.nvmf_perf -- common/autotest_common.sh@956 -- # ps --no-headers -o comm= 87982 00:22:03.301 11:32:58 nvmf_tcp.nvmf_host.nvmf_perf -- common/autotest_common.sh@956 -- # process_name=reactor_0 00:22:03.301 11:32:58 nvmf_tcp.nvmf_host.nvmf_perf -- common/autotest_common.sh@960 -- # '[' reactor_0 = sudo ']' 00:22:03.301 11:32:58 nvmf_tcp.nvmf_host.nvmf_perf -- common/autotest_common.sh@968 -- # echo 'killing process with pid 87982' 00:22:03.301 killing process with pid 87982 00:22:03.301 11:32:58 nvmf_tcp.nvmf_host.nvmf_perf -- common/autotest_common.sh@969 -- # kill 87982 00:22:03.301 11:32:58 nvmf_tcp.nvmf_host.nvmf_perf -- common/autotest_common.sh@974 -- # wait 87982 00:22:05.827 11:33:01 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@518 -- # '[' '' == iso ']' 00:22:05.827 11:33:01 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@521 -- # [[ tcp == \t\c\p ]] 00:22:05.827 11:33:01 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@522 -- # nvmf_tcp_fini 00:22:05.827 11:33:01 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@297 -- # iptr 00:22:05.827 11:33:01 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@789 -- # iptables-save 00:22:05.827 11:33:01 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@789 -- # grep -v SPDK_NVMF 00:22:05.827 11:33:01 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@789 -- # iptables-restore 00:22:05.827 11:33:01 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@298 -- # [[ nvmf_tgt_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s\_\s\p\d\k ]] 00:22:05.827 11:33:01 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@299 -- # nvmf_veth_fini 00:22:05.827 11:33:01 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@233 -- # ip link set nvmf_init_br nomaster 00:22:05.827 11:33:01 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@234 -- # ip link set nvmf_init_br2 nomaster 00:22:05.827 11:33:01 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@235 -- # ip link set nvmf_tgt_br nomaster 00:22:05.827 11:33:01 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@236 -- # ip link set nvmf_tgt_br2 nomaster 00:22:05.827 11:33:01 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@237 -- # ip link set nvmf_init_br down 00:22:05.827 11:33:01 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@238 -- # ip link set nvmf_init_br2 down 00:22:05.827 11:33:01 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@239 -- # ip link set nvmf_tgt_br down 00:22:05.827 11:33:01 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@240 -- # ip link set nvmf_tgt_br2 down 00:22:05.827 11:33:01 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@241 -- # ip link delete nvmf_br type bridge 00:22:05.827 11:33:01 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@242 -- # ip link delete nvmf_init_if 00:22:05.827 11:33:01 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@243 -- # ip link delete nvmf_init_if2 00:22:05.827 11:33:01 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@244 -- # ip netns exec nvmf_tgt_ns_spdk ip link delete nvmf_tgt_if 00:22:05.827 11:33:01 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@245 -- # ip netns exec nvmf_tgt_ns_spdk ip link delete nvmf_tgt_if2 00:22:05.827 11:33:01 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@246 -- # remove_spdk_ns 00:22:05.827 11:33:01 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@654 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:22:05.827 11:33:01 nvmf_tcp.nvmf_host.nvmf_perf -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 15> /dev/null' 00:22:05.827 11:33:01 nvmf_tcp.nvmf_host.nvmf_perf -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:22:05.827 11:33:01 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@300 -- # return 0 00:22:05.827 00:22:05.827 real 0m17.101s 00:22:05.827 user 1m2.880s 00:22:05.827 sys 0m3.761s 00:22:05.827 11:33:01 nvmf_tcp.nvmf_host.nvmf_perf -- common/autotest_common.sh@1126 -- # xtrace_disable 00:22:05.827 11:33:01 nvmf_tcp.nvmf_host.nvmf_perf -- common/autotest_common.sh@10 -- # set +x 00:22:05.827 ************************************ 00:22:05.827 END TEST nvmf_perf 00:22:05.827 ************************************ 00:22:06.085 11:33:01 nvmf_tcp.nvmf_host -- nvmf/nvmf_host.sh@24 -- # run_test nvmf_fio_host /home/vagrant/spdk_repo/spdk/test/nvmf/host/fio.sh --transport=tcp 00:22:06.085 11:33:01 nvmf_tcp.nvmf_host -- common/autotest_common.sh@1101 -- # '[' 3 -le 1 ']' 00:22:06.085 11:33:01 nvmf_tcp.nvmf_host -- common/autotest_common.sh@1107 -- # xtrace_disable 00:22:06.085 11:33:01 nvmf_tcp.nvmf_host -- common/autotest_common.sh@10 -- # set +x 00:22:06.085 ************************************ 00:22:06.085 START TEST nvmf_fio_host 00:22:06.085 ************************************ 00:22:06.085 11:33:01 nvmf_tcp.nvmf_host.nvmf_fio_host -- common/autotest_common.sh@1125 -- # /home/vagrant/spdk_repo/spdk/test/nvmf/host/fio.sh --transport=tcp 00:22:06.085 * Looking for test storage... 00:22:06.085 * Found test storage at /home/vagrant/spdk_repo/spdk/test/nvmf/host 00:22:06.085 11:33:01 nvmf_tcp.nvmf_host.nvmf_fio_host -- common/autotest_common.sh@1680 -- # [[ y == y ]] 00:22:06.085 11:33:01 nvmf_tcp.nvmf_host.nvmf_fio_host -- common/autotest_common.sh@1681 -- # lcov --version 00:22:06.085 11:33:01 nvmf_tcp.nvmf_host.nvmf_fio_host -- common/autotest_common.sh@1681 -- # awk '{print $NF}' 00:22:06.085 11:33:01 nvmf_tcp.nvmf_host.nvmf_fio_host -- common/autotest_common.sh@1681 -- # lt 1.15 2 00:22:06.086 11:33:01 nvmf_tcp.nvmf_host.nvmf_fio_host -- scripts/common.sh@373 -- # cmp_versions 1.15 '<' 2 00:22:06.086 11:33:01 nvmf_tcp.nvmf_host.nvmf_fio_host -- scripts/common.sh@333 -- # local ver1 ver1_l 00:22:06.086 11:33:01 nvmf_tcp.nvmf_host.nvmf_fio_host -- scripts/common.sh@334 -- # local ver2 ver2_l 00:22:06.086 11:33:01 nvmf_tcp.nvmf_host.nvmf_fio_host -- scripts/common.sh@336 -- # IFS=.-: 00:22:06.086 11:33:01 nvmf_tcp.nvmf_host.nvmf_fio_host -- scripts/common.sh@336 -- # read -ra ver1 00:22:06.086 11:33:01 nvmf_tcp.nvmf_host.nvmf_fio_host -- scripts/common.sh@337 -- # IFS=.-: 00:22:06.086 11:33:01 nvmf_tcp.nvmf_host.nvmf_fio_host -- scripts/common.sh@337 -- # read -ra ver2 00:22:06.086 11:33:01 nvmf_tcp.nvmf_host.nvmf_fio_host -- scripts/common.sh@338 -- # local 'op=<' 00:22:06.086 11:33:01 nvmf_tcp.nvmf_host.nvmf_fio_host -- scripts/common.sh@340 -- # ver1_l=2 00:22:06.086 11:33:01 nvmf_tcp.nvmf_host.nvmf_fio_host -- scripts/common.sh@341 -- # ver2_l=1 00:22:06.086 11:33:01 nvmf_tcp.nvmf_host.nvmf_fio_host -- scripts/common.sh@343 -- # local lt=0 gt=0 eq=0 v 00:22:06.086 11:33:01 nvmf_tcp.nvmf_host.nvmf_fio_host -- scripts/common.sh@344 -- # case "$op" in 00:22:06.086 11:33:01 nvmf_tcp.nvmf_host.nvmf_fio_host -- scripts/common.sh@345 -- # : 1 00:22:06.086 11:33:01 nvmf_tcp.nvmf_host.nvmf_fio_host -- scripts/common.sh@364 -- # (( v = 0 )) 00:22:06.086 11:33:01 nvmf_tcp.nvmf_host.nvmf_fio_host -- scripts/common.sh@364 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:22:06.086 11:33:01 nvmf_tcp.nvmf_host.nvmf_fio_host -- scripts/common.sh@365 -- # decimal 1 00:22:06.086 11:33:01 nvmf_tcp.nvmf_host.nvmf_fio_host -- scripts/common.sh@353 -- # local d=1 00:22:06.086 11:33:01 nvmf_tcp.nvmf_host.nvmf_fio_host -- scripts/common.sh@354 -- # [[ 1 =~ ^[0-9]+$ ]] 00:22:06.086 11:33:01 nvmf_tcp.nvmf_host.nvmf_fio_host -- scripts/common.sh@355 -- # echo 1 00:22:06.086 11:33:01 nvmf_tcp.nvmf_host.nvmf_fio_host -- scripts/common.sh@365 -- # ver1[v]=1 00:22:06.086 11:33:01 nvmf_tcp.nvmf_host.nvmf_fio_host -- scripts/common.sh@366 -- # decimal 2 00:22:06.086 11:33:01 nvmf_tcp.nvmf_host.nvmf_fio_host -- scripts/common.sh@353 -- # local d=2 00:22:06.086 11:33:01 nvmf_tcp.nvmf_host.nvmf_fio_host -- scripts/common.sh@354 -- # [[ 2 =~ ^[0-9]+$ ]] 00:22:06.086 11:33:01 nvmf_tcp.nvmf_host.nvmf_fio_host -- scripts/common.sh@355 -- # echo 2 00:22:06.086 11:33:01 nvmf_tcp.nvmf_host.nvmf_fio_host -- scripts/common.sh@366 -- # ver2[v]=2 00:22:06.086 11:33:01 nvmf_tcp.nvmf_host.nvmf_fio_host -- scripts/common.sh@367 -- # (( ver1[v] > ver2[v] )) 00:22:06.086 11:33:01 nvmf_tcp.nvmf_host.nvmf_fio_host -- scripts/common.sh@368 -- # (( ver1[v] < ver2[v] )) 00:22:06.086 11:33:01 nvmf_tcp.nvmf_host.nvmf_fio_host -- scripts/common.sh@368 -- # return 0 00:22:06.086 11:33:01 nvmf_tcp.nvmf_host.nvmf_fio_host -- common/autotest_common.sh@1682 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:22:06.086 11:33:01 nvmf_tcp.nvmf_host.nvmf_fio_host -- common/autotest_common.sh@1694 -- # export 'LCOV_OPTS= 00:22:06.086 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:22:06.086 --rc genhtml_branch_coverage=1 00:22:06.086 --rc genhtml_function_coverage=1 00:22:06.086 --rc genhtml_legend=1 00:22:06.086 --rc geninfo_all_blocks=1 00:22:06.086 --rc geninfo_unexecuted_blocks=1 00:22:06.086 00:22:06.086 ' 00:22:06.086 11:33:01 nvmf_tcp.nvmf_host.nvmf_fio_host -- common/autotest_common.sh@1694 -- # LCOV_OPTS=' 00:22:06.086 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:22:06.086 --rc genhtml_branch_coverage=1 00:22:06.086 --rc genhtml_function_coverage=1 00:22:06.086 --rc genhtml_legend=1 00:22:06.086 --rc geninfo_all_blocks=1 00:22:06.086 --rc geninfo_unexecuted_blocks=1 00:22:06.086 00:22:06.086 ' 00:22:06.086 11:33:01 nvmf_tcp.nvmf_host.nvmf_fio_host -- common/autotest_common.sh@1695 -- # export 'LCOV=lcov 00:22:06.086 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:22:06.086 --rc genhtml_branch_coverage=1 00:22:06.086 --rc genhtml_function_coverage=1 00:22:06.086 --rc genhtml_legend=1 00:22:06.086 --rc geninfo_all_blocks=1 00:22:06.086 --rc geninfo_unexecuted_blocks=1 00:22:06.086 00:22:06.086 ' 00:22:06.086 11:33:01 nvmf_tcp.nvmf_host.nvmf_fio_host -- common/autotest_common.sh@1695 -- # LCOV='lcov 00:22:06.086 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:22:06.086 --rc genhtml_branch_coverage=1 00:22:06.086 --rc genhtml_function_coverage=1 00:22:06.086 --rc genhtml_legend=1 00:22:06.086 --rc geninfo_all_blocks=1 00:22:06.086 --rc geninfo_unexecuted_blocks=1 00:22:06.086 00:22:06.086 ' 00:22:06.086 11:33:01 nvmf_tcp.nvmf_host.nvmf_fio_host -- host/fio.sh@9 -- # source /home/vagrant/spdk_repo/spdk/scripts/common.sh 00:22:06.086 11:33:01 nvmf_tcp.nvmf_host.nvmf_fio_host -- scripts/common.sh@15 -- # shopt -s extglob 00:22:06.086 11:33:01 nvmf_tcp.nvmf_host.nvmf_fio_host -- scripts/common.sh@544 -- # [[ -e /bin/wpdk_common.sh ]] 00:22:06.086 11:33:01 nvmf_tcp.nvmf_host.nvmf_fio_host -- scripts/common.sh@552 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:22:06.086 11:33:01 nvmf_tcp.nvmf_host.nvmf_fio_host -- scripts/common.sh@553 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:22:06.086 11:33:01 nvmf_tcp.nvmf_host.nvmf_fio_host -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:22:06.086 11:33:01 nvmf_tcp.nvmf_host.nvmf_fio_host -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:22:06.086 11:33:01 nvmf_tcp.nvmf_host.nvmf_fio_host -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:22:06.086 11:33:01 nvmf_tcp.nvmf_host.nvmf_fio_host -- paths/export.sh@5 -- # export PATH 00:22:06.086 11:33:01 nvmf_tcp.nvmf_host.nvmf_fio_host -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:22:06.086 11:33:01 nvmf_tcp.nvmf_host.nvmf_fio_host -- host/fio.sh@10 -- # source /home/vagrant/spdk_repo/spdk/test/nvmf/common.sh 00:22:06.086 11:33:01 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@7 -- # uname -s 00:22:06.086 11:33:01 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:22:06.086 11:33:01 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:22:06.086 11:33:01 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:22:06.086 11:33:01 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:22:06.086 11:33:01 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:22:06.086 11:33:01 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:22:06.086 11:33:01 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:22:06.086 11:33:01 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:22:06.086 11:33:01 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:22:06.086 11:33:01 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:22:06.086 11:33:01 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:c758a4ed-f09f-4c82-9afb-3d096f035464 00:22:06.086 11:33:01 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@18 -- # NVME_HOSTID=c758a4ed-f09f-4c82-9afb-3d096f035464 00:22:06.344 11:33:01 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:22:06.344 11:33:01 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:22:06.344 11:33:01 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@21 -- # NET_TYPE=virt 00:22:06.344 11:33:01 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:22:06.344 11:33:01 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@49 -- # source /home/vagrant/spdk_repo/spdk/scripts/common.sh 00:22:06.344 11:33:01 nvmf_tcp.nvmf_host.nvmf_fio_host -- scripts/common.sh@15 -- # shopt -s extglob 00:22:06.344 11:33:01 nvmf_tcp.nvmf_host.nvmf_fio_host -- scripts/common.sh@544 -- # [[ -e /bin/wpdk_common.sh ]] 00:22:06.344 11:33:01 nvmf_tcp.nvmf_host.nvmf_fio_host -- scripts/common.sh@552 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:22:06.344 11:33:01 nvmf_tcp.nvmf_host.nvmf_fio_host -- scripts/common.sh@553 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:22:06.344 11:33:01 nvmf_tcp.nvmf_host.nvmf_fio_host -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:22:06.345 11:33:01 nvmf_tcp.nvmf_host.nvmf_fio_host -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:22:06.345 11:33:01 nvmf_tcp.nvmf_host.nvmf_fio_host -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:22:06.345 11:33:01 nvmf_tcp.nvmf_host.nvmf_fio_host -- paths/export.sh@5 -- # export PATH 00:22:06.345 11:33:01 nvmf_tcp.nvmf_host.nvmf_fio_host -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:22:06.345 11:33:01 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@51 -- # : 0 00:22:06.345 11:33:01 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@52 -- # export NVMF_APP_SHM_ID 00:22:06.345 11:33:01 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@53 -- # build_nvmf_app_args 00:22:06.345 11:33:01 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:22:06.345 11:33:01 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:22:06.345 11:33:01 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:22:06.345 11:33:01 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@33 -- # '[' '' -eq 1 ']' 00:22:06.345 /home/vagrant/spdk_repo/spdk/test/nvmf/common.sh: line 33: [: : integer expression expected 00:22:06.345 11:33:01 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@37 -- # '[' -n '' ']' 00:22:06.345 11:33:01 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@39 -- # '[' 0 -eq 1 ']' 00:22:06.345 11:33:01 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@55 -- # have_pci_nics=0 00:22:06.345 11:33:01 nvmf_tcp.nvmf_host.nvmf_fio_host -- host/fio.sh@12 -- # rpc_py=/home/vagrant/spdk_repo/spdk/scripts/rpc.py 00:22:06.345 11:33:01 nvmf_tcp.nvmf_host.nvmf_fio_host -- host/fio.sh@14 -- # nvmftestinit 00:22:06.345 11:33:01 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@467 -- # '[' -z tcp ']' 00:22:06.345 11:33:01 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@472 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:22:06.345 11:33:01 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@474 -- # prepare_net_devs 00:22:06.345 11:33:01 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@436 -- # local -g is_hw=no 00:22:06.345 11:33:01 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@438 -- # remove_spdk_ns 00:22:06.345 11:33:01 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@654 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:22:06.345 11:33:01 nvmf_tcp.nvmf_host.nvmf_fio_host -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 15> /dev/null' 00:22:06.345 11:33:01 nvmf_tcp.nvmf_host.nvmf_fio_host -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:22:06.345 11:33:01 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@440 -- # [[ virt != virt ]] 00:22:06.345 11:33:01 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@442 -- # [[ no == yes ]] 00:22:06.345 11:33:01 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@449 -- # [[ virt == phy ]] 00:22:06.345 11:33:01 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@452 -- # [[ virt == phy-fallback ]] 00:22:06.345 11:33:01 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@457 -- # [[ tcp == tcp ]] 00:22:06.345 11:33:01 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@458 -- # nvmf_veth_init 00:22:06.345 11:33:01 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@145 -- # NVMF_FIRST_INITIATOR_IP=10.0.0.1 00:22:06.345 11:33:01 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@146 -- # NVMF_SECOND_INITIATOR_IP=10.0.0.2 00:22:06.345 11:33:01 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@147 -- # NVMF_FIRST_TARGET_IP=10.0.0.3 00:22:06.345 11:33:01 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@148 -- # NVMF_SECOND_TARGET_IP=10.0.0.4 00:22:06.345 11:33:01 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@149 -- # NVMF_INITIATOR_IP=10.0.0.1 00:22:06.345 11:33:01 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@150 -- # NVMF_BRIDGE=nvmf_br 00:22:06.345 11:33:01 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@151 -- # NVMF_INITIATOR_INTERFACE=nvmf_init_if 00:22:06.345 11:33:01 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@152 -- # NVMF_INITIATOR_INTERFACE2=nvmf_init_if2 00:22:06.345 11:33:01 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@153 -- # NVMF_INITIATOR_BRIDGE=nvmf_init_br 00:22:06.345 11:33:01 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@154 -- # NVMF_INITIATOR_BRIDGE2=nvmf_init_br2 00:22:06.345 11:33:01 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@155 -- # NVMF_TARGET_NAMESPACE=nvmf_tgt_ns_spdk 00:22:06.345 11:33:01 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@156 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:22:06.345 11:33:01 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@157 -- # NVMF_TARGET_INTERFACE=nvmf_tgt_if 00:22:06.345 11:33:01 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@158 -- # NVMF_TARGET_INTERFACE2=nvmf_tgt_if2 00:22:06.345 11:33:01 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@159 -- # NVMF_TARGET_BRIDGE=nvmf_tgt_br 00:22:06.345 11:33:01 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@160 -- # NVMF_TARGET_BRIDGE2=nvmf_tgt_br2 00:22:06.345 11:33:01 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@162 -- # ip link set nvmf_init_br nomaster 00:22:06.345 Cannot find device "nvmf_init_br" 00:22:06.345 11:33:01 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@162 -- # true 00:22:06.345 11:33:01 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@163 -- # ip link set nvmf_init_br2 nomaster 00:22:06.345 Cannot find device "nvmf_init_br2" 00:22:06.345 11:33:01 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@163 -- # true 00:22:06.345 11:33:01 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@164 -- # ip link set nvmf_tgt_br nomaster 00:22:06.345 Cannot find device "nvmf_tgt_br" 00:22:06.345 11:33:01 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@164 -- # true 00:22:06.345 11:33:01 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@165 -- # ip link set nvmf_tgt_br2 nomaster 00:22:06.345 Cannot find device "nvmf_tgt_br2" 00:22:06.345 11:33:01 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@165 -- # true 00:22:06.345 11:33:01 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@166 -- # ip link set nvmf_init_br down 00:22:06.345 Cannot find device "nvmf_init_br" 00:22:06.345 11:33:01 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@166 -- # true 00:22:06.345 11:33:01 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@167 -- # ip link set nvmf_init_br2 down 00:22:06.345 Cannot find device "nvmf_init_br2" 00:22:06.345 11:33:01 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@167 -- # true 00:22:06.345 11:33:01 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@168 -- # ip link set nvmf_tgt_br down 00:22:06.345 Cannot find device "nvmf_tgt_br" 00:22:06.345 11:33:01 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@168 -- # true 00:22:06.345 11:33:01 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@169 -- # ip link set nvmf_tgt_br2 down 00:22:06.345 Cannot find device "nvmf_tgt_br2" 00:22:06.345 11:33:01 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@169 -- # true 00:22:06.345 11:33:01 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@170 -- # ip link delete nvmf_br type bridge 00:22:06.345 Cannot find device "nvmf_br" 00:22:06.345 11:33:01 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@170 -- # true 00:22:06.345 11:33:01 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@171 -- # ip link delete nvmf_init_if 00:22:06.345 Cannot find device "nvmf_init_if" 00:22:06.345 11:33:01 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@171 -- # true 00:22:06.345 11:33:01 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@172 -- # ip link delete nvmf_init_if2 00:22:06.345 Cannot find device "nvmf_init_if2" 00:22:06.345 11:33:01 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@172 -- # true 00:22:06.345 11:33:01 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@173 -- # ip netns exec nvmf_tgt_ns_spdk ip link delete nvmf_tgt_if 00:22:06.345 Cannot open network namespace "nvmf_tgt_ns_spdk": No such file or directory 00:22:06.345 11:33:01 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@173 -- # true 00:22:06.345 11:33:01 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@174 -- # ip netns exec nvmf_tgt_ns_spdk ip link delete nvmf_tgt_if2 00:22:06.345 Cannot open network namespace "nvmf_tgt_ns_spdk": No such file or directory 00:22:06.345 11:33:01 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@174 -- # true 00:22:06.345 11:33:01 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@177 -- # ip netns add nvmf_tgt_ns_spdk 00:22:06.345 11:33:01 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@180 -- # ip link add nvmf_init_if type veth peer name nvmf_init_br 00:22:06.345 11:33:01 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@181 -- # ip link add nvmf_init_if2 type veth peer name nvmf_init_br2 00:22:06.345 11:33:01 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@182 -- # ip link add nvmf_tgt_if type veth peer name nvmf_tgt_br 00:22:06.345 11:33:01 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@183 -- # ip link add nvmf_tgt_if2 type veth peer name nvmf_tgt_br2 00:22:06.345 11:33:01 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@186 -- # ip link set nvmf_tgt_if netns nvmf_tgt_ns_spdk 00:22:06.345 11:33:01 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@187 -- # ip link set nvmf_tgt_if2 netns nvmf_tgt_ns_spdk 00:22:06.604 11:33:01 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@190 -- # ip addr add 10.0.0.1/24 dev nvmf_init_if 00:22:06.604 11:33:01 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@191 -- # ip addr add 10.0.0.2/24 dev nvmf_init_if2 00:22:06.604 11:33:01 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@192 -- # ip netns exec nvmf_tgt_ns_spdk ip addr add 10.0.0.3/24 dev nvmf_tgt_if 00:22:06.604 11:33:01 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@193 -- # ip netns exec nvmf_tgt_ns_spdk ip addr add 10.0.0.4/24 dev nvmf_tgt_if2 00:22:06.604 11:33:01 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@196 -- # ip link set nvmf_init_if up 00:22:06.604 11:33:01 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@197 -- # ip link set nvmf_init_if2 up 00:22:06.604 11:33:01 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@198 -- # ip link set nvmf_init_br up 00:22:06.604 11:33:01 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@199 -- # ip link set nvmf_init_br2 up 00:22:06.604 11:33:01 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@200 -- # ip link set nvmf_tgt_br up 00:22:06.604 11:33:01 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@201 -- # ip link set nvmf_tgt_br2 up 00:22:06.604 11:33:01 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@202 -- # ip netns exec nvmf_tgt_ns_spdk ip link set nvmf_tgt_if up 00:22:06.604 11:33:01 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@203 -- # ip netns exec nvmf_tgt_ns_spdk ip link set nvmf_tgt_if2 up 00:22:06.604 11:33:01 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@204 -- # ip netns exec nvmf_tgt_ns_spdk ip link set lo up 00:22:06.604 11:33:01 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@207 -- # ip link add nvmf_br type bridge 00:22:06.604 11:33:01 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@208 -- # ip link set nvmf_br up 00:22:06.604 11:33:01 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@211 -- # ip link set nvmf_init_br master nvmf_br 00:22:06.604 11:33:01 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@212 -- # ip link set nvmf_init_br2 master nvmf_br 00:22:06.604 11:33:01 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@213 -- # ip link set nvmf_tgt_br master nvmf_br 00:22:06.604 11:33:01 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@214 -- # ip link set nvmf_tgt_br2 master nvmf_br 00:22:06.604 11:33:02 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@217 -- # ipts -I INPUT 1 -i nvmf_init_if -p tcp --dport 4420 -j ACCEPT 00:22:06.604 11:33:02 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@788 -- # iptables -I INPUT 1 -i nvmf_init_if -p tcp --dport 4420 -j ACCEPT -m comment --comment 'SPDK_NVMF:-I INPUT 1 -i nvmf_init_if -p tcp --dport 4420 -j ACCEPT' 00:22:06.604 11:33:02 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@218 -- # ipts -I INPUT 1 -i nvmf_init_if2 -p tcp --dport 4420 -j ACCEPT 00:22:06.604 11:33:02 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@788 -- # iptables -I INPUT 1 -i nvmf_init_if2 -p tcp --dport 4420 -j ACCEPT -m comment --comment 'SPDK_NVMF:-I INPUT 1 -i nvmf_init_if2 -p tcp --dport 4420 -j ACCEPT' 00:22:06.604 11:33:02 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@219 -- # ipts -A FORWARD -i nvmf_br -o nvmf_br -j ACCEPT 00:22:06.604 11:33:02 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@788 -- # iptables -A FORWARD -i nvmf_br -o nvmf_br -j ACCEPT -m comment --comment 'SPDK_NVMF:-A FORWARD -i nvmf_br -o nvmf_br -j ACCEPT' 00:22:06.604 11:33:02 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@222 -- # ping -c 1 10.0.0.3 00:22:06.604 PING 10.0.0.3 (10.0.0.3) 56(84) bytes of data. 00:22:06.604 64 bytes from 10.0.0.3: icmp_seq=1 ttl=64 time=0.051 ms 00:22:06.604 00:22:06.604 --- 10.0.0.3 ping statistics --- 00:22:06.604 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:22:06.604 rtt min/avg/max/mdev = 0.051/0.051/0.051/0.000 ms 00:22:06.604 11:33:02 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@223 -- # ping -c 1 10.0.0.4 00:22:06.604 PING 10.0.0.4 (10.0.0.4) 56(84) bytes of data. 00:22:06.604 64 bytes from 10.0.0.4: icmp_seq=1 ttl=64 time=0.104 ms 00:22:06.604 00:22:06.604 --- 10.0.0.4 ping statistics --- 00:22:06.605 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:22:06.605 rtt min/avg/max/mdev = 0.104/0.104/0.104/0.000 ms 00:22:06.605 11:33:02 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@224 -- # ip netns exec nvmf_tgt_ns_spdk ping -c 1 10.0.0.1 00:22:06.605 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:22:06.605 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.027 ms 00:22:06.605 00:22:06.605 --- 10.0.0.1 ping statistics --- 00:22:06.605 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:22:06.605 rtt min/avg/max/mdev = 0.027/0.027/0.027/0.000 ms 00:22:06.605 11:33:02 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@225 -- # ip netns exec nvmf_tgt_ns_spdk ping -c 1 10.0.0.2 00:22:06.605 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:22:06.605 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.076 ms 00:22:06.605 00:22:06.605 --- 10.0.0.2 ping statistics --- 00:22:06.605 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:22:06.605 rtt min/avg/max/mdev = 0.076/0.076/0.076/0.000 ms 00:22:06.605 11:33:02 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@227 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:22:06.605 11:33:02 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@459 -- # return 0 00:22:06.605 11:33:02 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@476 -- # '[' '' == iso ']' 00:22:06.605 11:33:02 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@480 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:22:06.605 11:33:02 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@481 -- # [[ tcp == \r\d\m\a ]] 00:22:06.605 11:33:02 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@490 -- # [[ tcp == \t\c\p ]] 00:22:06.605 11:33:02 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@491 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:22:06.605 11:33:02 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@494 -- # '[' tcp == tcp ']' 00:22:06.605 11:33:02 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@500 -- # modprobe nvme-tcp 00:22:06.605 11:33:02 nvmf_tcp.nvmf_host.nvmf_fio_host -- host/fio.sh@16 -- # [[ y != y ]] 00:22:06.605 11:33:02 nvmf_tcp.nvmf_host.nvmf_fio_host -- host/fio.sh@21 -- # timing_enter start_nvmf_tgt 00:22:06.605 11:33:02 nvmf_tcp.nvmf_host.nvmf_fio_host -- common/autotest_common.sh@724 -- # xtrace_disable 00:22:06.605 11:33:02 nvmf_tcp.nvmf_host.nvmf_fio_host -- common/autotest_common.sh@10 -- # set +x 00:22:06.605 11:33:02 nvmf_tcp.nvmf_host.nvmf_fio_host -- host/fio.sh@24 -- # nvmfpid=88523 00:22:06.605 11:33:02 nvmf_tcp.nvmf_host.nvmf_fio_host -- host/fio.sh@23 -- # ip netns exec nvmf_tgt_ns_spdk /home/vagrant/spdk_repo/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:22:06.605 11:33:02 nvmf_tcp.nvmf_host.nvmf_fio_host -- host/fio.sh@26 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:22:06.605 11:33:02 nvmf_tcp.nvmf_host.nvmf_fio_host -- host/fio.sh@28 -- # waitforlisten 88523 00:22:06.605 11:33:02 nvmf_tcp.nvmf_host.nvmf_fio_host -- common/autotest_common.sh@831 -- # '[' -z 88523 ']' 00:22:06.605 11:33:02 nvmf_tcp.nvmf_host.nvmf_fio_host -- common/autotest_common.sh@835 -- # local rpc_addr=/var/tmp/spdk.sock 00:22:06.605 11:33:02 nvmf_tcp.nvmf_host.nvmf_fio_host -- common/autotest_common.sh@836 -- # local max_retries=100 00:22:06.605 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:22:06.605 11:33:02 nvmf_tcp.nvmf_host.nvmf_fio_host -- common/autotest_common.sh@838 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:22:06.605 11:33:02 nvmf_tcp.nvmf_host.nvmf_fio_host -- common/autotest_common.sh@840 -- # xtrace_disable 00:22:06.605 11:33:02 nvmf_tcp.nvmf_host.nvmf_fio_host -- common/autotest_common.sh@10 -- # set +x 00:22:06.863 [2024-10-07 11:33:02.145222] Starting SPDK v25.01-pre git sha1 2a4f56c54 / DPDK 24.03.0 initialization... 00:22:06.863 [2024-10-07 11:33:02.145338] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --iova-mode=pa --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:22:06.863 [2024-10-07 11:33:02.287110] app.c: 917:spdk_app_start: *NOTICE*: Total cores available: 4 00:22:07.121 [2024-10-07 11:33:02.411599] app.c: 610:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:22:07.121 [2024-10-07 11:33:02.411674] app.c: 611:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:22:07.121 [2024-10-07 11:33:02.411690] app.c: 616:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:22:07.121 [2024-10-07 11:33:02.411700] app.c: 617:app_setup_trace: *NOTICE*: SPDK application currently running. 00:22:07.121 [2024-10-07 11:33:02.411710] app.c: 618:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:22:07.121 [2024-10-07 11:33:02.413112] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 1 00:22:07.121 [2024-10-07 11:33:02.413243] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 2 00:22:07.121 [2024-10-07 11:33:02.413335] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 0 00:22:07.121 [2024-10-07 11:33:02.413334] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 3 00:22:08.056 11:33:03 nvmf_tcp.nvmf_host.nvmf_fio_host -- common/autotest_common.sh@860 -- # (( i == 0 )) 00:22:08.056 11:33:03 nvmf_tcp.nvmf_host.nvmf_fio_host -- common/autotest_common.sh@864 -- # return 0 00:22:08.056 11:33:03 nvmf_tcp.nvmf_host.nvmf_fio_host -- host/fio.sh@29 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_create_transport -t tcp -o -u 8192 00:22:08.056 [2024-10-07 11:33:03.540323] tcp.c: 738:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:22:08.056 11:33:03 nvmf_tcp.nvmf_host.nvmf_fio_host -- host/fio.sh@30 -- # timing_exit start_nvmf_tgt 00:22:08.056 11:33:03 nvmf_tcp.nvmf_host.nvmf_fio_host -- common/autotest_common.sh@730 -- # xtrace_disable 00:22:08.056 11:33:03 nvmf_tcp.nvmf_host.nvmf_fio_host -- common/autotest_common.sh@10 -- # set +x 00:22:08.314 11:33:03 nvmf_tcp.nvmf_host.nvmf_fio_host -- host/fio.sh@32 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py bdev_malloc_create 64 512 -b Malloc1 00:22:08.572 Malloc1 00:22:08.572 11:33:03 nvmf_tcp.nvmf_host.nvmf_fio_host -- host/fio.sh@33 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:22:08.831 11:33:04 nvmf_tcp.nvmf_host.nvmf_fio_host -- host/fio.sh@34 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:22:09.088 11:33:04 nvmf_tcp.nvmf_host.nvmf_fio_host -- host/fio.sh@35 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.3 -s 4420 00:22:09.345 [2024-10-07 11:33:04.806316] tcp.c:1081:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.3 port 4420 *** 00:22:09.345 11:33:04 nvmf_tcp.nvmf_host.nvmf_fio_host -- host/fio.sh@36 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.3 -s 4420 00:22:09.911 11:33:05 nvmf_tcp.nvmf_host.nvmf_fio_host -- host/fio.sh@38 -- # PLUGIN_DIR=/home/vagrant/spdk_repo/spdk/app/fio/nvme 00:22:09.912 11:33:05 nvmf_tcp.nvmf_host.nvmf_fio_host -- host/fio.sh@41 -- # fio_nvme /home/vagrant/spdk_repo/spdk/app/fio/nvme/example_config.fio '--filename=trtype=tcp adrfam=IPv4 traddr=10.0.0.3 trsvcid=4420 ns=1' --bs=4096 00:22:09.912 11:33:05 nvmf_tcp.nvmf_host.nvmf_fio_host -- common/autotest_common.sh@1360 -- # fio_plugin /home/vagrant/spdk_repo/spdk/build/fio/spdk_nvme /home/vagrant/spdk_repo/spdk/app/fio/nvme/example_config.fio '--filename=trtype=tcp adrfam=IPv4 traddr=10.0.0.3 trsvcid=4420 ns=1' --bs=4096 00:22:09.912 11:33:05 nvmf_tcp.nvmf_host.nvmf_fio_host -- common/autotest_common.sh@1337 -- # local fio_dir=/usr/src/fio 00:22:09.912 11:33:05 nvmf_tcp.nvmf_host.nvmf_fio_host -- common/autotest_common.sh@1339 -- # sanitizers=('libasan' 'libclang_rt.asan') 00:22:09.912 11:33:05 nvmf_tcp.nvmf_host.nvmf_fio_host -- common/autotest_common.sh@1339 -- # local sanitizers 00:22:09.912 11:33:05 nvmf_tcp.nvmf_host.nvmf_fio_host -- common/autotest_common.sh@1340 -- # local plugin=/home/vagrant/spdk_repo/spdk/build/fio/spdk_nvme 00:22:09.912 11:33:05 nvmf_tcp.nvmf_host.nvmf_fio_host -- common/autotest_common.sh@1341 -- # shift 00:22:09.912 11:33:05 nvmf_tcp.nvmf_host.nvmf_fio_host -- common/autotest_common.sh@1343 -- # local asan_lib= 00:22:09.912 11:33:05 nvmf_tcp.nvmf_host.nvmf_fio_host -- common/autotest_common.sh@1344 -- # for sanitizer in "${sanitizers[@]}" 00:22:09.912 11:33:05 nvmf_tcp.nvmf_host.nvmf_fio_host -- common/autotest_common.sh@1345 -- # ldd /home/vagrant/spdk_repo/spdk/build/fio/spdk_nvme 00:22:09.912 11:33:05 nvmf_tcp.nvmf_host.nvmf_fio_host -- common/autotest_common.sh@1345 -- # awk '{print $3}' 00:22:09.912 11:33:05 nvmf_tcp.nvmf_host.nvmf_fio_host -- common/autotest_common.sh@1345 -- # grep libasan 00:22:09.912 11:33:05 nvmf_tcp.nvmf_host.nvmf_fio_host -- common/autotest_common.sh@1345 -- # asan_lib= 00:22:09.912 11:33:05 nvmf_tcp.nvmf_host.nvmf_fio_host -- common/autotest_common.sh@1346 -- # [[ -n '' ]] 00:22:09.912 11:33:05 nvmf_tcp.nvmf_host.nvmf_fio_host -- common/autotest_common.sh@1344 -- # for sanitizer in "${sanitizers[@]}" 00:22:09.912 11:33:05 nvmf_tcp.nvmf_host.nvmf_fio_host -- common/autotest_common.sh@1345 -- # ldd /home/vagrant/spdk_repo/spdk/build/fio/spdk_nvme 00:22:09.912 11:33:05 nvmf_tcp.nvmf_host.nvmf_fio_host -- common/autotest_common.sh@1345 -- # awk '{print $3}' 00:22:09.912 11:33:05 nvmf_tcp.nvmf_host.nvmf_fio_host -- common/autotest_common.sh@1345 -- # grep libclang_rt.asan 00:22:09.912 11:33:05 nvmf_tcp.nvmf_host.nvmf_fio_host -- common/autotest_common.sh@1345 -- # asan_lib= 00:22:09.912 11:33:05 nvmf_tcp.nvmf_host.nvmf_fio_host -- common/autotest_common.sh@1346 -- # [[ -n '' ]] 00:22:09.912 11:33:05 nvmf_tcp.nvmf_host.nvmf_fio_host -- common/autotest_common.sh@1352 -- # LD_PRELOAD=' /home/vagrant/spdk_repo/spdk/build/fio/spdk_nvme' 00:22:09.912 11:33:05 nvmf_tcp.nvmf_host.nvmf_fio_host -- common/autotest_common.sh@1352 -- # /usr/src/fio/fio /home/vagrant/spdk_repo/spdk/app/fio/nvme/example_config.fio '--filename=trtype=tcp adrfam=IPv4 traddr=10.0.0.3 trsvcid=4420 ns=1' --bs=4096 00:22:09.912 test: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=spdk, iodepth=128 00:22:09.912 fio-3.35 00:22:09.912 Starting 1 thread 00:22:12.445 00:22:12.445 test: (groupid=0, jobs=1): err= 0: pid=88651: Mon Oct 7 11:33:07 2024 00:22:12.445 read: IOPS=8415, BW=32.9MiB/s (34.5MB/s)(66.0MiB/2007msec) 00:22:12.445 slat (nsec): min=1843, max=362897, avg=2791.66, stdev=3876.87 00:22:12.445 clat (usec): min=3401, max=15166, avg=7974.42, stdev=707.18 00:22:12.445 lat (usec): min=3441, max=15169, avg=7977.21, stdev=706.92 00:22:12.445 clat percentiles (usec): 00:22:12.445 | 1.00th=[ 6587], 5.00th=[ 7046], 10.00th=[ 7177], 20.00th=[ 7439], 00:22:12.445 | 30.00th=[ 7635], 40.00th=[ 7767], 50.00th=[ 7898], 60.00th=[ 8094], 00:22:12.445 | 70.00th=[ 8225], 80.00th=[ 8455], 90.00th=[ 8717], 95.00th=[ 9110], 00:22:12.445 | 99.00th=[10290], 99.50th=[10683], 99.90th=[12518], 99.95th=[13960], 00:22:12.445 | 99.99th=[15139] 00:22:12.445 bw ( KiB/s): min=33368, max=33928, per=99.96%, avg=33650.00, stdev=242.77, samples=4 00:22:12.445 iops : min= 8342, max= 8482, avg=8412.50, stdev=60.69, samples=4 00:22:12.445 write: IOPS=8411, BW=32.9MiB/s (34.5MB/s)(65.9MiB/2007msec); 0 zone resets 00:22:12.445 slat (nsec): min=2000, max=248184, avg=2950.94, stdev=3029.12 00:22:12.445 clat (usec): min=2489, max=12829, avg=7178.81, stdev=615.93 00:22:12.445 lat (usec): min=2503, max=12832, avg=7181.76, stdev=615.75 00:22:12.445 clat percentiles (usec): 00:22:12.445 | 1.00th=[ 5866], 5.00th=[ 6325], 10.00th=[ 6521], 20.00th=[ 6718], 00:22:12.445 | 30.00th=[ 6915], 40.00th=[ 7046], 50.00th=[ 7177], 60.00th=[ 7308], 00:22:12.445 | 70.00th=[ 7373], 80.00th=[ 7570], 90.00th=[ 7832], 95.00th=[ 8029], 00:22:12.445 | 99.00th=[ 9372], 99.50th=[ 9765], 99.90th=[11076], 99.95th=[11469], 00:22:12.445 | 99.99th=[12649] 00:22:12.445 bw ( KiB/s): min=33264, max=34408, per=99.98%, avg=33636.00, stdev=526.40, samples=4 00:22:12.445 iops : min= 8316, max= 8602, avg=8409.50, stdev=131.47, samples=4 00:22:12.445 lat (msec) : 4=0.07%, 10=99.06%, 20=0.86% 00:22:12.445 cpu : usr=65.75%, sys=25.37%, ctx=98, majf=0, minf=6 00:22:12.445 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.1%, 32=0.1%, >=64=99.8% 00:22:12.445 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:22:12.445 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:22:12.445 issued rwts: total=16890,16881,0,0 short=0,0,0,0 dropped=0,0,0,0 00:22:12.445 latency : target=0, window=0, percentile=100.00%, depth=128 00:22:12.445 00:22:12.445 Run status group 0 (all jobs): 00:22:12.445 READ: bw=32.9MiB/s (34.5MB/s), 32.9MiB/s-32.9MiB/s (34.5MB/s-34.5MB/s), io=66.0MiB (69.2MB), run=2007-2007msec 00:22:12.445 WRITE: bw=32.9MiB/s (34.5MB/s), 32.9MiB/s-32.9MiB/s (34.5MB/s-34.5MB/s), io=65.9MiB (69.1MB), run=2007-2007msec 00:22:12.445 11:33:07 nvmf_tcp.nvmf_host.nvmf_fio_host -- host/fio.sh@45 -- # fio_nvme /home/vagrant/spdk_repo/spdk/app/fio/nvme/mock_sgl_config.fio '--filename=trtype=tcp adrfam=IPv4 traddr=10.0.0.3 trsvcid=4420 ns=1' 00:22:12.445 11:33:07 nvmf_tcp.nvmf_host.nvmf_fio_host -- common/autotest_common.sh@1360 -- # fio_plugin /home/vagrant/spdk_repo/spdk/build/fio/spdk_nvme /home/vagrant/spdk_repo/spdk/app/fio/nvme/mock_sgl_config.fio '--filename=trtype=tcp adrfam=IPv4 traddr=10.0.0.3 trsvcid=4420 ns=1' 00:22:12.445 11:33:07 nvmf_tcp.nvmf_host.nvmf_fio_host -- common/autotest_common.sh@1337 -- # local fio_dir=/usr/src/fio 00:22:12.445 11:33:07 nvmf_tcp.nvmf_host.nvmf_fio_host -- common/autotest_common.sh@1339 -- # sanitizers=('libasan' 'libclang_rt.asan') 00:22:12.445 11:33:07 nvmf_tcp.nvmf_host.nvmf_fio_host -- common/autotest_common.sh@1339 -- # local sanitizers 00:22:12.445 11:33:07 nvmf_tcp.nvmf_host.nvmf_fio_host -- common/autotest_common.sh@1340 -- # local plugin=/home/vagrant/spdk_repo/spdk/build/fio/spdk_nvme 00:22:12.445 11:33:07 nvmf_tcp.nvmf_host.nvmf_fio_host -- common/autotest_common.sh@1341 -- # shift 00:22:12.445 11:33:07 nvmf_tcp.nvmf_host.nvmf_fio_host -- common/autotest_common.sh@1343 -- # local asan_lib= 00:22:12.445 11:33:07 nvmf_tcp.nvmf_host.nvmf_fio_host -- common/autotest_common.sh@1344 -- # for sanitizer in "${sanitizers[@]}" 00:22:12.445 11:33:07 nvmf_tcp.nvmf_host.nvmf_fio_host -- common/autotest_common.sh@1345 -- # ldd /home/vagrant/spdk_repo/spdk/build/fio/spdk_nvme 00:22:12.445 11:33:07 nvmf_tcp.nvmf_host.nvmf_fio_host -- common/autotest_common.sh@1345 -- # grep libasan 00:22:12.445 11:33:07 nvmf_tcp.nvmf_host.nvmf_fio_host -- common/autotest_common.sh@1345 -- # awk '{print $3}' 00:22:12.445 11:33:07 nvmf_tcp.nvmf_host.nvmf_fio_host -- common/autotest_common.sh@1345 -- # asan_lib= 00:22:12.445 11:33:07 nvmf_tcp.nvmf_host.nvmf_fio_host -- common/autotest_common.sh@1346 -- # [[ -n '' ]] 00:22:12.445 11:33:07 nvmf_tcp.nvmf_host.nvmf_fio_host -- common/autotest_common.sh@1344 -- # for sanitizer in "${sanitizers[@]}" 00:22:12.445 11:33:07 nvmf_tcp.nvmf_host.nvmf_fio_host -- common/autotest_common.sh@1345 -- # ldd /home/vagrant/spdk_repo/spdk/build/fio/spdk_nvme 00:22:12.445 11:33:07 nvmf_tcp.nvmf_host.nvmf_fio_host -- common/autotest_common.sh@1345 -- # grep libclang_rt.asan 00:22:12.445 11:33:07 nvmf_tcp.nvmf_host.nvmf_fio_host -- common/autotest_common.sh@1345 -- # awk '{print $3}' 00:22:12.445 11:33:07 nvmf_tcp.nvmf_host.nvmf_fio_host -- common/autotest_common.sh@1345 -- # asan_lib= 00:22:12.445 11:33:07 nvmf_tcp.nvmf_host.nvmf_fio_host -- common/autotest_common.sh@1346 -- # [[ -n '' ]] 00:22:12.445 11:33:07 nvmf_tcp.nvmf_host.nvmf_fio_host -- common/autotest_common.sh@1352 -- # LD_PRELOAD=' /home/vagrant/spdk_repo/spdk/build/fio/spdk_nvme' 00:22:12.445 11:33:07 nvmf_tcp.nvmf_host.nvmf_fio_host -- common/autotest_common.sh@1352 -- # /usr/src/fio/fio /home/vagrant/spdk_repo/spdk/app/fio/nvme/mock_sgl_config.fio '--filename=trtype=tcp adrfam=IPv4 traddr=10.0.0.3 trsvcid=4420 ns=1' 00:22:12.445 test: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=spdk, iodepth=128 00:22:12.445 fio-3.35 00:22:12.445 Starting 1 thread 00:22:15.007 00:22:15.007 test: (groupid=0, jobs=1): err= 0: pid=88694: Mon Oct 7 11:33:10 2024 00:22:15.007 read: IOPS=7268, BW=114MiB/s (119MB/s)(228MiB/2008msec) 00:22:15.007 slat (usec): min=2, max=164, avg= 4.15, stdev= 2.83 00:22:15.007 clat (usec): min=3393, max=20198, avg=10393.85, stdev=2511.04 00:22:15.007 lat (usec): min=3396, max=20202, avg=10398.00, stdev=2511.22 00:22:15.007 clat percentiles (usec): 00:22:15.007 | 1.00th=[ 5342], 5.00th=[ 6390], 10.00th=[ 7111], 20.00th=[ 8094], 00:22:15.007 | 30.00th=[ 8848], 40.00th=[ 9634], 50.00th=[10421], 60.00th=[11207], 00:22:15.007 | 70.00th=[11863], 80.00th=[12518], 90.00th=[13566], 95.00th=[14746], 00:22:15.007 | 99.00th=[16188], 99.50th=[16909], 99.90th=[17695], 99.95th=[18220], 00:22:15.007 | 99.99th=[18482] 00:22:15.007 bw ( KiB/s): min=53408, max=73664, per=51.42%, avg=59808.00, stdev=9330.51, samples=4 00:22:15.007 iops : min= 3338, max= 4604, avg=3738.00, stdev=583.16, samples=4 00:22:15.007 write: IOPS=4344, BW=67.9MiB/s (71.2MB/s)(122MiB/1801msec); 0 zone resets 00:22:15.007 slat (usec): min=33, max=231, avg=41.40, stdev= 8.58 00:22:15.007 clat (usec): min=5178, max=21727, avg=12643.03, stdev=2265.76 00:22:15.007 lat (usec): min=5215, max=21763, avg=12684.43, stdev=2267.01 00:22:15.007 clat percentiles (usec): 00:22:15.007 | 1.00th=[ 8094], 5.00th=[ 9241], 10.00th=[ 9896], 20.00th=[10683], 00:22:15.007 | 30.00th=[11338], 40.00th=[11994], 50.00th=[12387], 60.00th=[12911], 00:22:15.007 | 70.00th=[13698], 80.00th=[14615], 90.00th=[15795], 95.00th=[16581], 00:22:15.007 | 99.00th=[17957], 99.50th=[18744], 99.90th=[21627], 99.95th=[21627], 00:22:15.007 | 99.99th=[21627] 00:22:15.007 bw ( KiB/s): min=55808, max=75456, per=89.57%, avg=62256.00, stdev=8924.83, samples=4 00:22:15.007 iops : min= 3488, max= 4716, avg=3891.00, stdev=557.80, samples=4 00:22:15.007 lat (msec) : 4=0.06%, 10=33.35%, 20=66.49%, 50=0.10% 00:22:15.007 cpu : usr=69.66%, sys=19.38%, ctx=5, majf=0, minf=19 00:22:15.007 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.2%, 16=0.4%, 32=0.7%, >=64=98.6% 00:22:15.007 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:22:15.007 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:22:15.007 issued rwts: total=14596,7824,0,0 short=0,0,0,0 dropped=0,0,0,0 00:22:15.007 latency : target=0, window=0, percentile=100.00%, depth=128 00:22:15.007 00:22:15.007 Run status group 0 (all jobs): 00:22:15.007 READ: bw=114MiB/s (119MB/s), 114MiB/s-114MiB/s (119MB/s-119MB/s), io=228MiB (239MB), run=2008-2008msec 00:22:15.007 WRITE: bw=67.9MiB/s (71.2MB/s), 67.9MiB/s-67.9MiB/s (71.2MB/s-71.2MB/s), io=122MiB (128MB), run=1801-1801msec 00:22:15.007 11:33:10 nvmf_tcp.nvmf_host.nvmf_fio_host -- host/fio.sh@47 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:22:15.007 11:33:10 nvmf_tcp.nvmf_host.nvmf_fio_host -- host/fio.sh@49 -- # '[' 0 -eq 1 ']' 00:22:15.007 11:33:10 nvmf_tcp.nvmf_host.nvmf_fio_host -- host/fio.sh@83 -- # trap - SIGINT SIGTERM EXIT 00:22:15.007 11:33:10 nvmf_tcp.nvmf_host.nvmf_fio_host -- host/fio.sh@85 -- # rm -f ./local-test-0-verify.state 00:22:15.007 11:33:10 nvmf_tcp.nvmf_host.nvmf_fio_host -- host/fio.sh@86 -- # nvmftestfini 00:22:15.007 11:33:10 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@514 -- # nvmfcleanup 00:22:15.007 11:33:10 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@121 -- # sync 00:22:15.007 11:33:10 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@123 -- # '[' tcp == tcp ']' 00:22:15.007 11:33:10 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@124 -- # set +e 00:22:15.007 11:33:10 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@125 -- # for i in {1..20} 00:22:15.007 11:33:10 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@126 -- # modprobe -v -r nvme-tcp 00:22:15.007 rmmod nvme_tcp 00:22:15.265 rmmod nvme_fabrics 00:22:15.265 rmmod nvme_keyring 00:22:15.265 11:33:10 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@127 -- # modprobe -v -r nvme-fabrics 00:22:15.265 11:33:10 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@128 -- # set -e 00:22:15.265 11:33:10 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@129 -- # return 0 00:22:15.265 11:33:10 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@515 -- # '[' -n 88523 ']' 00:22:15.265 11:33:10 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@516 -- # killprocess 88523 00:22:15.265 11:33:10 nvmf_tcp.nvmf_host.nvmf_fio_host -- common/autotest_common.sh@950 -- # '[' -z 88523 ']' 00:22:15.265 11:33:10 nvmf_tcp.nvmf_host.nvmf_fio_host -- common/autotest_common.sh@954 -- # kill -0 88523 00:22:15.265 11:33:10 nvmf_tcp.nvmf_host.nvmf_fio_host -- common/autotest_common.sh@955 -- # uname 00:22:15.265 11:33:10 nvmf_tcp.nvmf_host.nvmf_fio_host -- common/autotest_common.sh@955 -- # '[' Linux = Linux ']' 00:22:15.265 11:33:10 nvmf_tcp.nvmf_host.nvmf_fio_host -- common/autotest_common.sh@956 -- # ps --no-headers -o comm= 88523 00:22:15.265 11:33:10 nvmf_tcp.nvmf_host.nvmf_fio_host -- common/autotest_common.sh@956 -- # process_name=reactor_0 00:22:15.265 11:33:10 nvmf_tcp.nvmf_host.nvmf_fio_host -- common/autotest_common.sh@960 -- # '[' reactor_0 = sudo ']' 00:22:15.265 killing process with pid 88523 00:22:15.265 11:33:10 nvmf_tcp.nvmf_host.nvmf_fio_host -- common/autotest_common.sh@968 -- # echo 'killing process with pid 88523' 00:22:15.265 11:33:10 nvmf_tcp.nvmf_host.nvmf_fio_host -- common/autotest_common.sh@969 -- # kill 88523 00:22:15.265 11:33:10 nvmf_tcp.nvmf_host.nvmf_fio_host -- common/autotest_common.sh@974 -- # wait 88523 00:22:15.523 11:33:10 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@518 -- # '[' '' == iso ']' 00:22:15.523 11:33:10 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@521 -- # [[ tcp == \t\c\p ]] 00:22:15.523 11:33:10 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@522 -- # nvmf_tcp_fini 00:22:15.523 11:33:10 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@297 -- # iptr 00:22:15.523 11:33:10 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@789 -- # iptables-save 00:22:15.523 11:33:10 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@789 -- # grep -v SPDK_NVMF 00:22:15.523 11:33:10 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@789 -- # iptables-restore 00:22:15.523 11:33:10 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@298 -- # [[ nvmf_tgt_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s\_\s\p\d\k ]] 00:22:15.523 11:33:10 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@299 -- # nvmf_veth_fini 00:22:15.523 11:33:10 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@233 -- # ip link set nvmf_init_br nomaster 00:22:15.523 11:33:10 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@234 -- # ip link set nvmf_init_br2 nomaster 00:22:15.523 11:33:10 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@235 -- # ip link set nvmf_tgt_br nomaster 00:22:15.523 11:33:10 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@236 -- # ip link set nvmf_tgt_br2 nomaster 00:22:15.523 11:33:10 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@237 -- # ip link set nvmf_init_br down 00:22:15.523 11:33:10 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@238 -- # ip link set nvmf_init_br2 down 00:22:15.523 11:33:10 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@239 -- # ip link set nvmf_tgt_br down 00:22:15.523 11:33:10 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@240 -- # ip link set nvmf_tgt_br2 down 00:22:15.523 11:33:10 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@241 -- # ip link delete nvmf_br type bridge 00:22:15.523 11:33:11 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@242 -- # ip link delete nvmf_init_if 00:22:15.523 11:33:11 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@243 -- # ip link delete nvmf_init_if2 00:22:15.523 11:33:11 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@244 -- # ip netns exec nvmf_tgt_ns_spdk ip link delete nvmf_tgt_if 00:22:15.781 11:33:11 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@245 -- # ip netns exec nvmf_tgt_ns_spdk ip link delete nvmf_tgt_if2 00:22:15.781 11:33:11 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@246 -- # remove_spdk_ns 00:22:15.781 11:33:11 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@654 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:22:15.781 11:33:11 nvmf_tcp.nvmf_host.nvmf_fio_host -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 15> /dev/null' 00:22:15.781 11:33:11 nvmf_tcp.nvmf_host.nvmf_fio_host -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:22:15.781 11:33:11 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@300 -- # return 0 00:22:15.781 00:22:15.781 real 0m9.721s 00:22:15.781 user 0m38.248s 00:22:15.781 sys 0m2.618s 00:22:15.781 11:33:11 nvmf_tcp.nvmf_host.nvmf_fio_host -- common/autotest_common.sh@1126 -- # xtrace_disable 00:22:15.781 11:33:11 nvmf_tcp.nvmf_host.nvmf_fio_host -- common/autotest_common.sh@10 -- # set +x 00:22:15.781 ************************************ 00:22:15.781 END TEST nvmf_fio_host 00:22:15.781 ************************************ 00:22:15.781 11:33:11 nvmf_tcp.nvmf_host -- nvmf/nvmf_host.sh@25 -- # run_test nvmf_failover /home/vagrant/spdk_repo/spdk/test/nvmf/host/failover.sh --transport=tcp 00:22:15.781 11:33:11 nvmf_tcp.nvmf_host -- common/autotest_common.sh@1101 -- # '[' 3 -le 1 ']' 00:22:15.781 11:33:11 nvmf_tcp.nvmf_host -- common/autotest_common.sh@1107 -- # xtrace_disable 00:22:15.781 11:33:11 nvmf_tcp.nvmf_host -- common/autotest_common.sh@10 -- # set +x 00:22:15.781 ************************************ 00:22:15.781 START TEST nvmf_failover 00:22:15.781 ************************************ 00:22:15.781 11:33:11 nvmf_tcp.nvmf_host.nvmf_failover -- common/autotest_common.sh@1125 -- # /home/vagrant/spdk_repo/spdk/test/nvmf/host/failover.sh --transport=tcp 00:22:15.781 * Looking for test storage... 00:22:15.781 * Found test storage at /home/vagrant/spdk_repo/spdk/test/nvmf/host 00:22:15.781 11:33:11 nvmf_tcp.nvmf_host.nvmf_failover -- common/autotest_common.sh@1680 -- # [[ y == y ]] 00:22:15.781 11:33:11 nvmf_tcp.nvmf_host.nvmf_failover -- common/autotest_common.sh@1681 -- # lcov --version 00:22:15.781 11:33:11 nvmf_tcp.nvmf_host.nvmf_failover -- common/autotest_common.sh@1681 -- # awk '{print $NF}' 00:22:16.041 11:33:11 nvmf_tcp.nvmf_host.nvmf_failover -- common/autotest_common.sh@1681 -- # lt 1.15 2 00:22:16.041 11:33:11 nvmf_tcp.nvmf_host.nvmf_failover -- scripts/common.sh@373 -- # cmp_versions 1.15 '<' 2 00:22:16.041 11:33:11 nvmf_tcp.nvmf_host.nvmf_failover -- scripts/common.sh@333 -- # local ver1 ver1_l 00:22:16.041 11:33:11 nvmf_tcp.nvmf_host.nvmf_failover -- scripts/common.sh@334 -- # local ver2 ver2_l 00:22:16.041 11:33:11 nvmf_tcp.nvmf_host.nvmf_failover -- scripts/common.sh@336 -- # IFS=.-: 00:22:16.041 11:33:11 nvmf_tcp.nvmf_host.nvmf_failover -- scripts/common.sh@336 -- # read -ra ver1 00:22:16.041 11:33:11 nvmf_tcp.nvmf_host.nvmf_failover -- scripts/common.sh@337 -- # IFS=.-: 00:22:16.041 11:33:11 nvmf_tcp.nvmf_host.nvmf_failover -- scripts/common.sh@337 -- # read -ra ver2 00:22:16.041 11:33:11 nvmf_tcp.nvmf_host.nvmf_failover -- scripts/common.sh@338 -- # local 'op=<' 00:22:16.041 11:33:11 nvmf_tcp.nvmf_host.nvmf_failover -- scripts/common.sh@340 -- # ver1_l=2 00:22:16.041 11:33:11 nvmf_tcp.nvmf_host.nvmf_failover -- scripts/common.sh@341 -- # ver2_l=1 00:22:16.041 11:33:11 nvmf_tcp.nvmf_host.nvmf_failover -- scripts/common.sh@343 -- # local lt=0 gt=0 eq=0 v 00:22:16.041 11:33:11 nvmf_tcp.nvmf_host.nvmf_failover -- scripts/common.sh@344 -- # case "$op" in 00:22:16.041 11:33:11 nvmf_tcp.nvmf_host.nvmf_failover -- scripts/common.sh@345 -- # : 1 00:22:16.041 11:33:11 nvmf_tcp.nvmf_host.nvmf_failover -- scripts/common.sh@364 -- # (( v = 0 )) 00:22:16.041 11:33:11 nvmf_tcp.nvmf_host.nvmf_failover -- scripts/common.sh@364 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:22:16.041 11:33:11 nvmf_tcp.nvmf_host.nvmf_failover -- scripts/common.sh@365 -- # decimal 1 00:22:16.041 11:33:11 nvmf_tcp.nvmf_host.nvmf_failover -- scripts/common.sh@353 -- # local d=1 00:22:16.041 11:33:11 nvmf_tcp.nvmf_host.nvmf_failover -- scripts/common.sh@354 -- # [[ 1 =~ ^[0-9]+$ ]] 00:22:16.041 11:33:11 nvmf_tcp.nvmf_host.nvmf_failover -- scripts/common.sh@355 -- # echo 1 00:22:16.041 11:33:11 nvmf_tcp.nvmf_host.nvmf_failover -- scripts/common.sh@365 -- # ver1[v]=1 00:22:16.041 11:33:11 nvmf_tcp.nvmf_host.nvmf_failover -- scripts/common.sh@366 -- # decimal 2 00:22:16.041 11:33:11 nvmf_tcp.nvmf_host.nvmf_failover -- scripts/common.sh@353 -- # local d=2 00:22:16.041 11:33:11 nvmf_tcp.nvmf_host.nvmf_failover -- scripts/common.sh@354 -- # [[ 2 =~ ^[0-9]+$ ]] 00:22:16.041 11:33:11 nvmf_tcp.nvmf_host.nvmf_failover -- scripts/common.sh@355 -- # echo 2 00:22:16.041 11:33:11 nvmf_tcp.nvmf_host.nvmf_failover -- scripts/common.sh@366 -- # ver2[v]=2 00:22:16.041 11:33:11 nvmf_tcp.nvmf_host.nvmf_failover -- scripts/common.sh@367 -- # (( ver1[v] > ver2[v] )) 00:22:16.041 11:33:11 nvmf_tcp.nvmf_host.nvmf_failover -- scripts/common.sh@368 -- # (( ver1[v] < ver2[v] )) 00:22:16.041 11:33:11 nvmf_tcp.nvmf_host.nvmf_failover -- scripts/common.sh@368 -- # return 0 00:22:16.041 11:33:11 nvmf_tcp.nvmf_host.nvmf_failover -- common/autotest_common.sh@1682 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:22:16.041 11:33:11 nvmf_tcp.nvmf_host.nvmf_failover -- common/autotest_common.sh@1694 -- # export 'LCOV_OPTS= 00:22:16.041 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:22:16.041 --rc genhtml_branch_coverage=1 00:22:16.041 --rc genhtml_function_coverage=1 00:22:16.041 --rc genhtml_legend=1 00:22:16.041 --rc geninfo_all_blocks=1 00:22:16.041 --rc geninfo_unexecuted_blocks=1 00:22:16.041 00:22:16.041 ' 00:22:16.041 11:33:11 nvmf_tcp.nvmf_host.nvmf_failover -- common/autotest_common.sh@1694 -- # LCOV_OPTS=' 00:22:16.041 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:22:16.041 --rc genhtml_branch_coverage=1 00:22:16.041 --rc genhtml_function_coverage=1 00:22:16.041 --rc genhtml_legend=1 00:22:16.041 --rc geninfo_all_blocks=1 00:22:16.041 --rc geninfo_unexecuted_blocks=1 00:22:16.041 00:22:16.041 ' 00:22:16.041 11:33:11 nvmf_tcp.nvmf_host.nvmf_failover -- common/autotest_common.sh@1695 -- # export 'LCOV=lcov 00:22:16.041 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:22:16.041 --rc genhtml_branch_coverage=1 00:22:16.041 --rc genhtml_function_coverage=1 00:22:16.041 --rc genhtml_legend=1 00:22:16.041 --rc geninfo_all_blocks=1 00:22:16.041 --rc geninfo_unexecuted_blocks=1 00:22:16.041 00:22:16.041 ' 00:22:16.041 11:33:11 nvmf_tcp.nvmf_host.nvmf_failover -- common/autotest_common.sh@1695 -- # LCOV='lcov 00:22:16.041 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:22:16.041 --rc genhtml_branch_coverage=1 00:22:16.041 --rc genhtml_function_coverage=1 00:22:16.041 --rc genhtml_legend=1 00:22:16.041 --rc geninfo_all_blocks=1 00:22:16.041 --rc geninfo_unexecuted_blocks=1 00:22:16.041 00:22:16.041 ' 00:22:16.041 11:33:11 nvmf_tcp.nvmf_host.nvmf_failover -- host/failover.sh@9 -- # source /home/vagrant/spdk_repo/spdk/test/nvmf/common.sh 00:22:16.041 11:33:11 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@7 -- # uname -s 00:22:16.041 11:33:11 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:22:16.041 11:33:11 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:22:16.041 11:33:11 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:22:16.041 11:33:11 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:22:16.041 11:33:11 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:22:16.041 11:33:11 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:22:16.041 11:33:11 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:22:16.041 11:33:11 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:22:16.041 11:33:11 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:22:16.041 11:33:11 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:22:16.041 11:33:11 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:c758a4ed-f09f-4c82-9afb-3d096f035464 00:22:16.041 11:33:11 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@18 -- # NVME_HOSTID=c758a4ed-f09f-4c82-9afb-3d096f035464 00:22:16.041 11:33:11 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:22:16.041 11:33:11 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:22:16.041 11:33:11 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@21 -- # NET_TYPE=virt 00:22:16.041 11:33:11 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:22:16.041 11:33:11 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@49 -- # source /home/vagrant/spdk_repo/spdk/scripts/common.sh 00:22:16.041 11:33:11 nvmf_tcp.nvmf_host.nvmf_failover -- scripts/common.sh@15 -- # shopt -s extglob 00:22:16.041 11:33:11 nvmf_tcp.nvmf_host.nvmf_failover -- scripts/common.sh@544 -- # [[ -e /bin/wpdk_common.sh ]] 00:22:16.041 11:33:11 nvmf_tcp.nvmf_host.nvmf_failover -- scripts/common.sh@552 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:22:16.041 11:33:11 nvmf_tcp.nvmf_host.nvmf_failover -- scripts/common.sh@553 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:22:16.041 11:33:11 nvmf_tcp.nvmf_host.nvmf_failover -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:22:16.041 11:33:11 nvmf_tcp.nvmf_host.nvmf_failover -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:22:16.041 11:33:11 nvmf_tcp.nvmf_host.nvmf_failover -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:22:16.041 11:33:11 nvmf_tcp.nvmf_host.nvmf_failover -- paths/export.sh@5 -- # export PATH 00:22:16.041 11:33:11 nvmf_tcp.nvmf_host.nvmf_failover -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:22:16.041 11:33:11 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@51 -- # : 0 00:22:16.041 11:33:11 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@52 -- # export NVMF_APP_SHM_ID 00:22:16.041 11:33:11 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@53 -- # build_nvmf_app_args 00:22:16.041 11:33:11 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:22:16.041 11:33:11 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:22:16.041 11:33:11 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:22:16.041 11:33:11 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@33 -- # '[' '' -eq 1 ']' 00:22:16.041 /home/vagrant/spdk_repo/spdk/test/nvmf/common.sh: line 33: [: : integer expression expected 00:22:16.041 11:33:11 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@37 -- # '[' -n '' ']' 00:22:16.041 11:33:11 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@39 -- # '[' 0 -eq 1 ']' 00:22:16.041 11:33:11 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@55 -- # have_pci_nics=0 00:22:16.041 11:33:11 nvmf_tcp.nvmf_host.nvmf_failover -- host/failover.sh@11 -- # MALLOC_BDEV_SIZE=64 00:22:16.041 11:33:11 nvmf_tcp.nvmf_host.nvmf_failover -- host/failover.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:22:16.041 11:33:11 nvmf_tcp.nvmf_host.nvmf_failover -- host/failover.sh@14 -- # rpc_py=/home/vagrant/spdk_repo/spdk/scripts/rpc.py 00:22:16.041 11:33:11 nvmf_tcp.nvmf_host.nvmf_failover -- host/failover.sh@16 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:22:16.041 11:33:11 nvmf_tcp.nvmf_host.nvmf_failover -- host/failover.sh@18 -- # nvmftestinit 00:22:16.041 11:33:11 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@467 -- # '[' -z tcp ']' 00:22:16.041 11:33:11 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@472 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:22:16.042 11:33:11 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@474 -- # prepare_net_devs 00:22:16.042 11:33:11 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@436 -- # local -g is_hw=no 00:22:16.042 11:33:11 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@438 -- # remove_spdk_ns 00:22:16.042 11:33:11 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@654 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:22:16.042 11:33:11 nvmf_tcp.nvmf_host.nvmf_failover -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 15> /dev/null' 00:22:16.042 11:33:11 nvmf_tcp.nvmf_host.nvmf_failover -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:22:16.042 11:33:11 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@440 -- # [[ virt != virt ]] 00:22:16.042 11:33:11 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@442 -- # [[ no == yes ]] 00:22:16.042 11:33:11 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@449 -- # [[ virt == phy ]] 00:22:16.042 11:33:11 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@452 -- # [[ virt == phy-fallback ]] 00:22:16.042 11:33:11 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@457 -- # [[ tcp == tcp ]] 00:22:16.042 11:33:11 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@458 -- # nvmf_veth_init 00:22:16.042 11:33:11 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@145 -- # NVMF_FIRST_INITIATOR_IP=10.0.0.1 00:22:16.042 11:33:11 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@146 -- # NVMF_SECOND_INITIATOR_IP=10.0.0.2 00:22:16.042 11:33:11 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@147 -- # NVMF_FIRST_TARGET_IP=10.0.0.3 00:22:16.042 11:33:11 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@148 -- # NVMF_SECOND_TARGET_IP=10.0.0.4 00:22:16.042 11:33:11 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@149 -- # NVMF_INITIATOR_IP=10.0.0.1 00:22:16.042 11:33:11 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@150 -- # NVMF_BRIDGE=nvmf_br 00:22:16.042 11:33:11 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@151 -- # NVMF_INITIATOR_INTERFACE=nvmf_init_if 00:22:16.042 11:33:11 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@152 -- # NVMF_INITIATOR_INTERFACE2=nvmf_init_if2 00:22:16.042 11:33:11 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@153 -- # NVMF_INITIATOR_BRIDGE=nvmf_init_br 00:22:16.042 11:33:11 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@154 -- # NVMF_INITIATOR_BRIDGE2=nvmf_init_br2 00:22:16.042 11:33:11 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@155 -- # NVMF_TARGET_NAMESPACE=nvmf_tgt_ns_spdk 00:22:16.042 11:33:11 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@156 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:22:16.042 11:33:11 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@157 -- # NVMF_TARGET_INTERFACE=nvmf_tgt_if 00:22:16.042 11:33:11 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@158 -- # NVMF_TARGET_INTERFACE2=nvmf_tgt_if2 00:22:16.042 11:33:11 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@159 -- # NVMF_TARGET_BRIDGE=nvmf_tgt_br 00:22:16.042 11:33:11 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@160 -- # NVMF_TARGET_BRIDGE2=nvmf_tgt_br2 00:22:16.042 11:33:11 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@162 -- # ip link set nvmf_init_br nomaster 00:22:16.042 Cannot find device "nvmf_init_br" 00:22:16.042 11:33:11 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@162 -- # true 00:22:16.042 11:33:11 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@163 -- # ip link set nvmf_init_br2 nomaster 00:22:16.042 Cannot find device "nvmf_init_br2" 00:22:16.042 11:33:11 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@163 -- # true 00:22:16.042 11:33:11 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@164 -- # ip link set nvmf_tgt_br nomaster 00:22:16.042 Cannot find device "nvmf_tgt_br" 00:22:16.042 11:33:11 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@164 -- # true 00:22:16.042 11:33:11 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@165 -- # ip link set nvmf_tgt_br2 nomaster 00:22:16.042 Cannot find device "nvmf_tgt_br2" 00:22:16.042 11:33:11 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@165 -- # true 00:22:16.042 11:33:11 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@166 -- # ip link set nvmf_init_br down 00:22:16.042 Cannot find device "nvmf_init_br" 00:22:16.042 11:33:11 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@166 -- # true 00:22:16.042 11:33:11 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@167 -- # ip link set nvmf_init_br2 down 00:22:16.042 Cannot find device "nvmf_init_br2" 00:22:16.042 11:33:11 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@167 -- # true 00:22:16.042 11:33:11 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@168 -- # ip link set nvmf_tgt_br down 00:22:16.042 Cannot find device "nvmf_tgt_br" 00:22:16.042 11:33:11 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@168 -- # true 00:22:16.042 11:33:11 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@169 -- # ip link set nvmf_tgt_br2 down 00:22:16.042 Cannot find device "nvmf_tgt_br2" 00:22:16.042 11:33:11 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@169 -- # true 00:22:16.042 11:33:11 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@170 -- # ip link delete nvmf_br type bridge 00:22:16.042 Cannot find device "nvmf_br" 00:22:16.042 11:33:11 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@170 -- # true 00:22:16.042 11:33:11 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@171 -- # ip link delete nvmf_init_if 00:22:16.042 Cannot find device "nvmf_init_if" 00:22:16.042 11:33:11 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@171 -- # true 00:22:16.042 11:33:11 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@172 -- # ip link delete nvmf_init_if2 00:22:16.042 Cannot find device "nvmf_init_if2" 00:22:16.042 11:33:11 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@172 -- # true 00:22:16.042 11:33:11 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@173 -- # ip netns exec nvmf_tgt_ns_spdk ip link delete nvmf_tgt_if 00:22:16.042 Cannot open network namespace "nvmf_tgt_ns_spdk": No such file or directory 00:22:16.042 11:33:11 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@173 -- # true 00:22:16.042 11:33:11 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@174 -- # ip netns exec nvmf_tgt_ns_spdk ip link delete nvmf_tgt_if2 00:22:16.042 Cannot open network namespace "nvmf_tgt_ns_spdk": No such file or directory 00:22:16.042 11:33:11 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@174 -- # true 00:22:16.042 11:33:11 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@177 -- # ip netns add nvmf_tgt_ns_spdk 00:22:16.042 11:33:11 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@180 -- # ip link add nvmf_init_if type veth peer name nvmf_init_br 00:22:16.042 11:33:11 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@181 -- # ip link add nvmf_init_if2 type veth peer name nvmf_init_br2 00:22:16.042 11:33:11 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@182 -- # ip link add nvmf_tgt_if type veth peer name nvmf_tgt_br 00:22:16.042 11:33:11 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@183 -- # ip link add nvmf_tgt_if2 type veth peer name nvmf_tgt_br2 00:22:16.042 11:33:11 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@186 -- # ip link set nvmf_tgt_if netns nvmf_tgt_ns_spdk 00:22:16.301 11:33:11 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@187 -- # ip link set nvmf_tgt_if2 netns nvmf_tgt_ns_spdk 00:22:16.301 11:33:11 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@190 -- # ip addr add 10.0.0.1/24 dev nvmf_init_if 00:22:16.301 11:33:11 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@191 -- # ip addr add 10.0.0.2/24 dev nvmf_init_if2 00:22:16.301 11:33:11 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@192 -- # ip netns exec nvmf_tgt_ns_spdk ip addr add 10.0.0.3/24 dev nvmf_tgt_if 00:22:16.301 11:33:11 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@193 -- # ip netns exec nvmf_tgt_ns_spdk ip addr add 10.0.0.4/24 dev nvmf_tgt_if2 00:22:16.301 11:33:11 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@196 -- # ip link set nvmf_init_if up 00:22:16.301 11:33:11 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@197 -- # ip link set nvmf_init_if2 up 00:22:16.301 11:33:11 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@198 -- # ip link set nvmf_init_br up 00:22:16.301 11:33:11 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@199 -- # ip link set nvmf_init_br2 up 00:22:16.301 11:33:11 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@200 -- # ip link set nvmf_tgt_br up 00:22:16.301 11:33:11 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@201 -- # ip link set nvmf_tgt_br2 up 00:22:16.301 11:33:11 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@202 -- # ip netns exec nvmf_tgt_ns_spdk ip link set nvmf_tgt_if up 00:22:16.301 11:33:11 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@203 -- # ip netns exec nvmf_tgt_ns_spdk ip link set nvmf_tgt_if2 up 00:22:16.301 11:33:11 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@204 -- # ip netns exec nvmf_tgt_ns_spdk ip link set lo up 00:22:16.301 11:33:11 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@207 -- # ip link add nvmf_br type bridge 00:22:16.301 11:33:11 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@208 -- # ip link set nvmf_br up 00:22:16.301 11:33:11 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@211 -- # ip link set nvmf_init_br master nvmf_br 00:22:16.301 11:33:11 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@212 -- # ip link set nvmf_init_br2 master nvmf_br 00:22:16.301 11:33:11 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@213 -- # ip link set nvmf_tgt_br master nvmf_br 00:22:16.301 11:33:11 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@214 -- # ip link set nvmf_tgt_br2 master nvmf_br 00:22:16.301 11:33:11 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@217 -- # ipts -I INPUT 1 -i nvmf_init_if -p tcp --dport 4420 -j ACCEPT 00:22:16.301 11:33:11 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@788 -- # iptables -I INPUT 1 -i nvmf_init_if -p tcp --dport 4420 -j ACCEPT -m comment --comment 'SPDK_NVMF:-I INPUT 1 -i nvmf_init_if -p tcp --dport 4420 -j ACCEPT' 00:22:16.301 11:33:11 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@218 -- # ipts -I INPUT 1 -i nvmf_init_if2 -p tcp --dport 4420 -j ACCEPT 00:22:16.301 11:33:11 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@788 -- # iptables -I INPUT 1 -i nvmf_init_if2 -p tcp --dport 4420 -j ACCEPT -m comment --comment 'SPDK_NVMF:-I INPUT 1 -i nvmf_init_if2 -p tcp --dport 4420 -j ACCEPT' 00:22:16.301 11:33:11 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@219 -- # ipts -A FORWARD -i nvmf_br -o nvmf_br -j ACCEPT 00:22:16.301 11:33:11 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@788 -- # iptables -A FORWARD -i nvmf_br -o nvmf_br -j ACCEPT -m comment --comment 'SPDK_NVMF:-A FORWARD -i nvmf_br -o nvmf_br -j ACCEPT' 00:22:16.301 11:33:11 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@222 -- # ping -c 1 10.0.0.3 00:22:16.301 PING 10.0.0.3 (10.0.0.3) 56(84) bytes of data. 00:22:16.301 64 bytes from 10.0.0.3: icmp_seq=1 ttl=64 time=0.073 ms 00:22:16.301 00:22:16.301 --- 10.0.0.3 ping statistics --- 00:22:16.301 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:22:16.301 rtt min/avg/max/mdev = 0.073/0.073/0.073/0.000 ms 00:22:16.301 11:33:11 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@223 -- # ping -c 1 10.0.0.4 00:22:16.301 PING 10.0.0.4 (10.0.0.4) 56(84) bytes of data. 00:22:16.301 64 bytes from 10.0.0.4: icmp_seq=1 ttl=64 time=0.049 ms 00:22:16.301 00:22:16.301 --- 10.0.0.4 ping statistics --- 00:22:16.301 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:22:16.301 rtt min/avg/max/mdev = 0.049/0.049/0.049/0.000 ms 00:22:16.301 11:33:11 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@224 -- # ip netns exec nvmf_tgt_ns_spdk ping -c 1 10.0.0.1 00:22:16.301 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:22:16.301 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.029 ms 00:22:16.301 00:22:16.301 --- 10.0.0.1 ping statistics --- 00:22:16.301 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:22:16.301 rtt min/avg/max/mdev = 0.029/0.029/0.029/0.000 ms 00:22:16.301 11:33:11 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@225 -- # ip netns exec nvmf_tgt_ns_spdk ping -c 1 10.0.0.2 00:22:16.301 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:22:16.301 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.047 ms 00:22:16.301 00:22:16.301 --- 10.0.0.2 ping statistics --- 00:22:16.301 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:22:16.301 rtt min/avg/max/mdev = 0.047/0.047/0.047/0.000 ms 00:22:16.301 11:33:11 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@227 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:22:16.301 11:33:11 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@459 -- # return 0 00:22:16.301 11:33:11 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@476 -- # '[' '' == iso ']' 00:22:16.301 11:33:11 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@480 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:22:16.302 11:33:11 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@481 -- # [[ tcp == \r\d\m\a ]] 00:22:16.302 11:33:11 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@490 -- # [[ tcp == \t\c\p ]] 00:22:16.302 11:33:11 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@491 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:22:16.302 11:33:11 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@494 -- # '[' tcp == tcp ']' 00:22:16.302 11:33:11 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@500 -- # modprobe nvme-tcp 00:22:16.302 11:33:11 nvmf_tcp.nvmf_host.nvmf_failover -- host/failover.sh@20 -- # nvmfappstart -m 0xE 00:22:16.302 11:33:11 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@505 -- # timing_enter start_nvmf_tgt 00:22:16.302 11:33:11 nvmf_tcp.nvmf_host.nvmf_failover -- common/autotest_common.sh@724 -- # xtrace_disable 00:22:16.302 11:33:11 nvmf_tcp.nvmf_host.nvmf_failover -- common/autotest_common.sh@10 -- # set +x 00:22:16.302 11:33:11 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@507 -- # nvmfpid=88975 00:22:16.302 11:33:11 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@508 -- # waitforlisten 88975 00:22:16.302 11:33:11 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@506 -- # ip netns exec nvmf_tgt_ns_spdk /home/vagrant/spdk_repo/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xE 00:22:16.302 11:33:11 nvmf_tcp.nvmf_host.nvmf_failover -- common/autotest_common.sh@831 -- # '[' -z 88975 ']' 00:22:16.302 11:33:11 nvmf_tcp.nvmf_host.nvmf_failover -- common/autotest_common.sh@835 -- # local rpc_addr=/var/tmp/spdk.sock 00:22:16.302 11:33:11 nvmf_tcp.nvmf_host.nvmf_failover -- common/autotest_common.sh@836 -- # local max_retries=100 00:22:16.302 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:22:16.302 11:33:11 nvmf_tcp.nvmf_host.nvmf_failover -- common/autotest_common.sh@838 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:22:16.302 11:33:11 nvmf_tcp.nvmf_host.nvmf_failover -- common/autotest_common.sh@840 -- # xtrace_disable 00:22:16.302 11:33:11 nvmf_tcp.nvmf_host.nvmf_failover -- common/autotest_common.sh@10 -- # set +x 00:22:16.560 [2024-10-07 11:33:11.850976] Starting SPDK v25.01-pre git sha1 2a4f56c54 / DPDK 24.03.0 initialization... 00:22:16.560 [2024-10-07 11:33:11.851098] [ DPDK EAL parameters: nvmf -c 0xE --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --iova-mode=pa --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:22:16.560 [2024-10-07 11:33:11.995307] app.c: 917:spdk_app_start: *NOTICE*: Total cores available: 3 00:22:16.819 [2024-10-07 11:33:12.115726] app.c: 610:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:22:16.819 [2024-10-07 11:33:12.115797] app.c: 611:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:22:16.819 [2024-10-07 11:33:12.115812] app.c: 616:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:22:16.819 [2024-10-07 11:33:12.115822] app.c: 617:app_setup_trace: *NOTICE*: SPDK application currently running. 00:22:16.819 [2024-10-07 11:33:12.115831] app.c: 618:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:22:16.819 [2024-10-07 11:33:12.116728] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 2 00:22:16.819 [2024-10-07 11:33:12.116821] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 3 00:22:16.819 [2024-10-07 11:33:12.116828] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 1 00:22:17.385 11:33:12 nvmf_tcp.nvmf_host.nvmf_failover -- common/autotest_common.sh@860 -- # (( i == 0 )) 00:22:17.385 11:33:12 nvmf_tcp.nvmf_host.nvmf_failover -- common/autotest_common.sh@864 -- # return 0 00:22:17.385 11:33:12 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@509 -- # timing_exit start_nvmf_tgt 00:22:17.385 11:33:12 nvmf_tcp.nvmf_host.nvmf_failover -- common/autotest_common.sh@730 -- # xtrace_disable 00:22:17.385 11:33:12 nvmf_tcp.nvmf_host.nvmf_failover -- common/autotest_common.sh@10 -- # set +x 00:22:17.385 11:33:12 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@510 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:22:17.385 11:33:12 nvmf_tcp.nvmf_host.nvmf_failover -- host/failover.sh@22 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_create_transport -t tcp -o -u 8192 00:22:17.950 [2024-10-07 11:33:13.176590] tcp.c: 738:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:22:17.950 11:33:13 nvmf_tcp.nvmf_host.nvmf_failover -- host/failover.sh@23 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py bdev_malloc_create 64 512 -b Malloc0 00:22:18.207 Malloc0 00:22:18.207 11:33:13 nvmf_tcp.nvmf_host.nvmf_failover -- host/failover.sh@24 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:22:18.465 11:33:13 nvmf_tcp.nvmf_host.nvmf_failover -- host/failover.sh@25 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:22:18.723 11:33:14 nvmf_tcp.nvmf_host.nvmf_failover -- host/failover.sh@26 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.3 -s 4420 00:22:18.981 [2024-10-07 11:33:14.367153] tcp.c:1081:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.3 port 4420 *** 00:22:18.981 11:33:14 nvmf_tcp.nvmf_host.nvmf_failover -- host/failover.sh@27 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.3 -s 4421 00:22:19.239 [2024-10-07 11:33:14.691479] tcp.c:1081:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.3 port 4421 *** 00:22:19.239 11:33:14 nvmf_tcp.nvmf_host.nvmf_failover -- host/failover.sh@28 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.3 -s 4422 00:22:19.496 [2024-10-07 11:33:14.963725] tcp.c:1081:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.3 port 4422 *** 00:22:19.496 11:33:14 nvmf_tcp.nvmf_host.nvmf_failover -- host/failover.sh@31 -- # bdevperf_pid=89088 00:22:19.496 11:33:14 nvmf_tcp.nvmf_host.nvmf_failover -- host/failover.sh@30 -- # /home/vagrant/spdk_repo/spdk/build/examples/bdevperf -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 15 -f 00:22:19.496 11:33:14 nvmf_tcp.nvmf_host.nvmf_failover -- host/failover.sh@33 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; cat $testdir/try.txt; rm -f $testdir/try.txt; killprocess $bdevperf_pid; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:22:19.496 11:33:14 nvmf_tcp.nvmf_host.nvmf_failover -- host/failover.sh@34 -- # waitforlisten 89088 /var/tmp/bdevperf.sock 00:22:19.496 11:33:14 nvmf_tcp.nvmf_host.nvmf_failover -- common/autotest_common.sh@831 -- # '[' -z 89088 ']' 00:22:19.496 11:33:14 nvmf_tcp.nvmf_host.nvmf_failover -- common/autotest_common.sh@835 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:22:19.496 11:33:14 nvmf_tcp.nvmf_host.nvmf_failover -- common/autotest_common.sh@836 -- # local max_retries=100 00:22:19.496 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:22:19.496 11:33:14 nvmf_tcp.nvmf_host.nvmf_failover -- common/autotest_common.sh@838 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:22:19.496 11:33:14 nvmf_tcp.nvmf_host.nvmf_failover -- common/autotest_common.sh@840 -- # xtrace_disable 00:22:19.496 11:33:14 nvmf_tcp.nvmf_host.nvmf_failover -- common/autotest_common.sh@10 -- # set +x 00:22:20.870 11:33:16 nvmf_tcp.nvmf_host.nvmf_failover -- common/autotest_common.sh@860 -- # (( i == 0 )) 00:22:20.870 11:33:16 nvmf_tcp.nvmf_host.nvmf_failover -- common/autotest_common.sh@864 -- # return 0 00:22:20.870 11:33:16 nvmf_tcp.nvmf_host.nvmf_failover -- host/failover.sh@35 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.3 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -x failover 00:22:21.129 NVMe0n1 00:22:21.129 11:33:16 nvmf_tcp.nvmf_host.nvmf_failover -- host/failover.sh@36 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.3 -s 4421 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -x failover 00:22:21.387 NVMe0n1 00:22:21.387 11:33:16 nvmf_tcp.nvmf_host.nvmf_failover -- host/failover.sh@39 -- # run_test_pid=89141 00:22:21.387 11:33:16 nvmf_tcp.nvmf_host.nvmf_failover -- host/failover.sh@38 -- # /home/vagrant/spdk_repo/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bdevperf.sock perform_tests 00:22:21.387 11:33:16 nvmf_tcp.nvmf_host.nvmf_failover -- host/failover.sh@41 -- # sleep 1 00:22:22.320 11:33:17 nvmf_tcp.nvmf_host.nvmf_failover -- host/failover.sh@43 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_remove_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.3 -s 4420 00:22:22.579 [2024-10-07 11:33:18.021391] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13fdde0 is same with the state(6) to be set 00:22:22.579 [2024-10-07 11:33:18.022000] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13fdde0 is same with the state(6) to be set 00:22:22.579 [2024-10-07 11:33:18.022108] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13fdde0 is same with the state(6) to be set 00:22:22.579 [2024-10-07 11:33:18.022208] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13fdde0 is same with the state(6) to be set 00:22:22.579 [2024-10-07 11:33:18.022272] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13fdde0 is same with the state(6) to be set 00:22:22.579 [2024-10-07 11:33:18.022334] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13fdde0 is same with the state(6) to be set 00:22:22.579 [2024-10-07 11:33:18.022411] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13fdde0 is same with the state(6) to be set 00:22:22.579 [2024-10-07 11:33:18.022491] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13fdde0 is same with the state(6) to be set 00:22:22.579 [2024-10-07 11:33:18.022561] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13fdde0 is same with the state(6) to be set 00:22:22.579 [2024-10-07 11:33:18.022621] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13fdde0 is same with the state(6) to be set 00:22:22.579 [2024-10-07 11:33:18.022705] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13fdde0 is same with the state(6) to be set 00:22:22.579 [2024-10-07 11:33:18.022774] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13fdde0 is same with the state(6) to be set 00:22:22.579 [2024-10-07 11:33:18.022850] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13fdde0 is same with the state(6) to be set 00:22:22.579 [2024-10-07 11:33:18.022913] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13fdde0 is same with the state(6) to be set 00:22:22.579 [2024-10-07 11:33:18.022973] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13fdde0 is same with the state(6) to be set 00:22:22.579 [2024-10-07 11:33:18.023047] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13fdde0 is same with the state(6) to be set 00:22:22.579 [2024-10-07 11:33:18.023121] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13fdde0 is same with the state(6) to be set 00:22:22.579 [2024-10-07 11:33:18.023183] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13fdde0 is same with the state(6) to be set 00:22:22.579 [2024-10-07 11:33:18.023295] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13fdde0 is same with the state(6) to be set 00:22:22.579 [2024-10-07 11:33:18.023359] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13fdde0 is same with the state(6) to be set 00:22:22.579 [2024-10-07 11:33:18.023425] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13fdde0 is same with the state(6) to be set 00:22:22.579 [2024-10-07 11:33:18.023500] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13fdde0 is same with the state(6) to be set 00:22:22.579 [2024-10-07 11:33:18.023574] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13fdde0 is same with the state(6) to be set 00:22:22.579 [2024-10-07 11:33:18.023671] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13fdde0 is same with the state(6) to be set 00:22:22.579 [2024-10-07 11:33:18.023731] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13fdde0 is same with the state(6) to be set 00:22:22.579 [2024-10-07 11:33:18.023800] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13fdde0 is same with the state(6) to be set 00:22:22.579 [2024-10-07 11:33:18.023862] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13fdde0 is same with the state(6) to be set 00:22:22.579 [2024-10-07 11:33:18.023923] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13fdde0 is same with the state(6) to be set 00:22:22.579 [2024-10-07 11:33:18.023989] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13fdde0 is same with the state(6) to be set 00:22:22.579 [2024-10-07 11:33:18.024041] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13fdde0 is same with the state(6) to be set 00:22:22.579 [2024-10-07 11:33:18.024089] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13fdde0 is same with the state(6) to be set 00:22:22.579 [2024-10-07 11:33:18.024137] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13fdde0 is same with the state(6) to be set 00:22:22.579 [2024-10-07 11:33:18.024209] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13fdde0 is same with the state(6) to be set 00:22:22.580 [2024-10-07 11:33:18.024271] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13fdde0 is same with the state(6) to be set 00:22:22.580 [2024-10-07 11:33:18.024334] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13fdde0 is same with the state(6) to be set 00:22:22.580 [2024-10-07 11:33:18.024411] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13fdde0 is same with the state(6) to be set 00:22:22.580 [2024-10-07 11:33:18.024485] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13fdde0 is same with the state(6) to be set 00:22:22.580 [2024-10-07 11:33:18.024565] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13fdde0 is same with the state(6) to be set 00:22:22.580 [2024-10-07 11:33:18.024618] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13fdde0 is same with the state(6) to be set 00:22:22.580 [2024-10-07 11:33:18.024692] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13fdde0 is same with the state(6) to be set 00:22:22.580 [2024-10-07 11:33:18.024760] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13fdde0 is same with the state(6) to be set 00:22:22.580 [2024-10-07 11:33:18.024830] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13fdde0 is same with the state(6) to be set 00:22:22.580 11:33:18 nvmf_tcp.nvmf_host.nvmf_failover -- host/failover.sh@45 -- # sleep 3 00:22:25.860 11:33:21 nvmf_tcp.nvmf_host.nvmf_failover -- host/failover.sh@47 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.3 -s 4422 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -x failover 00:22:26.118 NVMe0n1 00:22:26.118 11:33:21 nvmf_tcp.nvmf_host.nvmf_failover -- host/failover.sh@48 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_remove_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.3 -s 4421 00:22:26.377 [2024-10-07 11:33:21.782244] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13fe2b0 is same with the state(6) to be set 00:22:26.377 [2024-10-07 11:33:21.782318] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13fe2b0 is same with the state(6) to be set 00:22:26.377 [2024-10-07 11:33:21.782331] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13fe2b0 is same with the state(6) to be set 00:22:26.377 [2024-10-07 11:33:21.782340] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13fe2b0 is same with the state(6) to be set 00:22:26.377 [2024-10-07 11:33:21.782349] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13fe2b0 is same with the state(6) to be set 00:22:26.377 [2024-10-07 11:33:21.782358] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13fe2b0 is same with the state(6) to be set 00:22:26.377 [2024-10-07 11:33:21.782366] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13fe2b0 is same with the state(6) to be set 00:22:26.377 [2024-10-07 11:33:21.782375] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13fe2b0 is same with the state(6) to be set 00:22:26.377 [2024-10-07 11:33:21.782385] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13fe2b0 is same with the state(6) to be set 00:22:26.377 [2024-10-07 11:33:21.782394] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13fe2b0 is same with the state(6) to be set 00:22:26.377 [2024-10-07 11:33:21.782402] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13fe2b0 is same with the state(6) to be set 00:22:26.377 [2024-10-07 11:33:21.782411] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13fe2b0 is same with the state(6) to be set 00:22:26.377 [2024-10-07 11:33:21.782419] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13fe2b0 is same with the state(6) to be set 00:22:26.377 [2024-10-07 11:33:21.782427] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13fe2b0 is same with the state(6) to be set 00:22:26.377 [2024-10-07 11:33:21.782435] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13fe2b0 is same with the state(6) to be set 00:22:26.377 [2024-10-07 11:33:21.782443] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13fe2b0 is same with the state(6) to be set 00:22:26.377 [2024-10-07 11:33:21.782452] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13fe2b0 is same with the state(6) to be set 00:22:26.377 [2024-10-07 11:33:21.782460] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13fe2b0 is same with the state(6) to be set 00:22:26.377 [2024-10-07 11:33:21.782469] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13fe2b0 is same with the state(6) to be set 00:22:26.377 [2024-10-07 11:33:21.782477] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13fe2b0 is same with the state(6) to be set 00:22:26.377 [2024-10-07 11:33:21.782484] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13fe2b0 is same with the state(6) to be set 00:22:26.377 [2024-10-07 11:33:21.782492] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13fe2b0 is same with the state(6) to be set 00:22:26.377 [2024-10-07 11:33:21.782501] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13fe2b0 is same with the state(6) to be set 00:22:26.377 [2024-10-07 11:33:21.782509] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13fe2b0 is same with the state(6) to be set 00:22:26.377 [2024-10-07 11:33:21.782517] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13fe2b0 is same with the state(6) to be set 00:22:26.377 [2024-10-07 11:33:21.782526] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13fe2b0 is same with the state(6) to be set 00:22:26.377 [2024-10-07 11:33:21.782534] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13fe2b0 is same with the state(6) to be set 00:22:26.377 [2024-10-07 11:33:21.782543] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13fe2b0 is same with the state(6) to be set 00:22:26.377 [2024-10-07 11:33:21.782551] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13fe2b0 is same with the state(6) to be set 00:22:26.377 [2024-10-07 11:33:21.782559] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13fe2b0 is same with the state(6) to be set 00:22:26.377 [2024-10-07 11:33:21.782567] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13fe2b0 is same with the state(6) to be set 00:22:26.377 [2024-10-07 11:33:21.782575] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13fe2b0 is same with the state(6) to be set 00:22:26.377 [2024-10-07 11:33:21.782583] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13fe2b0 is same with the state(6) to be set 00:22:26.377 [2024-10-07 11:33:21.782593] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13fe2b0 is same with the state(6) to be set 00:22:26.377 [2024-10-07 11:33:21.782602] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13fe2b0 is same with the state(6) to be set 00:22:26.377 [2024-10-07 11:33:21.782610] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13fe2b0 is same with the state(6) to be set 00:22:26.377 [2024-10-07 11:33:21.782619] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13fe2b0 is same with the state(6) to be set 00:22:26.377 [2024-10-07 11:33:21.783177] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13fe2b0 is same with the state(6) to be set 00:22:26.377 [2024-10-07 11:33:21.783225] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13fe2b0 is same with the state(6) to be set 00:22:26.377 [2024-10-07 11:33:21.783235] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13fe2b0 is same with the state(6) to be set 00:22:26.377 [2024-10-07 11:33:21.783244] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13fe2b0 is same with the state(6) to be set 00:22:26.377 [2024-10-07 11:33:21.783253] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13fe2b0 is same with the state(6) to be set 00:22:26.377 [2024-10-07 11:33:21.783261] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13fe2b0 is same with the state(6) to be set 00:22:26.377 [2024-10-07 11:33:21.783270] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13fe2b0 is same with the state(6) to be set 00:22:26.377 [2024-10-07 11:33:21.783278] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13fe2b0 is same with the state(6) to be set 00:22:26.377 [2024-10-07 11:33:21.783287] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13fe2b0 is same with the state(6) to be set 00:22:26.377 [2024-10-07 11:33:21.783295] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13fe2b0 is same with the state(6) to be set 00:22:26.377 [2024-10-07 11:33:21.783304] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13fe2b0 is same with the state(6) to be set 00:22:26.377 [2024-10-07 11:33:21.783312] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13fe2b0 is same with the state(6) to be set 00:22:26.377 [2024-10-07 11:33:21.783320] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13fe2b0 is same with the state(6) to be set 00:22:26.377 [2024-10-07 11:33:21.783329] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13fe2b0 is same with the state(6) to be set 00:22:26.377 [2024-10-07 11:33:21.783337] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13fe2b0 is same with the state(6) to be set 00:22:26.377 [2024-10-07 11:33:21.783345] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13fe2b0 is same with the state(6) to be set 00:22:26.377 [2024-10-07 11:33:21.783353] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13fe2b0 is same with the state(6) to be set 00:22:26.377 11:33:21 nvmf_tcp.nvmf_host.nvmf_failover -- host/failover.sh@50 -- # sleep 3 00:22:29.659 11:33:24 nvmf_tcp.nvmf_host.nvmf_failover -- host/failover.sh@53 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.3 -s 4420 00:22:29.659 [2024-10-07 11:33:25.105806] tcp.c:1081:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.3 port 4420 *** 00:22:29.659 11:33:25 nvmf_tcp.nvmf_host.nvmf_failover -- host/failover.sh@55 -- # sleep 1 00:22:31.034 11:33:26 nvmf_tcp.nvmf_host.nvmf_failover -- host/failover.sh@57 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_remove_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.3 -s 4422 00:22:31.034 11:33:26 nvmf_tcp.nvmf_host.nvmf_failover -- host/failover.sh@59 -- # wait 89141 00:22:37.634 { 00:22:37.634 "results": [ 00:22:37.634 { 00:22:37.634 "job": "NVMe0n1", 00:22:37.634 "core_mask": "0x1", 00:22:37.634 "workload": "verify", 00:22:37.634 "status": "finished", 00:22:37.634 "verify_range": { 00:22:37.634 "start": 0, 00:22:37.634 "length": 16384 00:22:37.634 }, 00:22:37.634 "queue_depth": 128, 00:22:37.634 "io_size": 4096, 00:22:37.634 "runtime": 15.014085, 00:22:37.634 "iops": 8941.870250501446, 00:22:37.634 "mibps": 34.929180666021274, 00:22:37.634 "io_failed": 0, 00:22:37.634 "io_timeout": 0, 00:22:37.634 "avg_latency_us": 14282.614491662343, 00:22:37.634 "min_latency_us": 860.16, 00:22:37.634 "max_latency_us": 23712.116363636364 00:22:37.634 } 00:22:37.634 ], 00:22:37.634 "core_count": 1 00:22:37.634 } 00:22:37.634 11:33:31 nvmf_tcp.nvmf_host.nvmf_failover -- host/failover.sh@61 -- # killprocess 89088 00:22:37.634 11:33:31 nvmf_tcp.nvmf_host.nvmf_failover -- common/autotest_common.sh@950 -- # '[' -z 89088 ']' 00:22:37.634 11:33:31 nvmf_tcp.nvmf_host.nvmf_failover -- common/autotest_common.sh@954 -- # kill -0 89088 00:22:37.634 11:33:31 nvmf_tcp.nvmf_host.nvmf_failover -- common/autotest_common.sh@955 -- # uname 00:22:37.634 11:33:31 nvmf_tcp.nvmf_host.nvmf_failover -- common/autotest_common.sh@955 -- # '[' Linux = Linux ']' 00:22:37.634 11:33:31 nvmf_tcp.nvmf_host.nvmf_failover -- common/autotest_common.sh@956 -- # ps --no-headers -o comm= 89088 00:22:37.634 killing process with pid 89088 00:22:37.634 11:33:31 nvmf_tcp.nvmf_host.nvmf_failover -- common/autotest_common.sh@956 -- # process_name=reactor_0 00:22:37.634 11:33:31 nvmf_tcp.nvmf_host.nvmf_failover -- common/autotest_common.sh@960 -- # '[' reactor_0 = sudo ']' 00:22:37.634 11:33:31 nvmf_tcp.nvmf_host.nvmf_failover -- common/autotest_common.sh@968 -- # echo 'killing process with pid 89088' 00:22:37.634 11:33:31 nvmf_tcp.nvmf_host.nvmf_failover -- common/autotest_common.sh@969 -- # kill 89088 00:22:37.634 11:33:31 nvmf_tcp.nvmf_host.nvmf_failover -- common/autotest_common.sh@974 -- # wait 89088 00:22:37.634 11:33:32 nvmf_tcp.nvmf_host.nvmf_failover -- host/failover.sh@63 -- # cat /home/vagrant/spdk_repo/spdk/test/nvmf/host/try.txt 00:22:37.634 [2024-10-07 11:33:15.047444] Starting SPDK v25.01-pre git sha1 2a4f56c54 / DPDK 24.03.0 initialization... 00:22:37.634 [2024-10-07 11:33:15.047639] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --iova-mode=pa --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid89088 ] 00:22:37.634 [2024-10-07 11:33:15.187646] app.c: 917:spdk_app_start: *NOTICE*: Total cores available: 1 00:22:37.634 [2024-10-07 11:33:15.317426] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 0 00:22:37.634 Running I/O for 15 seconds... 00:22:37.634 8644.00 IOPS, 33.77 MiB/s [2024-10-07T11:33:33.157Z] [2024-10-07 11:33:18.025183] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:118 nsid:1 lba:78736 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:22:37.634 [2024-10-07 11:33:18.025238] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:37.634 [2024-10-07 11:33:18.025298] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:25 nsid:1 lba:78744 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:22:37.634 [2024-10-07 11:33:18.025314] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:37.634 [2024-10-07 11:33:18.025330] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:120 nsid:1 lba:78752 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:22:37.635 [2024-10-07 11:33:18.025344] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:37.635 [2024-10-07 11:33:18.025359] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:22 nsid:1 lba:78760 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:22:37.635 [2024-10-07 11:33:18.025373] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:37.635 [2024-10-07 11:33:18.025403] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:100 nsid:1 lba:78768 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:22:37.635 [2024-10-07 11:33:18.025416] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:37.635 [2024-10-07 11:33:18.025430] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:117 nsid:1 lba:78776 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:22:37.635 [2024-10-07 11:33:18.025443] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:37.635 [2024-10-07 11:33:18.025482] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:109 nsid:1 lba:78784 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:22:37.635 [2024-10-07 11:33:18.025495] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:37.635 [2024-10-07 11:33:18.025510] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:77 nsid:1 lba:78792 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:22:37.635 [2024-10-07 11:33:18.025523] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:37.635 [2024-10-07 11:33:18.025538] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:122 nsid:1 lba:78800 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:22:37.635 [2024-10-07 11:33:18.025551] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:37.635 [2024-10-07 11:33:18.025565] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:9 nsid:1 lba:78808 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:22:37.635 [2024-10-07 11:33:18.025579] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:37.635 [2024-10-07 11:33:18.025594] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:69 nsid:1 lba:78816 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:22:37.635 [2024-10-07 11:33:18.025608] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:37.635 [2024-10-07 11:33:18.025653] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:89 nsid:1 lba:78824 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:22:37.635 [2024-10-07 11:33:18.025669] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:37.635 [2024-10-07 11:33:18.025684] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:90 nsid:1 lba:78832 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:22:37.635 [2024-10-07 11:33:18.025698] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:37.635 [2024-10-07 11:33:18.025730] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:50 nsid:1 lba:78840 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:22:37.635 [2024-10-07 11:33:18.025778] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:37.635 [2024-10-07 11:33:18.025795] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:86 nsid:1 lba:78848 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:22:37.635 [2024-10-07 11:33:18.025809] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:37.635 [2024-10-07 11:33:18.025842] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:14 nsid:1 lba:78856 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:22:37.635 [2024-10-07 11:33:18.025864] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:37.635 [2024-10-07 11:33:18.025879] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:119 nsid:1 lba:78864 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:22:37.635 [2024-10-07 11:33:18.025893] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:37.635 [2024-10-07 11:33:18.025908] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:108 nsid:1 lba:78872 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:22:37.635 [2024-10-07 11:33:18.025921] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:37.635 [2024-10-07 11:33:18.025936] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:12 nsid:1 lba:78880 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:22:37.635 [2024-10-07 11:33:18.025949] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:37.635 [2024-10-07 11:33:18.025964] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:93 nsid:1 lba:78888 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:22:37.635 [2024-10-07 11:33:18.025977] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:37.635 [2024-10-07 11:33:18.025992] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:105 nsid:1 lba:78896 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:22:37.635 [2024-10-07 11:33:18.026014] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:37.635 [2024-10-07 11:33:18.026029] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:53 nsid:1 lba:78288 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:37.635 [2024-10-07 11:33:18.026042] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:37.635 [2024-10-07 11:33:18.026057] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:111 nsid:1 lba:78296 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:37.635 [2024-10-07 11:33:18.026071] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:37.635 [2024-10-07 11:33:18.026086] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:43 nsid:1 lba:78304 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:37.635 [2024-10-07 11:33:18.026123] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:37.635 [2024-10-07 11:33:18.026148] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:24 nsid:1 lba:78312 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:37.635 [2024-10-07 11:33:18.026178] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:37.635 [2024-10-07 11:33:18.026192] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:107 nsid:1 lba:78320 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:37.635 [2024-10-07 11:33:18.026205] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:37.635 [2024-10-07 11:33:18.026219] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:42 nsid:1 lba:78328 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:37.635 [2024-10-07 11:33:18.026231] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:37.635 [2024-10-07 11:33:18.026246] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:92 nsid:1 lba:78336 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:37.635 [2024-10-07 11:33:18.026259] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:37.635 [2024-10-07 11:33:18.026273] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:78344 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:37.635 [2024-10-07 11:33:18.026287] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:37.635 [2024-10-07 11:33:18.026301] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:16 nsid:1 lba:78352 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:37.635 [2024-10-07 11:33:18.026314] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:37.635 [2024-10-07 11:33:18.026328] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:64 nsid:1 lba:78360 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:37.635 [2024-10-07 11:33:18.026341] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:37.635 [2024-10-07 11:33:18.026355] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:78368 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:37.635 [2024-10-07 11:33:18.026368] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:37.635 [2024-10-07 11:33:18.026381] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:49 nsid:1 lba:78376 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:37.635 [2024-10-07 11:33:18.026394] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:37.635 [2024-10-07 11:33:18.026408] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:115 nsid:1 lba:78384 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:37.635 [2024-10-07 11:33:18.026421] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:37.635 [2024-10-07 11:33:18.026452] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:78392 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:37.635 [2024-10-07 11:33:18.026476] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:37.635 [2024-10-07 11:33:18.026492] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:62 nsid:1 lba:78400 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:37.635 [2024-10-07 11:33:18.026506] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:37.635 [2024-10-07 11:33:18.026540] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:23 nsid:1 lba:78408 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:37.635 [2024-10-07 11:33:18.026554] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:37.635 [2024-10-07 11:33:18.026570] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:46 nsid:1 lba:78416 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:37.635 [2024-10-07 11:33:18.026584] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:37.635 [2024-10-07 11:33:18.026599] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:35 nsid:1 lba:78424 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:37.635 [2024-10-07 11:33:18.026613] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:37.635 [2024-10-07 11:33:18.026629] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:72 nsid:1 lba:78432 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:37.635 [2024-10-07 11:33:18.026642] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:37.635 [2024-10-07 11:33:18.026663] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:37 nsid:1 lba:78440 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:37.635 [2024-10-07 11:33:18.026677] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:37.635 [2024-10-07 11:33:18.026693] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:44 nsid:1 lba:78448 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:37.635 [2024-10-07 11:33:18.026707] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:37.635 [2024-10-07 11:33:18.026735] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:116 nsid:1 lba:78456 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:37.635 [2024-10-07 11:33:18.026752] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:37.635 [2024-10-07 11:33:18.026769] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:29 nsid:1 lba:78464 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:37.636 [2024-10-07 11:33:18.026784] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:37.636 [2024-10-07 11:33:18.026800] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:17 nsid:1 lba:78472 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:37.636 [2024-10-07 11:33:18.026814] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:37.636 [2024-10-07 11:33:18.026873] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:34 nsid:1 lba:78480 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:37.636 [2024-10-07 11:33:18.026886] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:37.636 [2024-10-07 11:33:18.026901] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:78488 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:37.636 [2024-10-07 11:33:18.026913] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:37.636 [2024-10-07 11:33:18.026927] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:48 nsid:1 lba:78496 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:37.636 [2024-10-07 11:33:18.026940] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:37.636 [2024-10-07 11:33:18.026955] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:28 nsid:1 lba:78504 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:37.636 [2024-10-07 11:33:18.026983] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:37.636 [2024-10-07 11:33:18.026998] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:41 nsid:1 lba:78512 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:37.636 [2024-10-07 11:33:18.027011] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:37.636 [2024-10-07 11:33:18.027026] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:84 nsid:1 lba:78520 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:37.636 [2024-10-07 11:33:18.027038] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:37.636 [2024-10-07 11:33:18.027052] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:78 nsid:1 lba:78528 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:37.636 [2024-10-07 11:33:18.027065] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:37.636 [2024-10-07 11:33:18.027079] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:57 nsid:1 lba:78536 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:37.636 [2024-10-07 11:33:18.027091] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:37.636 [2024-10-07 11:33:18.027105] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:75 nsid:1 lba:78904 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:22:37.636 [2024-10-07 11:33:18.027118] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:37.636 [2024-10-07 11:33:18.027132] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:7 nsid:1 lba:78912 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:22:37.636 [2024-10-07 11:33:18.027146] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:37.636 [2024-10-07 11:33:18.027160] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:91 nsid:1 lba:78920 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:22:37.636 [2024-10-07 11:33:18.027173] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:37.636 [2024-10-07 11:33:18.027200] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:88 nsid:1 lba:78928 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:22:37.636 [2024-10-07 11:33:18.027246] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:37.636 [2024-10-07 11:33:18.027261] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:47 nsid:1 lba:78936 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:22:37.636 [2024-10-07 11:33:18.027275] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:37.636 [2024-10-07 11:33:18.027291] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:33 nsid:1 lba:78944 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:22:37.636 [2024-10-07 11:33:18.027305] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:37.636 [2024-10-07 11:33:18.027321] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:52 nsid:1 lba:78952 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:22:37.636 [2024-10-07 11:33:18.027335] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:37.636 [2024-10-07 11:33:18.027350] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:94 nsid:1 lba:78960 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:22:37.636 [2024-10-07 11:33:18.027364] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:37.636 [2024-10-07 11:33:18.027380] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:80 nsid:1 lba:78544 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:37.636 [2024-10-07 11:33:18.027401] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:37.636 [2024-10-07 11:33:18.027417] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:51 nsid:1 lba:78552 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:37.636 [2024-10-07 11:33:18.027431] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:37.636 [2024-10-07 11:33:18.027447] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:113 nsid:1 lba:78560 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:37.636 [2024-10-07 11:33:18.027461] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:37.636 [2024-10-07 11:33:18.027476] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:63 nsid:1 lba:78568 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:37.636 [2024-10-07 11:33:18.027490] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:37.636 [2024-10-07 11:33:18.027505] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:38 nsid:1 lba:78576 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:37.636 [2024-10-07 11:33:18.027519] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:37.636 [2024-10-07 11:33:18.027535] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:54 nsid:1 lba:78584 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:37.636 [2024-10-07 11:33:18.027564] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:37.636 [2024-10-07 11:33:18.027579] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:78592 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:37.636 [2024-10-07 11:33:18.027592] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:37.636 [2024-10-07 11:33:18.027607] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:61 nsid:1 lba:78600 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:37.636 [2024-10-07 11:33:18.027621] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:37.636 [2024-10-07 11:33:18.027635] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:78608 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:37.636 [2024-10-07 11:33:18.027649] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:37.636 [2024-10-07 11:33:18.027664] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:78616 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:37.636 [2024-10-07 11:33:18.027693] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:37.636 [2024-10-07 11:33:18.027722] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:114 nsid:1 lba:78624 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:37.636 [2024-10-07 11:33:18.027739] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:37.636 [2024-10-07 11:33:18.027759] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:56 nsid:1 lba:78632 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:37.636 [2024-10-07 11:33:18.027793] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:37.636 [2024-10-07 11:33:18.027807] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:78640 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:37.636 [2024-10-07 11:33:18.027820] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:37.636 [2024-10-07 11:33:18.027842] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:95 nsid:1 lba:78648 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:37.636 [2024-10-07 11:33:18.027855] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:37.636 [2024-10-07 11:33:18.027870] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:78656 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:37.636 [2024-10-07 11:33:18.027882] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:37.636 [2024-10-07 11:33:18.027896] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:30 nsid:1 lba:78664 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:37.636 [2024-10-07 11:33:18.027909] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:37.636 [2024-10-07 11:33:18.027923] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:96 nsid:1 lba:78672 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:37.636 [2024-10-07 11:33:18.027936] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:37.636 [2024-10-07 11:33:18.027950] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:27 nsid:1 lba:78680 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:37.636 [2024-10-07 11:33:18.027962] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:37.636 [2024-10-07 11:33:18.027977] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:70 nsid:1 lba:78688 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:37.636 [2024-10-07 11:33:18.027990] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:37.636 [2024-10-07 11:33:18.028004] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:123 nsid:1 lba:78696 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:37.636 [2024-10-07 11:33:18.028016] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:37.636 [2024-10-07 11:33:18.028030] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:71 nsid:1 lba:78704 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:37.636 [2024-10-07 11:33:18.028043] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:37.636 [2024-10-07 11:33:18.028057] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:45 nsid:1 lba:78712 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:37.636 [2024-10-07 11:33:18.028070] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:37.636 [2024-10-07 11:33:18.028084] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:21 nsid:1 lba:78720 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:37.636 [2024-10-07 11:33:18.028096] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:37.636 [2024-10-07 11:33:18.028110] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:40 nsid:1 lba:78728 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:37.636 [2024-10-07 11:33:18.028123] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:37.636 [2024-10-07 11:33:18.028137] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:31 nsid:1 lba:78968 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:22:37.637 [2024-10-07 11:33:18.028150] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:37.637 [2024-10-07 11:33:18.028165] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:121 nsid:1 lba:78976 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:22:37.637 [2024-10-07 11:33:18.028188] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:37.637 [2024-10-07 11:33:18.028203] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:59 nsid:1 lba:78984 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:22:37.637 [2024-10-07 11:33:18.028216] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:37.637 [2024-10-07 11:33:18.028235] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:60 nsid:1 lba:78992 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:22:37.637 [2024-10-07 11:33:18.028248] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:37.637 [2024-10-07 11:33:18.028262] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:104 nsid:1 lba:79000 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:22:37.637 [2024-10-07 11:33:18.028274] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:37.637 [2024-10-07 11:33:18.028288] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:32 nsid:1 lba:79008 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:22:37.637 [2024-10-07 11:33:18.028301] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:37.637 [2024-10-07 11:33:18.028315] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:126 nsid:1 lba:79016 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:22:37.637 [2024-10-07 11:33:18.028327] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:37.637 [2024-10-07 11:33:18.028341] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:26 nsid:1 lba:79024 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:22:37.637 [2024-10-07 11:33:18.028354] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:37.637 [2024-10-07 11:33:18.028368] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:110 nsid:1 lba:79032 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:22:37.637 [2024-10-07 11:33:18.028381] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:37.637 [2024-10-07 11:33:18.028395] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:68 nsid:1 lba:79040 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:22:37.637 [2024-10-07 11:33:18.028407] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:37.637 [2024-10-07 11:33:18.028430] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:36 nsid:1 lba:79048 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:22:37.637 [2024-10-07 11:33:18.028443] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:37.637 [2024-10-07 11:33:18.028490] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:112 nsid:1 lba:79056 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:22:37.637 [2024-10-07 11:33:18.028504] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:37.637 [2024-10-07 11:33:18.028518] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:81 nsid:1 lba:79064 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:22:37.637 [2024-10-07 11:33:18.028531] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:37.637 [2024-10-07 11:33:18.028546] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:19 nsid:1 lba:79072 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:22:37.637 [2024-10-07 11:33:18.028559] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:37.637 [2024-10-07 11:33:18.028576] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:103 nsid:1 lba:79080 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:22:37.637 [2024-10-07 11:33:18.028593] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:37.637 [2024-10-07 11:33:18.028607] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:39 nsid:1 lba:79088 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:22:37.637 [2024-10-07 11:33:18.028621] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:37.637 [2024-10-07 11:33:18.028635] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:76 nsid:1 lba:79096 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:22:37.637 [2024-10-07 11:33:18.028648] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:37.637 [2024-10-07 11:33:18.028680] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:58 nsid:1 lba:79104 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:22:37.637 [2024-10-07 11:33:18.028693] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:37.637 [2024-10-07 11:33:18.028721] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:74 nsid:1 lba:79112 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:22:37.637 [2024-10-07 11:33:18.028736] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:37.637 [2024-10-07 11:33:18.028756] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:101 nsid:1 lba:79120 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:22:37.637 [2024-10-07 11:33:18.028770] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:37.637 [2024-10-07 11:33:18.028785] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:20 nsid:1 lba:79128 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:22:37.637 [2024-10-07 11:33:18.028798] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:37.637 [2024-10-07 11:33:18.028828] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:79 nsid:1 lba:79136 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:22:37.637 [2024-10-07 11:33:18.028842] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:37.637 [2024-10-07 11:33:18.028856] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:87 nsid:1 lba:79144 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:22:37.637 [2024-10-07 11:33:18.028869] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:37.637 [2024-10-07 11:33:18.028884] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:82 nsid:1 lba:79152 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:22:37.637 [2024-10-07 11:33:18.028897] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:37.637 [2024-10-07 11:33:18.028911] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:98 nsid:1 lba:79160 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:22:37.637 [2024-10-07 11:33:18.028923] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:37.637 [2024-10-07 11:33:18.028938] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:85 nsid:1 lba:79168 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:22:37.637 [2024-10-07 11:33:18.028951] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:37.637 [2024-10-07 11:33:18.028966] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:83 nsid:1 lba:79176 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:22:37.637 [2024-10-07 11:33:18.028979] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:37.637 [2024-10-07 11:33:18.029000] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:125 nsid:1 lba:79184 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:22:37.637 [2024-10-07 11:33:18.029045] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:37.637 [2024-10-07 11:33:18.029059] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:8 nsid:1 lba:79192 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:22:37.637 [2024-10-07 11:33:18.029072] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:37.637 [2024-10-07 11:33:18.029087] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:67 nsid:1 lba:79200 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:22:37.637 [2024-10-07 11:33:18.029099] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:37.637 [2024-10-07 11:33:18.029114] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:73 nsid:1 lba:79208 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:22:37.637 [2024-10-07 11:33:18.029127] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:37.637 [2024-10-07 11:33:18.029141] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:66 nsid:1 lba:79216 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:22:37.637 [2024-10-07 11:33:18.029154] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:37.637 [2024-10-07 11:33:18.029168] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:102 nsid:1 lba:79224 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:22:37.637 [2024-10-07 11:33:18.029181] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:37.637 [2024-10-07 11:33:18.029195] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:18 nsid:1 lba:79232 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:22:37.637 [2024-10-07 11:33:18.029208] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:37.637 [2024-10-07 11:33:18.029222] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:124 nsid:1 lba:79240 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:22:37.637 [2024-10-07 11:33:18.029235] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:37.637 [2024-10-07 11:33:18.029255] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:65 nsid:1 lba:79248 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:22:37.637 [2024-10-07 11:33:18.029268] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:37.637 [2024-10-07 11:33:18.029282] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:55 nsid:1 lba:79256 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:22:37.637 [2024-10-07 11:33:18.029295] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:37.637 [2024-10-07 11:33:18.029310] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:4 nsid:1 lba:79264 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:22:37.637 [2024-10-07 11:33:18.029323] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:37.637 [2024-10-07 11:33:18.029336] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:13 nsid:1 lba:79272 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:22:37.637 [2024-10-07 11:33:18.029349] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:37.637 [2024-10-07 11:33:18.029364] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:99 nsid:1 lba:79280 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:22:37.637 [2024-10-07 11:33:18.029383] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:37.637 [2024-10-07 11:33:18.029398] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:97 nsid:1 lba:79288 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:22:37.638 [2024-10-07 11:33:18.029411] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:37.638 [2024-10-07 11:33:18.029440] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:106 nsid:1 lba:79296 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:22:37.638 [2024-10-07 11:33:18.029470] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:37.638 [2024-10-07 11:33:18.029483] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a29b30 is same with the state(6) to be set 00:22:37.638 [2024-10-07 11:33:18.029499] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:22:37.638 [2024-10-07 11:33:18.029509] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:22:37.638 [2024-10-07 11:33:18.029519] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:79304 len:8 PRP1 0x0 PRP2 0x0 00:22:37.638 [2024-10-07 11:33:18.029532] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:37.638 [2024-10-07 11:33:18.029594] bdev_nvme.c:1730:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0x1a29b30 was disconnected and freed. reset controller. 00:22:37.638 [2024-10-07 11:33:18.031095] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.638 [2024-10-07 11:33:18.031184] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.638 [2024-10-07 11:33:18.031374] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.638 [2024-10-07 11:33:18.031407] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.638 [2024-10-07 11:33:18.031424] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.638 [2024-10-07 11:33:18.031449] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.638 [2024-10-07 11:33:18.031472] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.638 [2024-10-07 11:33:18.031487] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.638 [2024-10-07 11:33:18.031502] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.638 [2024-10-07 11:33:18.031528] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.638 [2024-10-07 11:33:18.042132] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.638 [2024-10-07 11:33:18.042263] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.638 [2024-10-07 11:33:18.042294] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.638 [2024-10-07 11:33:18.042311] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.638 [2024-10-07 11:33:18.044162] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.638 [2024-10-07 11:33:18.044412] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.638 [2024-10-07 11:33:18.044445] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.638 [2024-10-07 11:33:18.044514] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.638 [2024-10-07 11:33:18.044574] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.638 [2024-10-07 11:33:18.052211] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.638 [2024-10-07 11:33:18.052357] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.638 [2024-10-07 11:33:18.052395] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.638 [2024-10-07 11:33:18.052413] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.638 [2024-10-07 11:33:18.052465] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.638 [2024-10-07 11:33:18.052488] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.638 [2024-10-07 11:33:18.052502] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.638 [2024-10-07 11:33:18.052516] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.638 [2024-10-07 11:33:18.052539] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.638 [2024-10-07 11:33:18.065191] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.638 [2024-10-07 11:33:18.065371] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.638 [2024-10-07 11:33:18.065404] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.638 [2024-10-07 11:33:18.065436] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.638 [2024-10-07 11:33:18.065461] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.638 [2024-10-07 11:33:18.065484] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.638 [2024-10-07 11:33:18.065498] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.638 [2024-10-07 11:33:18.065513] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.638 [2024-10-07 11:33:18.065537] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.638 [2024-10-07 11:33:18.076050] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.638 [2024-10-07 11:33:18.076282] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.638 [2024-10-07 11:33:18.076314] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.638 [2024-10-07 11:33:18.076330] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.638 [2024-10-07 11:33:18.077605] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.638 [2024-10-07 11:33:18.079696] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.638 [2024-10-07 11:33:18.079744] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.638 [2024-10-07 11:33:18.079779] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.638 [2024-10-07 11:33:18.080138] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.638 [2024-10-07 11:33:18.086386] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.638 [2024-10-07 11:33:18.086645] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.638 [2024-10-07 11:33:18.086728] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.638 [2024-10-07 11:33:18.086750] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.638 [2024-10-07 11:33:18.086897] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.638 [2024-10-07 11:33:18.087673] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.638 [2024-10-07 11:33:18.087753] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.638 [2024-10-07 11:33:18.087773] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.638 [2024-10-07 11:33:18.088225] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.638 [2024-10-07 11:33:18.096627] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.638 [2024-10-07 11:33:18.096775] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.638 [2024-10-07 11:33:18.096805] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.638 [2024-10-07 11:33:18.096821] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.638 [2024-10-07 11:33:18.096843] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.638 [2024-10-07 11:33:18.096865] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.638 [2024-10-07 11:33:18.096878] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.638 [2024-10-07 11:33:18.096891] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.638 [2024-10-07 11:33:18.096913] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.638 [2024-10-07 11:33:18.109255] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.638 [2024-10-07 11:33:18.109495] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.638 [2024-10-07 11:33:18.109528] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.638 [2024-10-07 11:33:18.109544] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.638 [2024-10-07 11:33:18.109568] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.638 [2024-10-07 11:33:18.109590] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.638 [2024-10-07 11:33:18.109604] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.638 [2024-10-07 11:33:18.109618] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.638 [2024-10-07 11:33:18.109641] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.638 [2024-10-07 11:33:18.119733] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.638 [2024-10-07 11:33:18.119975] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.638 [2024-10-07 11:33:18.120006] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.638 [2024-10-07 11:33:18.120023] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.638 [2024-10-07 11:33:18.120148] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.638 [2024-10-07 11:33:18.120298] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.639 [2024-10-07 11:33:18.120321] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.639 [2024-10-07 11:33:18.120336] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.639 [2024-10-07 11:33:18.120462] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.639 [2024-10-07 11:33:18.130103] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.639 [2024-10-07 11:33:18.130236] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.639 [2024-10-07 11:33:18.130282] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.639 [2024-10-07 11:33:18.130299] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.639 [2024-10-07 11:33:18.130323] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.639 [2024-10-07 11:33:18.130345] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.639 [2024-10-07 11:33:18.130359] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.639 [2024-10-07 11:33:18.130373] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.639 [2024-10-07 11:33:18.130396] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.639 [2024-10-07 11:33:18.142353] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.639 [2024-10-07 11:33:18.142631] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.639 [2024-10-07 11:33:18.142669] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.639 [2024-10-07 11:33:18.142703] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.639 [2024-10-07 11:33:18.143179] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.639 [2024-10-07 11:33:18.143343] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.639 [2024-10-07 11:33:18.143369] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.639 [2024-10-07 11:33:18.143385] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.639 [2024-10-07 11:33:18.145232] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.639 [2024-10-07 11:33:18.152451] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.639 [2024-10-07 11:33:18.152586] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.639 [2024-10-07 11:33:18.152617] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.639 [2024-10-07 11:33:18.152632] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.639 [2024-10-07 11:33:18.152655] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.639 [2024-10-07 11:33:18.152692] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.639 [2024-10-07 11:33:18.152709] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.639 [2024-10-07 11:33:18.152723] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.639 [2024-10-07 11:33:18.152774] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.639 [2024-10-07 11:33:18.165417] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.639 [2024-10-07 11:33:18.165577] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.639 [2024-10-07 11:33:18.165608] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.639 [2024-10-07 11:33:18.165624] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.639 [2024-10-07 11:33:18.165647] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.639 [2024-10-07 11:33:18.165684] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.639 [2024-10-07 11:33:18.165702] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.639 [2024-10-07 11:33:18.165715] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.639 [2024-10-07 11:33:18.165738] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.639 [2024-10-07 11:33:18.178503] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.639 [2024-10-07 11:33:18.178638] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.639 [2024-10-07 11:33:18.178687] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.639 [2024-10-07 11:33:18.178706] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.639 [2024-10-07 11:33:18.178732] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.639 [2024-10-07 11:33:18.178755] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.639 [2024-10-07 11:33:18.178770] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.639 [2024-10-07 11:33:18.178785] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.639 [2024-10-07 11:33:18.178809] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.639 [2024-10-07 11:33:18.192152] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.639 [2024-10-07 11:33:18.192412] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.639 [2024-10-07 11:33:18.192452] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.639 [2024-10-07 11:33:18.192471] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.639 [2024-10-07 11:33:18.192685] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.639 [2024-10-07 11:33:18.192754] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.639 [2024-10-07 11:33:18.192777] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.639 [2024-10-07 11:33:18.192792] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.639 [2024-10-07 11:33:18.192817] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.639 [2024-10-07 11:33:18.203971] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.639 [2024-10-07 11:33:18.204297] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.639 [2024-10-07 11:33:18.204342] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.639 [2024-10-07 11:33:18.204408] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.639 [2024-10-07 11:33:18.204524] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.639 [2024-10-07 11:33:18.204580] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.639 [2024-10-07 11:33:18.204601] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.639 [2024-10-07 11:33:18.204616] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.639 [2024-10-07 11:33:18.204641] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.639 [2024-10-07 11:33:18.216609] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.639 [2024-10-07 11:33:18.217100] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.639 [2024-10-07 11:33:18.217147] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.639 [2024-10-07 11:33:18.217168] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.639 [2024-10-07 11:33:18.218734] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.639 [2024-10-07 11:33:18.219279] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.639 [2024-10-07 11:33:18.219317] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.639 [2024-10-07 11:33:18.219336] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.639 [2024-10-07 11:33:18.219588] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.639 [2024-10-07 11:33:18.227876] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.639 [2024-10-07 11:33:18.228119] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.639 [2024-10-07 11:33:18.228168] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.639 [2024-10-07 11:33:18.228188] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.639 [2024-10-07 11:33:18.228349] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.639 [2024-10-07 11:33:18.228468] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.639 [2024-10-07 11:33:18.228512] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.639 [2024-10-07 11:33:18.228530] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.639 [2024-10-07 11:33:18.228638] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.639 [2024-10-07 11:33:18.238863] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.639 [2024-10-07 11:33:18.239130] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.640 [2024-10-07 11:33:18.239170] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.640 [2024-10-07 11:33:18.239190] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.640 [2024-10-07 11:33:18.239273] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.640 [2024-10-07 11:33:18.239302] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.640 [2024-10-07 11:33:18.239344] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.640 [2024-10-07 11:33:18.239360] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.640 [2024-10-07 11:33:18.239386] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.640 [2024-10-07 11:33:18.248984] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.640 [2024-10-07 11:33:18.249112] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.640 [2024-10-07 11:33:18.249146] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.640 [2024-10-07 11:33:18.249163] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.640 [2024-10-07 11:33:18.249188] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.640 [2024-10-07 11:33:18.249212] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.640 [2024-10-07 11:33:18.249227] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.640 [2024-10-07 11:33:18.249241] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.640 [2024-10-07 11:33:18.249265] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.640 [2024-10-07 11:33:18.261143] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.640 [2024-10-07 11:33:18.261435] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.640 [2024-10-07 11:33:18.261493] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.640 [2024-10-07 11:33:18.261513] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.640 [2024-10-07 11:33:18.262258] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.640 [2024-10-07 11:33:18.262498] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.640 [2024-10-07 11:33:18.262529] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.640 [2024-10-07 11:33:18.262547] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.640 [2024-10-07 11:33:18.262574] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.640 [2024-10-07 11:33:18.271256] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.640 [2024-10-07 11:33:18.271383] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.640 [2024-10-07 11:33:18.271415] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.640 [2024-10-07 11:33:18.271432] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.640 [2024-10-07 11:33:18.273716] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.640 [2024-10-07 11:33:18.273996] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.640 [2024-10-07 11:33:18.274035] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.640 [2024-10-07 11:33:18.274054] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.640 [2024-10-07 11:33:18.274312] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.640 [2024-10-07 11:33:18.283203] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.640 [2024-10-07 11:33:18.283335] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.640 [2024-10-07 11:33:18.283368] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.640 [2024-10-07 11:33:18.283384] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.640 [2024-10-07 11:33:18.283410] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.640 [2024-10-07 11:33:18.283433] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.640 [2024-10-07 11:33:18.283448] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.640 [2024-10-07 11:33:18.283463] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.640 [2024-10-07 11:33:18.283487] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.640 [2024-10-07 11:33:18.295167] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.640 [2024-10-07 11:33:18.295565] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.640 [2024-10-07 11:33:18.295609] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.640 [2024-10-07 11:33:18.295645] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.640 [2024-10-07 11:33:18.295713] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.640 [2024-10-07 11:33:18.295750] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.640 [2024-10-07 11:33:18.295765] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.640 [2024-10-07 11:33:18.295780] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.640 [2024-10-07 11:33:18.295804] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.640 [2024-10-07 11:33:18.305946] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.640 [2024-10-07 11:33:18.306073] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.640 [2024-10-07 11:33:18.306105] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.640 [2024-10-07 11:33:18.306122] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.640 [2024-10-07 11:33:18.306145] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.640 [2024-10-07 11:33:18.306168] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.640 [2024-10-07 11:33:18.306182] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.640 [2024-10-07 11:33:18.306196] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.640 [2024-10-07 11:33:18.306219] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.640 [2024-10-07 11:33:18.318591] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.640 [2024-10-07 11:33:18.319365] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.640 [2024-10-07 11:33:18.319412] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.640 [2024-10-07 11:33:18.319434] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.640 [2024-10-07 11:33:18.319599] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.640 [2024-10-07 11:33:18.319632] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.640 [2024-10-07 11:33:18.319648] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.640 [2024-10-07 11:33:18.319678] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.640 [2024-10-07 11:33:18.319718] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.640 [2024-10-07 11:33:18.328848] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.640 [2024-10-07 11:33:18.328982] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.640 [2024-10-07 11:33:18.329029] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.640 [2024-10-07 11:33:18.329046] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.640 [2024-10-07 11:33:18.329070] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.640 [2024-10-07 11:33:18.329093] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.640 [2024-10-07 11:33:18.329107] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.640 [2024-10-07 11:33:18.329122] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.640 [2024-10-07 11:33:18.329146] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.640 [2024-10-07 11:33:18.338940] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.640 [2024-10-07 11:33:18.339095] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.640 [2024-10-07 11:33:18.339125] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.640 [2024-10-07 11:33:18.339142] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.640 [2024-10-07 11:33:18.339166] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.640 [2024-10-07 11:33:18.339187] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.640 [2024-10-07 11:33:18.339229] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.640 [2024-10-07 11:33:18.339244] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.640 [2024-10-07 11:33:18.339270] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.640 [2024-10-07 11:33:18.350202] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.640 [2024-10-07 11:33:18.350480] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.640 [2024-10-07 11:33:18.350515] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.640 [2024-10-07 11:33:18.350533] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.640 [2024-10-07 11:33:18.350654] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.640 [2024-10-07 11:33:18.351820] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.640 [2024-10-07 11:33:18.351856] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.640 [2024-10-07 11:33:18.351919] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.640 [2024-10-07 11:33:18.352180] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.641 [2024-10-07 11:33:18.360306] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.641 [2024-10-07 11:33:18.360455] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.641 [2024-10-07 11:33:18.360486] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.641 [2024-10-07 11:33:18.360503] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.641 [2024-10-07 11:33:18.360529] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.641 [2024-10-07 11:33:18.360551] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.641 [2024-10-07 11:33:18.360566] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.641 [2024-10-07 11:33:18.360581] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.641 [2024-10-07 11:33:18.360605] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.641 [2024-10-07 11:33:18.372929] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.641 [2024-10-07 11:33:18.374998] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.641 [2024-10-07 11:33:18.375117] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.641 [2024-10-07 11:33:18.375170] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.641 [2024-10-07 11:33:18.375528] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.641 [2024-10-07 11:33:18.375809] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.641 [2024-10-07 11:33:18.375868] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.641 [2024-10-07 11:33:18.375900] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.641 [2024-10-07 11:33:18.376056] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.641 [2024-10-07 11:33:18.383090] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.641 [2024-10-07 11:33:18.383311] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.641 [2024-10-07 11:33:18.383348] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.641 [2024-10-07 11:33:18.383368] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.641 [2024-10-07 11:33:18.383409] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.641 [2024-10-07 11:33:18.383452] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.641 [2024-10-07 11:33:18.383482] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.641 [2024-10-07 11:33:18.383508] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.641 [2024-10-07 11:33:18.387620] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.641 [2024-10-07 11:33:18.393199] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.641 [2024-10-07 11:33:18.393356] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.641 [2024-10-07 11:33:18.393406] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.641 [2024-10-07 11:33:18.393424] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.641 [2024-10-07 11:33:18.393450] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.641 [2024-10-07 11:33:18.393472] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.641 [2024-10-07 11:33:18.393487] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.641 [2024-10-07 11:33:18.393502] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.641 [2024-10-07 11:33:18.393525] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.641 [2024-10-07 11:33:18.405064] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.641 [2024-10-07 11:33:18.405247] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.641 [2024-10-07 11:33:18.405281] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.641 [2024-10-07 11:33:18.405299] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.641 [2024-10-07 11:33:18.405325] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.641 [2024-10-07 11:33:18.405348] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.641 [2024-10-07 11:33:18.405363] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.641 [2024-10-07 11:33:18.405385] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.641 [2024-10-07 11:33:18.405409] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.641 [2024-10-07 11:33:18.415834] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.641 [2024-10-07 11:33:18.416147] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.641 [2024-10-07 11:33:18.416185] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.641 [2024-10-07 11:33:18.416205] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.641 [2024-10-07 11:33:18.416318] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.641 [2024-10-07 11:33:18.416725] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.641 [2024-10-07 11:33:18.416762] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.641 [2024-10-07 11:33:18.416780] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.641 [2024-10-07 11:33:18.417535] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.641 [2024-10-07 11:33:18.425939] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.641 [2024-10-07 11:33:18.426084] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.641 [2024-10-07 11:33:18.426116] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.641 [2024-10-07 11:33:18.426133] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.641 [2024-10-07 11:33:18.426158] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.641 [2024-10-07 11:33:18.426204] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.641 [2024-10-07 11:33:18.426219] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.641 [2024-10-07 11:33:18.426233] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.641 [2024-10-07 11:33:18.426256] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.641 [2024-10-07 11:33:18.436036] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.641 [2024-10-07 11:33:18.436178] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.641 [2024-10-07 11:33:18.436209] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.641 [2024-10-07 11:33:18.436226] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.641 [2024-10-07 11:33:18.436250] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.641 [2024-10-07 11:33:18.436273] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.641 [2024-10-07 11:33:18.436287] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.641 [2024-10-07 11:33:18.436302] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.641 [2024-10-07 11:33:18.436325] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.641 [2024-10-07 11:33:18.448908] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.641 [2024-10-07 11:33:18.449706] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.641 [2024-10-07 11:33:18.449765] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.641 [2024-10-07 11:33:18.449786] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.641 [2024-10-07 11:33:18.451007] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.641 [2024-10-07 11:33:18.452550] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.641 [2024-10-07 11:33:18.452586] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.641 [2024-10-07 11:33:18.452622] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.641 [2024-10-07 11:33:18.453047] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.641 [2024-10-07 11:33:18.460349] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.641 [2024-10-07 11:33:18.460584] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.641 [2024-10-07 11:33:18.460618] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.641 [2024-10-07 11:33:18.460636] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.641 [2024-10-07 11:33:18.460779] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.641 [2024-10-07 11:33:18.460909] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.641 [2024-10-07 11:33:18.460940] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.641 [2024-10-07 11:33:18.460959] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.641 [2024-10-07 11:33:18.462000] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.641 [2024-10-07 11:33:18.470933] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.641 [2024-10-07 11:33:18.471167] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.641 [2024-10-07 11:33:18.471238] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.641 [2024-10-07 11:33:18.471260] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.641 [2024-10-07 11:33:18.472730] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.641 [2024-10-07 11:33:18.472826] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.642 [2024-10-07 11:33:18.472849] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.642 [2024-10-07 11:33:18.472864] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.642 [2024-10-07 11:33:18.472888] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.642 [2024-10-07 11:33:18.481025] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.642 [2024-10-07 11:33:18.481164] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.642 [2024-10-07 11:33:18.481195] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.642 [2024-10-07 11:33:18.481211] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.642 [2024-10-07 11:33:18.481235] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.642 [2024-10-07 11:33:18.481257] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.642 [2024-10-07 11:33:18.481271] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.642 [2024-10-07 11:33:18.481285] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.642 [2024-10-07 11:33:18.481317] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.642 [2024-10-07 11:33:18.493246] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.642 [2024-10-07 11:33:18.493396] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.642 [2024-10-07 11:33:18.493428] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.642 [2024-10-07 11:33:18.493445] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.642 [2024-10-07 11:33:18.493469] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.642 [2024-10-07 11:33:18.493491] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.642 [2024-10-07 11:33:18.493512] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.642 [2024-10-07 11:33:18.493525] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.642 [2024-10-07 11:33:18.493807] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.642 [2024-10-07 11:33:18.507960] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.642 [2024-10-07 11:33:18.508176] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.642 [2024-10-07 11:33:18.508208] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.642 [2024-10-07 11:33:18.508248] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.642 [2024-10-07 11:33:18.508273] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.642 [2024-10-07 11:33:18.508296] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.642 [2024-10-07 11:33:18.508310] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.642 [2024-10-07 11:33:18.508323] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.642 [2024-10-07 11:33:18.508346] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.642 [2024-10-07 11:33:18.518555] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.642 [2024-10-07 11:33:18.518837] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.642 [2024-10-07 11:33:18.518885] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.642 [2024-10-07 11:33:18.518901] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.642 [2024-10-07 11:33:18.519291] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.642 [2024-10-07 11:33:18.520099] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.642 [2024-10-07 11:33:18.520134] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.642 [2024-10-07 11:33:18.520169] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.642 [2024-10-07 11:33:18.522195] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.642 [2024-10-07 11:33:18.528668] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.642 [2024-10-07 11:33:18.528805] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.642 [2024-10-07 11:33:18.528835] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.642 [2024-10-07 11:33:18.528851] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.642 [2024-10-07 11:33:18.528874] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.642 [2024-10-07 11:33:18.528896] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.642 [2024-10-07 11:33:18.528910] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.642 [2024-10-07 11:33:18.528924] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.642 [2024-10-07 11:33:18.528947] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.642 [2024-10-07 11:33:18.541199] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.642 [2024-10-07 11:33:18.541365] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.642 [2024-10-07 11:33:18.541396] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.642 [2024-10-07 11:33:18.541412] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.642 [2024-10-07 11:33:18.541435] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.642 [2024-10-07 11:33:18.541481] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.642 [2024-10-07 11:33:18.541497] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.642 [2024-10-07 11:33:18.541510] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.642 [2024-10-07 11:33:18.542385] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.642 [2024-10-07 11:33:18.556206] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.642 [2024-10-07 11:33:18.556423] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.642 [2024-10-07 11:33:18.556456] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.642 [2024-10-07 11:33:18.556472] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.642 [2024-10-07 11:33:18.556495] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.642 [2024-10-07 11:33:18.556518] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.642 [2024-10-07 11:33:18.556532] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.642 [2024-10-07 11:33:18.556546] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.642 [2024-10-07 11:33:18.556569] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.642 [2024-10-07 11:33:18.569361] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.642 [2024-10-07 11:33:18.570044] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.642 [2024-10-07 11:33:18.570102] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.642 [2024-10-07 11:33:18.570138] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.642 [2024-10-07 11:33:18.570347] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.642 [2024-10-07 11:33:18.570506] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.642 [2024-10-07 11:33:18.570530] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.642 [2024-10-07 11:33:18.570553] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.642 [2024-10-07 11:33:18.570772] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.642 [2024-10-07 11:33:18.580233] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.642 [2024-10-07 11:33:18.580368] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.642 [2024-10-07 11:33:18.580399] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.642 [2024-10-07 11:33:18.580416] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.642 [2024-10-07 11:33:18.580713] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.642 [2024-10-07 11:33:18.580869] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.642 [2024-10-07 11:33:18.580903] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.642 [2024-10-07 11:33:18.580921] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.642 [2024-10-07 11:33:18.581063] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.642 [2024-10-07 11:33:18.590323] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.642 [2024-10-07 11:33:18.590512] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.642 [2024-10-07 11:33:18.590544] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.642 [2024-10-07 11:33:18.590572] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.642 [2024-10-07 11:33:18.590744] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.642 [2024-10-07 11:33:18.590894] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.642 [2024-10-07 11:33:18.590917] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.642 [2024-10-07 11:33:18.590932] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.642 [2024-10-07 11:33:18.591120] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.642 [2024-10-07 11:33:18.602059] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.642 [2024-10-07 11:33:18.603575] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.642 [2024-10-07 11:33:18.603626] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.642 [2024-10-07 11:33:18.603660] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.642 [2024-10-07 11:33:18.603849] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.643 [2024-10-07 11:33:18.603900] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.643 [2024-10-07 11:33:18.603917] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.643 [2024-10-07 11:33:18.603932] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.643 [2024-10-07 11:33:18.603956] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.643 [2024-10-07 11:33:18.612150] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.643 [2024-10-07 11:33:18.612271] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.643 [2024-10-07 11:33:18.612302] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.643 [2024-10-07 11:33:18.612329] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.643 [2024-10-07 11:33:18.612364] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.643 [2024-10-07 11:33:18.612403] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.643 [2024-10-07 11:33:18.612417] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.643 [2024-10-07 11:33:18.612446] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.643 [2024-10-07 11:33:18.613985] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.643 [2024-10-07 11:33:18.622442] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.643 [2024-10-07 11:33:18.622583] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.643 [2024-10-07 11:33:18.622615] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.643 [2024-10-07 11:33:18.622673] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.643 [2024-10-07 11:33:18.622702] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.643 [2024-10-07 11:33:18.622725] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.643 [2024-10-07 11:33:18.622739] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.643 [2024-10-07 11:33:18.622754] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.643 [2024-10-07 11:33:18.622778] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.643 [2024-10-07 11:33:18.634018] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.643 [2024-10-07 11:33:18.634154] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.643 [2024-10-07 11:33:18.634195] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.643 [2024-10-07 11:33:18.634211] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.643 [2024-10-07 11:33:18.634234] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.643 [2024-10-07 11:33:18.634257] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.643 [2024-10-07 11:33:18.634270] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.643 [2024-10-07 11:33:18.634283] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.643 [2024-10-07 11:33:18.634305] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.643 [2024-10-07 11:33:18.644409] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.643 [2024-10-07 11:33:18.644650] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.643 [2024-10-07 11:33:18.644721] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.643 [2024-10-07 11:33:18.644743] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.643 [2024-10-07 11:33:18.644874] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.643 [2024-10-07 11:33:18.644979] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.643 [2024-10-07 11:33:18.645000] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.643 [2024-10-07 11:33:18.645030] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.643 [2024-10-07 11:33:18.647572] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.643 [2024-10-07 11:33:18.654505] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.643 [2024-10-07 11:33:18.654614] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.643 [2024-10-07 11:33:18.654645] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.643 [2024-10-07 11:33:18.654678] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.643 [2024-10-07 11:33:18.654704] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.643 [2024-10-07 11:33:18.654726] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.643 [2024-10-07 11:33:18.654765] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.643 [2024-10-07 11:33:18.654780] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.643 [2024-10-07 11:33:18.654804] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.643 [2024-10-07 11:33:18.664582] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.643 [2024-10-07 11:33:18.664720] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.643 [2024-10-07 11:33:18.664750] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.643 [2024-10-07 11:33:18.664765] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.643 [2024-10-07 11:33:18.664788] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.643 [2024-10-07 11:33:18.664808] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.643 [2024-10-07 11:33:18.664822] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.643 [2024-10-07 11:33:18.664835] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.643 [2024-10-07 11:33:18.664856] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.643 [2024-10-07 11:33:18.678333] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.643 [2024-10-07 11:33:18.678598] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.643 [2024-10-07 11:33:18.678632] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.643 [2024-10-07 11:33:18.678649] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.643 [2024-10-07 11:33:18.678673] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.643 [2024-10-07 11:33:18.678697] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.643 [2024-10-07 11:33:18.678728] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.643 [2024-10-07 11:33:18.678742] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.643 [2024-10-07 11:33:18.678767] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.643 [2024-10-07 11:33:18.692417] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.643 [2024-10-07 11:33:18.692534] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.643 [2024-10-07 11:33:18.692563] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.643 [2024-10-07 11:33:18.692579] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.643 [2024-10-07 11:33:18.692601] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.643 [2024-10-07 11:33:18.692621] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.643 [2024-10-07 11:33:18.692634] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.643 [2024-10-07 11:33:18.692647] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.643 [2024-10-07 11:33:18.692682] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.643 [2024-10-07 11:33:18.703967] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.643 [2024-10-07 11:33:18.704207] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.643 [2024-10-07 11:33:18.704238] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.643 [2024-10-07 11:33:18.704254] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.643 [2024-10-07 11:33:18.704349] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.643 [2024-10-07 11:33:18.704445] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.643 [2024-10-07 11:33:18.704463] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.643 [2024-10-07 11:33:18.704476] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.643 [2024-10-07 11:33:18.706783] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.644 [2024-10-07 11:33:18.714453] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.644 [2024-10-07 11:33:18.715393] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.644 [2024-10-07 11:33:18.715437] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.644 [2024-10-07 11:33:18.715457] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.644 [2024-10-07 11:33:18.715635] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.644 [2024-10-07 11:33:18.715768] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.644 [2024-10-07 11:33:18.715789] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.644 [2024-10-07 11:33:18.715802] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.644 [2024-10-07 11:33:18.715895] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.644 [2024-10-07 11:33:18.725192] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.644 [2024-10-07 11:33:18.725310] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.644 [2024-10-07 11:33:18.725339] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.644 [2024-10-07 11:33:18.725355] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.644 [2024-10-07 11:33:18.725376] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.644 [2024-10-07 11:33:18.725398] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.644 [2024-10-07 11:33:18.725411] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.644 [2024-10-07 11:33:18.725424] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.644 [2024-10-07 11:33:18.725446] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.644 [2024-10-07 11:33:18.735287] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.644 [2024-10-07 11:33:18.735406] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.644 [2024-10-07 11:33:18.735453] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.644 [2024-10-07 11:33:18.735471] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.644 [2024-10-07 11:33:18.735524] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.644 [2024-10-07 11:33:18.735572] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.644 [2024-10-07 11:33:18.735586] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.644 [2024-10-07 11:33:18.735600] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.644 [2024-10-07 11:33:18.735623] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.644 [2024-10-07 11:33:18.745369] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.644 [2024-10-07 11:33:18.745626] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.644 [2024-10-07 11:33:18.745675] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.644 [2024-10-07 11:33:18.745695] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.644 [2024-10-07 11:33:18.745832] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.644 [2024-10-07 11:33:18.745944] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.644 [2024-10-07 11:33:18.745965] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.644 [2024-10-07 11:33:18.745978] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.644 [2024-10-07 11:33:18.746121] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.644 [2024-10-07 11:33:18.756534] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.644 [2024-10-07 11:33:18.756780] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.644 [2024-10-07 11:33:18.756818] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.644 [2024-10-07 11:33:18.756837] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.644 [2024-10-07 11:33:18.756991] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.644 [2024-10-07 11:33:18.757134] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.644 [2024-10-07 11:33:18.757168] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.644 [2024-10-07 11:33:18.757185] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.644 [2024-10-07 11:33:18.757285] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.644 [2024-10-07 11:33:18.766631] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.644 [2024-10-07 11:33:18.766772] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.644 [2024-10-07 11:33:18.766803] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.644 [2024-10-07 11:33:18.766845] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.644 [2024-10-07 11:33:18.766868] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.644 [2024-10-07 11:33:18.766889] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.644 [2024-10-07 11:33:18.766903] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.644 [2024-10-07 11:33:18.766942] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.644 [2024-10-07 11:33:18.766966] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.644 [2024-10-07 11:33:18.776951] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.644 [2024-10-07 11:33:18.777077] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.644 [2024-10-07 11:33:18.777107] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.644 [2024-10-07 11:33:18.777123] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.644 [2024-10-07 11:33:18.777146] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.644 [2024-10-07 11:33:18.777167] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.644 [2024-10-07 11:33:18.777182] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.644 [2024-10-07 11:33:18.777195] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.644 [2024-10-07 11:33:18.777217] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.644 [2024-10-07 11:33:18.787173] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.644 [2024-10-07 11:33:18.787326] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.644 [2024-10-07 11:33:18.787358] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.644 [2024-10-07 11:33:18.787376] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.644 [2024-10-07 11:33:18.787401] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.644 [2024-10-07 11:33:18.787424] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.644 [2024-10-07 11:33:18.787439] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.644 [2024-10-07 11:33:18.787453] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.644 [2024-10-07 11:33:18.787477] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.644 [2024-10-07 11:33:18.799788] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.644 [2024-10-07 11:33:18.799914] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.644 [2024-10-07 11:33:18.799944] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.644 [2024-10-07 11:33:18.799967] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.644 [2024-10-07 11:33:18.799990] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.644 [2024-10-07 11:33:18.800012] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.644 [2024-10-07 11:33:18.800026] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.644 [2024-10-07 11:33:18.800039] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.644 [2024-10-07 11:33:18.800061] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.644 [2024-10-07 11:33:18.814303] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.644 [2024-10-07 11:33:18.815082] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.644 [2024-10-07 11:33:18.815164] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.644 [2024-10-07 11:33:18.815201] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.644 [2024-10-07 11:33:18.815624] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.644 [2024-10-07 11:33:18.815765] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.644 [2024-10-07 11:33:18.815796] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.644 [2024-10-07 11:33:18.815812] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.644 [2024-10-07 11:33:18.815978] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.644 [2024-10-07 11:33:18.829328] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.644 [2024-10-07 11:33:18.829466] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.644 [2024-10-07 11:33:18.829498] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.644 [2024-10-07 11:33:18.829515] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.644 [2024-10-07 11:33:18.829539] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.644 [2024-10-07 11:33:18.829566] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.644 [2024-10-07 11:33:18.829581] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.645 [2024-10-07 11:33:18.829610] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.645 [2024-10-07 11:33:18.829632] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.645 [2024-10-07 11:33:18.841125] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.645 [2024-10-07 11:33:18.841258] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.645 [2024-10-07 11:33:18.841290] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.645 [2024-10-07 11:33:18.841306] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.645 [2024-10-07 11:33:18.841329] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.645 [2024-10-07 11:33:18.841351] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.645 [2024-10-07 11:33:18.841364] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.645 [2024-10-07 11:33:18.841378] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.645 [2024-10-07 11:33:18.841400] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.645 [2024-10-07 11:33:18.851650] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.645 [2024-10-07 11:33:18.851837] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.645 [2024-10-07 11:33:18.851873] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.645 [2024-10-07 11:33:18.851889] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.645 [2024-10-07 11:33:18.851912] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.645 [2024-10-07 11:33:18.851968] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.645 [2024-10-07 11:33:18.851983] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.645 [2024-10-07 11:33:18.851996] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.645 [2024-10-07 11:33:18.852018] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.645 [2024-10-07 11:33:18.863842] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.645 [2024-10-07 11:33:18.864084] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.645 [2024-10-07 11:33:18.864127] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.645 [2024-10-07 11:33:18.864146] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.645 [2024-10-07 11:33:18.864275] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.645 [2024-10-07 11:33:18.864412] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.645 [2024-10-07 11:33:18.864434] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.645 [2024-10-07 11:33:18.864449] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.645 [2024-10-07 11:33:18.864558] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.645 [2024-10-07 11:33:18.875047] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.645 [2024-10-07 11:33:18.875363] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.645 [2024-10-07 11:33:18.875408] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.645 [2024-10-07 11:33:18.875429] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.645 [2024-10-07 11:33:18.875598] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.645 [2024-10-07 11:33:18.875766] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.645 [2024-10-07 11:33:18.875793] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.645 [2024-10-07 11:33:18.875807] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.645 [2024-10-07 11:33:18.875923] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.645 [2024-10-07 11:33:18.885469] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.645 [2024-10-07 11:33:18.885593] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.645 [2024-10-07 11:33:18.885623] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.645 [2024-10-07 11:33:18.885639] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.645 [2024-10-07 11:33:18.886085] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.645 [2024-10-07 11:33:18.886323] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.645 [2024-10-07 11:33:18.886366] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.645 [2024-10-07 11:33:18.886383] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.645 [2024-10-07 11:33:18.886495] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.645 8754.00 IOPS, 34.20 MiB/s [2024-10-07T11:33:33.168Z] [2024-10-07 11:33:18.900574] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.645 [2024-10-07 11:33:18.900904] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.645 [2024-10-07 11:33:18.900945] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.645 [2024-10-07 11:33:18.900969] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.645 [2024-10-07 11:33:18.901032] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.645 [2024-10-07 11:33:18.901061] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.645 [2024-10-07 11:33:18.901076] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.645 [2024-10-07 11:33:18.901089] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.645 [2024-10-07 11:33:18.901111] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.645 [2024-10-07 11:33:18.911794] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.645 [2024-10-07 11:33:18.912064] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.645 [2024-10-07 11:33:18.912097] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.645 [2024-10-07 11:33:18.912114] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.645 [2024-10-07 11:33:18.912539] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.645 [2024-10-07 11:33:18.913787] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.645 [2024-10-07 11:33:18.913824] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.645 [2024-10-07 11:33:18.913853] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.645 [2024-10-07 11:33:18.914206] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.645 [2024-10-07 11:33:18.923129] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.645 [2024-10-07 11:33:18.923426] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.645 [2024-10-07 11:33:18.923473] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.645 [2024-10-07 11:33:18.923493] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.645 [2024-10-07 11:33:18.923857] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.645 [2024-10-07 11:33:18.924086] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.645 [2024-10-07 11:33:18.924122] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.645 [2024-10-07 11:33:18.924140] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.645 [2024-10-07 11:33:18.924253] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.645 [2024-10-07 11:33:18.933413] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.645 [2024-10-07 11:33:18.933557] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.645 [2024-10-07 11:33:18.933611] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.645 [2024-10-07 11:33:18.933630] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.645 [2024-10-07 11:33:18.933656] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.645 [2024-10-07 11:33:18.933698] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.645 [2024-10-07 11:33:18.933714] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.645 [2024-10-07 11:33:18.933729] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.645 [2024-10-07 11:33:18.933753] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.645 [2024-10-07 11:33:18.949131] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.645 [2024-10-07 11:33:18.950060] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.645 [2024-10-07 11:33:18.950121] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.645 [2024-10-07 11:33:18.950142] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.645 [2024-10-07 11:33:18.950706] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.645 [2024-10-07 11:33:18.950950] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.645 [2024-10-07 11:33:18.951038] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.645 [2024-10-07 11:33:18.951057] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.645 [2024-10-07 11:33:18.951285] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.645 [2024-10-07 11:33:18.960318] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.645 [2024-10-07 11:33:18.962574] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.645 [2024-10-07 11:33:18.962636] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.645 [2024-10-07 11:33:18.962656] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.645 [2024-10-07 11:33:18.963152] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.646 [2024-10-07 11:33:18.963586] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.646 [2024-10-07 11:33:18.963635] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.646 [2024-10-07 11:33:18.963693] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.646 [2024-10-07 11:33:18.963917] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.646 [2024-10-07 11:33:18.971010] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.646 [2024-10-07 11:33:18.971136] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.646 [2024-10-07 11:33:18.971166] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.646 [2024-10-07 11:33:18.971182] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.646 [2024-10-07 11:33:18.971239] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.646 [2024-10-07 11:33:18.971307] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.646 [2024-10-07 11:33:18.971327] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.646 [2024-10-07 11:33:18.971342] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.646 [2024-10-07 11:33:18.971366] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.646 [2024-10-07 11:33:18.981108] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.646 [2024-10-07 11:33:18.981259] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.646 [2024-10-07 11:33:18.981291] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.646 [2024-10-07 11:33:18.981308] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.646 [2024-10-07 11:33:18.981332] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.646 [2024-10-07 11:33:18.981354] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.646 [2024-10-07 11:33:18.981369] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.646 [2024-10-07 11:33:18.981383] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.646 [2024-10-07 11:33:18.981406] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.646 [2024-10-07 11:33:18.994498] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.646 [2024-10-07 11:33:18.994824] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.646 [2024-10-07 11:33:18.994885] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.646 [2024-10-07 11:33:18.994906] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.646 [2024-10-07 11:33:18.995035] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.646 [2024-10-07 11:33:18.995269] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.646 [2024-10-07 11:33:18.995307] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.646 [2024-10-07 11:33:18.995326] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.646 [2024-10-07 11:33:18.995383] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.646 [2024-10-07 11:33:19.009288] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.646 [2024-10-07 11:33:19.009433] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.646 [2024-10-07 11:33:19.009464] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.646 [2024-10-07 11:33:19.009481] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.646 [2024-10-07 11:33:19.009505] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.646 [2024-10-07 11:33:19.009527] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.646 [2024-10-07 11:33:19.009541] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.646 [2024-10-07 11:33:19.009555] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.646 [2024-10-07 11:33:19.009577] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.646 [2024-10-07 11:33:19.024967] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.646 [2024-10-07 11:33:19.025123] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.646 [2024-10-07 11:33:19.025158] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.646 [2024-10-07 11:33:19.025175] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.646 [2024-10-07 11:33:19.025200] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.646 [2024-10-07 11:33:19.025223] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.646 [2024-10-07 11:33:19.025239] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.646 [2024-10-07 11:33:19.025255] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.646 [2024-10-07 11:33:19.025280] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.646 [2024-10-07 11:33:19.036650] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.646 [2024-10-07 11:33:19.036910] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.646 [2024-10-07 11:33:19.036946] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.646 [2024-10-07 11:33:19.036972] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.646 [2024-10-07 11:33:19.037154] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.646 [2024-10-07 11:33:19.037284] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.646 [2024-10-07 11:33:19.037307] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.646 [2024-10-07 11:33:19.037324] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.646 [2024-10-07 11:33:19.039230] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.646 [2024-10-07 11:33:19.046773] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.646 [2024-10-07 11:33:19.046939] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.646 [2024-10-07 11:33:19.046971] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.646 [2024-10-07 11:33:19.046988] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.646 [2024-10-07 11:33:19.047013] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.646 [2024-10-07 11:33:19.047036] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.646 [2024-10-07 11:33:19.047050] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.646 [2024-10-07 11:33:19.047064] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.646 [2024-10-07 11:33:19.047086] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.646 [2024-10-07 11:33:19.056889] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.646 [2024-10-07 11:33:19.057017] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.646 [2024-10-07 11:33:19.057049] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.646 [2024-10-07 11:33:19.057103] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.646 [2024-10-07 11:33:19.057130] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.646 [2024-10-07 11:33:19.057153] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.646 [2024-10-07 11:33:19.057168] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.646 [2024-10-07 11:33:19.057182] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.646 [2024-10-07 11:33:19.057206] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.646 [2024-10-07 11:33:19.068349] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.646 [2024-10-07 11:33:19.068691] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.646 [2024-10-07 11:33:19.068736] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.646 [2024-10-07 11:33:19.068757] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.646 [2024-10-07 11:33:19.068913] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.646 [2024-10-07 11:33:19.069147] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.646 [2024-10-07 11:33:19.069183] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.646 [2024-10-07 11:33:19.069200] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.646 [2024-10-07 11:33:19.069699] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.646 [2024-10-07 11:33:19.078481] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.646 [2024-10-07 11:33:19.078600] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.646 [2024-10-07 11:33:19.078632] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.646 [2024-10-07 11:33:19.078665] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.646 [2024-10-07 11:33:19.078693] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.646 [2024-10-07 11:33:19.078716] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.646 [2024-10-07 11:33:19.078731] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.646 [2024-10-07 11:33:19.078746] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.646 [2024-10-07 11:33:19.078771] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.646 [2024-10-07 11:33:19.088560] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.646 [2024-10-07 11:33:19.088705] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.646 [2024-10-07 11:33:19.088737] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.646 [2024-10-07 11:33:19.088754] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.647 [2024-10-07 11:33:19.088778] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.647 [2024-10-07 11:33:19.088800] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.647 [2024-10-07 11:33:19.088838] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.647 [2024-10-07 11:33:19.088853] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.647 [2024-10-07 11:33:19.088877] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.647 [2024-10-07 11:33:19.100093] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.647 [2024-10-07 11:33:19.100391] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.647 [2024-10-07 11:33:19.100434] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.647 [2024-10-07 11:33:19.100454] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.647 [2024-10-07 11:33:19.100642] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.647 [2024-10-07 11:33:19.100737] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.647 [2024-10-07 11:33:19.100759] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.647 [2024-10-07 11:33:19.100772] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.647 [2024-10-07 11:33:19.100795] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.647 [2024-10-07 11:33:19.112837] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.647 [2024-10-07 11:33:19.113079] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.647 [2024-10-07 11:33:19.113118] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.647 [2024-10-07 11:33:19.113136] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.647 [2024-10-07 11:33:19.113260] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.647 [2024-10-07 11:33:19.113370] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.647 [2024-10-07 11:33:19.113391] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.647 [2024-10-07 11:33:19.113406] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.647 [2024-10-07 11:33:19.113513] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.647 [2024-10-07 11:33:19.123178] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.647 [2024-10-07 11:33:19.123427] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.647 [2024-10-07 11:33:19.123462] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.647 [2024-10-07 11:33:19.123479] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.647 [2024-10-07 11:33:19.123608] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.647 [2024-10-07 11:33:19.125465] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.647 [2024-10-07 11:33:19.125501] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.647 [2024-10-07 11:33:19.125536] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.647 [2024-10-07 11:33:19.127606] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.647 [2024-10-07 11:33:19.133298] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.647 [2024-10-07 11:33:19.133461] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.647 [2024-10-07 11:33:19.133491] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.647 [2024-10-07 11:33:19.133506] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.647 [2024-10-07 11:33:19.133764] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.647 [2024-10-07 11:33:19.133910] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.647 [2024-10-07 11:33:19.133943] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.647 [2024-10-07 11:33:19.133966] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.647 [2024-10-07 11:33:19.134120] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.647 [2024-10-07 11:33:19.143422] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.647 [2024-10-07 11:33:19.143563] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.647 [2024-10-07 11:33:19.143594] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.647 [2024-10-07 11:33:19.143611] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.647 [2024-10-07 11:33:19.143633] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.647 [2024-10-07 11:33:19.143655] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.647 [2024-10-07 11:33:19.143684] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.647 [2024-10-07 11:33:19.143714] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.647 [2024-10-07 11:33:19.143736] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.647 [2024-10-07 11:33:19.154210] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.647 [2024-10-07 11:33:19.156711] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.647 [2024-10-07 11:33:19.156751] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.647 [2024-10-07 11:33:19.156769] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.647 [2024-10-07 11:33:19.157094] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.647 [2024-10-07 11:33:19.157266] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.647 [2024-10-07 11:33:19.157300] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.647 [2024-10-07 11:33:19.157317] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.647 [2024-10-07 11:33:19.157427] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.647 [2024-10-07 11:33:19.166193] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.647 [2024-10-07 11:33:19.166558] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.647 [2024-10-07 11:33:19.166602] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.647 [2024-10-07 11:33:19.166623] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.647 [2024-10-07 11:33:19.166740] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.647 [2024-10-07 11:33:19.166771] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.647 [2024-10-07 11:33:19.166787] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.647 [2024-10-07 11:33:19.166801] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.647 [2024-10-07 11:33:19.166858] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.647 [2024-10-07 11:33:19.177020] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.647 [2024-10-07 11:33:19.177263] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.647 [2024-10-07 11:33:19.177294] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.647 [2024-10-07 11:33:19.177310] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.647 [2024-10-07 11:33:19.177394] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.647 [2024-10-07 11:33:19.177446] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.647 [2024-10-07 11:33:19.177467] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.647 [2024-10-07 11:33:19.177480] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.647 [2024-10-07 11:33:19.177503] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.647 [2024-10-07 11:33:19.191122] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.647 [2024-10-07 11:33:19.191576] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.647 [2024-10-07 11:33:19.191619] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.647 [2024-10-07 11:33:19.191639] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.647 [2024-10-07 11:33:19.191709] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.647 [2024-10-07 11:33:19.191753] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.647 [2024-10-07 11:33:19.191768] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.647 [2024-10-07 11:33:19.191782] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.647 [2024-10-07 11:33:19.191804] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.648 [2024-10-07 11:33:19.204615] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.648 [2024-10-07 11:33:19.204762] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.648 [2024-10-07 11:33:19.204793] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.648 [2024-10-07 11:33:19.204809] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.648 [2024-10-07 11:33:19.204833] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.648 [2024-10-07 11:33:19.204855] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.648 [2024-10-07 11:33:19.204869] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.648 [2024-10-07 11:33:19.204912] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.648 [2024-10-07 11:33:19.204936] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.648 [2024-10-07 11:33:19.214726] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.648 [2024-10-07 11:33:19.215530] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.648 [2024-10-07 11:33:19.215605] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.648 [2024-10-07 11:33:19.215624] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.648 [2024-10-07 11:33:19.215824] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.648 [2024-10-07 11:33:19.215867] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.648 [2024-10-07 11:33:19.215884] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.648 [2024-10-07 11:33:19.215898] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.648 [2024-10-07 11:33:19.215921] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.648 [2024-10-07 11:33:19.226398] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.648 [2024-10-07 11:33:19.226778] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.648 [2024-10-07 11:33:19.226824] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.648 [2024-10-07 11:33:19.226844] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.648 [2024-10-07 11:33:19.227101] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.648 [2024-10-07 11:33:19.227188] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.648 [2024-10-07 11:33:19.227241] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.648 [2024-10-07 11:33:19.227257] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.648 [2024-10-07 11:33:19.227283] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.648 [2024-10-07 11:33:19.238332] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.648 [2024-10-07 11:33:19.238497] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.648 [2024-10-07 11:33:19.238529] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.648 [2024-10-07 11:33:19.238546] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.648 [2024-10-07 11:33:19.238793] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.648 [2024-10-07 11:33:19.239039] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.648 [2024-10-07 11:33:19.239072] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.648 [2024-10-07 11:33:19.239089] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.648 [2024-10-07 11:33:19.239241] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.648 [2024-10-07 11:33:19.248427] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.648 [2024-10-07 11:33:19.248553] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.648 [2024-10-07 11:33:19.248608] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.648 [2024-10-07 11:33:19.248626] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.648 [2024-10-07 11:33:19.248855] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.648 [2024-10-07 11:33:19.249055] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.648 [2024-10-07 11:33:19.249089] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.648 [2024-10-07 11:33:19.249106] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.648 [2024-10-07 11:33:19.249213] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.648 [2024-10-07 11:33:19.261169] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.648 [2024-10-07 11:33:19.261346] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.648 [2024-10-07 11:33:19.261393] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.648 [2024-10-07 11:33:19.261411] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.648 [2024-10-07 11:33:19.261435] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.648 [2024-10-07 11:33:19.261459] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.648 [2024-10-07 11:33:19.261474] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.648 [2024-10-07 11:33:19.261488] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.648 [2024-10-07 11:33:19.261512] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.648 [2024-10-07 11:33:19.276499] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.648 [2024-10-07 11:33:19.276864] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.648 [2024-10-07 11:33:19.276910] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.648 [2024-10-07 11:33:19.276932] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.648 [2024-10-07 11:33:19.277175] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.648 [2024-10-07 11:33:19.277252] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.648 [2024-10-07 11:33:19.277276] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.648 [2024-10-07 11:33:19.277292] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.648 [2024-10-07 11:33:19.277316] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.648 [2024-10-07 11:33:19.289003] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.648 [2024-10-07 11:33:19.289309] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.648 [2024-10-07 11:33:19.289343] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.648 [2024-10-07 11:33:19.289376] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.648 [2024-10-07 11:33:19.289497] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.648 [2024-10-07 11:33:19.291461] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.648 [2024-10-07 11:33:19.291509] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.648 [2024-10-07 11:33:19.291529] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.648 [2024-10-07 11:33:19.293655] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.648 [2024-10-07 11:33:19.299129] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.648 [2024-10-07 11:33:19.299599] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.648 [2024-10-07 11:33:19.299643] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.648 [2024-10-07 11:33:19.299680] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.648 [2024-10-07 11:33:19.299873] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.648 [2024-10-07 11:33:19.300001] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.648 [2024-10-07 11:33:19.300032] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.648 [2024-10-07 11:33:19.300049] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.648 [2024-10-07 11:33:19.300166] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.648 [2024-10-07 11:33:19.309224] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.648 [2024-10-07 11:33:19.309365] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.648 [2024-10-07 11:33:19.309396] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.648 [2024-10-07 11:33:19.309412] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.648 [2024-10-07 11:33:19.309435] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.648 [2024-10-07 11:33:19.309457] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.648 [2024-10-07 11:33:19.309471] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.648 [2024-10-07 11:33:19.309484] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.648 [2024-10-07 11:33:19.309506] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.648 [2024-10-07 11:33:19.321645] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.648 [2024-10-07 11:33:19.322363] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.648 [2024-10-07 11:33:19.322421] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.648 [2024-10-07 11:33:19.322462] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.648 [2024-10-07 11:33:19.323146] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.648 [2024-10-07 11:33:19.323300] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.648 [2024-10-07 11:33:19.323326] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.648 [2024-10-07 11:33:19.323342] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.649 [2024-10-07 11:33:19.323390] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.649 [2024-10-07 11:33:19.333619] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.649 [2024-10-07 11:33:19.334086] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.649 [2024-10-07 11:33:19.334130] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.649 [2024-10-07 11:33:19.334150] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.649 [2024-10-07 11:33:19.335326] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.649 [2024-10-07 11:33:19.335975] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.649 [2024-10-07 11:33:19.336013] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.649 [2024-10-07 11:33:19.336031] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.649 [2024-10-07 11:33:19.336305] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.649 [2024-10-07 11:33:19.344538] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.649 [2024-10-07 11:33:19.344800] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.649 [2024-10-07 11:33:19.344833] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.649 [2024-10-07 11:33:19.344850] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.649 [2024-10-07 11:33:19.344975] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.649 [2024-10-07 11:33:19.345100] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.649 [2024-10-07 11:33:19.345124] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.649 [2024-10-07 11:33:19.345139] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.649 [2024-10-07 11:33:19.345255] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.649 [2024-10-07 11:33:19.354815] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.649 [2024-10-07 11:33:19.355001] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.649 [2024-10-07 11:33:19.355034] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.649 [2024-10-07 11:33:19.355051] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.649 [2024-10-07 11:33:19.355075] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.649 [2024-10-07 11:33:19.355097] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.649 [2024-10-07 11:33:19.355111] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.649 [2024-10-07 11:33:19.355125] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.649 [2024-10-07 11:33:19.355177] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.649 [2024-10-07 11:33:19.364949] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.649 [2024-10-07 11:33:19.365065] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.649 [2024-10-07 11:33:19.365096] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.649 [2024-10-07 11:33:19.365135] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.649 [2024-10-07 11:33:19.365159] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.649 [2024-10-07 11:33:19.365180] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.649 [2024-10-07 11:33:19.365194] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.649 [2024-10-07 11:33:19.365207] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.649 [2024-10-07 11:33:19.365229] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.649 [2024-10-07 11:33:19.375048] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.649 [2024-10-07 11:33:19.375189] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.649 [2024-10-07 11:33:19.375259] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.649 [2024-10-07 11:33:19.375276] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.649 [2024-10-07 11:33:19.375300] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.649 [2024-10-07 11:33:19.377596] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.649 [2024-10-07 11:33:19.377633] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.649 [2024-10-07 11:33:19.377696] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.649 [2024-10-07 11:33:19.377977] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.649 [2024-10-07 11:33:19.385154] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.649 [2024-10-07 11:33:19.385286] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.649 [2024-10-07 11:33:19.385317] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.649 [2024-10-07 11:33:19.385333] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.649 [2024-10-07 11:33:19.385355] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.649 [2024-10-07 11:33:19.385376] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.649 [2024-10-07 11:33:19.385390] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.649 [2024-10-07 11:33:19.385403] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.649 [2024-10-07 11:33:19.385424] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.649 [2024-10-07 11:33:19.398521] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.649 [2024-10-07 11:33:19.398661] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.649 [2024-10-07 11:33:19.398706] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.649 [2024-10-07 11:33:19.398723] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.649 [2024-10-07 11:33:19.398748] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.649 [2024-10-07 11:33:19.398770] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.649 [2024-10-07 11:33:19.398815] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.649 [2024-10-07 11:33:19.398832] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.649 [2024-10-07 11:33:19.398865] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.649 [2024-10-07 11:33:19.411511] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.649 [2024-10-07 11:33:19.411957] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.649 [2024-10-07 11:33:19.412003] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.649 [2024-10-07 11:33:19.412023] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.649 [2024-10-07 11:33:19.412078] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.649 [2024-10-07 11:33:19.412106] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.649 [2024-10-07 11:33:19.412121] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.649 [2024-10-07 11:33:19.412135] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.649 [2024-10-07 11:33:19.412343] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.649 [2024-10-07 11:33:19.422806] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.649 [2024-10-07 11:33:19.423084] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.649 [2024-10-07 11:33:19.423118] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.649 [2024-10-07 11:33:19.423136] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.649 [2024-10-07 11:33:19.423285] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.649 [2024-10-07 11:33:19.423425] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.649 [2024-10-07 11:33:19.423458] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.649 [2024-10-07 11:33:19.423477] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.649 [2024-10-07 11:33:19.424289] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.649 [2024-10-07 11:33:19.432940] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.649 [2024-10-07 11:33:19.433086] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.649 [2024-10-07 11:33:19.433118] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.649 [2024-10-07 11:33:19.433135] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.649 [2024-10-07 11:33:19.433159] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.649 [2024-10-07 11:33:19.433184] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.649 [2024-10-07 11:33:19.433199] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.649 [2024-10-07 11:33:19.433213] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.649 [2024-10-07 11:33:19.433236] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.649 [2024-10-07 11:33:19.444562] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.649 [2024-10-07 11:33:19.446268] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.649 [2024-10-07 11:33:19.446318] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.649 [2024-10-07 11:33:19.446340] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.649 [2024-10-07 11:33:19.446592] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.649 [2024-10-07 11:33:19.446672] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.650 [2024-10-07 11:33:19.446697] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.650 [2024-10-07 11:33:19.446712] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.650 [2024-10-07 11:33:19.446739] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.650 [2024-10-07 11:33:19.456506] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.650 [2024-10-07 11:33:19.456783] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.650 [2024-10-07 11:33:19.456818] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.650 [2024-10-07 11:33:19.456836] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.650 [2024-10-07 11:33:19.456978] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.650 [2024-10-07 11:33:19.457099] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.650 [2024-10-07 11:33:19.457130] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.650 [2024-10-07 11:33:19.457149] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.650 [2024-10-07 11:33:19.457254] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.650 [2024-10-07 11:33:19.467742] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.650 [2024-10-07 11:33:19.467969] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.650 [2024-10-07 11:33:19.468012] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.650 [2024-10-07 11:33:19.468032] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.650 [2024-10-07 11:33:19.468145] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.650 [2024-10-07 11:33:19.468249] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.650 [2024-10-07 11:33:19.468274] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.650 [2024-10-07 11:33:19.468290] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.650 [2024-10-07 11:33:19.468382] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.650 [2024-10-07 11:33:19.477826] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.650 [2024-10-07 11:33:19.477938] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.650 [2024-10-07 11:33:19.477969] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.650 [2024-10-07 11:33:19.478015] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.650 [2024-10-07 11:33:19.478042] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.650 [2024-10-07 11:33:19.478065] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.650 [2024-10-07 11:33:19.478080] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.650 [2024-10-07 11:33:19.478094] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.650 [2024-10-07 11:33:19.478132] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.650 [2024-10-07 11:33:19.490855] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.650 [2024-10-07 11:33:19.491125] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.650 [2024-10-07 11:33:19.491162] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.650 [2024-10-07 11:33:19.491181] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.650 [2024-10-07 11:33:19.491312] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.650 [2024-10-07 11:33:19.491703] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.650 [2024-10-07 11:33:19.491738] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.650 [2024-10-07 11:33:19.491755] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.650 [2024-10-07 11:33:19.493686] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.650 [2024-10-07 11:33:19.503127] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.650 [2024-10-07 11:33:19.505663] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.650 [2024-10-07 11:33:19.505750] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.650 [2024-10-07 11:33:19.505774] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.650 [2024-10-07 11:33:19.506035] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.650 [2024-10-07 11:33:19.506102] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.650 [2024-10-07 11:33:19.506124] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.650 [2024-10-07 11:33:19.506141] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.650 [2024-10-07 11:33:19.506167] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.650 [2024-10-07 11:33:19.513233] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.650 [2024-10-07 11:33:19.513384] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.650 [2024-10-07 11:33:19.513418] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.650 [2024-10-07 11:33:19.513436] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.650 [2024-10-07 11:33:19.513462] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.650 [2024-10-07 11:33:19.513485] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.650 [2024-10-07 11:33:19.513511] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.650 [2024-10-07 11:33:19.513541] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.650 [2024-10-07 11:33:19.513567] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.650 [2024-10-07 11:33:19.526342] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.650 [2024-10-07 11:33:19.526520] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.650 [2024-10-07 11:33:19.526555] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.650 [2024-10-07 11:33:19.526573] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.650 [2024-10-07 11:33:19.526599] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.650 [2024-10-07 11:33:19.526623] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.650 [2024-10-07 11:33:19.526639] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.650 [2024-10-07 11:33:19.526655] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.650 [2024-10-07 11:33:19.526695] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.650 [2024-10-07 11:33:19.538373] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.650 [2024-10-07 11:33:19.538803] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.650 [2024-10-07 11:33:19.538871] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.650 [2024-10-07 11:33:19.538920] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.650 [2024-10-07 11:33:19.539105] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.650 [2024-10-07 11:33:19.539307] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.650 [2024-10-07 11:33:19.539363] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.650 [2024-10-07 11:33:19.539401] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.650 [2024-10-07 11:33:19.543606] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.650 [2024-10-07 11:33:19.550456] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.650 [2024-10-07 11:33:19.550660] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.650 [2024-10-07 11:33:19.550696] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.650 [2024-10-07 11:33:19.550716] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.650 [2024-10-07 11:33:19.550745] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.650 [2024-10-07 11:33:19.550770] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.650 [2024-10-07 11:33:19.550786] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.650 [2024-10-07 11:33:19.550801] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.650 [2024-10-07 11:33:19.550826] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.650 [2024-10-07 11:33:19.560947] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.650 [2024-10-07 11:33:19.561135] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.650 [2024-10-07 11:33:19.561169] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.650 [2024-10-07 11:33:19.561188] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.650 [2024-10-07 11:33:19.561214] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.650 [2024-10-07 11:33:19.561238] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.650 [2024-10-07 11:33:19.561253] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.650 [2024-10-07 11:33:19.561268] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.650 [2024-10-07 11:33:19.561292] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.650 [2024-10-07 11:33:19.572096] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.650 [2024-10-07 11:33:19.572772] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.650 [2024-10-07 11:33:19.572821] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.650 [2024-10-07 11:33:19.572853] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.650 [2024-10-07 11:33:19.574089] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.651 [2024-10-07 11:33:19.574683] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.651 [2024-10-07 11:33:19.574721] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.651 [2024-10-07 11:33:19.574741] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.651 [2024-10-07 11:33:19.574983] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.651 [2024-10-07 11:33:19.583266] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.651 [2024-10-07 11:33:19.583537] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.651 [2024-10-07 11:33:19.583575] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.651 [2024-10-07 11:33:19.583595] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.651 [2024-10-07 11:33:19.583746] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.651 [2024-10-07 11:33:19.583894] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.651 [2024-10-07 11:33:19.583928] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.651 [2024-10-07 11:33:19.583948] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.651 [2024-10-07 11:33:19.584057] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.651 [2024-10-07 11:33:19.594015] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.651 [2024-10-07 11:33:19.594415] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.651 [2024-10-07 11:33:19.594479] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.651 [2024-10-07 11:33:19.594501] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.651 [2024-10-07 11:33:19.594592] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.651 [2024-10-07 11:33:19.594625] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.651 [2024-10-07 11:33:19.594641] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.651 [2024-10-07 11:33:19.594674] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.651 [2024-10-07 11:33:19.594702] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.651 [2024-10-07 11:33:19.608099] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.651 [2024-10-07 11:33:19.608393] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.651 [2024-10-07 11:33:19.608430] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.651 [2024-10-07 11:33:19.608450] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.651 [2024-10-07 11:33:19.608808] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.651 [2024-10-07 11:33:19.609970] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.651 [2024-10-07 11:33:19.610013] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.651 [2024-10-07 11:33:19.610044] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.651 [2024-10-07 11:33:19.610797] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.651 [2024-10-07 11:33:19.619631] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.651 [2024-10-07 11:33:19.619870] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.651 [2024-10-07 11:33:19.619920] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.651 [2024-10-07 11:33:19.619953] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.651 [2024-10-07 11:33:19.619994] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.651 [2024-10-07 11:33:19.620043] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.651 [2024-10-07 11:33:19.620069] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.651 [2024-10-07 11:33:19.620094] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.651 [2024-10-07 11:33:19.620131] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.651 [2024-10-07 11:33:19.632217] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.651 [2024-10-07 11:33:19.632755] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.651 [2024-10-07 11:33:19.632806] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.651 [2024-10-07 11:33:19.632828] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.651 [2024-10-07 11:33:19.632972] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.651 [2024-10-07 11:33:19.633135] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.651 [2024-10-07 11:33:19.633176] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.651 [2024-10-07 11:33:19.633226] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.651 [2024-10-07 11:33:19.633295] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.651 [2024-10-07 11:33:19.646500] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.651 [2024-10-07 11:33:19.647179] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.651 [2024-10-07 11:33:19.647255] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.651 [2024-10-07 11:33:19.647278] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.651 [2024-10-07 11:33:19.647515] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.651 [2024-10-07 11:33:19.648078] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.651 [2024-10-07 11:33:19.648115] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.651 [2024-10-07 11:33:19.648158] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.651 [2024-10-07 11:33:19.648404] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.651 [2024-10-07 11:33:19.660440] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.651 [2024-10-07 11:33:19.660625] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.651 [2024-10-07 11:33:19.660659] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.651 [2024-10-07 11:33:19.660695] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.651 [2024-10-07 11:33:19.660722] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.651 [2024-10-07 11:33:19.660746] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.651 [2024-10-07 11:33:19.660761] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.651 [2024-10-07 11:33:19.660777] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.651 [2024-10-07 11:33:19.660802] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.651 [2024-10-07 11:33:19.673488] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.651 [2024-10-07 11:33:19.674539] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.651 [2024-10-07 11:33:19.674589] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.651 [2024-10-07 11:33:19.674612] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.651 [2024-10-07 11:33:19.674910] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.651 [2024-10-07 11:33:19.674976] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.651 [2024-10-07 11:33:19.674999] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.651 [2024-10-07 11:33:19.675031] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.651 [2024-10-07 11:33:19.675075] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.651 [2024-10-07 11:33:19.686420] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.651 [2024-10-07 11:33:19.686814] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.651 [2024-10-07 11:33:19.686907] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.651 [2024-10-07 11:33:19.686931] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.651 [2024-10-07 11:33:19.686995] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.651 [2024-10-07 11:33:19.687042] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.651 [2024-10-07 11:33:19.687058] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.651 [2024-10-07 11:33:19.687073] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.652 [2024-10-07 11:33:19.687099] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.652 [2024-10-07 11:33:19.698223] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.652 [2024-10-07 11:33:19.698556] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.652 [2024-10-07 11:33:19.698593] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.652 [2024-10-07 11:33:19.698612] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.652 [2024-10-07 11:33:19.698748] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.652 [2024-10-07 11:33:19.699337] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.652 [2024-10-07 11:33:19.699376] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.652 [2024-10-07 11:33:19.699395] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.652 [2024-10-07 11:33:19.701794] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.652 [2024-10-07 11:33:19.710849] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.652 [2024-10-07 11:33:19.711290] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.652 [2024-10-07 11:33:19.711339] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.652 [2024-10-07 11:33:19.711361] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.652 [2024-10-07 11:33:19.713534] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.652 [2024-10-07 11:33:19.713874] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.652 [2024-10-07 11:33:19.713911] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.652 [2024-10-07 11:33:19.713930] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.652 [2024-10-07 11:33:19.714510] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.652 [2024-10-07 11:33:19.721055] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.652 [2024-10-07 11:33:19.721223] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.652 [2024-10-07 11:33:19.721255] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.652 [2024-10-07 11:33:19.721273] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.652 [2024-10-07 11:33:19.721298] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.652 [2024-10-07 11:33:19.721516] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.652 [2024-10-07 11:33:19.721541] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.652 [2024-10-07 11:33:19.721557] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.652 [2024-10-07 11:33:19.721617] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.652 [2024-10-07 11:33:19.733767] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.652 [2024-10-07 11:33:19.733982] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.652 [2024-10-07 11:33:19.734050] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.652 [2024-10-07 11:33:19.734069] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.652 [2024-10-07 11:33:19.734097] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.652 [2024-10-07 11:33:19.734122] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.652 [2024-10-07 11:33:19.734137] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.652 [2024-10-07 11:33:19.734153] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.652 [2024-10-07 11:33:19.734178] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.652 [2024-10-07 11:33:19.748828] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.652 [2024-10-07 11:33:19.749242] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.652 [2024-10-07 11:33:19.749289] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.652 [2024-10-07 11:33:19.749311] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.652 [2024-10-07 11:33:19.749371] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.652 [2024-10-07 11:33:19.749430] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.652 [2024-10-07 11:33:19.749446] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.652 [2024-10-07 11:33:19.749461] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.652 [2024-10-07 11:33:19.749485] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.652 [2024-10-07 11:33:19.761296] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.652 [2024-10-07 11:33:19.761468] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.652 [2024-10-07 11:33:19.761502] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.652 [2024-10-07 11:33:19.761535] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.652 [2024-10-07 11:33:19.762108] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.652 [2024-10-07 11:33:19.762224] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.652 [2024-10-07 11:33:19.762249] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.652 [2024-10-07 11:33:19.762265] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.652 [2024-10-07 11:33:19.762325] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.652 [2024-10-07 11:33:19.772069] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.652 [2024-10-07 11:33:19.772303] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.652 [2024-10-07 11:33:19.772337] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.652 [2024-10-07 11:33:19.772359] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.652 [2024-10-07 11:33:19.772461] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.652 [2024-10-07 11:33:19.772822] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.652 [2024-10-07 11:33:19.772859] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.652 [2024-10-07 11:33:19.772878] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.652 [2024-10-07 11:33:19.772946] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.652 [2024-10-07 11:33:19.782186] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.652 [2024-10-07 11:33:19.782333] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.652 [2024-10-07 11:33:19.782366] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.652 [2024-10-07 11:33:19.782383] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.652 [2024-10-07 11:33:19.782423] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.652 [2024-10-07 11:33:19.782472] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.652 [2024-10-07 11:33:19.782486] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.652 [2024-10-07 11:33:19.782501] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.652 [2024-10-07 11:33:19.782524] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.652 [2024-10-07 11:33:19.792310] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.652 [2024-10-07 11:33:19.792469] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.652 [2024-10-07 11:33:19.792500] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.652 [2024-10-07 11:33:19.792517] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.652 [2024-10-07 11:33:19.792541] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.652 [2024-10-07 11:33:19.792563] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.652 [2024-10-07 11:33:19.792577] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.652 [2024-10-07 11:33:19.792592] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.652 [2024-10-07 11:33:19.792614] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.652 [2024-10-07 11:33:19.803092] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.652 [2024-10-07 11:33:19.803282] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.652 [2024-10-07 11:33:19.803316] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.652 [2024-10-07 11:33:19.803365] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.652 [2024-10-07 11:33:19.803986] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.652 [2024-10-07 11:33:19.804112] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.652 [2024-10-07 11:33:19.804136] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.652 [2024-10-07 11:33:19.804151] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.652 [2024-10-07 11:33:19.804190] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.652 [2024-10-07 11:33:19.813561] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.652 [2024-10-07 11:33:19.813805] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.652 [2024-10-07 11:33:19.813838] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.652 [2024-10-07 11:33:19.813855] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.652 [2024-10-07 11:33:19.813956] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.652 [2024-10-07 11:33:19.814073] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.653 [2024-10-07 11:33:19.814092] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.653 [2024-10-07 11:33:19.814107] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.653 [2024-10-07 11:33:19.814410] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.653 [2024-10-07 11:33:19.823677] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.653 [2024-10-07 11:33:19.823843] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.653 [2024-10-07 11:33:19.823874] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.653 [2024-10-07 11:33:19.823891] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.653 [2024-10-07 11:33:19.823915] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.653 [2024-10-07 11:33:19.823937] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.653 [2024-10-07 11:33:19.823960] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.653 [2024-10-07 11:33:19.823975] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.653 [2024-10-07 11:33:19.823998] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.653 [2024-10-07 11:33:19.834116] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.653 [2024-10-07 11:33:19.834265] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.653 [2024-10-07 11:33:19.834297] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.653 [2024-10-07 11:33:19.834315] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.653 [2024-10-07 11:33:19.834348] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.653 [2024-10-07 11:33:19.834371] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.653 [2024-10-07 11:33:19.834409] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.653 [2024-10-07 11:33:19.834439] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.653 [2024-10-07 11:33:19.834490] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.653 [2024-10-07 11:33:19.844844] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.653 [2024-10-07 11:33:19.845007] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.653 [2024-10-07 11:33:19.845039] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.653 [2024-10-07 11:33:19.845055] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.653 [2024-10-07 11:33:19.845080] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.653 [2024-10-07 11:33:19.845103] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.653 [2024-10-07 11:33:19.845116] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.653 [2024-10-07 11:33:19.845146] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.653 [2024-10-07 11:33:19.845758] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.653 [2024-10-07 11:33:19.856479] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.653 [2024-10-07 11:33:19.856856] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.653 [2024-10-07 11:33:19.856900] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.653 [2024-10-07 11:33:19.856920] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.653 [2024-10-07 11:33:19.857062] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.653 [2024-10-07 11:33:19.858898] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.653 [2024-10-07 11:33:19.858936] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.653 [2024-10-07 11:33:19.858954] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.653 [2024-10-07 11:33:19.859640] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.653 [2024-10-07 11:33:19.866576] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.653 [2024-10-07 11:33:19.866729] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.653 [2024-10-07 11:33:19.866761] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.653 [2024-10-07 11:33:19.866779] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.653 [2024-10-07 11:33:19.869213] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.653 [2024-10-07 11:33:19.871430] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.653 [2024-10-07 11:33:19.871471] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.653 [2024-10-07 11:33:19.871492] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.653 [2024-10-07 11:33:19.873371] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.653 [2024-10-07 11:33:19.876681] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.653 [2024-10-07 11:33:19.876953] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.653 [2024-10-07 11:33:19.876996] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.653 [2024-10-07 11:33:19.877015] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.653 [2024-10-07 11:33:19.877071] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.653 [2024-10-07 11:33:19.877098] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.653 [2024-10-07 11:33:19.877114] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.653 [2024-10-07 11:33:19.877127] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.653 [2024-10-07 11:33:19.877149] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.653 [2024-10-07 11:33:19.887477] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.653 [2024-10-07 11:33:19.887639] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.653 [2024-10-07 11:33:19.887701] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.653 [2024-10-07 11:33:19.887718] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.653 [2024-10-07 11:33:19.888236] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.653 [2024-10-07 11:33:19.888346] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.653 [2024-10-07 11:33:19.888374] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.653 [2024-10-07 11:33:19.888390] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.653 [2024-10-07 11:33:19.888413] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.653 8783.00 IOPS, 34.31 MiB/s [2024-10-07T11:33:33.176Z] [2024-10-07 11:33:19.899274] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.653 [2024-10-07 11:33:19.899503] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.653 [2024-10-07 11:33:19.899569] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.653 [2024-10-07 11:33:19.899590] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.653 [2024-10-07 11:33:19.899751] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.653 [2024-10-07 11:33:19.900455] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.653 [2024-10-07 11:33:19.900488] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.653 [2024-10-07 11:33:19.900522] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.653 [2024-10-07 11:33:19.903467] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.653 [2024-10-07 11:33:19.912936] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.653 [2024-10-07 11:33:19.913112] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.653 [2024-10-07 11:33:19.913160] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.653 [2024-10-07 11:33:19.913200] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.653 [2024-10-07 11:33:19.913227] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.653 [2024-10-07 11:33:19.913249] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.653 [2024-10-07 11:33:19.913262] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.653 [2024-10-07 11:33:19.913276] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.653 [2024-10-07 11:33:19.913300] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.653 [2024-10-07 11:33:19.924302] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.653 [2024-10-07 11:33:19.924541] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.653 [2024-10-07 11:33:19.924575] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.653 [2024-10-07 11:33:19.924593] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.653 [2024-10-07 11:33:19.925175] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.653 [2024-10-07 11:33:19.926683] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.653 [2024-10-07 11:33:19.926726] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.653 [2024-10-07 11:33:19.926746] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.653 [2024-10-07 11:33:19.927167] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.653 [2024-10-07 11:33:19.934408] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.653 [2024-10-07 11:33:19.934566] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.653 [2024-10-07 11:33:19.934597] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.653 [2024-10-07 11:33:19.934613] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.654 [2024-10-07 11:33:19.934637] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.654 [2024-10-07 11:33:19.934660] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.654 [2024-10-07 11:33:19.934689] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.654 [2024-10-07 11:33:19.934703] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.654 [2024-10-07 11:33:19.934726] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.654 [2024-10-07 11:33:19.945253] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.654 [2024-10-07 11:33:19.945409] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.654 [2024-10-07 11:33:19.945442] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.654 [2024-10-07 11:33:19.945459] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.654 [2024-10-07 11:33:19.945482] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.654 [2024-10-07 11:33:19.945505] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.654 [2024-10-07 11:33:19.945542] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.654 [2024-10-07 11:33:19.945558] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.654 [2024-10-07 11:33:19.945580] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.654 [2024-10-07 11:33:19.955400] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.654 [2024-10-07 11:33:19.955568] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.654 [2024-10-07 11:33:19.955600] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.654 [2024-10-07 11:33:19.955616] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.654 [2024-10-07 11:33:19.955640] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.654 [2024-10-07 11:33:19.955678] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.654 [2024-10-07 11:33:19.955707] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.654 [2024-10-07 11:33:19.955724] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.654 [2024-10-07 11:33:19.957984] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.654 [2024-10-07 11:33:19.965485] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.654 [2024-10-07 11:33:19.965627] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.654 [2024-10-07 11:33:19.965658] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.654 [2024-10-07 11:33:19.965690] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.654 [2024-10-07 11:33:19.965716] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.654 [2024-10-07 11:33:19.965738] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.654 [2024-10-07 11:33:19.965752] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.654 [2024-10-07 11:33:19.965766] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.654 [2024-10-07 11:33:19.965789] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.654 [2024-10-07 11:33:19.975597] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.654 [2024-10-07 11:33:19.975873] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.654 [2024-10-07 11:33:19.975927] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.654 [2024-10-07 11:33:19.975962] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.654 [2024-10-07 11:33:19.976003] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.654 [2024-10-07 11:33:19.976031] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.654 [2024-10-07 11:33:19.976050] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.654 [2024-10-07 11:33:19.976076] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.654 [2024-10-07 11:33:19.976118] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.654 [2024-10-07 11:33:19.986161] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.654 [2024-10-07 11:33:19.986474] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.654 [2024-10-07 11:33:19.986522] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.654 [2024-10-07 11:33:19.986552] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.654 [2024-10-07 11:33:19.986591] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.654 [2024-10-07 11:33:19.986627] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.654 [2024-10-07 11:33:19.986653] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.654 [2024-10-07 11:33:19.986677] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.654 [2024-10-07 11:33:19.986737] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.654 [2024-10-07 11:33:19.996761] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.654 [2024-10-07 11:33:19.997106] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.654 [2024-10-07 11:33:19.997157] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.654 [2024-10-07 11:33:19.997191] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.654 [2024-10-07 11:33:19.997360] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.654 [2024-10-07 11:33:19.997501] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.654 [2024-10-07 11:33:19.997536] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.654 [2024-10-07 11:33:19.997560] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.654 [2024-10-07 11:33:19.997596] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.654 [2024-10-07 11:33:20.007443] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.654 [2024-10-07 11:33:20.008476] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.654 [2024-10-07 11:33:20.008575] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.654 [2024-10-07 11:33:20.008612] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.654 [2024-10-07 11:33:20.009517] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.654 [2024-10-07 11:33:20.009819] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.654 [2024-10-07 11:33:20.009875] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.654 [2024-10-07 11:33:20.009910] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.654 [2024-10-07 11:33:20.012216] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.654 [2024-10-07 11:33:20.019567] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.654 [2024-10-07 11:33:20.020686] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.654 [2024-10-07 11:33:20.020763] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.654 [2024-10-07 11:33:20.020786] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.654 [2024-10-07 11:33:20.022818] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.654 [2024-10-07 11:33:20.023586] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.654 [2024-10-07 11:33:20.023625] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.654 [2024-10-07 11:33:20.023662] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.654 [2024-10-07 11:33:20.023920] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.654 [2024-10-07 11:33:20.029671] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.654 [2024-10-07 11:33:20.029845] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.654 [2024-10-07 11:33:20.029878] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.654 [2024-10-07 11:33:20.029894] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.654 [2024-10-07 11:33:20.029917] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.654 [2024-10-07 11:33:20.029938] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.654 [2024-10-07 11:33:20.029952] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.654 [2024-10-07 11:33:20.029964] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.654 [2024-10-07 11:33:20.029986] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.654 [2024-10-07 11:33:20.040474] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.654 [2024-10-07 11:33:20.040611] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.654 [2024-10-07 11:33:20.040643] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.654 [2024-10-07 11:33:20.040661] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.654 [2024-10-07 11:33:20.040705] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.654 [2024-10-07 11:33:20.040728] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.654 [2024-10-07 11:33:20.040742] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.654 [2024-10-07 11:33:20.040756] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.654 [2024-10-07 11:33:20.040779] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.654 [2024-10-07 11:33:20.053740] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.654 [2024-10-07 11:33:20.053956] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.655 [2024-10-07 11:33:20.053992] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.655 [2024-10-07 11:33:20.054010] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.655 [2024-10-07 11:33:20.056481] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.655 [2024-10-07 11:33:20.056766] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.655 [2024-10-07 11:33:20.056807] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.655 [2024-10-07 11:33:20.056873] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.655 [2024-10-07 11:33:20.057151] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.655 [2024-10-07 11:33:20.064478] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.655 [2024-10-07 11:33:20.064611] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.655 [2024-10-07 11:33:20.064644] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.655 [2024-10-07 11:33:20.064660] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.655 [2024-10-07 11:33:20.064703] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.655 [2024-10-07 11:33:20.064725] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.655 [2024-10-07 11:33:20.064739] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.655 [2024-10-07 11:33:20.064752] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.655 [2024-10-07 11:33:20.064775] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.655 [2024-10-07 11:33:20.080117] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.655 [2024-10-07 11:33:20.080495] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.655 [2024-10-07 11:33:20.080539] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.655 [2024-10-07 11:33:20.080559] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.655 [2024-10-07 11:33:20.080773] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.655 [2024-10-07 11:33:20.080871] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.655 [2024-10-07 11:33:20.080894] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.655 [2024-10-07 11:33:20.080908] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.655 [2024-10-07 11:33:20.080932] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.655 [2024-10-07 11:33:20.095021] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.655 [2024-10-07 11:33:20.095177] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.655 [2024-10-07 11:33:20.095250] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.655 [2024-10-07 11:33:20.095268] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.655 [2024-10-07 11:33:20.095293] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.655 [2024-10-07 11:33:20.095330] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.655 [2024-10-07 11:33:20.095347] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.655 [2024-10-07 11:33:20.095361] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.655 [2024-10-07 11:33:20.095385] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.655 [2024-10-07 11:33:20.107439] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.655 [2024-10-07 11:33:20.107687] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.655 [2024-10-07 11:33:20.107770] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.655 [2024-10-07 11:33:20.107790] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.655 [2024-10-07 11:33:20.107931] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.655 [2024-10-07 11:33:20.108057] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.655 [2024-10-07 11:33:20.108090] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.655 [2024-10-07 11:33:20.108106] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.655 [2024-10-07 11:33:20.108228] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.655 [2024-10-07 11:33:20.117519] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.655 [2024-10-07 11:33:20.117775] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.655 [2024-10-07 11:33:20.117824] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.655 [2024-10-07 11:33:20.117842] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.655 [2024-10-07 11:33:20.117960] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.655 [2024-10-07 11:33:20.118059] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.655 [2024-10-07 11:33:20.118078] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.655 [2024-10-07 11:33:20.118090] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.655 [2024-10-07 11:33:20.118239] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.655 [2024-10-07 11:33:20.129726] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.655 [2024-10-07 11:33:20.130015] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.655 [2024-10-07 11:33:20.130068] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.655 [2024-10-07 11:33:20.130091] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.655 [2024-10-07 11:33:20.130118] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.655 [2024-10-07 11:33:20.130141] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.655 [2024-10-07 11:33:20.130156] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.655 [2024-10-07 11:33:20.130170] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.655 [2024-10-07 11:33:20.130195] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.655 [2024-10-07 11:33:20.142876] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.655 [2024-10-07 11:33:20.143048] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.655 [2024-10-07 11:33:20.143081] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.655 [2024-10-07 11:33:20.143100] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.655 [2024-10-07 11:33:20.143124] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.655 [2024-10-07 11:33:20.143164] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.655 [2024-10-07 11:33:20.143180] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.655 [2024-10-07 11:33:20.143207] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.655 [2024-10-07 11:33:20.143374] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.655 [2024-10-07 11:33:20.154226] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.655 [2024-10-07 11:33:20.154450] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.655 [2024-10-07 11:33:20.154488] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.655 [2024-10-07 11:33:20.154506] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.655 [2024-10-07 11:33:20.154640] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.655 [2024-10-07 11:33:20.154845] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.655 [2024-10-07 11:33:20.154880] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.655 [2024-10-07 11:33:20.154897] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.655 [2024-10-07 11:33:20.155027] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.655 [2024-10-07 11:33:20.164318] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.655 [2024-10-07 11:33:20.164454] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.655 [2024-10-07 11:33:20.164484] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.655 [2024-10-07 11:33:20.164500] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.655 [2024-10-07 11:33:20.164523] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.655 [2024-10-07 11:33:20.164544] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.655 [2024-10-07 11:33:20.164558] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.655 [2024-10-07 11:33:20.164571] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.655 [2024-10-07 11:33:20.164594] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.655 [2024-10-07 11:33:20.177388] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.655 [2024-10-07 11:33:20.177742] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.655 [2024-10-07 11:33:20.177786] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.655 [2024-10-07 11:33:20.177807] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.655 [2024-10-07 11:33:20.177862] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.655 [2024-10-07 11:33:20.177890] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.655 [2024-10-07 11:33:20.177905] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.655 [2024-10-07 11:33:20.177918] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.655 [2024-10-07 11:33:20.177961] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.656 [2024-10-07 11:33:20.189131] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.656 [2024-10-07 11:33:20.189425] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.656 [2024-10-07 11:33:20.189470] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.656 [2024-10-07 11:33:20.189491] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.656 [2024-10-07 11:33:20.189636] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.656 [2024-10-07 11:33:20.189788] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.656 [2024-10-07 11:33:20.189819] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.656 [2024-10-07 11:33:20.189836] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.656 [2024-10-07 11:33:20.189953] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.656 [2024-10-07 11:33:20.199257] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.656 [2024-10-07 11:33:20.199365] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.656 [2024-10-07 11:33:20.199395] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.656 [2024-10-07 11:33:20.199412] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.656 [2024-10-07 11:33:20.199435] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.656 [2024-10-07 11:33:20.199470] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.656 [2024-10-07 11:33:20.199488] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.656 [2024-10-07 11:33:20.199501] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.656 [2024-10-07 11:33:20.199524] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.656 [2024-10-07 11:33:20.209664] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.656 [2024-10-07 11:33:20.209789] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.656 [2024-10-07 11:33:20.209819] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.656 [2024-10-07 11:33:20.209836] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.656 [2024-10-07 11:33:20.209859] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.656 [2024-10-07 11:33:20.209881] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.656 [2024-10-07 11:33:20.209895] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.656 [2024-10-07 11:33:20.209909] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.656 [2024-10-07 11:33:20.209931] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.656 [2024-10-07 11:33:20.222318] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.656 [2024-10-07 11:33:20.222444] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.656 [2024-10-07 11:33:20.222476] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.656 [2024-10-07 11:33:20.222516] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.656 [2024-10-07 11:33:20.222542] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.656 [2024-10-07 11:33:20.222564] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.656 [2024-10-07 11:33:20.222579] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.656 [2024-10-07 11:33:20.222592] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.656 [2024-10-07 11:33:20.222616] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.656 [2024-10-07 11:33:20.232969] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.656 [2024-10-07 11:33:20.233205] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.656 [2024-10-07 11:33:20.233240] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.656 [2024-10-07 11:33:20.233257] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.656 [2024-10-07 11:33:20.233359] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.656 [2024-10-07 11:33:20.233455] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.656 [2024-10-07 11:33:20.233474] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.656 [2024-10-07 11:33:20.233487] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.656 [2024-10-07 11:33:20.233512] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.656 [2024-10-07 11:33:20.243065] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.656 [2024-10-07 11:33:20.243175] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.656 [2024-10-07 11:33:20.243225] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.656 [2024-10-07 11:33:20.243243] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.656 [2024-10-07 11:33:20.243268] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.656 [2024-10-07 11:33:20.243291] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.656 [2024-10-07 11:33:20.243305] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.656 [2024-10-07 11:33:20.243319] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.656 [2024-10-07 11:33:20.243342] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.656 [2024-10-07 11:33:20.256364] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.656 [2024-10-07 11:33:20.256471] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.656 [2024-10-07 11:33:20.256502] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.656 [2024-10-07 11:33:20.256519] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.656 [2024-10-07 11:33:20.256542] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.656 [2024-10-07 11:33:20.256564] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.656 [2024-10-07 11:33:20.256596] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.656 [2024-10-07 11:33:20.256611] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.656 [2024-10-07 11:33:20.256635] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.656 [2024-10-07 11:33:20.270677] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.656 [2024-10-07 11:33:20.270796] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.656 [2024-10-07 11:33:20.270828] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.656 [2024-10-07 11:33:20.270845] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.656 [2024-10-07 11:33:20.270881] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.656 [2024-10-07 11:33:20.270909] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.656 [2024-10-07 11:33:20.270924] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.656 [2024-10-07 11:33:20.270938] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.656 [2024-10-07 11:33:20.270962] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.656 [2024-10-07 11:33:20.282993] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.656 [2024-10-07 11:33:20.283247] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.656 [2024-10-07 11:33:20.283280] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.656 [2024-10-07 11:33:20.283298] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.656 [2024-10-07 11:33:20.283419] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.656 [2024-10-07 11:33:20.283525] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.656 [2024-10-07 11:33:20.283555] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.656 [2024-10-07 11:33:20.283572] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.656 [2024-10-07 11:33:20.283693] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.656 [2024-10-07 11:33:20.293072] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.656 [2024-10-07 11:33:20.293181] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.656 [2024-10-07 11:33:20.293214] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.656 [2024-10-07 11:33:20.293231] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.656 [2024-10-07 11:33:20.293255] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.657 [2024-10-07 11:33:20.293279] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.657 [2024-10-07 11:33:20.293294] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.657 [2024-10-07 11:33:20.293308] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.657 [2024-10-07 11:33:20.293332] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.657 [2024-10-07 11:33:20.303965] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.657 [2024-10-07 11:33:20.304072] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.657 [2024-10-07 11:33:20.304103] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.657 [2024-10-07 11:33:20.304120] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.657 [2024-10-07 11:33:20.304396] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.657 [2024-10-07 11:33:20.304568] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.657 [2024-10-07 11:33:20.304602] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.657 [2024-10-07 11:33:20.304620] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.657 [2024-10-07 11:33:20.304767] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.657 [2024-10-07 11:33:20.314077] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.657 [2024-10-07 11:33:20.314193] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.657 [2024-10-07 11:33:20.314222] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.657 [2024-10-07 11:33:20.314238] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.657 [2024-10-07 11:33:20.314260] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.657 [2024-10-07 11:33:20.314281] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.657 [2024-10-07 11:33:20.314295] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.657 [2024-10-07 11:33:20.314307] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.657 [2024-10-07 11:33:20.314329] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.657 [2024-10-07 11:33:20.324165] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.657 [2024-10-07 11:33:20.324284] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.657 [2024-10-07 11:33:20.324321] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.657 [2024-10-07 11:33:20.324337] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.657 [2024-10-07 11:33:20.324359] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.657 [2024-10-07 11:33:20.324380] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.657 [2024-10-07 11:33:20.324394] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.657 [2024-10-07 11:33:20.324407] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.657 [2024-10-07 11:33:20.324430] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.657 [2024-10-07 11:33:20.334523] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.657 [2024-10-07 11:33:20.334760] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.657 [2024-10-07 11:33:20.334809] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.657 [2024-10-07 11:33:20.334827] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.657 [2024-10-07 11:33:20.336387] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.657 [2024-10-07 11:33:20.339313] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.657 [2024-10-07 11:33:20.339355] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.657 [2024-10-07 11:33:20.339373] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.657 [2024-10-07 11:33:20.339762] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.657 [2024-10-07 11:33:20.344981] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.657 [2024-10-07 11:33:20.345120] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.657 [2024-10-07 11:33:20.345153] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.657 [2024-10-07 11:33:20.345184] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.657 [2024-10-07 11:33:20.345208] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.657 [2024-10-07 11:33:20.345230] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.657 [2024-10-07 11:33:20.345244] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.657 [2024-10-07 11:33:20.345257] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.657 [2024-10-07 11:33:20.345286] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.657 [2024-10-07 11:33:20.355086] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.657 [2024-10-07 11:33:20.355252] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.657 [2024-10-07 11:33:20.355284] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.657 [2024-10-07 11:33:20.355301] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.657 [2024-10-07 11:33:20.355325] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.657 [2024-10-07 11:33:20.355348] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.657 [2024-10-07 11:33:20.355363] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.657 [2024-10-07 11:33:20.355377] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.657 [2024-10-07 11:33:20.355401] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.657 [2024-10-07 11:33:20.368194] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.657 [2024-10-07 11:33:20.368317] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.657 [2024-10-07 11:33:20.368355] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.657 [2024-10-07 11:33:20.368372] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.657 [2024-10-07 11:33:20.368869] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.657 [2024-10-07 11:33:20.369425] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.657 [2024-10-07 11:33:20.369460] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.657 [2024-10-07 11:33:20.369509] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.657 [2024-10-07 11:33:20.369742] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.657 [2024-10-07 11:33:20.380491] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.657 [2024-10-07 11:33:20.380611] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.657 [2024-10-07 11:33:20.380642] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.657 [2024-10-07 11:33:20.380658] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.657 [2024-10-07 11:33:20.381229] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.657 [2024-10-07 11:33:20.381372] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.657 [2024-10-07 11:33:20.381396] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.657 [2024-10-07 11:33:20.381424] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.657 [2024-10-07 11:33:20.381447] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.657 [2024-10-07 11:33:20.392391] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.657 [2024-10-07 11:33:20.392570] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.657 [2024-10-07 11:33:20.392602] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.657 [2024-10-07 11:33:20.392619] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.657 [2024-10-07 11:33:20.392643] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.657 [2024-10-07 11:33:20.392665] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.657 [2024-10-07 11:33:20.392695] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.657 [2024-10-07 11:33:20.392711] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.657 [2024-10-07 11:33:20.392735] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.657 [2024-10-07 11:33:20.404596] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.657 [2024-10-07 11:33:20.406588] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.657 [2024-10-07 11:33:20.406672] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.657 [2024-10-07 11:33:20.406693] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.657 [2024-10-07 11:33:20.407355] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.657 [2024-10-07 11:33:20.407638] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.657 [2024-10-07 11:33:20.407690] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.657 [2024-10-07 11:33:20.407727] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.657 [2024-10-07 11:33:20.407798] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.657 [2024-10-07 11:33:20.415514] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.657 [2024-10-07 11:33:20.415931] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.657 [2024-10-07 11:33:20.415986] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.658 [2024-10-07 11:33:20.416057] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.658 [2024-10-07 11:33:20.416240] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.658 [2024-10-07 11:33:20.416466] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.658 [2024-10-07 11:33:20.416510] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.658 [2024-10-07 11:33:20.416534] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.658 [2024-10-07 11:33:20.416694] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.658 [2024-10-07 11:33:20.425704] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.658 [2024-10-07 11:33:20.425827] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.658 [2024-10-07 11:33:20.425858] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.658 [2024-10-07 11:33:20.425875] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.658 [2024-10-07 11:33:20.426045] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.658 [2024-10-07 11:33:20.426296] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.658 [2024-10-07 11:33:20.426334] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.658 [2024-10-07 11:33:20.426368] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.658 [2024-10-07 11:33:20.426421] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.658 [2024-10-07 11:33:20.435981] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.658 [2024-10-07 11:33:20.436263] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.658 [2024-10-07 11:33:20.436298] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.658 [2024-10-07 11:33:20.436315] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.658 [2024-10-07 11:33:20.436847] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.658 [2024-10-07 11:33:20.439226] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.658 [2024-10-07 11:33:20.439283] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.658 [2024-10-07 11:33:20.439320] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.658 [2024-10-07 11:33:20.440273] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.658 [2024-10-07 11:33:20.446381] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.658 [2024-10-07 11:33:20.446594] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.658 [2024-10-07 11:33:20.446629] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.658 [2024-10-07 11:33:20.446660] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.658 [2024-10-07 11:33:20.448917] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.658 [2024-10-07 11:33:20.450868] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.658 [2024-10-07 11:33:20.450911] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.658 [2024-10-07 11:33:20.450930] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.658 [2024-10-07 11:33:20.451091] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.658 [2024-10-07 11:33:20.456543] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.658 [2024-10-07 11:33:20.456718] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.658 [2024-10-07 11:33:20.456767] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.658 [2024-10-07 11:33:20.456797] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.658 [2024-10-07 11:33:20.458676] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.658 [2024-10-07 11:33:20.460390] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.658 [2024-10-07 11:33:20.460437] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.658 [2024-10-07 11:33:20.460456] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.658 [2024-10-07 11:33:20.460525] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.658 [2024-10-07 11:33:20.467284] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.658 [2024-10-07 11:33:20.467495] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.658 [2024-10-07 11:33:20.467529] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.658 [2024-10-07 11:33:20.467547] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.658 [2024-10-07 11:33:20.467621] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.658 [2024-10-07 11:33:20.467664] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.658 [2024-10-07 11:33:20.467684] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.658 [2024-10-07 11:33:20.467698] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.658 [2024-10-07 11:33:20.468862] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.658 [2024-10-07 11:33:20.477761] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.658 [2024-10-07 11:33:20.478119] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.658 [2024-10-07 11:33:20.478164] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.658 [2024-10-07 11:33:20.478185] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.658 [2024-10-07 11:33:20.478232] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.658 [2024-10-07 11:33:20.478261] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.658 [2024-10-07 11:33:20.478277] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.658 [2024-10-07 11:33:20.478309] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.658 [2024-10-07 11:33:20.478337] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.658 [2024-10-07 11:33:20.491169] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.658 [2024-10-07 11:33:20.491366] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.658 [2024-10-07 11:33:20.491399] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.658 [2024-10-07 11:33:20.491416] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.658 [2024-10-07 11:33:20.491441] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.658 [2024-10-07 11:33:20.491464] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.658 [2024-10-07 11:33:20.491479] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.658 [2024-10-07 11:33:20.491493] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.658 [2024-10-07 11:33:20.491517] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.658 [2024-10-07 11:33:20.501342] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.658 [2024-10-07 11:33:20.501471] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.658 [2024-10-07 11:33:20.501502] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.658 [2024-10-07 11:33:20.501519] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.658 [2024-10-07 11:33:20.501706] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.658 [2024-10-07 11:33:20.501870] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.658 [2024-10-07 11:33:20.501906] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.658 [2024-10-07 11:33:20.501924] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.658 [2024-10-07 11:33:20.502053] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.658 [2024-10-07 11:33:20.515292] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.658 [2024-10-07 11:33:20.515491] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.658 [2024-10-07 11:33:20.515543] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.658 [2024-10-07 11:33:20.515560] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.658 [2024-10-07 11:33:20.516204] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.658 [2024-10-07 11:33:20.516884] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.658 [2024-10-07 11:33:20.516921] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.658 [2024-10-07 11:33:20.516938] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.658 [2024-10-07 11:33:20.517063] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.658 [2024-10-07 11:33:20.529260] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.658 [2024-10-07 11:33:20.529607] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.658 [2024-10-07 11:33:20.529696] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.658 [2024-10-07 11:33:20.529728] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.658 [2024-10-07 11:33:20.529986] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.658 [2024-10-07 11:33:20.530129] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.658 [2024-10-07 11:33:20.530162] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.658 [2024-10-07 11:33:20.530187] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.658 [2024-10-07 11:33:20.530224] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.658 [2024-10-07 11:33:20.544492] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.659 [2024-10-07 11:33:20.545867] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.659 [2024-10-07 11:33:20.545924] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.659 [2024-10-07 11:33:20.545954] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.659 [2024-10-07 11:33:20.547742] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.659 [2024-10-07 11:33:20.548167] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.659 [2024-10-07 11:33:20.548218] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.659 [2024-10-07 11:33:20.548245] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.659 [2024-10-07 11:33:20.548405] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.659 [2024-10-07 11:33:20.558684] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.659 [2024-10-07 11:33:20.558916] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.659 [2024-10-07 11:33:20.558959] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.659 [2024-10-07 11:33:20.558986] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.659 [2024-10-07 11:33:20.559023] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.659 [2024-10-07 11:33:20.559058] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.659 [2024-10-07 11:33:20.559083] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.659 [2024-10-07 11:33:20.559106] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.659 [2024-10-07 11:33:20.559143] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.659 [2024-10-07 11:33:20.568819] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.659 [2024-10-07 11:33:20.568971] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.659 [2024-10-07 11:33:20.569011] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.659 [2024-10-07 11:33:20.569039] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.659 [2024-10-07 11:33:20.569360] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.659 [2024-10-07 11:33:20.569631] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.659 [2024-10-07 11:33:20.569690] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.659 [2024-10-07 11:33:20.569717] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.659 [2024-10-07 11:33:20.569890] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.659 [2024-10-07 11:33:20.579701] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.659 [2024-10-07 11:33:20.579924] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.659 [2024-10-07 11:33:20.579956] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.659 [2024-10-07 11:33:20.579972] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.659 [2024-10-07 11:33:20.580120] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.659 [2024-10-07 11:33:20.580340] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.659 [2024-10-07 11:33:20.580391] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.659 [2024-10-07 11:33:20.580408] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.659 [2024-10-07 11:33:20.580465] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.659 [2024-10-07 11:33:20.593449] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.659 [2024-10-07 11:33:20.594599] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.659 [2024-10-07 11:33:20.594660] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.659 [2024-10-07 11:33:20.594694] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.659 [2024-10-07 11:33:20.594820] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.659 [2024-10-07 11:33:20.594850] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.659 [2024-10-07 11:33:20.594865] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.659 [2024-10-07 11:33:20.594879] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.659 [2024-10-07 11:33:20.594904] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.659 [2024-10-07 11:33:20.603556] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.659 [2024-10-07 11:33:20.603709] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.659 [2024-10-07 11:33:20.603749] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.659 [2024-10-07 11:33:20.603766] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.659 [2024-10-07 11:33:20.603788] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.659 [2024-10-07 11:33:20.603810] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.659 [2024-10-07 11:33:20.603823] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.659 [2024-10-07 11:33:20.603836] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.659 [2024-10-07 11:33:20.603875] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.659 [2024-10-07 11:33:20.617008] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.659 [2024-10-07 11:33:20.617351] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.659 [2024-10-07 11:33:20.617413] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.659 [2024-10-07 11:33:20.617433] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.659 [2024-10-07 11:33:20.617635] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.659 [2024-10-07 11:33:20.617734] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.659 [2024-10-07 11:33:20.617759] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.659 [2024-10-07 11:33:20.617774] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.659 [2024-10-07 11:33:20.617799] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.659 [2024-10-07 11:33:20.632051] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.659 [2024-10-07 11:33:20.632175] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.659 [2024-10-07 11:33:20.632215] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.659 [2024-10-07 11:33:20.632233] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.659 [2024-10-07 11:33:20.632258] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.659 [2024-10-07 11:33:20.632296] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.659 [2024-10-07 11:33:20.632314] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.659 [2024-10-07 11:33:20.632328] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.659 [2024-10-07 11:33:20.632353] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.659 [2024-10-07 11:33:20.647601] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.659 [2024-10-07 11:33:20.647736] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.659 [2024-10-07 11:33:20.647770] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.659 [2024-10-07 11:33:20.647788] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.659 [2024-10-07 11:33:20.647813] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.659 [2024-10-07 11:33:20.647836] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.659 [2024-10-07 11:33:20.647851] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.659 [2024-10-07 11:33:20.647865] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.659 [2024-10-07 11:33:20.647890] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.659 [2024-10-07 11:33:20.663324] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.659 [2024-10-07 11:33:20.663562] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.659 [2024-10-07 11:33:20.663607] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.659 [2024-10-07 11:33:20.663669] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.659 [2024-10-07 11:33:20.663700] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.659 [2024-10-07 11:33:20.663724] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.659 [2024-10-07 11:33:20.663739] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.659 [2024-10-07 11:33:20.663753] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.659 [2024-10-07 11:33:20.663778] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.659 [2024-10-07 11:33:20.673694] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.659 [2024-10-07 11:33:20.673937] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.659 [2024-10-07 11:33:20.673982] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.659 [2024-10-07 11:33:20.674003] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.659 [2024-10-07 11:33:20.674137] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.659 [2024-10-07 11:33:20.674274] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.659 [2024-10-07 11:33:20.674307] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.660 [2024-10-07 11:33:20.674324] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.660 [2024-10-07 11:33:20.674460] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.660 [2024-10-07 11:33:20.683787] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.660 [2024-10-07 11:33:20.683908] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.660 [2024-10-07 11:33:20.683942] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.660 [2024-10-07 11:33:20.683966] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.660 [2024-10-07 11:33:20.684003] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.660 [2024-10-07 11:33:20.684030] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.660 [2024-10-07 11:33:20.684045] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.660 [2024-10-07 11:33:20.684058] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.660 [2024-10-07 11:33:20.684083] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.660 [2024-10-07 11:33:20.694772] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.660 [2024-10-07 11:33:20.694890] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.660 [2024-10-07 11:33:20.694923] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.660 [2024-10-07 11:33:20.694951] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.660 [2024-10-07 11:33:20.694976] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.660 [2024-10-07 11:33:20.694999] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.660 [2024-10-07 11:33:20.695040] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.660 [2024-10-07 11:33:20.695055] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.660 [2024-10-07 11:33:20.695079] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.660 [2024-10-07 11:33:20.707091] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.660 [2024-10-07 11:33:20.707380] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.660 [2024-10-07 11:33:20.707430] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.660 [2024-10-07 11:33:20.707452] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.660 [2024-10-07 11:33:20.707633] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.660 [2024-10-07 11:33:20.707719] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.660 [2024-10-07 11:33:20.707742] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.660 [2024-10-07 11:33:20.707757] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.660 [2024-10-07 11:33:20.707783] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.660 [2024-10-07 11:33:20.718136] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.660 [2024-10-07 11:33:20.718349] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.660 [2024-10-07 11:33:20.718392] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.660 [2024-10-07 11:33:20.718413] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.660 [2024-10-07 11:33:20.719061] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.660 [2024-10-07 11:33:20.719324] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.660 [2024-10-07 11:33:20.719360] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.660 [2024-10-07 11:33:20.719378] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.660 [2024-10-07 11:33:20.719405] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.660 [2024-10-07 11:33:20.728338] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.660 [2024-10-07 11:33:20.728453] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.660 [2024-10-07 11:33:20.728485] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.660 [2024-10-07 11:33:20.728502] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.660 [2024-10-07 11:33:20.728526] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.660 [2024-10-07 11:33:20.728549] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.660 [2024-10-07 11:33:20.728564] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.660 [2024-10-07 11:33:20.728577] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.660 [2024-10-07 11:33:20.728602] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.660 [2024-10-07 11:33:20.738865] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.660 [2024-10-07 11:33:20.738990] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.660 [2024-10-07 11:33:20.739032] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.660 [2024-10-07 11:33:20.739052] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.660 [2024-10-07 11:33:20.739077] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.660 [2024-10-07 11:33:20.739100] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.660 [2024-10-07 11:33:20.739116] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.660 [2024-10-07 11:33:20.739129] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.660 [2024-10-07 11:33:20.739153] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.660 [2024-10-07 11:33:20.748946] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.660 [2024-10-07 11:33:20.749063] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.660 [2024-10-07 11:33:20.749105] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.660 [2024-10-07 11:33:20.749126] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.660 [2024-10-07 11:33:20.749150] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.660 [2024-10-07 11:33:20.749179] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.660 [2024-10-07 11:33:20.749195] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.660 [2024-10-07 11:33:20.749209] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.660 [2024-10-07 11:33:20.749233] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.660 [2024-10-07 11:33:20.759687] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.660 [2024-10-07 11:33:20.759856] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.660 [2024-10-07 11:33:20.759889] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.660 [2024-10-07 11:33:20.759906] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.660 [2024-10-07 11:33:20.760836] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.660 [2024-10-07 11:33:20.760968] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.660 [2024-10-07 11:33:20.760993] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.660 [2024-10-07 11:33:20.761008] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.660 [2024-10-07 11:33:20.761033] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.660 [2024-10-07 11:33:20.769771] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.660 [2024-10-07 11:33:20.770340] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.660 [2024-10-07 11:33:20.770384] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.660 [2024-10-07 11:33:20.770404] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.660 [2024-10-07 11:33:20.770458] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.660 [2024-10-07 11:33:20.770482] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.660 [2024-10-07 11:33:20.770497] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.660 [2024-10-07 11:33:20.770511] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.660 [2024-10-07 11:33:20.770535] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.660 [2024-10-07 11:33:20.779854] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.660 [2024-10-07 11:33:20.779977] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.660 [2024-10-07 11:33:20.780008] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.661 [2024-10-07 11:33:20.780026] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.661 [2024-10-07 11:33:20.780050] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.661 [2024-10-07 11:33:20.780072] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.661 [2024-10-07 11:33:20.780086] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.661 [2024-10-07 11:33:20.780100] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.661 [2024-10-07 11:33:20.780124] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.661 [2024-10-07 11:33:20.790504] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.661 [2024-10-07 11:33:20.790616] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.661 [2024-10-07 11:33:20.790660] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.661 [2024-10-07 11:33:20.790680] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.661 [2024-10-07 11:33:20.790859] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.661 [2024-10-07 11:33:20.790926] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.661 [2024-10-07 11:33:20.790949] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.661 [2024-10-07 11:33:20.790963] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.661 [2024-10-07 11:33:20.790988] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.661 [2024-10-07 11:33:20.800935] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.661 [2024-10-07 11:33:20.801139] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.661 [2024-10-07 11:33:20.801171] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.661 [2024-10-07 11:33:20.801189] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.661 [2024-10-07 11:33:20.801846] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.661 [2024-10-07 11:33:20.804630] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.661 [2024-10-07 11:33:20.804697] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.661 [2024-10-07 11:33:20.804739] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.661 [2024-10-07 11:33:20.805291] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.661 [2024-10-07 11:33:20.811297] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.661 [2024-10-07 11:33:20.811413] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.661 [2024-10-07 11:33:20.811445] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.661 [2024-10-07 11:33:20.811462] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.661 [2024-10-07 11:33:20.811487] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.661 [2024-10-07 11:33:20.811510] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.661 [2024-10-07 11:33:20.811524] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.661 [2024-10-07 11:33:20.811537] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.661 [2024-10-07 11:33:20.811561] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.661 [2024-10-07 11:33:20.822059] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.661 [2024-10-07 11:33:20.822184] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.661 [2024-10-07 11:33:20.822215] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.661 [2024-10-07 11:33:20.822232] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.661 [2024-10-07 11:33:20.822255] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.661 [2024-10-07 11:33:20.822277] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.661 [2024-10-07 11:33:20.822292] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.661 [2024-10-07 11:33:20.822306] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.661 [2024-10-07 11:33:20.822330] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.661 [2024-10-07 11:33:20.832330] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.661 [2024-10-07 11:33:20.832439] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.661 [2024-10-07 11:33:20.832471] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.661 [2024-10-07 11:33:20.832488] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.661 [2024-10-07 11:33:20.832511] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.661 [2024-10-07 11:33:20.832533] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.661 [2024-10-07 11:33:20.832547] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.661 [2024-10-07 11:33:20.832561] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.661 [2024-10-07 11:33:20.832585] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.661 [2024-10-07 11:33:20.844634] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.661 [2024-10-07 11:33:20.844991] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.661 [2024-10-07 11:33:20.845037] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.661 [2024-10-07 11:33:20.845058] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.661 [2024-10-07 11:33:20.845128] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.661 [2024-10-07 11:33:20.845161] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.661 [2024-10-07 11:33:20.845177] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.661 [2024-10-07 11:33:20.845191] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.661 [2024-10-07 11:33:20.845215] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.661 [2024-10-07 11:33:20.859486] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.661 [2024-10-07 11:33:20.859968] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.661 [2024-10-07 11:33:20.860014] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.661 [2024-10-07 11:33:20.860034] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.661 [2024-10-07 11:33:20.860105] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.661 [2024-10-07 11:33:20.860135] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.661 [2024-10-07 11:33:20.860150] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.661 [2024-10-07 11:33:20.860164] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.661 [2024-10-07 11:33:20.860189] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.661 [2024-10-07 11:33:20.870418] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.661 [2024-10-07 11:33:20.870627] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.661 [2024-10-07 11:33:20.870675] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.661 [2024-10-07 11:33:20.870695] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.661 [2024-10-07 11:33:20.872011] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.661 [2024-10-07 11:33:20.873802] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.661 [2024-10-07 11:33:20.873842] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.661 [2024-10-07 11:33:20.873876] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.661 [2024-10-07 11:33:20.874361] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.661 [2024-10-07 11:33:20.880515] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.661 [2024-10-07 11:33:20.880638] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.661 [2024-10-07 11:33:20.880681] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.661 [2024-10-07 11:33:20.880701] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.661 [2024-10-07 11:33:20.880742] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.661 [2024-10-07 11:33:20.880766] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.661 [2024-10-07 11:33:20.880781] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.661 [2024-10-07 11:33:20.880794] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.661 [2024-10-07 11:33:20.880818] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.661 [2024-10-07 11:33:20.893616] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.661 [2024-10-07 11:33:20.893948] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.661 [2024-10-07 11:33:20.894010] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.661 [2024-10-07 11:33:20.894062] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.661 [2024-10-07 11:33:20.894247] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.661 [2024-10-07 11:33:20.894434] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.661 [2024-10-07 11:33:20.894490] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.661 [2024-10-07 11:33:20.894526] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.661 [2024-10-07 11:33:20.896218] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.662 8792.25 IOPS, 34.34 MiB/s [2024-10-07T11:33:33.185Z] [2024-10-07 11:33:20.905859] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.662 [2024-10-07 11:33:20.906088] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.662 [2024-10-07 11:33:20.906130] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.662 [2024-10-07 11:33:20.906150] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.662 [2024-10-07 11:33:20.906286] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.662 [2024-10-07 11:33:20.906459] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.662 [2024-10-07 11:33:20.906496] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.662 [2024-10-07 11:33:20.906515] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.662 [2024-10-07 11:33:20.906710] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.662 [2024-10-07 11:33:20.915944] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.662 [2024-10-07 11:33:20.916072] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.662 [2024-10-07 11:33:20.916104] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.662 [2024-10-07 11:33:20.916121] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.662 [2024-10-07 11:33:20.916145] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.662 [2024-10-07 11:33:20.916168] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.662 [2024-10-07 11:33:20.916191] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.662 [2024-10-07 11:33:20.916222] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.662 [2024-10-07 11:33:20.916247] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.662 [2024-10-07 11:33:20.928882] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.662 [2024-10-07 11:33:20.929052] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.662 [2024-10-07 11:33:20.929102] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.662 [2024-10-07 11:33:20.929136] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.662 [2024-10-07 11:33:20.929181] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.662 [2024-10-07 11:33:20.929224] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.662 [2024-10-07 11:33:20.929252] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.662 [2024-10-07 11:33:20.929288] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.662 [2024-10-07 11:33:20.929330] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.662 [2024-10-07 11:33:20.943963] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.662 [2024-10-07 11:33:20.944121] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.662 [2024-10-07 11:33:20.944156] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.662 [2024-10-07 11:33:20.944174] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.662 [2024-10-07 11:33:20.944209] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.662 [2024-10-07 11:33:20.944233] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.662 [2024-10-07 11:33:20.944248] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.662 [2024-10-07 11:33:20.944261] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.662 [2024-10-07 11:33:20.944285] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.662 [2024-10-07 11:33:20.954331] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.662 [2024-10-07 11:33:20.954568] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.662 [2024-10-07 11:33:20.954602] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.662 [2024-10-07 11:33:20.954620] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.662 [2024-10-07 11:33:20.954739] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.662 [2024-10-07 11:33:20.954849] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.662 [2024-10-07 11:33:20.954868] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.662 [2024-10-07 11:33:20.954883] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.662 [2024-10-07 11:33:20.957424] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.662 [2024-10-07 11:33:20.964441] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.662 [2024-10-07 11:33:20.964563] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.662 [2024-10-07 11:33:20.964613] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.662 [2024-10-07 11:33:20.964632] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.662 [2024-10-07 11:33:20.964656] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.662 [2024-10-07 11:33:20.964694] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.662 [2024-10-07 11:33:20.964710] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.662 [2024-10-07 11:33:20.964723] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.662 [2024-10-07 11:33:20.964746] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.662 [2024-10-07 11:33:20.974534] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.662 [2024-10-07 11:33:20.974674] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.662 [2024-10-07 11:33:20.974706] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.662 [2024-10-07 11:33:20.974724] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.662 [2024-10-07 11:33:20.974747] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.662 [2024-10-07 11:33:20.974770] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.662 [2024-10-07 11:33:20.974784] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.662 [2024-10-07 11:33:20.974798] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.662 [2024-10-07 11:33:20.974836] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.662 [2024-10-07 11:33:20.986947] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.662 [2024-10-07 11:33:20.987964] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.662 [2024-10-07 11:33:20.988038] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.662 [2024-10-07 11:33:20.988067] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.662 [2024-10-07 11:33:20.988178] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.662 [2024-10-07 11:33:20.988210] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.662 [2024-10-07 11:33:20.988226] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.662 [2024-10-07 11:33:20.988240] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.662 [2024-10-07 11:33:20.988265] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.662 [2024-10-07 11:33:20.997671] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.662 [2024-10-07 11:33:20.997968] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.662 [2024-10-07 11:33:20.998013] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.662 [2024-10-07 11:33:20.998034] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.662 [2024-10-07 11:33:20.998095] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.662 [2024-10-07 11:33:20.998294] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.662 [2024-10-07 11:33:20.998318] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.662 [2024-10-07 11:33:20.998333] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.662 [2024-10-07 11:33:20.998409] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.662 [2024-10-07 11:33:21.012283] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.662 [2024-10-07 11:33:21.012774] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.662 [2024-10-07 11:33:21.012820] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.662 [2024-10-07 11:33:21.012841] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.662 [2024-10-07 11:33:21.012913] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.662 [2024-10-07 11:33:21.012942] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.662 [2024-10-07 11:33:21.012958] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.662 [2024-10-07 11:33:21.012971] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.662 [2024-10-07 11:33:21.012996] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.662 [2024-10-07 11:33:21.028042] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.662 [2024-10-07 11:33:21.028217] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.662 [2024-10-07 11:33:21.028262] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.662 [2024-10-07 11:33:21.028282] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.662 [2024-10-07 11:33:21.028310] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.662 [2024-10-07 11:33:21.028350] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.663 [2024-10-07 11:33:21.028380] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.663 [2024-10-07 11:33:21.028405] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.663 [2024-10-07 11:33:21.028446] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.663 [2024-10-07 11:33:21.043736] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.663 [2024-10-07 11:33:21.043893] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.663 [2024-10-07 11:33:21.043941] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.663 [2024-10-07 11:33:21.043987] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.663 [2024-10-07 11:33:21.045105] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.663 [2024-10-07 11:33:21.046026] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.663 [2024-10-07 11:33:21.046088] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.663 [2024-10-07 11:33:21.046124] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.663 [2024-10-07 11:33:21.046498] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.663 [2024-10-07 11:33:21.061002] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.663 [2024-10-07 11:33:21.061322] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.663 [2024-10-07 11:33:21.061369] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.663 [2024-10-07 11:33:21.061399] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.663 [2024-10-07 11:33:21.062140] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.663 [2024-10-07 11:33:21.062596] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.663 [2024-10-07 11:33:21.062639] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.663 [2024-10-07 11:33:21.062689] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.663 [2024-10-07 11:33:21.062787] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.663 [2024-10-07 11:33:21.073970] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.663 [2024-10-07 11:33:21.074249] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.663 [2024-10-07 11:33:21.074363] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.663 [2024-10-07 11:33:21.074478] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.663 [2024-10-07 11:33:21.074576] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.663 [2024-10-07 11:33:21.074687] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.663 [2024-10-07 11:33:21.074781] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.663 [2024-10-07 11:33:21.074870] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.663 [2024-10-07 11:33:21.074960] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.663 [2024-10-07 11:33:21.085461] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.663 [2024-10-07 11:33:21.085791] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.663 [2024-10-07 11:33:21.085934] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.663 [2024-10-07 11:33:21.086025] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.663 [2024-10-07 11:33:21.086251] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.663 [2024-10-07 11:33:21.086497] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.663 [2024-10-07 11:33:21.086594] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.663 [2024-10-07 11:33:21.086701] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.663 [2024-10-07 11:33:21.086937] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.663 [2024-10-07 11:33:21.097394] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.663 [2024-10-07 11:33:21.098156] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.663 [2024-10-07 11:33:21.098279] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.663 [2024-10-07 11:33:21.098394] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.663 [2024-10-07 11:33:21.098651] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.663 [2024-10-07 11:33:21.098943] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.663 [2024-10-07 11:33:21.099043] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.663 [2024-10-07 11:33:21.099143] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.663 [2024-10-07 11:33:21.099315] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.663 [2024-10-07 11:33:21.110587] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.663 [2024-10-07 11:33:21.111633] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.663 [2024-10-07 11:33:21.111782] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.663 [2024-10-07 11:33:21.111872] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.663 [2024-10-07 11:33:21.112079] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.663 [2024-10-07 11:33:21.112198] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.663 [2024-10-07 11:33:21.112280] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.663 [2024-10-07 11:33:21.112348] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.663 [2024-10-07 11:33:21.112436] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.663 [2024-10-07 11:33:21.125494] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.663 [2024-10-07 11:33:21.125813] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.663 [2024-10-07 11:33:21.125930] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.663 [2024-10-07 11:33:21.126030] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.663 [2024-10-07 11:33:21.126646] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.663 [2024-10-07 11:33:21.127018] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.663 [2024-10-07 11:33:21.127115] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.663 [2024-10-07 11:33:21.127233] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.663 [2024-10-07 11:33:21.127833] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.663 [2024-10-07 11:33:21.139248] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.663 [2024-10-07 11:33:21.139445] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.663 [2024-10-07 11:33:21.139543] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.663 [2024-10-07 11:33:21.139631] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.663 [2024-10-07 11:33:21.140322] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.663 [2024-10-07 11:33:21.140511] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.663 [2024-10-07 11:33:21.140631] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.663 [2024-10-07 11:33:21.140744] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.663 [2024-10-07 11:33:21.140832] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.663 [2024-10-07 11:33:21.150146] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.663 [2024-10-07 11:33:21.150521] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.663 [2024-10-07 11:33:21.150641] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.663 [2024-10-07 11:33:21.150757] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.663 [2024-10-07 11:33:21.150909] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.663 [2024-10-07 11:33:21.151068] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.663 [2024-10-07 11:33:21.151094] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.663 [2024-10-07 11:33:21.151109] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.663 [2024-10-07 11:33:21.151169] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.663 [2024-10-07 11:33:21.160480] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.663 [2024-10-07 11:33:21.161093] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.663 [2024-10-07 11:33:21.161213] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.663 [2024-10-07 11:33:21.161299] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.663 [2024-10-07 11:33:21.161518] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.663 [2024-10-07 11:33:21.164147] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.663 [2024-10-07 11:33:21.164259] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.663 [2024-10-07 11:33:21.164340] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.663 [2024-10-07 11:33:21.166777] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.663 [2024-10-07 11:33:21.170638] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.663 [2024-10-07 11:33:21.170855] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.663 [2024-10-07 11:33:21.170971] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.664 [2024-10-07 11:33:21.171053] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.664 [2024-10-07 11:33:21.171155] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.664 [2024-10-07 11:33:21.171287] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.664 [2024-10-07 11:33:21.171369] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.664 [2024-10-07 11:33:21.171444] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.664 [2024-10-07 11:33:21.171791] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.664 [2024-10-07 11:33:21.181236] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.664 [2024-10-07 11:33:21.181433] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.664 [2024-10-07 11:33:21.181541] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.664 [2024-10-07 11:33:21.181626] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.664 [2024-10-07 11:33:21.181915] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.664 [2024-10-07 11:33:21.182136] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.664 [2024-10-07 11:33:21.182229] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.664 [2024-10-07 11:33:21.182307] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.664 [2024-10-07 11:33:21.182520] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.664 [2024-10-07 11:33:21.195183] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.664 [2024-10-07 11:33:21.195491] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.664 [2024-10-07 11:33:21.195625] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.664 [2024-10-07 11:33:21.195754] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.664 [2024-10-07 11:33:21.196445] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.664 [2024-10-07 11:33:21.196838] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.664 [2024-10-07 11:33:21.196958] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.664 [2024-10-07 11:33:21.197053] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.664 [2024-10-07 11:33:21.197177] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.664 [2024-10-07 11:33:21.205595] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.664 [2024-10-07 11:33:21.206297] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.664 [2024-10-07 11:33:21.206401] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.664 [2024-10-07 11:33:21.206502] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.664 [2024-10-07 11:33:21.209497] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.664 [2024-10-07 11:33:21.210189] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.664 [2024-10-07 11:33:21.210305] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.664 [2024-10-07 11:33:21.210395] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.664 [2024-10-07 11:33:21.210712] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.664 [2024-10-07 11:33:21.216824] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.664 [2024-10-07 11:33:21.217383] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.664 [2024-10-07 11:33:21.217494] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.664 [2024-10-07 11:33:21.217576] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.664 [2024-10-07 11:33:21.220766] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.664 [2024-10-07 11:33:21.221233] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.664 [2024-10-07 11:33:21.221341] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.664 [2024-10-07 11:33:21.221426] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.664 [2024-10-07 11:33:21.223353] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.664 [2024-10-07 11:33:21.226980] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.664 [2024-10-07 11:33:21.227245] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.664 [2024-10-07 11:33:21.227347] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.664 [2024-10-07 11:33:21.227434] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.664 [2024-10-07 11:33:21.228296] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.664 [2024-10-07 11:33:21.228500] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.664 [2024-10-07 11:33:21.228580] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.664 [2024-10-07 11:33:21.228697] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.664 [2024-10-07 11:33:21.230356] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.664 [2024-10-07 11:33:21.238540] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.664 [2024-10-07 11:33:21.239463] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.664 [2024-10-07 11:33:21.239511] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.664 [2024-10-07 11:33:21.239533] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.664 [2024-10-07 11:33:21.239945] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.664 [2024-10-07 11:33:21.240177] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.664 [2024-10-07 11:33:21.240213] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.664 [2024-10-07 11:33:21.240230] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.664 [2024-10-07 11:33:21.240292] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.664 [2024-10-07 11:33:21.249010] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.664 [2024-10-07 11:33:21.249259] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.664 [2024-10-07 11:33:21.249292] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.664 [2024-10-07 11:33:21.249309] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.664 [2024-10-07 11:33:21.249440] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.664 [2024-10-07 11:33:21.249559] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.664 [2024-10-07 11:33:21.249599] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.664 [2024-10-07 11:33:21.249635] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.664 [2024-10-07 11:33:21.249769] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.664 [2024-10-07 11:33:21.259354] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.664 [2024-10-07 11:33:21.259465] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.664 [2024-10-07 11:33:21.259496] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.664 [2024-10-07 11:33:21.259513] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.664 [2024-10-07 11:33:21.259537] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.664 [2024-10-07 11:33:21.259559] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.664 [2024-10-07 11:33:21.259574] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.664 [2024-10-07 11:33:21.259588] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.664 [2024-10-07 11:33:21.259611] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.664 [2024-10-07 11:33:21.269431] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.664 [2024-10-07 11:33:21.269551] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.664 [2024-10-07 11:33:21.269581] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.664 [2024-10-07 11:33:21.269598] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.664 [2024-10-07 11:33:21.269625] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.664 [2024-10-07 11:33:21.269647] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.664 [2024-10-07 11:33:21.269661] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.665 [2024-10-07 11:33:21.269692] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.665 [2024-10-07 11:33:21.269941] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.665 [2024-10-07 11:33:21.279758] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.665 [2024-10-07 11:33:21.279881] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.665 [2024-10-07 11:33:21.279912] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.665 [2024-10-07 11:33:21.279929] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.665 [2024-10-07 11:33:21.279952] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.665 [2024-10-07 11:33:21.279976] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.665 [2024-10-07 11:33:21.279990] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.665 [2024-10-07 11:33:21.280003] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.665 [2024-10-07 11:33:21.280026] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.665 [2024-10-07 11:33:21.294127] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.665 [2024-10-07 11:33:21.294271] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.665 [2024-10-07 11:33:21.294304] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.665 [2024-10-07 11:33:21.294321] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.665 [2024-10-07 11:33:21.294344] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.665 [2024-10-07 11:33:21.294367] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.665 [2024-10-07 11:33:21.294382] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.665 [2024-10-07 11:33:21.294396] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.665 [2024-10-07 11:33:21.294450] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.665 [2024-10-07 11:33:21.308953] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.665 [2024-10-07 11:33:21.309055] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.665 [2024-10-07 11:33:21.309086] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.665 [2024-10-07 11:33:21.309102] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.665 [2024-10-07 11:33:21.309126] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.665 [2024-10-07 11:33:21.309148] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.665 [2024-10-07 11:33:21.309163] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.665 [2024-10-07 11:33:21.309176] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.665 [2024-10-07 11:33:21.309200] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.665 [2024-10-07 11:33:21.319029] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.665 [2024-10-07 11:33:21.319139] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.665 [2024-10-07 11:33:21.319170] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.665 [2024-10-07 11:33:21.319187] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.665 [2024-10-07 11:33:21.322005] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.665 [2024-10-07 11:33:21.324511] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.665 [2024-10-07 11:33:21.324547] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.665 [2024-10-07 11:33:21.324564] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.665 [2024-10-07 11:33:21.325533] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.665 [2024-10-07 11:33:21.329106] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.665 [2024-10-07 11:33:21.329206] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.665 [2024-10-07 11:33:21.329236] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.665 [2024-10-07 11:33:21.329252] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.665 [2024-10-07 11:33:21.329294] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.665 [2024-10-07 11:33:21.329319] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.665 [2024-10-07 11:33:21.329333] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.665 [2024-10-07 11:33:21.329347] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.665 [2024-10-07 11:33:21.329370] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.665 [2024-10-07 11:33:21.340090] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.665 [2024-10-07 11:33:21.340194] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.665 [2024-10-07 11:33:21.340226] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.665 [2024-10-07 11:33:21.340242] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.665 [2024-10-07 11:33:21.340266] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.665 [2024-10-07 11:33:21.340289] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.665 [2024-10-07 11:33:21.340303] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.665 [2024-10-07 11:33:21.340316] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.665 [2024-10-07 11:33:21.340340] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.665 [2024-10-07 11:33:21.355002] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.665 [2024-10-07 11:33:21.357375] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.665 [2024-10-07 11:33:21.357416] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.665 [2024-10-07 11:33:21.357435] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.665 [2024-10-07 11:33:21.357922] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.665 [2024-10-07 11:33:21.358112] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.665 [2024-10-07 11:33:21.358144] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.665 [2024-10-07 11:33:21.358161] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.665 [2024-10-07 11:33:21.358266] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.665 [2024-10-07 11:33:21.366994] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.665 [2024-10-07 11:33:21.367223] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.665 [2024-10-07 11:33:21.367263] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.665 [2024-10-07 11:33:21.367283] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.665 [2024-10-07 11:33:21.367308] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.665 [2024-10-07 11:33:21.367330] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.665 [2024-10-07 11:33:21.367345] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.665 [2024-10-07 11:33:21.367375] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.665 [2024-10-07 11:33:21.367402] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.665 [2024-10-07 11:33:21.377226] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.665 [2024-10-07 11:33:21.377327] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.665 [2024-10-07 11:33:21.377357] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.665 [2024-10-07 11:33:21.377373] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.665 [2024-10-07 11:33:21.377397] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.665 [2024-10-07 11:33:21.377418] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.665 [2024-10-07 11:33:21.377432] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.665 [2024-10-07 11:33:21.377445] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.665 [2024-10-07 11:33:21.377469] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.665 [2024-10-07 11:33:21.389878] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.665 [2024-10-07 11:33:21.390039] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.665 [2024-10-07 11:33:21.390076] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.665 [2024-10-07 11:33:21.390095] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.665 [2024-10-07 11:33:21.390151] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.665 [2024-10-07 11:33:21.390197] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.665 [2024-10-07 11:33:21.390217] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.665 [2024-10-07 11:33:21.390231] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.665 [2024-10-07 11:33:21.390256] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.665 [2024-10-07 11:33:21.401722] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.665 [2024-10-07 11:33:21.401928] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.665 [2024-10-07 11:33:21.401966] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.665 [2024-10-07 11:33:21.401984] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.665 [2024-10-07 11:33:21.402131] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.666 [2024-10-07 11:33:21.402256] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.666 [2024-10-07 11:33:21.402282] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.666 [2024-10-07 11:33:21.402297] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.666 [2024-10-07 11:33:21.402487] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.666 [2024-10-07 11:33:21.411798] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.666 [2024-10-07 11:33:21.411899] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.666 [2024-10-07 11:33:21.411957] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.666 [2024-10-07 11:33:21.411977] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.666 [2024-10-07 11:33:21.412001] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.666 [2024-10-07 11:33:21.412025] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.666 [2024-10-07 11:33:21.412040] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.666 [2024-10-07 11:33:21.412053] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.666 [2024-10-07 11:33:21.412077] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.666 [2024-10-07 11:33:21.422836] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.666 [2024-10-07 11:33:21.423045] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.666 [2024-10-07 11:33:21.423084] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.666 [2024-10-07 11:33:21.423103] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.666 [2024-10-07 11:33:21.423220] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.666 [2024-10-07 11:33:21.424562] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.666 [2024-10-07 11:33:21.424597] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.666 [2024-10-07 11:33:21.424613] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.666 [2024-10-07 11:33:21.425739] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.666 [2024-10-07 11:33:21.433261] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.666 [2024-10-07 11:33:21.433461] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.666 [2024-10-07 11:33:21.433499] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.666 [2024-10-07 11:33:21.433518] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.666 [2024-10-07 11:33:21.433635] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.666 [2024-10-07 11:33:21.433793] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.666 [2024-10-07 11:33:21.433823] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.666 [2024-10-07 11:33:21.433838] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.666 [2024-10-07 11:33:21.434717] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.666 [2024-10-07 11:33:21.443379] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.666 [2024-10-07 11:33:21.443487] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.666 [2024-10-07 11:33:21.443522] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.666 [2024-10-07 11:33:21.443539] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.666 [2024-10-07 11:33:21.443585] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.666 [2024-10-07 11:33:21.443637] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.666 [2024-10-07 11:33:21.443669] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.666 [2024-10-07 11:33:21.443685] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.666 [2024-10-07 11:33:21.443710] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.666 [2024-10-07 11:33:21.456135] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.666 [2024-10-07 11:33:21.456279] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.666 [2024-10-07 11:33:21.456317] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.666 [2024-10-07 11:33:21.456337] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.666 [2024-10-07 11:33:21.456362] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.666 [2024-10-07 11:33:21.456385] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.666 [2024-10-07 11:33:21.456399] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.666 [2024-10-07 11:33:21.456413] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.666 [2024-10-07 11:33:21.456438] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.666 [2024-10-07 11:33:21.470490] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.666 [2024-10-07 11:33:21.470605] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.666 [2024-10-07 11:33:21.470641] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.666 [2024-10-07 11:33:21.470675] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.666 [2024-10-07 11:33:21.470702] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.666 [2024-10-07 11:33:21.470725] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.666 [2024-10-07 11:33:21.470740] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.666 [2024-10-07 11:33:21.470754] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.666 [2024-10-07 11:33:21.470778] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.666 [2024-10-07 11:33:21.485233] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.666 [2024-10-07 11:33:21.485437] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.666 [2024-10-07 11:33:21.485475] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.666 [2024-10-07 11:33:21.485494] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.666 [2024-10-07 11:33:21.486007] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.666 [2024-10-07 11:33:21.486128] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.666 [2024-10-07 11:33:21.486158] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.666 [2024-10-07 11:33:21.486174] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.666 [2024-10-07 11:33:21.486217] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.666 [2024-10-07 11:33:21.498606] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.666 [2024-10-07 11:33:21.498728] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.666 [2024-10-07 11:33:21.498759] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.666 [2024-10-07 11:33:21.498776] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.666 [2024-10-07 11:33:21.499357] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.666 [2024-10-07 11:33:21.499473] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.666 [2024-10-07 11:33:21.499497] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.666 [2024-10-07 11:33:21.499512] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.666 [2024-10-07 11:33:21.499537] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.666 [2024-10-07 11:33:21.509268] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.666 [2024-10-07 11:33:21.509484] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.666 [2024-10-07 11:33:21.509517] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.666 [2024-10-07 11:33:21.509535] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.666 [2024-10-07 11:33:21.509703] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.666 [2024-10-07 11:33:21.509855] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.666 [2024-10-07 11:33:21.509892] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.666 [2024-10-07 11:33:21.509910] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.666 [2024-10-07 11:33:21.510092] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.666 [2024-10-07 11:33:21.519523] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.666 [2024-10-07 11:33:21.519852] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.666 [2024-10-07 11:33:21.519897] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.666 [2024-10-07 11:33:21.519917] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.666 [2024-10-07 11:33:21.519974] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.666 [2024-10-07 11:33:21.520003] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.666 [2024-10-07 11:33:21.520019] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.666 [2024-10-07 11:33:21.520033] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.666 [2024-10-07 11:33:21.520057] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.666 [2024-10-07 11:33:21.530047] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.666 [2024-10-07 11:33:21.530155] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.666 [2024-10-07 11:33:21.530185] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.667 [2024-10-07 11:33:21.530229] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.667 [2024-10-07 11:33:21.530255] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.667 [2024-10-07 11:33:21.530278] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.667 [2024-10-07 11:33:21.530296] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.667 [2024-10-07 11:33:21.530309] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.667 [2024-10-07 11:33:21.530334] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.667 [2024-10-07 11:33:21.541189] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.667 [2024-10-07 11:33:21.542583] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.667 [2024-10-07 11:33:21.542628] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.667 [2024-10-07 11:33:21.542661] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.667 [2024-10-07 11:33:21.543223] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.667 [2024-10-07 11:33:21.543470] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.667 [2024-10-07 11:33:21.543499] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.667 [2024-10-07 11:33:21.543514] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.667 [2024-10-07 11:33:21.543739] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.667 [2024-10-07 11:33:21.551289] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.667 [2024-10-07 11:33:21.551395] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.667 [2024-10-07 11:33:21.551426] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.667 [2024-10-07 11:33:21.551451] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.667 [2024-10-07 11:33:21.554261] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.667 [2024-10-07 11:33:21.556881] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.667 [2024-10-07 11:33:21.556920] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.667 [2024-10-07 11:33:21.556955] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.667 [2024-10-07 11:33:21.557421] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.667 [2024-10-07 11:33:21.561365] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.667 [2024-10-07 11:33:21.561484] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.667 [2024-10-07 11:33:21.561514] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.667 [2024-10-07 11:33:21.561530] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.667 [2024-10-07 11:33:21.561553] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.667 [2024-10-07 11:33:21.561577] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.667 [2024-10-07 11:33:21.561611] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.667 [2024-10-07 11:33:21.561626] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.667 [2024-10-07 11:33:21.561649] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.667 [2024-10-07 11:33:21.571456] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.667 [2024-10-07 11:33:21.571563] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.667 [2024-10-07 11:33:21.571593] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.667 [2024-10-07 11:33:21.571610] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.667 [2024-10-07 11:33:21.571636] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.667 [2024-10-07 11:33:21.571676] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.667 [2024-10-07 11:33:21.571692] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.667 [2024-10-07 11:33:21.571706] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.667 [2024-10-07 11:33:21.571730] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.667 [2024-10-07 11:33:21.585702] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.667 [2024-10-07 11:33:21.585820] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.667 [2024-10-07 11:33:21.585850] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.667 [2024-10-07 11:33:21.585867] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.667 [2024-10-07 11:33:21.585890] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.667 [2024-10-07 11:33:21.585912] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.667 [2024-10-07 11:33:21.585926] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.667 [2024-10-07 11:33:21.585939] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.667 [2024-10-07 11:33:21.585962] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.667 [2024-10-07 11:33:21.600505] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.667 [2024-10-07 11:33:21.600717] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.667 [2024-10-07 11:33:21.600749] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.667 [2024-10-07 11:33:21.600767] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.667 [2024-10-07 11:33:21.600791] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.667 [2024-10-07 11:33:21.600814] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.667 [2024-10-07 11:33:21.600829] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.667 [2024-10-07 11:33:21.600843] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.667 [2024-10-07 11:33:21.600867] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.667 [2024-10-07 11:33:21.610918] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.667 [2024-10-07 11:33:21.611160] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.667 [2024-10-07 11:33:21.611229] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.667 [2024-10-07 11:33:21.611249] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.667 [2024-10-07 11:33:21.611384] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.667 [2024-10-07 11:33:21.611504] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.667 [2024-10-07 11:33:21.611526] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.667 [2024-10-07 11:33:21.611541] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.667 [2024-10-07 11:33:21.611642] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.667 [2024-10-07 11:33:21.621015] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.667 [2024-10-07 11:33:21.621149] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.667 [2024-10-07 11:33:21.621179] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.667 [2024-10-07 11:33:21.621195] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.667 [2024-10-07 11:33:21.621219] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.667 [2024-10-07 11:33:21.621241] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.667 [2024-10-07 11:33:21.621255] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.667 [2024-10-07 11:33:21.621268] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.667 [2024-10-07 11:33:21.621291] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.667 [2024-10-07 11:33:21.633067] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.667 [2024-10-07 11:33:21.633744] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.667 [2024-10-07 11:33:21.633788] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.667 [2024-10-07 11:33:21.633809] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.667 [2024-10-07 11:33:21.633891] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.667 [2024-10-07 11:33:21.633921] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.667 [2024-10-07 11:33:21.633937] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.667 [2024-10-07 11:33:21.633950] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.667 [2024-10-07 11:33:21.633975] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.667 [2024-10-07 11:33:21.644141] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.667 [2024-10-07 11:33:21.644329] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.667 [2024-10-07 11:33:21.644362] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.667 [2024-10-07 11:33:21.644379] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.667 [2024-10-07 11:33:21.645257] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.667 [2024-10-07 11:33:21.645394] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.667 [2024-10-07 11:33:21.645418] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.667 [2024-10-07 11:33:21.645433] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.667 [2024-10-07 11:33:21.645458] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.668 [2024-10-07 11:33:21.654224] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.668 [2024-10-07 11:33:21.654331] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.668 [2024-10-07 11:33:21.654362] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.668 [2024-10-07 11:33:21.654379] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.668 [2024-10-07 11:33:21.656607] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.668 [2024-10-07 11:33:21.657297] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.668 [2024-10-07 11:33:21.657350] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.668 [2024-10-07 11:33:21.657368] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.668 [2024-10-07 11:33:21.657500] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.668 [2024-10-07 11:33:21.664309] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.668 [2024-10-07 11:33:21.664426] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.668 [2024-10-07 11:33:21.664459] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.668 [2024-10-07 11:33:21.664476] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.668 [2024-10-07 11:33:21.664501] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.668 [2024-10-07 11:33:21.664524] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.668 [2024-10-07 11:33:21.664539] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.668 [2024-10-07 11:33:21.664552] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.668 [2024-10-07 11:33:21.664577] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.668 [2024-10-07 11:33:21.674520] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.668 [2024-10-07 11:33:21.674664] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.668 [2024-10-07 11:33:21.674697] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.668 [2024-10-07 11:33:21.674715] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.668 [2024-10-07 11:33:21.674741] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.668 [2024-10-07 11:33:21.674764] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.668 [2024-10-07 11:33:21.674780] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.668 [2024-10-07 11:33:21.674812] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.668 [2024-10-07 11:33:21.676746] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.668 [2024-10-07 11:33:21.684628] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.668 [2024-10-07 11:33:21.684759] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.668 [2024-10-07 11:33:21.684799] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.668 [2024-10-07 11:33:21.684818] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.668 [2024-10-07 11:33:21.684843] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.668 [2024-10-07 11:33:21.684866] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.668 [2024-10-07 11:33:21.684881] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.668 [2024-10-07 11:33:21.684894] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.668 [2024-10-07 11:33:21.684918] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.668 [2024-10-07 11:33:21.697642] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.668 [2024-10-07 11:33:21.698223] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.668 [2024-10-07 11:33:21.698268] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.668 [2024-10-07 11:33:21.698289] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.668 [2024-10-07 11:33:21.698399] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.668 [2024-10-07 11:33:21.698433] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.668 [2024-10-07 11:33:21.698451] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.668 [2024-10-07 11:33:21.698465] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.668 [2024-10-07 11:33:21.698490] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.668 [2024-10-07 11:33:21.708627] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.668 [2024-10-07 11:33:21.708879] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.668 [2024-10-07 11:33:21.708913] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.668 [2024-10-07 11:33:21.708931] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.668 [2024-10-07 11:33:21.709064] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.668 [2024-10-07 11:33:21.709198] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.668 [2024-10-07 11:33:21.709232] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.668 [2024-10-07 11:33:21.709250] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.668 [2024-10-07 11:33:21.709380] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.668 [2024-10-07 11:33:21.718737] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.668 [2024-10-07 11:33:21.718895] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.668 [2024-10-07 11:33:21.718926] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.668 [2024-10-07 11:33:21.718942] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.668 [2024-10-07 11:33:21.718966] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.668 [2024-10-07 11:33:21.718989] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.668 [2024-10-07 11:33:21.719003] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.668 [2024-10-07 11:33:21.719016] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.668 [2024-10-07 11:33:21.719039] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.668 [2024-10-07 11:33:21.729846] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.668 [2024-10-07 11:33:21.730054] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.668 [2024-10-07 11:33:21.730087] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.668 [2024-10-07 11:33:21.730104] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.668 [2024-10-07 11:33:21.730220] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.668 [2024-10-07 11:33:21.730346] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.668 [2024-10-07 11:33:21.730369] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.668 [2024-10-07 11:33:21.730383] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.668 [2024-10-07 11:33:21.730488] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.668 [2024-10-07 11:33:21.742369] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.668 [2024-10-07 11:33:21.742584] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.668 [2024-10-07 11:33:21.742631] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.668 [2024-10-07 11:33:21.742668] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.668 [2024-10-07 11:33:21.742698] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.668 [2024-10-07 11:33:21.742721] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.668 [2024-10-07 11:33:21.742736] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.668 [2024-10-07 11:33:21.742750] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.668 [2024-10-07 11:33:21.742775] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.668 [2024-10-07 11:33:21.754382] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.668 [2024-10-07 11:33:21.754554] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.668 [2024-10-07 11:33:21.754587] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.668 [2024-10-07 11:33:21.754605] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.668 [2024-10-07 11:33:21.754802] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.668 [2024-10-07 11:33:21.754889] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.668 [2024-10-07 11:33:21.754913] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.668 [2024-10-07 11:33:21.754927] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.668 [2024-10-07 11:33:21.754952] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.668 [2024-10-07 11:33:21.767308] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.668 [2024-10-07 11:33:21.767534] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.668 [2024-10-07 11:33:21.767579] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.668 [2024-10-07 11:33:21.767600] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.669 [2024-10-07 11:33:21.767778] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.669 [2024-10-07 11:33:21.767915] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.669 [2024-10-07 11:33:21.767944] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.669 [2024-10-07 11:33:21.767961] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.669 [2024-10-07 11:33:21.768100] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.669 [2024-10-07 11:33:21.778049] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.669 [2024-10-07 11:33:21.778327] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.669 [2024-10-07 11:33:21.778379] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.669 [2024-10-07 11:33:21.778416] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.669 [2024-10-07 11:33:21.778575] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.669 [2024-10-07 11:33:21.778747] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.669 [2024-10-07 11:33:21.778783] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.669 [2024-10-07 11:33:21.778801] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.669 [2024-10-07 11:33:21.782423] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.669 [2024-10-07 11:33:21.783819] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:28 nsid:1 lba:81440 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:37.669 [2024-10-07 11:33:21.783854] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:37.669 [2024-10-07 11:33:21.783879] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:19 nsid:1 lba:81448 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:37.669 [2024-10-07 11:33:21.783896] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:37.669 [2024-10-07 11:33:21.783912] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:95 nsid:1 lba:81456 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:37.669 [2024-10-07 11:33:21.783926] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:37.669 [2024-10-07 11:33:21.783942] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:18 nsid:1 lba:81464 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:37.669 [2024-10-07 11:33:21.783974] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:37.669 [2024-10-07 11:33:21.783992] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:30 nsid:1 lba:81472 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:37.669 [2024-10-07 11:33:21.784006] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:37.669 [2024-10-07 11:33:21.784021] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:75 nsid:1 lba:81480 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:37.669 [2024-10-07 11:33:21.784036] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:37.669 [2024-10-07 11:33:21.784051] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:68 nsid:1 lba:81488 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:37.669 [2024-10-07 11:33:21.784065] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:37.669 [2024-10-07 11:33:21.784080] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:27 nsid:1 lba:81496 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:37.669 [2024-10-07 11:33:21.784094] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:37.669 [2024-10-07 11:33:21.784110] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:79 nsid:1 lba:81504 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:37.669 [2024-10-07 11:33:21.784123] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:37.669 [2024-10-07 11:33:21.784138] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:108 nsid:1 lba:81512 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:37.669 [2024-10-07 11:33:21.784153] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:37.669 [2024-10-07 11:33:21.784168] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:81520 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:37.669 [2024-10-07 11:33:21.784182] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:37.669 [2024-10-07 11:33:21.784203] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:72 nsid:1 lba:81528 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:37.669 [2024-10-07 11:33:21.784217] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:37.669 [2024-10-07 11:33:21.784233] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:102 nsid:1 lba:81536 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:37.669 [2024-10-07 11:33:21.784247] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:37.669 [2024-10-07 11:33:21.784263] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:81544 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:37.669 [2024-10-07 11:33:21.784277] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:37.669 [2024-10-07 11:33:21.784292] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:42 nsid:1 lba:81552 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:37.669 [2024-10-07 11:33:21.784306] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:37.669 [2024-10-07 11:33:21.784321] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:81560 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:37.669 [2024-10-07 11:33:21.784335] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:37.669 [2024-10-07 11:33:21.784358] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:29 nsid:1 lba:81568 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:37.669 [2024-10-07 11:33:21.784379] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:37.669 [2024-10-07 11:33:21.784395] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:84 nsid:1 lba:81576 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:37.669 [2024-10-07 11:33:21.784409] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:37.669 [2024-10-07 11:33:21.784425] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:83 nsid:1 lba:81584 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:37.669 [2024-10-07 11:33:21.784439] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:37.669 [2024-10-07 11:33:21.784455] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:125 nsid:1 lba:81592 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:37.669 [2024-10-07 11:33:21.784469] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:37.669 [2024-10-07 11:33:21.784485] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:81600 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:37.669 [2024-10-07 11:33:21.784499] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:37.669 [2024-10-07 11:33:21.784515] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:86 nsid:1 lba:81608 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:37.669 [2024-10-07 11:33:21.784529] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:37.669 [2024-10-07 11:33:21.784545] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:41 nsid:1 lba:81616 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:37.669 [2024-10-07 11:33:21.784559] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:37.669 [2024-10-07 11:33:21.784574] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:34 nsid:1 lba:81624 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:37.669 [2024-10-07 11:33:21.784589] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:37.669 [2024-10-07 11:33:21.784604] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:88 nsid:1 lba:81632 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:37.669 [2024-10-07 11:33:21.784619] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:37.669 [2024-10-07 11:33:21.784634] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:82 nsid:1 lba:81640 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:37.669 [2024-10-07 11:33:21.784662] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:37.669 [2024-10-07 11:33:21.784682] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:123 nsid:1 lba:81648 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:37.669 [2024-10-07 11:33:21.784696] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:37.669 [2024-10-07 11:33:21.784712] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:16 nsid:1 lba:81656 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:37.669 [2024-10-07 11:33:21.784726] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:37.669 [2024-10-07 11:33:21.784744] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:35 nsid:1 lba:81664 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:37.669 [2024-10-07 11:33:21.784767] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:37.669 [2024-10-07 11:33:21.784784] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:56 nsid:1 lba:81672 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:37.669 [2024-10-07 11:33:21.784798] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:37.669 [2024-10-07 11:33:21.784814] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:81680 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:37.669 [2024-10-07 11:33:21.784829] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:37.669 [2024-10-07 11:33:21.784844] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:90 nsid:1 lba:81688 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:37.670 [2024-10-07 11:33:21.784859] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:37.670 [2024-10-07 11:33:21.784874] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:59 nsid:1 lba:81696 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:37.670 [2024-10-07 11:33:21.784893] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:37.670 [2024-10-07 11:33:21.784911] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:52 nsid:1 lba:81704 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:37.670 [2024-10-07 11:33:21.784925] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:37.670 [2024-10-07 11:33:21.784941] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:43 nsid:1 lba:81712 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:37.670 [2024-10-07 11:33:21.784955] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:37.670 [2024-10-07 11:33:21.784971] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:17 nsid:1 lba:81720 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:37.670 [2024-10-07 11:33:21.784995] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:37.670 [2024-10-07 11:33:21.785011] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:55 nsid:1 lba:81856 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:22:37.670 [2024-10-07 11:33:21.785025] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:37.670 [2024-10-07 11:33:21.785041] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:114 nsid:1 lba:81864 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:22:37.670 [2024-10-07 11:33:21.785056] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:37.670 [2024-10-07 11:33:21.785072] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:70 nsid:1 lba:81872 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:22:37.670 [2024-10-07 11:33:21.785086] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:37.670 [2024-10-07 11:33:21.785102] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:54 nsid:1 lba:81880 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:22:37.670 [2024-10-07 11:33:21.785116] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:37.670 [2024-10-07 11:33:21.785131] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:126 nsid:1 lba:81888 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:22:37.670 [2024-10-07 11:33:21.785146] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:37.670 [2024-10-07 11:33:21.785168] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:92 nsid:1 lba:81896 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:22:37.670 [2024-10-07 11:33:21.785183] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:37.670 [2024-10-07 11:33:21.785199] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:64 nsid:1 lba:81904 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:22:37.670 [2024-10-07 11:33:21.785213] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:37.670 [2024-10-07 11:33:21.785229] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:85 nsid:1 lba:81912 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:22:37.670 [2024-10-07 11:33:21.785243] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:37.670 [2024-10-07 11:33:21.785259] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:4 nsid:1 lba:81920 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:22:37.670 [2024-10-07 11:33:21.785274] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:37.670 [2024-10-07 11:33:21.785289] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:39 nsid:1 lba:81928 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:22:37.670 [2024-10-07 11:33:21.785303] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:37.670 [2024-10-07 11:33:21.785319] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:71 nsid:1 lba:81936 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:22:37.670 [2024-10-07 11:33:21.785333] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:37.670 [2024-10-07 11:33:21.785348] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:50 nsid:1 lba:81944 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:22:37.670 [2024-10-07 11:33:21.785363] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:37.670 [2024-10-07 11:33:21.785379] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:36 nsid:1 lba:81952 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:22:37.670 [2024-10-07 11:33:21.785398] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:37.670 [2024-10-07 11:33:21.785414] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:40 nsid:1 lba:81960 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:22:37.670 [2024-10-07 11:33:21.785428] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:37.670 [2024-10-07 11:33:21.785444] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:13 nsid:1 lba:81968 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:22:37.670 [2024-10-07 11:33:21.785459] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:37.670 [2024-10-07 11:33:21.785474] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:119 nsid:1 lba:81976 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:22:37.670 [2024-10-07 11:33:21.785488] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:37.670 [2024-10-07 11:33:21.785504] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:115 nsid:1 lba:81984 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:22:37.670 [2024-10-07 11:33:21.785518] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:37.670 [2024-10-07 11:33:21.785535] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:100 nsid:1 lba:81992 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:22:37.670 [2024-10-07 11:33:21.785548] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:37.670 [2024-10-07 11:33:21.785571] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:101 nsid:1 lba:82000 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:22:37.670 [2024-10-07 11:33:21.785586] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:37.670 [2024-10-07 11:33:21.785603] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:78 nsid:1 lba:82008 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:22:37.670 [2024-10-07 11:33:21.785617] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:37.670 [2024-10-07 11:33:21.785633] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:23 nsid:1 lba:82016 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:22:37.670 [2024-10-07 11:33:21.785660] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:37.670 [2024-10-07 11:33:21.785680] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:21 nsid:1 lba:82024 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:22:37.670 [2024-10-07 11:33:21.785694] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:37.670 [2024-10-07 11:33:21.785710] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:89 nsid:1 lba:82032 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:22:37.670 [2024-10-07 11:33:21.785724] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:37.670 [2024-10-07 11:33:21.785740] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:111 nsid:1 lba:82040 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:22:37.670 [2024-10-07 11:33:21.785754] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:37.670 [2024-10-07 11:33:21.785776] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:117 nsid:1 lba:82048 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:22:37.670 [2024-10-07 11:33:21.785791] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:37.670 [2024-10-07 11:33:21.785807] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:33 nsid:1 lba:82056 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:22:37.670 [2024-10-07 11:33:21.785822] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:37.670 [2024-10-07 11:33:21.785838] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:51 nsid:1 lba:81728 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:37.670 [2024-10-07 11:33:21.785852] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:37.670 [2024-10-07 11:33:21.785868] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:58 nsid:1 lba:81736 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:37.670 [2024-10-07 11:33:21.785882] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:37.670 [2024-10-07 11:33:21.785898] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:67 nsid:1 lba:81744 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:37.670 [2024-10-07 11:33:21.785917] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:37.670 [2024-10-07 11:33:21.785933] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:80 nsid:1 lba:81752 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:37.670 [2024-10-07 11:33:21.785947] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:37.670 [2024-10-07 11:33:21.785963] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:81760 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:37.670 [2024-10-07 11:33:21.785984] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:37.670 [2024-10-07 11:33:21.786001] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:81768 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:37.670 [2024-10-07 11:33:21.786015] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:37.670 [2024-10-07 11:33:21.786031] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:53 nsid:1 lba:81776 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:37.670 [2024-10-07 11:33:21.786045] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:37.670 [2024-10-07 11:33:21.786061] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:81784 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:37.670 [2024-10-07 11:33:21.786075] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:37.670 [2024-10-07 11:33:21.786090] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:24 nsid:1 lba:82064 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:22:37.670 [2024-10-07 11:33:21.786104] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:37.670 [2024-10-07 11:33:21.786120] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:116 nsid:1 lba:82072 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:22:37.670 [2024-10-07 11:33:21.786135] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:37.670 [2024-10-07 11:33:21.786150] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:60 nsid:1 lba:82080 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:22:37.670 [2024-10-07 11:33:21.786164] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:37.670 [2024-10-07 11:33:21.786179] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:104 nsid:1 lba:82088 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:22:37.670 [2024-10-07 11:33:21.786194] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:37.671 [2024-10-07 11:33:21.786218] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:48 nsid:1 lba:82096 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:22:37.671 [2024-10-07 11:33:21.786232] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:37.671 [2024-10-07 11:33:21.786248] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:103 nsid:1 lba:82104 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:22:37.671 [2024-10-07 11:33:21.786261] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:37.671 [2024-10-07 11:33:21.786282] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:106 nsid:1 lba:82112 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:22:37.671 [2024-10-07 11:33:21.786297] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:37.671 [2024-10-07 11:33:21.786313] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:73 nsid:1 lba:82120 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:22:37.671 [2024-10-07 11:33:21.786327] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:37.671 [2024-10-07 11:33:21.786342] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:74 nsid:1 lba:82128 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:22:37.671 [2024-10-07 11:33:21.786356] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:37.671 [2024-10-07 11:33:21.786379] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:113 nsid:1 lba:82136 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:22:37.671 [2024-10-07 11:33:21.786394] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:37.671 [2024-10-07 11:33:21.786410] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:109 nsid:1 lba:82144 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:22:37.671 [2024-10-07 11:33:21.786440] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:37.671 [2024-10-07 11:33:21.786456] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:120 nsid:1 lba:82152 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:22:37.671 [2024-10-07 11:33:21.786470] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:37.671 [2024-10-07 11:33:21.786486] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:94 nsid:1 lba:82160 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:22:37.671 [2024-10-07 11:33:21.786500] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:37.671 [2024-10-07 11:33:21.786516] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:107 nsid:1 lba:82168 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:22:37.671 [2024-10-07 11:33:21.786530] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:37.671 [2024-10-07 11:33:21.786548] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:87 nsid:1 lba:82176 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:22:37.671 [2024-10-07 11:33:21.786574] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:37.671 [2024-10-07 11:33:21.786607] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:37 nsid:1 lba:82184 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:22:37.671 [2024-10-07 11:33:21.786635] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:37.671 [2024-10-07 11:33:21.786688] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:26 nsid:1 lba:82192 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:22:37.671 [2024-10-07 11:33:21.786716] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:37.671 [2024-10-07 11:33:21.786734] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:46 nsid:1 lba:82200 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:22:37.671 [2024-10-07 11:33:21.786749] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:37.671 [2024-10-07 11:33:21.786765] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:98 nsid:1 lba:82208 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:22:37.671 [2024-10-07 11:33:21.786789] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:37.671 [2024-10-07 11:33:21.786804] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:61 nsid:1 lba:82216 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:22:37.671 [2024-10-07 11:33:21.786825] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:37.671 [2024-10-07 11:33:21.786855] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:118 nsid:1 lba:82224 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:22:37.671 [2024-10-07 11:33:21.786885] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:37.671 [2024-10-07 11:33:21.786915] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:25 nsid:1 lba:82232 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:22:37.671 [2024-10-07 11:33:21.786959] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:37.671 [2024-10-07 11:33:21.786994] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:110 nsid:1 lba:82240 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:22:37.671 [2024-10-07 11:33:21.787013] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:37.671 [2024-10-07 11:33:21.787034] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:122 nsid:1 lba:82248 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:22:37.671 [2024-10-07 11:33:21.787057] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:37.671 [2024-10-07 11:33:21.787073] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:62 nsid:1 lba:82256 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:22:37.671 [2024-10-07 11:33:21.787087] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:37.671 [2024-10-07 11:33:21.787103] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:38 nsid:1 lba:82264 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:22:37.671 [2024-10-07 11:33:21.787117] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:37.671 [2024-10-07 11:33:21.787133] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:6 nsid:1 lba:82272 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:22:37.671 [2024-10-07 11:33:21.787152] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:37.671 [2024-10-07 11:33:21.787169] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:77 nsid:1 lba:82280 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:22:37.671 [2024-10-07 11:33:21.787184] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:37.671 [2024-10-07 11:33:21.787216] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:81 nsid:1 lba:82288 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:22:37.671 [2024-10-07 11:33:21.787232] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:37.671 [2024-10-07 11:33:21.787248] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:3 nsid:1 lba:82296 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:22:37.671 [2024-10-07 11:33:21.787262] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:37.671 [2024-10-07 11:33:21.787277] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:65 nsid:1 lba:82304 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:22:37.671 [2024-10-07 11:33:21.787291] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:37.671 [2024-10-07 11:33:21.787307] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:112 nsid:1 lba:82312 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:22:37.671 [2024-10-07 11:33:21.787321] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:37.671 [2024-10-07 11:33:21.787347] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:121 nsid:1 lba:82320 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:22:37.671 [2024-10-07 11:33:21.787361] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:37.671 [2024-10-07 11:33:21.787377] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:32 nsid:1 lba:82328 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:22:37.671 [2024-10-07 11:33:21.787391] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:37.671 [2024-10-07 11:33:21.787407] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:105 nsid:1 lba:82336 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:22:37.671 [2024-10-07 11:33:21.787434] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:37.671 [2024-10-07 11:33:21.787451] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:57 nsid:1 lba:82344 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:22:37.671 [2024-10-07 11:33:21.787466] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:37.671 [2024-10-07 11:33:21.787482] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:44 nsid:1 lba:82352 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:22:37.671 [2024-10-07 11:33:21.787496] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:37.671 [2024-10-07 11:33:21.787512] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:63 nsid:1 lba:82360 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:22:37.671 [2024-10-07 11:33:21.787526] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:37.671 [2024-10-07 11:33:21.787542] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:22 nsid:1 lba:81792 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:37.671 [2024-10-07 11:33:21.787556] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:37.671 [2024-10-07 11:33:21.787573] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:66 nsid:1 lba:82368 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:22:37.671 [2024-10-07 11:33:21.787587] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:37.671 [2024-10-07 11:33:21.787603] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:99 nsid:1 lba:82376 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:22:37.671 [2024-10-07 11:33:21.787617] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:37.671 [2024-10-07 11:33:21.787632] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:45 nsid:1 lba:82384 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:22:37.671 [2024-10-07 11:33:21.787646] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:37.671 [2024-10-07 11:33:21.787680] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:93 nsid:1 lba:82392 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:22:37.671 [2024-10-07 11:33:21.787700] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:37.671 [2024-10-07 11:33:21.787717] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:31 nsid:1 lba:82400 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:22:37.671 [2024-10-07 11:33:21.787731] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:37.671 [2024-10-07 11:33:21.787747] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:47 nsid:1 lba:82408 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:22:37.672 [2024-10-07 11:33:21.787761] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:37.672 [2024-10-07 11:33:21.787777] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:10 nsid:1 lba:82416 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:22:37.672 [2024-10-07 11:33:21.787791] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:37.672 [2024-10-07 11:33:21.787806] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:76 nsid:1 lba:82424 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:22:37.672 [2024-10-07 11:33:21.787820] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:37.672 [2024-10-07 11:33:21.787844] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:97 nsid:1 lba:82432 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:22:37.672 [2024-10-07 11:33:21.787859] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:37.672 [2024-10-07 11:33:21.787875] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:96 nsid:1 lba:82440 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:22:37.672 [2024-10-07 11:33:21.787889] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:37.672 [2024-10-07 11:33:21.787905] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:91 nsid:1 lba:82448 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:22:37.672 [2024-10-07 11:33:21.787919] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:37.672 [2024-10-07 11:33:21.787934] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:124 nsid:1 lba:82456 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:22:37.672 [2024-10-07 11:33:21.787948] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:37.672 [2024-10-07 11:33:21.787965] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:81800 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:37.672 [2024-10-07 11:33:21.787979] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:37.672 [2024-10-07 11:33:21.787994] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:20 nsid:1 lba:81808 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:37.672 [2024-10-07 11:33:21.788009] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:37.672 [2024-10-07 11:33:21.788024] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:69 nsid:1 lba:81816 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:37.672 [2024-10-07 11:33:21.788039] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:37.672 [2024-10-07 11:33:21.788055] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:81824 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:37.672 [2024-10-07 11:33:21.788069] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:37.672 [2024-10-07 11:33:21.788085] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:49 nsid:1 lba:81832 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:37.672 [2024-10-07 11:33:21.788099] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:37.672 [2024-10-07 11:33:21.788116] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:81840 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:37.672 [2024-10-07 11:33:21.788130] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:37.672 [2024-10-07 11:33:21.788145] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a29fb0 is same with the state(6) to be set 00:22:37.672 [2024-10-07 11:33:21.788161] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:22:37.672 [2024-10-07 11:33:21.788173] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:22:37.672 [2024-10-07 11:33:21.788189] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:81848 len:8 PRP1 0x0 PRP2 0x0 00:22:37.672 [2024-10-07 11:33:21.788205] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:37.672 [2024-10-07 11:33:21.788264] bdev_nvme.c:1730:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0x1a29fb0 was disconnected and freed. reset controller. 00:22:37.672 [2024-10-07 11:33:21.788363] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:22:37.672 [2024-10-07 11:33:21.788390] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:37.672 [2024-10-07 11:33:21.788406] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:22:37.672 [2024-10-07 11:33:21.788420] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:37.672 [2024-10-07 11:33:21.788434] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:22:37.672 [2024-10-07 11:33:21.788448] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:37.672 [2024-10-07 11:33:21.788463] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:22:37.672 [2024-10-07 11:33:21.788477] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:37.672 [2024-10-07 11:33:21.788491] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.672 [2024-10-07 11:33:21.789827] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.672 [2024-10-07 11:33:21.789866] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.672 [2024-10-07 11:33:21.789897] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.672 [2024-10-07 11:33:21.789988] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.672 [2024-10-07 11:33:21.790018] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.672 [2024-10-07 11:33:21.790035] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.672 [2024-10-07 11:33:21.790085] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.672 [2024-10-07 11:33:21.790109] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.672 [2024-10-07 11:33:21.790124] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.672 [2024-10-07 11:33:21.790147] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.672 [2024-10-07 11:33:21.790167] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.672 [2024-10-07 11:33:21.790188] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.672 [2024-10-07 11:33:21.790202] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.672 [2024-10-07 11:33:21.790216] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.672 [2024-10-07 11:33:21.790232] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.672 [2024-10-07 11:33:21.790247] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.672 [2024-10-07 11:33:21.790260] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.672 [2024-10-07 11:33:21.790283] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.672 [2024-10-07 11:33:21.790297] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.672 [2024-10-07 11:33:21.799963] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.672 [2024-10-07 11:33:21.800034] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.672 [2024-10-07 11:33:21.800113] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.672 [2024-10-07 11:33:21.800143] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.672 [2024-10-07 11:33:21.800160] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.672 [2024-10-07 11:33:21.800215] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.672 [2024-10-07 11:33:21.800240] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.672 [2024-10-07 11:33:21.800255] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.672 [2024-10-07 11:33:21.800273] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.672 [2024-10-07 11:33:21.800519] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.672 [2024-10-07 11:33:21.800560] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.672 [2024-10-07 11:33:21.800578] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.672 [2024-10-07 11:33:21.800592] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.672 [2024-10-07 11:33:21.800766] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.672 [2024-10-07 11:33:21.800801] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.672 [2024-10-07 11:33:21.800818] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.672 [2024-10-07 11:33:21.800832] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.672 [2024-10-07 11:33:21.800973] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.672 [2024-10-07 11:33:21.810365] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.672 [2024-10-07 11:33:21.810962] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.672 [2024-10-07 11:33:21.811062] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.672 [2024-10-07 11:33:21.811092] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.672 [2024-10-07 11:33:21.811110] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.672 [2024-10-07 11:33:21.811241] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.672 [2024-10-07 11:33:21.811282] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.672 [2024-10-07 11:33:21.811302] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.672 [2024-10-07 11:33:21.811320] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.672 [2024-10-07 11:33:21.811346] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.672 [2024-10-07 11:33:21.811364] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.672 [2024-10-07 11:33:21.811378] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.672 [2024-10-07 11:33:21.811406] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.672 [2024-10-07 11:33:21.811434] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.673 [2024-10-07 11:33:21.811450] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.673 [2024-10-07 11:33:21.811463] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.673 [2024-10-07 11:33:21.811476] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.673 [2024-10-07 11:33:21.811496] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.673 [2024-10-07 11:33:21.823498] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.673 [2024-10-07 11:33:21.823549] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.673 [2024-10-07 11:33:21.824481] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.673 [2024-10-07 11:33:21.824526] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.673 [2024-10-07 11:33:21.824564] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.673 [2024-10-07 11:33:21.824616] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.673 [2024-10-07 11:33:21.824640] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.673 [2024-10-07 11:33:21.824656] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.673 [2024-10-07 11:33:21.824985] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.673 [2024-10-07 11:33:21.825029] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.673 [2024-10-07 11:33:21.825089] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.673 [2024-10-07 11:33:21.825119] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.673 [2024-10-07 11:33:21.825136] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.673 [2024-10-07 11:33:21.825154] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.673 [2024-10-07 11:33:21.825168] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.673 [2024-10-07 11:33:21.825181] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.673 [2024-10-07 11:33:21.825205] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.673 [2024-10-07 11:33:21.825219] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.673 [2024-10-07 11:33:21.839348] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.673 [2024-10-07 11:33:21.839403] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.673 [2024-10-07 11:33:21.839745] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.673 [2024-10-07 11:33:21.839804] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.673 [2024-10-07 11:33:21.839824] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.673 [2024-10-07 11:33:21.839875] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.673 [2024-10-07 11:33:21.839899] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.673 [2024-10-07 11:33:21.839929] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.673 [2024-10-07 11:33:21.840412] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.673 [2024-10-07 11:33:21.840486] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.673 [2024-10-07 11:33:21.840734] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.673 [2024-10-07 11:33:21.840771] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.673 [2024-10-07 11:33:21.840788] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.673 [2024-10-07 11:33:21.840807] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.673 [2024-10-07 11:33:21.840822] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.673 [2024-10-07 11:33:21.840835] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.673 [2024-10-07 11:33:21.841039] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.673 [2024-10-07 11:33:21.841064] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.673 [2024-10-07 11:33:21.851972] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.673 [2024-10-07 11:33:21.852022] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.673 [2024-10-07 11:33:21.852127] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.673 [2024-10-07 11:33:21.852156] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.673 [2024-10-07 11:33:21.852173] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.673 [2024-10-07 11:33:21.852221] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.673 [2024-10-07 11:33:21.852244] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.673 [2024-10-07 11:33:21.852260] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.673 [2024-10-07 11:33:21.852856] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.673 [2024-10-07 11:33:21.852897] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.673 [2024-10-07 11:33:21.853058] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.673 [2024-10-07 11:33:21.853083] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.673 [2024-10-07 11:33:21.853098] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.673 [2024-10-07 11:33:21.853115] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.673 [2024-10-07 11:33:21.853129] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.673 [2024-10-07 11:33:21.853142] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.673 [2024-10-07 11:33:21.853166] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.673 [2024-10-07 11:33:21.853181] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.673 [2024-10-07 11:33:21.862384] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.673 [2024-10-07 11:33:21.862450] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.673 [2024-10-07 11:33:21.862570] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.673 [2024-10-07 11:33:21.862601] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.673 [2024-10-07 11:33:21.862618] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.673 [2024-10-07 11:33:21.862684] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.673 [2024-10-07 11:33:21.862710] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.673 [2024-10-07 11:33:21.862726] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.673 [2024-10-07 11:33:21.862750] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.673 [2024-10-07 11:33:21.862771] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.673 [2024-10-07 11:33:21.862791] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.673 [2024-10-07 11:33:21.862806] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.673 [2024-10-07 11:33:21.862819] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.673 [2024-10-07 11:33:21.862837] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.673 [2024-10-07 11:33:21.862851] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.673 [2024-10-07 11:33:21.862864] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.673 [2024-10-07 11:33:21.862888] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.673 [2024-10-07 11:33:21.862902] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.673 [2024-10-07 11:33:21.875995] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.673 [2024-10-07 11:33:21.876043] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.673 [2024-10-07 11:33:21.876410] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.673 [2024-10-07 11:33:21.876454] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.673 [2024-10-07 11:33:21.876474] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.673 [2024-10-07 11:33:21.876531] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.673 [2024-10-07 11:33:21.876555] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.673 [2024-10-07 11:33:21.876570] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.673 [2024-10-07 11:33:21.876825] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.674 [2024-10-07 11:33:21.876860] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.674 [2024-10-07 11:33:21.876989] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.674 [2024-10-07 11:33:21.877019] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.674 [2024-10-07 11:33:21.877035] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.674 [2024-10-07 11:33:21.877071] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.674 [2024-10-07 11:33:21.877088] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.674 [2024-10-07 11:33:21.877101] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.674 [2024-10-07 11:33:21.877257] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.674 [2024-10-07 11:33:21.877281] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.674 [2024-10-07 11:33:21.889748] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.674 [2024-10-07 11:33:21.889798] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.674 [2024-10-07 11:33:21.890144] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.674 [2024-10-07 11:33:21.890188] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.674 [2024-10-07 11:33:21.890209] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.674 [2024-10-07 11:33:21.890261] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.674 [2024-10-07 11:33:21.890284] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.674 [2024-10-07 11:33:21.890300] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.674 [2024-10-07 11:33:21.890360] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.674 [2024-10-07 11:33:21.890387] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.674 [2024-10-07 11:33:21.890414] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.674 [2024-10-07 11:33:21.890429] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.674 [2024-10-07 11:33:21.890443] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.674 [2024-10-07 11:33:21.890459] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.674 [2024-10-07 11:33:21.890473] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.674 [2024-10-07 11:33:21.890487] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.674 [2024-10-07 11:33:21.890510] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.674 [2024-10-07 11:33:21.890525] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.674 8778.80 IOPS, 34.29 MiB/s [2024-10-07T11:33:33.197Z] [2024-10-07 11:33:21.902871] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.674 [2024-10-07 11:33:21.902918] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.674 [2024-10-07 11:33:21.903125] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.674 [2024-10-07 11:33:21.903157] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.674 [2024-10-07 11:33:21.903174] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.674 [2024-10-07 11:33:21.903238] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.674 [2024-10-07 11:33:21.903263] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.674 [2024-10-07 11:33:21.903278] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.674 [2024-10-07 11:33:21.903545] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.674 [2024-10-07 11:33:21.903577] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.674 [2024-10-07 11:33:21.904230] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.674 [2024-10-07 11:33:21.904269] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.674 [2024-10-07 11:33:21.904287] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.674 [2024-10-07 11:33:21.904305] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.674 [2024-10-07 11:33:21.904320] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.674 [2024-10-07 11:33:21.904332] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.674 [2024-10-07 11:33:21.904973] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.674 [2024-10-07 11:33:21.905009] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.674 [2024-10-07 11:33:21.912997] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.674 [2024-10-07 11:33:21.913502] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.674 [2024-10-07 11:33:21.913603] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.674 [2024-10-07 11:33:21.913632] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.674 [2024-10-07 11:33:21.913663] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.674 [2024-10-07 11:33:21.913932] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.674 [2024-10-07 11:33:21.913973] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.674 [2024-10-07 11:33:21.913993] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.674 [2024-10-07 11:33:21.914012] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.674 [2024-10-07 11:33:21.914217] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.674 [2024-10-07 11:33:21.914261] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.674 [2024-10-07 11:33:21.914279] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.674 [2024-10-07 11:33:21.914293] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.674 [2024-10-07 11:33:21.914354] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.674 [2024-10-07 11:33:21.914376] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.674 [2024-10-07 11:33:21.914390] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.674 [2024-10-07 11:33:21.914403] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.674 [2024-10-07 11:33:21.914425] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.674 [2024-10-07 11:33:21.926051] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.674 [2024-10-07 11:33:21.926099] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.674 [2024-10-07 11:33:21.926683] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.674 [2024-10-07 11:33:21.926726] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.674 [2024-10-07 11:33:21.926747] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.674 [2024-10-07 11:33:21.926799] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.674 [2024-10-07 11:33:21.926823] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.674 [2024-10-07 11:33:21.926839] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.674 [2024-10-07 11:33:21.926924] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.674 [2024-10-07 11:33:21.926952] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.674 [2024-10-07 11:33:21.926972] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.674 [2024-10-07 11:33:21.926987] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.674 [2024-10-07 11:33:21.927001] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.674 [2024-10-07 11:33:21.927018] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.674 [2024-10-07 11:33:21.927032] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.674 [2024-10-07 11:33:21.927045] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.674 [2024-10-07 11:33:21.927068] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.674 [2024-10-07 11:33:21.927083] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.674 [2024-10-07 11:33:21.936967] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.674 [2024-10-07 11:33:21.937029] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.674 [2024-10-07 11:33:21.937211] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.674 [2024-10-07 11:33:21.937241] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.674 [2024-10-07 11:33:21.937258] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.674 [2024-10-07 11:33:21.937306] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.674 [2024-10-07 11:33:21.937330] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.674 [2024-10-07 11:33:21.937345] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.674 [2024-10-07 11:33:21.937506] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.674 [2024-10-07 11:33:21.937535] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.674 [2024-10-07 11:33:21.937588] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.674 [2024-10-07 11:33:21.937610] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.674 [2024-10-07 11:33:21.937624] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.674 [2024-10-07 11:33:21.937640] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.674 [2024-10-07 11:33:21.937669] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.674 [2024-10-07 11:33:21.937683] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.674 [2024-10-07 11:33:21.937723] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.674 [2024-10-07 11:33:21.937740] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.674 [2024-10-07 11:33:21.948750] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.674 [2024-10-07 11:33:21.948797] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.674 [2024-10-07 11:33:21.948898] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.674 [2024-10-07 11:33:21.948927] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.674 [2024-10-07 11:33:21.948944] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.675 [2024-10-07 11:33:21.948991] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.675 [2024-10-07 11:33:21.949014] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.675 [2024-10-07 11:33:21.949029] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.675 [2024-10-07 11:33:21.949053] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.675 [2024-10-07 11:33:21.949073] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.675 [2024-10-07 11:33:21.949109] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.675 [2024-10-07 11:33:21.949127] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.675 [2024-10-07 11:33:21.949141] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.675 [2024-10-07 11:33:21.949157] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.675 [2024-10-07 11:33:21.949172] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.675 [2024-10-07 11:33:21.949185] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.675 [2024-10-07 11:33:21.949208] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.675 [2024-10-07 11:33:21.949222] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.675 [2024-10-07 11:33:21.960256] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.675 [2024-10-07 11:33:21.960304] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.675 [2024-10-07 11:33:21.960460] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.675 [2024-10-07 11:33:21.960493] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.675 [2024-10-07 11:33:21.960510] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.675 [2024-10-07 11:33:21.960557] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.675 [2024-10-07 11:33:21.960581] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.675 [2024-10-07 11:33:21.960596] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.675 [2024-10-07 11:33:21.960634] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.675 [2024-10-07 11:33:21.960671] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.675 [2024-10-07 11:33:21.960694] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.675 [2024-10-07 11:33:21.960709] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.675 [2024-10-07 11:33:21.960723] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.675 [2024-10-07 11:33:21.960739] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.675 [2024-10-07 11:33:21.960754] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.675 [2024-10-07 11:33:21.960767] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.675 [2024-10-07 11:33:21.960789] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.675 [2024-10-07 11:33:21.960803] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.675 [2024-10-07 11:33:21.974987] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.675 [2024-10-07 11:33:21.975036] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.675 [2024-10-07 11:33:21.975275] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.675 [2024-10-07 11:33:21.975308] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.675 [2024-10-07 11:33:21.975326] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.675 [2024-10-07 11:33:21.975374] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.675 [2024-10-07 11:33:21.975398] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.675 [2024-10-07 11:33:21.975413] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.675 [2024-10-07 11:33:21.975524] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.675 [2024-10-07 11:33:21.975549] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.675 [2024-10-07 11:33:21.977088] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.675 [2024-10-07 11:33:21.977128] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.675 [2024-10-07 11:33:21.977146] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.675 [2024-10-07 11:33:21.977164] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.675 [2024-10-07 11:33:21.977179] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.675 [2024-10-07 11:33:21.977198] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.675 [2024-10-07 11:33:21.977809] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.675 [2024-10-07 11:33:21.977845] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.675 [2024-10-07 11:33:21.985610] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.675 [2024-10-07 11:33:21.985683] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.675 [2024-10-07 11:33:21.985876] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.675 [2024-10-07 11:33:21.985925] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.675 [2024-10-07 11:33:21.985944] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.675 [2024-10-07 11:33:21.985996] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.675 [2024-10-07 11:33:21.986019] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.675 [2024-10-07 11:33:21.986035] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.675 [2024-10-07 11:33:21.986164] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.675 [2024-10-07 11:33:21.986193] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.675 [2024-10-07 11:33:21.986317] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.675 [2024-10-07 11:33:21.986341] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.675 [2024-10-07 11:33:21.986356] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.675 [2024-10-07 11:33:21.986373] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.675 [2024-10-07 11:33:21.986387] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.675 [2024-10-07 11:33:21.986399] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.675 [2024-10-07 11:33:21.986523] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.675 [2024-10-07 11:33:21.986546] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.675 [2024-10-07 11:33:21.996329] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.675 [2024-10-07 11:33:21.996377] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.675 [2024-10-07 11:33:21.996501] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.675 [2024-10-07 11:33:21.996532] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.675 [2024-10-07 11:33:21.996550] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.675 [2024-10-07 11:33:21.996598] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.675 [2024-10-07 11:33:21.996622] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.675 [2024-10-07 11:33:21.996637] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.676 [2024-10-07 11:33:21.996661] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.676 [2024-10-07 11:33:21.996700] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.676 [2024-10-07 11:33:21.996721] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.676 [2024-10-07 11:33:21.996736] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.676 [2024-10-07 11:33:21.996750] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.676 [2024-10-07 11:33:21.996766] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.676 [2024-10-07 11:33:21.996780] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.676 [2024-10-07 11:33:21.996809] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.676 [2024-10-07 11:33:21.996835] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.676 [2024-10-07 11:33:21.996850] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.676 [2024-10-07 11:33:22.009176] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.676 [2024-10-07 11:33:22.009226] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.676 [2024-10-07 11:33:22.009750] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.676 [2024-10-07 11:33:22.009824] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.676 [2024-10-07 11:33:22.009844] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.676 [2024-10-07 11:33:22.009895] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.676 [2024-10-07 11:33:22.009919] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.676 [2024-10-07 11:33:22.009934] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.676 [2024-10-07 11:33:22.010081] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.676 [2024-10-07 11:33:22.010110] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.676 [2024-10-07 11:33:22.010220] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.676 [2024-10-07 11:33:22.010247] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.676 [2024-10-07 11:33:22.010262] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.676 [2024-10-07 11:33:22.010278] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.676 [2024-10-07 11:33:22.010293] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.676 [2024-10-07 11:33:22.010305] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.676 [2024-10-07 11:33:22.010357] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.676 [2024-10-07 11:33:22.010378] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.676 [2024-10-07 11:33:22.021514] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.676 [2024-10-07 11:33:22.021562] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.676 [2024-10-07 11:33:22.021984] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.676 [2024-10-07 11:33:22.022029] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.676 [2024-10-07 11:33:22.022050] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.676 [2024-10-07 11:33:22.022102] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.676 [2024-10-07 11:33:22.022128] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.676 [2024-10-07 11:33:22.022143] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.676 [2024-10-07 11:33:22.022207] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.676 [2024-10-07 11:33:22.022249] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.676 [2024-10-07 11:33:22.022271] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.676 [2024-10-07 11:33:22.022287] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.676 [2024-10-07 11:33:22.022301] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.676 [2024-10-07 11:33:22.022318] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.676 [2024-10-07 11:33:22.022332] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.676 [2024-10-07 11:33:22.022345] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.676 [2024-10-07 11:33:22.022369] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.676 [2024-10-07 11:33:22.022383] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.676 [2024-10-07 11:33:22.033346] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.676 [2024-10-07 11:33:22.033396] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.676 [2024-10-07 11:33:22.033580] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.676 [2024-10-07 11:33:22.033612] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.676 [2024-10-07 11:33:22.033629] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.676 [2024-10-07 11:33:22.033698] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.676 [2024-10-07 11:33:22.033724] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.676 [2024-10-07 11:33:22.033740] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.676 [2024-10-07 11:33:22.035576] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.676 [2024-10-07 11:33:22.035621] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.676 [2024-10-07 11:33:22.036201] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.676 [2024-10-07 11:33:22.036252] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.676 [2024-10-07 11:33:22.036285] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.676 [2024-10-07 11:33:22.036302] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.676 [2024-10-07 11:33:22.036316] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.676 [2024-10-07 11:33:22.036328] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.676 [2024-10-07 11:33:22.036954] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.676 [2024-10-07 11:33:22.036989] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.676 [2024-10-07 11:33:22.044900] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.676 [2024-10-07 11:33:22.044945] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.676 [2024-10-07 11:33:22.045111] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.676 [2024-10-07 11:33:22.045142] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.676 [2024-10-07 11:33:22.045179] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.676 [2024-10-07 11:33:22.045232] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.676 [2024-10-07 11:33:22.045256] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.676 [2024-10-07 11:33:22.045271] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.676 [2024-10-07 11:33:22.045295] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.676 [2024-10-07 11:33:22.045316] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.676 [2024-10-07 11:33:22.045335] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.676 [2024-10-07 11:33:22.045350] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.676 [2024-10-07 11:33:22.045364] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.676 [2024-10-07 11:33:22.045380] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.676 [2024-10-07 11:33:22.045394] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.676 [2024-10-07 11:33:22.045421] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.676 [2024-10-07 11:33:22.045449] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.676 [2024-10-07 11:33:22.045462] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.676 [2024-10-07 11:33:22.055023] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.676 [2024-10-07 11:33:22.055115] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.676 [2024-10-07 11:33:22.055215] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.676 [2024-10-07 11:33:22.055246] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.676 [2024-10-07 11:33:22.055263] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.676 [2024-10-07 11:33:22.057643] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.676 [2024-10-07 11:33:22.057710] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.676 [2024-10-07 11:33:22.057731] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.676 [2024-10-07 11:33:22.057750] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.676 [2024-10-07 11:33:22.058848] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.676 [2024-10-07 11:33:22.058906] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.676 [2024-10-07 11:33:22.058941] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.676 [2024-10-07 11:33:22.058956] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.677 [2024-10-07 11:33:22.059210] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.677 [2024-10-07 11:33:22.059254] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.677 [2024-10-07 11:33:22.059269] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.677 [2024-10-07 11:33:22.059297] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.677 [2024-10-07 11:33:22.061958] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.677 [2024-10-07 11:33:22.066116] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.677 [2024-10-07 11:33:22.066159] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.677 [2024-10-07 11:33:22.066258] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.677 [2024-10-07 11:33:22.066286] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.677 [2024-10-07 11:33:22.066302] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.677 [2024-10-07 11:33:22.066346] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.677 [2024-10-07 11:33:22.066368] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.677 [2024-10-07 11:33:22.066382] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.677 [2024-10-07 11:33:22.066404] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.677 [2024-10-07 11:33:22.066440] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.677 [2024-10-07 11:33:22.066476] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.677 [2024-10-07 11:33:22.066490] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.677 [2024-10-07 11:33:22.066504] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.677 [2024-10-07 11:33:22.066520] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.677 [2024-10-07 11:33:22.066535] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.677 [2024-10-07 11:33:22.066548] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.677 [2024-10-07 11:33:22.066571] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.677 [2024-10-07 11:33:22.066585] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.677 [2024-10-07 11:33:22.077747] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.677 [2024-10-07 11:33:22.077793] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.677 [2024-10-07 11:33:22.078016] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.677 [2024-10-07 11:33:22.078047] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.677 [2024-10-07 11:33:22.078063] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.677 [2024-10-07 11:33:22.078109] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.677 [2024-10-07 11:33:22.078131] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.677 [2024-10-07 11:33:22.078146] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.677 [2024-10-07 11:33:22.078268] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.677 [2024-10-07 11:33:22.078295] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.677 [2024-10-07 11:33:22.078436] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.677 [2024-10-07 11:33:22.078492] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.677 [2024-10-07 11:33:22.078507] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.677 [2024-10-07 11:33:22.078523] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.677 [2024-10-07 11:33:22.078538] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.677 [2024-10-07 11:33:22.078551] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.677 [2024-10-07 11:33:22.078667] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.677 [2024-10-07 11:33:22.078688] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.677 [2024-10-07 11:33:22.088751] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.677 [2024-10-07 11:33:22.088797] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.677 [2024-10-07 11:33:22.089000] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.677 [2024-10-07 11:33:22.089047] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.677 [2024-10-07 11:33:22.089064] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.677 [2024-10-07 11:33:22.089112] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.677 [2024-10-07 11:33:22.089135] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.677 [2024-10-07 11:33:22.089151] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.677 [2024-10-07 11:33:22.089277] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.677 [2024-10-07 11:33:22.089305] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.677 [2024-10-07 11:33:22.089430] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.677 [2024-10-07 11:33:22.089452] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.677 [2024-10-07 11:33:22.089466] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.677 [2024-10-07 11:33:22.089483] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.677 [2024-10-07 11:33:22.089497] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.677 [2024-10-07 11:33:22.089509] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.677 [2024-10-07 11:33:22.089608] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.677 [2024-10-07 11:33:22.089627] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.677 [2024-10-07 11:33:22.099288] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.677 [2024-10-07 11:33:22.099513] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.677 [2024-10-07 11:33:22.099604] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.677 [2024-10-07 11:33:22.099634] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.677 [2024-10-07 11:33:22.099668] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.677 [2024-10-07 11:33:22.099844] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.677 [2024-10-07 11:33:22.099874] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.677 [2024-10-07 11:33:22.099891] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.677 [2024-10-07 11:33:22.099909] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.677 [2024-10-07 11:33:22.100013] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.677 [2024-10-07 11:33:22.100036] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.677 [2024-10-07 11:33:22.100051] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.677 [2024-10-07 11:33:22.100073] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.677 [2024-10-07 11:33:22.100166] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.677 [2024-10-07 11:33:22.100192] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.677 [2024-10-07 11:33:22.100206] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.677 [2024-10-07 11:33:22.100219] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.677 [2024-10-07 11:33:22.100265] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.677 [2024-10-07 11:33:22.110039] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.677 [2024-10-07 11:33:22.110137] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.677 [2024-10-07 11:33:22.110222] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.677 [2024-10-07 11:33:22.110256] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.677 [2024-10-07 11:33:22.110285] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.678 [2024-10-07 11:33:22.110369] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.678 [2024-10-07 11:33:22.110397] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.678 [2024-10-07 11:33:22.110412] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.678 [2024-10-07 11:33:22.110431] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.678 [2024-10-07 11:33:22.110455] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.678 [2024-10-07 11:33:22.110472] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.678 [2024-10-07 11:33:22.110487] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.678 [2024-10-07 11:33:22.110500] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.678 [2024-10-07 11:33:22.110524] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.678 [2024-10-07 11:33:22.110538] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.678 [2024-10-07 11:33:22.110551] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.678 [2024-10-07 11:33:22.110579] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.678 [2024-10-07 11:33:22.110603] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.678 [2024-10-07 11:33:22.123763] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.678 [2024-10-07 11:33:22.123816] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.678 [2024-10-07 11:33:22.124424] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.678 [2024-10-07 11:33:22.124470] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.678 [2024-10-07 11:33:22.124491] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.678 [2024-10-07 11:33:22.124543] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.678 [2024-10-07 11:33:22.124568] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.678 [2024-10-07 11:33:22.124584] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.678 [2024-10-07 11:33:22.124925] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.678 [2024-10-07 11:33:22.124960] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.678 [2024-10-07 11:33:22.125106] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.678 [2024-10-07 11:33:22.125133] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.678 [2024-10-07 11:33:22.125149] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.678 [2024-10-07 11:33:22.125166] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.678 [2024-10-07 11:33:22.125189] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.678 [2024-10-07 11:33:22.125203] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.678 [2024-10-07 11:33:22.125249] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.678 [2024-10-07 11:33:22.125280] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.678 [2024-10-07 11:33:22.137200] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.678 [2024-10-07 11:33:22.137252] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.678 [2024-10-07 11:33:22.137343] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.678 [2024-10-07 11:33:22.137373] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.678 [2024-10-07 11:33:22.137390] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.678 [2024-10-07 11:33:22.137438] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.678 [2024-10-07 11:33:22.137461] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.678 [2024-10-07 11:33:22.137476] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.678 [2024-10-07 11:33:22.137500] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.678 [2024-10-07 11:33:22.137520] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.678 [2024-10-07 11:33:22.137540] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.678 [2024-10-07 11:33:22.137574] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.678 [2024-10-07 11:33:22.137590] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.678 [2024-10-07 11:33:22.137607] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.678 [2024-10-07 11:33:22.137621] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.678 [2024-10-07 11:33:22.137634] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.678 [2024-10-07 11:33:22.137672] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.678 [2024-10-07 11:33:22.137691] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.678 [2024-10-07 11:33:22.149011] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.678 [2024-10-07 11:33:22.149069] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.678 [2024-10-07 11:33:22.149247] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.678 [2024-10-07 11:33:22.149279] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.678 [2024-10-07 11:33:22.149297] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.678 [2024-10-07 11:33:22.149345] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.678 [2024-10-07 11:33:22.149369] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.678 [2024-10-07 11:33:22.149385] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.678 [2024-10-07 11:33:22.150106] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.678 [2024-10-07 11:33:22.150152] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.678 [2024-10-07 11:33:22.150263] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.678 [2024-10-07 11:33:22.150287] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.678 [2024-10-07 11:33:22.150301] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.678 [2024-10-07 11:33:22.150318] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.678 [2024-10-07 11:33:22.150333] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.678 [2024-10-07 11:33:22.150346] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.678 [2024-10-07 11:33:22.150399] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.678 [2024-10-07 11:33:22.150426] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.678 [2024-10-07 11:33:22.162273] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.678 [2024-10-07 11:33:22.162330] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.678 [2024-10-07 11:33:22.162430] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.678 [2024-10-07 11:33:22.162461] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.678 [2024-10-07 11:33:22.162478] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.678 [2024-10-07 11:33:22.162547] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.678 [2024-10-07 11:33:22.162572] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.678 [2024-10-07 11:33:22.162588] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.678 [2024-10-07 11:33:22.162613] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.678 [2024-10-07 11:33:22.162633] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.678 [2024-10-07 11:33:22.162668] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.678 [2024-10-07 11:33:22.162686] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.678 [2024-10-07 11:33:22.162701] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.678 [2024-10-07 11:33:22.162717] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.678 [2024-10-07 11:33:22.162760] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.678 [2024-10-07 11:33:22.162776] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.678 [2024-10-07 11:33:22.162801] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.678 [2024-10-07 11:33:22.162816] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.678 [2024-10-07 11:33:22.176511] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.678 [2024-10-07 11:33:22.176565] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.678 [2024-10-07 11:33:22.176675] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.678 [2024-10-07 11:33:22.176707] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.678 [2024-10-07 11:33:22.176725] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.678 [2024-10-07 11:33:22.176780] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.678 [2024-10-07 11:33:22.176804] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.678 [2024-10-07 11:33:22.176820] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.678 [2024-10-07 11:33:22.176845] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.678 [2024-10-07 11:33:22.176866] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.679 [2024-10-07 11:33:22.176886] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.679 [2024-10-07 11:33:22.176901] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.679 [2024-10-07 11:33:22.176915] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.679 [2024-10-07 11:33:22.176940] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.679 [2024-10-07 11:33:22.176955] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.679 [2024-10-07 11:33:22.176968] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.679 [2024-10-07 11:33:22.176991] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.679 [2024-10-07 11:33:22.177022] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.679 [2024-10-07 11:33:22.186812] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.679 [2024-10-07 11:33:22.186864] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.679 [2024-10-07 11:33:22.189434] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.679 [2024-10-07 11:33:22.189483] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.679 [2024-10-07 11:33:22.189505] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.679 [2024-10-07 11:33:22.189559] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.679 [2024-10-07 11:33:22.189583] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.679 [2024-10-07 11:33:22.189598] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.679 [2024-10-07 11:33:22.191980] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.679 [2024-10-07 11:33:22.192030] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.679 [2024-10-07 11:33:22.192169] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.679 [2024-10-07 11:33:22.192195] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.679 [2024-10-07 11:33:22.192210] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.679 [2024-10-07 11:33:22.192228] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.679 [2024-10-07 11:33:22.192243] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.679 [2024-10-07 11:33:22.192256] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.679 [2024-10-07 11:33:22.193320] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.679 [2024-10-07 11:33:22.193361] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.679 [2024-10-07 11:33:22.196928] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.679 [2024-10-07 11:33:22.196990] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.679 [2024-10-07 11:33:22.197069] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.679 [2024-10-07 11:33:22.197099] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.679 [2024-10-07 11:33:22.197116] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.679 [2024-10-07 11:33:22.197171] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.679 [2024-10-07 11:33:22.197207] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.679 [2024-10-07 11:33:22.197232] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.679 [2024-10-07 11:33:22.197252] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.679 [2024-10-07 11:33:22.197277] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.679 [2024-10-07 11:33:22.197295] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.679 [2024-10-07 11:33:22.197308] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.679 [2024-10-07 11:33:22.197342] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.679 [2024-10-07 11:33:22.197368] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.679 [2024-10-07 11:33:22.197383] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.679 [2024-10-07 11:33:22.197397] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.679 [2024-10-07 11:33:22.197410] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.679 [2024-10-07 11:33:22.197430] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.679 [2024-10-07 11:33:22.207268] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.679 [2024-10-07 11:33:22.207319] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.679 [2024-10-07 11:33:22.207410] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.679 [2024-10-07 11:33:22.207441] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.679 [2024-10-07 11:33:22.207458] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.679 [2024-10-07 11:33:22.207506] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.679 [2024-10-07 11:33:22.207529] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.679 [2024-10-07 11:33:22.207544] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.679 [2024-10-07 11:33:22.207568] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.679 [2024-10-07 11:33:22.207588] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.679 [2024-10-07 11:33:22.207608] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.679 [2024-10-07 11:33:22.207623] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.679 [2024-10-07 11:33:22.207637] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.679 [2024-10-07 11:33:22.207670] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.679 [2024-10-07 11:33:22.207688] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.679 [2024-10-07 11:33:22.207701] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.679 [2024-10-07 11:33:22.207725] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.679 [2024-10-07 11:33:22.207740] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.679 [2024-10-07 11:33:22.217927] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.679 [2024-10-07 11:33:22.217979] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.679 [2024-10-07 11:33:22.218375] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.679 [2024-10-07 11:33:22.218419] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.679 [2024-10-07 11:33:22.218439] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.679 [2024-10-07 11:33:22.218534] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.679 [2024-10-07 11:33:22.218560] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.679 [2024-10-07 11:33:22.218590] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.679 [2024-10-07 11:33:22.218787] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.679 [2024-10-07 11:33:22.218821] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.679 [2024-10-07 11:33:22.219555] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.679 [2024-10-07 11:33:22.219595] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.679 [2024-10-07 11:33:22.219613] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.679 [2024-10-07 11:33:22.219631] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.679 [2024-10-07 11:33:22.219645] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.679 [2024-10-07 11:33:22.219675] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.679 [2024-10-07 11:33:22.222168] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.679 [2024-10-07 11:33:22.222209] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.679 [2024-10-07 11:33:22.228050] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.679 [2024-10-07 11:33:22.228115] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.679 [2024-10-07 11:33:22.228205] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.679 [2024-10-07 11:33:22.228234] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.679 [2024-10-07 11:33:22.228251] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.679 [2024-10-07 11:33:22.228310] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.679 [2024-10-07 11:33:22.228335] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.679 [2024-10-07 11:33:22.228350] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.679 [2024-10-07 11:33:22.228368] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.679 [2024-10-07 11:33:22.228392] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.679 [2024-10-07 11:33:22.228410] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.679 [2024-10-07 11:33:22.228424] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.679 [2024-10-07 11:33:22.228437] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.679 [2024-10-07 11:33:22.228461] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.679 [2024-10-07 11:33:22.228475] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.679 [2024-10-07 11:33:22.228488] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.679 [2024-10-07 11:33:22.228502] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.679 [2024-10-07 11:33:22.228522] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.680 [2024-10-07 11:33:22.238247] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.680 [2024-10-07 11:33:22.238298] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.680 [2024-10-07 11:33:22.238386] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.680 [2024-10-07 11:33:22.238416] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.680 [2024-10-07 11:33:22.238444] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.680 [2024-10-07 11:33:22.238516] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.680 [2024-10-07 11:33:22.238548] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.680 [2024-10-07 11:33:22.238564] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.680 [2024-10-07 11:33:22.238589] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.680 [2024-10-07 11:33:22.238610] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.680 [2024-10-07 11:33:22.238660] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.680 [2024-10-07 11:33:22.238682] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.680 [2024-10-07 11:33:22.238696] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.680 [2024-10-07 11:33:22.238713] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.680 [2024-10-07 11:33:22.238727] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.680 [2024-10-07 11:33:22.238741] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.680 [2024-10-07 11:33:22.238764] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.680 [2024-10-07 11:33:22.238779] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.680 [2024-10-07 11:33:22.248785] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.680 [2024-10-07 11:33:22.248837] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.680 [2024-10-07 11:33:22.249033] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.680 [2024-10-07 11:33:22.249067] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.680 [2024-10-07 11:33:22.249084] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.680 [2024-10-07 11:33:22.249134] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.680 [2024-10-07 11:33:22.249158] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.680 [2024-10-07 11:33:22.249173] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.680 [2024-10-07 11:33:22.249250] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.680 [2024-10-07 11:33:22.249280] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.680 [2024-10-07 11:33:22.249326] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.680 [2024-10-07 11:33:22.249347] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.680 [2024-10-07 11:33:22.249380] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.680 [2024-10-07 11:33:22.249400] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.680 [2024-10-07 11:33:22.249415] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.680 [2024-10-07 11:33:22.249428] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.680 [2024-10-07 11:33:22.249452] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.680 [2024-10-07 11:33:22.249466] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.680 [2024-10-07 11:33:22.259059] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.680 [2024-10-07 11:33:22.259111] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.680 [2024-10-07 11:33:22.260429] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.680 [2024-10-07 11:33:22.260476] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.680 [2024-10-07 11:33:22.260497] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.680 [2024-10-07 11:33:22.260549] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.680 [2024-10-07 11:33:22.260573] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.680 [2024-10-07 11:33:22.260589] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.680 [2024-10-07 11:33:22.262161] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.680 [2024-10-07 11:33:22.262208] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.680 [2024-10-07 11:33:22.262624] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.680 [2024-10-07 11:33:22.262673] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.680 [2024-10-07 11:33:22.262693] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.680 [2024-10-07 11:33:22.262711] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.680 [2024-10-07 11:33:22.262726] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.680 [2024-10-07 11:33:22.262738] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.680 [2024-10-07 11:33:22.262811] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.680 [2024-10-07 11:33:22.262832] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.680 [2024-10-07 11:33:22.269175] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.680 [2024-10-07 11:33:22.269257] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.680 [2024-10-07 11:33:22.269337] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.680 [2024-10-07 11:33:22.269366] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.680 [2024-10-07 11:33:22.269383] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.680 [2024-10-07 11:33:22.269439] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.680 [2024-10-07 11:33:22.269464] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.680 [2024-10-07 11:33:22.269505] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.680 [2024-10-07 11:33:22.269525] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.680 [2024-10-07 11:33:22.269552] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.680 [2024-10-07 11:33:22.269582] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.680 [2024-10-07 11:33:22.269607] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.680 [2024-10-07 11:33:22.269626] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.680 [2024-10-07 11:33:22.269666] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.680 [2024-10-07 11:33:22.269685] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.680 [2024-10-07 11:33:22.269699] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.680 [2024-10-07 11:33:22.269712] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.680 [2024-10-07 11:33:22.269733] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.680 [2024-10-07 11:33:22.279276] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.680 [2024-10-07 11:33:22.279412] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.680 [2024-10-07 11:33:22.279451] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.680 [2024-10-07 11:33:22.279470] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.680 [2024-10-07 11:33:22.279509] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.680 [2024-10-07 11:33:22.279539] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.680 [2024-10-07 11:33:22.279567] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.680 [2024-10-07 11:33:22.279583] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.680 [2024-10-07 11:33:22.279596] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.680 [2024-10-07 11:33:22.279618] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.680 [2024-10-07 11:33:22.279698] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.680 [2024-10-07 11:33:22.279726] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.680 [2024-10-07 11:33:22.279742] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.680 [2024-10-07 11:33:22.279766] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.680 [2024-10-07 11:33:22.279788] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.680 [2024-10-07 11:33:22.279802] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.680 [2024-10-07 11:33:22.279816] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.680 [2024-10-07 11:33:22.279838] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.680 [2024-10-07 11:33:22.291410] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.680 [2024-10-07 11:33:22.291481] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.680 [2024-10-07 11:33:22.291573] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.680 [2024-10-07 11:33:22.291604] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.680 [2024-10-07 11:33:22.291622] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.680 [2024-10-07 11:33:22.291686] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.681 [2024-10-07 11:33:22.291711] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.681 [2024-10-07 11:33:22.291727] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.681 [2024-10-07 11:33:22.291751] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.681 [2024-10-07 11:33:22.291771] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.681 [2024-10-07 11:33:22.291810] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.681 [2024-10-07 11:33:22.291829] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.681 [2024-10-07 11:33:22.291843] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.681 [2024-10-07 11:33:22.291860] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.681 [2024-10-07 11:33:22.291874] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.681 [2024-10-07 11:33:22.291887] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.681 [2024-10-07 11:33:22.291910] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.681 [2024-10-07 11:33:22.291925] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.681 [2024-10-07 11:33:22.305856] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.681 [2024-10-07 11:33:22.305910] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.681 [2024-10-07 11:33:22.306008] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.681 [2024-10-07 11:33:22.306038] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.681 [2024-10-07 11:33:22.306055] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.681 [2024-10-07 11:33:22.306103] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.681 [2024-10-07 11:33:22.306127] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.681 [2024-10-07 11:33:22.306142] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.681 [2024-10-07 11:33:22.306166] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.681 [2024-10-07 11:33:22.306186] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.681 [2024-10-07 11:33:22.306206] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.681 [2024-10-07 11:33:22.306220] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.681 [2024-10-07 11:33:22.306233] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.681 [2024-10-07 11:33:22.306266] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.681 [2024-10-07 11:33:22.306293] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.681 [2024-10-07 11:33:22.306319] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.681 [2024-10-07 11:33:22.306354] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.681 [2024-10-07 11:33:22.306373] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.681 [2024-10-07 11:33:22.318176] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.681 [2024-10-07 11:33:22.318228] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.681 [2024-10-07 11:33:22.318421] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.681 [2024-10-07 11:33:22.318467] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.681 [2024-10-07 11:33:22.318498] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.681 [2024-10-07 11:33:22.318570] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.681 [2024-10-07 11:33:22.318598] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.681 [2024-10-07 11:33:22.318614] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.681 [2024-10-07 11:33:22.318784] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.681 [2024-10-07 11:33:22.318816] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.681 [2024-10-07 11:33:22.318940] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.681 [2024-10-07 11:33:22.318962] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.681 [2024-10-07 11:33:22.318977] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.681 [2024-10-07 11:33:22.318994] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.681 [2024-10-07 11:33:22.319008] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.681 [2024-10-07 11:33:22.319021] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.681 [2024-10-07 11:33:22.319126] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.681 [2024-10-07 11:33:22.319145] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.681 [2024-10-07 11:33:22.328670] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.681 [2024-10-07 11:33:22.328716] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.681 [2024-10-07 11:33:22.328882] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.681 [2024-10-07 11:33:22.328914] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.681 [2024-10-07 11:33:22.328931] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.681 [2024-10-07 11:33:22.328980] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.681 [2024-10-07 11:33:22.329004] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.681 [2024-10-07 11:33:22.329019] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.681 [2024-10-07 11:33:22.329906] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.681 [2024-10-07 11:33:22.329951] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.681 [2024-10-07 11:33:22.331594] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.681 [2024-10-07 11:33:22.331635] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.681 [2024-10-07 11:33:22.331675] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.681 [2024-10-07 11:33:22.331695] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.681 [2024-10-07 11:33:22.331710] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.681 [2024-10-07 11:33:22.331723] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.681 [2024-10-07 11:33:22.331780] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.681 [2024-10-07 11:33:22.331801] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.681 [2024-10-07 11:33:22.338780] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.681 [2024-10-07 11:33:22.338852] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.681 [2024-10-07 11:33:22.338929] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.681 [2024-10-07 11:33:22.338958] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.681 [2024-10-07 11:33:22.338975] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.681 [2024-10-07 11:33:22.339031] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.681 [2024-10-07 11:33:22.339056] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.681 [2024-10-07 11:33:22.339072] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.681 [2024-10-07 11:33:22.339091] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.681 [2024-10-07 11:33:22.339115] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.681 [2024-10-07 11:33:22.339132] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.681 [2024-10-07 11:33:22.339146] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.681 [2024-10-07 11:33:22.339159] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.681 [2024-10-07 11:33:22.339182] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.681 [2024-10-07 11:33:22.339216] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.681 [2024-10-07 11:33:22.339230] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.681 [2024-10-07 11:33:22.339243] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.681 [2024-10-07 11:33:22.339264] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.681 [2024-10-07 11:33:22.351065] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.681 [2024-10-07 11:33:22.351116] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.681 [2024-10-07 11:33:22.351485] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.681 [2024-10-07 11:33:22.351550] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.682 [2024-10-07 11:33:22.351571] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.682 [2024-10-07 11:33:22.351623] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.682 [2024-10-07 11:33:22.351663] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.682 [2024-10-07 11:33:22.351682] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.682 [2024-10-07 11:33:22.351811] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.682 [2024-10-07 11:33:22.351842] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.682 [2024-10-07 11:33:22.351863] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.682 [2024-10-07 11:33:22.351878] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.682 [2024-10-07 11:33:22.351892] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.682 [2024-10-07 11:33:22.351909] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.682 [2024-10-07 11:33:22.351924] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.682 [2024-10-07 11:33:22.351936] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.682 [2024-10-07 11:33:22.351959] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.682 [2024-10-07 11:33:22.351974] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.682 [2024-10-07 11:33:22.367266] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.682 [2024-10-07 11:33:22.367756] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.682 [2024-10-07 11:33:22.367859] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.682 [2024-10-07 11:33:22.367890] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.682 [2024-10-07 11:33:22.367907] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.682 [2024-10-07 11:33:22.368890] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.682 [2024-10-07 11:33:22.368936] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.682 [2024-10-07 11:33:22.368957] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.682 [2024-10-07 11:33:22.368977] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.682 [2024-10-07 11:33:22.369207] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.682 [2024-10-07 11:33:22.369237] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.682 [2024-10-07 11:33:22.369252] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.682 [2024-10-07 11:33:22.369266] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.682 [2024-10-07 11:33:22.369390] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.682 [2024-10-07 11:33:22.369434] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.682 [2024-10-07 11:33:22.369456] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.682 [2024-10-07 11:33:22.369470] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.682 [2024-10-07 11:33:22.369634] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.682 [2024-10-07 11:33:22.377928] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.682 [2024-10-07 11:33:22.378538] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.682 [2024-10-07 11:33:22.378640] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.682 [2024-10-07 11:33:22.378697] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.682 [2024-10-07 11:33:22.378716] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.682 [2024-10-07 11:33:22.378960] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.682 [2024-10-07 11:33:22.378990] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.682 [2024-10-07 11:33:22.379006] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.682 [2024-10-07 11:33:22.379025] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.682 [2024-10-07 11:33:22.379154] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.682 [2024-10-07 11:33:22.379180] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.682 [2024-10-07 11:33:22.379209] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.682 [2024-10-07 11:33:22.379225] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.682 [2024-10-07 11:33:22.380307] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.682 [2024-10-07 11:33:22.380350] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.682 [2024-10-07 11:33:22.380367] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.682 [2024-10-07 11:33:22.380381] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.682 [2024-10-07 11:33:22.382365] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.682 [2024-10-07 11:33:22.389506] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.682 [2024-10-07 11:33:22.389556] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.682 [2024-10-07 11:33:22.389764] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.682 [2024-10-07 11:33:22.389797] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.682 [2024-10-07 11:33:22.389814] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.682 [2024-10-07 11:33:22.389875] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.682 [2024-10-07 11:33:22.389906] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.682 [2024-10-07 11:33:22.389922] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.682 [2024-10-07 11:33:22.390059] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.682 [2024-10-07 11:33:22.390106] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.682 [2024-10-07 11:33:22.390233] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.682 [2024-10-07 11:33:22.390258] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.682 [2024-10-07 11:33:22.390273] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.682 [2024-10-07 11:33:22.390291] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.682 [2024-10-07 11:33:22.390305] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.682 [2024-10-07 11:33:22.390317] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.682 [2024-10-07 11:33:22.391073] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.682 [2024-10-07 11:33:22.391113] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.683 [2024-10-07 11:33:22.399806] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.683 [2024-10-07 11:33:22.399869] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.683 [2024-10-07 11:33:22.399997] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.683 [2024-10-07 11:33:22.400030] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.683 [2024-10-07 11:33:22.400047] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.683 [2024-10-07 11:33:22.400099] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.683 [2024-10-07 11:33:22.400124] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.683 [2024-10-07 11:33:22.400139] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.683 [2024-10-07 11:33:22.400319] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.683 [2024-10-07 11:33:22.400350] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.683 [2024-10-07 11:33:22.400406] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.683 [2024-10-07 11:33:22.400428] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.683 [2024-10-07 11:33:22.400442] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.683 [2024-10-07 11:33:22.400460] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.683 [2024-10-07 11:33:22.400474] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.683 [2024-10-07 11:33:22.400487] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.683 [2024-10-07 11:33:22.400510] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.683 [2024-10-07 11:33:22.400524] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.683 [2024-10-07 11:33:22.412832] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.683 [2024-10-07 11:33:22.412884] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.683 [2024-10-07 11:33:22.413129] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.683 [2024-10-07 11:33:22.413188] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.683 [2024-10-07 11:33:22.413210] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.683 [2024-10-07 11:33:22.413264] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.683 [2024-10-07 11:33:22.413288] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.683 [2024-10-07 11:33:22.413304] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.683 [2024-10-07 11:33:22.413418] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.683 [2024-10-07 11:33:22.413446] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.683 [2024-10-07 11:33:22.413544] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.683 [2024-10-07 11:33:22.413564] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.683 [2024-10-07 11:33:22.413578] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.683 [2024-10-07 11:33:22.413596] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.683 [2024-10-07 11:33:22.413610] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.683 [2024-10-07 11:33:22.413623] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.683 [2024-10-07 11:33:22.413953] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.683 [2024-10-07 11:33:22.413984] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.683 [2024-10-07 11:33:22.424644] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.683 [2024-10-07 11:33:22.424711] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.683 [2024-10-07 11:33:22.424922] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.683 [2024-10-07 11:33:22.424961] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.683 [2024-10-07 11:33:22.424980] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.683 [2024-10-07 11:33:22.425031] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.683 [2024-10-07 11:33:22.425055] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.683 [2024-10-07 11:33:22.425070] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.683 [2024-10-07 11:33:22.425225] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.683 [2024-10-07 11:33:22.425256] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.683 [2024-10-07 11:33:22.425379] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.683 [2024-10-07 11:33:22.425403] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.683 [2024-10-07 11:33:22.425418] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.683 [2024-10-07 11:33:22.425435] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.683 [2024-10-07 11:33:22.425454] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.683 [2024-10-07 11:33:22.425501] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.683 [2024-10-07 11:33:22.425623] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.683 [2024-10-07 11:33:22.425645] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.683 [2024-10-07 11:33:22.434777] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.683 [2024-10-07 11:33:22.434856] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.683 [2024-10-07 11:33:22.434940] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.683 [2024-10-07 11:33:22.434970] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.683 [2024-10-07 11:33:22.434987] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.683 [2024-10-07 11:33:22.435042] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.683 [2024-10-07 11:33:22.435067] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.683 [2024-10-07 11:33:22.435083] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.683 [2024-10-07 11:33:22.435101] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.683 [2024-10-07 11:33:22.435166] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.683 [2024-10-07 11:33:22.435201] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.683 [2024-10-07 11:33:22.435219] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.683 [2024-10-07 11:33:22.435232] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.683 [2024-10-07 11:33:22.435257] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.683 [2024-10-07 11:33:22.435272] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.683 [2024-10-07 11:33:22.435285] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.683 [2024-10-07 11:33:22.435298] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.683 [2024-10-07 11:33:22.435318] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.683 [2024-10-07 11:33:22.448888] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.683 [2024-10-07 11:33:22.448943] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.683 [2024-10-07 11:33:22.449153] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.683 [2024-10-07 11:33:22.449201] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.683 [2024-10-07 11:33:22.449229] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.683 [2024-10-07 11:33:22.449316] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.683 [2024-10-07 11:33:22.449343] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.683 [2024-10-07 11:33:22.449359] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.683 [2024-10-07 11:33:22.449527] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.683 [2024-10-07 11:33:22.449557] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.683 [2024-10-07 11:33:22.449631] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.683 [2024-10-07 11:33:22.449675] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.683 [2024-10-07 11:33:22.449691] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.683 [2024-10-07 11:33:22.449709] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.683 [2024-10-07 11:33:22.449723] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.683 [2024-10-07 11:33:22.449736] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.683 [2024-10-07 11:33:22.449761] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.683 [2024-10-07 11:33:22.449776] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.683 [2024-10-07 11:33:22.463437] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.683 [2024-10-07 11:33:22.463493] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.683 [2024-10-07 11:33:22.463821] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.683 [2024-10-07 11:33:22.463865] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.683 [2024-10-07 11:33:22.463884] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.683 [2024-10-07 11:33:22.463935] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.683 [2024-10-07 11:33:22.463959] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.684 [2024-10-07 11:33:22.463975] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.684 [2024-10-07 11:33:22.465041] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.684 [2024-10-07 11:33:22.465088] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.684 [2024-10-07 11:33:22.465747] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.684 [2024-10-07 11:33:22.465787] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.684 [2024-10-07 11:33:22.465805] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.684 [2024-10-07 11:33:22.465823] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.684 [2024-10-07 11:33:22.465838] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.684 [2024-10-07 11:33:22.465851] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.684 [2024-10-07 11:33:22.466089] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.684 [2024-10-07 11:33:22.466115] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.684 [2024-10-07 11:33:22.474834] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.684 [2024-10-07 11:33:22.474907] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.684 [2024-10-07 11:33:22.475145] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.684 [2024-10-07 11:33:22.475178] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.684 [2024-10-07 11:33:22.475226] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.684 [2024-10-07 11:33:22.475308] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.684 [2024-10-07 11:33:22.475338] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.684 [2024-10-07 11:33:22.475355] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.684 [2024-10-07 11:33:22.475477] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.684 [2024-10-07 11:33:22.475505] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.684 [2024-10-07 11:33:22.475604] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.684 [2024-10-07 11:33:22.475623] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.684 [2024-10-07 11:33:22.475637] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.684 [2024-10-07 11:33:22.475670] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.684 [2024-10-07 11:33:22.475688] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.684 [2024-10-07 11:33:22.475701] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.684 [2024-10-07 11:33:22.475820] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.684 [2024-10-07 11:33:22.475840] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.684 [2024-10-07 11:33:22.485890] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.684 [2024-10-07 11:33:22.485940] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.684 [2024-10-07 11:33:22.486030] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.684 [2024-10-07 11:33:22.486060] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.684 [2024-10-07 11:33:22.486076] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.684 [2024-10-07 11:33:22.486125] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.684 [2024-10-07 11:33:22.486148] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.684 [2024-10-07 11:33:22.486163] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.684 [2024-10-07 11:33:22.486186] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.684 [2024-10-07 11:33:22.486239] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.684 [2024-10-07 11:33:22.486267] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.684 [2024-10-07 11:33:22.486283] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.684 [2024-10-07 11:33:22.486297] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.684 [2024-10-07 11:33:22.486313] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.684 [2024-10-07 11:33:22.486328] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.684 [2024-10-07 11:33:22.486340] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.684 [2024-10-07 11:33:22.486381] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.684 [2024-10-07 11:33:22.486397] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.684 [2024-10-07 11:33:22.498060] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.684 [2024-10-07 11:33:22.498113] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.684 [2024-10-07 11:33:22.498258] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.684 [2024-10-07 11:33:22.498291] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.684 [2024-10-07 11:33:22.498308] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.684 [2024-10-07 11:33:22.498357] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.684 [2024-10-07 11:33:22.498381] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.684 [2024-10-07 11:33:22.498396] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.684 [2024-10-07 11:33:22.498421] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.684 [2024-10-07 11:33:22.498443] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.684 [2024-10-07 11:33:22.498463] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.684 [2024-10-07 11:33:22.498477] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.684 [2024-10-07 11:33:22.498509] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.684 [2024-10-07 11:33:22.498541] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.684 [2024-10-07 11:33:22.498565] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.684 [2024-10-07 11:33:22.498586] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.684 [2024-10-07 11:33:22.498619] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.684 [2024-10-07 11:33:22.498634] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.684 [2024-10-07 11:33:22.508181] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.684 [2024-10-07 11:33:22.509047] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.684 [2024-10-07 11:33:22.509149] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.684 [2024-10-07 11:33:22.509179] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.684 [2024-10-07 11:33:22.509196] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.684 [2024-10-07 11:33:22.511240] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.684 [2024-10-07 11:33:22.511280] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.684 [2024-10-07 11:33:22.511299] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.684 [2024-10-07 11:33:22.511319] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.684 [2024-10-07 11:33:22.511978] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.684 [2024-10-07 11:33:22.512037] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.684 [2024-10-07 11:33:22.512057] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.684 [2024-10-07 11:33:22.512071] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.684 [2024-10-07 11:33:22.512167] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.685 [2024-10-07 11:33:22.512189] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.685 [2024-10-07 11:33:22.512203] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.685 [2024-10-07 11:33:22.512216] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.685 [2024-10-07 11:33:22.512238] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.685 [2024-10-07 11:33:22.518509] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.685 [2024-10-07 11:33:22.518714] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.685 [2024-10-07 11:33:22.518747] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.685 [2024-10-07 11:33:22.518764] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.685 [2024-10-07 11:33:22.519256] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.685 [2024-10-07 11:33:22.519349] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.685 [2024-10-07 11:33:22.519374] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.685 [2024-10-07 11:33:22.519388] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.685 [2024-10-07 11:33:22.519414] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.685 [2024-10-07 11:33:22.519434] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.685 [2024-10-07 11:33:22.519502] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.685 [2024-10-07 11:33:22.519541] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.685 [2024-10-07 11:33:22.519557] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.685 [2024-10-07 11:33:22.522358] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.685 [2024-10-07 11:33:22.522825] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.685 [2024-10-07 11:33:22.522862] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.685 [2024-10-07 11:33:22.522880] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.685 [2024-10-07 11:33:22.523221] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.685 [2024-10-07 11:33:22.528800] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.685 [2024-10-07 11:33:22.528905] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.685 [2024-10-07 11:33:22.528935] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.685 [2024-10-07 11:33:22.528952] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.685 [2024-10-07 11:33:22.528976] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.685 [2024-10-07 11:33:22.529016] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.685 [2024-10-07 11:33:22.529031] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.685 [2024-10-07 11:33:22.529045] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.685 [2024-10-07 11:33:22.529068] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.685 [2024-10-07 11:33:22.529793] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.685 [2024-10-07 11:33:22.529894] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.685 [2024-10-07 11:33:22.529924] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.685 [2024-10-07 11:33:22.529940] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.685 [2024-10-07 11:33:22.529963] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.685 [2024-10-07 11:33:22.529986] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.685 [2024-10-07 11:33:22.530001] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.685 [2024-10-07 11:33:22.530014] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.685 [2024-10-07 11:33:22.530037] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.685 [2024-10-07 11:33:22.539401] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.685 [2024-10-07 11:33:22.539601] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.685 [2024-10-07 11:33:22.539633] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.685 [2024-10-07 11:33:22.539666] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.685 [2024-10-07 11:33:22.539776] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.685 [2024-10-07 11:33:22.539880] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.685 [2024-10-07 11:33:22.539900] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.685 [2024-10-07 11:33:22.539914] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.685 [2024-10-07 11:33:22.540299] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.685 [2024-10-07 11:33:22.540388] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.685 [2024-10-07 11:33:22.540471] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.685 [2024-10-07 11:33:22.540501] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.685 [2024-10-07 11:33:22.540524] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.685 [2024-10-07 11:33:22.542707] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.685 [2024-10-07 11:33:22.543521] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.685 [2024-10-07 11:33:22.543559] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.685 [2024-10-07 11:33:22.543576] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.685 [2024-10-07 11:33:22.543737] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.685 [2024-10-07 11:33:22.549541] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.685 [2024-10-07 11:33:22.549660] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.685 [2024-10-07 11:33:22.549691] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.685 [2024-10-07 11:33:22.549708] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.685 [2024-10-07 11:33:22.549732] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.685 [2024-10-07 11:33:22.549755] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.685 [2024-10-07 11:33:22.549769] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.685 [2024-10-07 11:33:22.549783] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.685 [2024-10-07 11:33:22.549806] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.685 [2024-10-07 11:33:22.550443] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.685 [2024-10-07 11:33:22.550527] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.685 [2024-10-07 11:33:22.550555] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.685 [2024-10-07 11:33:22.550571] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.685 [2024-10-07 11:33:22.555049] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.685 [2024-10-07 11:33:22.557380] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.685 [2024-10-07 11:33:22.557421] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.685 [2024-10-07 11:33:22.557440] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.685 [2024-10-07 11:33:22.557551] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.685 [2024-10-07 11:33:22.559619] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.685 [2024-10-07 11:33:22.559734] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.685 [2024-10-07 11:33:22.559765] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.685 [2024-10-07 11:33:22.559781] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.685 [2024-10-07 11:33:22.559805] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.685 [2024-10-07 11:33:22.559827] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.685 [2024-10-07 11:33:22.559841] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.685 [2024-10-07 11:33:22.559854] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.685 [2024-10-07 11:33:22.559878] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.685 [2024-10-07 11:33:22.560498] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.685 [2024-10-07 11:33:22.560583] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.685 [2024-10-07 11:33:22.560611] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.685 [2024-10-07 11:33:22.560645] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.685 [2024-10-07 11:33:22.560685] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.685 [2024-10-07 11:33:22.560708] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.685 [2024-10-07 11:33:22.560722] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.685 [2024-10-07 11:33:22.560735] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.685 [2024-10-07 11:33:22.560758] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.685 [2024-10-07 11:33:22.571944] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.685 [2024-10-07 11:33:22.572232] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.686 [2024-10-07 11:33:22.572337] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.686 [2024-10-07 11:33:22.572368] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.686 [2024-10-07 11:33:22.572385] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.686 [2024-10-07 11:33:22.572627] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.686 [2024-10-07 11:33:22.572692] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.686 [2024-10-07 11:33:22.572713] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.686 [2024-10-07 11:33:22.572733] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.686 [2024-10-07 11:33:22.572794] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.686 [2024-10-07 11:33:22.572818] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.686 [2024-10-07 11:33:22.572833] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.686 [2024-10-07 11:33:22.572847] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.686 [2024-10-07 11:33:22.572889] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.686 [2024-10-07 11:33:22.572908] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.686 [2024-10-07 11:33:22.572921] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.686 [2024-10-07 11:33:22.572935] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.686 [2024-10-07 11:33:22.572956] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.686 [2024-10-07 11:33:22.584867] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.686 [2024-10-07 11:33:22.584918] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.686 [2024-10-07 11:33:22.585010] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.686 [2024-10-07 11:33:22.585039] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.686 [2024-10-07 11:33:22.585056] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.686 [2024-10-07 11:33:22.585104] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.686 [2024-10-07 11:33:22.585141] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.686 [2024-10-07 11:33:22.585158] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.686 [2024-10-07 11:33:22.585743] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.686 [2024-10-07 11:33:22.585785] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.686 [2024-10-07 11:33:22.585902] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.686 [2024-10-07 11:33:22.585927] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.686 [2024-10-07 11:33:22.585941] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.686 [2024-10-07 11:33:22.585958] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.686 [2024-10-07 11:33:22.585973] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.686 [2024-10-07 11:33:22.585985] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.686 [2024-10-07 11:33:22.586009] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.686 [2024-10-07 11:33:22.586023] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.686 [2024-10-07 11:33:22.595550] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.686 [2024-10-07 11:33:22.595605] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.686 [2024-10-07 11:33:22.595815] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.686 [2024-10-07 11:33:22.595847] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.686 [2024-10-07 11:33:22.595864] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.686 [2024-10-07 11:33:22.595912] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.686 [2024-10-07 11:33:22.595936] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.686 [2024-10-07 11:33:22.595951] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.686 [2024-10-07 11:33:22.596074] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.686 [2024-10-07 11:33:22.596102] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.686 [2024-10-07 11:33:22.596201] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.686 [2024-10-07 11:33:22.596219] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.686 [2024-10-07 11:33:22.596234] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.686 [2024-10-07 11:33:22.596251] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.686 [2024-10-07 11:33:22.596265] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.686 [2024-10-07 11:33:22.596286] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.686 [2024-10-07 11:33:22.596389] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.686 [2024-10-07 11:33:22.596409] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.686 [2024-10-07 11:33:22.605923] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.686 [2024-10-07 11:33:22.605971] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.686 [2024-10-07 11:33:22.606154] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.686 [2024-10-07 11:33:22.606186] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.686 [2024-10-07 11:33:22.606203] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.686 [2024-10-07 11:33:22.606251] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.686 [2024-10-07 11:33:22.606274] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.686 [2024-10-07 11:33:22.606289] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.686 [2024-10-07 11:33:22.606391] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.686 [2024-10-07 11:33:22.606416] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.686 [2024-10-07 11:33:22.608366] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.686 [2024-10-07 11:33:22.608407] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.686 [2024-10-07 11:33:22.608425] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.686 [2024-10-07 11:33:22.608443] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.686 [2024-10-07 11:33:22.608457] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.686 [2024-10-07 11:33:22.608470] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.686 [2024-10-07 11:33:22.610419] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.686 [2024-10-07 11:33:22.610459] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.686 [2024-10-07 11:33:22.616136] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.686 [2024-10-07 11:33:22.616184] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.686 [2024-10-07 11:33:22.616271] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.686 [2024-10-07 11:33:22.616301] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.686 [2024-10-07 11:33:22.616318] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.686 [2024-10-07 11:33:22.616365] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.686 [2024-10-07 11:33:22.616387] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.686 [2024-10-07 11:33:22.616403] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.687 [2024-10-07 11:33:22.616427] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.687 [2024-10-07 11:33:22.616447] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.687 [2024-10-07 11:33:22.616481] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.687 [2024-10-07 11:33:22.616498] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.687 [2024-10-07 11:33:22.616541] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.687 [2024-10-07 11:33:22.616558] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.687 [2024-10-07 11:33:22.616573] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.687 [2024-10-07 11:33:22.616586] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.687 [2024-10-07 11:33:22.616609] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.687 [2024-10-07 11:33:22.616623] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.687 [2024-10-07 11:33:22.627621] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.687 [2024-10-07 11:33:22.627684] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.687 [2024-10-07 11:33:22.627962] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.687 [2024-10-07 11:33:22.628006] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.687 [2024-10-07 11:33:22.628026] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.687 [2024-10-07 11:33:22.628077] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.687 [2024-10-07 11:33:22.628101] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.687 [2024-10-07 11:33:22.628116] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.687 [2024-10-07 11:33:22.628170] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.687 [2024-10-07 11:33:22.628197] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.687 [2024-10-07 11:33:22.628218] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.687 [2024-10-07 11:33:22.628233] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.687 [2024-10-07 11:33:22.628246] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.687 [2024-10-07 11:33:22.628263] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.687 [2024-10-07 11:33:22.628278] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.687 [2024-10-07 11:33:22.628291] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.687 [2024-10-07 11:33:22.628314] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.687 [2024-10-07 11:33:22.628327] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.687 [2024-10-07 11:33:22.639612] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.687 [2024-10-07 11:33:22.639673] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.687 [2024-10-07 11:33:22.639928] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.687 [2024-10-07 11:33:22.639971] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.687 [2024-10-07 11:33:22.639991] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.687 [2024-10-07 11:33:22.640042] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.687 [2024-10-07 11:33:22.640066] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.687 [2024-10-07 11:33:22.640099] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.687 [2024-10-07 11:33:22.640232] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.687 [2024-10-07 11:33:22.640261] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.687 [2024-10-07 11:33:22.640382] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.687 [2024-10-07 11:33:22.640405] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.687 [2024-10-07 11:33:22.640420] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.687 [2024-10-07 11:33:22.640437] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.687 [2024-10-07 11:33:22.640452] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.687 [2024-10-07 11:33:22.640465] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.687 [2024-10-07 11:33:22.640580] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.687 [2024-10-07 11:33:22.640601] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.687 [2024-10-07 11:33:22.649740] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.687 [2024-10-07 11:33:22.649806] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.687 [2024-10-07 11:33:22.649887] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.687 [2024-10-07 11:33:22.649916] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.687 [2024-10-07 11:33:22.649933] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.687 [2024-10-07 11:33:22.649987] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.687 [2024-10-07 11:33:22.650011] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.687 [2024-10-07 11:33:22.650026] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.687 [2024-10-07 11:33:22.650043] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.687 [2024-10-07 11:33:22.650067] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.687 [2024-10-07 11:33:22.650085] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.687 [2024-10-07 11:33:22.650098] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.687 [2024-10-07 11:33:22.650111] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.687 [2024-10-07 11:33:22.650134] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.687 [2024-10-07 11:33:22.650149] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.687 [2024-10-07 11:33:22.650162] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.687 [2024-10-07 11:33:22.650174] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.687 [2024-10-07 11:33:22.650194] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.687 [2024-10-07 11:33:22.661413] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.687 [2024-10-07 11:33:22.661479] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.687 [2024-10-07 11:33:22.661724] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.687 [2024-10-07 11:33:22.661756] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.687 [2024-10-07 11:33:22.661774] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.687 [2024-10-07 11:33:22.661821] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.687 [2024-10-07 11:33:22.661844] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.687 [2024-10-07 11:33:22.661859] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.687 [2024-10-07 11:33:22.661883] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.687 [2024-10-07 11:33:22.661903] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.687 [2024-10-07 11:33:22.661923] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.687 [2024-10-07 11:33:22.661938] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.687 [2024-10-07 11:33:22.661951] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.687 [2024-10-07 11:33:22.661968] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.687 [2024-10-07 11:33:22.661982] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.687 [2024-10-07 11:33:22.661995] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.688 [2024-10-07 11:33:22.662018] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.688 [2024-10-07 11:33:22.662032] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.688 [2024-10-07 11:33:22.671559] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.688 [2024-10-07 11:33:22.671624] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.688 [2024-10-07 11:33:22.671716] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.688 [2024-10-07 11:33:22.671746] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.688 [2024-10-07 11:33:22.671763] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.688 [2024-10-07 11:33:22.671818] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.688 [2024-10-07 11:33:22.671844] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.688 [2024-10-07 11:33:22.671859] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.688 [2024-10-07 11:33:22.671876] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.688 [2024-10-07 11:33:22.671900] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.688 [2024-10-07 11:33:22.671917] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.688 [2024-10-07 11:33:22.671931] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.688 [2024-10-07 11:33:22.671944] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.688 [2024-10-07 11:33:22.671982] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.688 [2024-10-07 11:33:22.671999] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.688 [2024-10-07 11:33:22.672012] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.688 [2024-10-07 11:33:22.672026] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.688 [2024-10-07 11:33:22.672046] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.688 [2024-10-07 11:33:22.686150] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.688 [2024-10-07 11:33:22.686203] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.688 [2024-10-07 11:33:22.687320] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.688 [2024-10-07 11:33:22.687366] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.688 [2024-10-07 11:33:22.687387] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.688 [2024-10-07 11:33:22.687439] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.688 [2024-10-07 11:33:22.687463] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.688 [2024-10-07 11:33:22.687478] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.688 [2024-10-07 11:33:22.687902] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.688 [2024-10-07 11:33:22.687946] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.688 [2024-10-07 11:33:22.688171] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.688 [2024-10-07 11:33:22.688208] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.688 [2024-10-07 11:33:22.688226] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.688 [2024-10-07 11:33:22.688244] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.688 [2024-10-07 11:33:22.688258] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.688 [2024-10-07 11:33:22.688271] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.688 [2024-10-07 11:33:22.688407] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.688 [2024-10-07 11:33:22.688433] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.688 [2024-10-07 11:33:22.703293] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.688 [2024-10-07 11:33:22.703351] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.688 [2024-10-07 11:33:22.703529] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.688 [2024-10-07 11:33:22.703561] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.688 [2024-10-07 11:33:22.703579] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.688 [2024-10-07 11:33:22.703628] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.688 [2024-10-07 11:33:22.703669] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.688 [2024-10-07 11:33:22.703689] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.688 [2024-10-07 11:33:22.703743] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.688 [2024-10-07 11:33:22.703765] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.688 [2024-10-07 11:33:22.703785] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.688 [2024-10-07 11:33:22.703800] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.688 [2024-10-07 11:33:22.703814] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.688 [2024-10-07 11:33:22.703831] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.688 [2024-10-07 11:33:22.703845] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.688 [2024-10-07 11:33:22.703858] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.688 [2024-10-07 11:33:22.703881] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.688 [2024-10-07 11:33:22.703895] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.688 [2024-10-07 11:33:22.719226] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.688 [2024-10-07 11:33:22.719279] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.688 [2024-10-07 11:33:22.719635] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.688 [2024-10-07 11:33:22.719696] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.688 [2024-10-07 11:33:22.719717] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.688 [2024-10-07 11:33:22.719772] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.688 [2024-10-07 11:33:22.719796] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.688 [2024-10-07 11:33:22.719812] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.688 [2024-10-07 11:33:22.720020] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.688 [2024-10-07 11:33:22.720064] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.688 [2024-10-07 11:33:22.720279] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.688 [2024-10-07 11:33:22.720316] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.688 [2024-10-07 11:33:22.720334] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.688 [2024-10-07 11:33:22.720351] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.688 [2024-10-07 11:33:22.720367] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.688 [2024-10-07 11:33:22.720380] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.688 [2024-10-07 11:33:22.720585] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.688 [2024-10-07 11:33:22.720610] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.688 [2024-10-07 11:33:22.734399] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.688 [2024-10-07 11:33:22.734451] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.688 [2024-10-07 11:33:22.734590] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.688 [2024-10-07 11:33:22.734622] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.688 [2024-10-07 11:33:22.734639] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.688 [2024-10-07 11:33:22.734708] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.688 [2024-10-07 11:33:22.734732] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.688 [2024-10-07 11:33:22.734748] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.688 [2024-10-07 11:33:22.734772] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.688 [2024-10-07 11:33:22.734793] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.688 [2024-10-07 11:33:22.734812] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.688 [2024-10-07 11:33:22.734827] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.688 [2024-10-07 11:33:22.734841] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.688 [2024-10-07 11:33:22.734857] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.688 [2024-10-07 11:33:22.734872] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.688 [2024-10-07 11:33:22.734884] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.688 [2024-10-07 11:33:22.734907] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.689 [2024-10-07 11:33:22.734922] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.689 [2024-10-07 11:33:22.750002] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.689 [2024-10-07 11:33:22.750059] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.689 [2024-10-07 11:33:22.750210] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.689 [2024-10-07 11:33:22.750246] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.689 [2024-10-07 11:33:22.750264] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.689 [2024-10-07 11:33:22.750319] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.689 [2024-10-07 11:33:22.750343] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.689 [2024-10-07 11:33:22.750359] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.689 [2024-10-07 11:33:22.750383] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.689 [2024-10-07 11:33:22.750403] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.689 [2024-10-07 11:33:22.750423] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.689 [2024-10-07 11:33:22.750437] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.689 [2024-10-07 11:33:22.750451] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.689 [2024-10-07 11:33:22.750467] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.689 [2024-10-07 11:33:22.750498] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.689 [2024-10-07 11:33:22.750512] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.689 [2024-10-07 11:33:22.750537] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.689 [2024-10-07 11:33:22.750551] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.689 [2024-10-07 11:33:22.766111] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.689 [2024-10-07 11:33:22.766162] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.689 [2024-10-07 11:33:22.766251] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.689 [2024-10-07 11:33:22.766281] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.689 [2024-10-07 11:33:22.766298] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.689 [2024-10-07 11:33:22.766346] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.689 [2024-10-07 11:33:22.766392] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.689 [2024-10-07 11:33:22.766430] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.689 [2024-10-07 11:33:22.766459] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.689 [2024-10-07 11:33:22.766479] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.689 [2024-10-07 11:33:22.766499] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.689 [2024-10-07 11:33:22.766514] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.689 [2024-10-07 11:33:22.766528] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.689 [2024-10-07 11:33:22.766544] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.689 [2024-10-07 11:33:22.766558] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.689 [2024-10-07 11:33:22.766571] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.689 [2024-10-07 11:33:22.766594] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.689 [2024-10-07 11:33:22.766608] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.689 [2024-10-07 11:33:22.782084] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.689 [2024-10-07 11:33:22.782136] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.689 [2024-10-07 11:33:22.782227] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.689 [2024-10-07 11:33:22.782257] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.689 [2024-10-07 11:33:22.782274] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.689 [2024-10-07 11:33:22.782335] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.689 [2024-10-07 11:33:22.782371] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.689 [2024-10-07 11:33:22.782391] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.689 [2024-10-07 11:33:22.782446] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.689 [2024-10-07 11:33:22.782468] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.689 [2024-10-07 11:33:22.782489] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.689 [2024-10-07 11:33:22.782503] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.689 [2024-10-07 11:33:22.782527] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.689 [2024-10-07 11:33:22.782549] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.689 [2024-10-07 11:33:22.782564] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.689 [2024-10-07 11:33:22.782577] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.689 [2024-10-07 11:33:22.782601] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.689 [2024-10-07 11:33:22.782615] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.689 [2024-10-07 11:33:22.797918] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.689 [2024-10-07 11:33:22.797971] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.689 [2024-10-07 11:33:22.798071] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.689 [2024-10-07 11:33:22.798113] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.689 [2024-10-07 11:33:22.798146] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.689 [2024-10-07 11:33:22.798221] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.689 [2024-10-07 11:33:22.798255] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.689 [2024-10-07 11:33:22.798276] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.689 [2024-10-07 11:33:22.798301] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.689 [2024-10-07 11:33:22.798321] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.689 [2024-10-07 11:33:22.798340] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.689 [2024-10-07 11:33:22.798355] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.689 [2024-10-07 11:33:22.798369] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.689 [2024-10-07 11:33:22.798386] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.689 [2024-10-07 11:33:22.798400] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.689 [2024-10-07 11:33:22.798413] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.689 [2024-10-07 11:33:22.798435] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.689 [2024-10-07 11:33:22.798450] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.689 [2024-10-07 11:33:22.813685] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.689 [2024-10-07 11:33:22.813737] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.689 [2024-10-07 11:33:22.813830] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.689 [2024-10-07 11:33:22.813881] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.689 [2024-10-07 11:33:22.813900] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.689 [2024-10-07 11:33:22.813951] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.689 [2024-10-07 11:33:22.813990] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.689 [2024-10-07 11:33:22.814005] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.689 [2024-10-07 11:33:22.814029] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.689 [2024-10-07 11:33:22.814049] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.690 [2024-10-07 11:33:22.814068] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.690 [2024-10-07 11:33:22.814082] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.690 [2024-10-07 11:33:22.814095] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.690 [2024-10-07 11:33:22.814111] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.690 [2024-10-07 11:33:22.814140] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.690 [2024-10-07 11:33:22.814153] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.690 [2024-10-07 11:33:22.814177] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.690 [2024-10-07 11:33:22.814191] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.690 [2024-10-07 11:33:22.830732] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.690 [2024-10-07 11:33:22.830784] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.690 [2024-10-07 11:33:22.831308] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.690 [2024-10-07 11:33:22.831354] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.690 [2024-10-07 11:33:22.831375] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.690 [2024-10-07 11:33:22.831427] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.690 [2024-10-07 11:33:22.831452] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.690 [2024-10-07 11:33:22.831468] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.690 [2024-10-07 11:33:22.831703] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.690 [2024-10-07 11:33:22.831735] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.690 [2024-10-07 11:33:22.831935] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.690 [2024-10-07 11:33:22.831971] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.690 [2024-10-07 11:33:22.831989] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.690 [2024-10-07 11:33:22.832007] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.690 [2024-10-07 11:33:22.832021] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.690 [2024-10-07 11:33:22.832055] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.690 [2024-10-07 11:33:22.832309] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.690 [2024-10-07 11:33:22.832336] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.690 [2024-10-07 11:33:22.846708] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.690 [2024-10-07 11:33:22.846763] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.690 [2024-10-07 11:33:22.847084] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.690 [2024-10-07 11:33:22.847118] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.690 [2024-10-07 11:33:22.847135] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.690 [2024-10-07 11:33:22.847184] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.690 [2024-10-07 11:33:22.847227] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.690 [2024-10-07 11:33:22.847245] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.690 [2024-10-07 11:33:22.847466] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.690 [2024-10-07 11:33:22.847498] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.690 [2024-10-07 11:33:22.847750] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.690 [2024-10-07 11:33:22.847786] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.690 [2024-10-07 11:33:22.847803] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.690 [2024-10-07 11:33:22.847823] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.690 [2024-10-07 11:33:22.847837] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.690 [2024-10-07 11:33:22.847850] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.690 [2024-10-07 11:33:22.848062] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.690 [2024-10-07 11:33:22.848087] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.690 [2024-10-07 11:33:22.857099] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.690 [2024-10-07 11:33:22.857151] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.690 [2024-10-07 11:33:22.857351] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.690 [2024-10-07 11:33:22.857384] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.690 [2024-10-07 11:33:22.857402] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.690 [2024-10-07 11:33:22.857450] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.690 [2024-10-07 11:33:22.857474] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.690 [2024-10-07 11:33:22.857497] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.690 [2024-10-07 11:33:22.857613] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.690 [2024-10-07 11:33:22.857676] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.690 [2024-10-07 11:33:22.857785] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.690 [2024-10-07 11:33:22.857806] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.690 [2024-10-07 11:33:22.857820] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.690 [2024-10-07 11:33:22.857837] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.690 [2024-10-07 11:33:22.857851] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.690 [2024-10-07 11:33:22.857865] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.690 [2024-10-07 11:33:22.858294] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.690 [2024-10-07 11:33:22.858339] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.690 [2024-10-07 11:33:22.868295] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.690 [2024-10-07 11:33:22.868345] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.690 [2024-10-07 11:33:22.868435] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.690 [2024-10-07 11:33:22.868465] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.690 [2024-10-07 11:33:22.868482] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.690 [2024-10-07 11:33:22.868530] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.690 [2024-10-07 11:33:22.868553] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.690 [2024-10-07 11:33:22.868568] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.690 [2024-10-07 11:33:22.868592] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.690 [2024-10-07 11:33:22.868612] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.690 [2024-10-07 11:33:22.868632] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.690 [2024-10-07 11:33:22.868661] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.690 [2024-10-07 11:33:22.868678] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.690 [2024-10-07 11:33:22.868695] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.690 [2024-10-07 11:33:22.868709] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.690 [2024-10-07 11:33:22.868722] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.690 [2024-10-07 11:33:22.868745] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.690 [2024-10-07 11:33:22.868760] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.690 [2024-10-07 11:33:22.879883] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.690 [2024-10-07 11:33:22.879938] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.690 [2024-10-07 11:33:22.881048] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.690 [2024-10-07 11:33:22.881107] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.690 [2024-10-07 11:33:22.881160] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.690 [2024-10-07 11:33:22.881214] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.690 [2024-10-07 11:33:22.881238] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.690 [2024-10-07 11:33:22.881254] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.690 [2024-10-07 11:33:22.882415] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.690 [2024-10-07 11:33:22.882462] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.690 [2024-10-07 11:33:22.882587] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.690 [2024-10-07 11:33:22.882612] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.690 [2024-10-07 11:33:22.882627] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.690 [2024-10-07 11:33:22.882645] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.690 [2024-10-07 11:33:22.882679] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.690 [2024-10-07 11:33:22.882693] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.690 [2024-10-07 11:33:22.883268] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.691 [2024-10-07 11:33:22.883307] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.691 [2024-10-07 11:33:22.890007] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.691 [2024-10-07 11:33:22.890074] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.691 [2024-10-07 11:33:22.890155] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.691 [2024-10-07 11:33:22.890185] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.691 [2024-10-07 11:33:22.890208] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.691 [2024-10-07 11:33:22.890264] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.691 [2024-10-07 11:33:22.890288] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.691 [2024-10-07 11:33:22.890303] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.691 [2024-10-07 11:33:22.890321] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.691 [2024-10-07 11:33:22.890344] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.691 [2024-10-07 11:33:22.890362] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.691 [2024-10-07 11:33:22.890375] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.691 [2024-10-07 11:33:22.890389] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.691 [2024-10-07 11:33:22.890412] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.691 [2024-10-07 11:33:22.890426] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.691 [2024-10-07 11:33:22.890439] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.691 [2024-10-07 11:33:22.890466] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.691 [2024-10-07 11:33:22.890489] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.691 8792.17 IOPS, 34.34 MiB/s [2024-10-07T11:33:33.214Z] [2024-10-07 11:33:22.905447] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.691 [2024-10-07 11:33:22.905495] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.691 [2024-10-07 11:33:22.906471] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.691 [2024-10-07 11:33:22.906516] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.691 [2024-10-07 11:33:22.906537] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.691 [2024-10-07 11:33:22.906588] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.691 [2024-10-07 11:33:22.906613] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.691 [2024-10-07 11:33:22.906639] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.691 [2024-10-07 11:33:22.907326] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.691 [2024-10-07 11:33:22.907372] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.691 [2024-10-07 11:33:22.907436] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.691 [2024-10-07 11:33:22.907459] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.691 [2024-10-07 11:33:22.907475] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.691 [2024-10-07 11:33:22.907499] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.691 [2024-10-07 11:33:22.907516] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.691 [2024-10-07 11:33:22.907529] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.691 [2024-10-07 11:33:22.907554] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.691 [2024-10-07 11:33:22.907568] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.691 [2024-10-07 11:33:22.917981] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.691 [2024-10-07 11:33:22.918037] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.691 [2024-10-07 11:33:22.918289] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.691 [2024-10-07 11:33:22.918322] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.691 [2024-10-07 11:33:22.918340] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.691 [2024-10-07 11:33:22.918389] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.691 [2024-10-07 11:33:22.918413] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.691 [2024-10-07 11:33:22.918428] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.691 [2024-10-07 11:33:22.918682] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.691 [2024-10-07 11:33:22.918719] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.691 [2024-10-07 11:33:22.918947] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.691 [2024-10-07 11:33:22.919006] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.691 [2024-10-07 11:33:22.919041] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.691 [2024-10-07 11:33:22.919074] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.691 [2024-10-07 11:33:22.919094] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.691 [2024-10-07 11:33:22.919108] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.691 [2024-10-07 11:33:22.919160] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.691 [2024-10-07 11:33:22.919182] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.691 [2024-10-07 11:33:22.928228] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.691 [2024-10-07 11:33:22.928284] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.691 [2024-10-07 11:33:22.928376] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.691 [2024-10-07 11:33:22.928406] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.691 [2024-10-07 11:33:22.928423] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.691 [2024-10-07 11:33:22.928472] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.691 [2024-10-07 11:33:22.928496] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.691 [2024-10-07 11:33:22.928511] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.691 [2024-10-07 11:33:22.931057] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.691 [2024-10-07 11:33:22.931105] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.691 [2024-10-07 11:33:22.932002] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.691 [2024-10-07 11:33:22.932041] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.691 [2024-10-07 11:33:22.932059] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.691 [2024-10-07 11:33:22.932077] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.691 [2024-10-07 11:33:22.932091] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.691 [2024-10-07 11:33:22.932104] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.691 [2024-10-07 11:33:22.932232] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.691 [2024-10-07 11:33:22.932257] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.691 [2024-10-07 11:33:22.939113] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.691 [2024-10-07 11:33:22.939165] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.691 [2024-10-07 11:33:22.939275] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.691 [2024-10-07 11:33:22.939306] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.692 [2024-10-07 11:33:22.939339] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.692 [2024-10-07 11:33:22.939392] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.692 [2024-10-07 11:33:22.939416] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.692 [2024-10-07 11:33:22.939431] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.692 [2024-10-07 11:33:22.939455] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.692 [2024-10-07 11:33:22.939475] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.692 [2024-10-07 11:33:22.939495] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.692 [2024-10-07 11:33:22.939509] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.692 [2024-10-07 11:33:22.939523] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.692 [2024-10-07 11:33:22.939540] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.692 [2024-10-07 11:33:22.939554] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.692 [2024-10-07 11:33:22.939567] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.692 [2024-10-07 11:33:22.939596] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.692 [2024-10-07 11:33:22.939615] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.692 [2024-10-07 11:33:22.949230] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.692 [2024-10-07 11:33:22.949362] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.692 [2024-10-07 11:33:22.949395] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.692 [2024-10-07 11:33:22.949412] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.692 [2024-10-07 11:33:22.949438] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.692 [2024-10-07 11:33:22.949469] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.692 [2024-10-07 11:33:22.949532] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.692 [2024-10-07 11:33:22.949558] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.692 [2024-10-07 11:33:22.949574] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.692 [2024-10-07 11:33:22.949589] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.692 [2024-10-07 11:33:22.949602] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.692 [2024-10-07 11:33:22.949615] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.692 [2024-10-07 11:33:22.949639] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.692 [2024-10-07 11:33:22.949688] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.692 [2024-10-07 11:33:22.949710] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.692 [2024-10-07 11:33:22.949725] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.692 [2024-10-07 11:33:22.949759] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.692 [2024-10-07 11:33:22.949783] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.692 [2024-10-07 11:33:22.959830] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.692 [2024-10-07 11:33:22.959880] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.692 [2024-10-07 11:33:22.959981] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.692 [2024-10-07 11:33:22.960010] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.692 [2024-10-07 11:33:22.960042] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.692 [2024-10-07 11:33:22.960087] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.692 [2024-10-07 11:33:22.960109] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.692 [2024-10-07 11:33:22.960124] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.692 [2024-10-07 11:33:22.960737] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.692 [2024-10-07 11:33:22.960780] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.692 [2024-10-07 11:33:22.960878] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.692 [2024-10-07 11:33:22.960900] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.692 [2024-10-07 11:33:22.960914] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.692 [2024-10-07 11:33:22.960931] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.692 [2024-10-07 11:33:22.960945] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.692 [2024-10-07 11:33:22.960958] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.692 [2024-10-07 11:33:22.960981] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.692 [2024-10-07 11:33:22.960995] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.692 [2024-10-07 11:33:22.970803] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.692 [2024-10-07 11:33:22.970894] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.692 [2024-10-07 11:33:22.971112] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.692 [2024-10-07 11:33:22.971145] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.692 [2024-10-07 11:33:22.971162] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.692 [2024-10-07 11:33:22.971222] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.692 [2024-10-07 11:33:22.971247] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.692 [2024-10-07 11:33:22.971262] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.692 [2024-10-07 11:33:22.971379] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.692 [2024-10-07 11:33:22.971406] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.692 [2024-10-07 11:33:22.971506] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.692 [2024-10-07 11:33:22.971548] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.692 [2024-10-07 11:33:22.971563] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.692 [2024-10-07 11:33:22.971581] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.692 [2024-10-07 11:33:22.971595] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.692 [2024-10-07 11:33:22.971607] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.692 [2024-10-07 11:33:22.971974] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.692 [2024-10-07 11:33:22.972001] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.692 [2024-10-07 11:33:22.983611] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.692 [2024-10-07 11:33:22.983684] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.692 [2024-10-07 11:33:22.984008] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.692 [2024-10-07 11:33:22.984066] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.692 [2024-10-07 11:33:22.984085] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.692 [2024-10-07 11:33:22.984136] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.692 [2024-10-07 11:33:22.984159] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.692 [2024-10-07 11:33:22.984174] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.692 [2024-10-07 11:33:22.986388] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.692 [2024-10-07 11:33:22.986445] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.692 [2024-10-07 11:33:22.986808] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.692 [2024-10-07 11:33:22.986837] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.692 [2024-10-07 11:33:22.986852] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.692 [2024-10-07 11:33:22.986870] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.692 [2024-10-07 11:33:22.986891] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.692 [2024-10-07 11:33:22.986904] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.692 [2024-10-07 11:33:22.987067] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.692 [2024-10-07 11:33:22.987092] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.692 [2024-10-07 11:33:22.995152] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.692 [2024-10-07 11:33:22.995242] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.692 [2024-10-07 11:33:22.995544] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.692 [2024-10-07 11:33:22.995589] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.692 [2024-10-07 11:33:22.995610] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.692 [2024-10-07 11:33:22.995696] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.692 [2024-10-07 11:33:22.995723] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.692 [2024-10-07 11:33:22.995739] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.692 [2024-10-07 11:33:22.995795] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.692 [2024-10-07 11:33:22.995822] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.692 [2024-10-07 11:33:22.995843] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.693 [2024-10-07 11:33:22.995858] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.693 [2024-10-07 11:33:22.995871] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.693 [2024-10-07 11:33:22.995888] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.693 [2024-10-07 11:33:22.995903] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.693 [2024-10-07 11:33:22.995915] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.693 [2024-10-07 11:33:22.995953] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.693 [2024-10-07 11:33:22.995967] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.693 [2024-10-07 11:33:23.007964] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.693 [2024-10-07 11:33:23.008028] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.693 [2024-10-07 11:33:23.008468] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.693 [2024-10-07 11:33:23.008512] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.693 [2024-10-07 11:33:23.008533] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.693 [2024-10-07 11:33:23.008584] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.693 [2024-10-07 11:33:23.008608] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.693 [2024-10-07 11:33:23.008623] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.693 [2024-10-07 11:33:23.008707] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.693 [2024-10-07 11:33:23.008735] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.693 [2024-10-07 11:33:23.008756] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.693 [2024-10-07 11:33:23.008771] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.693 [2024-10-07 11:33:23.008784] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.693 [2024-10-07 11:33:23.008801] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.693 [2024-10-07 11:33:23.008815] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.693 [2024-10-07 11:33:23.008828] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.693 [2024-10-07 11:33:23.008869] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.693 [2024-10-07 11:33:23.008901] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.693 [2024-10-07 11:33:23.019382] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.693 [2024-10-07 11:33:23.019430] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.693 [2024-10-07 11:33:23.019618] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.693 [2024-10-07 11:33:23.019664] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.693 [2024-10-07 11:33:23.019685] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.693 [2024-10-07 11:33:23.019736] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.693 [2024-10-07 11:33:23.019760] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.693 [2024-10-07 11:33:23.019775] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.693 [2024-10-07 11:33:23.019931] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.693 [2024-10-07 11:33:23.019964] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.693 [2024-10-07 11:33:23.021255] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.693 [2024-10-07 11:33:23.021292] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.693 [2024-10-07 11:33:23.021326] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.693 [2024-10-07 11:33:23.021343] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.693 [2024-10-07 11:33:23.021356] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.693 [2024-10-07 11:33:23.021369] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.693 [2024-10-07 11:33:23.022209] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.693 [2024-10-07 11:33:23.022244] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.693 [2024-10-07 11:33:23.030372] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.693 [2024-10-07 11:33:23.030976] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.693 [2024-10-07 11:33:23.031084] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.693 [2024-10-07 11:33:23.031114] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.693 [2024-10-07 11:33:23.031131] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.693 [2024-10-07 11:33:23.031442] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.693 [2024-10-07 11:33:23.031488] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.693 [2024-10-07 11:33:23.031519] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.693 [2024-10-07 11:33:23.031553] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.693 [2024-10-07 11:33:23.031638] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.693 [2024-10-07 11:33:23.031683] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.693 [2024-10-07 11:33:23.031715] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.693 [2024-10-07 11:33:23.031730] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.693 [2024-10-07 11:33:23.031758] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.693 [2024-10-07 11:33:23.031774] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.693 [2024-10-07 11:33:23.031787] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.693 [2024-10-07 11:33:23.031800] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.693 [2024-10-07 11:33:23.031820] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.693 [2024-10-07 11:33:23.044380] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.693 [2024-10-07 11:33:23.044436] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.693 [2024-10-07 11:33:23.044898] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.693 [2024-10-07 11:33:23.044943] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.693 [2024-10-07 11:33:23.044964] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.693 [2024-10-07 11:33:23.045026] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.693 [2024-10-07 11:33:23.045057] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.693 [2024-10-07 11:33:23.045074] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.693 [2024-10-07 11:33:23.045307] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.693 [2024-10-07 11:33:23.045340] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.693 [2024-10-07 11:33:23.045397] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.693 [2024-10-07 11:33:23.045419] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.693 [2024-10-07 11:33:23.045434] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.693 [2024-10-07 11:33:23.045452] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.693 [2024-10-07 11:33:23.045466] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.693 [2024-10-07 11:33:23.045479] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.693 [2024-10-07 11:33:23.045668] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.693 [2024-10-07 11:33:23.045693] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.693 [2024-10-07 11:33:23.058042] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.693 [2024-10-07 11:33:23.058100] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.693 [2024-10-07 11:33:23.058910] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.693 [2024-10-07 11:33:23.058956] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.693 [2024-10-07 11:33:23.058977] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.693 [2024-10-07 11:33:23.059030] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.693 [2024-10-07 11:33:23.059071] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.693 [2024-10-07 11:33:23.059088] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.693 [2024-10-07 11:33:23.059278] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.693 [2024-10-07 11:33:23.059309] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.693 [2024-10-07 11:33:23.059409] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.693 [2024-10-07 11:33:23.059428] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.693 [2024-10-07 11:33:23.059443] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.693 [2024-10-07 11:33:23.059460] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.693 [2024-10-07 11:33:23.059475] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.693 [2024-10-07 11:33:23.059489] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.693 [2024-10-07 11:33:23.059981] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.693 [2024-10-07 11:33:23.060019] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.694 [2024-10-07 11:33:23.069099] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.694 [2024-10-07 11:33:23.069150] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.694 [2024-10-07 11:33:23.069334] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.694 [2024-10-07 11:33:23.069365] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.694 [2024-10-07 11:33:23.069383] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.694 [2024-10-07 11:33:23.069432] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.694 [2024-10-07 11:33:23.069471] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.694 [2024-10-07 11:33:23.069487] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.694 [2024-10-07 11:33:23.069591] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.694 [2024-10-07 11:33:23.069616] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.694 [2024-10-07 11:33:23.069854] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.694 [2024-10-07 11:33:23.069881] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.694 [2024-10-07 11:33:23.069896] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.694 [2024-10-07 11:33:23.069913] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.694 [2024-10-07 11:33:23.069928] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.694 [2024-10-07 11:33:23.069942] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.694 [2024-10-07 11:33:23.071826] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.694 [2024-10-07 11:33:23.071865] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.694 [2024-10-07 11:33:23.083279] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.694 [2024-10-07 11:33:23.083330] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.694 [2024-10-07 11:33:23.083501] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.694 [2024-10-07 11:33:23.083533] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.694 [2024-10-07 11:33:23.083551] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.694 [2024-10-07 11:33:23.083600] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.694 [2024-10-07 11:33:23.083623] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.694 [2024-10-07 11:33:23.083638] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.694 [2024-10-07 11:33:23.084883] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.694 [2024-10-07 11:33:23.084927] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.694 [2024-10-07 11:33:23.086789] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.694 [2024-10-07 11:33:23.086828] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.694 [2024-10-07 11:33:23.086847] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.694 [2024-10-07 11:33:23.086865] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.694 [2024-10-07 11:33:23.086880] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.694 [2024-10-07 11:33:23.086892] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.694 [2024-10-07 11:33:23.087536] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.694 [2024-10-07 11:33:23.087572] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.694 [2024-10-07 11:33:23.094501] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.694 [2024-10-07 11:33:23.094548] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.694 [2024-10-07 11:33:23.094759] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.694 [2024-10-07 11:33:23.094791] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.694 [2024-10-07 11:33:23.094808] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.694 [2024-10-07 11:33:23.094857] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.694 [2024-10-07 11:33:23.094880] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.694 [2024-10-07 11:33:23.094896] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.694 [2024-10-07 11:33:23.095048] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.694 [2024-10-07 11:33:23.095077] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.694 [2024-10-07 11:33:23.095240] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.694 [2024-10-07 11:33:23.095266] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.694 [2024-10-07 11:33:23.095297] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.694 [2024-10-07 11:33:23.095315] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.694 [2024-10-07 11:33:23.095330] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.694 [2024-10-07 11:33:23.095343] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.694 [2024-10-07 11:33:23.095459] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.694 [2024-10-07 11:33:23.095481] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.694 [2024-10-07 11:33:23.105459] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.694 [2024-10-07 11:33:23.105512] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.694 [2024-10-07 11:33:23.105866] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.694 [2024-10-07 11:33:23.105937] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.694 [2024-10-07 11:33:23.105983] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.694 [2024-10-07 11:33:23.106079] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.694 [2024-10-07 11:33:23.106118] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.694 [2024-10-07 11:33:23.106146] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.694 [2024-10-07 11:33:23.106303] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.694 [2024-10-07 11:33:23.106344] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.694 [2024-10-07 11:33:23.106510] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.694 [2024-10-07 11:33:23.106565] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.694 [2024-10-07 11:33:23.106595] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.694 [2024-10-07 11:33:23.106627] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.694 [2024-10-07 11:33:23.106710] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.694 [2024-10-07 11:33:23.106738] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.694 [2024-10-07 11:33:23.106908] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.694 [2024-10-07 11:33:23.106937] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.694 [2024-10-07 11:33:23.115893] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.694 [2024-10-07 11:33:23.115947] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.694 [2024-10-07 11:33:23.116131] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.694 [2024-10-07 11:33:23.116165] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.694 [2024-10-07 11:33:23.116182] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.694 [2024-10-07 11:33:23.116231] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.694 [2024-10-07 11:33:23.116255] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.694 [2024-10-07 11:33:23.116287] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.694 [2024-10-07 11:33:23.116394] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.694 [2024-10-07 11:33:23.116421] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.694 [2024-10-07 11:33:23.116487] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.694 [2024-10-07 11:33:23.116507] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.694 [2024-10-07 11:33:23.116521] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.694 [2024-10-07 11:33:23.116538] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.694 [2024-10-07 11:33:23.116553] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.694 [2024-10-07 11:33:23.116566] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.694 [2024-10-07 11:33:23.116590] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.694 [2024-10-07 11:33:23.116604] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.694 [2024-10-07 11:33:23.126439] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.694 [2024-10-07 11:33:23.126491] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.694 [2024-10-07 11:33:23.126582] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.694 [2024-10-07 11:33:23.126612] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.694 [2024-10-07 11:33:23.126628] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.694 [2024-10-07 11:33:23.126694] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.694 [2024-10-07 11:33:23.126719] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.694 [2024-10-07 11:33:23.126735] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.695 [2024-10-07 11:33:23.126759] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.695 [2024-10-07 11:33:23.126780] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.695 [2024-10-07 11:33:23.126800] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.695 [2024-10-07 11:33:23.126814] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.695 [2024-10-07 11:33:23.126827] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.695 [2024-10-07 11:33:23.126843] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.695 [2024-10-07 11:33:23.126858] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.695 [2024-10-07 11:33:23.126871] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.695 [2024-10-07 11:33:23.126893] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.695 [2024-10-07 11:33:23.126908] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.695 [2024-10-07 11:33:23.136881] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.695 [2024-10-07 11:33:23.136953] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.695 [2024-10-07 11:33:23.137043] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.695 [2024-10-07 11:33:23.137074] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.695 [2024-10-07 11:33:23.137090] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.695 [2024-10-07 11:33:23.137138] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.695 [2024-10-07 11:33:23.137162] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.695 [2024-10-07 11:33:23.137177] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.695 [2024-10-07 11:33:23.137356] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.695 [2024-10-07 11:33:23.137387] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.695 [2024-10-07 11:33:23.137441] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.695 [2024-10-07 11:33:23.137463] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.695 [2024-10-07 11:33:23.137477] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.695 [2024-10-07 11:33:23.137494] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.695 [2024-10-07 11:33:23.137508] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.695 [2024-10-07 11:33:23.137521] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.695 [2024-10-07 11:33:23.137544] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.695 [2024-10-07 11:33:23.137558] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.695 [2024-10-07 11:33:23.148982] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.695 [2024-10-07 11:33:23.149031] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.695 [2024-10-07 11:33:23.149226] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.695 [2024-10-07 11:33:23.149264] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.695 [2024-10-07 11:33:23.149295] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.695 [2024-10-07 11:33:23.149386] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.695 [2024-10-07 11:33:23.149432] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.695 [2024-10-07 11:33:23.149465] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.695 [2024-10-07 11:33:23.149520] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.695 [2024-10-07 11:33:23.149545] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.695 [2024-10-07 11:33:23.149574] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.695 [2024-10-07 11:33:23.149604] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.695 [2024-10-07 11:33:23.149634] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.695 [2024-10-07 11:33:23.149708] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.695 [2024-10-07 11:33:23.149741] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.695 [2024-10-07 11:33:23.149769] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.695 [2024-10-07 11:33:23.149814] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.695 [2024-10-07 11:33:23.149843] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.695 [2024-10-07 11:33:23.163456] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.695 [2024-10-07 11:33:23.163510] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.695 [2024-10-07 11:33:23.163605] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.695 [2024-10-07 11:33:23.163636] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.695 [2024-10-07 11:33:23.163671] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.695 [2024-10-07 11:33:23.163725] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.695 [2024-10-07 11:33:23.163750] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.695 [2024-10-07 11:33:23.163765] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.695 [2024-10-07 11:33:23.163789] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.695 [2024-10-07 11:33:23.163809] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.695 [2024-10-07 11:33:23.163829] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.695 [2024-10-07 11:33:23.163843] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.695 [2024-10-07 11:33:23.163857] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.695 [2024-10-07 11:33:23.163873] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.695 [2024-10-07 11:33:23.163887] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.695 [2024-10-07 11:33:23.163900] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.695 [2024-10-07 11:33:23.163923] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.695 [2024-10-07 11:33:23.163938] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.695 [2024-10-07 11:33:23.175952] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.695 [2024-10-07 11:33:23.176005] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.695 [2024-10-07 11:33:23.176112] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.695 [2024-10-07 11:33:23.176141] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.695 [2024-10-07 11:33:23.176158] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.695 [2024-10-07 11:33:23.176205] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.695 [2024-10-07 11:33:23.176229] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.695 [2024-10-07 11:33:23.176244] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.695 [2024-10-07 11:33:23.176296] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.695 [2024-10-07 11:33:23.176317] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.695 [2024-10-07 11:33:23.176337] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.695 [2024-10-07 11:33:23.176352] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.695 [2024-10-07 11:33:23.176366] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.695 [2024-10-07 11:33:23.176383] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.695 [2024-10-07 11:33:23.176397] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.695 [2024-10-07 11:33:23.176410] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.695 [2024-10-07 11:33:23.176433] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.695 [2024-10-07 11:33:23.176447] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.695 [2024-10-07 11:33:23.186453] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.695 [2024-10-07 11:33:23.186503] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.695 [2024-10-07 11:33:23.186689] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.695 [2024-10-07 11:33:23.186723] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.695 [2024-10-07 11:33:23.186741] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.696 [2024-10-07 11:33:23.186791] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.696 [2024-10-07 11:33:23.186815] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.696 [2024-10-07 11:33:23.186830] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.696 [2024-10-07 11:33:23.186876] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.696 [2024-10-07 11:33:23.186903] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.696 [2024-10-07 11:33:23.186924] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.696 [2024-10-07 11:33:23.186939] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.696 [2024-10-07 11:33:23.186952] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.696 [2024-10-07 11:33:23.186969] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.696 [2024-10-07 11:33:23.186983] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.696 [2024-10-07 11:33:23.186997] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.696 [2024-10-07 11:33:23.187020] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.696 [2024-10-07 11:33:23.187034] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.696 [2024-10-07 11:33:23.200421] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.696 [2024-10-07 11:33:23.200470] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.696 [2024-10-07 11:33:23.201105] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.696 [2024-10-07 11:33:23.201179] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.696 [2024-10-07 11:33:23.201200] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.696 [2024-10-07 11:33:23.201252] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.696 [2024-10-07 11:33:23.201277] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.696 [2024-10-07 11:33:23.201291] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.696 [2024-10-07 11:33:23.201370] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.696 [2024-10-07 11:33:23.201397] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.696 [2024-10-07 11:33:23.201418] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.696 [2024-10-07 11:33:23.201432] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.696 [2024-10-07 11:33:23.201446] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.696 [2024-10-07 11:33:23.201463] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.696 [2024-10-07 11:33:23.201477] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.696 [2024-10-07 11:33:23.201490] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.696 [2024-10-07 11:33:23.201513] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.696 [2024-10-07 11:33:23.201527] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.696 [2024-10-07 11:33:23.215462] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.696 [2024-10-07 11:33:23.215525] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.696 [2024-10-07 11:33:23.215617] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.696 [2024-10-07 11:33:23.215662] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.696 [2024-10-07 11:33:23.215682] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.696 [2024-10-07 11:33:23.215732] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.696 [2024-10-07 11:33:23.215756] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.696 [2024-10-07 11:33:23.215771] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.696 [2024-10-07 11:33:23.216162] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.696 [2024-10-07 11:33:23.216194] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.696 [2024-10-07 11:33:23.216331] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.696 [2024-10-07 11:33:23.216366] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.696 [2024-10-07 11:33:23.216384] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.696 [2024-10-07 11:33:23.216401] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.696 [2024-10-07 11:33:23.216431] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.696 [2024-10-07 11:33:23.216445] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.696 [2024-10-07 11:33:23.216472] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.696 [2024-10-07 11:33:23.216487] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.696 [2024-10-07 11:33:23.229919] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.696 [2024-10-07 11:33:23.229968] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.696 [2024-10-07 11:33:23.230500] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.696 [2024-10-07 11:33:23.230545] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.696 [2024-10-07 11:33:23.230565] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.696 [2024-10-07 11:33:23.230616] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.696 [2024-10-07 11:33:23.230641] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.696 [2024-10-07 11:33:23.230673] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.696 [2024-10-07 11:33:23.231019] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.696 [2024-10-07 11:33:23.231062] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.696 [2024-10-07 11:33:23.231660] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.696 [2024-10-07 11:33:23.231696] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.696 [2024-10-07 11:33:23.231713] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.696 [2024-10-07 11:33:23.231731] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.696 [2024-10-07 11:33:23.231745] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.696 [2024-10-07 11:33:23.231758] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.696 [2024-10-07 11:33:23.232122] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.696 [2024-10-07 11:33:23.232148] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.696 [2024-10-07 11:33:23.243443] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.696 [2024-10-07 11:33:23.243492] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.696 [2024-10-07 11:33:23.243852] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.696 [2024-10-07 11:33:23.243895] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.696 [2024-10-07 11:33:23.243915] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.696 [2024-10-07 11:33:23.243966] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.696 [2024-10-07 11:33:23.243989] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.696 [2024-10-07 11:33:23.244004] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.696 [2024-10-07 11:33:23.244280] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.696 [2024-10-07 11:33:23.244323] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.696 [2024-10-07 11:33:23.244381] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.696 [2024-10-07 11:33:23.244404] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.696 [2024-10-07 11:33:23.244419] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.696 [2024-10-07 11:33:23.244436] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.696 [2024-10-07 11:33:23.244451] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.696 [2024-10-07 11:33:23.244463] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.696 [2024-10-07 11:33:23.244486] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.696 [2024-10-07 11:33:23.244501] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.696 [2024-10-07 11:33:23.253829] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.696 [2024-10-07 11:33:23.253876] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.696 [2024-10-07 11:33:23.255082] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.696 [2024-10-07 11:33:23.255126] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.696 [2024-10-07 11:33:23.255146] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.696 [2024-10-07 11:33:23.255209] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.696 [2024-10-07 11:33:23.255235] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.696 [2024-10-07 11:33:23.255250] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.696 [2024-10-07 11:33:23.256776] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.696 [2024-10-07 11:33:23.256821] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.696 [2024-10-07 11:33:23.257324] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.697 [2024-10-07 11:33:23.257362] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.697 [2024-10-07 11:33:23.257379] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.697 [2024-10-07 11:33:23.257397] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.697 [2024-10-07 11:33:23.257413] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.697 [2024-10-07 11:33:23.257426] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.697 [2024-10-07 11:33:23.257743] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.697 [2024-10-07 11:33:23.257770] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.697 [2024-10-07 11:33:23.267838] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.697 [2024-10-07 11:33:23.267883] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.697 [2024-10-07 11:33:23.268197] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.697 [2024-10-07 11:33:23.268256] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.697 [2024-10-07 11:33:23.268278] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.697 [2024-10-07 11:33:23.268331] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.697 [2024-10-07 11:33:23.268354] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.697 [2024-10-07 11:33:23.268369] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.697 [2024-10-07 11:33:23.268496] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.697 [2024-10-07 11:33:23.268523] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.697 [2024-10-07 11:33:23.268615] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.697 [2024-10-07 11:33:23.268633] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.697 [2024-10-07 11:33:23.268647] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.697 [2024-10-07 11:33:23.268693] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.697 [2024-10-07 11:33:23.268711] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.697 [2024-10-07 11:33:23.268724] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.697 [2024-10-07 11:33:23.269660] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.697 [2024-10-07 11:33:23.269720] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.697 [2024-10-07 11:33:23.278336] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.697 [2024-10-07 11:33:23.278384] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.697 [2024-10-07 11:33:23.278636] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.697 [2024-10-07 11:33:23.278668] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.697 [2024-10-07 11:33:23.278685] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.697 [2024-10-07 11:33:23.278753] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.697 [2024-10-07 11:33:23.278777] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.697 [2024-10-07 11:33:23.278792] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.697 [2024-10-07 11:33:23.278896] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.697 [2024-10-07 11:33:23.278936] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.697 [2024-10-07 11:33:23.279030] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.697 [2024-10-07 11:33:23.279048] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.697 [2024-10-07 11:33:23.279062] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.697 [2024-10-07 11:33:23.279078] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.697 [2024-10-07 11:33:23.279093] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.697 [2024-10-07 11:33:23.279120] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.697 [2024-10-07 11:33:23.279313] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.697 [2024-10-07 11:33:23.279339] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.697 [2024-10-07 11:33:23.291487] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.697 [2024-10-07 11:33:23.291551] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.697 [2024-10-07 11:33:23.291926] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.697 [2024-10-07 11:33:23.291967] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.697 [2024-10-07 11:33:23.291986] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.697 [2024-10-07 11:33:23.292052] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.697 [2024-10-07 11:33:23.292076] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.697 [2024-10-07 11:33:23.292091] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.697 [2024-10-07 11:33:23.292145] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.697 [2024-10-07 11:33:23.292170] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.697 [2024-10-07 11:33:23.292190] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.697 [2024-10-07 11:33:23.292204] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.697 [2024-10-07 11:33:23.292217] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.697 [2024-10-07 11:33:23.292233] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.697 [2024-10-07 11:33:23.292247] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.697 [2024-10-07 11:33:23.292259] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.697 [2024-10-07 11:33:23.292281] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.697 [2024-10-07 11:33:23.292295] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.697 [2024-10-07 11:33:23.305669] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.697 [2024-10-07 11:33:23.305746] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.697 [2024-10-07 11:33:23.306515] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.697 [2024-10-07 11:33:23.306559] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.697 [2024-10-07 11:33:23.306580] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.697 [2024-10-07 11:33:23.306631] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.697 [2024-10-07 11:33:23.306670] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.697 [2024-10-07 11:33:23.306688] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.697 [2024-10-07 11:33:23.307121] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.697 [2024-10-07 11:33:23.307179] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.697 [2024-10-07 11:33:23.307432] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.697 [2024-10-07 11:33:23.307469] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.697 [2024-10-07 11:33:23.307487] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.697 [2024-10-07 11:33:23.307504] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.697 [2024-10-07 11:33:23.307519] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.697 [2024-10-07 11:33:23.307547] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.697 [2024-10-07 11:33:23.307618] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.697 [2024-10-07 11:33:23.307639] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.697 [2024-10-07 11:33:23.316901] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.697 [2024-10-07 11:33:23.316948] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.697 [2024-10-07 11:33:23.317148] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.697 [2024-10-07 11:33:23.317180] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.697 [2024-10-07 11:33:23.317197] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.697 [2024-10-07 11:33:23.317246] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.697 [2024-10-07 11:33:23.317269] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.697 [2024-10-07 11:33:23.317285] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.697 [2024-10-07 11:33:23.317401] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.697 [2024-10-07 11:33:23.317425] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.697 [2024-10-07 11:33:23.318185] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.697 [2024-10-07 11:33:23.318221] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.697 [2024-10-07 11:33:23.318254] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.697 [2024-10-07 11:33:23.318271] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.697 [2024-10-07 11:33:23.318285] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.697 [2024-10-07 11:33:23.318297] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.697 [2024-10-07 11:33:23.321063] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.697 [2024-10-07 11:33:23.321101] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.698 [2024-10-07 11:33:23.327026] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.698 [2024-10-07 11:33:23.329321] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.698 [2024-10-07 11:33:23.329449] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.698 [2024-10-07 11:33:23.329479] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.698 [2024-10-07 11:33:23.329510] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.698 [2024-10-07 11:33:23.330267] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.698 [2024-10-07 11:33:23.330323] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.698 [2024-10-07 11:33:23.330342] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.698 [2024-10-07 11:33:23.330361] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.698 [2024-10-07 11:33:23.330693] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.698 [2024-10-07 11:33:23.330724] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.698 [2024-10-07 11:33:23.330739] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.698 [2024-10-07 11:33:23.330753] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.698 [2024-10-07 11:33:23.330915] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.698 [2024-10-07 11:33:23.330940] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.698 [2024-10-07 11:33:23.330954] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.698 [2024-10-07 11:33:23.330968] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.698 [2024-10-07 11:33:23.331091] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.698 [2024-10-07 11:33:23.337119] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.698 [2024-10-07 11:33:23.337249] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.698 [2024-10-07 11:33:23.337280] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.698 [2024-10-07 11:33:23.337296] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.698 [2024-10-07 11:33:23.337320] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.698 [2024-10-07 11:33:23.337342] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.698 [2024-10-07 11:33:23.337356] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.698 [2024-10-07 11:33:23.337370] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.698 [2024-10-07 11:33:23.337422] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.698 [2024-10-07 11:33:23.340919] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.698 [2024-10-07 11:33:23.341159] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.698 [2024-10-07 11:33:23.341197] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.698 [2024-10-07 11:33:23.341216] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.698 [2024-10-07 11:33:23.341345] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.698 [2024-10-07 11:33:23.341489] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.698 [2024-10-07 11:33:23.341511] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.698 [2024-10-07 11:33:23.341541] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.698 [2024-10-07 11:33:23.342661] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.698 [2024-10-07 11:33:23.349703] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.698 [2024-10-07 11:33:23.350071] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.698 [2024-10-07 11:33:23.350116] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.698 [2024-10-07 11:33:23.350137] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.698 [2024-10-07 11:33:23.350198] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.698 [2024-10-07 11:33:23.350228] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.698 [2024-10-07 11:33:23.350243] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.698 [2024-10-07 11:33:23.350257] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.698 [2024-10-07 11:33:23.350281] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.698 [2024-10-07 11:33:23.351494] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.698 [2024-10-07 11:33:23.351598] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.698 [2024-10-07 11:33:23.351627] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.698 [2024-10-07 11:33:23.351643] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.698 [2024-10-07 11:33:23.351694] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.698 [2024-10-07 11:33:23.351718] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.698 [2024-10-07 11:33:23.351733] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.698 [2024-10-07 11:33:23.351747] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.698 [2024-10-07 11:33:23.351770] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.698 [2024-10-07 11:33:23.361107] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.698 [2024-10-07 11:33:23.362313] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.698 [2024-10-07 11:33:23.362347] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.698 [2024-10-07 11:33:23.362365] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.698 [2024-10-07 11:33:23.363998] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.698 [2024-10-07 11:33:23.364312] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.698 [2024-10-07 11:33:23.364369] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.698 [2024-10-07 11:33:23.364388] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.698 [2024-10-07 11:33:23.364402] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.698 [2024-10-07 11:33:23.364459] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.698 [2024-10-07 11:33:23.364539] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.698 [2024-10-07 11:33:23.364566] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.698 [2024-10-07 11:33:23.364583] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.698 [2024-10-07 11:33:23.364607] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.698 [2024-10-07 11:33:23.364630] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.698 [2024-10-07 11:33:23.364644] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.698 [2024-10-07 11:33:23.364675] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.698 [2024-10-07 11:33:23.364700] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.698 [2024-10-07 11:33:23.371178] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.698 [2024-10-07 11:33:23.371312] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.698 [2024-10-07 11:33:23.371343] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.698 [2024-10-07 11:33:23.371359] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.698 [2024-10-07 11:33:23.371383] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.698 [2024-10-07 11:33:23.371406] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.698 [2024-10-07 11:33:23.371420] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.698 [2024-10-07 11:33:23.371434] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.698 [2024-10-07 11:33:23.371457] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.698 [2024-10-07 11:33:23.375125] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.698 [2024-10-07 11:33:23.376328] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.698 [2024-10-07 11:33:23.376387] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.698 [2024-10-07 11:33:23.376407] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.698 [2024-10-07 11:33:23.376609] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.698 [2024-10-07 11:33:23.376813] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.698 [2024-10-07 11:33:23.376840] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.698 [2024-10-07 11:33:23.376855] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.698 [2024-10-07 11:33:23.376911] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.698 [2024-10-07 11:33:23.381905] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.698 [2024-10-07 11:33:23.382084] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.698 [2024-10-07 11:33:23.382114] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.698 [2024-10-07 11:33:23.382129] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.698 [2024-10-07 11:33:23.382152] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.698 [2024-10-07 11:33:23.382188] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.698 [2024-10-07 11:33:23.382203] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.698 [2024-10-07 11:33:23.382215] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.699 [2024-10-07 11:33:23.382238] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.699 [2024-10-07 11:33:23.385223] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.699 [2024-10-07 11:33:23.385340] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.699 [2024-10-07 11:33:23.385369] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.699 [2024-10-07 11:33:23.385385] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.699 [2024-10-07 11:33:23.386138] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.699 [2024-10-07 11:33:23.386528] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.699 [2024-10-07 11:33:23.386567] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.699 [2024-10-07 11:33:23.386585] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.699 [2024-10-07 11:33:23.386754] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.699 [2024-10-07 11:33:23.392973] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.699 [2024-10-07 11:33:23.393095] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.699 [2024-10-07 11:33:23.393125] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.699 [2024-10-07 11:33:23.393142] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.699 [2024-10-07 11:33:23.393166] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.699 [2024-10-07 11:33:23.393188] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.699 [2024-10-07 11:33:23.393202] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.699 [2024-10-07 11:33:23.393216] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.699 [2024-10-07 11:33:23.393239] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.699 [2024-10-07 11:33:23.395779] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.699 [2024-10-07 11:33:23.395908] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.699 [2024-10-07 11:33:23.395938] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.699 [2024-10-07 11:33:23.395955] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.699 [2024-10-07 11:33:23.395994] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.699 [2024-10-07 11:33:23.396016] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.699 [2024-10-07 11:33:23.396031] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.699 [2024-10-07 11:33:23.396045] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.699 [2024-10-07 11:33:23.396083] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.699 [2024-10-07 11:33:23.405636] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.699 [2024-10-07 11:33:23.405815] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.699 [2024-10-07 11:33:23.405847] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.699 [2024-10-07 11:33:23.405864] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.699 [2024-10-07 11:33:23.406514] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.699 [2024-10-07 11:33:23.407522] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.699 [2024-10-07 11:33:23.407560] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.699 [2024-10-07 11:33:23.407577] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.699 [2024-10-07 11:33:23.407996] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.699 [2024-10-07 11:33:23.408038] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.699 [2024-10-07 11:33:23.408327] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.699 [2024-10-07 11:33:23.408369] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.699 [2024-10-07 11:33:23.408388] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.699 [2024-10-07 11:33:23.408441] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.699 [2024-10-07 11:33:23.408469] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.699 [2024-10-07 11:33:23.408484] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.699 [2024-10-07 11:33:23.408497] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.699 [2024-10-07 11:33:23.408520] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.699 [2024-10-07 11:33:23.420954] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.699 [2024-10-07 11:33:23.420999] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.699 [2024-10-07 11:33:23.421159] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.699 [2024-10-07 11:33:23.421189] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.699 [2024-10-07 11:33:23.421206] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.699 [2024-10-07 11:33:23.421254] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.699 [2024-10-07 11:33:23.421277] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.699 [2024-10-07 11:33:23.421292] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.699 [2024-10-07 11:33:23.421326] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.699 [2024-10-07 11:33:23.421348] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.699 [2024-10-07 11:33:23.421367] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.699 [2024-10-07 11:33:23.421395] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.699 [2024-10-07 11:33:23.421410] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.699 [2024-10-07 11:33:23.421440] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.699 [2024-10-07 11:33:23.421455] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.699 [2024-10-07 11:33:23.421467] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.699 [2024-10-07 11:33:23.421623] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.699 [2024-10-07 11:33:23.421648] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.699 [2024-10-07 11:33:23.431402] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.699 [2024-10-07 11:33:23.431450] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.699 [2024-10-07 11:33:23.431551] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.699 [2024-10-07 11:33:23.431580] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.699 [2024-10-07 11:33:23.431596] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.699 [2024-10-07 11:33:23.431642] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.699 [2024-10-07 11:33:23.431690] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.699 [2024-10-07 11:33:23.431723] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.699 [2024-10-07 11:33:23.431747] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.699 [2024-10-07 11:33:23.431766] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.699 [2024-10-07 11:33:23.431785] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.699 [2024-10-07 11:33:23.431799] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.699 [2024-10-07 11:33:23.431812] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.699 [2024-10-07 11:33:23.431827] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.699 [2024-10-07 11:33:23.431841] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.699 [2024-10-07 11:33:23.431854] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.699 [2024-10-07 11:33:23.431875] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.699 [2024-10-07 11:33:23.431889] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.699 [2024-10-07 11:33:23.442028] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.699 [2024-10-07 11:33:23.442078] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.699 [2024-10-07 11:33:23.442192] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.699 [2024-10-07 11:33:23.442223] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.699 [2024-10-07 11:33:23.442240] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.699 [2024-10-07 11:33:23.442307] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.699 [2024-10-07 11:33:23.442332] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.699 [2024-10-07 11:33:23.442348] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.699 [2024-10-07 11:33:23.442372] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.699 [2024-10-07 11:33:23.442392] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.699 [2024-10-07 11:33:23.442412] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.699 [2024-10-07 11:33:23.442426] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.699 [2024-10-07 11:33:23.442441] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.699 [2024-10-07 11:33:23.442458] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.700 [2024-10-07 11:33:23.442473] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.700 [2024-10-07 11:33:23.442485] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.700 [2024-10-07 11:33:23.442509] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.700 [2024-10-07 11:33:23.442523] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.700 [2024-10-07 11:33:23.452925] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.700 [2024-10-07 11:33:23.452983] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.700 [2024-10-07 11:33:23.453141] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.700 [2024-10-07 11:33:23.453200] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.700 [2024-10-07 11:33:23.453224] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.700 [2024-10-07 11:33:23.453282] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.700 [2024-10-07 11:33:23.453307] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.700 [2024-10-07 11:33:23.453323] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.700 [2024-10-07 11:33:23.453365] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.700 [2024-10-07 11:33:23.453391] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.700 [2024-10-07 11:33:23.453411] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.700 [2024-10-07 11:33:23.453426] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.700 [2024-10-07 11:33:23.453451] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.700 [2024-10-07 11:33:23.453468] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.700 [2024-10-07 11:33:23.453482] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.700 [2024-10-07 11:33:23.453495] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.700 [2024-10-07 11:33:23.453518] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.700 [2024-10-07 11:33:23.453533] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.700 [2024-10-07 11:33:23.466226] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.700 [2024-10-07 11:33:23.466281] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.700 [2024-10-07 11:33:23.466526] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.700 [2024-10-07 11:33:23.466570] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.700 [2024-10-07 11:33:23.466591] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.700 [2024-10-07 11:33:23.466643] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.700 [2024-10-07 11:33:23.466682] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.700 [2024-10-07 11:33:23.466698] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.700 [2024-10-07 11:33:23.467312] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.700 [2024-10-07 11:33:23.467367] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.700 [2024-10-07 11:33:23.468299] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.700 [2024-10-07 11:33:23.468352] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.700 [2024-10-07 11:33:23.468376] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.700 [2024-10-07 11:33:23.468399] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.700 [2024-10-07 11:33:23.468419] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.700 [2024-10-07 11:33:23.468437] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.700 [2024-10-07 11:33:23.469157] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.700 [2024-10-07 11:33:23.469197] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.700 [2024-10-07 11:33:23.476775] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.700 [2024-10-07 11:33:23.476827] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.700 [2024-10-07 11:33:23.477013] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.700 [2024-10-07 11:33:23.477060] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.700 [2024-10-07 11:33:23.477081] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.700 [2024-10-07 11:33:23.477135] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.700 [2024-10-07 11:33:23.477159] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.700 [2024-10-07 11:33:23.477174] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.700 [2024-10-07 11:33:23.477289] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.700 [2024-10-07 11:33:23.477317] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.700 [2024-10-07 11:33:23.477913] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.700 [2024-10-07 11:33:23.477959] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.700 [2024-10-07 11:33:23.478000] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.700 [2024-10-07 11:33:23.478033] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.700 [2024-10-07 11:33:23.478053] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.700 [2024-10-07 11:33:23.478070] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.700 [2024-10-07 11:33:23.480370] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.700 [2024-10-07 11:33:23.480410] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.700 [2024-10-07 11:33:23.486899] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.700 [2024-10-07 11:33:23.487307] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.700 [2024-10-07 11:33:23.487414] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.700 [2024-10-07 11:33:23.487445] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.700 [2024-10-07 11:33:23.487461] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.700 [2024-10-07 11:33:23.487696] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.700 [2024-10-07 11:33:23.487737] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.700 [2024-10-07 11:33:23.487756] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.700 [2024-10-07 11:33:23.487776] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.700 [2024-10-07 11:33:23.487909] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.700 [2024-10-07 11:33:23.487936] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.700 [2024-10-07 11:33:23.487951] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.700 [2024-10-07 11:33:23.487965] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.700 [2024-10-07 11:33:23.488083] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.700 [2024-10-07 11:33:23.488130] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.700 [2024-10-07 11:33:23.488153] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.700 [2024-10-07 11:33:23.488176] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.700 [2024-10-07 11:33:23.488295] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.700 [2024-10-07 11:33:23.500973] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.700 [2024-10-07 11:33:23.501038] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.700 [2024-10-07 11:33:23.501874] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.700 [2024-10-07 11:33:23.501923] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.700 [2024-10-07 11:33:23.501953] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.700 [2024-10-07 11:33:23.502019] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.700 [2024-10-07 11:33:23.502049] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.700 [2024-10-07 11:33:23.502091] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.701 [2024-10-07 11:33:23.502234] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.701 [2024-10-07 11:33:23.502272] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.701 [2024-10-07 11:33:23.502313] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.701 [2024-10-07 11:33:23.502335] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.701 [2024-10-07 11:33:23.502355] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.701 [2024-10-07 11:33:23.502376] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.701 [2024-10-07 11:33:23.502396] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.701 [2024-10-07 11:33:23.502418] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.701 [2024-10-07 11:33:23.502451] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.701 [2024-10-07 11:33:23.502469] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.701 [2024-10-07 11:33:23.514325] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.701 [2024-10-07 11:33:23.514380] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.701 [2024-10-07 11:33:23.514664] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.701 [2024-10-07 11:33:23.514708] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.701 [2024-10-07 11:33:23.514753] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.701 [2024-10-07 11:33:23.514813] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.701 [2024-10-07 11:33:23.514838] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.701 [2024-10-07 11:33:23.514854] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.701 [2024-10-07 11:33:23.516037] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.701 [2024-10-07 11:33:23.516087] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.701 [2024-10-07 11:33:23.516218] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.701 [2024-10-07 11:33:23.516242] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.701 [2024-10-07 11:33:23.516257] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.701 [2024-10-07 11:33:23.516274] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.701 [2024-10-07 11:33:23.516288] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.701 [2024-10-07 11:33:23.516302] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.701 [2024-10-07 11:33:23.516326] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.701 [2024-10-07 11:33:23.516341] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.701 [2024-10-07 11:33:23.524451] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.701 [2024-10-07 11:33:23.524549] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.701 [2024-10-07 11:33:23.524643] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.701 [2024-10-07 11:33:23.524690] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.701 [2024-10-07 11:33:23.524707] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.701 [2024-10-07 11:33:23.524767] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.701 [2024-10-07 11:33:23.524793] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.701 [2024-10-07 11:33:23.524808] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.701 [2024-10-07 11:33:23.524826] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.701 [2024-10-07 11:33:23.526125] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.701 [2024-10-07 11:33:23.526169] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.701 [2024-10-07 11:33:23.526187] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.701 [2024-10-07 11:33:23.526201] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.701 [2024-10-07 11:33:23.528097] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.701 [2024-10-07 11:33:23.528146] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.701 [2024-10-07 11:33:23.528170] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.701 [2024-10-07 11:33:23.528190] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.701 [2024-10-07 11:33:23.528222] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.701 [2024-10-07 11:33:23.535944] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.701 [2024-10-07 11:33:23.536001] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.701 [2024-10-07 11:33:23.536104] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.701 [2024-10-07 11:33:23.536144] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.701 [2024-10-07 11:33:23.536161] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.701 [2024-10-07 11:33:23.536208] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.701 [2024-10-07 11:33:23.536231] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.701 [2024-10-07 11:33:23.536246] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.701 [2024-10-07 11:33:23.536280] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.701 [2024-10-07 11:33:23.536306] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.701 [2024-10-07 11:33:23.536332] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.701 [2024-10-07 11:33:23.536351] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.701 [2024-10-07 11:33:23.536370] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.701 [2024-10-07 11:33:23.536411] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.701 [2024-10-07 11:33:23.536433] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.701 [2024-10-07 11:33:23.536451] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.701 [2024-10-07 11:33:23.536480] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.701 [2024-10-07 11:33:23.536499] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.701 [2024-10-07 11:33:23.548689] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.701 [2024-10-07 11:33:23.548753] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.701 [2024-10-07 11:33:23.549453] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.701 [2024-10-07 11:33:23.549507] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.701 [2024-10-07 11:33:23.549533] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.701 [2024-10-07 11:33:23.549599] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.701 [2024-10-07 11:33:23.549632] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.701 [2024-10-07 11:33:23.549677] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.701 [2024-10-07 11:33:23.550386] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.701 [2024-10-07 11:33:23.550430] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.701 [2024-10-07 11:33:23.550527] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.701 [2024-10-07 11:33:23.550550] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.701 [2024-10-07 11:33:23.550572] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.701 [2024-10-07 11:33:23.550595] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.701 [2024-10-07 11:33:23.550614] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.701 [2024-10-07 11:33:23.550632] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.701 [2024-10-07 11:33:23.550689] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.701 [2024-10-07 11:33:23.550710] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.701 [2024-10-07 11:33:23.560273] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.701 [2024-10-07 11:33:23.560326] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.701 [2024-10-07 11:33:23.560520] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.701 [2024-10-07 11:33:23.560563] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.701 [2024-10-07 11:33:23.560583] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.701 [2024-10-07 11:33:23.560635] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.701 [2024-10-07 11:33:23.560673] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.701 [2024-10-07 11:33:23.560702] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.701 [2024-10-07 11:33:23.560829] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.701 [2024-10-07 11:33:23.560857] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.701 [2024-10-07 11:33:23.560967] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.701 [2024-10-07 11:33:23.560995] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.701 [2024-10-07 11:33:23.561014] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.701 [2024-10-07 11:33:23.561035] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.701 [2024-10-07 11:33:23.561055] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.702 [2024-10-07 11:33:23.561082] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.702 [2024-10-07 11:33:23.562834] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.702 [2024-10-07 11:33:23.562886] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.702 [2024-10-07 11:33:23.570399] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.702 [2024-10-07 11:33:23.570475] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.702 [2024-10-07 11:33:23.570576] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.702 [2024-10-07 11:33:23.570611] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.702 [2024-10-07 11:33:23.570632] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.702 [2024-10-07 11:33:23.570884] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.702 [2024-10-07 11:33:23.570928] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.702 [2024-10-07 11:33:23.570948] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.702 [2024-10-07 11:33:23.570967] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.702 [2024-10-07 11:33:23.571111] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.702 [2024-10-07 11:33:23.571153] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.702 [2024-10-07 11:33:23.571172] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.702 [2024-10-07 11:33:23.571199] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.702 [2024-10-07 11:33:23.571338] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.702 [2024-10-07 11:33:23.571361] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.702 [2024-10-07 11:33:23.571375] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.702 [2024-10-07 11:33:23.571388] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.702 [2024-10-07 11:33:23.571515] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.702 [2024-10-07 11:33:23.580614] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.702 [2024-10-07 11:33:23.580704] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.702 [2024-10-07 11:33:23.580814] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.702 [2024-10-07 11:33:23.580846] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.702 [2024-10-07 11:33:23.580862] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.702 [2024-10-07 11:33:23.580911] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.702 [2024-10-07 11:33:23.580935] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.702 [2024-10-07 11:33:23.580951] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.702 [2024-10-07 11:33:23.580975] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.702 [2024-10-07 11:33:23.580996] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.702 [2024-10-07 11:33:23.581016] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.702 [2024-10-07 11:33:23.581030] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.702 [2024-10-07 11:33:23.581044] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.702 [2024-10-07 11:33:23.581060] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.702 [2024-10-07 11:33:23.581074] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.702 [2024-10-07 11:33:23.581087] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.702 [2024-10-07 11:33:23.581109] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.702 [2024-10-07 11:33:23.581124] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.702 [2024-10-07 11:33:23.591345] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.702 [2024-10-07 11:33:23.591406] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.702 [2024-10-07 11:33:23.591642] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.702 [2024-10-07 11:33:23.591711] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.702 [2024-10-07 11:33:23.591739] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.702 [2024-10-07 11:33:23.591801] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.702 [2024-10-07 11:33:23.591826] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.702 [2024-10-07 11:33:23.591842] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.702 [2024-10-07 11:33:23.591962] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.702 [2024-10-07 11:33:23.591990] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.702 [2024-10-07 11:33:23.592097] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.702 [2024-10-07 11:33:23.592125] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.702 [2024-10-07 11:33:23.592139] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.702 [2024-10-07 11:33:23.592156] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.702 [2024-10-07 11:33:23.592189] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.702 [2024-10-07 11:33:23.592204] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.702 [2024-10-07 11:33:23.593451] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.702 [2024-10-07 11:33:23.593490] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.702 [2024-10-07 11:33:23.601995] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.702 [2024-10-07 11:33:23.602045] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.702 [2024-10-07 11:33:23.602223] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.702 [2024-10-07 11:33:23.602271] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.702 [2024-10-07 11:33:23.602291] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.702 [2024-10-07 11:33:23.602354] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.702 [2024-10-07 11:33:23.602384] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.702 [2024-10-07 11:33:23.602409] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.702 [2024-10-07 11:33:23.602547] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.702 [2024-10-07 11:33:23.602584] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.702 [2024-10-07 11:33:23.605891] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.702 [2024-10-07 11:33:23.605945] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.702 [2024-10-07 11:33:23.605969] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.702 [2024-10-07 11:33:23.605992] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.702 [2024-10-07 11:33:23.606011] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.702 [2024-10-07 11:33:23.606030] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.702 [2024-10-07 11:33:23.606258] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.702 [2024-10-07 11:33:23.606286] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.702 [2024-10-07 11:33:23.612453] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.702 [2024-10-07 11:33:23.612512] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.702 [2024-10-07 11:33:23.612669] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.702 [2024-10-07 11:33:23.612712] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.702 [2024-10-07 11:33:23.612742] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.702 [2024-10-07 11:33:23.612830] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.702 [2024-10-07 11:33:23.612868] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.702 [2024-10-07 11:33:23.612896] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.702 [2024-10-07 11:33:23.612957] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.702 [2024-10-07 11:33:23.612994] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.702 [2024-10-07 11:33:23.613029] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.702 [2024-10-07 11:33:23.613055] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.702 [2024-10-07 11:33:23.613078] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.702 [2024-10-07 11:33:23.613105] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.702 [2024-10-07 11:33:23.613129] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.702 [2024-10-07 11:33:23.613151] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.702 [2024-10-07 11:33:23.613188] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.702 [2024-10-07 11:33:23.613213] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.702 [2024-10-07 11:33:23.624807] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.702 [2024-10-07 11:33:23.624874] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.702 [2024-10-07 11:33:23.625217] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.702 [2024-10-07 11:33:23.625267] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.703 [2024-10-07 11:33:23.625300] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.703 [2024-10-07 11:33:23.625386] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.703 [2024-10-07 11:33:23.625429] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.703 [2024-10-07 11:33:23.625456] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.703 [2024-10-07 11:33:23.625523] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.703 [2024-10-07 11:33:23.625562] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.703 [2024-10-07 11:33:23.625903] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.703 [2024-10-07 11:33:23.625945] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.703 [2024-10-07 11:33:23.625975] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.703 [2024-10-07 11:33:23.626011] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.703 [2024-10-07 11:33:23.626035] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.703 [2024-10-07 11:33:23.626057] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.703 [2024-10-07 11:33:23.626263] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.703 [2024-10-07 11:33:23.626297] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.703 [2024-10-07 11:33:23.639674] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.703 [2024-10-07 11:33:23.639730] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.703 [2024-10-07 11:33:23.639962] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.703 [2024-10-07 11:33:23.640013] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.703 [2024-10-07 11:33:23.640045] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.703 [2024-10-07 11:33:23.640128] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.703 [2024-10-07 11:33:23.640165] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.703 [2024-10-07 11:33:23.640193] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.703 [2024-10-07 11:33:23.640232] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.703 [2024-10-07 11:33:23.640266] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.703 [2024-10-07 11:33:23.640318] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.703 [2024-10-07 11:33:23.640343] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.703 [2024-10-07 11:33:23.640367] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.703 [2024-10-07 11:33:23.640393] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.703 [2024-10-07 11:33:23.640418] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.703 [2024-10-07 11:33:23.640440] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.703 [2024-10-07 11:33:23.640478] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.703 [2024-10-07 11:33:23.640503] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.703 [2024-10-07 11:33:23.652759] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.703 [2024-10-07 11:33:23.652817] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.703 [2024-10-07 11:33:23.653009] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.703 [2024-10-07 11:33:23.653058] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.703 [2024-10-07 11:33:23.653090] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.703 [2024-10-07 11:33:23.653173] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.703 [2024-10-07 11:33:23.653211] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.703 [2024-10-07 11:33:23.653239] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.703 [2024-10-07 11:33:23.653280] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.703 [2024-10-07 11:33:23.653315] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.703 [2024-10-07 11:33:23.653347] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.703 [2024-10-07 11:33:23.653373] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.703 [2024-10-07 11:33:23.653402] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.703 [2024-10-07 11:33:23.653429] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.703 [2024-10-07 11:33:23.653473] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.703 [2024-10-07 11:33:23.653498] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.703 [2024-10-07 11:33:23.653537] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.703 [2024-10-07 11:33:23.653563] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.703 [2024-10-07 11:33:23.663828] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.703 [2024-10-07 11:33:23.663890] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.703 [2024-10-07 11:33:23.664015] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.703 [2024-10-07 11:33:23.664046] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.703 [2024-10-07 11:33:23.664063] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.703 [2024-10-07 11:33:23.664113] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.703 [2024-10-07 11:33:23.664137] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.703 [2024-10-07 11:33:23.664152] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.703 [2024-10-07 11:33:23.664176] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.703 [2024-10-07 11:33:23.664196] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.703 [2024-10-07 11:33:23.664216] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.703 [2024-10-07 11:33:23.664230] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.703 [2024-10-07 11:33:23.664244] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.703 [2024-10-07 11:33:23.664261] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.703 [2024-10-07 11:33:23.664275] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.703 [2024-10-07 11:33:23.664288] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.703 [2024-10-07 11:33:23.664311] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.703 [2024-10-07 11:33:23.664326] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.703 [2024-10-07 11:33:23.675011] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.703 [2024-10-07 11:33:23.675081] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.703 [2024-10-07 11:33:23.675368] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.703 [2024-10-07 11:33:23.675424] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.703 [2024-10-07 11:33:23.675457] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.703 [2024-10-07 11:33:23.675542] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.703 [2024-10-07 11:33:23.675580] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.703 [2024-10-07 11:33:23.675608] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.703 [2024-10-07 11:33:23.675792] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.703 [2024-10-07 11:33:23.675871] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.703 [2024-10-07 11:33:23.676034] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.703 [2024-10-07 11:33:23.676079] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.703 [2024-10-07 11:33:23.676108] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.703 [2024-10-07 11:33:23.676138] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.703 [2024-10-07 11:33:23.676180] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.703 [2024-10-07 11:33:23.676203] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.703 [2024-10-07 11:33:23.677243] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.703 [2024-10-07 11:33:23.677286] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.703 [2024-10-07 11:33:23.685168] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.703 [2024-10-07 11:33:23.685243] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.703 [2024-10-07 11:33:23.685356] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.703 [2024-10-07 11:33:23.685399] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.703 [2024-10-07 11:33:23.685431] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.703 [2024-10-07 11:33:23.685764] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.703 [2024-10-07 11:33:23.685812] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.703 [2024-10-07 11:33:23.685843] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.703 [2024-10-07 11:33:23.685876] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.703 [2024-10-07 11:33:23.686113] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.703 [2024-10-07 11:33:23.686158] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.703 [2024-10-07 11:33:23.686186] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.704 [2024-10-07 11:33:23.686212] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.704 [2024-10-07 11:33:23.686368] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.704 [2024-10-07 11:33:23.686410] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.704 [2024-10-07 11:33:23.686438] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.704 [2024-10-07 11:33:23.686463] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.704 [2024-10-07 11:33:23.686602] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.704 [2024-10-07 11:33:23.695852] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.704 [2024-10-07 11:33:23.695907] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.704 [2024-10-07 11:33:23.696230] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.704 [2024-10-07 11:33:23.696281] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.704 [2024-10-07 11:33:23.696337] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.704 [2024-10-07 11:33:23.696422] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.704 [2024-10-07 11:33:23.696461] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.704 [2024-10-07 11:33:23.696489] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.704 [2024-10-07 11:33:23.696690] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.704 [2024-10-07 11:33:23.696742] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.704 [2024-10-07 11:33:23.696947] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.704 [2024-10-07 11:33:23.696988] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.704 [2024-10-07 11:33:23.697017] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.704 [2024-10-07 11:33:23.697047] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.704 [2024-10-07 11:33:23.697073] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.704 [2024-10-07 11:33:23.697096] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.704 [2024-10-07 11:33:23.697179] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.704 [2024-10-07 11:33:23.697216] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.704 [2024-10-07 11:33:23.711968] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.704 [2024-10-07 11:33:23.712030] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.704 [2024-10-07 11:33:23.712298] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.704 [2024-10-07 11:33:23.712355] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.704 [2024-10-07 11:33:23.712382] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.704 [2024-10-07 11:33:23.712451] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.704 [2024-10-07 11:33:23.712483] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.704 [2024-10-07 11:33:23.712505] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.704 [2024-10-07 11:33:23.712537] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.704 [2024-10-07 11:33:23.712564] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.704 [2024-10-07 11:33:23.712596] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.704 [2024-10-07 11:33:23.712615] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.704 [2024-10-07 11:33:23.712635] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.704 [2024-10-07 11:33:23.712674] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.704 [2024-10-07 11:33:23.712697] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.704 [2024-10-07 11:33:23.712738] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.704 [2024-10-07 11:33:23.712770] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.704 [2024-10-07 11:33:23.712790] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.704 [2024-10-07 11:33:23.725916] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.704 [2024-10-07 11:33:23.725972] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.704 [2024-10-07 11:33:23.726063] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.704 [2024-10-07 11:33:23.726094] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.704 [2024-10-07 11:33:23.726111] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.704 [2024-10-07 11:33:23.726159] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.704 [2024-10-07 11:33:23.726182] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.704 [2024-10-07 11:33:23.726198] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.704 [2024-10-07 11:33:23.726221] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.704 [2024-10-07 11:33:23.726241] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.704 [2024-10-07 11:33:23.726261] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.704 [2024-10-07 11:33:23.726275] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.704 [2024-10-07 11:33:23.726289] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.704 [2024-10-07 11:33:23.726305] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.704 [2024-10-07 11:33:23.726320] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.704 [2024-10-07 11:33:23.726332] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.704 [2024-10-07 11:33:23.726355] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.704 [2024-10-07 11:33:23.726369] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.704 [2024-10-07 11:33:23.740347] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.704 [2024-10-07 11:33:23.740402] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.704 [2024-10-07 11:33:23.740674] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.704 [2024-10-07 11:33:23.740718] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.704 [2024-10-07 11:33:23.740739] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.704 [2024-10-07 11:33:23.740790] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.704 [2024-10-07 11:33:23.740814] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.704 [2024-10-07 11:33:23.740830] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.704 [2024-10-07 11:33:23.740856] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.704 [2024-10-07 11:33:23.740876] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.704 [2024-10-07 11:33:23.740915] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.704 [2024-10-07 11:33:23.740931] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.704 [2024-10-07 11:33:23.740945] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.704 [2024-10-07 11:33:23.740963] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.704 [2024-10-07 11:33:23.740977] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.704 [2024-10-07 11:33:23.740990] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.704 [2024-10-07 11:33:23.741013] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.704 [2024-10-07 11:33:23.741028] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.704 [2024-10-07 11:33:23.755579] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.704 [2024-10-07 11:33:23.755630] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.704 [2024-10-07 11:33:23.755759] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.704 [2024-10-07 11:33:23.755791] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.704 [2024-10-07 11:33:23.755808] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.705 [2024-10-07 11:33:23.755855] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.705 [2024-10-07 11:33:23.755878] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.705 [2024-10-07 11:33:23.755893] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.705 [2024-10-07 11:33:23.755917] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.705 [2024-10-07 11:33:23.755938] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.705 [2024-10-07 11:33:23.755971] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.705 [2024-10-07 11:33:23.755989] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.705 [2024-10-07 11:33:23.756002] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.705 [2024-10-07 11:33:23.756019] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.705 [2024-10-07 11:33:23.756033] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.705 [2024-10-07 11:33:23.756045] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.705 [2024-10-07 11:33:23.756068] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.705 [2024-10-07 11:33:23.756082] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.705 [2024-10-07 11:33:23.766012] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.705 [2024-10-07 11:33:23.766064] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.705 [2024-10-07 11:33:23.766272] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.705 [2024-10-07 11:33:23.766321] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.705 [2024-10-07 11:33:23.766356] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.705 [2024-10-07 11:33:23.766412] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.705 [2024-10-07 11:33:23.766437] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.705 [2024-10-07 11:33:23.766453] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.705 [2024-10-07 11:33:23.766606] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.705 [2024-10-07 11:33:23.766636] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.705 [2024-10-07 11:33:23.766779] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.705 [2024-10-07 11:33:23.766805] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.705 [2024-10-07 11:33:23.766820] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.705 [2024-10-07 11:33:23.766837] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.705 [2024-10-07 11:33:23.766851] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.705 [2024-10-07 11:33:23.766865] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.705 [2024-10-07 11:33:23.766995] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.705 [2024-10-07 11:33:23.767017] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.705 [2024-10-07 11:33:23.776127] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.705 [2024-10-07 11:33:23.776192] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.705 [2024-10-07 11:33:23.776306] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.705 [2024-10-07 11:33:23.776342] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.705 [2024-10-07 11:33:23.776364] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.705 [2024-10-07 11:33:23.776439] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.705 [2024-10-07 11:33:23.776467] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.705 [2024-10-07 11:33:23.776482] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.705 [2024-10-07 11:33:23.776500] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.705 [2024-10-07 11:33:23.776524] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.705 [2024-10-07 11:33:23.776541] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.705 [2024-10-07 11:33:23.776554] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.705 [2024-10-07 11:33:23.776568] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.705 [2024-10-07 11:33:23.776592] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.705 [2024-10-07 11:33:23.776606] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.705 [2024-10-07 11:33:23.776619] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.705 [2024-10-07 11:33:23.776665] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.705 [2024-10-07 11:33:23.776692] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.705 [2024-10-07 11:33:23.788687] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.705 [2024-10-07 11:33:23.788737] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.705 [2024-10-07 11:33:23.788858] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.705 [2024-10-07 11:33:23.788889] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.705 [2024-10-07 11:33:23.788907] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.705 [2024-10-07 11:33:23.788956] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.705 [2024-10-07 11:33:23.788979] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.705 [2024-10-07 11:33:23.788995] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.705 [2024-10-07 11:33:23.789034] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.705 [2024-10-07 11:33:23.789054] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.705 [2024-10-07 11:33:23.789074] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.705 [2024-10-07 11:33:23.789088] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.705 [2024-10-07 11:33:23.789103] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.705 [2024-10-07 11:33:23.789119] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.705 [2024-10-07 11:33:23.789134] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.705 [2024-10-07 11:33:23.789146] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.705 [2024-10-07 11:33:23.789169] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.705 [2024-10-07 11:33:23.789184] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.705 [2024-10-07 11:33:23.799956] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.705 [2024-10-07 11:33:23.800016] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.705 [2024-10-07 11:33:23.800124] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.705 [2024-10-07 11:33:23.800161] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.705 [2024-10-07 11:33:23.800187] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.705 [2024-10-07 11:33:23.800249] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.705 [2024-10-07 11:33:23.800277] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.705 [2024-10-07 11:33:23.800298] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.705 [2024-10-07 11:33:23.800328] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.705 [2024-10-07 11:33:23.800354] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.705 [2024-10-07 11:33:23.800401] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.705 [2024-10-07 11:33:23.800423] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.705 [2024-10-07 11:33:23.800442] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.705 [2024-10-07 11:33:23.800463] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.705 [2024-10-07 11:33:23.800482] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.705 [2024-10-07 11:33:23.800499] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.705 [2024-10-07 11:33:23.800528] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.705 [2024-10-07 11:33:23.800547] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.705 [2024-10-07 11:33:23.810085] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.705 [2024-10-07 11:33:23.810150] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.705 [2024-10-07 11:33:23.810240] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.705 [2024-10-07 11:33:23.810271] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.705 [2024-10-07 11:33:23.810288] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.705 [2024-10-07 11:33:23.812253] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.705 [2024-10-07 11:33:23.812301] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.705 [2024-10-07 11:33:23.812323] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.705 [2024-10-07 11:33:23.812343] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.705 [2024-10-07 11:33:23.812852] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.705 [2024-10-07 11:33:23.812894] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.705 [2024-10-07 11:33:23.812923] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.706 [2024-10-07 11:33:23.812946] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.706 [2024-10-07 11:33:23.813166] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.706 [2024-10-07 11:33:23.813202] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.706 [2024-10-07 11:33:23.813219] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.706 [2024-10-07 11:33:23.813233] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.706 [2024-10-07 11:33:23.813390] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.706 [2024-10-07 11:33:23.822043] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.706 [2024-10-07 11:33:23.822093] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.706 [2024-10-07 11:33:23.822183] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.706 [2024-10-07 11:33:23.822214] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.706 [2024-10-07 11:33:23.822231] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.706 [2024-10-07 11:33:23.822301] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.706 [2024-10-07 11:33:23.822326] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.706 [2024-10-07 11:33:23.822342] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.706 [2024-10-07 11:33:23.822948] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.706 [2024-10-07 11:33:23.822991] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.706 [2024-10-07 11:33:23.823108] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.706 [2024-10-07 11:33:23.823133] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.706 [2024-10-07 11:33:23.823148] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.706 [2024-10-07 11:33:23.823165] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.706 [2024-10-07 11:33:23.823179] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.706 [2024-10-07 11:33:23.823204] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.706 [2024-10-07 11:33:23.823231] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.706 [2024-10-07 11:33:23.823245] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.706 [2024-10-07 11:33:23.833250] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.706 [2024-10-07 11:33:23.833303] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.706 [2024-10-07 11:33:23.833484] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.706 [2024-10-07 11:33:23.833518] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.706 [2024-10-07 11:33:23.833535] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.706 [2024-10-07 11:33:23.833584] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.706 [2024-10-07 11:33:23.833613] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.706 [2024-10-07 11:33:23.833635] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.706 [2024-10-07 11:33:23.833775] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.706 [2024-10-07 11:33:23.833808] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.706 [2024-10-07 11:33:23.833928] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.706 [2024-10-07 11:33:23.833961] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.706 [2024-10-07 11:33:23.833978] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.706 [2024-10-07 11:33:23.833995] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.706 [2024-10-07 11:33:23.834009] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.706 [2024-10-07 11:33:23.834022] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.706 [2024-10-07 11:33:23.834328] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.706 [2024-10-07 11:33:23.834376] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.706 [2024-10-07 11:33:23.845231] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.706 [2024-10-07 11:33:23.845282] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.706 [2024-10-07 11:33:23.845507] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.706 [2024-10-07 11:33:23.845551] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.706 [2024-10-07 11:33:23.845571] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.706 [2024-10-07 11:33:23.845632] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.706 [2024-10-07 11:33:23.845671] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.706 [2024-10-07 11:33:23.845689] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.706 [2024-10-07 11:33:23.845829] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.706 [2024-10-07 11:33:23.845857] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.706 [2024-10-07 11:33:23.845977] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.706 [2024-10-07 11:33:23.846001] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.706 [2024-10-07 11:33:23.846016] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.706 [2024-10-07 11:33:23.846036] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.706 [2024-10-07 11:33:23.846058] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.706 [2024-10-07 11:33:23.846075] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.706 [2024-10-07 11:33:23.846215] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.706 [2024-10-07 11:33:23.846241] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.706 [2024-10-07 11:33:23.856577] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.706 [2024-10-07 11:33:23.856640] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.706 [2024-10-07 11:33:23.856752] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.706 [2024-10-07 11:33:23.856783] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.706 [2024-10-07 11:33:23.856799] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.706 [2024-10-07 11:33:23.856847] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.706 [2024-10-07 11:33:23.856871] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.706 [2024-10-07 11:33:23.856886] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.706 [2024-10-07 11:33:23.856910] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.706 [2024-10-07 11:33:23.856930] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.706 [2024-10-07 11:33:23.856950] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.706 [2024-10-07 11:33:23.856986] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.706 [2024-10-07 11:33:23.857001] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.706 [2024-10-07 11:33:23.857024] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.706 [2024-10-07 11:33:23.857043] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.706 [2024-10-07 11:33:23.857057] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.706 [2024-10-07 11:33:23.857081] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.706 [2024-10-07 11:33:23.857096] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.706 [2024-10-07 11:33:23.870271] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.706 [2024-10-07 11:33:23.870330] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.706 [2024-10-07 11:33:23.870440] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.706 [2024-10-07 11:33:23.870471] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.706 [2024-10-07 11:33:23.870493] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.706 [2024-10-07 11:33:23.870543] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.706 [2024-10-07 11:33:23.870567] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.706 [2024-10-07 11:33:23.870582] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.706 [2024-10-07 11:33:23.870606] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.706 [2024-10-07 11:33:23.870626] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.706 [2024-10-07 11:33:23.870660] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.706 [2024-10-07 11:33:23.870678] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.706 [2024-10-07 11:33:23.870692] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.706 [2024-10-07 11:33:23.870709] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.706 [2024-10-07 11:33:23.870723] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.706 [2024-10-07 11:33:23.870735] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.706 [2024-10-07 11:33:23.870758] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.706 [2024-10-07 11:33:23.870773] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.706 [2024-10-07 11:33:23.885722] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.706 [2024-10-07 11:33:23.885772] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.707 [2024-10-07 11:33:23.885863] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.707 [2024-10-07 11:33:23.885894] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.707 [2024-10-07 11:33:23.885910] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.707 [2024-10-07 11:33:23.885971] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.707 [2024-10-07 11:33:23.886021] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.707 [2024-10-07 11:33:23.886044] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.707 [2024-10-07 11:33:23.886075] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.707 [2024-10-07 11:33:23.886101] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.707 [2024-10-07 11:33:23.886126] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.707 [2024-10-07 11:33:23.886146] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.707 [2024-10-07 11:33:23.886165] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.707 [2024-10-07 11:33:23.886188] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.707 [2024-10-07 11:33:23.886210] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.707 [2024-10-07 11:33:23.886225] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.707 [2024-10-07 11:33:23.886250] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.707 [2024-10-07 11:33:23.886265] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.707 8798.43 IOPS, 34.37 MiB/s [2024-10-07T11:33:33.230Z] [2024-10-07 11:33:23.902787] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.707 [2024-10-07 11:33:23.902838] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.707 [2024-10-07 11:33:23.902953] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.707 [2024-10-07 11:33:23.902989] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.707 [2024-10-07 11:33:23.903011] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.707 [2024-10-07 11:33:23.903071] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.707 [2024-10-07 11:33:23.903105] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.707 [2024-10-07 11:33:23.903125] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.707 [2024-10-07 11:33:23.903149] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.707 [2024-10-07 11:33:23.903170] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.707 [2024-10-07 11:33:23.903201] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.707 [2024-10-07 11:33:23.903218] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.707 [2024-10-07 11:33:23.903231] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.707 [2024-10-07 11:33:23.903248] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.707 [2024-10-07 11:33:23.903261] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.707 [2024-10-07 11:33:23.903274] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.707 [2024-10-07 11:33:23.903297] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.707 [2024-10-07 11:33:23.903311] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.707 [2024-10-07 11:33:23.913145] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.707 [2024-10-07 11:33:23.913198] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.707 [2024-10-07 11:33:23.913365] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.707 [2024-10-07 11:33:23.913398] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.707 [2024-10-07 11:33:23.913416] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.707 [2024-10-07 11:33:23.913467] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.707 [2024-10-07 11:33:23.913491] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.707 [2024-10-07 11:33:23.913506] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.707 [2024-10-07 11:33:23.916053] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.707 [2024-10-07 11:33:23.916101] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.707 [2024-10-07 11:33:23.917758] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.707 [2024-10-07 11:33:23.917800] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.707 [2024-10-07 11:33:23.917819] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.707 [2024-10-07 11:33:23.917837] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.707 [2024-10-07 11:33:23.917851] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.707 [2024-10-07 11:33:23.917864] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.707 [2024-10-07 11:33:23.918082] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.707 [2024-10-07 11:33:23.918110] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.707 [2024-10-07 11:33:23.923271] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.707 [2024-10-07 11:33:23.923354] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.707 [2024-10-07 11:33:23.923456] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.707 [2024-10-07 11:33:23.923491] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.707 [2024-10-07 11:33:23.923513] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.707 [2024-10-07 11:33:23.924205] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.707 [2024-10-07 11:33:23.924251] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.707 [2024-10-07 11:33:23.924272] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.707 [2024-10-07 11:33:23.924291] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.707 [2024-10-07 11:33:23.924506] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.707 [2024-10-07 11:33:23.924547] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.707 [2024-10-07 11:33:23.924576] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.707 [2024-10-07 11:33:23.924605] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.707 [2024-10-07 11:33:23.924769] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.707 [2024-10-07 11:33:23.924794] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.707 [2024-10-07 11:33:23.924809] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.707 [2024-10-07 11:33:23.924822] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.707 [2024-10-07 11:33:23.924961] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.707 [2024-10-07 11:33:23.933694] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.707 [2024-10-07 11:33:23.933748] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.707 [2024-10-07 11:33:23.933856] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.707 [2024-10-07 11:33:23.933892] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.707 [2024-10-07 11:33:23.933914] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.707 [2024-10-07 11:33:23.933974] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.707 [2024-10-07 11:33:23.934003] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.707 [2024-10-07 11:33:23.934023] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.707 [2024-10-07 11:33:23.934056] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.707 [2024-10-07 11:33:23.934084] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.707 [2024-10-07 11:33:23.934104] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.707 [2024-10-07 11:33:23.934119] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.707 [2024-10-07 11:33:23.934132] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.707 [2024-10-07 11:33:23.934148] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.707 [2024-10-07 11:33:23.934163] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.707 [2024-10-07 11:33:23.934175] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.707 [2024-10-07 11:33:23.934198] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.707 [2024-10-07 11:33:23.934218] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.707 [2024-10-07 11:33:23.945829] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.707 [2024-10-07 11:33:23.945889] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.707 [2024-10-07 11:33:23.946159] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.707 [2024-10-07 11:33:23.946214] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.707 [2024-10-07 11:33:23.946234] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.707 [2024-10-07 11:33:23.946288] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.707 [2024-10-07 11:33:23.946313] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.707 [2024-10-07 11:33:23.946343] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.707 [2024-10-07 11:33:23.946414] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.708 [2024-10-07 11:33:23.946442] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.708 [2024-10-07 11:33:23.946463] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.708 [2024-10-07 11:33:23.946478] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.708 [2024-10-07 11:33:23.946493] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.708 [2024-10-07 11:33:23.946517] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.708 [2024-10-07 11:33:23.946533] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.708 [2024-10-07 11:33:23.946546] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.708 [2024-10-07 11:33:23.946570] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.708 [2024-10-07 11:33:23.946584] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.708 [2024-10-07 11:33:23.959851] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.708 [2024-10-07 11:33:23.959911] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.708 [2024-10-07 11:33:23.960018] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.708 [2024-10-07 11:33:23.960053] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.708 [2024-10-07 11:33:23.960075] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.708 [2024-10-07 11:33:23.960140] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.708 [2024-10-07 11:33:23.960167] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.708 [2024-10-07 11:33:23.960182] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.708 [2024-10-07 11:33:23.960207] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.708 [2024-10-07 11:33:23.960227] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.708 [2024-10-07 11:33:23.960247] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.708 [2024-10-07 11:33:23.960261] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.708 [2024-10-07 11:33:23.960275] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.708 [2024-10-07 11:33:23.960292] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.708 [2024-10-07 11:33:23.960306] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.708 [2024-10-07 11:33:23.960319] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.708 [2024-10-07 11:33:23.961209] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.708 [2024-10-07 11:33:23.961254] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.708 [2024-10-07 11:33:23.971094] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.708 [2024-10-07 11:33:23.971163] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.708 [2024-10-07 11:33:23.971456] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.708 [2024-10-07 11:33:23.971509] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.708 [2024-10-07 11:33:23.971535] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.708 [2024-10-07 11:33:23.971599] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.708 [2024-10-07 11:33:23.971640] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.708 [2024-10-07 11:33:23.971683] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.708 [2024-10-07 11:33:23.971825] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.708 [2024-10-07 11:33:23.971872] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.708 [2024-10-07 11:33:23.972050] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.708 [2024-10-07 11:33:23.972094] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.708 [2024-10-07 11:33:23.972117] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.708 [2024-10-07 11:33:23.972140] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.708 [2024-10-07 11:33:23.972166] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.708 [2024-10-07 11:33:23.972184] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.708 [2024-10-07 11:33:23.972249] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.708 [2024-10-07 11:33:23.972276] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.708 [2024-10-07 11:33:23.981615] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.708 [2024-10-07 11:33:23.981680] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.708 [2024-10-07 11:33:23.981795] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.708 [2024-10-07 11:33:23.981832] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.708 [2024-10-07 11:33:23.981854] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.708 [2024-10-07 11:33:23.981916] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.708 [2024-10-07 11:33:23.981944] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.708 [2024-10-07 11:33:23.981965] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.708 [2024-10-07 11:33:23.982470] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.708 [2024-10-07 11:33:23.982521] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.708 [2024-10-07 11:33:23.982553] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.708 [2024-10-07 11:33:23.982574] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.708 [2024-10-07 11:33:23.982592] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.708 [2024-10-07 11:33:23.982631] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.708 [2024-10-07 11:33:23.982681] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.708 [2024-10-07 11:33:23.982702] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.708 [2024-10-07 11:33:23.982733] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.708 [2024-10-07 11:33:23.982751] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.708 [2024-10-07 11:33:23.992640] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.708 [2024-10-07 11:33:23.992703] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.708 [2024-10-07 11:33:23.992886] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.708 [2024-10-07 11:33:23.992935] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.708 [2024-10-07 11:33:23.992961] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.708 [2024-10-07 11:33:23.993030] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.708 [2024-10-07 11:33:23.993064] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.708 [2024-10-07 11:33:23.993080] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.708 [2024-10-07 11:33:23.993106] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.708 [2024-10-07 11:33:23.993126] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.708 [2024-10-07 11:33:23.993163] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.708 [2024-10-07 11:33:23.993182] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.708 [2024-10-07 11:33:23.993196] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.708 [2024-10-07 11:33:23.993212] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.708 [2024-10-07 11:33:23.993227] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.708 [2024-10-07 11:33:23.993239] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.708 [2024-10-07 11:33:23.993263] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.708 [2024-10-07 11:33:23.993277] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.708 [2024-10-07 11:33:24.003707] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.708 [2024-10-07 11:33:24.003758] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.708 [2024-10-07 11:33:24.004375] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.709 [2024-10-07 11:33:24.004420] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.709 [2024-10-07 11:33:24.004440] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.709 [2024-10-07 11:33:24.004491] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.709 [2024-10-07 11:33:24.004516] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.709 [2024-10-07 11:33:24.004549] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.709 [2024-10-07 11:33:24.004804] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.709 [2024-10-07 11:33:24.004853] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.709 [2024-10-07 11:33:24.005364] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.709 [2024-10-07 11:33:24.005402] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.709 [2024-10-07 11:33:24.005420] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.709 [2024-10-07 11:33:24.005437] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.709 [2024-10-07 11:33:24.005452] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.709 [2024-10-07 11:33:24.005465] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.709 [2024-10-07 11:33:24.005749] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.709 [2024-10-07 11:33:24.005782] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.709 [2024-10-07 11:33:24.017307] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.709 [2024-10-07 11:33:24.017359] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.709 [2024-10-07 11:33:24.017449] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.709 [2024-10-07 11:33:24.017480] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.709 [2024-10-07 11:33:24.017497] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.709 [2024-10-07 11:33:24.017552] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.709 [2024-10-07 11:33:24.017575] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.709 [2024-10-07 11:33:24.017590] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.709 [2024-10-07 11:33:24.018220] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.709 [2024-10-07 11:33:24.018265] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.709 [2024-10-07 11:33:24.018365] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.709 [2024-10-07 11:33:24.018388] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.709 [2024-10-07 11:33:24.018402] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.709 [2024-10-07 11:33:24.018419] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.709 [2024-10-07 11:33:24.018433] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.709 [2024-10-07 11:33:24.018446] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.709 [2024-10-07 11:33:24.018470] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.709 [2024-10-07 11:33:24.018484] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.709 [2024-10-07 11:33:24.027923] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.709 [2024-10-07 11:33:24.027984] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.709 [2024-10-07 11:33:24.028217] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.709 [2024-10-07 11:33:24.028263] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.709 [2024-10-07 11:33:24.028284] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.709 [2024-10-07 11:33:24.028336] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.709 [2024-10-07 11:33:24.028360] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.709 [2024-10-07 11:33:24.028376] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.709 [2024-10-07 11:33:24.028482] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.709 [2024-10-07 11:33:24.028508] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.709 [2024-10-07 11:33:24.028752] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.709 [2024-10-07 11:33:24.028790] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.709 [2024-10-07 11:33:24.028807] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.709 [2024-10-07 11:33:24.028825] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.709 [2024-10-07 11:33:24.028840] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.709 [2024-10-07 11:33:24.028864] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.709 [2024-10-07 11:33:24.028924] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.709 [2024-10-07 11:33:24.028945] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.709 [2024-10-07 11:33:24.041813] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.709 [2024-10-07 11:33:24.041875] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.709 [2024-10-07 11:33:24.042065] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.709 [2024-10-07 11:33:24.042098] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.709 [2024-10-07 11:33:24.042115] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.709 [2024-10-07 11:33:24.042164] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.709 [2024-10-07 11:33:24.042188] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.709 [2024-10-07 11:33:24.042203] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.709 [2024-10-07 11:33:24.042227] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.709 [2024-10-07 11:33:24.042248] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.709 [2024-10-07 11:33:24.042268] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.709 [2024-10-07 11:33:24.042283] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.709 [2024-10-07 11:33:24.042296] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.709 [2024-10-07 11:33:24.042323] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.709 [2024-10-07 11:33:24.042354] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.709 [2024-10-07 11:33:24.042369] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.709 [2024-10-07 11:33:24.042394] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.709 [2024-10-07 11:33:24.042409] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.709 [2024-10-07 11:33:24.053208] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.709 [2024-10-07 11:33:24.053264] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.709 [2024-10-07 11:33:24.053451] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.709 [2024-10-07 11:33:24.053483] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.709 [2024-10-07 11:33:24.053500] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.709 [2024-10-07 11:33:24.053549] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.709 [2024-10-07 11:33:24.053572] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.709 [2024-10-07 11:33:24.053588] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.709 [2024-10-07 11:33:24.053707] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.709 [2024-10-07 11:33:24.053735] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.709 [2024-10-07 11:33:24.053845] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.709 [2024-10-07 11:33:24.053867] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.709 [2024-10-07 11:33:24.053882] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.709 [2024-10-07 11:33:24.053899] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.709 [2024-10-07 11:33:24.053913] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.709 [2024-10-07 11:33:24.053926] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.709 [2024-10-07 11:33:24.055218] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.709 [2024-10-07 11:33:24.055260] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.709 [2024-10-07 11:33:24.063939] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.709 [2024-10-07 11:33:24.063989] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.709 [2024-10-07 11:33:24.064087] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.709 [2024-10-07 11:33:24.064117] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.709 [2024-10-07 11:33:24.064133] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.709 [2024-10-07 11:33:24.064182] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.709 [2024-10-07 11:33:24.064206] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.709 [2024-10-07 11:33:24.064221] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.709 [2024-10-07 11:33:24.064260] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.710 [2024-10-07 11:33:24.064282] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.710 [2024-10-07 11:33:24.064301] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.710 [2024-10-07 11:33:24.064315] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.710 [2024-10-07 11:33:24.064335] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.710 [2024-10-07 11:33:24.064357] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.710 [2024-10-07 11:33:24.064377] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.710 [2024-10-07 11:33:24.064395] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.710 [2024-10-07 11:33:24.064425] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.710 [2024-10-07 11:33:24.064444] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.710 [2024-10-07 11:33:24.074053] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.710 [2024-10-07 11:33:24.074121] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.710 [2024-10-07 11:33:24.074203] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.710 [2024-10-07 11:33:24.074233] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.710 [2024-10-07 11:33:24.074250] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.710 [2024-10-07 11:33:24.074313] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.710 [2024-10-07 11:33:24.074344] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.710 [2024-10-07 11:33:24.074365] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.710 [2024-10-07 11:33:24.074389] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.710 [2024-10-07 11:33:24.074419] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.710 [2024-10-07 11:33:24.074441] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.710 [2024-10-07 11:33:24.074461] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.710 [2024-10-07 11:33:24.074480] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.710 [2024-10-07 11:33:24.074528] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.710 [2024-10-07 11:33:24.074551] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.710 [2024-10-07 11:33:24.074570] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.710 [2024-10-07 11:33:24.074588] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.710 [2024-10-07 11:33:24.074614] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.710 [2024-10-07 11:33:24.087182] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.710 [2024-10-07 11:33:24.087259] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.710 [2024-10-07 11:33:24.088027] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.710 [2024-10-07 11:33:24.088089] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.710 [2024-10-07 11:33:24.088112] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.710 [2024-10-07 11:33:24.088166] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.710 [2024-10-07 11:33:24.088191] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.710 [2024-10-07 11:33:24.088207] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.710 [2024-10-07 11:33:24.088957] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.710 [2024-10-07 11:33:24.089002] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.710 [2024-10-07 11:33:24.089101] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.710 [2024-10-07 11:33:24.089124] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.710 [2024-10-07 11:33:24.089139] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.710 [2024-10-07 11:33:24.089156] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.710 [2024-10-07 11:33:24.089171] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.710 [2024-10-07 11:33:24.089184] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.710 [2024-10-07 11:33:24.089207] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.710 [2024-10-07 11:33:24.089221] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.710 [2024-10-07 11:33:24.098853] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.710 [2024-10-07 11:33:24.098904] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.710 [2024-10-07 11:33:24.100495] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.710 [2024-10-07 11:33:24.100542] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.710 [2024-10-07 11:33:24.100563] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.710 [2024-10-07 11:33:24.100625] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.710 [2024-10-07 11:33:24.100665] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.710 [2024-10-07 11:33:24.100696] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.710 [2024-10-07 11:33:24.101382] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.710 [2024-10-07 11:33:24.101427] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.710 [2024-10-07 11:33:24.101693] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.710 [2024-10-07 11:33:24.101738] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.710 [2024-10-07 11:33:24.101756] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.710 [2024-10-07 11:33:24.101774] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.710 [2024-10-07 11:33:24.101788] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.710 [2024-10-07 11:33:24.101815] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.710 [2024-10-07 11:33:24.101887] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.710 [2024-10-07 11:33:24.101909] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.710 [2024-10-07 11:33:24.110489] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.710 [2024-10-07 11:33:24.110540] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.710 [2024-10-07 11:33:24.110751] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.710 [2024-10-07 11:33:24.110783] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.710 [2024-10-07 11:33:24.110801] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.710 [2024-10-07 11:33:24.110849] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.710 [2024-10-07 11:33:24.110873] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.710 [2024-10-07 11:33:24.110887] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.710 [2024-10-07 11:33:24.111047] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.710 [2024-10-07 11:33:24.111089] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.710 [2024-10-07 11:33:24.111254] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.710 [2024-10-07 11:33:24.111289] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.710 [2024-10-07 11:33:24.111306] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.710 [2024-10-07 11:33:24.111324] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.710 [2024-10-07 11:33:24.111338] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.710 [2024-10-07 11:33:24.111351] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.710 [2024-10-07 11:33:24.111476] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.710 [2024-10-07 11:33:24.111498] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.710 [2024-10-07 11:33:24.121932] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.710 [2024-10-07 11:33:24.121985] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.710 [2024-10-07 11:33:24.122173] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.710 [2024-10-07 11:33:24.122206] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.710 [2024-10-07 11:33:24.122223] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.710 [2024-10-07 11:33:24.122272] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.710 [2024-10-07 11:33:24.122296] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.710 [2024-10-07 11:33:24.122322] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.710 [2024-10-07 11:33:24.122493] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.710 [2024-10-07 11:33:24.122550] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.710 [2024-10-07 11:33:24.122626] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.710 [2024-10-07 11:33:24.122666] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.710 [2024-10-07 11:33:24.122682] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.710 [2024-10-07 11:33:24.122700] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.711 [2024-10-07 11:33:24.122714] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.711 [2024-10-07 11:33:24.122728] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.711 [2024-10-07 11:33:24.122752] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.711 [2024-10-07 11:33:24.122767] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.711 [2024-10-07 11:33:24.132443] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.711 [2024-10-07 11:33:24.132503] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.711 [2024-10-07 11:33:24.132612] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.711 [2024-10-07 11:33:24.132662] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.711 [2024-10-07 11:33:24.132683] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.711 [2024-10-07 11:33:24.132737] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.711 [2024-10-07 11:33:24.132761] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.711 [2024-10-07 11:33:24.132783] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.711 [2024-10-07 11:33:24.132807] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.711 [2024-10-07 11:33:24.132830] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.711 [2024-10-07 11:33:24.132850] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.711 [2024-10-07 11:33:24.132865] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.711 [2024-10-07 11:33:24.132878] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.711 [2024-10-07 11:33:24.132894] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.711 [2024-10-07 11:33:24.132908] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.711 [2024-10-07 11:33:24.132921] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.711 [2024-10-07 11:33:24.132944] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.711 [2024-10-07 11:33:24.132958] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.711 [2024-10-07 11:33:24.144672] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.711 [2024-10-07 11:33:24.144723] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.711 [2024-10-07 11:33:24.144813] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.711 [2024-10-07 11:33:24.144844] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.711 [2024-10-07 11:33:24.144875] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.711 [2024-10-07 11:33:24.144934] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.711 [2024-10-07 11:33:24.144970] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.711 [2024-10-07 11:33:24.144993] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.711 [2024-10-07 11:33:24.145028] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.711 [2024-10-07 11:33:24.145055] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.711 [2024-10-07 11:33:24.145076] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.711 [2024-10-07 11:33:24.145101] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.711 [2024-10-07 11:33:24.145115] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.711 [2024-10-07 11:33:24.145131] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.711 [2024-10-07 11:33:24.145145] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.711 [2024-10-07 11:33:24.145158] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.711 [2024-10-07 11:33:24.145181] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.711 [2024-10-07 11:33:24.145195] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.711 [2024-10-07 11:33:24.157513] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.711 [2024-10-07 11:33:24.157565] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.711 [2024-10-07 11:33:24.157763] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.711 [2024-10-07 11:33:24.157800] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.711 [2024-10-07 11:33:24.157835] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.711 [2024-10-07 11:33:24.157899] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.711 [2024-10-07 11:33:24.157929] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.711 [2024-10-07 11:33:24.157949] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.711 [2024-10-07 11:33:24.158074] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.711 [2024-10-07 11:33:24.158114] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.711 [2024-10-07 11:33:24.158269] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.711 [2024-10-07 11:33:24.158307] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.711 [2024-10-07 11:33:24.158324] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.711 [2024-10-07 11:33:24.158342] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.711 [2024-10-07 11:33:24.158357] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.711 [2024-10-07 11:33:24.158392] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.711 [2024-10-07 11:33:24.158789] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.711 [2024-10-07 11:33:24.158833] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.711 [2024-10-07 11:33:24.167634] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.711 [2024-10-07 11:33:24.167735] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.711 [2024-10-07 11:33:24.167821] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.711 [2024-10-07 11:33:24.167851] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.711 [2024-10-07 11:33:24.167867] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.711 [2024-10-07 11:33:24.167924] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.711 [2024-10-07 11:33:24.167949] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.711 [2024-10-07 11:33:24.167964] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.711 [2024-10-07 11:33:24.167982] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.711 [2024-10-07 11:33:24.168006] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.711 [2024-10-07 11:33:24.168023] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.711 [2024-10-07 11:33:24.168037] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.711 [2024-10-07 11:33:24.168050] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.711 [2024-10-07 11:33:24.168073] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.711 [2024-10-07 11:33:24.168088] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.711 [2024-10-07 11:33:24.168101] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.711 [2024-10-07 11:33:24.168114] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.711 [2024-10-07 11:33:24.168134] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.711 [2024-10-07 11:33:24.178078] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.711 [2024-10-07 11:33:24.178153] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.711 [2024-10-07 11:33:24.178247] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.711 [2024-10-07 11:33:24.178279] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.711 [2024-10-07 11:33:24.178296] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.711 [2024-10-07 11:33:24.178347] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.711 [2024-10-07 11:33:24.178372] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.711 [2024-10-07 11:33:24.178387] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.711 [2024-10-07 11:33:24.180259] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.711 [2024-10-07 11:33:24.180308] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.711 [2024-10-07 11:33:24.180818] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.711 [2024-10-07 11:33:24.180857] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.711 [2024-10-07 11:33:24.180883] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.711 [2024-10-07 11:33:24.180909] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.711 [2024-10-07 11:33:24.180930] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.711 [2024-10-07 11:33:24.180950] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.711 [2024-10-07 11:33:24.181337] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.711 [2024-10-07 11:33:24.181374] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.711 [2024-10-07 11:33:24.188829] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.711 [2024-10-07 11:33:24.188883] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.711 [2024-10-07 11:33:24.189082] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.711 [2024-10-07 11:33:24.189131] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.712 [2024-10-07 11:33:24.189159] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.712 [2024-10-07 11:33:24.189224] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.712 [2024-10-07 11:33:24.189253] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.712 [2024-10-07 11:33:24.189275] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.712 [2024-10-07 11:33:24.189414] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.712 [2024-10-07 11:33:24.189454] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.712 [2024-10-07 11:33:24.189736] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.712 [2024-10-07 11:33:24.189773] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.712 [2024-10-07 11:33:24.189791] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.712 [2024-10-07 11:33:24.189810] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.712 [2024-10-07 11:33:24.189835] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.712 [2024-10-07 11:33:24.189849] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.712 [2024-10-07 11:33:24.189989] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.712 [2024-10-07 11:33:24.190013] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.712 [2024-10-07 11:33:24.200004] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.712 [2024-10-07 11:33:24.200058] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.712 [2024-10-07 11:33:24.200233] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.712 [2024-10-07 11:33:24.200276] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.712 [2024-10-07 11:33:24.200313] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.712 [2024-10-07 11:33:24.200370] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.712 [2024-10-07 11:33:24.200397] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.712 [2024-10-07 11:33:24.200413] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.712 [2024-10-07 11:33:24.200572] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.712 [2024-10-07 11:33:24.200614] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.712 [2024-10-07 11:33:24.200687] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.712 [2024-10-07 11:33:24.200720] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.712 [2024-10-07 11:33:24.200735] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.712 [2024-10-07 11:33:24.200751] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.712 [2024-10-07 11:33:24.200765] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.712 [2024-10-07 11:33:24.200778] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.712 [2024-10-07 11:33:24.200802] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.712 [2024-10-07 11:33:24.200816] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.712 [2024-10-07 11:33:24.214756] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.712 [2024-10-07 11:33:24.214818] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.712 [2024-10-07 11:33:24.215010] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.712 [2024-10-07 11:33:24.215053] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.712 [2024-10-07 11:33:24.215073] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.712 [2024-10-07 11:33:24.215125] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.712 [2024-10-07 11:33:24.215148] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.712 [2024-10-07 11:33:24.215164] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.712 [2024-10-07 11:33:24.215201] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.712 [2024-10-07 11:33:24.215227] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.712 [2024-10-07 11:33:24.215247] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.712 [2024-10-07 11:33:24.215262] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.712 [2024-10-07 11:33:24.215275] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.712 [2024-10-07 11:33:24.215292] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.712 [2024-10-07 11:33:24.215307] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.712 [2024-10-07 11:33:24.215319] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.712 [2024-10-07 11:33:24.215360] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.712 [2024-10-07 11:33:24.215376] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.712 [2024-10-07 11:33:24.228527] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.712 [2024-10-07 11:33:24.228584] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.712 [2024-10-07 11:33:24.228691] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.712 [2024-10-07 11:33:24.228723] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.712 [2024-10-07 11:33:24.228740] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.712 [2024-10-07 11:33:24.228802] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.712 [2024-10-07 11:33:24.228826] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.712 [2024-10-07 11:33:24.228844] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.712 [2024-10-07 11:33:24.229434] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.712 [2024-10-07 11:33:24.229484] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.712 [2024-10-07 11:33:24.229603] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.712 [2024-10-07 11:33:24.229633] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.712 [2024-10-07 11:33:24.229670] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.712 [2024-10-07 11:33:24.229696] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.712 [2024-10-07 11:33:24.229715] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.712 [2024-10-07 11:33:24.229737] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.712 [2024-10-07 11:33:24.229766] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.712 [2024-10-07 11:33:24.229781] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.712 [2024-10-07 11:33:24.239739] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.712 [2024-10-07 11:33:24.239793] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.712 [2024-10-07 11:33:24.239971] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.712 [2024-10-07 11:33:24.240013] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.712 [2024-10-07 11:33:24.240034] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.712 [2024-10-07 11:33:24.240085] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.712 [2024-10-07 11:33:24.240110] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.712 [2024-10-07 11:33:24.240125] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.712 [2024-10-07 11:33:24.240230] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.712 [2024-10-07 11:33:24.240255] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.712 [2024-10-07 11:33:24.240390] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.712 [2024-10-07 11:33:24.240444] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.712 [2024-10-07 11:33:24.240465] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.712 [2024-10-07 11:33:24.240484] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.712 [2024-10-07 11:33:24.240498] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.712 [2024-10-07 11:33:24.240511] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.712 [2024-10-07 11:33:24.242980] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.712 [2024-10-07 11:33:24.243025] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.712 [2024-10-07 11:33:24.250100] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.712 [2024-10-07 11:33:24.250162] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.712 [2024-10-07 11:33:24.250363] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.712 [2024-10-07 11:33:24.250403] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.712 [2024-10-07 11:33:24.250426] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.712 [2024-10-07 11:33:24.250487] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.712 [2024-10-07 11:33:24.250513] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.712 [2024-10-07 11:33:24.250528] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.712 [2024-10-07 11:33:24.250578] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.712 [2024-10-07 11:33:24.250604] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.712 [2024-10-07 11:33:24.250625] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.713 [2024-10-07 11:33:24.250640] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.713 [2024-10-07 11:33:24.250670] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.713 [2024-10-07 11:33:24.250689] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.713 [2024-10-07 11:33:24.250703] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.713 [2024-10-07 11:33:24.250716] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.713 [2024-10-07 11:33:24.250740] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.713 [2024-10-07 11:33:24.250754] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.713 [2024-10-07 11:33:24.260233] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.713 [2024-10-07 11:33:24.260302] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.713 [2024-10-07 11:33:24.260381] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.713 [2024-10-07 11:33:24.260411] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.713 [2024-10-07 11:33:24.260428] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.713 [2024-10-07 11:33:24.260505] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.713 [2024-10-07 11:33:24.260532] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.713 [2024-10-07 11:33:24.260547] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.713 [2024-10-07 11:33:24.260565] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.713 [2024-10-07 11:33:24.260589] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.713 [2024-10-07 11:33:24.260607] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.713 [2024-10-07 11:33:24.260620] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.713 [2024-10-07 11:33:24.260634] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.713 [2024-10-07 11:33:24.260674] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.713 [2024-10-07 11:33:24.260693] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.713 [2024-10-07 11:33:24.260717] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.713 [2024-10-07 11:33:24.260730] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.713 [2024-10-07 11:33:24.260751] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.713 [2024-10-07 11:33:24.275372] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.713 [2024-10-07 11:33:24.275431] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.713 [2024-10-07 11:33:24.275709] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.713 [2024-10-07 11:33:24.275761] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.713 [2024-10-07 11:33:24.275787] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.713 [2024-10-07 11:33:24.275855] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.713 [2024-10-07 11:33:24.275882] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.713 [2024-10-07 11:33:24.275898] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.713 [2024-10-07 11:33:24.275924] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.713 [2024-10-07 11:33:24.275944] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.713 [2024-10-07 11:33:24.275965] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.713 [2024-10-07 11:33:24.275979] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.713 [2024-10-07 11:33:24.276003] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.713 [2024-10-07 11:33:24.276020] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.713 [2024-10-07 11:33:24.276035] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.713 [2024-10-07 11:33:24.276048] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.713 [2024-10-07 11:33:24.276071] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.713 [2024-10-07 11:33:24.276100] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.713 [2024-10-07 11:33:24.286734] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.713 [2024-10-07 11:33:24.286786] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.713 [2024-10-07 11:33:24.286991] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.713 [2024-10-07 11:33:24.287034] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.713 [2024-10-07 11:33:24.287055] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.713 [2024-10-07 11:33:24.287106] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.713 [2024-10-07 11:33:24.287130] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.713 [2024-10-07 11:33:24.287146] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.713 [2024-10-07 11:33:24.287306] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.713 [2024-10-07 11:33:24.287341] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.713 [2024-10-07 11:33:24.287699] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.713 [2024-10-07 11:33:24.287736] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.713 [2024-10-07 11:33:24.287754] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.713 [2024-10-07 11:33:24.287771] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.713 [2024-10-07 11:33:24.287786] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.713 [2024-10-07 11:33:24.287799] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.713 [2024-10-07 11:33:24.288010] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.713 [2024-10-07 11:33:24.288037] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.713 [2024-10-07 11:33:24.296861] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.713 [2024-10-07 11:33:24.296931] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.713 [2024-10-07 11:33:24.297011] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.713 [2024-10-07 11:33:24.297041] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.713 [2024-10-07 11:33:24.297058] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.713 [2024-10-07 11:33:24.297114] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.713 [2024-10-07 11:33:24.297139] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.713 [2024-10-07 11:33:24.297155] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.713 [2024-10-07 11:33:24.297172] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.713 [2024-10-07 11:33:24.297196] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.713 [2024-10-07 11:33:24.297214] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.713 [2024-10-07 11:33:24.297243] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.713 [2024-10-07 11:33:24.297258] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.713 [2024-10-07 11:33:24.297454] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.713 [2024-10-07 11:33:24.297501] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.713 [2024-10-07 11:33:24.297524] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.713 [2024-10-07 11:33:24.297543] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.713 [2024-10-07 11:33:24.297745] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.713 [2024-10-07 11:33:24.310944] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.713 [2024-10-07 11:33:24.311009] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.713 [2024-10-07 11:33:24.311126] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.713 [2024-10-07 11:33:24.311163] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.713 [2024-10-07 11:33:24.311185] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.713 [2024-10-07 11:33:24.311265] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.714 [2024-10-07 11:33:24.311298] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.714 [2024-10-07 11:33:24.311326] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.714 [2024-10-07 11:33:24.312249] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.714 [2024-10-07 11:33:24.312296] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.714 [2024-10-07 11:33:24.312508] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.714 [2024-10-07 11:33:24.312552] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.714 [2024-10-07 11:33:24.312571] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.714 [2024-10-07 11:33:24.312589] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.714 [2024-10-07 11:33:24.312604] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.714 [2024-10-07 11:33:24.312616] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.714 [2024-10-07 11:33:24.312673] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.714 [2024-10-07 11:33:24.312694] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.714 [2024-10-07 11:33:24.322323] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.714 [2024-10-07 11:33:24.322377] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.714 [2024-10-07 11:33:24.322577] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.714 [2024-10-07 11:33:24.322621] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.714 [2024-10-07 11:33:24.322642] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.714 [2024-10-07 11:33:24.322710] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.714 [2024-10-07 11:33:24.322755] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.714 [2024-10-07 11:33:24.322772] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.714 [2024-10-07 11:33:24.324077] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.714 [2024-10-07 11:33:24.324133] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.714 [2024-10-07 11:33:24.324401] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.714 [2024-10-07 11:33:24.324447] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.714 [2024-10-07 11:33:24.324471] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.714 [2024-10-07 11:33:24.324494] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.714 [2024-10-07 11:33:24.324514] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.714 [2024-10-07 11:33:24.324531] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.714 [2024-10-07 11:33:24.326075] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.714 [2024-10-07 11:33:24.326115] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.714 [2024-10-07 11:33:24.332802] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.714 [2024-10-07 11:33:24.332854] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.714 [2024-10-07 11:33:24.333848] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.714 [2024-10-07 11:33:24.333897] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.714 [2024-10-07 11:33:24.333918] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.714 [2024-10-07 11:33:24.333971] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.714 [2024-10-07 11:33:24.333995] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.714 [2024-10-07 11:33:24.334010] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.714 [2024-10-07 11:33:24.334237] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.714 [2024-10-07 11:33:24.334303] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.714 [2024-10-07 11:33:24.334473] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.714 [2024-10-07 11:33:24.334515] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.714 [2024-10-07 11:33:24.334538] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.714 [2024-10-07 11:33:24.334560] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.714 [2024-10-07 11:33:24.334579] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.714 [2024-10-07 11:33:24.334598] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.714 [2024-10-07 11:33:24.334728] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.714 [2024-10-07 11:33:24.334752] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.714 [2024-10-07 11:33:24.343155] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.714 [2024-10-07 11:33:24.343214] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.714 [2024-10-07 11:33:24.343314] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.714 [2024-10-07 11:33:24.343354] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.714 [2024-10-07 11:33:24.343378] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.714 [2024-10-07 11:33:24.343507] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.714 [2024-10-07 11:33:24.343534] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.714 [2024-10-07 11:33:24.343550] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.714 [2024-10-07 11:33:24.343578] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.714 [2024-10-07 11:33:24.343600] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.714 [2024-10-07 11:33:24.344217] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.714 [2024-10-07 11:33:24.344263] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.714 [2024-10-07 11:33:24.344282] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.714 [2024-10-07 11:33:24.344302] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.714 [2024-10-07 11:33:24.344316] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.714 [2024-10-07 11:33:24.344337] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.714 [2024-10-07 11:33:24.344504] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.714 [2024-10-07 11:33:24.344528] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.714 [2024-10-07 11:33:24.353283] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.714 [2024-10-07 11:33:24.353385] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.714 [2024-10-07 11:33:24.353472] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.714 [2024-10-07 11:33:24.353502] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.714 [2024-10-07 11:33:24.353519] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.714 [2024-10-07 11:33:24.353575] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.714 [2024-10-07 11:33:24.353600] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.714 [2024-10-07 11:33:24.353615] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.714 [2024-10-07 11:33:24.353634] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.714 [2024-10-07 11:33:24.353678] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.714 [2024-10-07 11:33:24.353699] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.714 [2024-10-07 11:33:24.353712] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.714 [2024-10-07 11:33:24.353743] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.714 [2024-10-07 11:33:24.354986] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.714 [2024-10-07 11:33:24.355035] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.714 [2024-10-07 11:33:24.355062] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.714 [2024-10-07 11:33:24.355078] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.714 [2024-10-07 11:33:24.355313] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.714 [2024-10-07 11:33:24.363388] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.714 [2024-10-07 11:33:24.363503] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.714 [2024-10-07 11:33:24.363539] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.714 [2024-10-07 11:33:24.363570] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.714 [2024-10-07 11:33:24.363618] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.714 [2024-10-07 11:33:24.363676] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.714 [2024-10-07 11:33:24.363714] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.714 [2024-10-07 11:33:24.363740] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.714 [2024-10-07 11:33:24.363756] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.714 [2024-10-07 11:33:24.363797] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.714 [2024-10-07 11:33:24.363857] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.714 [2024-10-07 11:33:24.363883] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.714 [2024-10-07 11:33:24.363900] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.715 [2024-10-07 11:33:24.363922] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.715 [2024-10-07 11:33:24.363945] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.715 [2024-10-07 11:33:24.363959] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.715 [2024-10-07 11:33:24.363972] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.715 [2024-10-07 11:33:24.363995] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.715 [2024-10-07 11:33:24.373483] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.715 [2024-10-07 11:33:24.373618] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.715 [2024-10-07 11:33:24.373667] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.715 [2024-10-07 11:33:24.373688] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.715 [2024-10-07 11:33:24.373714] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.715 [2024-10-07 11:33:24.373736] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.715 [2024-10-07 11:33:24.373751] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.715 [2024-10-07 11:33:24.373782] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.715 [2024-10-07 11:33:24.373820] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.715 [2024-10-07 11:33:24.373844] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.715 [2024-10-07 11:33:24.373918] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.715 [2024-10-07 11:33:24.373945] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.715 [2024-10-07 11:33:24.373965] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.715 [2024-10-07 11:33:24.373994] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.715 [2024-10-07 11:33:24.374016] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.715 [2024-10-07 11:33:24.374031] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.715 [2024-10-07 11:33:24.374044] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.715 [2024-10-07 11:33:24.374067] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.715 [2024-10-07 11:33:24.383834] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.715 [2024-10-07 11:33:24.383963] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.715 [2024-10-07 11:33:24.384000] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.715 [2024-10-07 11:33:24.384023] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.715 [2024-10-07 11:33:24.384071] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.715 [2024-10-07 11:33:24.384108] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.715 [2024-10-07 11:33:24.384142] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.715 [2024-10-07 11:33:24.384167] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.715 [2024-10-07 11:33:24.384188] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.715 [2024-10-07 11:33:24.384211] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.715 [2024-10-07 11:33:24.384267] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.715 [2024-10-07 11:33:24.384294] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.715 [2024-10-07 11:33:24.384310] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.715 [2024-10-07 11:33:24.384334] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.715 [2024-10-07 11:33:24.384356] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.715 [2024-10-07 11:33:24.384370] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.715 [2024-10-07 11:33:24.384383] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.715 [2024-10-07 11:33:24.384405] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.715 [2024-10-07 11:33:24.393926] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.715 [2024-10-07 11:33:24.394340] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.715 [2024-10-07 11:33:24.394395] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.715 [2024-10-07 11:33:24.394429] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.715 [2024-10-07 11:33:24.394700] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.715 [2024-10-07 11:33:24.394927] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.715 [2024-10-07 11:33:24.394982] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.715 [2024-10-07 11:33:24.395001] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.715 [2024-10-07 11:33:24.395014] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.715 [2024-10-07 11:33:24.395145] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.715 [2024-10-07 11:33:24.395223] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.715 [2024-10-07 11:33:24.395251] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.715 [2024-10-07 11:33:24.395268] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.715 [2024-10-07 11:33:24.395384] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.715 [2024-10-07 11:33:24.395504] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.715 [2024-10-07 11:33:24.395523] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.715 [2024-10-07 11:33:24.395537] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.715 [2024-10-07 11:33:24.395690] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.715 [2024-10-07 11:33:24.404024] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.715 [2024-10-07 11:33:24.404136] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.715 [2024-10-07 11:33:24.404166] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.715 [2024-10-07 11:33:24.404184] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.715 [2024-10-07 11:33:24.404208] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.715 [2024-10-07 11:33:24.404230] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.715 [2024-10-07 11:33:24.404245] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.715 [2024-10-07 11:33:24.404258] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.715 [2024-10-07 11:33:24.404283] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.715 [2024-10-07 11:33:24.405005] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.715 [2024-10-07 11:33:24.405114] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.715 [2024-10-07 11:33:24.405149] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.715 [2024-10-07 11:33:24.405170] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.715 [2024-10-07 11:33:24.405217] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.715 [2024-10-07 11:33:24.405247] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.715 [2024-10-07 11:33:24.405267] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.715 [2024-10-07 11:33:24.405285] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.715 [2024-10-07 11:33:24.405314] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.715 [2024-10-07 11:33:24.416677] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.715 [2024-10-07 11:33:24.416739] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.715 [2024-10-07 11:33:24.416831] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.715 [2024-10-07 11:33:24.416861] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.715 [2024-10-07 11:33:24.416878] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.715 [2024-10-07 11:33:24.416933] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.715 [2024-10-07 11:33:24.416957] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.715 [2024-10-07 11:33:24.416972] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.715 [2024-10-07 11:33:24.417550] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.715 [2024-10-07 11:33:24.417600] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.715 [2024-10-07 11:33:24.417733] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.715 [2024-10-07 11:33:24.417759] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.715 [2024-10-07 11:33:24.417773] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.715 [2024-10-07 11:33:24.417791] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.715 [2024-10-07 11:33:24.417805] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.715 [2024-10-07 11:33:24.417817] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.715 [2024-10-07 11:33:24.417841] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.715 [2024-10-07 11:33:24.417855] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.715 [2024-10-07 11:33:24.427637] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.715 [2024-10-07 11:33:24.427702] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.716 [2024-10-07 11:33:24.427890] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.716 [2024-10-07 11:33:24.427938] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.716 [2024-10-07 11:33:24.427965] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.716 [2024-10-07 11:33:24.428030] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.716 [2024-10-07 11:33:24.428064] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.716 [2024-10-07 11:33:24.428087] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.716 [2024-10-07 11:33:24.428211] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.716 [2024-10-07 11:33:24.428238] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.716 [2024-10-07 11:33:24.428335] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.716 [2024-10-07 11:33:24.428355] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.716 [2024-10-07 11:33:24.428369] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.716 [2024-10-07 11:33:24.428386] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.716 [2024-10-07 11:33:24.428400] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.716 [2024-10-07 11:33:24.428413] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.716 [2024-10-07 11:33:24.428784] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.716 [2024-10-07 11:33:24.428831] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.716 [2024-10-07 11:33:24.438031] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.716 [2024-10-07 11:33:24.438080] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.716 [2024-10-07 11:33:24.438267] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.716 [2024-10-07 11:33:24.438309] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.716 [2024-10-07 11:33:24.438329] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.716 [2024-10-07 11:33:24.438380] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.716 [2024-10-07 11:33:24.438405] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.716 [2024-10-07 11:33:24.438420] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.716 [2024-10-07 11:33:24.438553] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.716 [2024-10-07 11:33:24.438592] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.716 [2024-10-07 11:33:24.440276] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.716 [2024-10-07 11:33:24.440319] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.716 [2024-10-07 11:33:24.440337] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.716 [2024-10-07 11:33:24.440355] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.716 [2024-10-07 11:33:24.440369] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.716 [2024-10-07 11:33:24.440382] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.716 [2024-10-07 11:33:24.443336] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.716 [2024-10-07 11:33:24.443376] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.716 [2024-10-07 11:33:24.448430] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.716 [2024-10-07 11:33:24.448477] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.716 [2024-10-07 11:33:24.448629] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.716 [2024-10-07 11:33:24.448660] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.716 [2024-10-07 11:33:24.448695] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.716 [2024-10-07 11:33:24.448747] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.716 [2024-10-07 11:33:24.448771] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.716 [2024-10-07 11:33:24.448786] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.716 [2024-10-07 11:33:24.448810] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.716 [2024-10-07 11:33:24.448830] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.716 [2024-10-07 11:33:24.448849] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.716 [2024-10-07 11:33:24.448863] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.716 [2024-10-07 11:33:24.448876] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.716 [2024-10-07 11:33:24.448892] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.716 [2024-10-07 11:33:24.448906] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.716 [2024-10-07 11:33:24.448918] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.716 [2024-10-07 11:33:24.448940] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.716 [2024-10-07 11:33:24.448954] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.716 [2024-10-07 11:33:24.461123] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.716 [2024-10-07 11:33:24.461186] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.716 [2024-10-07 11:33:24.461290] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.716 [2024-10-07 11:33:24.461319] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.716 [2024-10-07 11:33:24.461336] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.716 [2024-10-07 11:33:24.461394] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.716 [2024-10-07 11:33:24.461418] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.716 [2024-10-07 11:33:24.461433] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.716 [2024-10-07 11:33:24.462501] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.716 [2024-10-07 11:33:24.462545] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.716 [2024-10-07 11:33:24.463109] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.716 [2024-10-07 11:33:24.463146] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.716 [2024-10-07 11:33:24.463178] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.716 [2024-10-07 11:33:24.463221] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.716 [2024-10-07 11:33:24.463252] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.716 [2024-10-07 11:33:24.463266] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.716 [2024-10-07 11:33:24.463684] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.716 [2024-10-07 11:33:24.463724] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.716 [2024-10-07 11:33:24.474477] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.716 [2024-10-07 11:33:24.474524] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.716 [2024-10-07 11:33:24.474625] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.716 [2024-10-07 11:33:24.474652] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.716 [2024-10-07 11:33:24.474684] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.716 [2024-10-07 11:33:24.474734] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.716 [2024-10-07 11:33:24.474774] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.716 [2024-10-07 11:33:24.474790] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.716 [2024-10-07 11:33:24.475402] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.716 [2024-10-07 11:33:24.475446] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.716 [2024-10-07 11:33:24.475543] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.716 [2024-10-07 11:33:24.475566] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.716 [2024-10-07 11:33:24.475580] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.716 [2024-10-07 11:33:24.475597] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.716 [2024-10-07 11:33:24.475611] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.716 [2024-10-07 11:33:24.475623] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.716 [2024-10-07 11:33:24.475667] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.716 [2024-10-07 11:33:24.475687] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.716 [2024-10-07 11:33:24.485558] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.716 [2024-10-07 11:33:24.485623] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.716 [2024-10-07 11:33:24.485857] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.716 [2024-10-07 11:33:24.485908] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.716 [2024-10-07 11:33:24.485928] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.716 [2024-10-07 11:33:24.485979] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.716 [2024-10-07 11:33:24.486003] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.716 [2024-10-07 11:33:24.486018] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.716 [2024-10-07 11:33:24.486157] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.717 [2024-10-07 11:33:24.486200] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.717 [2024-10-07 11:33:24.486309] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.717 [2024-10-07 11:33:24.486330] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.717 [2024-10-07 11:33:24.486344] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.717 [2024-10-07 11:33:24.486360] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.717 [2024-10-07 11:33:24.486373] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.717 [2024-10-07 11:33:24.486386] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.717 [2024-10-07 11:33:24.488962] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.717 [2024-10-07 11:33:24.488999] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.717 [2024-10-07 11:33:24.496696] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.717 [2024-10-07 11:33:24.496910] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.717 [2024-10-07 11:33:24.496994] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.717 [2024-10-07 11:33:24.497023] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.717 [2024-10-07 11:33:24.497040] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.717 [2024-10-07 11:33:24.497197] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.717 [2024-10-07 11:33:24.497242] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.717 [2024-10-07 11:33:24.497259] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.717 [2024-10-07 11:33:24.497277] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.717 [2024-10-07 11:33:24.497392] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.717 [2024-10-07 11:33:24.497415] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.717 [2024-10-07 11:33:24.497429] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.717 [2024-10-07 11:33:24.497442] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.717 [2024-10-07 11:33:24.497570] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.717 [2024-10-07 11:33:24.497591] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.717 [2024-10-07 11:33:24.497604] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.717 [2024-10-07 11:33:24.497617] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.717 [2024-10-07 11:33:24.497715] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.717 [2024-10-07 11:33:24.506909] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.717 [2024-10-07 11:33:24.507018] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.717 [2024-10-07 11:33:24.507049] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.717 [2024-10-07 11:33:24.507084] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.717 [2024-10-07 11:33:24.507626] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.717 [2024-10-07 11:33:24.507851] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.717 [2024-10-07 11:33:24.507898] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.717 [2024-10-07 11:33:24.507916] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.717 [2024-10-07 11:33:24.507930] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.717 [2024-10-07 11:33:24.508042] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.717 [2024-10-07 11:33:24.508107] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.717 [2024-10-07 11:33:24.508135] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.717 [2024-10-07 11:33:24.508151] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.717 [2024-10-07 11:33:24.508353] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.717 [2024-10-07 11:33:24.508414] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.717 [2024-10-07 11:33:24.508436] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.717 [2024-10-07 11:33:24.508450] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.717 [2024-10-07 11:33:24.508474] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.717 [2024-10-07 11:33:24.520162] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.717 [2024-10-07 11:33:24.520226] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.717 [2024-10-07 11:33:24.520343] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.717 [2024-10-07 11:33:24.520374] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.717 [2024-10-07 11:33:24.520391] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.717 [2024-10-07 11:33:24.520440] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.717 [2024-10-07 11:33:24.520464] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.717 [2024-10-07 11:33:24.520479] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.717 [2024-10-07 11:33:24.521083] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.717 [2024-10-07 11:33:24.521129] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.717 [2024-10-07 11:33:24.521309] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.717 [2024-10-07 11:33:24.521344] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.717 [2024-10-07 11:33:24.521361] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.717 [2024-10-07 11:33:24.521379] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.717 [2024-10-07 11:33:24.521393] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.717 [2024-10-07 11:33:24.521421] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.717 [2024-10-07 11:33:24.521526] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.717 [2024-10-07 11:33:24.521545] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.717 [2024-10-07 11:33:24.530864] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.717 [2024-10-07 11:33:24.530913] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.717 [2024-10-07 11:33:24.533208] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.717 [2024-10-07 11:33:24.533268] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.717 [2024-10-07 11:33:24.533304] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.717 [2024-10-07 11:33:24.533355] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.717 [2024-10-07 11:33:24.533379] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.717 [2024-10-07 11:33:24.533395] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.717 [2024-10-07 11:33:24.534602] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.717 [2024-10-07 11:33:24.534663] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.717 [2024-10-07 11:33:24.535094] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.717 [2024-10-07 11:33:24.535134] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.717 [2024-10-07 11:33:24.535153] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.717 [2024-10-07 11:33:24.535170] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.717 [2024-10-07 11:33:24.535185] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.717 [2024-10-07 11:33:24.535209] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.717 [2024-10-07 11:33:24.535353] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.717 [2024-10-07 11:33:24.535377] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.717 [2024-10-07 11:33:24.541007] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.717 [2024-10-07 11:33:24.541457] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.717 [2024-10-07 11:33:24.541571] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.717 [2024-10-07 11:33:24.541602] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.718 [2024-10-07 11:33:24.541619] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.718 [2024-10-07 11:33:24.541718] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.718 [2024-10-07 11:33:24.541747] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.718 [2024-10-07 11:33:24.541763] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.718 [2024-10-07 11:33:24.541781] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.718 [2024-10-07 11:33:24.544387] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.718 [2024-10-07 11:33:24.544430] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.718 [2024-10-07 11:33:24.544448] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.718 [2024-10-07 11:33:24.544461] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.718 [2024-10-07 11:33:24.545043] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.718 [2024-10-07 11:33:24.545084] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.718 [2024-10-07 11:33:24.545101] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.718 [2024-10-07 11:33:24.545115] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.718 [2024-10-07 11:33:24.545306] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.718 [2024-10-07 11:33:24.551091] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.718 [2024-10-07 11:33:24.551210] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.718 [2024-10-07 11:33:24.551242] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.718 [2024-10-07 11:33:24.551259] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.718 [2024-10-07 11:33:24.551283] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.718 [2024-10-07 11:33:24.551305] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.718 [2024-10-07 11:33:24.551319] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.718 [2024-10-07 11:33:24.551333] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.718 [2024-10-07 11:33:24.551356] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.718 [2024-10-07 11:33:24.551528] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.718 [2024-10-07 11:33:24.551600] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.718 [2024-10-07 11:33:24.551628] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.718 [2024-10-07 11:33:24.551643] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.718 [2024-10-07 11:33:24.551683] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.718 [2024-10-07 11:33:24.551706] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.718 [2024-10-07 11:33:24.551720] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.718 [2024-10-07 11:33:24.551733] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.718 [2024-10-07 11:33:24.551756] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.718 [2024-10-07 11:33:24.562662] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.718 [2024-10-07 11:33:24.563100] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.718 [2024-10-07 11:33:24.563224] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.718 [2024-10-07 11:33:24.563255] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.718 [2024-10-07 11:33:24.563290] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.718 [2024-10-07 11:33:24.563552] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.718 [2024-10-07 11:33:24.563594] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.718 [2024-10-07 11:33:24.563614] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.718 [2024-10-07 11:33:24.563633] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.718 [2024-10-07 11:33:24.563877] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.718 [2024-10-07 11:33:24.563919] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.718 [2024-10-07 11:33:24.563935] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.718 [2024-10-07 11:33:24.563949] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.718 [2024-10-07 11:33:24.564145] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.718 [2024-10-07 11:33:24.564170] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.718 [2024-10-07 11:33:24.564185] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.718 [2024-10-07 11:33:24.564198] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.718 [2024-10-07 11:33:24.564255] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.718 [2024-10-07 11:33:24.572951] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.718 [2024-10-07 11:33:24.573667] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.718 [2024-10-07 11:33:24.573721] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.718 [2024-10-07 11:33:24.573757] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.718 [2024-10-07 11:33:24.576442] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.718 [2024-10-07 11:33:24.577150] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.718 [2024-10-07 11:33:24.577203] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.718 [2024-10-07 11:33:24.577223] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.718 [2024-10-07 11:33:24.577237] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.718 [2024-10-07 11:33:24.577440] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.718 [2024-10-07 11:33:24.577507] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.718 [2024-10-07 11:33:24.577534] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.718 [2024-10-07 11:33:24.577549] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.718 [2024-10-07 11:33:24.577701] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.718 [2024-10-07 11:33:24.577842] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.718 [2024-10-07 11:33:24.577866] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.719 [2024-10-07 11:33:24.577896] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.719 [2024-10-07 11:33:24.578000] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.719 [2024-10-07 11:33:24.583043] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.719 [2024-10-07 11:33:24.583162] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.719 [2024-10-07 11:33:24.583223] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.719 [2024-10-07 11:33:24.583242] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.719 [2024-10-07 11:33:24.583266] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.719 [2024-10-07 11:33:24.583289] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.719 [2024-10-07 11:33:24.583304] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.719 [2024-10-07 11:33:24.583318] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.719 [2024-10-07 11:33:24.585487] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.719 [2024-10-07 11:33:24.587242] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.719 [2024-10-07 11:33:24.587346] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.719 [2024-10-07 11:33:24.587376] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.719 [2024-10-07 11:33:24.587393] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.719 [2024-10-07 11:33:24.587417] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.719 [2024-10-07 11:33:24.587439] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.719 [2024-10-07 11:33:24.587453] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.719 [2024-10-07 11:33:24.587467] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.719 [2024-10-07 11:33:24.589074] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.719 [2024-10-07 11:33:24.593133] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.719 [2024-10-07 11:33:24.593262] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.719 [2024-10-07 11:33:24.593292] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.719 [2024-10-07 11:33:24.593308] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.719 [2024-10-07 11:33:24.593331] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.719 [2024-10-07 11:33:24.593353] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.719 [2024-10-07 11:33:24.593367] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.719 [2024-10-07 11:33:24.593380] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.719 [2024-10-07 11:33:24.593402] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.719 [2024-10-07 11:33:24.597647] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.719 [2024-10-07 11:33:24.597905] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.719 [2024-10-07 11:33:24.597937] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.719 [2024-10-07 11:33:24.597954] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.719 [2024-10-07 11:33:24.598058] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.719 [2024-10-07 11:33:24.599044] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.719 [2024-10-07 11:33:24.599083] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.719 [2024-10-07 11:33:24.599116] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.719 [2024-10-07 11:33:24.601675] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.719 [2024-10-07 11:33:24.605857] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.719 [2024-10-07 11:33:24.606004] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.719 [2024-10-07 11:33:24.606050] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.719 [2024-10-07 11:33:24.606067] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.719 [2024-10-07 11:33:24.606091] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.719 [2024-10-07 11:33:24.606114] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.719 [2024-10-07 11:33:24.606129] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.719 [2024-10-07 11:33:24.606142] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.719 [2024-10-07 11:33:24.606166] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.719 [2024-10-07 11:33:24.607767] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.719 [2024-10-07 11:33:24.607900] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.719 [2024-10-07 11:33:24.607929] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.719 [2024-10-07 11:33:24.607962] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.719 [2024-10-07 11:33:24.607985] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.719 [2024-10-07 11:33:24.608007] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.719 [2024-10-07 11:33:24.608022] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.719 [2024-10-07 11:33:24.608036] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.719 [2024-10-07 11:33:24.608059] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.719 [2024-10-07 11:33:24.618815] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.719 [2024-10-07 11:33:24.619596] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.719 [2024-10-07 11:33:24.619656] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.719 [2024-10-07 11:33:24.619691] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.719 [2024-10-07 11:33:24.619951] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.719 [2024-10-07 11:33:24.620019] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.719 [2024-10-07 11:33:24.620120] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.719 [2024-10-07 11:33:24.620148] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.719 [2024-10-07 11:33:24.620164] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.719 [2024-10-07 11:33:24.620179] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.719 [2024-10-07 11:33:24.620192] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.719 [2024-10-07 11:33:24.620205] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.719 [2024-10-07 11:33:24.620229] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.719 [2024-10-07 11:33:24.620248] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.719 [2024-10-07 11:33:24.620268] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.719 [2024-10-07 11:33:24.620282] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.719 [2024-10-07 11:33:24.620295] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.719 [2024-10-07 11:33:24.620315] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.719 [2024-10-07 11:33:24.629169] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.719 [2024-10-07 11:33:24.629378] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.719 [2024-10-07 11:33:24.629409] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.719 [2024-10-07 11:33:24.629426] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.719 [2024-10-07 11:33:24.631957] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.719 [2024-10-07 11:33:24.633959] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.719 [2024-10-07 11:33:24.633997] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.719 [2024-10-07 11:33:24.634030] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.719 [2024-10-07 11:33:24.634145] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.719 [2024-10-07 11:33:24.634175] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.719 [2024-10-07 11:33:24.634245] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.719 [2024-10-07 11:33:24.634274] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.719 [2024-10-07 11:33:24.634290] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.719 [2024-10-07 11:33:24.634314] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.719 [2024-10-07 11:33:24.634336] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.719 [2024-10-07 11:33:24.634350] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.719 [2024-10-07 11:33:24.634363] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.719 [2024-10-07 11:33:24.634400] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.719 [2024-10-07 11:33:24.639263] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.719 [2024-10-07 11:33:24.639367] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.719 [2024-10-07 11:33:24.639397] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.720 [2024-10-07 11:33:24.639414] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.720 [2024-10-07 11:33:24.639437] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.720 [2024-10-07 11:33:24.639460] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.720 [2024-10-07 11:33:24.639474] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.720 [2024-10-07 11:33:24.639487] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.720 [2024-10-07 11:33:24.639509] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.720 [2024-10-07 11:33:24.648056] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.720 [2024-10-07 11:33:24.648175] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.720 [2024-10-07 11:33:24.648205] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.720 [2024-10-07 11:33:24.648222] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.720 [2024-10-07 11:33:24.648245] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.720 [2024-10-07 11:33:24.648840] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.720 [2024-10-07 11:33:24.648877] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.720 [2024-10-07 11:33:24.648926] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.720 [2024-10-07 11:33:24.649038] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.720 [2024-10-07 11:33:24.649337] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.720 [2024-10-07 11:33:24.649423] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.720 [2024-10-07 11:33:24.649452] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.720 [2024-10-07 11:33:24.649468] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.720 [2024-10-07 11:33:24.649491] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.720 [2024-10-07 11:33:24.649512] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.720 [2024-10-07 11:33:24.649526] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.720 [2024-10-07 11:33:24.649539] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.720 [2024-10-07 11:33:24.649561] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.720 [2024-10-07 11:33:24.660538] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.720 [2024-10-07 11:33:24.660588] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.720 [2024-10-07 11:33:24.662975] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.720 [2024-10-07 11:33:24.663035] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.720 [2024-10-07 11:33:24.663056] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.720 [2024-10-07 11:33:24.663107] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.720 [2024-10-07 11:33:24.663130] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.720 [2024-10-07 11:33:24.663145] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.720 [2024-10-07 11:33:24.663716] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.720 [2024-10-07 11:33:24.663760] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.720 [2024-10-07 11:33:24.663858] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.720 [2024-10-07 11:33:24.663880] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.720 [2024-10-07 11:33:24.663895] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.720 [2024-10-07 11:33:24.663912] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.720 [2024-10-07 11:33:24.663925] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.720 [2024-10-07 11:33:24.663937] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.720 [2024-10-07 11:33:24.664193] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.720 [2024-10-07 11:33:24.664219] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.720 [2024-10-07 11:33:24.670676] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.720 [2024-10-07 11:33:24.670760] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.720 [2024-10-07 11:33:24.670863] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.720 [2024-10-07 11:33:24.670892] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.720 [2024-10-07 11:33:24.670907] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.720 [2024-10-07 11:33:24.670960] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.720 [2024-10-07 11:33:24.670983] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.720 [2024-10-07 11:33:24.670997] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.720 [2024-10-07 11:33:24.671014] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.720 [2024-10-07 11:33:24.671036] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.720 [2024-10-07 11:33:24.671052] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.720 [2024-10-07 11:33:24.671065] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.720 [2024-10-07 11:33:24.671077] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.720 [2024-10-07 11:33:24.671099] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.720 [2024-10-07 11:33:24.671128] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.720 [2024-10-07 11:33:24.671142] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.720 [2024-10-07 11:33:24.671154] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.720 [2024-10-07 11:33:24.671174] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.720 [2024-10-07 11:33:24.683842] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.720 [2024-10-07 11:33:24.683890] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.720 [2024-10-07 11:33:24.684105] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.720 [2024-10-07 11:33:24.684137] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.720 [2024-10-07 11:33:24.684154] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.720 [2024-10-07 11:33:24.684202] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.720 [2024-10-07 11:33:24.684225] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.720 [2024-10-07 11:33:24.684239] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.720 [2024-10-07 11:33:24.684470] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.720 [2024-10-07 11:33:24.684501] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.720 [2024-10-07 11:33:24.684555] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.720 [2024-10-07 11:33:24.684576] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.720 [2024-10-07 11:33:24.684590] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.720 [2024-10-07 11:33:24.684607] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.720 [2024-10-07 11:33:24.684620] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.720 [2024-10-07 11:33:24.684633] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.720 [2024-10-07 11:33:24.684655] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.720 [2024-10-07 11:33:24.684686] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.720 [2024-10-07 11:33:24.697713] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.720 [2024-10-07 11:33:24.697771] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.720 [2024-10-07 11:33:24.698116] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.720 [2024-10-07 11:33:24.698160] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.720 [2024-10-07 11:33:24.698180] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.720 [2024-10-07 11:33:24.698231] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.720 [2024-10-07 11:33:24.698253] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.720 [2024-10-07 11:33:24.698268] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.720 [2024-10-07 11:33:24.698321] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.720 [2024-10-07 11:33:24.698363] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.720 [2024-10-07 11:33:24.698385] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.720 [2024-10-07 11:33:24.698399] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.720 [2024-10-07 11:33:24.698413] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.720 [2024-10-07 11:33:24.698460] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.720 [2024-10-07 11:33:24.698474] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.721 [2024-10-07 11:33:24.698487] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.721 [2024-10-07 11:33:24.698514] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.721 [2024-10-07 11:33:24.698529] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.721 [2024-10-07 11:33:24.711418] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.721 [2024-10-07 11:33:24.711467] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.721 [2024-10-07 11:33:24.711553] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.721 [2024-10-07 11:33:24.711582] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.721 [2024-10-07 11:33:24.711599] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.721 [2024-10-07 11:33:24.711660] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.721 [2024-10-07 11:33:24.711686] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.721 [2024-10-07 11:33:24.711702] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.721 [2024-10-07 11:33:24.711727] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.721 [2024-10-07 11:33:24.711747] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.721 [2024-10-07 11:33:24.711767] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.721 [2024-10-07 11:33:24.711781] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.721 [2024-10-07 11:33:24.711794] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.721 [2024-10-07 11:33:24.711810] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.721 [2024-10-07 11:33:24.711825] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.721 [2024-10-07 11:33:24.711837] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.721 [2024-10-07 11:33:24.711860] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.721 [2024-10-07 11:33:24.711875] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.721 [2024-10-07 11:33:24.726344] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.721 [2024-10-07 11:33:24.726394] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.721 [2024-10-07 11:33:24.726586] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.721 [2024-10-07 11:33:24.726633] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.721 [2024-10-07 11:33:24.726668] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.721 [2024-10-07 11:33:24.726723] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.721 [2024-10-07 11:33:24.726747] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.721 [2024-10-07 11:33:24.726762] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.721 [2024-10-07 11:33:24.726786] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.721 [2024-10-07 11:33:24.726806] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.721 [2024-10-07 11:33:24.726826] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.721 [2024-10-07 11:33:24.726841] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.721 [2024-10-07 11:33:24.726855] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.721 [2024-10-07 11:33:24.726871] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.721 [2024-10-07 11:33:24.726885] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.721 [2024-10-07 11:33:24.726898] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.721 [2024-10-07 11:33:24.726921] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.721 [2024-10-07 11:33:24.726936] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.721 [2024-10-07 11:33:24.741065] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.721 [2024-10-07 11:33:24.741115] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.721 [2024-10-07 11:33:24.741202] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.721 [2024-10-07 11:33:24.741232] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.721 [2024-10-07 11:33:24.741249] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.721 [2024-10-07 11:33:24.741297] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.721 [2024-10-07 11:33:24.741320] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.721 [2024-10-07 11:33:24.741336] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.721 [2024-10-07 11:33:24.742314] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.721 [2024-10-07 11:33:24.742358] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.721 [2024-10-07 11:33:24.743034] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.721 [2024-10-07 11:33:24.743084] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.721 [2024-10-07 11:33:24.743102] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.721 [2024-10-07 11:33:24.743119] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.721 [2024-10-07 11:33:24.743133] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.721 [2024-10-07 11:33:24.743169] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.721 [2024-10-07 11:33:24.743436] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.721 [2024-10-07 11:33:24.743463] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.721 [2024-10-07 11:33:24.753967] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.721 [2024-10-07 11:33:24.754015] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.721 [2024-10-07 11:33:24.754738] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.721 [2024-10-07 11:33:24.754782] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.721 [2024-10-07 11:33:24.754802] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.721 [2024-10-07 11:33:24.754854] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.721 [2024-10-07 11:33:24.754877] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.721 [2024-10-07 11:33:24.754893] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.721 [2024-10-07 11:33:24.754986] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.721 [2024-10-07 11:33:24.755013] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.721 [2024-10-07 11:33:24.755033] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.721 [2024-10-07 11:33:24.755048] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.721 [2024-10-07 11:33:24.755062] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.721 [2024-10-07 11:33:24.755079] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.721 [2024-10-07 11:33:24.755093] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.721 [2024-10-07 11:33:24.755106] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.721 [2024-10-07 11:33:24.755129] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.721 [2024-10-07 11:33:24.755144] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.721 [2024-10-07 11:33:24.765030] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.721 [2024-10-07 11:33:24.765081] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.721 [2024-10-07 11:33:24.765214] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.721 [2024-10-07 11:33:24.765246] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.721 [2024-10-07 11:33:24.765263] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.721 [2024-10-07 11:33:24.765311] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.721 [2024-10-07 11:33:24.765335] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.721 [2024-10-07 11:33:24.765352] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.721 [2024-10-07 11:33:24.765375] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.721 [2024-10-07 11:33:24.765396] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.721 [2024-10-07 11:33:24.765432] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.721 [2024-10-07 11:33:24.765447] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.721 [2024-10-07 11:33:24.765461] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.721 [2024-10-07 11:33:24.765478] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.721 [2024-10-07 11:33:24.765492] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.721 [2024-10-07 11:33:24.765505] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.721 [2024-10-07 11:33:24.765528] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.721 [2024-10-07 11:33:24.765542] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.721 [2024-10-07 11:33:24.775937] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.721 [2024-10-07 11:33:24.775987] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.722 [2024-10-07 11:33:24.776867] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.722 [2024-10-07 11:33:24.776928] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.722 [2024-10-07 11:33:24.776949] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.722 [2024-10-07 11:33:24.777002] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.722 [2024-10-07 11:33:24.777026] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.722 [2024-10-07 11:33:24.777041] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.722 [2024-10-07 11:33:24.777424] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.722 [2024-10-07 11:33:24.777471] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.722 [2024-10-07 11:33:24.777734] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.722 [2024-10-07 11:33:24.777771] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.722 [2024-10-07 11:33:24.777788] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.722 [2024-10-07 11:33:24.777805] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.722 [2024-10-07 11:33:24.777819] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.722 [2024-10-07 11:33:24.777848] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.722 [2024-10-07 11:33:24.778054] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.722 [2024-10-07 11:33:24.778080] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.722 [2024-10-07 11:33:24.789423] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.722 [2024-10-07 11:33:24.789472] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.722 [2024-10-07 11:33:24.789701] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.722 [2024-10-07 11:33:24.789735] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.722 [2024-10-07 11:33:24.789767] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.722 [2024-10-07 11:33:24.789833] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.722 [2024-10-07 11:33:24.789856] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.722 [2024-10-07 11:33:24.789871] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.722 [2024-10-07 11:33:24.789931] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.722 [2024-10-07 11:33:24.789958] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.722 [2024-10-07 11:33:24.789979] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.722 [2024-10-07 11:33:24.789993] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.722 [2024-10-07 11:33:24.790006] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.722 [2024-10-07 11:33:24.790022] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.722 [2024-10-07 11:33:24.790035] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.722 [2024-10-07 11:33:24.790048] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.722 [2024-10-07 11:33:24.790070] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.722 [2024-10-07 11:33:24.790084] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.722 [2024-10-07 11:33:24.803386] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.722 [2024-10-07 11:33:24.803434] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.722 [2024-10-07 11:33:24.803521] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.722 [2024-10-07 11:33:24.803550] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.722 [2024-10-07 11:33:24.803567] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.722 [2024-10-07 11:33:24.803614] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.722 [2024-10-07 11:33:24.803637] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.722 [2024-10-07 11:33:24.803682] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.722 [2024-10-07 11:33:24.803707] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.722 [2024-10-07 11:33:24.803726] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.722 [2024-10-07 11:33:24.804545] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.722 [2024-10-07 11:33:24.804581] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.722 [2024-10-07 11:33:24.804616] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.722 [2024-10-07 11:33:24.804633] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.722 [2024-10-07 11:33:24.804647] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.722 [2024-10-07 11:33:24.804659] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.722 [2024-10-07 11:33:24.805208] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.722 [2024-10-07 11:33:24.805245] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.722 [2024-10-07 11:33:24.817642] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.722 [2024-10-07 11:33:24.817720] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.722 [2024-10-07 11:33:24.818008] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.722 [2024-10-07 11:33:24.818052] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.722 [2024-10-07 11:33:24.818073] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.722 [2024-10-07 11:33:24.818125] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.722 [2024-10-07 11:33:24.818148] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.722 [2024-10-07 11:33:24.818163] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.722 [2024-10-07 11:33:24.818355] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.722 [2024-10-07 11:33:24.818385] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.722 [2024-10-07 11:33:24.818583] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.722 [2024-10-07 11:33:24.818616] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.722 [2024-10-07 11:33:24.818632] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.722 [2024-10-07 11:33:24.818663] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.722 [2024-10-07 11:33:24.818680] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.722 [2024-10-07 11:33:24.818693] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.722 [2024-10-07 11:33:24.818885] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.722 [2024-10-07 11:33:24.818910] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.722 [2024-10-07 11:33:24.832260] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.722 [2024-10-07 11:33:24.832310] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.722 [2024-10-07 11:33:24.832396] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.722 [2024-10-07 11:33:24.832426] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.722 [2024-10-07 11:33:24.832442] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.722 [2024-10-07 11:33:24.832490] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.722 [2024-10-07 11:33:24.832514] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.723 [2024-10-07 11:33:24.832529] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.723 [2024-10-07 11:33:24.832553] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.723 [2024-10-07 11:33:24.832573] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.723 [2024-10-07 11:33:24.832611] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.723 [2024-10-07 11:33:24.832627] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.723 [2024-10-07 11:33:24.832640] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.723 [2024-10-07 11:33:24.832672] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.723 [2024-10-07 11:33:24.832688] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.723 [2024-10-07 11:33:24.832701] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.723 [2024-10-07 11:33:24.832724] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.723 [2024-10-07 11:33:24.832738] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.723 [2024-10-07 11:33:24.842635] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.723 [2024-10-07 11:33:24.842700] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.723 [2024-10-07 11:33:24.842787] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.723 [2024-10-07 11:33:24.842817] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.723 [2024-10-07 11:33:24.842834] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.723 [2024-10-07 11:33:24.842882] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.723 [2024-10-07 11:33:24.842905] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.723 [2024-10-07 11:33:24.842921] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.723 [2024-10-07 11:33:24.842944] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.723 [2024-10-07 11:33:24.842964] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.723 [2024-10-07 11:33:24.845784] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.723 [2024-10-07 11:33:24.845825] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.723 [2024-10-07 11:33:24.845844] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.723 [2024-10-07 11:33:24.845862] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.723 [2024-10-07 11:33:24.845876] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.723 [2024-10-07 11:33:24.845888] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.723 [2024-10-07 11:33:24.848221] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.723 [2024-10-07 11:33:24.848260] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.723 [2024-10-07 11:33:24.852760] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.723 [2024-10-07 11:33:24.852821] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.723 [2024-10-07 11:33:24.852897] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.723 [2024-10-07 11:33:24.852926] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.723 [2024-10-07 11:33:24.852943] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.723 [2024-10-07 11:33:24.853017] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.723 [2024-10-07 11:33:24.853043] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.723 [2024-10-07 11:33:24.853058] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.723 [2024-10-07 11:33:24.853076] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.723 [2024-10-07 11:33:24.853100] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.723 [2024-10-07 11:33:24.853117] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.723 [2024-10-07 11:33:24.853130] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.723 [2024-10-07 11:33:24.853144] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.723 [2024-10-07 11:33:24.853168] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.723 [2024-10-07 11:33:24.853182] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.723 [2024-10-07 11:33:24.853195] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.723 [2024-10-07 11:33:24.853208] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.723 [2024-10-07 11:33:24.853228] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.723 [2024-10-07 11:33:24.862852] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.723 [2024-10-07 11:33:24.862987] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.723 [2024-10-07 11:33:24.863019] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.723 [2024-10-07 11:33:24.863036] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.723 [2024-10-07 11:33:24.863060] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.723 [2024-10-07 11:33:24.863091] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.723 [2024-10-07 11:33:24.863153] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.723 [2024-10-07 11:33:24.863178] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.723 [2024-10-07 11:33:24.863206] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.723 [2024-10-07 11:33:24.863221] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.723 [2024-10-07 11:33:24.863233] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.723 [2024-10-07 11:33:24.863247] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.723 [2024-10-07 11:33:24.863272] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.723 [2024-10-07 11:33:24.863290] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.723 [2024-10-07 11:33:24.863311] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.723 [2024-10-07 11:33:24.863325] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.723 [2024-10-07 11:33:24.863338] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.723 [2024-10-07 11:33:24.863375] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.723 [2024-10-07 11:33:24.874447] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.723 [2024-10-07 11:33:24.874500] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.723 [2024-10-07 11:33:24.874898] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.723 [2024-10-07 11:33:24.874944] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.723 [2024-10-07 11:33:24.874964] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.723 [2024-10-07 11:33:24.875016] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.723 [2024-10-07 11:33:24.875041] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.723 [2024-10-07 11:33:24.875056] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.723 [2024-10-07 11:33:24.875598] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.723 [2024-10-07 11:33:24.875642] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.723 [2024-10-07 11:33:24.875755] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.723 [2024-10-07 11:33:24.875780] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.723 [2024-10-07 11:33:24.875795] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.723 [2024-10-07 11:33:24.875812] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.723 [2024-10-07 11:33:24.875826] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.723 [2024-10-07 11:33:24.875839] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.723 [2024-10-07 11:33:24.875862] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.723 [2024-10-07 11:33:24.875876] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.723 [2024-10-07 11:33:24.884884] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.723 [2024-10-07 11:33:24.885040] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.723 [2024-10-07 11:33:24.885121] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.723 [2024-10-07 11:33:24.885150] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.723 [2024-10-07 11:33:24.885167] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.723 [2024-10-07 11:33:24.885318] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.723 [2024-10-07 11:33:24.885346] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.723 [2024-10-07 11:33:24.885362] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.723 [2024-10-07 11:33:24.885380] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.723 [2024-10-07 11:33:24.886525] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.723 [2024-10-07 11:33:24.886565] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.723 [2024-10-07 11:33:24.886598] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.724 [2024-10-07 11:33:24.886614] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.724 [2024-10-07 11:33:24.889546] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.724 [2024-10-07 11:33:24.889587] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.724 [2024-10-07 11:33:24.889604] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.724 [2024-10-07 11:33:24.889619] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.724 [2024-10-07 11:33:24.890500] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.724 [2024-10-07 11:33:24.894967] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.724 [2024-10-07 11:33:24.895074] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.724 [2024-10-07 11:33:24.895104] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.724 [2024-10-07 11:33:24.895121] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.724 [2024-10-07 11:33:24.895144] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.724 [2024-10-07 11:33:24.895181] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.724 [2024-10-07 11:33:24.895213] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.724 [2024-10-07 11:33:24.895227] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.724 [2024-10-07 11:33:24.896348] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.724 [2024-10-07 11:33:24.896393] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.724 [2024-10-07 11:33:24.896677] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.724 [2024-10-07 11:33:24.896710] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.724 [2024-10-07 11:33:24.896727] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.724 [2024-10-07 11:33:24.896843] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.724 [2024-10-07 11:33:24.896973] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.724 [2024-10-07 11:33:24.897000] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.724 [2024-10-07 11:33:24.897015] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.724 [2024-10-07 11:33:24.897062] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.724 8795.75 IOPS, 34.36 MiB/s [2024-10-07T11:33:33.247Z] [2024-10-07 11:33:24.906004] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.724 [2024-10-07 11:33:24.906111] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.724 [2024-10-07 11:33:24.906142] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.724 [2024-10-07 11:33:24.906160] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.724 [2024-10-07 11:33:24.906184] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.724 [2024-10-07 11:33:24.906222] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.724 [2024-10-07 11:33:24.906237] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.724 [2024-10-07 11:33:24.906251] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.724 [2024-10-07 11:33:24.906274] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.724 [2024-10-07 11:33:24.906440] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.724 [2024-10-07 11:33:24.906515] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.724 [2024-10-07 11:33:24.906542] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.724 [2024-10-07 11:33:24.906558] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.724 [2024-10-07 11:33:24.906581] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.724 [2024-10-07 11:33:24.907331] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.724 [2024-10-07 11:33:24.907370] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.724 [2024-10-07 11:33:24.907388] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.724 [2024-10-07 11:33:24.907581] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.724 [2024-10-07 11:33:24.917465] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.724 [2024-10-07 11:33:24.917515] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.724 [2024-10-07 11:33:24.917632] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.724 [2024-10-07 11:33:24.917680] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.724 [2024-10-07 11:33:24.917699] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.724 [2024-10-07 11:33:24.917752] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.724 [2024-10-07 11:33:24.917776] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.724 [2024-10-07 11:33:24.917791] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.724 [2024-10-07 11:33:24.917969] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.724 [2024-10-07 11:33:24.917999] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.724 [2024-10-07 11:33:24.918055] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.724 [2024-10-07 11:33:24.918077] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.724 [2024-10-07 11:33:24.918091] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.724 [2024-10-07 11:33:24.918108] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.724 [2024-10-07 11:33:24.918122] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.724 [2024-10-07 11:33:24.918135] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.724 [2024-10-07 11:33:24.918587] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.724 [2024-10-07 11:33:24.918634] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.724 [2024-10-07 11:33:24.930664] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.724 [2024-10-07 11:33:24.930714] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.724 [2024-10-07 11:33:24.930938] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.724 [2024-10-07 11:33:24.930972] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.724 [2024-10-07 11:33:24.930989] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.724 [2024-10-07 11:33:24.931038] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.724 [2024-10-07 11:33:24.931065] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.724 [2024-10-07 11:33:24.931081] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.724 [2024-10-07 11:33:24.931293] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.724 [2024-10-07 11:33:24.931326] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.724 [2024-10-07 11:33:24.931446] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.724 [2024-10-07 11:33:24.931470] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.724 [2024-10-07 11:33:24.931484] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.724 [2024-10-07 11:33:24.931502] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.724 [2024-10-07 11:33:24.931516] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.724 [2024-10-07 11:33:24.931529] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.724 [2024-10-07 11:33:24.931630] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.724 [2024-10-07 11:33:24.931662] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.724 [2024-10-07 11:33:24.944265] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.724 [2024-10-07 11:33:24.944315] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.724 [2024-10-07 11:33:24.944402] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.724 [2024-10-07 11:33:24.944433] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.724 [2024-10-07 11:33:24.944450] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.724 [2024-10-07 11:33:24.944497] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.724 [2024-10-07 11:33:24.944521] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.724 [2024-10-07 11:33:24.944536] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.724 [2024-10-07 11:33:24.944559] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.724 [2024-10-07 11:33:24.944579] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.724 [2024-10-07 11:33:24.944599] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.724 [2024-10-07 11:33:24.944613] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.724 [2024-10-07 11:33:24.944662] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.724 [2024-10-07 11:33:24.944684] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.724 [2024-10-07 11:33:24.944698] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.724 [2024-10-07 11:33:24.944711] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.724 [2024-10-07 11:33:24.944735] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.725 [2024-10-07 11:33:24.944750] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.725 [2024-10-07 11:33:24.959312] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.725 [2024-10-07 11:33:24.959365] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.725 [2024-10-07 11:33:24.959538] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.725 [2024-10-07 11:33:24.959572] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.725 [2024-10-07 11:33:24.959589] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.725 [2024-10-07 11:33:24.959638] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.725 [2024-10-07 11:33:24.959688] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.725 [2024-10-07 11:33:24.959705] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.725 [2024-10-07 11:33:24.959730] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.725 [2024-10-07 11:33:24.959751] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.725 [2024-10-07 11:33:24.959771] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.725 [2024-10-07 11:33:24.959785] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.725 [2024-10-07 11:33:24.959799] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.725 [2024-10-07 11:33:24.959816] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.725 [2024-10-07 11:33:24.959830] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.725 [2024-10-07 11:33:24.959843] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.725 [2024-10-07 11:33:24.959866] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.725 [2024-10-07 11:33:24.959881] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.725 [2024-10-07 11:33:24.973255] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.725 [2024-10-07 11:33:24.973307] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.725 [2024-10-07 11:33:24.973399] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.725 [2024-10-07 11:33:24.973428] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.725 [2024-10-07 11:33:24.973445] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.725 [2024-10-07 11:33:24.973492] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.725 [2024-10-07 11:33:24.973515] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.725 [2024-10-07 11:33:24.973550] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.725 [2024-10-07 11:33:24.973575] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.725 [2024-10-07 11:33:24.973595] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.725 [2024-10-07 11:33:24.973615] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.725 [2024-10-07 11:33:24.973629] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.725 [2024-10-07 11:33:24.973643] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.725 [2024-10-07 11:33:24.973678] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.725 [2024-10-07 11:33:24.973693] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.725 [2024-10-07 11:33:24.973706] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.725 [2024-10-07 11:33:24.973730] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.725 [2024-10-07 11:33:24.973745] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.725 [2024-10-07 11:33:24.983595] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.725 [2024-10-07 11:33:24.983744] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.725 [2024-10-07 11:33:24.983943] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.725 [2024-10-07 11:33:24.984023] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.725 [2024-10-07 11:33:24.984064] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.725 [2024-10-07 11:33:24.984171] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.725 [2024-10-07 11:33:24.984220] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.725 [2024-10-07 11:33:24.984254] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.725 [2024-10-07 11:33:24.984306] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.725 [2024-10-07 11:33:24.984349] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.725 [2024-10-07 11:33:24.990089] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.725 [2024-10-07 11:33:24.990171] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.725 [2024-10-07 11:33:24.990209] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.725 [2024-10-07 11:33:24.990247] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.725 [2024-10-07 11:33:24.990278] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.725 [2024-10-07 11:33:24.990306] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.725 [2024-10-07 11:33:24.991540] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.725 [2024-10-07 11:33:24.991614] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.725 [2024-10-07 11:33:24.997877] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.725 [2024-10-07 11:33:24.997953] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.725 [2024-10-07 11:33:24.998318] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.725 [2024-10-07 11:33:24.998369] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.725 [2024-10-07 11:33:24.998393] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.725 [2024-10-07 11:33:24.998457] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.725 [2024-10-07 11:33:24.998485] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.725 [2024-10-07 11:33:24.998504] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.725 [2024-10-07 11:33:25.001863] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.725 [2024-10-07 11:33:25.001921] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.725 [2024-10-07 11:33:25.002563] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.725 [2024-10-07 11:33:25.002608] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.725 [2024-10-07 11:33:25.002630] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.725 [2024-10-07 11:33:25.002668] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.725 [2024-10-07 11:33:25.002689] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.725 [2024-10-07 11:33:25.002705] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.725 [2024-10-07 11:33:25.006608] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.725 [2024-10-07 11:33:25.006667] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.725 [2024-10-07 11:33:25.011129] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.725 [2024-10-07 11:33:25.011194] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.725 [2024-10-07 11:33:25.011949] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.725 [2024-10-07 11:33:25.012002] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.725 [2024-10-07 11:33:25.012027] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.725 [2024-10-07 11:33:25.012089] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.725 [2024-10-07 11:33:25.012118] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.725 [2024-10-07 11:33:25.012136] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.725 [2024-10-07 11:33:25.012459] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.725 [2024-10-07 11:33:25.012510] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.725 [2024-10-07 11:33:25.012724] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.725 [2024-10-07 11:33:25.012757] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.725 [2024-10-07 11:33:25.012775] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.725 [2024-10-07 11:33:25.012813] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.725 [2024-10-07 11:33:25.012833] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.725 [2024-10-07 11:33:25.012849] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.725 [2024-10-07 11:33:25.013010] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.725 [2024-10-07 11:33:25.013037] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.726 [2024-10-07 11:33:25.022703] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.726 [2024-10-07 11:33:25.022760] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.726 [2024-10-07 11:33:25.022977] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.726 [2024-10-07 11:33:25.023026] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.726 [2024-10-07 11:33:25.023050] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.726 [2024-10-07 11:33:25.023112] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.726 [2024-10-07 11:33:25.023141] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.726 [2024-10-07 11:33:25.023160] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.726 [2024-10-07 11:33:25.023302] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.726 [2024-10-07 11:33:25.023333] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.726 [2024-10-07 11:33:25.023578] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.726 [2024-10-07 11:33:25.023610] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.726 [2024-10-07 11:33:25.023628] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.726 [2024-10-07 11:33:25.023666] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.726 [2024-10-07 11:33:25.023688] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.726 [2024-10-07 11:33:25.023704] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.726 [2024-10-07 11:33:25.023793] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.726 [2024-10-07 11:33:25.023818] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.726 [2024-10-07 11:33:25.037635] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.726 [2024-10-07 11:33:25.037708] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.726 [2024-10-07 11:33:25.038029] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.726 [2024-10-07 11:33:25.038081] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.726 [2024-10-07 11:33:25.038105] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.726 [2024-10-07 11:33:25.038166] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.726 [2024-10-07 11:33:25.038194] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.726 [2024-10-07 11:33:25.038233] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.726 [2024-10-07 11:33:25.040137] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.726 [2024-10-07 11:33:25.040190] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.726 [2024-10-07 11:33:25.040679] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.726 [2024-10-07 11:33:25.040725] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.726 [2024-10-07 11:33:25.040745] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.726 [2024-10-07 11:33:25.040767] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.726 [2024-10-07 11:33:25.040784] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.726 [2024-10-07 11:33:25.040799] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.726 [2024-10-07 11:33:25.040916] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.726 [2024-10-07 11:33:25.040944] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.726 [2024-10-07 11:33:25.051501] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.726 [2024-10-07 11:33:25.051561] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.726 [2024-10-07 11:33:25.052085] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.726 [2024-10-07 11:33:25.052138] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.726 [2024-10-07 11:33:25.052163] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.726 [2024-10-07 11:33:25.052224] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.726 [2024-10-07 11:33:25.052252] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.726 [2024-10-07 11:33:25.052271] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.726 [2024-10-07 11:33:25.053195] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.726 [2024-10-07 11:33:25.053247] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.726 [2024-10-07 11:33:25.055858] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.726 [2024-10-07 11:33:25.055903] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.726 [2024-10-07 11:33:25.055925] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.726 [2024-10-07 11:33:25.055947] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.726 [2024-10-07 11:33:25.055965] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.726 [2024-10-07 11:33:25.055980] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.726 [2024-10-07 11:33:25.056719] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.726 [2024-10-07 11:33:25.056762] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.726 [2024-10-07 11:33:25.062058] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.726 [2024-10-07 11:33:25.062114] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.726 [2024-10-07 11:33:25.062247] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.726 [2024-10-07 11:33:25.062283] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.726 [2024-10-07 11:33:25.062303] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.726 [2024-10-07 11:33:25.062360] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.726 [2024-10-07 11:33:25.062389] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.726 [2024-10-07 11:33:25.062407] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.726 [2024-10-07 11:33:25.062436] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.726 [2024-10-07 11:33:25.062460] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.726 [2024-10-07 11:33:25.062484] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.726 [2024-10-07 11:33:25.062502] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.726 [2024-10-07 11:33:25.062518] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.726 [2024-10-07 11:33:25.062538] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.726 [2024-10-07 11:33:25.062555] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.726 [2024-10-07 11:33:25.062571] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.726 [2024-10-07 11:33:25.064517] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.726 [2024-10-07 11:33:25.064563] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.726 [2024-10-07 11:33:25.074789] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.726 [2024-10-07 11:33:25.074849] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.726 [2024-10-07 11:33:25.074956] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.726 [2024-10-07 11:33:25.074990] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.726 [2024-10-07 11:33:25.075011] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.726 [2024-10-07 11:33:25.075068] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.726 [2024-10-07 11:33:25.075095] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.726 [2024-10-07 11:33:25.075114] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.726 [2024-10-07 11:33:25.075483] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.726 [2024-10-07 11:33:25.075535] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.727 [2024-10-07 11:33:25.075788] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.727 [2024-10-07 11:33:25.075828] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.727 [2024-10-07 11:33:25.075849] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.727 [2024-10-07 11:33:25.075870] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.727 [2024-10-07 11:33:25.075906] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.727 [2024-10-07 11:33:25.075924] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.727 [2024-10-07 11:33:25.076068] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.727 [2024-10-07 11:33:25.076095] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.727 [2024-10-07 11:33:25.085351] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.727 [2024-10-07 11:33:25.085408] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.727 [2024-10-07 11:33:25.085512] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.727 [2024-10-07 11:33:25.085547] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.727 [2024-10-07 11:33:25.085567] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.727 [2024-10-07 11:33:25.085623] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.727 [2024-10-07 11:33:25.085667] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.727 [2024-10-07 11:33:25.085690] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.727 [2024-10-07 11:33:25.085718] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.727 [2024-10-07 11:33:25.085743] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.727 [2024-10-07 11:33:25.085767] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.727 [2024-10-07 11:33:25.085784] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.727 [2024-10-07 11:33:25.085801] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.727 [2024-10-07 11:33:25.085821] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.727 [2024-10-07 11:33:25.085838] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.727 [2024-10-07 11:33:25.085855] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.727 [2024-10-07 11:33:25.085883] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.727 [2024-10-07 11:33:25.085900] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.727 [2024-10-07 11:33:25.099576] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.727 [2024-10-07 11:33:25.099635] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.727 [2024-10-07 11:33:25.099870] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.727 [2024-10-07 11:33:25.099920] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.727 [2024-10-07 11:33:25.099944] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.727 [2024-10-07 11:33:25.100004] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.727 [2024-10-07 11:33:25.100032] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.727 [2024-10-07 11:33:25.100051] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.727 [2024-10-07 11:33:25.100098] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.727 [2024-10-07 11:33:25.100124] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.727 [2024-10-07 11:33:25.100148] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.727 [2024-10-07 11:33:25.100166] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.727 [2024-10-07 11:33:25.100182] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.727 [2024-10-07 11:33:25.100202] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.727 [2024-10-07 11:33:25.100219] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.727 [2024-10-07 11:33:25.100234] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.727 [2024-10-07 11:33:25.100263] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.727 [2024-10-07 11:33:25.100280] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.727 [2024-10-07 11:33:25.113221] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.727 [2024-10-07 11:33:25.113280] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.727 [2024-10-07 11:33:25.113584] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.727 [2024-10-07 11:33:25.113635] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.727 [2024-10-07 11:33:25.113676] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.727 [2024-10-07 11:33:25.115250] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.727 [2024-10-07 11:33:25.116206] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.727 [2024-10-07 11:33:25.116251] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.727 [2024-10-07 11:33:25.116272] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.727 [2024-10-07 11:33:25.116581] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.727 [2024-10-07 11:33:25.124362] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.727 [2024-10-07 11:33:25.124530] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.727 [2024-10-07 11:33:25.124570] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.727 [2024-10-07 11:33:25.124591] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.727 [2024-10-07 11:33:25.127789] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.727 [2024-10-07 11:33:25.128823] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.727 [2024-10-07 11:33:25.128858] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.727 [2024-10-07 11:33:25.128877] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.727 [2024-10-07 11:33:25.129150] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.727 [2024-10-07 11:33:25.134463] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.727 [2024-10-07 11:33:25.134613] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.727 [2024-10-07 11:33:25.134673] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.727 [2024-10-07 11:33:25.134698] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.727 [2024-10-07 11:33:25.134942] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.727 [2024-10-07 11:33:25.135165] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.727 [2024-10-07 11:33:25.135219] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.727 [2024-10-07 11:33:25.135240] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.727 [2024-10-07 11:33:25.135388] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.727 [2024-10-07 11:33:25.135771] bdev_nvme.c:2183:_bdev_nvme_reset_ctrlr_complete: *NOTICE*: Resetting controller successful. 00:22:37.727 [2024-10-07 11:33:25.146262] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.727 [2024-10-07 11:33:25.147048] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.727 [2024-10-07 11:33:25.147102] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.727 [2024-10-07 11:33:25.147127] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.727 [2024-10-07 11:33:25.147270] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.727 [2024-10-07 11:33:25.147321] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.727 [2024-10-07 11:33:25.147343] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.727 [2024-10-07 11:33:25.147360] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.727 [2024-10-07 11:33:25.147390] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.727 [2024-10-07 11:33:25.159100] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.727 [2024-10-07 11:33:25.159240] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.727 [2024-10-07 11:33:25.159277] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.727 [2024-10-07 11:33:25.159298] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.727 [2024-10-07 11:33:25.159327] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.727 [2024-10-07 11:33:25.159355] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.727 [2024-10-07 11:33:25.159373] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.727 [2024-10-07 11:33:25.159390] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.727 [2024-10-07 11:33:25.159418] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.727 [2024-10-07 11:33:25.169862] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.727 [2024-10-07 11:33:25.170113] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.727 [2024-10-07 11:33:25.170162] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.727 [2024-10-07 11:33:25.170185] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.728 [2024-10-07 11:33:25.170337] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.728 [2024-10-07 11:33:25.170481] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.728 [2024-10-07 11:33:25.170514] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.728 [2024-10-07 11:33:25.170542] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.728 [2024-10-07 11:33:25.171635] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.728 [2024-10-07 11:33:25.180454] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.728 [2024-10-07 11:33:25.180700] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.728 [2024-10-07 11:33:25.180750] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.728 [2024-10-07 11:33:25.180774] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.728 [2024-10-07 11:33:25.180930] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.728 [2024-10-07 11:33:25.185074] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.728 [2024-10-07 11:33:25.185122] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.728 [2024-10-07 11:33:25.185144] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.728 [2024-10-07 11:33:25.185554] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.728 [2024-10-07 11:33:25.191858] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.728 [2024-10-07 11:33:25.191999] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.728 [2024-10-07 11:33:25.192035] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.728 [2024-10-07 11:33:25.192055] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.728 [2024-10-07 11:33:25.192084] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.728 [2024-10-07 11:33:25.195348] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.728 [2024-10-07 11:33:25.195395] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.728 [2024-10-07 11:33:25.195417] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.728 [2024-10-07 11:33:25.195825] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.728 [2024-10-07 11:33:25.205349] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.728 [2024-10-07 11:33:25.205586] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.728 [2024-10-07 11:33:25.205635] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.728 [2024-10-07 11:33:25.205678] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.728 [2024-10-07 11:33:25.205710] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.728 [2024-10-07 11:33:25.205738] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.728 [2024-10-07 11:33:25.205756] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.728 [2024-10-07 11:33:25.205795] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.728 [2024-10-07 11:33:25.206175] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.728 [2024-10-07 11:33:25.218629] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.728 [2024-10-07 11:33:25.219790] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.728 [2024-10-07 11:33:25.219842] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.728 [2024-10-07 11:33:25.219867] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.728 [2024-10-07 11:33:25.219999] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.728 [2024-10-07 11:33:25.220047] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.728 [2024-10-07 11:33:25.220065] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.728 [2024-10-07 11:33:25.220082] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.728 [2024-10-07 11:33:25.220111] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.728 [2024-10-07 11:33:25.231198] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.728 [2024-10-07 11:33:25.232368] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.728 [2024-10-07 11:33:25.232432] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.728 [2024-10-07 11:33:25.232457] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.728 [2024-10-07 11:33:25.233152] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.728 [2024-10-07 11:33:25.233511] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.728 [2024-10-07 11:33:25.233554] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.728 [2024-10-07 11:33:25.233576] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.728 [2024-10-07 11:33:25.233692] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.728 [2024-10-07 11:33:25.245449] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.728 [2024-10-07 11:33:25.246833] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.728 [2024-10-07 11:33:25.246886] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.728 [2024-10-07 11:33:25.246917] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.728 [2024-10-07 11:33:25.247062] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.728 [2024-10-07 11:33:25.247098] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.728 [2024-10-07 11:33:25.247117] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.728 [2024-10-07 11:33:25.247134] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.728 [2024-10-07 11:33:25.247176] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.728 [2024-10-07 11:33:25.257313] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.728 [2024-10-07 11:33:25.257557] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.728 [2024-10-07 11:33:25.257618] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.728 [2024-10-07 11:33:25.257642] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.728 [2024-10-07 11:33:25.257793] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.728 [2024-10-07 11:33:25.258686] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.728 [2024-10-07 11:33:25.258728] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.728 [2024-10-07 11:33:25.258748] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.728 [2024-10-07 11:33:25.259589] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.728 [2024-10-07 11:33:25.269641] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.728 [2024-10-07 11:33:25.269932] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.728 [2024-10-07 11:33:25.269991] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.728 [2024-10-07 11:33:25.270015] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.728 [2024-10-07 11:33:25.270146] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.728 [2024-10-07 11:33:25.272692] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.728 [2024-10-07 11:33:25.272738] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.728 [2024-10-07 11:33:25.272773] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.728 [2024-10-07 11:33:25.273569] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.728 [2024-10-07 11:33:25.280918] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.728 [2024-10-07 11:33:25.281194] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.728 [2024-10-07 11:33:25.281243] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.728 [2024-10-07 11:33:25.281267] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.728 [2024-10-07 11:33:25.281441] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.728 [2024-10-07 11:33:25.281602] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.728 [2024-10-07 11:33:25.281662] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.728 [2024-10-07 11:33:25.281684] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.728 [2024-10-07 11:33:25.281815] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.728 [2024-10-07 11:33:25.292182] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.728 [2024-10-07 11:33:25.292433] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.728 [2024-10-07 11:33:25.292482] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.728 [2024-10-07 11:33:25.292506] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.728 [2024-10-07 11:33:25.292665] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.728 [2024-10-07 11:33:25.295588] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.728 [2024-10-07 11:33:25.295635] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.728 [2024-10-07 11:33:25.295676] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.728 [2024-10-07 11:33:25.296507] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.728 [2024-10-07 11:33:25.304994] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.729 [2024-10-07 11:33:25.305147] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.729 [2024-10-07 11:33:25.305195] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.729 [2024-10-07 11:33:25.305215] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.729 [2024-10-07 11:33:25.305244] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.729 [2024-10-07 11:33:25.305272] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.729 [2024-10-07 11:33:25.305290] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.729 [2024-10-07 11:33:25.305306] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.729 [2024-10-07 11:33:25.305335] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.729 [2024-10-07 11:33:25.319129] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.729 [2024-10-07 11:33:25.319391] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.729 [2024-10-07 11:33:25.319442] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.729 [2024-10-07 11:33:25.319467] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.729 [2024-10-07 11:33:25.319603] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.729 [2024-10-07 11:33:25.319770] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.729 [2024-10-07 11:33:25.319808] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.729 [2024-10-07 11:33:25.319828] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.729 [2024-10-07 11:33:25.322263] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.729 [2024-10-07 11:33:25.333805] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.729 [2024-10-07 11:33:25.334126] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.729 [2024-10-07 11:33:25.334178] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.729 [2024-10-07 11:33:25.334202] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.729 [2024-10-07 11:33:25.334376] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.729 [2024-10-07 11:33:25.334971] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.729 [2024-10-07 11:33:25.335015] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.729 [2024-10-07 11:33:25.335037] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.729 [2024-10-07 11:33:25.335283] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.729 [2024-10-07 11:33:25.345813] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.729 [2024-10-07 11:33:25.346067] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.729 [2024-10-07 11:33:25.346117] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.729 [2024-10-07 11:33:25.346141] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.729 [2024-10-07 11:33:25.346293] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.729 [2024-10-07 11:33:25.346436] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.729 [2024-10-07 11:33:25.346469] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.729 [2024-10-07 11:33:25.346490] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.729 [2024-10-07 11:33:25.346621] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.729 [2024-10-07 11:33:25.356724] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.729 [2024-10-07 11:33:25.356979] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.729 [2024-10-07 11:33:25.357029] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.729 [2024-10-07 11:33:25.357054] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.729 [2024-10-07 11:33:25.357484] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.729 [2024-10-07 11:33:25.358979] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.729 [2024-10-07 11:33:25.359017] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.729 [2024-10-07 11:33:25.359034] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.729 [2024-10-07 11:33:25.359248] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.729 [2024-10-07 11:33:25.366813] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.729 [2024-10-07 11:33:25.366918] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.729 [2024-10-07 11:33:25.366949] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.729 [2024-10-07 11:33:25.366965] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.729 [2024-10-07 11:33:25.366989] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.729 [2024-10-07 11:33:25.367011] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.729 [2024-10-07 11:33:25.367025] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.729 [2024-10-07 11:33:25.367038] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.729 [2024-10-07 11:33:25.367062] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.729 [2024-10-07 11:33:25.377198] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.729 [2024-10-07 11:33:25.377725] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.729 [2024-10-07 11:33:25.377783] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.729 [2024-10-07 11:33:25.377832] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.729 [2024-10-07 11:33:25.380166] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.729 [2024-10-07 11:33:25.380444] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.729 [2024-10-07 11:33:25.380480] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.729 [2024-10-07 11:33:25.380497] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.729 [2024-10-07 11:33:25.380552] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.729 [2024-10-07 11:33:25.387291] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.729 [2024-10-07 11:33:25.387400] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.729 [2024-10-07 11:33:25.387430] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.729 [2024-10-07 11:33:25.387446] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.729 [2024-10-07 11:33:25.387470] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.729 [2024-10-07 11:33:25.387492] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.729 [2024-10-07 11:33:25.387506] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.729 [2024-10-07 11:33:25.387519] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.729 [2024-10-07 11:33:25.387542] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.729 [2024-10-07 11:33:25.401453] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.729 [2024-10-07 11:33:25.401557] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.729 [2024-10-07 11:33:25.401587] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.729 [2024-10-07 11:33:25.401604] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.729 [2024-10-07 11:33:25.401628] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.729 [2024-10-07 11:33:25.401666] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.729 [2024-10-07 11:33:25.401684] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.729 [2024-10-07 11:33:25.401697] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.729 [2024-10-07 11:33:25.401720] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.729 [2024-10-07 11:33:25.414868] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.729 [2024-10-07 11:33:25.415761] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.729 [2024-10-07 11:33:25.415805] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.729 [2024-10-07 11:33:25.415825] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.729 [2024-10-07 11:33:25.416579] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.729 [2024-10-07 11:33:25.416909] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.729 [2024-10-07 11:33:25.416946] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.729 [2024-10-07 11:33:25.416963] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.729 [2024-10-07 11:33:25.417255] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.729 [2024-10-07 11:33:25.425247] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.729 [2024-10-07 11:33:25.425457] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.729 [2024-10-07 11:33:25.425497] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.729 [2024-10-07 11:33:25.425516] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.729 [2024-10-07 11:33:25.430239] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.729 [2024-10-07 11:33:25.430559] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.729 [2024-10-07 11:33:25.430598] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.729 [2024-10-07 11:33:25.430626] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.729 [2024-10-07 11:33:25.431594] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.730 [2024-10-07 11:33:25.435563] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.730 [2024-10-07 11:33:25.435694] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.730 [2024-10-07 11:33:25.435740] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.730 [2024-10-07 11:33:25.435756] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.730 [2024-10-07 11:33:25.435780] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.730 [2024-10-07 11:33:25.435968] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.730 [2024-10-07 11:33:25.435995] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.730 [2024-10-07 11:33:25.436009] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.730 [2024-10-07 11:33:25.436133] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.730 [2024-10-07 11:33:25.447405] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.730 [2024-10-07 11:33:25.447519] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.730 [2024-10-07 11:33:25.447550] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.730 [2024-10-07 11:33:25.447566] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.730 [2024-10-07 11:33:25.447590] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.730 [2024-10-07 11:33:25.447612] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.730 [2024-10-07 11:33:25.447627] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.730 [2024-10-07 11:33:25.447640] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.730 [2024-10-07 11:33:25.448221] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.730 [2024-10-07 11:33:25.459496] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.730 [2024-10-07 11:33:25.459916] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.730 [2024-10-07 11:33:25.459961] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.730 [2024-10-07 11:33:25.459981] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.730 [2024-10-07 11:33:25.460034] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.730 [2024-10-07 11:33:25.460062] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.730 [2024-10-07 11:33:25.460077] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.730 [2024-10-07 11:33:25.460090] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.730 [2024-10-07 11:33:25.460114] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.730 [2024-10-07 11:33:25.473013] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.730 [2024-10-07 11:33:25.473134] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.730 [2024-10-07 11:33:25.473164] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.730 [2024-10-07 11:33:25.473180] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.730 [2024-10-07 11:33:25.473562] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.730 [2024-10-07 11:33:25.473731] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.730 [2024-10-07 11:33:25.473757] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.730 [2024-10-07 11:33:25.473772] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.730 [2024-10-07 11:33:25.473833] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.730 [2024-10-07 11:33:25.486227] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.730 [2024-10-07 11:33:25.486394] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.730 [2024-10-07 11:33:25.486425] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.730 [2024-10-07 11:33:25.486442] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.730 [2024-10-07 11:33:25.486467] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.730 [2024-10-07 11:33:25.486490] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.730 [2024-10-07 11:33:25.486504] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.730 [2024-10-07 11:33:25.486518] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.730 [2024-10-07 11:33:25.486542] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.730 [2024-10-07 11:33:25.500454] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.730 [2024-10-07 11:33:25.500560] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.730 [2024-10-07 11:33:25.500590] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.730 [2024-10-07 11:33:25.500629] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.730 [2024-10-07 11:33:25.500672] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.730 [2024-10-07 11:33:25.500699] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.730 [2024-10-07 11:33:25.500713] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.730 [2024-10-07 11:33:25.500726] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.730 [2024-10-07 11:33:25.500750] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.730 [2024-10-07 11:33:25.514549] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.730 [2024-10-07 11:33:25.514667] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.730 [2024-10-07 11:33:25.514698] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.730 [2024-10-07 11:33:25.514715] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.730 [2024-10-07 11:33:25.514739] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.730 [2024-10-07 11:33:25.514761] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.730 [2024-10-07 11:33:25.514775] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.730 [2024-10-07 11:33:25.514789] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.730 [2024-10-07 11:33:25.514812] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.730 [2024-10-07 11:33:25.528466] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.730 [2024-10-07 11:33:25.528720] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.730 [2024-10-07 11:33:25.528753] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.730 [2024-10-07 11:33:25.528770] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.730 [2024-10-07 11:33:25.528915] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.730 [2024-10-07 11:33:25.528972] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.730 [2024-10-07 11:33:25.528993] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.730 [2024-10-07 11:33:25.529007] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.730 [2024-10-07 11:33:25.529032] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.730 [2024-10-07 11:33:25.541494] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.730 [2024-10-07 11:33:25.541708] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.730 [2024-10-07 11:33:25.541745] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.730 [2024-10-07 11:33:25.541763] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.730 [2024-10-07 11:33:25.541788] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.730 [2024-10-07 11:33:25.541811] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.730 [2024-10-07 11:33:25.541842] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.730 [2024-10-07 11:33:25.541856] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.730 [2024-10-07 11:33:25.543127] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.730 [2024-10-07 11:33:25.553724] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.730 [2024-10-07 11:33:25.555652] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.731 [2024-10-07 11:33:25.555707] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.731 [2024-10-07 11:33:25.555728] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.731 [2024-10-07 11:33:25.556258] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.731 [2024-10-07 11:33:25.556347] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.731 [2024-10-07 11:33:25.556368] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.731 [2024-10-07 11:33:25.556382] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.731 [2024-10-07 11:33:25.556407] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.731 [2024-10-07 11:33:25.565917] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.731 [2024-10-07 11:33:25.566159] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.731 [2024-10-07 11:33:25.566191] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.731 [2024-10-07 11:33:25.566208] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.731 [2024-10-07 11:33:25.566318] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.731 [2024-10-07 11:33:25.566438] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.731 [2024-10-07 11:33:25.566475] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.731 [2024-10-07 11:33:25.566493] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.731 [2024-10-07 11:33:25.566597] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.731 [2024-10-07 11:33:25.577933] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.731 [2024-10-07 11:33:25.580224] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.731 [2024-10-07 11:33:25.580284] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.731 [2024-10-07 11:33:25.580304] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.731 [2024-10-07 11:33:25.580407] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.731 [2024-10-07 11:33:25.580437] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.731 [2024-10-07 11:33:25.580452] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.731 [2024-10-07 11:33:25.580465] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.731 [2024-10-07 11:33:25.580489] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.731 [2024-10-07 11:33:25.588086] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.731 [2024-10-07 11:33:25.588221] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.731 [2024-10-07 11:33:25.588252] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.731 [2024-10-07 11:33:25.588268] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.731 [2024-10-07 11:33:25.588292] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.731 [2024-10-07 11:33:25.588468] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.731 [2024-10-07 11:33:25.588493] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.731 [2024-10-07 11:33:25.588507] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.731 [2024-10-07 11:33:25.588565] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.731 [2024-10-07 11:33:25.600334] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.731 [2024-10-07 11:33:25.600681] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.731 [2024-10-07 11:33:25.600724] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.731 [2024-10-07 11:33:25.600744] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.731 [2024-10-07 11:33:25.600951] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.731 [2024-10-07 11:33:25.601029] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.731 [2024-10-07 11:33:25.601053] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.731 [2024-10-07 11:33:25.601067] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.731 [2024-10-07 11:33:25.601241] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.731 [2024-10-07 11:33:25.612984] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.731 [2024-10-07 11:33:25.613385] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.731 [2024-10-07 11:33:25.613429] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.731 [2024-10-07 11:33:25.613449] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.731 [2024-10-07 11:33:25.613701] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.731 [2024-10-07 11:33:25.614357] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.731 [2024-10-07 11:33:25.614392] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.731 [2024-10-07 11:33:25.614425] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.731 [2024-10-07 11:33:25.614682] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.731 [2024-10-07 11:33:25.629240] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.731 [2024-10-07 11:33:25.629438] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.731 [2024-10-07 11:33:25.629471] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.731 [2024-10-07 11:33:25.629488] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.731 [2024-10-07 11:33:25.629544] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.731 [2024-10-07 11:33:25.629568] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.731 [2024-10-07 11:33:25.629582] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.731 [2024-10-07 11:33:25.629595] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.731 [2024-10-07 11:33:25.629617] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.731 [2024-10-07 11:33:25.641948] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.731 [2024-10-07 11:33:25.642676] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.731 [2024-10-07 11:33:25.642747] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.731 [2024-10-07 11:33:25.642768] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.731 [2024-10-07 11:33:25.642910] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.731 [2024-10-07 11:33:25.642941] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.731 [2024-10-07 11:33:25.642957] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.731 [2024-10-07 11:33:25.642971] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.731 [2024-10-07 11:33:25.642994] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.731 [2024-10-07 11:33:25.656450] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.731 [2024-10-07 11:33:25.657315] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.731 [2024-10-07 11:33:25.657358] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.731 [2024-10-07 11:33:25.657378] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.731 [2024-10-07 11:33:25.657491] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.731 [2024-10-07 11:33:25.657520] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.731 [2024-10-07 11:33:25.657535] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.731 [2024-10-07 11:33:25.657548] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.731 [2024-10-07 11:33:25.657571] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.731 [2024-10-07 11:33:25.669475] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.731 [2024-10-07 11:33:25.669675] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.731 [2024-10-07 11:33:25.669708] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.731 [2024-10-07 11:33:25.669726] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.731 [2024-10-07 11:33:25.669751] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.731 [2024-10-07 11:33:25.669905] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.731 [2024-10-07 11:33:25.669930] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.731 [2024-10-07 11:33:25.669960] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.731 [2024-10-07 11:33:25.670212] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.731 [2024-10-07 11:33:25.683327] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.731 [2024-10-07 11:33:25.683433] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.731 [2024-10-07 11:33:25.683464] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.731 [2024-10-07 11:33:25.683480] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.731 [2024-10-07 11:33:25.684083] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.731 [2024-10-07 11:33:25.684199] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.731 [2024-10-07 11:33:25.684222] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.732 [2024-10-07 11:33:25.684237] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.732 [2024-10-07 11:33:25.684261] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.732 [2024-10-07 11:33:25.693952] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.732 [2024-10-07 11:33:25.694177] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.732 [2024-10-07 11:33:25.694209] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.732 [2024-10-07 11:33:25.694226] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.732 [2024-10-07 11:33:25.694325] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.732 [2024-10-07 11:33:25.694851] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.732 [2024-10-07 11:33:25.694886] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.732 [2024-10-07 11:33:25.694919] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.732 [2024-10-07 11:33:25.695150] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.732 [2024-10-07 11:33:25.705193] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.732 [2024-10-07 11:33:25.705398] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.732 [2024-10-07 11:33:25.705429] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.732 [2024-10-07 11:33:25.705445] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.732 [2024-10-07 11:33:25.706258] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.732 [2024-10-07 11:33:25.708740] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.732 [2024-10-07 11:33:25.708778] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.732 [2024-10-07 11:33:25.708795] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.732 [2024-10-07 11:33:25.709144] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.732 [2024-10-07 11:33:25.715413] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.732 [2024-10-07 11:33:25.715517] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.732 [2024-10-07 11:33:25.715563] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.732 [2024-10-07 11:33:25.715582] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.732 [2024-10-07 11:33:25.715606] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.732 [2024-10-07 11:33:25.715640] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.732 [2024-10-07 11:33:25.715670] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.732 [2024-10-07 11:33:25.715684] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.732 [2024-10-07 11:33:25.715708] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.732 [2024-10-07 11:33:25.726724] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.732 [2024-10-07 11:33:25.726924] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.732 [2024-10-07 11:33:25.726970] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.732 [2024-10-07 11:33:25.726990] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.732 [2024-10-07 11:33:25.727015] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.732 [2024-10-07 11:33:25.727038] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.732 [2024-10-07 11:33:25.727053] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.732 [2024-10-07 11:33:25.727066] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.732 [2024-10-07 11:33:25.727090] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.732 [2024-10-07 11:33:25.739887] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.732 [2024-10-07 11:33:25.740645] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.732 [2024-10-07 11:33:25.740702] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.732 [2024-10-07 11:33:25.740722] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.732 [2024-10-07 11:33:25.740972] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.732 [2024-10-07 11:33:25.741183] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.732 [2024-10-07 11:33:25.741218] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.732 [2024-10-07 11:33:25.741235] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.732 [2024-10-07 11:33:25.741295] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.732 [2024-10-07 11:33:25.750425] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.732 [2024-10-07 11:33:25.750617] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.732 [2024-10-07 11:33:25.750660] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.732 [2024-10-07 11:33:25.750681] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.732 [2024-10-07 11:33:25.750815] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.732 [2024-10-07 11:33:25.750954] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.732 [2024-10-07 11:33:25.750987] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.732 [2024-10-07 11:33:25.751005] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.732 [2024-10-07 11:33:25.751110] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.732 [2024-10-07 11:33:25.760807] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.732 [2024-10-07 11:33:25.761111] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.732 [2024-10-07 11:33:25.761154] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.732 [2024-10-07 11:33:25.761174] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.732 [2024-10-07 11:33:25.761230] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.732 [2024-10-07 11:33:25.761259] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.732 [2024-10-07 11:33:25.761274] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.732 [2024-10-07 11:33:25.761287] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.732 [2024-10-07 11:33:25.761311] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.732 [2024-10-07 11:33:25.771386] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.732 [2024-10-07 11:33:25.771601] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.732 [2024-10-07 11:33:25.771633] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.732 [2024-10-07 11:33:25.771664] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.732 [2024-10-07 11:33:25.771853] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.732 [2024-10-07 11:33:25.772010] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.732 [2024-10-07 11:33:25.772043] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.732 [2024-10-07 11:33:25.772060] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.732 [2024-10-07 11:33:25.772163] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.732 [2024-10-07 11:33:25.781620] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.732 [2024-10-07 11:33:25.781735] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.732 [2024-10-07 11:33:25.781765] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.732 [2024-10-07 11:33:25.781782] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.732 [2024-10-07 11:33:25.781806] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.732 [2024-10-07 11:33:25.781829] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.732 [2024-10-07 11:33:25.781843] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.732 [2024-10-07 11:33:25.781856] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.732 [2024-10-07 11:33:25.781894] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.732 [2024-10-07 11:33:25.792917] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.732 [2024-10-07 11:33:25.793022] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.732 [2024-10-07 11:33:25.793053] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.732 [2024-10-07 11:33:25.793069] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.732 [2024-10-07 11:33:25.793093] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.732 [2024-10-07 11:33:25.793115] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.732 [2024-10-07 11:33:25.793129] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.732 [2024-10-07 11:33:25.793142] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.732 [2024-10-07 11:33:25.793165] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.732 [2024-10-07 11:33:25.802997] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.732 [2024-10-07 11:33:25.803117] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.732 [2024-10-07 11:33:25.803147] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.732 [2024-10-07 11:33:25.803163] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.732 [2024-10-07 11:33:25.804704] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.732 [2024-10-07 11:33:25.805280] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.733 [2024-10-07 11:33:25.805315] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.733 [2024-10-07 11:33:25.805348] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.733 [2024-10-07 11:33:25.805533] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.733 [2024-10-07 11:33:25.813075] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.733 [2024-10-07 11:33:25.813208] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.733 [2024-10-07 11:33:25.813238] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.733 [2024-10-07 11:33:25.813254] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.733 [2024-10-07 11:33:25.813277] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.733 [2024-10-07 11:33:25.813299] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.733 [2024-10-07 11:33:25.813313] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.733 [2024-10-07 11:33:25.813327] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.733 [2024-10-07 11:33:25.813350] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.733 [2024-10-07 11:33:25.825824] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.733 [2024-10-07 11:33:25.826178] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.733 [2024-10-07 11:33:25.826223] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.733 [2024-10-07 11:33:25.826257] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.733 [2024-10-07 11:33:25.826330] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.733 [2024-10-07 11:33:25.826361] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.733 [2024-10-07 11:33:25.826377] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.733 [2024-10-07 11:33:25.826390] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.733 [2024-10-07 11:33:25.826429] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.733 [2024-10-07 11:33:25.839506] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.733 [2024-10-07 11:33:25.840641] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.733 [2024-10-07 11:33:25.840709] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.733 [2024-10-07 11:33:25.840747] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.733 [2024-10-07 11:33:25.840892] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.733 [2024-10-07 11:33:25.840923] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.733 [2024-10-07 11:33:25.840938] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.733 [2024-10-07 11:33:25.840952] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.733 [2024-10-07 11:33:25.840975] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.733 [2024-10-07 11:33:25.854667] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.733 [2024-10-07 11:33:25.854802] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.733 [2024-10-07 11:33:25.854832] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.733 [2024-10-07 11:33:25.854848] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.733 [2024-10-07 11:33:25.854871] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.733 [2024-10-07 11:33:25.854892] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.733 [2024-10-07 11:33:25.854906] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.733 [2024-10-07 11:33:25.854920] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.733 [2024-10-07 11:33:25.854942] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.733 [2024-10-07 11:33:25.864926] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.733 [2024-10-07 11:33:25.867693] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.733 [2024-10-07 11:33:25.867799] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.733 [2024-10-07 11:33:25.867819] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.733 [2024-10-07 11:33:25.869790] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.733 [2024-10-07 11:33:25.870279] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.733 [2024-10-07 11:33:25.870332] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.733 [2024-10-07 11:33:25.870350] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.733 [2024-10-07 11:33:25.871157] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.733 [2024-10-07 11:33:25.876119] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.733 [2024-10-07 11:33:25.876326] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.733 [2024-10-07 11:33:25.876356] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.733 [2024-10-07 11:33:25.876372] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.733 [2024-10-07 11:33:25.876506] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.733 [2024-10-07 11:33:25.876659] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.733 [2024-10-07 11:33:25.876690] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.733 [2024-10-07 11:33:25.876712] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.733 [2024-10-07 11:33:25.876812] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.733 [2024-10-07 11:33:25.886211] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.733 [2024-10-07 11:33:25.886326] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.733 [2024-10-07 11:33:25.886355] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.733 [2024-10-07 11:33:25.886371] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.733 [2024-10-07 11:33:25.886394] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.733 [2024-10-07 11:33:25.886447] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.733 [2024-10-07 11:33:25.886461] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.733 [2024-10-07 11:33:25.886475] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.733 [2024-10-07 11:33:25.886498] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.733 [2024-10-07 11:33:25.896901] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.733 [2024-10-07 11:33:25.897020] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.733 [2024-10-07 11:33:25.897050] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.733 [2024-10-07 11:33:25.897065] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.733 [2024-10-07 11:33:25.897088] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.733 [2024-10-07 11:33:25.897109] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.733 [2024-10-07 11:33:25.897123] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.733 [2024-10-07 11:33:25.897135] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.733 [2024-10-07 11:33:25.897157] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.733 8820.78 IOPS, 34.46 MiB/s [2024-10-07T11:33:33.256Z] [2024-10-07 11:33:25.907618] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.733 [2024-10-07 11:33:25.907772] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.733 [2024-10-07 11:33:25.907802] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.733 [2024-10-07 11:33:25.907818] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.733 [2024-10-07 11:33:25.907841] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.733 [2024-10-07 11:33:25.907862] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.733 [2024-10-07 11:33:25.907876] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.733 [2024-10-07 11:33:25.907889] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.733 [2024-10-07 11:33:25.907912] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.733 [2024-10-07 11:33:25.917801] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.733 [2024-10-07 11:33:25.917906] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.733 [2024-10-07 11:33:25.917937] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.733 [2024-10-07 11:33:25.917953] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.733 [2024-10-07 11:33:25.917977] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.733 [2024-10-07 11:33:25.917999] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.733 [2024-10-07 11:33:25.918013] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.733 [2024-10-07 11:33:25.918028] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.733 [2024-10-07 11:33:25.918204] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.734 [2024-10-07 11:33:25.930701] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.734 [2024-10-07 11:33:25.930898] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.734 [2024-10-07 11:33:25.930930] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.734 [2024-10-07 11:33:25.930947] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.734 [2024-10-07 11:33:25.931051] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.734 [2024-10-07 11:33:25.931155] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.734 [2024-10-07 11:33:25.931173] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.734 [2024-10-07 11:33:25.931199] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.734 [2024-10-07 11:33:25.931518] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.734 [2024-10-07 11:33:25.942139] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.734 [2024-10-07 11:33:25.942244] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.734 [2024-10-07 11:33:25.942274] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.734 [2024-10-07 11:33:25.942307] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.734 [2024-10-07 11:33:25.942332] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.734 [2024-10-07 11:33:25.942357] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.734 [2024-10-07 11:33:25.942371] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.734 [2024-10-07 11:33:25.942385] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.734 [2024-10-07 11:33:25.942408] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.734 [2024-10-07 11:33:25.957988] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.734 [2024-10-07 11:33:25.958338] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.734 [2024-10-07 11:33:25.958382] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.734 [2024-10-07 11:33:25.958403] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.734 [2024-10-07 11:33:25.958459] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.734 [2024-10-07 11:33:25.958488] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.734 [2024-10-07 11:33:25.958503] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.734 [2024-10-07 11:33:25.958517] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.734 [2024-10-07 11:33:25.958540] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.734 [2024-10-07 11:33:25.969718] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.734 [2024-10-07 11:33:25.969940] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.734 [2024-10-07 11:33:25.969971] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.734 [2024-10-07 11:33:25.969988] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.734 [2024-10-07 11:33:25.970122] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.734 [2024-10-07 11:33:25.970247] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.734 [2024-10-07 11:33:25.970268] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.734 [2024-10-07 11:33:25.970282] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.734 [2024-10-07 11:33:25.970385] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.734 [2024-10-07 11:33:25.979793] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.734 [2024-10-07 11:33:25.979896] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.734 [2024-10-07 11:33:25.979926] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.734 [2024-10-07 11:33:25.979942] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.734 [2024-10-07 11:33:25.979965] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.734 [2024-10-07 11:33:25.979988] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.734 [2024-10-07 11:33:25.980017] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.734 [2024-10-07 11:33:25.980033] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.734 [2024-10-07 11:33:25.980056] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.734 [2024-10-07 11:33:25.992135] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.734 [2024-10-07 11:33:25.994006] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.734 [2024-10-07 11:33:25.994050] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.734 [2024-10-07 11:33:25.994071] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.734 [2024-10-07 11:33:25.994701] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.734 [2024-10-07 11:33:25.995091] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.734 [2024-10-07 11:33:25.995126] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.734 [2024-10-07 11:33:25.995144] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.734 [2024-10-07 11:33:25.995230] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.734 [2024-10-07 11:33:26.002663] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.734 [2024-10-07 11:33:26.002888] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.734 [2024-10-07 11:33:26.002938] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.734 [2024-10-07 11:33:26.002965] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.734 [2024-10-07 11:33:26.003092] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.734 [2024-10-07 11:33:26.003224] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.734 [2024-10-07 11:33:26.003248] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.734 [2024-10-07 11:33:26.003262] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.734 [2024-10-07 11:33:26.003370] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.734 [2024-10-07 11:33:26.012969] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.734 [2024-10-07 11:33:26.013075] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.734 [2024-10-07 11:33:26.013105] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.734 [2024-10-07 11:33:26.013121] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.734 [2024-10-07 11:33:26.013145] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.734 [2024-10-07 11:33:26.013167] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.734 [2024-10-07 11:33:26.013182] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.734 [2024-10-07 11:33:26.013195] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.734 [2024-10-07 11:33:26.013218] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.734 [2024-10-07 11:33:26.023313] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.734 [2024-10-07 11:33:26.023438] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.734 [2024-10-07 11:33:26.023469] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.734 [2024-10-07 11:33:26.023485] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.734 [2024-10-07 11:33:26.023509] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.734 [2024-10-07 11:33:26.023531] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.734 [2024-10-07 11:33:26.023546] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.734 [2024-10-07 11:33:26.023559] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.734 [2024-10-07 11:33:26.023582] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.734 [2024-10-07 11:33:26.033666] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.734 [2024-10-07 11:33:26.034315] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.734 [2024-10-07 11:33:26.034357] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.734 [2024-10-07 11:33:26.034377] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.734 [2024-10-07 11:33:26.035644] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.734 [2024-10-07 11:33:26.035917] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.734 [2024-10-07 11:33:26.035962] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.734 [2024-10-07 11:33:26.035980] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.734 [2024-10-07 11:33:26.036027] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.734 [2024-10-07 11:33:26.043799] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.734 [2024-10-07 11:33:26.044253] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.734 [2024-10-07 11:33:26.044294] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.734 [2024-10-07 11:33:26.044314] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.734 [2024-10-07 11:33:26.044340] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.734 [2024-10-07 11:33:26.044362] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.734 [2024-10-07 11:33:26.044377] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.735 [2024-10-07 11:33:26.044390] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.735 [2024-10-07 11:33:26.044414] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.735 [2024-10-07 11:33:26.054613] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.735 [2024-10-07 11:33:26.054729] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.735 [2024-10-07 11:33:26.054760] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.735 [2024-10-07 11:33:26.054777] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.735 [2024-10-07 11:33:26.054817] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.735 [2024-10-07 11:33:26.054857] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.735 [2024-10-07 11:33:26.054876] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.735 [2024-10-07 11:33:26.054890] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.735 [2024-10-07 11:33:26.054913] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.735 [2024-10-07 11:33:26.064701] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.735 [2024-10-07 11:33:26.064821] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.735 [2024-10-07 11:33:26.064851] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.735 [2024-10-07 11:33:26.064868] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.735 [2024-10-07 11:33:26.064892] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.735 [2024-10-07 11:33:26.064914] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.735 [2024-10-07 11:33:26.064928] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.735 [2024-10-07 11:33:26.064942] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.735 [2024-10-07 11:33:26.064965] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.735 [2024-10-07 11:33:26.076531] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.735 [2024-10-07 11:33:26.076637] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.735 [2024-10-07 11:33:26.076680] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.735 [2024-10-07 11:33:26.076699] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.735 [2024-10-07 11:33:26.076723] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.735 [2024-10-07 11:33:26.076746] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.735 [2024-10-07 11:33:26.076760] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.735 [2024-10-07 11:33:26.076773] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.735 [2024-10-07 11:33:26.076796] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.735 [2024-10-07 11:33:26.090040] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.735 [2024-10-07 11:33:26.090150] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.735 [2024-10-07 11:33:26.090180] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.735 [2024-10-07 11:33:26.090197] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.735 [2024-10-07 11:33:26.090220] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.735 [2024-10-07 11:33:26.090243] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.735 [2024-10-07 11:33:26.090257] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.735 [2024-10-07 11:33:26.090292] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.735 [2024-10-07 11:33:26.090316] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.735 [2024-10-07 11:33:26.103842] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.735 [2024-10-07 11:33:26.103945] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.735 [2024-10-07 11:33:26.103975] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.735 [2024-10-07 11:33:26.103991] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.735 [2024-10-07 11:33:26.104014] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.735 [2024-10-07 11:33:26.104043] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.735 [2024-10-07 11:33:26.104058] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.735 [2024-10-07 11:33:26.104071] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.735 [2024-10-07 11:33:26.104098] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.735 [2024-10-07 11:33:26.117670] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.735 [2024-10-07 11:33:26.118166] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.735 [2024-10-07 11:33:26.118211] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.735 [2024-10-07 11:33:26.118231] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.735 [2024-10-07 11:33:26.119450] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.735 [2024-10-07 11:33:26.120036] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.735 [2024-10-07 11:33:26.120073] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.735 [2024-10-07 11:33:26.120091] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.735 [2024-10-07 11:33:26.120324] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.735 [2024-10-07 11:33:26.128120] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.735 [2024-10-07 11:33:26.128333] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.735 [2024-10-07 11:33:26.128366] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.736 [2024-10-07 11:33:26.128383] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.736 [2024-10-07 11:33:26.128499] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.736 [2024-10-07 11:33:26.128607] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.736 [2024-10-07 11:33:26.128632] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.736 [2024-10-07 11:33:26.128660] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.736 [2024-10-07 11:33:26.128767] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.736 [2024-10-07 11:33:26.138199] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.736 [2024-10-07 11:33:26.138308] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.736 [2024-10-07 11:33:26.138360] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.736 [2024-10-07 11:33:26.138378] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.736 [2024-10-07 11:33:26.138402] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.736 [2024-10-07 11:33:26.138425] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.736 [2024-10-07 11:33:26.138446] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.736 [2024-10-07 11:33:26.138460] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.736 [2024-10-07 11:33:26.138483] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.736 [2024-10-07 11:33:26.148280] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.736 [2024-10-07 11:33:26.148388] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.736 [2024-10-07 11:33:26.148418] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.736 [2024-10-07 11:33:26.148441] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.736 [2024-10-07 11:33:26.148465] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.736 [2024-10-07 11:33:26.148487] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.736 [2024-10-07 11:33:26.148501] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.736 [2024-10-07 11:33:26.148515] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.736 [2024-10-07 11:33:26.148538] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.736 [2024-10-07 11:33:26.160469] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.736 [2024-10-07 11:33:26.160723] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.736 [2024-10-07 11:33:26.160757] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.736 [2024-10-07 11:33:26.160774] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.736 [2024-10-07 11:33:26.160897] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.736 [2024-10-07 11:33:26.161014] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.736 [2024-10-07 11:33:26.161036] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.736 [2024-10-07 11:33:26.161050] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.736 [2024-10-07 11:33:26.161153] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.736 [2024-10-07 11:33:26.170549] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.736 [2024-10-07 11:33:26.170667] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.736 [2024-10-07 11:33:26.170698] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.736 [2024-10-07 11:33:26.170714] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.736 [2024-10-07 11:33:26.170738] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.736 [2024-10-07 11:33:26.170794] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.736 [2024-10-07 11:33:26.170815] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.736 [2024-10-07 11:33:26.170829] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.736 [2024-10-07 11:33:26.170853] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.736 [2024-10-07 11:33:26.181332] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.736 [2024-10-07 11:33:26.181440] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.736 [2024-10-07 11:33:26.181470] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.736 [2024-10-07 11:33:26.181487] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.736 [2024-10-07 11:33:26.181593] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.736 [2024-10-07 11:33:26.181620] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.736 [2024-10-07 11:33:26.181635] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.736 [2024-10-07 11:33:26.181661] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.736 [2024-10-07 11:33:26.181688] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.736 [2024-10-07 11:33:26.191919] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.736 [2024-10-07 11:33:26.192142] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.736 [2024-10-07 11:33:26.192181] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.736 [2024-10-07 11:33:26.192200] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.736 [2024-10-07 11:33:26.192304] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.736 [2024-10-07 11:33:26.192407] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.736 [2024-10-07 11:33:26.192426] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.736 [2024-10-07 11:33:26.192441] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.736 [2024-10-07 11:33:26.192633] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.736 [2024-10-07 11:33:26.205369] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.736 [2024-10-07 11:33:26.205572] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.736 [2024-10-07 11:33:26.205604] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.736 [2024-10-07 11:33:26.205621] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.736 [2024-10-07 11:33:26.205747] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.736 [2024-10-07 11:33:26.206901] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.736 [2024-10-07 11:33:26.206939] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.736 [2024-10-07 11:33:26.206956] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.736 [2024-10-07 11:33:26.208967] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.736 [2024-10-07 11:33:26.215455] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.736 [2024-10-07 11:33:26.215565] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.736 [2024-10-07 11:33:26.215596] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.736 [2024-10-07 11:33:26.215622] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.736 [2024-10-07 11:33:26.215662] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.736 [2024-10-07 11:33:26.215688] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.736 [2024-10-07 11:33:26.215702] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.736 [2024-10-07 11:33:26.215715] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.736 [2024-10-07 11:33:26.215738] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.736 [2024-10-07 11:33:26.225908] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.736 [2024-10-07 11:33:26.226014] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.736 [2024-10-07 11:33:26.226043] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.736 [2024-10-07 11:33:26.226060] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.736 [2024-10-07 11:33:26.226238] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.736 [2024-10-07 11:33:26.226303] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.736 [2024-10-07 11:33:26.226325] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.736 [2024-10-07 11:33:26.226348] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.736 [2024-10-07 11:33:26.226391] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.736 [2024-10-07 11:33:26.238633] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.736 [2024-10-07 11:33:26.238759] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.736 [2024-10-07 11:33:26.238790] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.736 [2024-10-07 11:33:26.238807] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.736 [2024-10-07 11:33:26.238832] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.736 [2024-10-07 11:33:26.238854] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.736 [2024-10-07 11:33:26.238869] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.736 [2024-10-07 11:33:26.238883] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.737 [2024-10-07 11:33:26.238906] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.737 [2024-10-07 11:33:26.251062] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.737 [2024-10-07 11:33:26.251236] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.737 [2024-10-07 11:33:26.251268] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.737 [2024-10-07 11:33:26.251310] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.737 [2024-10-07 11:33:26.251336] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.737 [2024-10-07 11:33:26.251359] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.737 [2024-10-07 11:33:26.251374] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.737 [2024-10-07 11:33:26.251387] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.737 [2024-10-07 11:33:26.251411] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.737 [2024-10-07 11:33:26.265321] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.737 [2024-10-07 11:33:26.265428] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.737 [2024-10-07 11:33:26.265459] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.737 [2024-10-07 11:33:26.265476] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.737 [2024-10-07 11:33:26.265499] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.737 [2024-10-07 11:33:26.265522] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.737 [2024-10-07 11:33:26.265536] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.737 [2024-10-07 11:33:26.265549] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.737 [2024-10-07 11:33:26.265572] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.737 [2024-10-07 11:33:26.278016] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.737 [2024-10-07 11:33:26.278121] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.737 [2024-10-07 11:33:26.278152] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.737 [2024-10-07 11:33:26.278169] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.737 [2024-10-07 11:33:26.278193] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.737 [2024-10-07 11:33:26.278215] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.737 [2024-10-07 11:33:26.278230] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.737 [2024-10-07 11:33:26.278244] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.737 [2024-10-07 11:33:26.278267] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.737 [2024-10-07 11:33:26.288353] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.737 [2024-10-07 11:33:26.288551] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.737 [2024-10-07 11:33:26.288583] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.737 [2024-10-07 11:33:26.288600] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.737 [2024-10-07 11:33:26.288891] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.737 [2024-10-07 11:33:26.289118] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.737 [2024-10-07 11:33:26.289173] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.737 [2024-10-07 11:33:26.289191] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.737 [2024-10-07 11:33:26.289248] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.737 [2024-10-07 11:33:26.298434] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.737 [2024-10-07 11:33:26.298539] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.737 [2024-10-07 11:33:26.298569] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.737 [2024-10-07 11:33:26.298586] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.737 [2024-10-07 11:33:26.298610] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.737 [2024-10-07 11:33:26.298632] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.737 [2024-10-07 11:33:26.298660] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.737 [2024-10-07 11:33:26.298681] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.737 [2024-10-07 11:33:26.298704] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.737 [2024-10-07 11:33:26.313198] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.737 [2024-10-07 11:33:26.314291] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.737 [2024-10-07 11:33:26.314336] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.737 [2024-10-07 11:33:26.314357] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.737 [2024-10-07 11:33:26.315079] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.737 [2024-10-07 11:33:26.315358] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.737 [2024-10-07 11:33:26.315402] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.737 [2024-10-07 11:33:26.315419] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.737 [2024-10-07 11:33:26.315699] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.737 [2024-10-07 11:33:26.326686] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.737 [2024-10-07 11:33:26.327004] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.737 [2024-10-07 11:33:26.327046] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.737 [2024-10-07 11:33:26.327066] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.737 [2024-10-07 11:33:26.327207] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.737 [2024-10-07 11:33:26.327360] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.737 [2024-10-07 11:33:26.327384] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.737 [2024-10-07 11:33:26.327399] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.737 [2024-10-07 11:33:26.327452] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.737 [2024-10-07 11:33:26.336769] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.737 [2024-10-07 11:33:26.336874] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.737 [2024-10-07 11:33:26.336904] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.737 [2024-10-07 11:33:26.336921] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.737 [2024-10-07 11:33:26.336945] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.737 [2024-10-07 11:33:26.336968] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.737 [2024-10-07 11:33:26.336982] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.737 [2024-10-07 11:33:26.336995] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.737 [2024-10-07 11:33:26.337019] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.737 [2024-10-07 11:33:26.347080] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.737 [2024-10-07 11:33:26.347196] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.737 [2024-10-07 11:33:26.347228] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.737 [2024-10-07 11:33:26.347245] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.737 [2024-10-07 11:33:26.347270] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.737 [2024-10-07 11:33:26.347292] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.737 [2024-10-07 11:33:26.347307] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.737 [2024-10-07 11:33:26.347322] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.737 [2024-10-07 11:33:26.347346] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.737 [2024-10-07 11:33:26.357160] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.737 [2024-10-07 11:33:26.357264] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.737 [2024-10-07 11:33:26.357294] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.737 [2024-10-07 11:33:26.357311] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.737 [2024-10-07 11:33:26.357334] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.737 [2024-10-07 11:33:26.357357] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.737 [2024-10-07 11:33:26.357371] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.737 [2024-10-07 11:33:26.357384] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.737 [2024-10-07 11:33:26.357407] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.737 [2024-10-07 11:33:26.367954] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.737 [2024-10-07 11:33:26.368201] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.737 [2024-10-07 11:33:26.368251] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.737 [2024-10-07 11:33:26.368301] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.737 [2024-10-07 11:33:26.368359] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.737 [2024-10-07 11:33:26.368388] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.738 [2024-10-07 11:33:26.368404] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.738 [2024-10-07 11:33:26.368417] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.738 [2024-10-07 11:33:26.368441] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.738 [2024-10-07 11:33:26.381807] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.738 [2024-10-07 11:33:26.382397] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.738 [2024-10-07 11:33:26.382440] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.738 [2024-10-07 11:33:26.382460] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.738 [2024-10-07 11:33:26.383085] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.738 [2024-10-07 11:33:26.384007] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.738 [2024-10-07 11:33:26.384043] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.738 [2024-10-07 11:33:26.384060] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.738 [2024-10-07 11:33:26.384444] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.738 [2024-10-07 11:33:26.393062] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.738 [2024-10-07 11:33:26.393166] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.738 [2024-10-07 11:33:26.393197] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.738 [2024-10-07 11:33:26.393213] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.738 [2024-10-07 11:33:26.395563] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.738 [2024-10-07 11:33:26.395833] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.738 [2024-10-07 11:33:26.395872] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.738 [2024-10-07 11:33:26.395889] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.738 [2024-10-07 11:33:26.396157] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.738 [2024-10-07 11:33:26.405337] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.738 [2024-10-07 11:33:26.405567] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.738 [2024-10-07 11:33:26.405599] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.738 [2024-10-07 11:33:26.405616] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.738 [2024-10-07 11:33:26.405747] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.738 [2024-10-07 11:33:26.405859] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.738 [2024-10-07 11:33:26.405895] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.738 [2024-10-07 11:33:26.405910] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.738 [2024-10-07 11:33:26.406024] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.738 [2024-10-07 11:33:26.416377] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.738 [2024-10-07 11:33:26.416599] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.738 [2024-10-07 11:33:26.416642] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.738 [2024-10-07 11:33:26.416676] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.738 [2024-10-07 11:33:26.416794] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.738 [2024-10-07 11:33:26.416912] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.738 [2024-10-07 11:33:26.416933] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.738 [2024-10-07 11:33:26.416947] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.738 [2024-10-07 11:33:26.417048] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.738 [2024-10-07 11:33:26.427629] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.738 [2024-10-07 11:33:26.428122] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.738 [2024-10-07 11:33:26.428161] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.738 [2024-10-07 11:33:26.428181] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.738 [2024-10-07 11:33:26.428398] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.738 [2024-10-07 11:33:26.428617] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.738 [2024-10-07 11:33:26.428642] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.738 [2024-10-07 11:33:26.428672] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.738 [2024-10-07 11:33:26.428735] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.738 [2024-10-07 11:33:26.440794] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.738 [2024-10-07 11:33:26.441143] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.738 [2024-10-07 11:33:26.441187] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.738 [2024-10-07 11:33:26.441207] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.738 [2024-10-07 11:33:26.441365] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.738 [2024-10-07 11:33:26.441492] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.738 [2024-10-07 11:33:26.441524] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.738 [2024-10-07 11:33:26.441541] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.738 [2024-10-07 11:33:26.441673] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.738 [2024-10-07 11:33:26.453827] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.738 [2024-10-07 11:33:26.453954] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.738 [2024-10-07 11:33:26.453984] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.738 [2024-10-07 11:33:26.454001] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.738 [2024-10-07 11:33:26.454452] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.738 [2024-10-07 11:33:26.454624] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.738 [2024-10-07 11:33:26.454668] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.738 [2024-10-07 11:33:26.454687] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.738 [2024-10-07 11:33:26.454812] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.738 [2024-10-07 11:33:26.464282] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.738 [2024-10-07 11:33:26.464457] bdev_nvme.c:1730:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0x1a2cb00 was disconnected and freed. reset controller. 00:22:37.738 [2024-10-07 11:33:26.464538] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.738 [2024-10-07 11:33:26.464566] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.738 [2024-10-07 11:33:26.464582] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.738 [2024-10-07 11:33:26.465181] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.738 [2024-10-07 11:33:26.465261] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.738 [2024-10-07 11:33:26.465292] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.738 [2024-10-07 11:33:26.465386] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.738 [2024-10-07 11:33:26.465409] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.738 [2024-10-07 11:33:26.465423] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.738 [2024-10-07 11:33:26.465447] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.738 [2024-10-07 11:33:26.468916] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.738 [2024-10-07 11:33:26.468962] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.738 [2024-10-07 11:33:26.468980] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.738 [2024-10-07 11:33:26.468994] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.738 [2024-10-07 11:33:26.469018] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.738 [2024-10-07 11:33:26.477010] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.738 [2024-10-07 11:33:26.477672] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.738 [2024-10-07 11:33:26.477767] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.738 [2024-10-07 11:33:26.477795] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.738 [2024-10-07 11:33:26.477812] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.738 [2024-10-07 11:33:26.477961] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.738 [2024-10-07 11:33:26.477990] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.738 [2024-10-07 11:33:26.478006] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.738 [2024-10-07 11:33:26.478024] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.738 [2024-10-07 11:33:26.478047] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.738 [2024-10-07 11:33:26.478064] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.738 [2024-10-07 11:33:26.478078] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.738 [2024-10-07 11:33:26.478092] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.739 [2024-10-07 11:33:26.478116] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.739 [2024-10-07 11:33:26.478131] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.739 [2024-10-07 11:33:26.478144] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.739 [2024-10-07 11:33:26.478156] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.739 [2024-10-07 11:33:26.478176] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.739 [2024-10-07 11:33:26.489594] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.739 [2024-10-07 11:33:26.489643] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.739 [2024-10-07 11:33:26.490134] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.739 [2024-10-07 11:33:26.490180] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.739 [2024-10-07 11:33:26.490199] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.739 [2024-10-07 11:33:26.490250] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.739 [2024-10-07 11:33:26.490272] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.739 [2024-10-07 11:33:26.490287] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.739 [2024-10-07 11:33:26.491147] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.739 [2024-10-07 11:33:26.491197] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.739 [2024-10-07 11:33:26.491485] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.739 [2024-10-07 11:33:26.491526] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.739 [2024-10-07 11:33:26.491541] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.739 [2024-10-07 11:33:26.491557] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.739 [2024-10-07 11:33:26.491571] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.739 [2024-10-07 11:33:26.491583] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.739 [2024-10-07 11:33:26.491635] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.739 [2024-10-07 11:33:26.491689] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.739 [2024-10-07 11:33:26.503036] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.739 [2024-10-07 11:33:26.503084] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.739 [2024-10-07 11:33:26.504164] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.739 [2024-10-07 11:33:26.504208] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.739 [2024-10-07 11:33:26.504228] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.739 [2024-10-07 11:33:26.504279] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.739 [2024-10-07 11:33:26.504302] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.739 [2024-10-07 11:33:26.504327] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.739 [2024-10-07 11:33:26.504442] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.739 [2024-10-07 11:33:26.504469] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.739 [2024-10-07 11:33:26.504489] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.739 [2024-10-07 11:33:26.504504] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.739 [2024-10-07 11:33:26.504517] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.739 [2024-10-07 11:33:26.504533] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.739 [2024-10-07 11:33:26.504549] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.739 [2024-10-07 11:33:26.504561] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.739 [2024-10-07 11:33:26.504583] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.739 [2024-10-07 11:33:26.504597] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.739 [2024-10-07 11:33:26.518396] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.739 [2024-10-07 11:33:26.518450] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.739 [2024-10-07 11:33:26.518535] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.739 [2024-10-07 11:33:26.518563] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.739 [2024-10-07 11:33:26.518579] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.739 [2024-10-07 11:33:26.518625] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.739 [2024-10-07 11:33:26.518662] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.739 [2024-10-07 11:33:26.518681] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.739 [2024-10-07 11:33:26.518705] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.739 [2024-10-07 11:33:26.518725] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.739 [2024-10-07 11:33:26.518744] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.739 [2024-10-07 11:33:26.518773] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.739 [2024-10-07 11:33:26.518788] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.739 [2024-10-07 11:33:26.518804] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.739 [2024-10-07 11:33:26.518818] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.739 [2024-10-07 11:33:26.518831] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.739 [2024-10-07 11:33:26.518854] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.739 [2024-10-07 11:33:26.518868] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.739 [2024-10-07 11:33:26.529623] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.739 [2024-10-07 11:33:26.529687] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.739 [2024-10-07 11:33:26.529892] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.739 [2024-10-07 11:33:26.529924] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.739 [2024-10-07 11:33:26.529940] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.739 [2024-10-07 11:33:26.529989] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.739 [2024-10-07 11:33:26.530012] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.739 [2024-10-07 11:33:26.530027] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.739 [2024-10-07 11:33:26.530152] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.739 [2024-10-07 11:33:26.530179] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.739 [2024-10-07 11:33:26.530581] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.739 [2024-10-07 11:33:26.530618] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.739 [2024-10-07 11:33:26.530636] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.739 [2024-10-07 11:33:26.530666] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.739 [2024-10-07 11:33:26.530683] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.739 [2024-10-07 11:33:26.530697] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.739 [2024-10-07 11:33:26.530867] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.739 [2024-10-07 11:33:26.530891] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.739 [2024-10-07 11:33:26.540031] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.739 [2024-10-07 11:33:26.540077] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.739 [2024-10-07 11:33:26.540162] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.739 [2024-10-07 11:33:26.540192] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.739 [2024-10-07 11:33:26.540209] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.739 [2024-10-07 11:33:26.540255] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.739 [2024-10-07 11:33:26.540293] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.739 [2024-10-07 11:33:26.540310] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.740 [2024-10-07 11:33:26.540334] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.740 [2024-10-07 11:33:26.540354] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.740 [2024-10-07 11:33:26.540387] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.740 [2024-10-07 11:33:26.540404] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.740 [2024-10-07 11:33:26.540417] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.740 [2024-10-07 11:33:26.540433] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.740 [2024-10-07 11:33:26.540447] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.740 [2024-10-07 11:33:26.540460] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.740 [2024-10-07 11:33:26.540482] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.740 [2024-10-07 11:33:26.540497] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.740 [2024-10-07 11:33:26.550252] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.740 [2024-10-07 11:33:26.550299] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.740 [2024-10-07 11:33:26.550384] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.740 [2024-10-07 11:33:26.550413] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.740 [2024-10-07 11:33:26.550429] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.740 [2024-10-07 11:33:26.550475] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.740 [2024-10-07 11:33:26.550498] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.740 [2024-10-07 11:33:26.550513] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.740 [2024-10-07 11:33:26.550536] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.740 [2024-10-07 11:33:26.550556] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.740 [2024-10-07 11:33:26.550575] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.740 [2024-10-07 11:33:26.550589] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.740 [2024-10-07 11:33:26.550603] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.740 [2024-10-07 11:33:26.550619] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.740 [2024-10-07 11:33:26.550633] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.740 [2024-10-07 11:33:26.550660] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.740 [2024-10-07 11:33:26.550687] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.740 [2024-10-07 11:33:26.550701] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.740 [2024-10-07 11:33:26.563907] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.740 [2024-10-07 11:33:26.563955] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.740 [2024-10-07 11:33:26.564313] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.740 [2024-10-07 11:33:26.564355] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.740 [2024-10-07 11:33:26.564375] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.740 [2024-10-07 11:33:26.564426] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.740 [2024-10-07 11:33:26.564456] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.740 [2024-10-07 11:33:26.564472] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.740 [2024-10-07 11:33:26.564607] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.740 [2024-10-07 11:33:26.564636] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.740 [2024-10-07 11:33:26.564971] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.740 [2024-10-07 11:33:26.565006] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.740 [2024-10-07 11:33:26.565024] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.740 [2024-10-07 11:33:26.565041] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.740 [2024-10-07 11:33:26.565056] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.740 [2024-10-07 11:33:26.565068] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.740 [2024-10-07 11:33:26.565245] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.740 [2024-10-07 11:33:26.565270] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.740 [2024-10-07 11:33:26.574723] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.740 [2024-10-07 11:33:26.574778] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.740 [2024-10-07 11:33:26.574861] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.740 [2024-10-07 11:33:26.574889] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.740 [2024-10-07 11:33:26.574905] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.740 [2024-10-07 11:33:26.574952] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.740 [2024-10-07 11:33:26.574975] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.740 [2024-10-07 11:33:26.574990] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.740 [2024-10-07 11:33:26.575013] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.740 [2024-10-07 11:33:26.575032] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.740 [2024-10-07 11:33:26.575052] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.740 [2024-10-07 11:33:26.575066] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.740 [2024-10-07 11:33:26.575096] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.740 [2024-10-07 11:33:26.575113] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.740 [2024-10-07 11:33:26.575127] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.740 [2024-10-07 11:33:26.575140] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.740 [2024-10-07 11:33:26.575162] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.740 [2024-10-07 11:33:26.575176] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.740 [2024-10-07 11:33:26.585118] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.740 [2024-10-07 11:33:26.585165] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.740 [2024-10-07 11:33:26.585248] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.740 [2024-10-07 11:33:26.585277] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.740 [2024-10-07 11:33:26.585294] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.740 [2024-10-07 11:33:26.585340] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.740 [2024-10-07 11:33:26.585363] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.740 [2024-10-07 11:33:26.585378] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.740 [2024-10-07 11:33:26.585401] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.740 [2024-10-07 11:33:26.585420] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.740 [2024-10-07 11:33:26.585440] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.740 [2024-10-07 11:33:26.585455] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.740 [2024-10-07 11:33:26.585468] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.740 [2024-10-07 11:33:26.585483] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.740 [2024-10-07 11:33:26.585497] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.740 [2024-10-07 11:33:26.585509] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.740 [2024-10-07 11:33:26.585532] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.740 [2024-10-07 11:33:26.585546] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.740 [2024-10-07 11:33:26.595226] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.740 [2024-10-07 11:33:26.595286] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.740 [2024-10-07 11:33:26.595362] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.740 [2024-10-07 11:33:26.595390] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.740 [2024-10-07 11:33:26.595406] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.740 [2024-10-07 11:33:26.595459] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.740 [2024-10-07 11:33:26.595483] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.740 [2024-10-07 11:33:26.595512] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.740 [2024-10-07 11:33:26.595531] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.740 [2024-10-07 11:33:26.595554] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.740 [2024-10-07 11:33:26.595572] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.740 [2024-10-07 11:33:26.595585] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.740 [2024-10-07 11:33:26.595598] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.740 [2024-10-07 11:33:26.595621] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.740 [2024-10-07 11:33:26.595636] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.741 [2024-10-07 11:33:26.595672] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.741 [2024-10-07 11:33:26.595688] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.741 [2024-10-07 11:33:26.595709] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.741 [2024-10-07 11:33:26.605977] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.741 [2024-10-07 11:33:26.606024] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.741 [2024-10-07 11:33:26.606204] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.741 [2024-10-07 11:33:26.606234] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.741 [2024-10-07 11:33:26.606251] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.741 [2024-10-07 11:33:26.606298] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.741 [2024-10-07 11:33:26.606320] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.741 [2024-10-07 11:33:26.606335] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.741 [2024-10-07 11:33:26.606438] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.741 [2024-10-07 11:33:26.606467] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.741 [2024-10-07 11:33:26.606782] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.741 [2024-10-07 11:33:26.606808] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.741 [2024-10-07 11:33:26.606822] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.741 [2024-10-07 11:33:26.606839] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.741 [2024-10-07 11:33:26.606853] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.741 [2024-10-07 11:33:26.606865] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.741 [2024-10-07 11:33:26.608528] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.741 [2024-10-07 11:33:26.608565] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.741 [2024-10-07 11:33:26.616660] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.741 [2024-10-07 11:33:26.616733] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.741 [2024-10-07 11:33:26.616929] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.741 [2024-10-07 11:33:26.616961] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.741 [2024-10-07 11:33:26.616977] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.741 [2024-10-07 11:33:26.617025] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.741 [2024-10-07 11:33:26.617047] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.741 [2024-10-07 11:33:26.617062] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.741 [2024-10-07 11:33:26.617177] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.741 [2024-10-07 11:33:26.617204] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.741 [2024-10-07 11:33:26.617739] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.741 [2024-10-07 11:33:26.617775] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.741 [2024-10-07 11:33:26.617793] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.741 [2024-10-07 11:33:26.617810] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.741 [2024-10-07 11:33:26.617824] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.741 [2024-10-07 11:33:26.617836] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.741 [2024-10-07 11:33:26.618125] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.741 [2024-10-07 11:33:26.618152] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.741 [2024-10-07 11:33:26.629358] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.741 [2024-10-07 11:33:26.629405] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.741 [2024-10-07 11:33:26.629598] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.741 [2024-10-07 11:33:26.629628] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.741 [2024-10-07 11:33:26.629644] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.741 [2024-10-07 11:33:26.629713] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.741 [2024-10-07 11:33:26.629737] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.741 [2024-10-07 11:33:26.629752] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.741 [2024-10-07 11:33:26.629776] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.741 [2024-10-07 11:33:26.629795] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.741 [2024-10-07 11:33:26.629815] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.741 [2024-10-07 11:33:26.629830] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.741 [2024-10-07 11:33:26.629843] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.741 [2024-10-07 11:33:26.629876] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.741 [2024-10-07 11:33:26.629892] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.741 [2024-10-07 11:33:26.629905] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.741 [2024-10-07 11:33:26.630084] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.741 [2024-10-07 11:33:26.630110] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.741 [2024-10-07 11:33:26.639498] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.741 [2024-10-07 11:33:26.639562] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.741 [2024-10-07 11:33:26.639678] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.741 [2024-10-07 11:33:26.639709] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.741 [2024-10-07 11:33:26.639726] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.741 [2024-10-07 11:33:26.639774] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.741 [2024-10-07 11:33:26.639797] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.741 [2024-10-07 11:33:26.639812] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.741 [2024-10-07 11:33:26.639835] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.741 [2024-10-07 11:33:26.639855] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.741 [2024-10-07 11:33:26.639875] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.741 [2024-10-07 11:33:26.639889] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.741 [2024-10-07 11:33:26.639903] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.741 [2024-10-07 11:33:26.639919] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.741 [2024-10-07 11:33:26.639932] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.741 [2024-10-07 11:33:26.639945] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.741 [2024-10-07 11:33:26.639967] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.741 [2024-10-07 11:33:26.639982] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.741 [2024-10-07 11:33:26.650579] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.741 [2024-10-07 11:33:26.650627] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.741 [2024-10-07 11:33:26.650761] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.741 [2024-10-07 11:33:26.650792] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.741 [2024-10-07 11:33:26.650809] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.741 [2024-10-07 11:33:26.650874] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.741 [2024-10-07 11:33:26.650913] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.741 [2024-10-07 11:33:26.650928] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.741 [2024-10-07 11:33:26.651125] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.741 [2024-10-07 11:33:26.651155] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.741 [2024-10-07 11:33:26.651227] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.741 [2024-10-07 11:33:26.651250] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.741 [2024-10-07 11:33:26.651263] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.741 [2024-10-07 11:33:26.651280] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.741 [2024-10-07 11:33:26.651294] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.741 [2024-10-07 11:33:26.651307] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.741 [2024-10-07 11:33:26.651478] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.741 [2024-10-07 11:33:26.651500] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.741 [2024-10-07 11:33:26.662699] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.741 [2024-10-07 11:33:26.662746] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.741 [2024-10-07 11:33:26.662861] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.741 [2024-10-07 11:33:26.662891] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.741 [2024-10-07 11:33:26.662908] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.742 [2024-10-07 11:33:26.662955] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.742 [2024-10-07 11:33:26.662978] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.742 [2024-10-07 11:33:26.662993] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.742 [2024-10-07 11:33:26.663017] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.742 [2024-10-07 11:33:26.663037] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.742 [2024-10-07 11:33:26.663056] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.742 [2024-10-07 11:33:26.663070] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.742 [2024-10-07 11:33:26.663084] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.742 [2024-10-07 11:33:26.663099] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.742 [2024-10-07 11:33:26.663114] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.742 [2024-10-07 11:33:26.663126] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.742 [2024-10-07 11:33:26.663152] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.742 [2024-10-07 11:33:26.663166] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.742 [2024-10-07 11:33:26.676284] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.742 [2024-10-07 11:33:26.676334] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.742 [2024-10-07 11:33:26.676685] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.742 [2024-10-07 11:33:26.676728] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.742 [2024-10-07 11:33:26.676747] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.742 [2024-10-07 11:33:26.676798] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.742 [2024-10-07 11:33:26.676822] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.742 [2024-10-07 11:33:26.676837] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.742 [2024-10-07 11:33:26.677041] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.742 [2024-10-07 11:33:26.677072] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.742 [2024-10-07 11:33:26.677127] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.742 [2024-10-07 11:33:26.677148] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.742 [2024-10-07 11:33:26.677162] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.742 [2024-10-07 11:33:26.677178] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.742 [2024-10-07 11:33:26.677193] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.742 [2024-10-07 11:33:26.677205] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.742 [2024-10-07 11:33:26.677228] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.742 [2024-10-07 11:33:26.677242] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.742 [2024-10-07 11:33:26.691017] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.742 [2024-10-07 11:33:26.691068] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.742 [2024-10-07 11:33:26.691152] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.742 [2024-10-07 11:33:26.691180] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.742 [2024-10-07 11:33:26.691210] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.742 [2024-10-07 11:33:26.691259] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.742 [2024-10-07 11:33:26.691282] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.742 [2024-10-07 11:33:26.691297] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.742 [2024-10-07 11:33:26.691321] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.742 [2024-10-07 11:33:26.691340] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.742 [2024-10-07 11:33:26.691360] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.742 [2024-10-07 11:33:26.691374] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.742 [2024-10-07 11:33:26.691387] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.742 [2024-10-07 11:33:26.691403] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.742 [2024-10-07 11:33:26.691432] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.742 [2024-10-07 11:33:26.691446] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.742 [2024-10-07 11:33:26.691470] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.742 [2024-10-07 11:33:26.691485] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.742 [2024-10-07 11:33:26.703267] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.742 [2024-10-07 11:33:26.703315] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.742 [2024-10-07 11:33:26.703429] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.742 [2024-10-07 11:33:26.703459] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.742 [2024-10-07 11:33:26.703475] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.742 [2024-10-07 11:33:26.703523] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.742 [2024-10-07 11:33:26.703546] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.742 [2024-10-07 11:33:26.703562] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.742 [2024-10-07 11:33:26.703585] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.742 [2024-10-07 11:33:26.703605] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.742 [2024-10-07 11:33:26.703625] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.742 [2024-10-07 11:33:26.703638] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.742 [2024-10-07 11:33:26.703667] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.742 [2024-10-07 11:33:26.703686] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.742 [2024-10-07 11:33:26.703700] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.742 [2024-10-07 11:33:26.703712] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.742 [2024-10-07 11:33:26.703735] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.742 [2024-10-07 11:33:26.703764] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.742 [2024-10-07 11:33:26.716816] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.742 [2024-10-07 11:33:26.716863] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.742 [2024-10-07 11:33:26.716946] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.742 [2024-10-07 11:33:26.716974] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.742 [2024-10-07 11:33:26.716990] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.742 [2024-10-07 11:33:26.717037] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.742 [2024-10-07 11:33:26.717059] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.742 [2024-10-07 11:33:26.717073] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.742 [2024-10-07 11:33:26.717113] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.742 [2024-10-07 11:33:26.717134] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.742 [2024-10-07 11:33:26.717153] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.742 [2024-10-07 11:33:26.717167] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.742 [2024-10-07 11:33:26.717181] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.742 [2024-10-07 11:33:26.717196] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.742 [2024-10-07 11:33:26.717211] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.742 [2024-10-07 11:33:26.717223] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.742 [2024-10-07 11:33:26.717246] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.742 [2024-10-07 11:33:26.717260] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.742 [2024-10-07 11:33:26.729205] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.742 [2024-10-07 11:33:26.729254] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.742 [2024-10-07 11:33:26.729485] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.742 [2024-10-07 11:33:26.729518] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.742 [2024-10-07 11:33:26.729535] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.742 [2024-10-07 11:33:26.729582] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.743 [2024-10-07 11:33:26.729605] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.743 [2024-10-07 11:33:26.729620] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.743 [2024-10-07 11:33:26.729835] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.743 [2024-10-07 11:33:26.729866] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.743 [2024-10-07 11:33:26.730076] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.743 [2024-10-07 11:33:26.730103] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.743 [2024-10-07 11:33:26.730117] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.743 [2024-10-07 11:33:26.730133] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.743 [2024-10-07 11:33:26.730147] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.743 [2024-10-07 11:33:26.730160] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.743 [2024-10-07 11:33:26.730229] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.743 [2024-10-07 11:33:26.730249] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.743 [2024-10-07 11:33:26.742427] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.743 [2024-10-07 11:33:26.742474] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.743 [2024-10-07 11:33:26.742559] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.743 [2024-10-07 11:33:26.742605] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.743 [2024-10-07 11:33:26.742623] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.743 [2024-10-07 11:33:26.742688] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.743 [2024-10-07 11:33:26.742714] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.743 [2024-10-07 11:33:26.742729] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.743 [2024-10-07 11:33:26.743308] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.743 [2024-10-07 11:33:26.743349] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.743 [2024-10-07 11:33:26.743445] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.743 [2024-10-07 11:33:26.743467] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.743 [2024-10-07 11:33:26.743481] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.743 [2024-10-07 11:33:26.743498] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.743 [2024-10-07 11:33:26.743512] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.743 [2024-10-07 11:33:26.743524] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.743 [2024-10-07 11:33:26.743547] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.743 [2024-10-07 11:33:26.743561] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.743 [2024-10-07 11:33:26.754762] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.743 [2024-10-07 11:33:26.754809] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.743 [2024-10-07 11:33:26.755261] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.743 [2024-10-07 11:33:26.755303] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.743 [2024-10-07 11:33:26.755323] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.743 [2024-10-07 11:33:26.755372] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.743 [2024-10-07 11:33:26.755396] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.743 [2024-10-07 11:33:26.755411] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.743 [2024-10-07 11:33:26.755627] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.743 [2024-10-07 11:33:26.755672] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.743 [2024-10-07 11:33:26.755725] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.743 [2024-10-07 11:33:26.755746] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.743 [2024-10-07 11:33:26.755761] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.743 [2024-10-07 11:33:26.755777] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.743 [2024-10-07 11:33:26.755791] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.743 [2024-10-07 11:33:26.755819] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.743 [2024-10-07 11:33:26.755844] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.743 [2024-10-07 11:33:26.755859] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.743 [2024-10-07 11:33:26.765745] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.743 [2024-10-07 11:33:26.765792] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.743 [2024-10-07 11:33:26.765970] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.743 [2024-10-07 11:33:26.766000] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.743 [2024-10-07 11:33:26.766016] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.743 [2024-10-07 11:33:26.766063] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.743 [2024-10-07 11:33:26.766086] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.743 [2024-10-07 11:33:26.766101] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.743 [2024-10-07 11:33:26.766257] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.743 [2024-10-07 11:33:26.766286] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.743 [2024-10-07 11:33:26.768390] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.743 [2024-10-07 11:33:26.768429] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.743 [2024-10-07 11:33:26.768463] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.743 [2024-10-07 11:33:26.768480] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.743 [2024-10-07 11:33:26.768494] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.743 [2024-10-07 11:33:26.768507] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.743 [2024-10-07 11:33:26.769637] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.743 [2024-10-07 11:33:26.769696] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.743 [2024-10-07 11:33:26.776767] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.743 [2024-10-07 11:33:26.776815] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.743 [2024-10-07 11:33:26.777021] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.743 [2024-10-07 11:33:26.777062] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.743 [2024-10-07 11:33:26.777081] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.743 [2024-10-07 11:33:26.777144] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.743 [2024-10-07 11:33:26.777168] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.743 [2024-10-07 11:33:26.777183] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.743 [2024-10-07 11:33:26.777308] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.743 [2024-10-07 11:33:26.777350] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.743 [2024-10-07 11:33:26.777465] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.743 [2024-10-07 11:33:26.777486] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.743 [2024-10-07 11:33:26.777500] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.743 [2024-10-07 11:33:26.777517] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.743 [2024-10-07 11:33:26.777532] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.743 [2024-10-07 11:33:26.777544] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.743 [2024-10-07 11:33:26.777645] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.743 [2024-10-07 11:33:26.777683] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.743 [2024-10-07 11:33:26.787129] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.743 [2024-10-07 11:33:26.787191] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.743 [2024-10-07 11:33:26.787379] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.743 [2024-10-07 11:33:26.787410] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.744 [2024-10-07 11:33:26.787427] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.744 [2024-10-07 11:33:26.787477] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.744 [2024-10-07 11:33:26.787501] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.744 [2024-10-07 11:33:26.787516] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.744 [2024-10-07 11:33:26.787618] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.744 [2024-10-07 11:33:26.787642] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.744 [2024-10-07 11:33:26.787757] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.744 [2024-10-07 11:33:26.787777] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.744 [2024-10-07 11:33:26.787791] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.744 [2024-10-07 11:33:26.787807] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.744 [2024-10-07 11:33:26.787820] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.744 [2024-10-07 11:33:26.787833] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.744 [2024-10-07 11:33:26.789520] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.744 [2024-10-07 11:33:26.789558] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.744 [2024-10-07 11:33:26.797254] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.744 [2024-10-07 11:33:26.797314] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.744 [2024-10-07 11:33:26.797388] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.744 [2024-10-07 11:33:26.797417] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.744 [2024-10-07 11:33:26.797452] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.744 [2024-10-07 11:33:26.798033] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.744 [2024-10-07 11:33:26.798075] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.744 [2024-10-07 11:33:26.798095] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.744 [2024-10-07 11:33:26.798114] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.744 [2024-10-07 11:33:26.798311] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.744 [2024-10-07 11:33:26.798338] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.744 [2024-10-07 11:33:26.798352] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.744 [2024-10-07 11:33:26.798365] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.744 [2024-10-07 11:33:26.798509] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.744 [2024-10-07 11:33:26.798531] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.744 [2024-10-07 11:33:26.798545] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.744 [2024-10-07 11:33:26.798558] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.744 [2024-10-07 11:33:26.798699] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.744 [2024-10-07 11:33:26.808084] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.744 [2024-10-07 11:33:26.808131] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.744 [2024-10-07 11:33:26.808229] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.744 [2024-10-07 11:33:26.808259] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.744 [2024-10-07 11:33:26.808276] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.744 [2024-10-07 11:33:26.808323] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.744 [2024-10-07 11:33:26.808346] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.744 [2024-10-07 11:33:26.808360] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.744 [2024-10-07 11:33:26.808384] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.744 [2024-10-07 11:33:26.808404] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.744 [2024-10-07 11:33:26.808423] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.744 [2024-10-07 11:33:26.808438] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.744 [2024-10-07 11:33:26.808451] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.744 [2024-10-07 11:33:26.808467] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.744 [2024-10-07 11:33:26.808481] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.744 [2024-10-07 11:33:26.808507] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.744 [2024-10-07 11:33:26.808532] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.744 [2024-10-07 11:33:26.808547] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.744 [2024-10-07 11:33:26.818777] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.744 [2024-10-07 11:33:26.818824] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.744 [2024-10-07 11:33:26.819350] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.744 [2024-10-07 11:33:26.819392] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.744 [2024-10-07 11:33:26.819412] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.744 [2024-10-07 11:33:26.819462] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.744 [2024-10-07 11:33:26.819485] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.744 [2024-10-07 11:33:26.819500] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.744 [2024-10-07 11:33:26.819742] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.744 [2024-10-07 11:33:26.819774] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.744 [2024-10-07 11:33:26.819975] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.744 [2024-10-07 11:33:26.820002] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.744 [2024-10-07 11:33:26.820016] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.744 [2024-10-07 11:33:26.820033] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.744 [2024-10-07 11:33:26.820047] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.744 [2024-10-07 11:33:26.820060] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.744 [2024-10-07 11:33:26.820119] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.744 [2024-10-07 11:33:26.820139] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.744 [2024-10-07 11:33:26.830786] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.744 [2024-10-07 11:33:26.830835] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.744 [2024-10-07 11:33:26.830919] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.744 [2024-10-07 11:33:26.830948] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.744 [2024-10-07 11:33:26.830964] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.745 [2024-10-07 11:33:26.831010] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.745 [2024-10-07 11:33:26.831033] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.745 [2024-10-07 11:33:26.831048] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.745 [2024-10-07 11:33:26.831627] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.745 [2024-10-07 11:33:26.831681] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.745 [2024-10-07 11:33:26.831815] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.745 [2024-10-07 11:33:26.831841] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.745 [2024-10-07 11:33:26.831855] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.745 [2024-10-07 11:33:26.831872] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.745 [2024-10-07 11:33:26.831886] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.745 [2024-10-07 11:33:26.831898] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.745 [2024-10-07 11:33:26.831922] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.745 [2024-10-07 11:33:26.831936] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.745 [2024-10-07 11:33:26.843327] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.745 [2024-10-07 11:33:26.843376] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.745 [2024-10-07 11:33:26.843694] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.745 [2024-10-07 11:33:26.843728] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.745 [2024-10-07 11:33:26.843745] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.745 [2024-10-07 11:33:26.843796] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.745 [2024-10-07 11:33:26.843820] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.745 [2024-10-07 11:33:26.843835] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.745 [2024-10-07 11:33:26.844038] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.745 [2024-10-07 11:33:26.844069] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.745 [2024-10-07 11:33:26.844126] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.745 [2024-10-07 11:33:26.844148] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.745 [2024-10-07 11:33:26.844161] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.745 [2024-10-07 11:33:26.844178] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.745 [2024-10-07 11:33:26.844192] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.745 [2024-10-07 11:33:26.844205] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.745 [2024-10-07 11:33:26.844227] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.745 [2024-10-07 11:33:26.844241] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.745 [2024-10-07 11:33:26.855084] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.745 [2024-10-07 11:33:26.855134] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.745 [2024-10-07 11:33:26.855353] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.745 [2024-10-07 11:33:26.855385] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.745 [2024-10-07 11:33:26.855402] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.745 [2024-10-07 11:33:26.855468] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.745 [2024-10-07 11:33:26.855492] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.745 [2024-10-07 11:33:26.855507] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.745 [2024-10-07 11:33:26.855630] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.745 [2024-10-07 11:33:26.855678] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.745 [2024-10-07 11:33:26.855779] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.745 [2024-10-07 11:33:26.855799] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.745 [2024-10-07 11:33:26.855813] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.745 [2024-10-07 11:33:26.855830] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.745 [2024-10-07 11:33:26.855844] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.745 [2024-10-07 11:33:26.855857] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.745 [2024-10-07 11:33:26.855968] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.745 [2024-10-07 11:33:26.855989] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.745 [2024-10-07 11:33:26.867277] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.745 [2024-10-07 11:33:26.867326] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.745 [2024-10-07 11:33:26.867500] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.745 [2024-10-07 11:33:26.867531] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.745 [2024-10-07 11:33:26.867549] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.745 [2024-10-07 11:33:26.867596] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.745 [2024-10-07 11:33:26.867619] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.745 [2024-10-07 11:33:26.867634] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.745 [2024-10-07 11:33:26.867753] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.745 [2024-10-07 11:33:26.867780] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.745 [2024-10-07 11:33:26.867891] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.745 [2024-10-07 11:33:26.867912] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.745 [2024-10-07 11:33:26.867926] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.745 [2024-10-07 11:33:26.867942] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.745 [2024-10-07 11:33:26.867955] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.745 [2024-10-07 11:33:26.867968] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.745 [2024-10-07 11:33:26.872271] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.745 [2024-10-07 11:33:26.872310] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.745 [2024-10-07 11:33:26.877506] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.745 [2024-10-07 11:33:26.877554] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.745 [2024-10-07 11:33:26.877639] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.745 [2024-10-07 11:33:26.877682] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.745 [2024-10-07 11:33:26.877700] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.745 [2024-10-07 11:33:26.877749] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.745 [2024-10-07 11:33:26.877772] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.745 [2024-10-07 11:33:26.877787] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.745 [2024-10-07 11:33:26.877811] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.745 [2024-10-07 11:33:26.877831] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.745 [2024-10-07 11:33:26.877851] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.745 [2024-10-07 11:33:26.877866] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.745 [2024-10-07 11:33:26.877879] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.745 [2024-10-07 11:33:26.877895] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.745 [2024-10-07 11:33:26.877909] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.745 [2024-10-07 11:33:26.877921] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.745 [2024-10-07 11:33:26.877943] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.745 [2024-10-07 11:33:26.877957] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.745 [2024-10-07 11:33:26.887614] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.745 [2024-10-07 11:33:26.887690] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.745 [2024-10-07 11:33:26.887767] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.745 [2024-10-07 11:33:26.887796] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.745 [2024-10-07 11:33:26.887812] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.745 [2024-10-07 11:33:26.887865] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.745 [2024-10-07 11:33:26.887889] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.746 [2024-10-07 11:33:26.887904] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.746 [2024-10-07 11:33:26.887921] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.746 [2024-10-07 11:33:26.887944] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.746 [2024-10-07 11:33:26.887961] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.746 [2024-10-07 11:33:26.887989] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.746 [2024-10-07 11:33:26.888003] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.746 [2024-10-07 11:33:26.888026] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.746 [2024-10-07 11:33:26.888041] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.746 [2024-10-07 11:33:26.888054] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.746 [2024-10-07 11:33:26.888066] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.746 [2024-10-07 11:33:26.888086] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.746 [2024-10-07 11:33:26.902231] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.746 [2024-10-07 11:33:26.902280] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.746 [2024-10-07 11:33:26.902576] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.746 [2024-10-07 11:33:26.902610] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.746 [2024-10-07 11:33:26.902628] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.746 [2024-10-07 11:33:26.902691] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.746 [2024-10-07 11:33:26.902717] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.746 [2024-10-07 11:33:26.902732] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.746 [2024-10-07 11:33:26.902960] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.746 [2024-10-07 11:33:26.902992] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.746 8863.40 IOPS, 34.62 MiB/s [2024-10-07T11:33:33.269Z] [2024-10-07 11:33:26.904769] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.746 [2024-10-07 11:33:26.904799] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.746 [2024-10-07 11:33:26.904816] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.746 [2024-10-07 11:33:26.904834] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.746 [2024-10-07 11:33:26.904848] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.746 [2024-10-07 11:33:26.904860] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.746 [2024-10-07 11:33:26.904883] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.746 [2024-10-07 11:33:26.904897] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.746 [2024-10-07 11:33:26.916716] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.746 [2024-10-07 11:33:26.916764] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.746 [2024-10-07 11:33:26.917764] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.746 [2024-10-07 11:33:26.917807] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.746 [2024-10-07 11:33:26.917827] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.746 [2024-10-07 11:33:26.917896] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.746 [2024-10-07 11:33:26.917921] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.746 [2024-10-07 11:33:26.917935] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.746 [2024-10-07 11:33:26.918830] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.746 [2024-10-07 11:33:26.918873] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.746 [2024-10-07 11:33:26.919443] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.746 [2024-10-07 11:33:26.919480] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.746 [2024-10-07 11:33:26.919497] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.746 [2024-10-07 11:33:26.919514] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.746 [2024-10-07 11:33:26.919528] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.746 [2024-10-07 11:33:26.919541] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.746 [2024-10-07 11:33:26.919625] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.746 [2024-10-07 11:33:26.919660] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.746 [2024-10-07 11:33:26.928325] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.746 [2024-10-07 11:33:26.928374] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.746 [2024-10-07 11:33:26.928567] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.746 [2024-10-07 11:33:26.928606] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.746 [2024-10-07 11:33:26.928625] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.746 [2024-10-07 11:33:26.928691] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.746 [2024-10-07 11:33:26.928717] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.746 [2024-10-07 11:33:26.928732] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.746 [2024-10-07 11:33:26.928838] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.746 [2024-10-07 11:33:26.928863] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.746 [2024-10-07 11:33:26.929478] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.746 [2024-10-07 11:33:26.929515] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.746 [2024-10-07 11:33:26.929532] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.746 [2024-10-07 11:33:26.929549] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.746 [2024-10-07 11:33:26.929563] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.746 [2024-10-07 11:33:26.929576] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.746 [2024-10-07 11:33:26.931472] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.746 [2024-10-07 11:33:26.931532] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.746 [2024-10-07 11:33:26.941095] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.746 [2024-10-07 11:33:26.941142] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.746 [2024-10-07 11:33:26.941285] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.746 [2024-10-07 11:33:26.941320] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.746 [2024-10-07 11:33:26.941337] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.746 [2024-10-07 11:33:26.941384] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.746 [2024-10-07 11:33:26.941407] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.746 [2024-10-07 11:33:26.941422] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.746 [2024-10-07 11:33:26.941445] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.746 [2024-10-07 11:33:26.941464] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.746 [2024-10-07 11:33:26.941484] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.746 [2024-10-07 11:33:26.941498] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.746 [2024-10-07 11:33:26.941512] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.746 [2024-10-07 11:33:26.941528] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.746 [2024-10-07 11:33:26.941542] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.746 [2024-10-07 11:33:26.941555] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.746 [2024-10-07 11:33:26.941577] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.746 [2024-10-07 11:33:26.941591] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.746 [2024-10-07 11:33:26.951215] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.746 [2024-10-07 11:33:26.951278] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.746 [2024-10-07 11:33:26.951355] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.746 [2024-10-07 11:33:26.951384] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.746 [2024-10-07 11:33:26.951400] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.747 [2024-10-07 11:33:26.951454] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.747 [2024-10-07 11:33:26.951478] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.747 [2024-10-07 11:33:26.951493] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.747 [2024-10-07 11:33:26.951511] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.747 [2024-10-07 11:33:26.951534] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.747 [2024-10-07 11:33:26.951551] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.747 [2024-10-07 11:33:26.951581] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.747 [2024-10-07 11:33:26.951596] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.747 [2024-10-07 11:33:26.951620] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.747 [2024-10-07 11:33:26.951635] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.747 [2024-10-07 11:33:26.951663] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.747 [2024-10-07 11:33:26.951679] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.747 [2024-10-07 11:33:26.951701] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.747 [2024-10-07 11:33:26.961301] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.747 [2024-10-07 11:33:26.961417] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.747 [2024-10-07 11:33:26.961448] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.747 [2024-10-07 11:33:26.961464] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.747 [2024-10-07 11:33:26.961502] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.747 [2024-10-07 11:33:26.961532] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.747 [2024-10-07 11:33:26.961559] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.747 [2024-10-07 11:33:26.961574] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.747 [2024-10-07 11:33:26.961588] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.747 [2024-10-07 11:33:26.961609] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.747 [2024-10-07 11:33:26.961675] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.747 [2024-10-07 11:33:26.961701] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.747 [2024-10-07 11:33:26.961717] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.747 [2024-10-07 11:33:26.961741] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.747 [2024-10-07 11:33:26.961762] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.747 [2024-10-07 11:33:26.961776] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.747 [2024-10-07 11:33:26.961790] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.747 [2024-10-07 11:33:26.961812] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.747 [2024-10-07 11:33:26.971675] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.747 [2024-10-07 11:33:26.971893] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.747 [2024-10-07 11:33:26.971927] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.747 [2024-10-07 11:33:26.971943] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.747 [2024-10-07 11:33:26.972218] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.747 [2024-10-07 11:33:26.972269] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.747 [2024-10-07 11:33:26.972817] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.747 [2024-10-07 11:33:26.972858] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.747 [2024-10-07 11:33:26.972877] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.747 [2024-10-07 11:33:26.972892] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.747 [2024-10-07 11:33:26.972905] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.747 [2024-10-07 11:33:26.972918] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.747 [2024-10-07 11:33:26.976094] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.747 [2024-10-07 11:33:26.976137] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.747 [2024-10-07 11:33:26.976594] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.747 [2024-10-07 11:33:26.976632] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.747 [2024-10-07 11:33:26.976664] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.747 [2024-10-07 11:33:26.976905] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.747 [2024-10-07 11:33:26.981798] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.747 [2024-10-07 11:33:26.981905] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.747 [2024-10-07 11:33:26.981936] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.747 [2024-10-07 11:33:26.981953] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.747 [2024-10-07 11:33:26.981976] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.747 [2024-10-07 11:33:26.981998] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.747 [2024-10-07 11:33:26.982012] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.747 [2024-10-07 11:33:26.982025] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.747 [2024-10-07 11:33:26.982048] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.747 [2024-10-07 11:33:26.982288] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.747 [2024-10-07 11:33:26.982359] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.747 [2024-10-07 11:33:26.982385] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.747 [2024-10-07 11:33:26.982401] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.747 [2024-10-07 11:33:26.982422] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.747 [2024-10-07 11:33:26.982444] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.747 [2024-10-07 11:33:26.982458] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.747 [2024-10-07 11:33:26.982471] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.747 [2024-10-07 11:33:26.982493] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.747 [2024-10-07 11:33:26.991879] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.747 [2024-10-07 11:33:26.991984] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.747 [2024-10-07 11:33:26.992015] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.747 [2024-10-07 11:33:26.992032] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.747 [2024-10-07 11:33:26.994051] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.747 [2024-10-07 11:33:26.994596] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.747 [2024-10-07 11:33:26.994632] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.747 [2024-10-07 11:33:26.994662] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.747 [2024-10-07 11:33:26.995436] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.747 [2024-10-07 11:33:26.995483] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.747 [2024-10-07 11:33:26.995630] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.747 [2024-10-07 11:33:26.995673] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.747 [2024-10-07 11:33:26.995692] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.747 [2024-10-07 11:33:26.995716] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.747 [2024-10-07 11:33:26.995738] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.747 [2024-10-07 11:33:26.995753] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.747 [2024-10-07 11:33:26.995766] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.747 [2024-10-07 11:33:26.995790] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.747 [2024-10-07 11:33:27.004069] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.747 [2024-10-07 11:33:27.004282] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.747 [2024-10-07 11:33:27.004314] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.747 [2024-10-07 11:33:27.004331] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.747 [2024-10-07 11:33:27.004477] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.747 [2024-10-07 11:33:27.004596] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.748 [2024-10-07 11:33:27.004619] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.748 [2024-10-07 11:33:27.004634] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.748 [2024-10-07 11:33:27.004762] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.748 [2024-10-07 11:33:27.010086] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.748 [2024-10-07 11:33:27.010191] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.748 [2024-10-07 11:33:27.010222] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.748 [2024-10-07 11:33:27.010238] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.748 [2024-10-07 11:33:27.010279] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.748 [2024-10-07 11:33:27.010303] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.748 [2024-10-07 11:33:27.010319] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.748 [2024-10-07 11:33:27.010332] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.748 [2024-10-07 11:33:27.010355] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.748 [2024-10-07 11:33:27.016579] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.748 [2024-10-07 11:33:27.016864] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.748 [2024-10-07 11:33:27.016909] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.748 [2024-10-07 11:33:27.016930] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.748 [2024-10-07 11:33:27.017060] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.748 [2024-10-07 11:33:27.017170] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.748 [2024-10-07 11:33:27.017189] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.748 [2024-10-07 11:33:27.017203] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.748 [2024-10-07 11:33:27.017307] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.748 [2024-10-07 11:33:27.021619] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.748 [2024-10-07 11:33:27.021840] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.748 [2024-10-07 11:33:27.021873] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.748 [2024-10-07 11:33:27.021890] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.748 [2024-10-07 11:33:27.022035] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.748 [2024-10-07 11:33:27.022169] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.748 [2024-10-07 11:33:27.022191] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.748 [2024-10-07 11:33:27.022206] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.748 [2024-10-07 11:33:27.022322] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.748 [2024-10-07 11:33:27.027008] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.748 [2024-10-07 11:33:27.027211] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.748 [2024-10-07 11:33:27.027244] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.748 [2024-10-07 11:33:27.027262] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.748 [2024-10-07 11:33:27.027621] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.748 [2024-10-07 11:33:27.029526] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.748 [2024-10-07 11:33:27.029565] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.748 [2024-10-07 11:33:27.029598] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.748 [2024-10-07 11:33:27.030234] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.748 [2024-10-07 11:33:27.032144] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.748 [2024-10-07 11:33:27.032245] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.748 [2024-10-07 11:33:27.032274] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.748 [2024-10-07 11:33:27.032291] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.748 [2024-10-07 11:33:27.032315] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.748 [2024-10-07 11:33:27.032337] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.748 [2024-10-07 11:33:27.032351] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.748 [2024-10-07 11:33:27.032364] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.748 [2024-10-07 11:33:27.032387] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.748 [2024-10-07 11:33:27.037688] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.748 [2024-10-07 11:33:27.037898] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.748 [2024-10-07 11:33:27.037942] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.748 [2024-10-07 11:33:27.037962] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.748 [2024-10-07 11:33:27.038078] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.748 [2024-10-07 11:33:27.038187] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.748 [2024-10-07 11:33:27.038207] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.748 [2024-10-07 11:33:27.038221] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.748 [2024-10-07 11:33:27.038321] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.748 [2024-10-07 11:33:27.042229] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.748 [2024-10-07 11:33:27.042333] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.748 [2024-10-07 11:33:27.042363] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.748 [2024-10-07 11:33:27.042380] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.748 [2024-10-07 11:33:27.042403] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.748 [2024-10-07 11:33:27.042440] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.748 [2024-10-07 11:33:27.042459] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.748 [2024-10-07 11:33:27.042473] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.748 [2024-10-07 11:33:27.043950] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.748 [2024-10-07 11:33:27.047766] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.748 [2024-10-07 11:33:27.047885] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.748 [2024-10-07 11:33:27.047916] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.748 [2024-10-07 11:33:27.047933] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.748 [2024-10-07 11:33:27.047957] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.748 [2024-10-07 11:33:27.049051] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.748 [2024-10-07 11:33:27.049090] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.748 [2024-10-07 11:33:27.049108] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.748 [2024-10-07 11:33:27.049807] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.748 [2024-10-07 11:33:27.052544] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.748 [2024-10-07 11:33:27.052645] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.748 [2024-10-07 11:33:27.052687] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.749 [2024-10-07 11:33:27.052705] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.749 [2024-10-07 11:33:27.052728] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.749 [2024-10-07 11:33:27.052750] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.749 [2024-10-07 11:33:27.052765] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.749 [2024-10-07 11:33:27.052778] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.749 [2024-10-07 11:33:27.052801] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.749 [2024-10-07 11:33:27.057855] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.749 [2024-10-07 11:33:27.057962] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.749 [2024-10-07 11:33:27.057992] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.749 [2024-10-07 11:33:27.058008] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.749 [2024-10-07 11:33:27.058031] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.749 [2024-10-07 11:33:27.058053] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.749 [2024-10-07 11:33:27.058068] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.749 [2024-10-07 11:33:27.058081] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.749 [2024-10-07 11:33:27.058104] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.749 [2024-10-07 11:33:27.064541] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.749 [2024-10-07 11:33:27.064719] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.749 [2024-10-07 11:33:27.064751] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.749 [2024-10-07 11:33:27.064767] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.749 [2024-10-07 11:33:27.064805] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.749 [2024-10-07 11:33:27.064829] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.749 [2024-10-07 11:33:27.064844] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.749 [2024-10-07 11:33:27.064858] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.749 [2024-10-07 11:33:27.064882] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.749 [2024-10-07 11:33:27.070462] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.749 [2024-10-07 11:33:27.070691] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.749 [2024-10-07 11:33:27.070725] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.749 [2024-10-07 11:33:27.070742] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.749 [2024-10-07 11:33:27.071085] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.749 [2024-10-07 11:33:27.071279] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.749 [2024-10-07 11:33:27.071314] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.749 [2024-10-07 11:33:27.071331] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.749 [2024-10-07 11:33:27.071435] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.749 [2024-10-07 11:33:27.074966] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.749 [2024-10-07 11:33:27.075233] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.749 [2024-10-07 11:33:27.075277] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.749 [2024-10-07 11:33:27.075297] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.749 [2024-10-07 11:33:27.075465] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.749 [2024-10-07 11:33:27.075588] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.749 [2024-10-07 11:33:27.075610] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.749 [2024-10-07 11:33:27.075625] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.749 [2024-10-07 11:33:27.075770] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.749 [2024-10-07 11:33:27.080557] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.749 [2024-10-07 11:33:27.080675] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.749 [2024-10-07 11:33:27.080706] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.749 [2024-10-07 11:33:27.080722] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.749 [2024-10-07 11:33:27.080746] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.749 [2024-10-07 11:33:27.080768] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.749 [2024-10-07 11:33:27.080782] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.749 [2024-10-07 11:33:27.080813] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.749 [2024-10-07 11:33:27.080839] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.749 [2024-10-07 11:33:27.086250] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.749 [2024-10-07 11:33:27.086460] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.749 [2024-10-07 11:33:27.086492] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.749 [2024-10-07 11:33:27.086509] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.749 [2024-10-07 11:33:27.086623] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.749 [2024-10-07 11:33:27.086748] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.749 [2024-10-07 11:33:27.086769] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.749 [2024-10-07 11:33:27.086784] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.749 [2024-10-07 11:33:27.086894] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.749 [2024-10-07 11:33:27.090936] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.749 [2024-10-07 11:33:27.091040] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.749 [2024-10-07 11:33:27.091070] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.749 [2024-10-07 11:33:27.091087] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.749 [2024-10-07 11:33:27.091110] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.749 [2024-10-07 11:33:27.091132] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.749 [2024-10-07 11:33:27.091147] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.749 [2024-10-07 11:33:27.091160] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.749 [2024-10-07 11:33:27.091194] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.749 [2024-10-07 11:33:27.096684] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.749 [2024-10-07 11:33:27.096945] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.749 [2024-10-07 11:33:27.096988] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.749 [2024-10-07 11:33:27.097008] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.749 [2024-10-07 11:33:27.097081] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.749 [2024-10-07 11:33:27.097112] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.749 [2024-10-07 11:33:27.097128] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.749 [2024-10-07 11:33:27.097142] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.749 [2024-10-07 11:33:27.097317] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.749 [2024-10-07 11:33:27.101402] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.749 [2024-10-07 11:33:27.101505] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.749 [2024-10-07 11:33:27.101557] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.749 [2024-10-07 11:33:27.101576] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.749 [2024-10-07 11:33:27.101611] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.750 [2024-10-07 11:33:27.101636] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.750 [2024-10-07 11:33:27.101665] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.750 [2024-10-07 11:33:27.101681] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.750 [2024-10-07 11:33:27.101704] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.750 [2024-10-07 11:33:27.107639] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.750 [2024-10-07 11:33:27.110276] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.750 [2024-10-07 11:33:27.110321] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.750 [2024-10-07 11:33:27.110341] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.750 [2024-10-07 11:33:27.110847] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.750 [2024-10-07 11:33:27.111070] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.750 [2024-10-07 11:33:27.111106] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.750 [2024-10-07 11:33:27.111123] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.750 [2024-10-07 11:33:27.111264] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.750 [2024-10-07 11:33:27.111728] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.750 [2024-10-07 11:33:27.112006] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.750 [2024-10-07 11:33:27.112047] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.750 [2024-10-07 11:33:27.112067] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.750 [2024-10-07 11:33:27.112121] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.750 [2024-10-07 11:33:27.112149] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.750 [2024-10-07 11:33:27.112164] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.750 [2024-10-07 11:33:27.112177] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.750 [2024-10-07 11:33:27.112201] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.750 [2024-10-07 11:33:27.119099] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.750 [2024-10-07 11:33:27.119309] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.750 [2024-10-07 11:33:27.119341] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.750 [2024-10-07 11:33:27.119358] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.750 [2024-10-07 11:33:27.119382] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.750 [2024-10-07 11:33:27.119419] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.750 [2024-10-07 11:33:27.119435] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.750 [2024-10-07 11:33:27.119448] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.750 [2024-10-07 11:33:27.119472] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.750 [2024-10-07 11:33:27.121800] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.750 [2024-10-07 11:33:27.121901] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.750 [2024-10-07 11:33:27.121930] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.750 [2024-10-07 11:33:27.121946] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.750 [2024-10-07 11:33:27.121969] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.750 [2024-10-07 11:33:27.121991] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.750 [2024-10-07 11:33:27.122005] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.750 [2024-10-07 11:33:27.122019] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.750 [2024-10-07 11:33:27.122042] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.750 [2024-10-07 11:33:27.130210] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.750 [2024-10-07 11:33:27.130417] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.750 [2024-10-07 11:33:27.130449] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.750 [2024-10-07 11:33:27.130467] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.750 [2024-10-07 11:33:27.130580] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.750 [2024-10-07 11:33:27.130700] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.750 [2024-10-07 11:33:27.130722] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.750 [2024-10-07 11:33:27.130736] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.750 [2024-10-07 11:33:27.130838] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.750 [2024-10-07 11:33:27.134351] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.750 [2024-10-07 11:33:27.134501] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.750 [2024-10-07 11:33:27.134531] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.750 [2024-10-07 11:33:27.134548] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.750 [2024-10-07 11:33:27.134821] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.750 [2024-10-07 11:33:27.134970] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.750 [2024-10-07 11:33:27.135013] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.750 [2024-10-07 11:33:27.135031] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.750 [2024-10-07 11:33:27.135095] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.750 [2024-10-07 11:33:27.140291] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.750 [2024-10-07 11:33:27.140396] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.750 [2024-10-07 11:33:27.140426] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.750 [2024-10-07 11:33:27.140443] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.750 [2024-10-07 11:33:27.140467] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.750 [2024-10-07 11:33:27.140503] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.750 [2024-10-07 11:33:27.140521] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.750 [2024-10-07 11:33:27.140535] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.750 [2024-10-07 11:33:27.140558] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.750 [2024-10-07 11:33:27.144429] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.750 [2024-10-07 11:33:27.144532] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.750 [2024-10-07 11:33:27.144561] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.750 [2024-10-07 11:33:27.144577] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.750 [2024-10-07 11:33:27.147077] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.750 [2024-10-07 11:33:27.147970] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.750 [2024-10-07 11:33:27.148007] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.750 [2024-10-07 11:33:27.148024] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.750 [2024-10-07 11:33:27.148363] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.750 [2024-10-07 11:33:27.150367] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.750 [2024-10-07 11:33:27.150502] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.750 [2024-10-07 11:33:27.150531] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.750 [2024-10-07 11:33:27.150548] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.750 [2024-10-07 11:33:27.150571] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.750 [2024-10-07 11:33:27.150593] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.750 [2024-10-07 11:33:27.150607] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.750 [2024-10-07 11:33:27.150620] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.750 [2024-10-07 11:33:27.150643] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.750 [2024-10-07 11:33:27.154995] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.750 [2024-10-07 11:33:27.155159] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.750 [2024-10-07 11:33:27.155206] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.750 [2024-10-07 11:33:27.155242] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.750 [2024-10-07 11:33:27.155268] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.750 [2024-10-07 11:33:27.155290] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.750 [2024-10-07 11:33:27.155304] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.750 [2024-10-07 11:33:27.155318] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.751 [2024-10-07 11:33:27.155342] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.751 [2024-10-07 11:33:27.163574] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.751 [2024-10-07 11:33:27.163692] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.751 [2024-10-07 11:33:27.163723] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.751 [2024-10-07 11:33:27.163740] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.751 [2024-10-07 11:33:27.163764] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.751 [2024-10-07 11:33:27.163787] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.751 [2024-10-07 11:33:27.163801] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.751 [2024-10-07 11:33:27.163816] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.751 [2024-10-07 11:33:27.163839] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.751 [2024-10-07 11:33:27.165086] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.751 [2024-10-07 11:33:27.165178] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.751 [2024-10-07 11:33:27.165206] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.751 [2024-10-07 11:33:27.165222] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.751 [2024-10-07 11:33:27.165245] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.751 [2024-10-07 11:33:27.165267] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.751 [2024-10-07 11:33:27.165281] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.751 [2024-10-07 11:33:27.165294] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.751 [2024-10-07 11:33:27.165316] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.751 [2024-10-07 11:33:27.178550] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.751 [2024-10-07 11:33:27.178696] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.751 [2024-10-07 11:33:27.178779] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.751 [2024-10-07 11:33:27.178808] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.751 [2024-10-07 11:33:27.178824] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.751 [2024-10-07 11:33:27.178894] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.751 [2024-10-07 11:33:27.178935] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.751 [2024-10-07 11:33:27.178952] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.751 [2024-10-07 11:33:27.178970] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.751 [2024-10-07 11:33:27.178994] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.751 [2024-10-07 11:33:27.179011] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.751 [2024-10-07 11:33:27.179026] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.751 [2024-10-07 11:33:27.179039] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.751 [2024-10-07 11:33:27.179063] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.751 [2024-10-07 11:33:27.179078] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.751 [2024-10-07 11:33:27.179090] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.751 [2024-10-07 11:33:27.179103] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.751 [2024-10-07 11:33:27.179124] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.751 [2024-10-07 11:33:27.193728] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.751 [2024-10-07 11:33:27.193776] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.751 [2024-10-07 11:33:27.194223] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.751 [2024-10-07 11:33:27.194267] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.751 [2024-10-07 11:33:27.194287] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.751 [2024-10-07 11:33:27.194338] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.751 [2024-10-07 11:33:27.194362] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.751 [2024-10-07 11:33:27.194377] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.751 [2024-10-07 11:33:27.194444] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.751 [2024-10-07 11:33:27.194470] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.751 [2024-10-07 11:33:27.194490] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.751 [2024-10-07 11:33:27.194505] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.751 [2024-10-07 11:33:27.194518] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.751 [2024-10-07 11:33:27.194534] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.751 [2024-10-07 11:33:27.194548] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.751 [2024-10-07 11:33:27.194561] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.751 [2024-10-07 11:33:27.194584] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.751 [2024-10-07 11:33:27.194598] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.751 [2024-10-07 11:33:27.204131] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.751 [2024-10-07 11:33:27.204287] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.751 [2024-10-07 11:33:27.204368] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.751 [2024-10-07 11:33:27.204397] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.751 [2024-10-07 11:33:27.204413] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.751 [2024-10-07 11:33:27.204552] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.751 [2024-10-07 11:33:27.204578] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.751 [2024-10-07 11:33:27.204594] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.751 [2024-10-07 11:33:27.204612] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.751 [2024-10-07 11:33:27.204776] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.751 [2024-10-07 11:33:27.204805] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.751 [2024-10-07 11:33:27.204820] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.751 [2024-10-07 11:33:27.204834] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.751 [2024-10-07 11:33:27.204884] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.751 [2024-10-07 11:33:27.204904] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.751 [2024-10-07 11:33:27.204917] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.751 [2024-10-07 11:33:27.204930] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.751 [2024-10-07 11:33:27.204952] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.751 [2024-10-07 11:33:27.215246] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.751 [2024-10-07 11:33:27.215293] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.751 [2024-10-07 11:33:27.215515] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.751 [2024-10-07 11:33:27.215558] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.751 [2024-10-07 11:33:27.215575] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.751 [2024-10-07 11:33:27.215623] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.751 [2024-10-07 11:33:27.215661] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.751 [2024-10-07 11:33:27.215679] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.751 [2024-10-07 11:33:27.215800] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.751 [2024-10-07 11:33:27.215827] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.751 [2024-10-07 11:33:27.215923] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.751 [2024-10-07 11:33:27.215948] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.751 [2024-10-07 11:33:27.215978] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.751 [2024-10-07 11:33:27.215997] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.751 [2024-10-07 11:33:27.216012] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.751 [2024-10-07 11:33:27.216025] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.751 [2024-10-07 11:33:27.216128] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.751 [2024-10-07 11:33:27.216147] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.751 [2024-10-07 11:33:27.225875] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.751 [2024-10-07 11:33:27.225924] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.751 [2024-10-07 11:33:27.226817] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.751 [2024-10-07 11:33:27.226861] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.751 [2024-10-07 11:33:27.226881] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.751 [2024-10-07 11:33:27.226931] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.751 [2024-10-07 11:33:27.226955] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.751 [2024-10-07 11:33:27.226970] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.751 [2024-10-07 11:33:27.228726] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.751 [2024-10-07 11:33:27.228770] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.752 [2024-10-07 11:33:27.229218] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.752 [2024-10-07 11:33:27.229256] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.752 [2024-10-07 11:33:27.229274] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.752 [2024-10-07 11:33:27.229291] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.752 [2024-10-07 11:33:27.229305] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.752 [2024-10-07 11:33:27.229318] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.752 [2024-10-07 11:33:27.229460] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.752 [2024-10-07 11:33:27.229483] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.752 [2024-10-07 11:33:27.235993] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.752 [2024-10-07 11:33:27.236057] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.752 [2024-10-07 11:33:27.236133] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.752 [2024-10-07 11:33:27.236162] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.752 [2024-10-07 11:33:27.236178] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.752 [2024-10-07 11:33:27.236643] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.752 [2024-10-07 11:33:27.236697] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.752 [2024-10-07 11:33:27.236732] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.752 [2024-10-07 11:33:27.236753] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.752 [2024-10-07 11:33:27.236905] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.752 [2024-10-07 11:33:27.236932] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.752 [2024-10-07 11:33:27.236946] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.752 [2024-10-07 11:33:27.236959] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.752 [2024-10-07 11:33:27.237086] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.752 [2024-10-07 11:33:27.237110] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.752 [2024-10-07 11:33:27.237124] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.752 [2024-10-07 11:33:27.237137] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.752 [2024-10-07 11:33:27.237170] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.752 [2024-10-07 11:33:27.246071] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.752 [2024-10-07 11:33:27.246196] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.752 [2024-10-07 11:33:27.246227] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.752 [2024-10-07 11:33:27.246245] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.752 [2024-10-07 11:33:27.246284] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.752 [2024-10-07 11:33:27.246313] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.752 [2024-10-07 11:33:27.246340] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.752 [2024-10-07 11:33:27.246355] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.752 [2024-10-07 11:33:27.246369] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.752 [2024-10-07 11:33:27.246390] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.752 [2024-10-07 11:33:27.246442] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.752 [2024-10-07 11:33:27.246467] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.752 [2024-10-07 11:33:27.246482] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.752 [2024-10-07 11:33:27.246508] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.752 [2024-10-07 11:33:27.246529] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.752 [2024-10-07 11:33:27.246543] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.752 [2024-10-07 11:33:27.246556] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.752 [2024-10-07 11:33:27.246578] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.752 [2024-10-07 11:33:27.258339] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.752 [2024-10-07 11:33:27.258402] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.752 [2024-10-07 11:33:27.258718] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.752 [2024-10-07 11:33:27.258752] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.752 [2024-10-07 11:33:27.258791] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.752 [2024-10-07 11:33:27.258847] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.752 [2024-10-07 11:33:27.258870] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.752 [2024-10-07 11:33:27.258885] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.752 [2024-10-07 11:33:27.259379] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.752 [2024-10-07 11:33:27.259421] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.752 [2024-10-07 11:33:27.259662] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.752 [2024-10-07 11:33:27.259696] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.752 [2024-10-07 11:33:27.259713] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.752 [2024-10-07 11:33:27.259730] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.752 [2024-10-07 11:33:27.259745] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.752 [2024-10-07 11:33:27.259757] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.752 [2024-10-07 11:33:27.259813] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.752 [2024-10-07 11:33:27.259833] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.752 [2024-10-07 11:33:27.271046] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.752 [2024-10-07 11:33:27.271096] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.752 [2024-10-07 11:33:27.271292] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.752 [2024-10-07 11:33:27.271324] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.752 [2024-10-07 11:33:27.271341] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.752 [2024-10-07 11:33:27.271389] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.752 [2024-10-07 11:33:27.271412] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.752 [2024-10-07 11:33:27.271427] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.752 [2024-10-07 11:33:27.271560] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.752 [2024-10-07 11:33:27.271588] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.752 [2024-10-07 11:33:27.271713] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.752 [2024-10-07 11:33:27.271736] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.752 [2024-10-07 11:33:27.271750] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.752 [2024-10-07 11:33:27.271781] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.752 [2024-10-07 11:33:27.271797] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.752 [2024-10-07 11:33:27.271810] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.752 [2024-10-07 11:33:27.271925] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.752 [2024-10-07 11:33:27.271946] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.752 [2024-10-07 11:33:27.281175] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.752 [2024-10-07 11:33:27.281221] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.752 [2024-10-07 11:33:27.281306] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.752 [2024-10-07 11:33:27.281335] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.752 [2024-10-07 11:33:27.281351] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.752 [2024-10-07 11:33:27.281397] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.752 [2024-10-07 11:33:27.281419] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.752 [2024-10-07 11:33:27.281434] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.752 [2024-10-07 11:33:27.281457] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.752 [2024-10-07 11:33:27.281476] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.752 [2024-10-07 11:33:27.281496] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.752 [2024-10-07 11:33:27.281510] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.752 [2024-10-07 11:33:27.281523] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.752 [2024-10-07 11:33:27.281539] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.752 [2024-10-07 11:33:27.281553] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.752 [2024-10-07 11:33:27.281565] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.752 [2024-10-07 11:33:27.281588] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.752 [2024-10-07 11:33:27.281602] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.752 [2024-10-07 11:33:27.291284] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.752 [2024-10-07 11:33:27.291348] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.752 [2024-10-07 11:33:27.291434] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.752 [2024-10-07 11:33:27.291463] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.753 [2024-10-07 11:33:27.291479] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.753 [2024-10-07 11:33:27.291533] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.753 [2024-10-07 11:33:27.291557] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.753 [2024-10-07 11:33:27.291572] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.753 [2024-10-07 11:33:27.291606] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.753 [2024-10-07 11:33:27.291664] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.753 [2024-10-07 11:33:27.291687] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.753 [2024-10-07 11:33:27.291701] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.753 [2024-10-07 11:33:27.291714] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.753 [2024-10-07 11:33:27.291738] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.753 [2024-10-07 11:33:27.291754] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.753 [2024-10-07 11:33:27.291766] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.753 [2024-10-07 11:33:27.291779] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.753 [2024-10-07 11:33:27.291799] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.753 [2024-10-07 11:33:27.303747] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.753 [2024-10-07 11:33:27.303795] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.753 [2024-10-07 11:33:27.303881] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.753 [2024-10-07 11:33:27.303909] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.753 [2024-10-07 11:33:27.303925] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.753 [2024-10-07 11:33:27.303973] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.753 [2024-10-07 11:33:27.303996] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.753 [2024-10-07 11:33:27.304011] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.753 [2024-10-07 11:33:27.304507] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.753 [2024-10-07 11:33:27.304549] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.753 [2024-10-07 11:33:27.304812] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.753 [2024-10-07 11:33:27.304848] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.753 [2024-10-07 11:33:27.304870] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.753 [2024-10-07 11:33:27.304898] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.753 [2024-10-07 11:33:27.304914] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.753 [2024-10-07 11:33:27.304927] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.753 [2024-10-07 11:33:27.305407] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.753 [2024-10-07 11:33:27.305442] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.753 [2024-10-07 11:33:27.318075] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.753 [2024-10-07 11:33:27.318129] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.753 [2024-10-07 11:33:27.318236] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.753 [2024-10-07 11:33:27.318266] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.753 [2024-10-07 11:33:27.318283] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.753 [2024-10-07 11:33:27.318330] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.753 [2024-10-07 11:33:27.318353] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.753 [2024-10-07 11:33:27.318368] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.753 [2024-10-07 11:33:27.318391] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.753 [2024-10-07 11:33:27.318411] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.753 [2024-10-07 11:33:27.318431] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.753 [2024-10-07 11:33:27.318445] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.753 [2024-10-07 11:33:27.318459] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.753 [2024-10-07 11:33:27.318475] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.753 [2024-10-07 11:33:27.318489] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.753 [2024-10-07 11:33:27.318502] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.753 [2024-10-07 11:33:27.318524] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.753 [2024-10-07 11:33:27.318540] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.753 [2024-10-07 11:33:27.330325] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.753 [2024-10-07 11:33:27.330374] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.753 [2024-10-07 11:33:27.330499] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.753 [2024-10-07 11:33:27.330529] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.753 [2024-10-07 11:33:27.330546] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.753 [2024-10-07 11:33:27.330593] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.753 [2024-10-07 11:33:27.330616] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.753 [2024-10-07 11:33:27.330632] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.753 [2024-10-07 11:33:27.330696] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.753 [2024-10-07 11:33:27.330723] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.753 [2024-10-07 11:33:27.330743] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.753 [2024-10-07 11:33:27.330757] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.753 [2024-10-07 11:33:27.330771] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.753 [2024-10-07 11:33:27.330788] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.753 [2024-10-07 11:33:27.330816] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.753 [2024-10-07 11:33:27.330830] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.753 [2024-10-07 11:33:27.330853] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.753 [2024-10-07 11:33:27.330868] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.753 [2024-10-07 11:33:27.342374] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.753 [2024-10-07 11:33:27.342423] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.753 [2024-10-07 11:33:27.342622] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.753 [2024-10-07 11:33:27.342681] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.753 [2024-10-07 11:33:27.342701] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.753 [2024-10-07 11:33:27.342752] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.753 [2024-10-07 11:33:27.342776] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.753 [2024-10-07 11:33:27.342791] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.753 [2024-10-07 11:33:27.342946] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.753 [2024-10-07 11:33:27.342976] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.753 [2024-10-07 11:33:27.343101] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.753 [2024-10-07 11:33:27.343124] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.753 [2024-10-07 11:33:27.343138] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.753 [2024-10-07 11:33:27.343155] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.753 [2024-10-07 11:33:27.343169] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.753 [2024-10-07 11:33:27.343195] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.753 [2024-10-07 11:33:27.343312] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.754 [2024-10-07 11:33:27.343333] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.754 [2024-10-07 11:33:27.352724] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.754 [2024-10-07 11:33:27.352773] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.754 [2024-10-07 11:33:27.352942] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.754 [2024-10-07 11:33:27.352973] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.754 [2024-10-07 11:33:27.352989] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.754 [2024-10-07 11:33:27.353038] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.754 [2024-10-07 11:33:27.353062] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.754 [2024-10-07 11:33:27.353077] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.754 [2024-10-07 11:33:27.353241] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.754 [2024-10-07 11:33:27.353286] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.754 [2024-10-07 11:33:27.353338] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.754 [2024-10-07 11:33:27.353360] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.754 [2024-10-07 11:33:27.353374] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.754 [2024-10-07 11:33:27.353390] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.754 [2024-10-07 11:33:27.353405] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.754 [2024-10-07 11:33:27.353418] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.754 [2024-10-07 11:33:27.353440] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.754 [2024-10-07 11:33:27.353455] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.754 [2024-10-07 11:33:27.362944] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.754 [2024-10-07 11:33:27.362993] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.754 [2024-10-07 11:33:27.363080] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.754 [2024-10-07 11:33:27.363110] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.754 [2024-10-07 11:33:27.363126] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.754 [2024-10-07 11:33:27.363174] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.754 [2024-10-07 11:33:27.363209] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.754 [2024-10-07 11:33:27.363237] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.754 [2024-10-07 11:33:27.365860] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.754 [2024-10-07 11:33:27.365903] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.754 [2024-10-07 11:33:27.367039] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.754 [2024-10-07 11:33:27.367078] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.754 [2024-10-07 11:33:27.367096] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.754 [2024-10-07 11:33:27.367113] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.754 [2024-10-07 11:33:27.367127] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.754 [2024-10-07 11:33:27.367139] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.754 [2024-10-07 11:33:27.367391] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.754 [2024-10-07 11:33:27.367417] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.754 [2024-10-07 11:33:27.373054] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.754 [2024-10-07 11:33:27.373114] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.754 [2024-10-07 11:33:27.373190] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.754 [2024-10-07 11:33:27.373238] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.754 [2024-10-07 11:33:27.373256] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.754 [2024-10-07 11:33:27.373312] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.754 [2024-10-07 11:33:27.373337] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.754 [2024-10-07 11:33:27.373352] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.754 [2024-10-07 11:33:27.373370] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.754 [2024-10-07 11:33:27.373394] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.754 [2024-10-07 11:33:27.373411] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.754 [2024-10-07 11:33:27.373424] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.754 [2024-10-07 11:33:27.373438] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.754 [2024-10-07 11:33:27.375891] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.754 [2024-10-07 11:33:27.375932] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.754 [2024-10-07 11:33:27.375950] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.754 [2024-10-07 11:33:27.375964] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.754 [2024-10-07 11:33:27.376533] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.754 [2024-10-07 11:33:27.383133] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.754 [2024-10-07 11:33:27.383249] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.754 [2024-10-07 11:33:27.383280] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.754 [2024-10-07 11:33:27.383297] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.754 [2024-10-07 11:33:27.383551] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.754 [2024-10-07 11:33:27.383639] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.754 [2024-10-07 11:33:27.383694] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.754 [2024-10-07 11:33:27.383711] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.754 [2024-10-07 11:33:27.383725] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.754 [2024-10-07 11:33:27.383748] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.754 [2024-10-07 11:33:27.383805] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.754 [2024-10-07 11:33:27.383830] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.754 [2024-10-07 11:33:27.383846] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.754 [2024-10-07 11:33:27.383870] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.754 [2024-10-07 11:33:27.383892] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.754 [2024-10-07 11:33:27.383922] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.754 [2024-10-07 11:33:27.383936] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.754 [2024-10-07 11:33:27.383959] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.754 [2024-10-07 11:33:27.396115] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.754 [2024-10-07 11:33:27.396165] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.754 [2024-10-07 11:33:27.396383] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.754 [2024-10-07 11:33:27.396416] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.754 [2024-10-07 11:33:27.396433] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.754 [2024-10-07 11:33:27.396484] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.754 [2024-10-07 11:33:27.396507] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.754 [2024-10-07 11:33:27.396522] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.754 [2024-10-07 11:33:27.396625] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.754 [2024-10-07 11:33:27.396665] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.754 [2024-10-07 11:33:27.396768] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.754 [2024-10-07 11:33:27.396788] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.754 [2024-10-07 11:33:27.396802] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.754 [2024-10-07 11:33:27.396818] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.754 [2024-10-07 11:33:27.396832] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.754 [2024-10-07 11:33:27.396846] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.754 [2024-10-07 11:33:27.396960] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.754 [2024-10-07 11:33:27.396982] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.754 [2024-10-07 11:33:27.406228] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.755 [2024-10-07 11:33:27.406292] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.755 [2024-10-07 11:33:27.406369] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.755 [2024-10-07 11:33:27.406398] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.755 [2024-10-07 11:33:27.406415] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.755 [2024-10-07 11:33:27.406468] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.755 [2024-10-07 11:33:27.406492] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.755 [2024-10-07 11:33:27.406507] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.755 [2024-10-07 11:33:27.406524] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.755 [2024-10-07 11:33:27.406547] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.755 [2024-10-07 11:33:27.406579] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.755 [2024-10-07 11:33:27.406594] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.755 [2024-10-07 11:33:27.406607] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.755 [2024-10-07 11:33:27.407079] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.755 [2024-10-07 11:33:27.407107] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.755 [2024-10-07 11:33:27.407121] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.755 [2024-10-07 11:33:27.407134] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.755 [2024-10-07 11:33:27.407301] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.755 [2024-10-07 11:33:27.416577] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.755 [2024-10-07 11:33:27.416625] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.755 [2024-10-07 11:33:27.416725] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.755 [2024-10-07 11:33:27.416755] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.755 [2024-10-07 11:33:27.416771] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.755 [2024-10-07 11:33:27.416818] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.755 [2024-10-07 11:33:27.416841] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.755 [2024-10-07 11:33:27.416855] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.755 [2024-10-07 11:33:27.416878] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.755 [2024-10-07 11:33:27.416898] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.755 [2024-10-07 11:33:27.416917] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.755 [2024-10-07 11:33:27.416933] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.755 [2024-10-07 11:33:27.416946] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.755 [2024-10-07 11:33:27.416962] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.755 [2024-10-07 11:33:27.416976] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.755 [2024-10-07 11:33:27.416988] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.755 [2024-10-07 11:33:27.417011] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.755 [2024-10-07 11:33:27.417025] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.755 [2024-10-07 11:33:27.427049] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.755 [2024-10-07 11:33:27.427098] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.755 [2024-10-07 11:33:27.427339] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.755 [2024-10-07 11:33:27.427372] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.755 [2024-10-07 11:33:27.427406] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.755 [2024-10-07 11:33:27.427457] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.755 [2024-10-07 11:33:27.427481] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.755 [2024-10-07 11:33:27.427496] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.755 [2024-10-07 11:33:27.427619] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.755 [2024-10-07 11:33:27.427665] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.755 [2024-10-07 11:33:27.427771] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.755 [2024-10-07 11:33:27.427791] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.755 [2024-10-07 11:33:27.427805] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.755 [2024-10-07 11:33:27.427822] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.755 [2024-10-07 11:33:27.427836] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.755 [2024-10-07 11:33:27.427849] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.755 [2024-10-07 11:33:27.428210] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.755 [2024-10-07 11:33:27.428236] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.755 [2024-10-07 11:33:27.437159] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.755 [2024-10-07 11:33:27.437222] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.755 [2024-10-07 11:33:27.437298] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.755 [2024-10-07 11:33:27.437329] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.755 [2024-10-07 11:33:27.437345] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.755 [2024-10-07 11:33:27.437398] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.755 [2024-10-07 11:33:27.437422] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.755 [2024-10-07 11:33:27.437437] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.755 [2024-10-07 11:33:27.437454] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.755 [2024-10-07 11:33:27.437477] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.755 [2024-10-07 11:33:27.437494] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.755 [2024-10-07 11:33:27.437508] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.755 [2024-10-07 11:33:27.437521] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.755 [2024-10-07 11:33:27.437544] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.755 [2024-10-07 11:33:27.437558] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.755 [2024-10-07 11:33:27.437571] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.755 [2024-10-07 11:33:27.437598] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.755 [2024-10-07 11:33:27.437621] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.755 [2024-10-07 11:33:27.449669] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.755 [2024-10-07 11:33:27.449713] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.755 [2024-10-07 11:33:27.450121] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.755 [2024-10-07 11:33:27.450164] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.755 [2024-10-07 11:33:27.450184] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.755 [2024-10-07 11:33:27.450234] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.755 [2024-10-07 11:33:27.450258] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.755 [2024-10-07 11:33:27.450277] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.755 [2024-10-07 11:33:27.450349] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.755 [2024-10-07 11:33:27.450375] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.755 [2024-10-07 11:33:27.450412] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.755 [2024-10-07 11:33:27.450431] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.755 [2024-10-07 11:33:27.450444] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.755 [2024-10-07 11:33:27.450460] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.755 [2024-10-07 11:33:27.450474] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.755 [2024-10-07 11:33:27.450487] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.755 [2024-10-07 11:33:27.450509] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.755 [2024-10-07 11:33:27.450524] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.755 [2024-10-07 11:33:27.462024] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.755 [2024-10-07 11:33:27.462073] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.755 [2024-10-07 11:33:27.462187] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.755 [2024-10-07 11:33:27.462218] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.755 [2024-10-07 11:33:27.462234] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.755 [2024-10-07 11:33:27.462281] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.755 [2024-10-07 11:33:27.462304] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.755 [2024-10-07 11:33:27.462318] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.755 [2024-10-07 11:33:27.462800] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.755 [2024-10-07 11:33:27.462841] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.755 [2024-10-07 11:33:27.463077] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.755 [2024-10-07 11:33:27.463115] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.755 [2024-10-07 11:33:27.463132] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.755 [2024-10-07 11:33:27.463150] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.755 [2024-10-07 11:33:27.463163] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.755 [2024-10-07 11:33:27.463176] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.755 [2024-10-07 11:33:27.463246] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.755 [2024-10-07 11:33:27.463267] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.756 [2024-10-07 11:33:27.472476] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.756 [2024-10-07 11:33:27.472523] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.756 [2024-10-07 11:33:27.472608] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.756 [2024-10-07 11:33:27.472637] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.756 [2024-10-07 11:33:27.472668] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.756 [2024-10-07 11:33:27.472719] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.756 [2024-10-07 11:33:27.472742] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.756 [2024-10-07 11:33:27.472758] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.756 [2024-10-07 11:33:27.472781] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.756 [2024-10-07 11:33:27.472801] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.756 [2024-10-07 11:33:27.472821] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.756 [2024-10-07 11:33:27.472835] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.756 [2024-10-07 11:33:27.472848] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.756 [2024-10-07 11:33:27.472864] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.756 [2024-10-07 11:33:27.472878] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.756 [2024-10-07 11:33:27.472890] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.756 [2024-10-07 11:33:27.472913] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.756 [2024-10-07 11:33:27.472927] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.756 [2024-10-07 11:33:27.482945] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.756 [2024-10-07 11:33:27.482994] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.756 [2024-10-07 11:33:27.483113] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.756 [2024-10-07 11:33:27.483143] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.756 [2024-10-07 11:33:27.483160] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.756 [2024-10-07 11:33:27.483241] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.756 [2024-10-07 11:33:27.483267] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.756 [2024-10-07 11:33:27.483282] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.756 [2024-10-07 11:33:27.483307] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.756 [2024-10-07 11:33:27.483333] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.756 [2024-10-07 11:33:27.483352] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.756 [2024-10-07 11:33:27.483367] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.756 [2024-10-07 11:33:27.483380] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.756 [2024-10-07 11:33:27.483396] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.756 [2024-10-07 11:33:27.483410] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.756 [2024-10-07 11:33:27.483423] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.756 [2024-10-07 11:33:27.483445] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.756 [2024-10-07 11:33:27.483460] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.756 [2024-10-07 11:33:27.495870] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.756 [2024-10-07 11:33:27.495918] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.756 [2024-10-07 11:33:27.496199] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.756 [2024-10-07 11:33:27.496241] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.756 [2024-10-07 11:33:27.496262] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.756 [2024-10-07 11:33:27.496312] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.756 [2024-10-07 11:33:27.496335] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.756 [2024-10-07 11:33:27.496351] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.756 [2024-10-07 11:33:27.496419] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.756 [2024-10-07 11:33:27.496458] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.756 [2024-10-07 11:33:27.496484] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.756 [2024-10-07 11:33:27.496498] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.756 [2024-10-07 11:33:27.496512] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.756 [2024-10-07 11:33:27.496529] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.756 [2024-10-07 11:33:27.496543] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.756 [2024-10-07 11:33:27.496556] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.756 [2024-10-07 11:33:27.496578] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.756 [2024-10-07 11:33:27.496606] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.756 [2024-10-07 11:33:27.510107] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.756 [2024-10-07 11:33:27.510156] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.756 [2024-10-07 11:33:27.510514] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.756 [2024-10-07 11:33:27.510557] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.756 [2024-10-07 11:33:27.510576] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.756 [2024-10-07 11:33:27.510626] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.756 [2024-10-07 11:33:27.510664] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.756 [2024-10-07 11:33:27.510682] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.756 [2024-10-07 11:33:27.510806] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.756 [2024-10-07 11:33:27.510835] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.756 [2024-10-07 11:33:27.510856] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.756 [2024-10-07 11:33:27.510872] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.756 [2024-10-07 11:33:27.510885] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.756 [2024-10-07 11:33:27.510902] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.756 [2024-10-07 11:33:27.510916] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.756 [2024-10-07 11:33:27.510928] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.756 [2024-10-07 11:33:27.510951] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.756 [2024-10-07 11:33:27.510965] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.756 [2024-10-07 11:33:27.523502] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.756 [2024-10-07 11:33:27.523557] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.756 [2024-10-07 11:33:27.523740] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.756 [2024-10-07 11:33:27.523772] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.756 [2024-10-07 11:33:27.523789] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.756 [2024-10-07 11:33:27.523839] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.756 [2024-10-07 11:33:27.523868] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.756 [2024-10-07 11:33:27.523883] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.756 [2024-10-07 11:33:27.524048] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.756 [2024-10-07 11:33:27.524078] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.756 [2024-10-07 11:33:27.524129] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.756 [2024-10-07 11:33:27.524167] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.756 [2024-10-07 11:33:27.524183] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.756 [2024-10-07 11:33:27.524199] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.756 [2024-10-07 11:33:27.524214] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.756 [2024-10-07 11:33:27.524227] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.756 [2024-10-07 11:33:27.524250] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.756 [2024-10-07 11:33:27.524264] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.756 [2024-10-07 11:33:27.536874] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.756 [2024-10-07 11:33:27.536924] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.756 [2024-10-07 11:33:27.537030] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.756 [2024-10-07 11:33:27.537061] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.756 [2024-10-07 11:33:27.537078] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.756 [2024-10-07 11:33:27.537126] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.756 [2024-10-07 11:33:27.537149] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.756 [2024-10-07 11:33:27.537164] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.756 [2024-10-07 11:33:27.537484] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.756 [2024-10-07 11:33:27.537515] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.756 [2024-10-07 11:33:27.537663] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.756 [2024-10-07 11:33:27.537687] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.756 [2024-10-07 11:33:27.537701] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.756 [2024-10-07 11:33:27.537718] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.756 [2024-10-07 11:33:27.537732] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.756 [2024-10-07 11:33:27.537745] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.756 [2024-10-07 11:33:27.537854] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.756 [2024-10-07 11:33:27.537878] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.756 [2024-10-07 11:33:27.547126] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.756 [2024-10-07 11:33:27.547174] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.756 [2024-10-07 11:33:27.547271] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.756 [2024-10-07 11:33:27.547300] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.756 [2024-10-07 11:33:27.547316] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.756 [2024-10-07 11:33:27.547363] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.757 [2024-10-07 11:33:27.547402] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.757 [2024-10-07 11:33:27.547419] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.757 [2024-10-07 11:33:27.547443] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.757 [2024-10-07 11:33:27.547462] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.757 [2024-10-07 11:33:27.547481] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.757 [2024-10-07 11:33:27.547495] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.757 [2024-10-07 11:33:27.547509] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.757 [2024-10-07 11:33:27.547525] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.757 [2024-10-07 11:33:27.547539] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.757 [2024-10-07 11:33:27.547551] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.757 [2024-10-07 11:33:27.547573] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.757 [2024-10-07 11:33:27.547588] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.757 [2024-10-07 11:33:27.557963] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.757 [2024-10-07 11:33:27.558010] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.757 [2024-10-07 11:33:27.558095] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.757 [2024-10-07 11:33:27.558124] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.757 [2024-10-07 11:33:27.558141] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.757 [2024-10-07 11:33:27.558187] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.757 [2024-10-07 11:33:27.558210] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.757 [2024-10-07 11:33:27.558225] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.757 [2024-10-07 11:33:27.558262] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.757 [2024-10-07 11:33:27.558286] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.757 [2024-10-07 11:33:27.558305] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.757 [2024-10-07 11:33:27.558320] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.757 [2024-10-07 11:33:27.558333] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.757 [2024-10-07 11:33:27.558349] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.757 [2024-10-07 11:33:27.558362] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.757 [2024-10-07 11:33:27.558375] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.757 [2024-10-07 11:33:27.558397] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.757 [2024-10-07 11:33:27.558411] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.757 [2024-10-07 11:33:27.568077] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.757 [2024-10-07 11:33:27.568298] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.757 [2024-10-07 11:33:27.568391] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.757 [2024-10-07 11:33:27.568420] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.757 [2024-10-07 11:33:27.568437] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.757 [2024-10-07 11:33:27.568523] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.757 [2024-10-07 11:33:27.568551] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.757 [2024-10-07 11:33:27.568566] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.757 [2024-10-07 11:33:27.568585] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.757 [2024-10-07 11:33:27.568624] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.757 [2024-10-07 11:33:27.568660] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.757 [2024-10-07 11:33:27.568676] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.757 [2024-10-07 11:33:27.568690] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.757 [2024-10-07 11:33:27.568714] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.757 [2024-10-07 11:33:27.568729] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.757 [2024-10-07 11:33:27.568742] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.757 [2024-10-07 11:33:27.568755] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.757 [2024-10-07 11:33:27.568775] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.757 [2024-10-07 11:33:27.578857] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.757 [2024-10-07 11:33:27.578905] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.757 [2024-10-07 11:33:27.578990] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.757 [2024-10-07 11:33:27.579019] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.757 [2024-10-07 11:33:27.579035] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.757 [2024-10-07 11:33:27.579087] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.757 [2024-10-07 11:33:27.579110] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.757 [2024-10-07 11:33:27.579125] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.757 [2024-10-07 11:33:27.579148] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.757 [2024-10-07 11:33:27.579167] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.757 [2024-10-07 11:33:27.579200] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.757 [2024-10-07 11:33:27.579217] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.757 [2024-10-07 11:33:27.579247] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.757 [2024-10-07 11:33:27.579265] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.757 [2024-10-07 11:33:27.579279] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.757 [2024-10-07 11:33:27.579292] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.757 [2024-10-07 11:33:27.579470] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.757 [2024-10-07 11:33:27.579496] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.757 [2024-10-07 11:33:27.592895] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.757 [2024-10-07 11:33:27.592944] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.757 [2024-10-07 11:33:27.593030] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.757 [2024-10-07 11:33:27.593060] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.757 [2024-10-07 11:33:27.593076] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.757 [2024-10-07 11:33:27.593124] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.757 [2024-10-07 11:33:27.593146] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.757 [2024-10-07 11:33:27.593161] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.757 [2024-10-07 11:33:27.593184] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.757 [2024-10-07 11:33:27.593204] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.757 [2024-10-07 11:33:27.593224] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.757 [2024-10-07 11:33:27.593238] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.757 [2024-10-07 11:33:27.593252] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.757 [2024-10-07 11:33:27.593268] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.757 [2024-10-07 11:33:27.593282] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.757 [2024-10-07 11:33:27.593295] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.757 [2024-10-07 11:33:27.593317] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.757 [2024-10-07 11:33:27.593331] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.757 [2024-10-07 11:33:27.606719] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.757 [2024-10-07 11:33:27.606768] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.757 [2024-10-07 11:33:27.607134] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.757 [2024-10-07 11:33:27.607178] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.757 [2024-10-07 11:33:27.607208] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.757 [2024-10-07 11:33:27.607260] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.757 [2024-10-07 11:33:27.607284] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.757 [2024-10-07 11:33:27.607314] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.757 [2024-10-07 11:33:27.607522] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.757 [2024-10-07 11:33:27.607553] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.757 [2024-10-07 11:33:27.607609] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.757 [2024-10-07 11:33:27.607630] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.757 [2024-10-07 11:33:27.607644] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.757 [2024-10-07 11:33:27.607678] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.757 [2024-10-07 11:33:27.607693] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.757 [2024-10-07 11:33:27.607706] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.757 [2024-10-07 11:33:27.607730] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.757 [2024-10-07 11:33:27.607745] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.757 [2024-10-07 11:33:27.617569] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.757 [2024-10-07 11:33:27.617618] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.757 [2024-10-07 11:33:27.617801] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.757 [2024-10-07 11:33:27.617833] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.757 [2024-10-07 11:33:27.617850] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.757 [2024-10-07 11:33:27.617896] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.757 [2024-10-07 11:33:27.617920] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.757 [2024-10-07 11:33:27.617934] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.757 [2024-10-07 11:33:27.618037] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.758 [2024-10-07 11:33:27.618065] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.758 [2024-10-07 11:33:27.618394] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.758 [2024-10-07 11:33:27.618431] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.758 [2024-10-07 11:33:27.618448] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.758 [2024-10-07 11:33:27.618465] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.758 [2024-10-07 11:33:27.618480] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.758 [2024-10-07 11:33:27.618492] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.758 [2024-10-07 11:33:27.618561] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.758 [2024-10-07 11:33:27.618581] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.758 [2024-10-07 11:33:27.630962] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.758 [2024-10-07 11:33:27.631032] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.758 [2024-10-07 11:33:27.631118] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.758 [2024-10-07 11:33:27.631147] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.758 [2024-10-07 11:33:27.631163] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.758 [2024-10-07 11:33:27.631224] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.758 [2024-10-07 11:33:27.631249] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.758 [2024-10-07 11:33:27.631264] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.758 [2024-10-07 11:33:27.631288] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.758 [2024-10-07 11:33:27.631308] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.758 [2024-10-07 11:33:27.631327] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.758 [2024-10-07 11:33:27.631342] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.758 [2024-10-07 11:33:27.631355] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.758 [2024-10-07 11:33:27.631371] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.758 [2024-10-07 11:33:27.631385] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.758 [2024-10-07 11:33:27.631397] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.758 [2024-10-07 11:33:27.631420] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.758 [2024-10-07 11:33:27.631434] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.758 [2024-10-07 11:33:27.641268] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.758 [2024-10-07 11:33:27.641318] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.758 [2024-10-07 11:33:27.641482] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.758 [2024-10-07 11:33:27.641513] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.758 [2024-10-07 11:33:27.641530] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.758 [2024-10-07 11:33:27.641578] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.758 [2024-10-07 11:33:27.641608] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.758 [2024-10-07 11:33:27.641623] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.758 [2024-10-07 11:33:27.642351] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.758 [2024-10-07 11:33:27.642393] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.758 [2024-10-07 11:33:27.645290] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.758 [2024-10-07 11:33:27.645330] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.758 [2024-10-07 11:33:27.645348] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.758 [2024-10-07 11:33:27.645380] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.758 [2024-10-07 11:33:27.645396] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.758 [2024-10-07 11:33:27.645409] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.758 [2024-10-07 11:33:27.645866] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.758 [2024-10-07 11:33:27.645896] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.758 [2024-10-07 11:33:27.651515] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.758 [2024-10-07 11:33:27.651562] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.758 [2024-10-07 11:33:27.651663] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.758 [2024-10-07 11:33:27.651694] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.758 [2024-10-07 11:33:27.651710] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.758 [2024-10-07 11:33:27.651760] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.758 [2024-10-07 11:33:27.651784] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.758 [2024-10-07 11:33:27.651799] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.758 [2024-10-07 11:33:27.651822] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.758 [2024-10-07 11:33:27.651842] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.758 [2024-10-07 11:33:27.651862] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.758 [2024-10-07 11:33:27.651876] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.758 [2024-10-07 11:33:27.651889] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.758 [2024-10-07 11:33:27.651905] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.758 [2024-10-07 11:33:27.651919] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.758 [2024-10-07 11:33:27.651932] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.758 [2024-10-07 11:33:27.651954] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.758 [2024-10-07 11:33:27.651968] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.758 [2024-10-07 11:33:27.661788] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.758 [2024-10-07 11:33:27.661836] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.758 [2024-10-07 11:33:27.661920] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.758 [2024-10-07 11:33:27.661949] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.758 [2024-10-07 11:33:27.661966] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.758 [2024-10-07 11:33:27.662013] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.758 [2024-10-07 11:33:27.662036] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.758 [2024-10-07 11:33:27.662051] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.758 [2024-10-07 11:33:27.662094] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.758 [2024-10-07 11:33:27.662114] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.758 [2024-10-07 11:33:27.662134] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.758 [2024-10-07 11:33:27.662150] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.758 [2024-10-07 11:33:27.662164] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.758 [2024-10-07 11:33:27.662180] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.758 [2024-10-07 11:33:27.662194] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.758 [2024-10-07 11:33:27.662206] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.758 [2024-10-07 11:33:27.662228] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.758 [2024-10-07 11:33:27.662242] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.758 [2024-10-07 11:33:27.672821] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.758 [2024-10-07 11:33:27.672869] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.758 [2024-10-07 11:33:27.672954] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.758 [2024-10-07 11:33:27.672983] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.758 [2024-10-07 11:33:27.672999] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.758 [2024-10-07 11:33:27.673048] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.758 [2024-10-07 11:33:27.673071] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.758 [2024-10-07 11:33:27.673086] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.758 [2024-10-07 11:33:27.675264] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.758 [2024-10-07 11:33:27.675311] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.758 [2024-10-07 11:33:27.675446] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.758 [2024-10-07 11:33:27.675472] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.758 [2024-10-07 11:33:27.675486] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.758 [2024-10-07 11:33:27.675503] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.759 [2024-10-07 11:33:27.675517] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.759 [2024-10-07 11:33:27.675530] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.759 [2024-10-07 11:33:27.675708] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.759 [2024-10-07 11:33:27.675735] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.759 [2024-10-07 11:33:27.682949] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.759 [2024-10-07 11:33:27.682995] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.759 [2024-10-07 11:33:27.683097] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.759 [2024-10-07 11:33:27.683126] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.759 [2024-10-07 11:33:27.683143] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.759 [2024-10-07 11:33:27.683203] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.759 [2024-10-07 11:33:27.683228] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.759 [2024-10-07 11:33:27.683243] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.759 [2024-10-07 11:33:27.683421] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.759 [2024-10-07 11:33:27.683450] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.759 [2024-10-07 11:33:27.683508] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.759 [2024-10-07 11:33:27.683530] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.759 [2024-10-07 11:33:27.683544] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.759 [2024-10-07 11:33:27.683560] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.759 [2024-10-07 11:33:27.683575] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.759 [2024-10-07 11:33:27.683587] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.759 [2024-10-07 11:33:27.683609] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.759 [2024-10-07 11:33:27.683623] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.759 [2024-10-07 11:33:27.696324] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.759 [2024-10-07 11:33:27.696372] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.759 [2024-10-07 11:33:27.696458] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.759 [2024-10-07 11:33:27.696487] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.759 [2024-10-07 11:33:27.696504] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.759 [2024-10-07 11:33:27.696551] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.759 [2024-10-07 11:33:27.696574] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.759 [2024-10-07 11:33:27.696589] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.759 [2024-10-07 11:33:27.696612] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.759 [2024-10-07 11:33:27.696631] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.759 [2024-10-07 11:33:27.696664] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.759 [2024-10-07 11:33:27.696682] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.759 [2024-10-07 11:33:27.696696] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.759 [2024-10-07 11:33:27.696712] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.759 [2024-10-07 11:33:27.696739] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.759 [2024-10-07 11:33:27.696753] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.759 [2024-10-07 11:33:27.696777] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.759 [2024-10-07 11:33:27.696792] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.759 [2024-10-07 11:33:27.710479] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.759 [2024-10-07 11:33:27.710529] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.759 [2024-10-07 11:33:27.711842] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.759 [2024-10-07 11:33:27.711888] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.759 [2024-10-07 11:33:27.711909] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.759 [2024-10-07 11:33:27.711959] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.759 [2024-10-07 11:33:27.711982] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.759 [2024-10-07 11:33:27.711997] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.759 [2024-10-07 11:33:27.712585] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.759 [2024-10-07 11:33:27.712628] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.759 [2024-10-07 11:33:27.712876] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.759 [2024-10-07 11:33:27.712912] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.759 [2024-10-07 11:33:27.712929] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.759 [2024-10-07 11:33:27.712947] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.759 [2024-10-07 11:33:27.712962] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.759 [2024-10-07 11:33:27.712974] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.759 [2024-10-07 11:33:27.713176] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.759 [2024-10-07 11:33:27.713200] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.759 [2024-10-07 11:33:27.720875] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.759 [2024-10-07 11:33:27.720928] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.759 [2024-10-07 11:33:27.721093] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.759 [2024-10-07 11:33:27.721123] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.759 [2024-10-07 11:33:27.721139] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.759 [2024-10-07 11:33:27.721186] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.759 [2024-10-07 11:33:27.721208] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.759 [2024-10-07 11:33:27.721223] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.759 [2024-10-07 11:33:27.721351] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.759 [2024-10-07 11:33:27.721378] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.759 [2024-10-07 11:33:27.722070] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.759 [2024-10-07 11:33:27.722109] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.759 [2024-10-07 11:33:27.722126] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.759 [2024-10-07 11:33:27.722143] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.759 [2024-10-07 11:33:27.722158] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.759 [2024-10-07 11:33:27.722171] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.759 [2024-10-07 11:33:27.725620] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.759 [2024-10-07 11:33:27.725671] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.759 [2024-10-07 11:33:27.731110] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.759 [2024-10-07 11:33:27.731156] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.759 [2024-10-07 11:33:27.731272] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.759 [2024-10-07 11:33:27.731313] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.759 [2024-10-07 11:33:27.731333] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.759 [2024-10-07 11:33:27.731385] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.759 [2024-10-07 11:33:27.731409] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.759 [2024-10-07 11:33:27.731425] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.759 [2024-10-07 11:33:27.731449] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.759 [2024-10-07 11:33:27.731469] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.759 [2024-10-07 11:33:27.731489] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.759 [2024-10-07 11:33:27.731504] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.759 [2024-10-07 11:33:27.731517] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.759 [2024-10-07 11:33:27.731533] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.759 [2024-10-07 11:33:27.731552] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.759 [2024-10-07 11:33:27.731565] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.759 [2024-10-07 11:33:27.731587] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.759 [2024-10-07 11:33:27.731601] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.759 [2024-10-07 11:33:27.743715] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.759 [2024-10-07 11:33:27.743763] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.759 [2024-10-07 11:33:27.744064] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.759 [2024-10-07 11:33:27.744121] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.759 [2024-10-07 11:33:27.744142] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.759 [2024-10-07 11:33:27.744194] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.759 [2024-10-07 11:33:27.744218] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.759 [2024-10-07 11:33:27.744233] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.759 [2024-10-07 11:33:27.744438] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.759 [2024-10-07 11:33:27.744469] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.759 [2024-10-07 11:33:27.744539] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.759 [2024-10-07 11:33:27.744563] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.759 [2024-10-07 11:33:27.744578] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.759 [2024-10-07 11:33:27.744595] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.759 [2024-10-07 11:33:27.744609] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.759 [2024-10-07 11:33:27.744621] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.759 [2024-10-07 11:33:27.744644] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.759 [2024-10-07 11:33:27.744676] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.760 [2024-10-07 11:33:27.755491] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.760 [2024-10-07 11:33:27.755540] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.760 [2024-10-07 11:33:27.755781] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.760 [2024-10-07 11:33:27.755814] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.760 [2024-10-07 11:33:27.755832] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.760 [2024-10-07 11:33:27.755880] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.760 [2024-10-07 11:33:27.755903] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.760 [2024-10-07 11:33:27.755918] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.760 [2024-10-07 11:33:27.756047] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.760 [2024-10-07 11:33:27.756076] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.760 [2024-10-07 11:33:27.756183] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.760 [2024-10-07 11:33:27.756204] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.760 [2024-10-07 11:33:27.756218] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.760 [2024-10-07 11:33:27.756235] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.760 [2024-10-07 11:33:27.756250] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.760 [2024-10-07 11:33:27.756278] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.760 [2024-10-07 11:33:27.756394] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.760 [2024-10-07 11:33:27.756415] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.760 [2024-10-07 11:33:27.766507] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.760 [2024-10-07 11:33:27.766562] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.760 [2024-10-07 11:33:27.766659] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.760 [2024-10-07 11:33:27.766689] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.760 [2024-10-07 11:33:27.766705] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.760 [2024-10-07 11:33:27.766755] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.760 [2024-10-07 11:33:27.766778] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.760 [2024-10-07 11:33:27.766794] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.760 [2024-10-07 11:33:27.769310] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.760 [2024-10-07 11:33:27.769355] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.760 [2024-10-07 11:33:27.769645] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.760 [2024-10-07 11:33:27.769696] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.760 [2024-10-07 11:33:27.769713] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.760 [2024-10-07 11:33:27.769731] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.760 [2024-10-07 11:33:27.769745] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.760 [2024-10-07 11:33:27.769758] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.760 [2024-10-07 11:33:27.769905] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.760 [2024-10-07 11:33:27.769928] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.760 [2024-10-07 11:33:27.777595] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.760 [2024-10-07 11:33:27.777642] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.760 [2024-10-07 11:33:27.777803] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.760 [2024-10-07 11:33:27.777834] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.760 [2024-10-07 11:33:27.777850] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.760 [2024-10-07 11:33:27.777897] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.760 [2024-10-07 11:33:27.777920] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.760 [2024-10-07 11:33:27.777935] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.760 [2024-10-07 11:33:27.777958] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.760 [2024-10-07 11:33:27.778006] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.760 [2024-10-07 11:33:27.778027] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.760 [2024-10-07 11:33:27.778042] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.760 [2024-10-07 11:33:27.778055] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.760 [2024-10-07 11:33:27.778072] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.760 [2024-10-07 11:33:27.778086] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.760 [2024-10-07 11:33:27.778099] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.760 [2024-10-07 11:33:27.778121] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.760 [2024-10-07 11:33:27.778135] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.760 [2024-10-07 11:33:27.787718] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.760 [2024-10-07 11:33:27.787781] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.760 [2024-10-07 11:33:27.787856] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.760 [2024-10-07 11:33:27.787884] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.760 [2024-10-07 11:33:27.787900] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.760 [2024-10-07 11:33:27.788094] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.760 [2024-10-07 11:33:27.788126] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.760 [2024-10-07 11:33:27.788153] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.760 [2024-10-07 11:33:27.788175] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.761 [2024-10-07 11:33:27.788299] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.761 [2024-10-07 11:33:27.788325] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.761 [2024-10-07 11:33:27.788339] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.761 [2024-10-07 11:33:27.788352] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.761 [2024-10-07 11:33:27.788498] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.761 [2024-10-07 11:33:27.788522] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.761 [2024-10-07 11:33:27.788536] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.761 [2024-10-07 11:33:27.788550] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.761 [2024-10-07 11:33:27.788600] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.761 [2024-10-07 11:33:27.798027] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.761 [2024-10-07 11:33:27.798172] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.761 [2024-10-07 11:33:27.798251] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.761 [2024-10-07 11:33:27.798280] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.761 [2024-10-07 11:33:27.798312] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.761 [2024-10-07 11:33:27.798591] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.761 [2024-10-07 11:33:27.798633] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.761 [2024-10-07 11:33:27.798664] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.761 [2024-10-07 11:33:27.798685] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.761 [2024-10-07 11:33:27.798743] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.761 [2024-10-07 11:33:27.798767] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.761 [2024-10-07 11:33:27.798782] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.761 [2024-10-07 11:33:27.798795] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.761 [2024-10-07 11:33:27.798819] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.761 [2024-10-07 11:33:27.798834] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.761 [2024-10-07 11:33:27.798847] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.761 [2024-10-07 11:33:27.798859] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.761 [2024-10-07 11:33:27.798879] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.761 [2024-10-07 11:33:27.808108] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.761 [2024-10-07 11:33:27.808214] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.761 [2024-10-07 11:33:27.808244] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.761 [2024-10-07 11:33:27.808260] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.761 [2024-10-07 11:33:27.808284] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.761 [2024-10-07 11:33:27.808319] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.761 [2024-10-07 11:33:27.808338] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.761 [2024-10-07 11:33:27.808351] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.761 [2024-10-07 11:33:27.808375] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.761 [2024-10-07 11:33:27.808393] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.761 [2024-10-07 11:33:27.808456] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.761 [2024-10-07 11:33:27.808482] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.761 [2024-10-07 11:33:27.808497] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.761 [2024-10-07 11:33:27.808524] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.761 [2024-10-07 11:33:27.808585] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.761 [2024-10-07 11:33:27.808605] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.761 [2024-10-07 11:33:27.808633] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.761 [2024-10-07 11:33:27.808671] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.761 [2024-10-07 11:33:27.820444] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.761 [2024-10-07 11:33:27.820493] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.761 [2024-10-07 11:33:27.820579] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.761 [2024-10-07 11:33:27.820607] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.761 [2024-10-07 11:33:27.820624] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.761 [2024-10-07 11:33:27.820685] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.761 [2024-10-07 11:33:27.820710] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.761 [2024-10-07 11:33:27.820725] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.761 [2024-10-07 11:33:27.820748] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.761 [2024-10-07 11:33:27.820768] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.761 [2024-10-07 11:33:27.820803] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.761 [2024-10-07 11:33:27.820821] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.761 [2024-10-07 11:33:27.820834] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.761 [2024-10-07 11:33:27.820850] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.761 [2024-10-07 11:33:27.820865] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.761 [2024-10-07 11:33:27.820877] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.761 [2024-10-07 11:33:27.820900] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.761 [2024-10-07 11:33:27.820914] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.761 [2024-10-07 11:33:27.834108] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.761 [2024-10-07 11:33:27.834157] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.761 [2024-10-07 11:33:27.834483] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.761 [2024-10-07 11:33:27.834526] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.761 [2024-10-07 11:33:27.834546] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.761 [2024-10-07 11:33:27.834596] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.761 [2024-10-07 11:33:27.834620] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.761 [2024-10-07 11:33:27.834635] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.761 [2024-10-07 11:33:27.834704] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.761 [2024-10-07 11:33:27.834731] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.761 [2024-10-07 11:33:27.834771] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.761 [2024-10-07 11:33:27.834787] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.761 [2024-10-07 11:33:27.834800] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.761 [2024-10-07 11:33:27.834817] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.761 [2024-10-07 11:33:27.834832] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.761 [2024-10-07 11:33:27.834844] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.761 [2024-10-07 11:33:27.834867] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.761 [2024-10-07 11:33:27.834881] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.761 [2024-10-07 11:33:27.848134] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.761 [2024-10-07 11:33:27.848182] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.761 [2024-10-07 11:33:27.848268] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.761 [2024-10-07 11:33:27.848297] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.761 [2024-10-07 11:33:27.848314] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.761 [2024-10-07 11:33:27.848359] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.761 [2024-10-07 11:33:27.848382] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.761 [2024-10-07 11:33:27.848397] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.761 [2024-10-07 11:33:27.848419] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.761 [2024-10-07 11:33:27.848439] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.761 [2024-10-07 11:33:27.848459] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.761 [2024-10-07 11:33:27.848473] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.761 [2024-10-07 11:33:27.848487] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.761 [2024-10-07 11:33:27.848502] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.761 [2024-10-07 11:33:27.848516] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.761 [2024-10-07 11:33:27.848529] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.762 [2024-10-07 11:33:27.848553] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.762 [2024-10-07 11:33:27.848568] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.762 [2024-10-07 11:33:27.862203] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.762 [2024-10-07 11:33:27.862250] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.762 [2024-10-07 11:33:27.862334] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.762 [2024-10-07 11:33:27.862362] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.762 [2024-10-07 11:33:27.862379] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.762 [2024-10-07 11:33:27.862442] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.762 [2024-10-07 11:33:27.862466] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.762 [2024-10-07 11:33:27.862481] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.762 [2024-10-07 11:33:27.862505] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.762 [2024-10-07 11:33:27.862524] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.762 [2024-10-07 11:33:27.862544] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.762 [2024-10-07 11:33:27.862558] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.762 [2024-10-07 11:33:27.862571] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.762 [2024-10-07 11:33:27.862587] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.762 [2024-10-07 11:33:27.862602] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.762 [2024-10-07 11:33:27.862614] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.762 [2024-10-07 11:33:27.862636] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.762 [2024-10-07 11:33:27.862664] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.762 [2024-10-07 11:33:27.876500] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.762 [2024-10-07 11:33:27.876547] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.762 [2024-10-07 11:33:27.876632] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.762 [2024-10-07 11:33:27.876675] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.762 [2024-10-07 11:33:27.876694] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.762 [2024-10-07 11:33:27.876742] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.762 [2024-10-07 11:33:27.876765] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.762 [2024-10-07 11:33:27.876780] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.762 [2024-10-07 11:33:27.876803] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.762 [2024-10-07 11:33:27.876823] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.762 [2024-10-07 11:33:27.876842] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.762 [2024-10-07 11:33:27.876856] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.762 [2024-10-07 11:33:27.876870] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.762 [2024-10-07 11:33:27.876886] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.762 [2024-10-07 11:33:27.876900] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.762 [2024-10-07 11:33:27.876912] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.762 [2024-10-07 11:33:27.876952] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.762 [2024-10-07 11:33:27.876968] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.762 [2024-10-07 11:33:27.889150] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.762 [2024-10-07 11:33:27.889201] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.762 [2024-10-07 11:33:27.889292] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.762 [2024-10-07 11:33:27.889321] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.762 [2024-10-07 11:33:27.889336] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.762 [2024-10-07 11:33:27.889384] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.762 [2024-10-07 11:33:27.889407] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.762 [2024-10-07 11:33:27.889422] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.762 [2024-10-07 11:33:27.889444] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.762 [2024-10-07 11:33:27.889464] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.762 [2024-10-07 11:33:27.889484] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.762 [2024-10-07 11:33:27.889498] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.762 [2024-10-07 11:33:27.889511] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.762 [2024-10-07 11:33:27.889527] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.762 [2024-10-07 11:33:27.889541] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.762 [2024-10-07 11:33:27.889553] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.762 [2024-10-07 11:33:27.889576] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.762 [2024-10-07 11:33:27.889590] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.762 [2024-10-07 11:33:27.899262] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.762 [2024-10-07 11:33:27.899328] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.762 [2024-10-07 11:33:27.899404] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.762 [2024-10-07 11:33:27.899432] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.762 [2024-10-07 11:33:27.899448] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.762 [2024-10-07 11:33:27.899503] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.762 [2024-10-07 11:33:27.899527] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.762 [2024-10-07 11:33:27.899542] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.762 [2024-10-07 11:33:27.899560] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.762 [2024-10-07 11:33:27.899583] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.762 [2024-10-07 11:33:27.899600] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.762 [2024-10-07 11:33:27.899628] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.762 [2024-10-07 11:33:27.899643] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.762 [2024-10-07 11:33:27.899682] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.762 [2024-10-07 11:33:27.899698] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.762 [2024-10-07 11:33:27.899711] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.762 [2024-10-07 11:33:27.899728] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.762 [2024-10-07 11:33:27.899751] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.762 8897.27 IOPS, 34.75 MiB/s [2024-10-07T11:33:33.285Z] [2024-10-07 11:33:27.909616] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.762 [2024-10-07 11:33:27.909675] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.762 [2024-10-07 11:33:27.909861] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.762 [2024-10-07 11:33:27.909892] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.762 [2024-10-07 11:33:27.909909] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.762 [2024-10-07 11:33:27.909958] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.763 [2024-10-07 11:33:27.909982] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.763 [2024-10-07 11:33:27.909997] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.763 [2024-10-07 11:33:27.910112] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.763 [2024-10-07 11:33:27.910138] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.763 [2024-10-07 11:33:27.910237] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.763 [2024-10-07 11:33:27.910256] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.763 [2024-10-07 11:33:27.910270] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.763 [2024-10-07 11:33:27.910287] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.763 [2024-10-07 11:33:27.910301] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.763 [2024-10-07 11:33:27.910314] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.763 [2024-10-07 11:33:27.911106] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.763 [2024-10-07 11:33:27.911140] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.763 [2024-10-07 11:33:27.920368] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.763 [2024-10-07 11:33:27.920416] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.763 [2024-10-07 11:33:27.920589] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.763 [2024-10-07 11:33:27.920619] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.763 [2024-10-07 11:33:27.920636] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.763 [2024-10-07 11:33:27.920729] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.763 [2024-10-07 11:33:27.920754] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.763 [2024-10-07 11:33:27.920770] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.763 [2024-10-07 11:33:27.920876] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.763 [2024-10-07 11:33:27.920901] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.763 [2024-10-07 11:33:27.920996] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.763 [2024-10-07 11:33:27.921015] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.763 [2024-10-07 11:33:27.921029] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.763 [2024-10-07 11:33:27.921046] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.763 [2024-10-07 11:33:27.921061] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.763 [2024-10-07 11:33:27.921073] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.763 [2024-10-07 11:33:27.921175] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.763 [2024-10-07 11:33:27.921193] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.763 [2024-10-07 11:33:27.931976] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.763 [2024-10-07 11:33:27.932025] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.763 [2024-10-07 11:33:27.932330] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.763 [2024-10-07 11:33:27.932382] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.763 [2024-10-07 11:33:27.932402] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.763 [2024-10-07 11:33:27.932452] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.763 [2024-10-07 11:33:27.932475] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.763 [2024-10-07 11:33:27.932490] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.763 [2024-10-07 11:33:27.932709] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.763 [2024-10-07 11:33:27.932741] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.763 [2024-10-07 11:33:27.932797] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.763 [2024-10-07 11:33:27.932819] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.763 [2024-10-07 11:33:27.932833] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.763 [2024-10-07 11:33:27.932850] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.763 [2024-10-07 11:33:27.932864] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.763 [2024-10-07 11:33:27.932876] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.763 [2024-10-07 11:33:27.932899] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.763 [2024-10-07 11:33:27.932928] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.763 [2024-10-07 11:33:27.944496] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.763 [2024-10-07 11:33:27.944544] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.763 [2024-10-07 11:33:27.944631] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.763 [2024-10-07 11:33:27.944677] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.763 [2024-10-07 11:33:27.944695] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.763 [2024-10-07 11:33:27.944744] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.763 [2024-10-07 11:33:27.944768] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.763 [2024-10-07 11:33:27.944783] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.763 [2024-10-07 11:33:27.944806] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.763 [2024-10-07 11:33:27.944826] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.763 [2024-10-07 11:33:27.944846] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.763 [2024-10-07 11:33:27.944860] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.763 [2024-10-07 11:33:27.944873] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.763 [2024-10-07 11:33:27.944890] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.763 [2024-10-07 11:33:27.944904] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.763 [2024-10-07 11:33:27.944916] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.763 [2024-10-07 11:33:27.944939] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.763 [2024-10-07 11:33:27.944954] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.763 [2024-10-07 11:33:27.956722] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.763 [2024-10-07 11:33:27.956772] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.763 [2024-10-07 11:33:27.956902] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.763 [2024-10-07 11:33:27.956932] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.763 [2024-10-07 11:33:27.956950] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.763 [2024-10-07 11:33:27.956997] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.763 [2024-10-07 11:33:27.957021] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.763 [2024-10-07 11:33:27.957037] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.763 [2024-10-07 11:33:27.957060] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.763 [2024-10-07 11:33:27.957080] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.763 [2024-10-07 11:33:27.957116] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.763 [2024-10-07 11:33:27.957155] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.763 [2024-10-07 11:33:27.957169] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.763 [2024-10-07 11:33:27.957186] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.763 [2024-10-07 11:33:27.957200] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.763 [2024-10-07 11:33:27.957213] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.763 [2024-10-07 11:33:27.957236] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.763 [2024-10-07 11:33:27.957251] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.763 [2024-10-07 11:33:27.970499] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.763 [2024-10-07 11:33:27.970548] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.763 [2024-10-07 11:33:27.970858] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.763 [2024-10-07 11:33:27.970900] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.763 [2024-10-07 11:33:27.970921] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.763 [2024-10-07 11:33:27.970971] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.763 [2024-10-07 11:33:27.970994] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.763 [2024-10-07 11:33:27.971010] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.763 [2024-10-07 11:33:27.971223] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.763 [2024-10-07 11:33:27.971254] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.763 [2024-10-07 11:33:27.971311] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.763 [2024-10-07 11:33:27.971332] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.763 [2024-10-07 11:33:27.971346] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.764 [2024-10-07 11:33:27.971363] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.764 [2024-10-07 11:33:27.971377] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.764 [2024-10-07 11:33:27.971390] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.764 [2024-10-07 11:33:27.971413] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.764 [2024-10-07 11:33:27.971428] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.764 [2024-10-07 11:33:27.982746] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.764 [2024-10-07 11:33:27.982793] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.764 [2024-10-07 11:33:27.982969] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.764 [2024-10-07 11:33:27.983000] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.764 [2024-10-07 11:33:27.983016] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.764 [2024-10-07 11:33:27.983064] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.764 [2024-10-07 11:33:27.983103] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.764 [2024-10-07 11:33:27.983121] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.764 [2024-10-07 11:33:27.983461] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.764 [2024-10-07 11:33:27.983503] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.764 [2024-10-07 11:33:27.984715] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.764 [2024-10-07 11:33:27.984751] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.764 [2024-10-07 11:33:27.984768] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.764 [2024-10-07 11:33:27.984785] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.764 [2024-10-07 11:33:27.984799] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.764 [2024-10-07 11:33:27.984811] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.764 [2024-10-07 11:33:27.986604] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.764 [2024-10-07 11:33:27.986641] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.764 [2024-10-07 11:33:27.993056] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.764 [2024-10-07 11:33:27.993113] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.764 [2024-10-07 11:33:27.993305] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.764 [2024-10-07 11:33:27.993336] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.764 [2024-10-07 11:33:27.993353] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.764 [2024-10-07 11:33:27.993401] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.764 [2024-10-07 11:33:27.993424] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.764 [2024-10-07 11:33:27.993439] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.764 [2024-10-07 11:33:27.993557] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.764 [2024-10-07 11:33:27.993584] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.764 [2024-10-07 11:33:27.994296] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.764 [2024-10-07 11:33:27.994332] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.764 [2024-10-07 11:33:27.994350] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.764 [2024-10-07 11:33:27.994367] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.764 [2024-10-07 11:33:27.994381] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.764 [2024-10-07 11:33:27.994393] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.764 [2024-10-07 11:33:27.994565] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.764 [2024-10-07 11:33:27.994590] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.764 [2024-10-07 11:33:28.003174] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.764 [2024-10-07 11:33:28.003244] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.764 [2024-10-07 11:33:28.003319] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.764 [2024-10-07 11:33:28.003347] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.764 [2024-10-07 11:33:28.003365] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.764 [2024-10-07 11:33:28.003418] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.764 [2024-10-07 11:33:28.003442] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.764 [2024-10-07 11:33:28.003458] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.764 [2024-10-07 11:33:28.003475] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.764 [2024-10-07 11:33:28.003498] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.764 [2024-10-07 11:33:28.003515] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.764 [2024-10-07 11:33:28.003529] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.764 [2024-10-07 11:33:28.003542] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.764 [2024-10-07 11:33:28.003565] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.764 [2024-10-07 11:33:28.003580] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.764 [2024-10-07 11:33:28.003592] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.764 [2024-10-07 11:33:28.003605] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.764 [2024-10-07 11:33:28.003625] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.764 [2024-10-07 11:33:28.013593] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.764 [2024-10-07 11:33:28.013641] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.764 [2024-10-07 11:33:28.014775] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.764 [2024-10-07 11:33:28.014817] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.764 [2024-10-07 11:33:28.014836] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.764 [2024-10-07 11:33:28.014886] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.764 [2024-10-07 11:33:28.014908] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.764 [2024-10-07 11:33:28.014924] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.764 [2024-10-07 11:33:28.015204] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.764 [2024-10-07 11:33:28.015238] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.764 [2024-10-07 11:33:28.015371] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.764 [2024-10-07 11:33:28.015396] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.764 [2024-10-07 11:33:28.015424] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.764 [2024-10-07 11:33:28.015443] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.764 [2024-10-07 11:33:28.015458] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.764 [2024-10-07 11:33:28.015470] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.764 [2024-10-07 11:33:28.015573] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.764 [2024-10-07 11:33:28.015592] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.764 [2024-10-07 11:33:28.024432] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.764 [2024-10-07 11:33:28.024481] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.764 [2024-10-07 11:33:28.024631] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.764 [2024-10-07 11:33:28.024678] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.764 [2024-10-07 11:33:28.024697] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.764 [2024-10-07 11:33:28.024747] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.764 [2024-10-07 11:33:28.024771] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.764 [2024-10-07 11:33:28.024786] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.764 [2024-10-07 11:33:28.024831] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.764 [2024-10-07 11:33:28.024860] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.764 [2024-10-07 11:33:28.024880] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.764 [2024-10-07 11:33:28.024895] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.764 [2024-10-07 11:33:28.024909] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.764 [2024-10-07 11:33:28.024925] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.764 [2024-10-07 11:33:28.024939] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.764 [2024-10-07 11:33:28.024952] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.764 [2024-10-07 11:33:28.024974] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.764 [2024-10-07 11:33:28.024988] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.764 [2024-10-07 11:33:28.035964] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.764 [2024-10-07 11:33:28.036013] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.764 [2024-10-07 11:33:28.036098] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.765 [2024-10-07 11:33:28.036127] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.765 [2024-10-07 11:33:28.036143] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.765 [2024-10-07 11:33:28.036190] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.765 [2024-10-07 11:33:28.036214] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.765 [2024-10-07 11:33:28.036245] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.765 [2024-10-07 11:33:28.036269] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.765 [2024-10-07 11:33:28.036289] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.765 [2024-10-07 11:33:28.036309] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.765 [2024-10-07 11:33:28.036323] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.765 [2024-10-07 11:33:28.036337] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.765 [2024-10-07 11:33:28.036353] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.765 [2024-10-07 11:33:28.036367] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.765 [2024-10-07 11:33:28.036380] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.765 [2024-10-07 11:33:28.036572] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.765 [2024-10-07 11:33:28.036598] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.765 [2024-10-07 11:33:28.046393] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.765 [2024-10-07 11:33:28.046441] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.765 [2024-10-07 11:33:28.046611] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.765 [2024-10-07 11:33:28.046641] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.765 [2024-10-07 11:33:28.046674] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.765 [2024-10-07 11:33:28.046725] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.765 [2024-10-07 11:33:28.046749] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.765 [2024-10-07 11:33:28.046764] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.765 [2024-10-07 11:33:28.046867] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.765 [2024-10-07 11:33:28.046891] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.765 [2024-10-07 11:33:28.047652] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.765 [2024-10-07 11:33:28.047717] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.765 [2024-10-07 11:33:28.047734] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.765 [2024-10-07 11:33:28.047752] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.765 [2024-10-07 11:33:28.047767] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.765 [2024-10-07 11:33:28.047779] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.765 [2024-10-07 11:33:28.049746] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.765 [2024-10-07 11:33:28.049782] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.765 [2024-10-07 11:33:28.057603] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.765 [2024-10-07 11:33:28.057688] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.765 [2024-10-07 11:33:28.057857] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.765 [2024-10-07 11:33:28.057887] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.765 [2024-10-07 11:33:28.057904] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.765 [2024-10-07 11:33:28.057951] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.765 [2024-10-07 11:33:28.057974] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.765 [2024-10-07 11:33:28.057989] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.765 [2024-10-07 11:33:28.058144] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.765 [2024-10-07 11:33:28.058175] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.765 [2024-10-07 11:33:28.058242] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.765 [2024-10-07 11:33:28.058265] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.765 [2024-10-07 11:33:28.058279] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.765 [2024-10-07 11:33:28.058296] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.765 [2024-10-07 11:33:28.058310] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.765 [2024-10-07 11:33:28.058323] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.765 [2024-10-07 11:33:28.058346] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.765 [2024-10-07 11:33:28.058361] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.765 [2024-10-07 11:33:28.067754] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.765 [2024-10-07 11:33:28.067816] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.765 [2024-10-07 11:33:28.067891] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.765 [2024-10-07 11:33:28.067919] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.765 [2024-10-07 11:33:28.067935] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.765 [2024-10-07 11:33:28.067991] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.765 [2024-10-07 11:33:28.068015] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.765 [2024-10-07 11:33:28.068030] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.765 [2024-10-07 11:33:28.068047] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.765 [2024-10-07 11:33:28.068071] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.765 [2024-10-07 11:33:28.068089] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.765 [2024-10-07 11:33:28.068102] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.765 [2024-10-07 11:33:28.068115] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.765 [2024-10-07 11:33:28.068153] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.765 [2024-10-07 11:33:28.068169] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.765 [2024-10-07 11:33:28.068183] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.765 [2024-10-07 11:33:28.068196] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.765 [2024-10-07 11:33:28.068215] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.765 [2024-10-07 11:33:28.077833] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.765 [2024-10-07 11:33:28.077951] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.765 [2024-10-07 11:33:28.077981] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.765 [2024-10-07 11:33:28.077997] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.765 [2024-10-07 11:33:28.078212] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.765 [2024-10-07 11:33:28.078371] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.765 [2024-10-07 11:33:28.078419] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.765 [2024-10-07 11:33:28.078438] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.765 [2024-10-07 11:33:28.078452] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.765 [2024-10-07 11:33:28.078560] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.765 [2024-10-07 11:33:28.078621] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.765 [2024-10-07 11:33:28.078660] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.765 [2024-10-07 11:33:28.078680] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.765 [2024-10-07 11:33:28.078792] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.765 [2024-10-07 11:33:28.078896] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.765 [2024-10-07 11:33:28.078915] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.765 [2024-10-07 11:33:28.078929] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.765 [2024-10-07 11:33:28.079092] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.765 [2024-10-07 11:33:28.088179] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.765 [2024-10-07 11:33:28.088297] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.765 [2024-10-07 11:33:28.088327] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.765 [2024-10-07 11:33:28.088343] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.765 [2024-10-07 11:33:28.088366] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.765 [2024-10-07 11:33:28.088388] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.765 [2024-10-07 11:33:28.088402] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.765 [2024-10-07 11:33:28.088432] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.765 [2024-10-07 11:33:28.088458] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.765 [2024-10-07 11:33:28.088494] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.765 [2024-10-07 11:33:28.088566] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.766 [2024-10-07 11:33:28.088593] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.766 [2024-10-07 11:33:28.088609] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.766 [2024-10-07 11:33:28.088631] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.766 [2024-10-07 11:33:28.088653] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.766 [2024-10-07 11:33:28.088684] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.766 [2024-10-07 11:33:28.088699] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.766 [2024-10-07 11:33:28.088722] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.766 [2024-10-07 11:33:28.099607] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.766 [2024-10-07 11:33:28.099667] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.766 [2024-10-07 11:33:28.101973] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.766 [2024-10-07 11:33:28.102017] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.766 [2024-10-07 11:33:28.102038] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.766 [2024-10-07 11:33:28.102087] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.766 [2024-10-07 11:33:28.102111] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.766 [2024-10-07 11:33:28.102126] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.766 [2024-10-07 11:33:28.102391] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.766 [2024-10-07 11:33:28.102423] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.766 [2024-10-07 11:33:28.102600] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.766 [2024-10-07 11:33:28.102633] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.766 [2024-10-07 11:33:28.102664] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.766 [2024-10-07 11:33:28.102685] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.766 [2024-10-07 11:33:28.102699] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.766 [2024-10-07 11:33:28.102711] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.766 [2024-10-07 11:33:28.102850] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.766 [2024-10-07 11:33:28.102873] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.766 [2024-10-07 11:33:28.111091] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.766 [2024-10-07 11:33:28.111138] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.766 [2024-10-07 11:33:28.111250] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.766 [2024-10-07 11:33:28.111281] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.766 [2024-10-07 11:33:28.111297] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.766 [2024-10-07 11:33:28.111344] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.766 [2024-10-07 11:33:28.111367] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.766 [2024-10-07 11:33:28.111382] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.766 [2024-10-07 11:33:28.111405] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.766 [2024-10-07 11:33:28.111424] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.766 [2024-10-07 11:33:28.111444] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.766 [2024-10-07 11:33:28.111459] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.766 [2024-10-07 11:33:28.111472] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.766 [2024-10-07 11:33:28.111488] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.766 [2024-10-07 11:33:28.111502] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.766 [2024-10-07 11:33:28.111515] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.766 [2024-10-07 11:33:28.111538] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.766 [2024-10-07 11:33:28.111552] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.766 [2024-10-07 11:33:28.122027] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.766 [2024-10-07 11:33:28.122075] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.766 [2024-10-07 11:33:28.123361] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.766 [2024-10-07 11:33:28.123404] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.766 [2024-10-07 11:33:28.123423] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.766 [2024-10-07 11:33:28.123475] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.766 [2024-10-07 11:33:28.123499] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.766 [2024-10-07 11:33:28.123514] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.766 [2024-10-07 11:33:28.124012] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.766 [2024-10-07 11:33:28.124054] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.766 [2024-10-07 11:33:28.125222] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.766 [2024-10-07 11:33:28.125258] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.766 [2024-10-07 11:33:28.125276] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.766 [2024-10-07 11:33:28.125293] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.766 [2024-10-07 11:33:28.125320] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.766 [2024-10-07 11:33:28.125350] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.766 [2024-10-07 11:33:28.125616] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.766 [2024-10-07 11:33:28.125679] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.766 [2024-10-07 11:33:28.132137] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.766 [2024-10-07 11:33:28.132228] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.766 [2024-10-07 11:33:28.132317] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.766 [2024-10-07 11:33:28.132344] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.766 [2024-10-07 11:33:28.132360] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.766 [2024-10-07 11:33:28.132413] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.766 [2024-10-07 11:33:28.132436] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.766 [2024-10-07 11:33:28.132451] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.766 [2024-10-07 11:33:28.132468] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.766 [2024-10-07 11:33:28.132491] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.766 [2024-10-07 11:33:28.132507] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.766 [2024-10-07 11:33:28.132520] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.766 [2024-10-07 11:33:28.132549] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.766 [2024-10-07 11:33:28.132572] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.766 [2024-10-07 11:33:28.132587] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.766 [2024-10-07 11:33:28.132600] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.766 [2024-10-07 11:33:28.132612] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.766 [2024-10-07 11:33:28.132648] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.766 [2024-10-07 11:33:28.143165] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.766 [2024-10-07 11:33:28.143396] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.766 [2024-10-07 11:33:28.143489] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.766 [2024-10-07 11:33:28.143520] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.766 [2024-10-07 11:33:28.143536] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.766 [2024-10-07 11:33:28.143625] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.766 [2024-10-07 11:33:28.143665] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.766 [2024-10-07 11:33:28.143684] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.766 [2024-10-07 11:33:28.143719] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.766 [2024-10-07 11:33:28.144531] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.766 [2024-10-07 11:33:28.144569] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.766 [2024-10-07 11:33:28.144602] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.766 [2024-10-07 11:33:28.144615] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.766 [2024-10-07 11:33:28.146047] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.766 [2024-10-07 11:33:28.146083] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.766 [2024-10-07 11:33:28.146116] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.767 [2024-10-07 11:33:28.146130] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.767 [2024-10-07 11:33:28.146288] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.767 [2024-10-07 11:33:28.153495] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.767 [2024-10-07 11:33:28.153570] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.767 [2024-10-07 11:33:28.153644] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.767 [2024-10-07 11:33:28.153686] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.767 [2024-10-07 11:33:28.153705] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.767 [2024-10-07 11:33:28.153761] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.767 [2024-10-07 11:33:28.153786] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.767 [2024-10-07 11:33:28.153802] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.767 [2024-10-07 11:33:28.153821] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.767 [2024-10-07 11:33:28.153845] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.767 [2024-10-07 11:33:28.153862] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.767 [2024-10-07 11:33:28.153875] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.767 [2024-10-07 11:33:28.153889] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.767 [2024-10-07 11:33:28.153912] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.767 [2024-10-07 11:33:28.153927] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.767 [2024-10-07 11:33:28.153939] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.767 [2024-10-07 11:33:28.153952] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.767 [2024-10-07 11:33:28.153972] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.767 [2024-10-07 11:33:28.163571] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.767 [2024-10-07 11:33:28.163685] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.767 [2024-10-07 11:33:28.163716] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.767 [2024-10-07 11:33:28.163754] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.767 [2024-10-07 11:33:28.163792] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.767 [2024-10-07 11:33:28.163822] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.767 [2024-10-07 11:33:28.163848] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.767 [2024-10-07 11:33:28.163864] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.767 [2024-10-07 11:33:28.163878] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.767 [2024-10-07 11:33:28.163898] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.767 [2024-10-07 11:33:28.163951] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.767 [2024-10-07 11:33:28.163977] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.767 [2024-10-07 11:33:28.163993] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.767 [2024-10-07 11:33:28.164016] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.767 [2024-10-07 11:33:28.164038] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.767 [2024-10-07 11:33:28.164051] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.767 [2024-10-07 11:33:28.164064] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.767 [2024-10-07 11:33:28.165800] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.767 [2024-10-07 11:33:28.173647] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.767 [2024-10-07 11:33:28.173777] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.767 [2024-10-07 11:33:28.173808] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.767 [2024-10-07 11:33:28.173825] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.767 [2024-10-07 11:33:28.173848] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.767 [2024-10-07 11:33:28.173870] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.767 [2024-10-07 11:33:28.173884] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.767 [2024-10-07 11:33:28.173897] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.767 [2024-10-07 11:33:28.173930] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.767 [2024-10-07 11:33:28.173954] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.767 [2024-10-07 11:33:28.174021] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.767 [2024-10-07 11:33:28.174048] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.767 [2024-10-07 11:33:28.174063] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.767 [2024-10-07 11:33:28.174086] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.767 [2024-10-07 11:33:28.174107] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.767 [2024-10-07 11:33:28.174136] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.767 [2024-10-07 11:33:28.174150] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.767 [2024-10-07 11:33:28.174173] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.767 [2024-10-07 11:33:28.185968] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.767 [2024-10-07 11:33:28.186030] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.767 [2024-10-07 11:33:28.186339] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.767 [2024-10-07 11:33:28.186380] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.767 [2024-10-07 11:33:28.186399] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.767 [2024-10-07 11:33:28.186465] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.767 [2024-10-07 11:33:28.186489] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.767 [2024-10-07 11:33:28.186504] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.767 [2024-10-07 11:33:28.187021] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.767 [2024-10-07 11:33:28.187063] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.767 [2024-10-07 11:33:28.187312] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.767 [2024-10-07 11:33:28.187348] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.767 [2024-10-07 11:33:28.187365] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.767 [2024-10-07 11:33:28.187382] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.767 [2024-10-07 11:33:28.187396] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.767 [2024-10-07 11:33:28.187409] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.767 [2024-10-07 11:33:28.187611] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.767 [2024-10-07 11:33:28.187636] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.767 [2024-10-07 11:33:28.198598] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.767 [2024-10-07 11:33:28.198657] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.767 [2024-10-07 11:33:28.198744] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.767 [2024-10-07 11:33:28.198773] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.767 [2024-10-07 11:33:28.198789] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.767 [2024-10-07 11:33:28.198836] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.767 [2024-10-07 11:33:28.198859] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.767 [2024-10-07 11:33:28.198874] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.767 [2024-10-07 11:33:28.199453] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.768 [2024-10-07 11:33:28.199510] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.768 [2024-10-07 11:33:28.199606] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.768 [2024-10-07 11:33:28.199628] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.768 [2024-10-07 11:33:28.199643] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.768 [2024-10-07 11:33:28.199676] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.768 [2024-10-07 11:33:28.199691] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.768 [2024-10-07 11:33:28.199703] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.768 [2024-10-07 11:33:28.199727] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.768 [2024-10-07 11:33:28.199741] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.768 [2024-10-07 11:33:28.209318] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.768 [2024-10-07 11:33:28.209363] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.768 [2024-10-07 11:33:28.210180] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.768 [2024-10-07 11:33:28.210221] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.768 [2024-10-07 11:33:28.210240] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.768 [2024-10-07 11:33:28.210289] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.768 [2024-10-07 11:33:28.210312] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.768 [2024-10-07 11:33:28.210326] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.768 [2024-10-07 11:33:28.211515] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.768 [2024-10-07 11:33:28.211557] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.768 [2024-10-07 11:33:28.211991] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.768 [2024-10-07 11:33:28.212027] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.768 [2024-10-07 11:33:28.212044] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.768 [2024-10-07 11:33:28.212061] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.768 [2024-10-07 11:33:28.212075] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.768 [2024-10-07 11:33:28.212088] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.768 [2024-10-07 11:33:28.212295] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.768 [2024-10-07 11:33:28.212319] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.768 [2024-10-07 11:33:28.219438] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.768 [2024-10-07 11:33:28.222281] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.768 [2024-10-07 11:33:28.222378] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.768 [2024-10-07 11:33:28.222407] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.768 [2024-10-07 11:33:28.222438] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.768 [2024-10-07 11:33:28.223498] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.768 [2024-10-07 11:33:28.223541] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.768 [2024-10-07 11:33:28.223561] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.768 [2024-10-07 11:33:28.223579] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.768 [2024-10-07 11:33:28.223805] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.768 [2024-10-07 11:33:28.223833] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.768 [2024-10-07 11:33:28.223848] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.768 [2024-10-07 11:33:28.223861] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.768 [2024-10-07 11:33:28.223965] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.768 [2024-10-07 11:33:28.223985] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.768 [2024-10-07 11:33:28.223998] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.768 [2024-10-07 11:33:28.224011] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.768 [2024-10-07 11:33:28.224574] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.768 [2024-10-07 11:33:28.229514] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.768 [2024-10-07 11:33:28.229615] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.768 [2024-10-07 11:33:28.229645] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.768 [2024-10-07 11:33:28.229679] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.768 [2024-10-07 11:33:28.232111] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.768 [2024-10-07 11:33:28.233021] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.768 [2024-10-07 11:33:28.233059] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.768 [2024-10-07 11:33:28.233077] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.768 [2024-10-07 11:33:28.233329] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.768 [2024-10-07 11:33:28.233478] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.768 [2024-10-07 11:33:28.233667] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.768 [2024-10-07 11:33:28.233706] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.768 [2024-10-07 11:33:28.233725] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.768 [2024-10-07 11:33:28.233841] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.768 [2024-10-07 11:33:28.233945] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.768 [2024-10-07 11:33:28.233965] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.768 [2024-10-07 11:33:28.233999] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.768 [2024-10-07 11:33:28.234298] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.768 [2024-10-07 11:33:28.239590] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.768 [2024-10-07 11:33:28.239707] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.768 [2024-10-07 11:33:28.239738] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.768 [2024-10-07 11:33:28.239755] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.768 [2024-10-07 11:33:28.239778] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.768 [2024-10-07 11:33:28.239800] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.768 [2024-10-07 11:33:28.239814] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.768 [2024-10-07 11:33:28.239828] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.768 [2024-10-07 11:33:28.239851] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.768 [2024-10-07 11:33:28.244585] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.768 [2024-10-07 11:33:28.244812] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.768 [2024-10-07 11:33:28.244844] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.768 [2024-10-07 11:33:28.244861] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.768 [2024-10-07 11:33:28.244991] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.768 [2024-10-07 11:33:28.245110] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.768 [2024-10-07 11:33:28.245132] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.768 [2024-10-07 11:33:28.245146] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.768 [2024-10-07 11:33:28.245249] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.768 [2024-10-07 11:33:28.252895] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.768 [2024-10-07 11:33:28.253232] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.768 [2024-10-07 11:33:28.253275] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.768 [2024-10-07 11:33:28.253295] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.768 [2024-10-07 11:33:28.253350] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.768 [2024-10-07 11:33:28.253379] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.768 [2024-10-07 11:33:28.253394] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.768 [2024-10-07 11:33:28.253407] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.768 [2024-10-07 11:33:28.253431] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.768 [2024-10-07 11:33:28.254676] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.768 [2024-10-07 11:33:28.254792] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.768 [2024-10-07 11:33:28.254822] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.768 [2024-10-07 11:33:28.254838] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.768 [2024-10-07 11:33:28.254861] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.768 [2024-10-07 11:33:28.254883] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.768 [2024-10-07 11:33:28.254898] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.768 [2024-10-07 11:33:28.254911] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.769 [2024-10-07 11:33:28.254933] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.769 [2024-10-07 11:33:28.266337] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.769 [2024-10-07 11:33:28.266386] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.769 [2024-10-07 11:33:28.267814] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.769 [2024-10-07 11:33:28.267858] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.769 [2024-10-07 11:33:28.267878] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.769 [2024-10-07 11:33:28.267928] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.769 [2024-10-07 11:33:28.267951] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.769 [2024-10-07 11:33:28.267966] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.769 [2024-10-07 11:33:28.268635] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.769 [2024-10-07 11:33:28.268689] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.769 [2024-10-07 11:33:28.268784] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.769 [2024-10-07 11:33:28.268806] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.769 [2024-10-07 11:33:28.268821] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.769 [2024-10-07 11:33:28.268841] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.769 [2024-10-07 11:33:28.268871] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.769 [2024-10-07 11:33:28.268898] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.769 [2024-10-07 11:33:28.268946] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.769 [2024-10-07 11:33:28.268966] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.769 [2024-10-07 11:33:28.276703] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.769 [2024-10-07 11:33:28.276749] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.769 [2024-10-07 11:33:28.276924] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.769 [2024-10-07 11:33:28.276954] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.769 [2024-10-07 11:33:28.276971] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.769 [2024-10-07 11:33:28.277036] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.769 [2024-10-07 11:33:28.277060] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.769 [2024-10-07 11:33:28.277075] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.769 [2024-10-07 11:33:28.277504] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.769 [2024-10-07 11:33:28.277545] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.769 [2024-10-07 11:33:28.280634] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.769 [2024-10-07 11:33:28.280698] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.769 [2024-10-07 11:33:28.280718] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.769 [2024-10-07 11:33:28.280736] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.769 [2024-10-07 11:33:28.280750] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.769 [2024-10-07 11:33:28.280763] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.769 [2024-10-07 11:33:28.281208] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.769 [2024-10-07 11:33:28.281236] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.769 [2024-10-07 11:33:28.287893] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.769 [2024-10-07 11:33:28.287940] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.769 [2024-10-07 11:33:28.288024] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.769 [2024-10-07 11:33:28.288053] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.769 [2024-10-07 11:33:28.288070] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.769 [2024-10-07 11:33:28.288116] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.769 [2024-10-07 11:33:28.288138] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.769 [2024-10-07 11:33:28.288153] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.769 [2024-10-07 11:33:28.288176] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.769 [2024-10-07 11:33:28.288195] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.769 [2024-10-07 11:33:28.288215] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.769 [2024-10-07 11:33:28.288230] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.769 [2024-10-07 11:33:28.288243] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.769 [2024-10-07 11:33:28.288258] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.769 [2024-10-07 11:33:28.288272] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.769 [2024-10-07 11:33:28.288285] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.769 [2024-10-07 11:33:28.288311] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.769 [2024-10-07 11:33:28.288357] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.769 [2024-10-07 11:33:28.298003] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.769 [2024-10-07 11:33:28.298067] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.769 [2024-10-07 11:33:28.298144] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.769 [2024-10-07 11:33:28.298173] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.769 [2024-10-07 11:33:28.298189] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.769 [2024-10-07 11:33:28.298258] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.769 [2024-10-07 11:33:28.298284] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.769 [2024-10-07 11:33:28.298300] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.769 [2024-10-07 11:33:28.298318] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.769 [2024-10-07 11:33:28.298341] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.769 [2024-10-07 11:33:28.298358] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.769 [2024-10-07 11:33:28.298372] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.769 [2024-10-07 11:33:28.298385] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.769 [2024-10-07 11:33:28.298407] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.769 [2024-10-07 11:33:28.298422] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.769 [2024-10-07 11:33:28.298435] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.769 [2024-10-07 11:33:28.298448] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.769 [2024-10-07 11:33:28.298468] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.769 [2024-10-07 11:33:28.311320] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.769 [2024-10-07 11:33:28.311370] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.769 [2024-10-07 11:33:28.311955] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.769 [2024-10-07 11:33:28.311998] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.769 [2024-10-07 11:33:28.312018] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.769 [2024-10-07 11:33:28.312068] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.769 [2024-10-07 11:33:28.312092] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.769 [2024-10-07 11:33:28.312107] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.769 [2024-10-07 11:33:28.312189] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.769 [2024-10-07 11:33:28.312216] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.769 [2024-10-07 11:33:28.312250] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.769 [2024-10-07 11:33:28.312284] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.769 [2024-10-07 11:33:28.312298] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.769 [2024-10-07 11:33:28.312316] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.769 [2024-10-07 11:33:28.312330] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.769 [2024-10-07 11:33:28.312343] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.769 [2024-10-07 11:33:28.312366] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.769 [2024-10-07 11:33:28.312381] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.769 [2024-10-07 11:33:28.323973] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.769 [2024-10-07 11:33:28.324022] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.769 [2024-10-07 11:33:28.324253] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.769 [2024-10-07 11:33:28.324292] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.769 [2024-10-07 11:33:28.324308] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.769 [2024-10-07 11:33:28.324356] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.769 [2024-10-07 11:33:28.324379] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.770 [2024-10-07 11:33:28.324394] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.770 [2024-10-07 11:33:28.324497] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.770 [2024-10-07 11:33:28.324522] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.770 [2024-10-07 11:33:28.324606] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.770 [2024-10-07 11:33:28.324631] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.770 [2024-10-07 11:33:28.324645] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.770 [2024-10-07 11:33:28.324679] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.770 [2024-10-07 11:33:28.324693] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.770 [2024-10-07 11:33:28.324707] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.770 [2024-10-07 11:33:28.324754] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.770 [2024-10-07 11:33:28.324774] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.770 [2024-10-07 11:33:28.334562] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.770 [2024-10-07 11:33:28.334731] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.770 [2024-10-07 11:33:28.334817] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.770 [2024-10-07 11:33:28.334845] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.770 [2024-10-07 11:33:28.334862] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.770 [2024-10-07 11:33:28.334959] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.770 [2024-10-07 11:33:28.334987] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.770 [2024-10-07 11:33:28.335004] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.770 [2024-10-07 11:33:28.335021] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.770 [2024-10-07 11:33:28.335045] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.770 [2024-10-07 11:33:28.335063] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.770 [2024-10-07 11:33:28.335076] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.770 [2024-10-07 11:33:28.335089] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.770 [2024-10-07 11:33:28.335113] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.770 [2024-10-07 11:33:28.335128] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.770 [2024-10-07 11:33:28.335141] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.770 [2024-10-07 11:33:28.335153] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.770 [2024-10-07 11:33:28.335174] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.770 [2024-10-07 11:33:28.345133] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.770 [2024-10-07 11:33:28.345185] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.770 [2024-10-07 11:33:28.345386] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.770 [2024-10-07 11:33:28.345418] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.770 [2024-10-07 11:33:28.345435] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.770 [2024-10-07 11:33:28.345484] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.770 [2024-10-07 11:33:28.345507] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.770 [2024-10-07 11:33:28.345524] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.770 [2024-10-07 11:33:28.345681] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.770 [2024-10-07 11:33:28.345726] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.770 [2024-10-07 11:33:28.345888] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.770 [2024-10-07 11:33:28.345912] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.770 [2024-10-07 11:33:28.345927] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.770 [2024-10-07 11:33:28.345944] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.770 [2024-10-07 11:33:28.345958] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.770 [2024-10-07 11:33:28.345971] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.770 [2024-10-07 11:33:28.346099] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.770 [2024-10-07 11:33:28.346121] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.770 [2024-10-07 11:33:28.355246] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.770 [2024-10-07 11:33:28.355309] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.770 [2024-10-07 11:33:28.355384] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.770 [2024-10-07 11:33:28.355413] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.770 [2024-10-07 11:33:28.355429] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.770 [2024-10-07 11:33:28.355482] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.770 [2024-10-07 11:33:28.355506] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.770 [2024-10-07 11:33:28.355521] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.770 [2024-10-07 11:33:28.355539] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.770 [2024-10-07 11:33:28.355562] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.770 [2024-10-07 11:33:28.355579] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.770 [2024-10-07 11:33:28.355593] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.770 [2024-10-07 11:33:28.355606] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.770 [2024-10-07 11:33:28.355629] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.770 [2024-10-07 11:33:28.355643] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.770 [2024-10-07 11:33:28.355671] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.770 [2024-10-07 11:33:28.355685] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.770 [2024-10-07 11:33:28.355706] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.770 [2024-10-07 11:33:28.368146] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.770 [2024-10-07 11:33:28.368194] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.770 [2024-10-07 11:33:28.368280] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.770 [2024-10-07 11:33:28.368309] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.770 [2024-10-07 11:33:28.368326] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.770 [2024-10-07 11:33:28.368372] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.770 [2024-10-07 11:33:28.368395] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.770 [2024-10-07 11:33:28.368410] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.770 [2024-10-07 11:33:28.368433] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.770 [2024-10-07 11:33:28.368453] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.770 [2024-10-07 11:33:28.368473] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.770 [2024-10-07 11:33:28.368487] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.770 [2024-10-07 11:33:28.368517] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.770 [2024-10-07 11:33:28.368535] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.770 [2024-10-07 11:33:28.368549] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.770 [2024-10-07 11:33:28.368562] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.770 [2024-10-07 11:33:28.368585] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.770 [2024-10-07 11:33:28.368599] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.770 [2024-10-07 11:33:28.378451] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.770 [2024-10-07 11:33:28.378498] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.770 [2024-10-07 11:33:28.378686] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.770 [2024-10-07 11:33:28.378717] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.770 [2024-10-07 11:33:28.378735] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.770 [2024-10-07 11:33:28.378783] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.770 [2024-10-07 11:33:28.378806] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.770 [2024-10-07 11:33:28.378821] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.770 [2024-10-07 11:33:28.379456] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.770 [2024-10-07 11:33:28.379498] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.770 [2024-10-07 11:33:28.382427] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.770 [2024-10-07 11:33:28.382467] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.770 [2024-10-07 11:33:28.382485] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.770 [2024-10-07 11:33:28.382502] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.770 [2024-10-07 11:33:28.382516] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.771 [2024-10-07 11:33:28.382529] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.771 [2024-10-07 11:33:28.383133] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.771 [2024-10-07 11:33:28.383169] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.771 [2024-10-07 11:33:28.388557] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.771 [2024-10-07 11:33:28.388619] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.771 [2024-10-07 11:33:28.388706] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.771 [2024-10-07 11:33:28.388742] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.771 [2024-10-07 11:33:28.388758] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.771 [2024-10-07 11:33:28.388812] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.771 [2024-10-07 11:33:28.388836] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.771 [2024-10-07 11:33:28.388866] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.771 [2024-10-07 11:33:28.388897] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.771 [2024-10-07 11:33:28.388937] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.771 [2024-10-07 11:33:28.388968] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.771 [2024-10-07 11:33:28.388993] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.771 [2024-10-07 11:33:28.389017] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.771 [2024-10-07 11:33:28.391527] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.771 [2024-10-07 11:33:28.391568] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.771 [2024-10-07 11:33:28.391586] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.771 [2024-10-07 11:33:28.391600] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.771 [2024-10-07 11:33:28.392228] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.771 [2024-10-07 11:33:28.398633] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.771 [2024-10-07 11:33:28.398767] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.771 [2024-10-07 11:33:28.398797] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.771 [2024-10-07 11:33:28.398813] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.771 [2024-10-07 11:33:28.398850] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.771 [2024-10-07 11:33:28.398880] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.771 [2024-10-07 11:33:28.398906] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.771 [2024-10-07 11:33:28.398922] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.771 [2024-10-07 11:33:28.398935] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.771 [2024-10-07 11:33:28.398956] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.771 [2024-10-07 11:33:28.399008] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.771 [2024-10-07 11:33:28.399033] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.771 [2024-10-07 11:33:28.399049] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.771 [2024-10-07 11:33:28.399071] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.771 [2024-10-07 11:33:28.399092] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.771 [2024-10-07 11:33:28.399106] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.771 [2024-10-07 11:33:28.399119] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.771 [2024-10-07 11:33:28.399141] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.771 [2024-10-07 11:33:28.408722] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.771 [2024-10-07 11:33:28.408845] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.771 [2024-10-07 11:33:28.408877] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.771 [2024-10-07 11:33:28.408893] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.771 [2024-10-07 11:33:28.408917] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.771 [2024-10-07 11:33:28.408953] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.771 [2024-10-07 11:33:28.408971] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.771 [2024-10-07 11:33:28.408985] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.771 [2024-10-07 11:33:28.409009] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.771 [2024-10-07 11:33:28.409027] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.771 [2024-10-07 11:33:28.409090] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.771 [2024-10-07 11:33:28.409117] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.771 [2024-10-07 11:33:28.409133] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.771 [2024-10-07 11:33:28.409155] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.771 [2024-10-07 11:33:28.409177] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.771 [2024-10-07 11:33:28.409191] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.771 [2024-10-07 11:33:28.409204] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.771 [2024-10-07 11:33:28.409226] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.771 [2024-10-07 11:33:28.418816] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.771 [2024-10-07 11:33:28.418924] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.771 [2024-10-07 11:33:28.418954] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.771 [2024-10-07 11:33:28.418972] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.771 [2024-10-07 11:33:28.418995] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.771 [2024-10-07 11:33:28.419021] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.771 [2024-10-07 11:33:28.419035] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.771 [2024-10-07 11:33:28.419048] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.771 [2024-10-07 11:33:28.419071] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.771 [2024-10-07 11:33:28.419105] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.771 [2024-10-07 11:33:28.419174] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.771 [2024-10-07 11:33:28.419222] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.771 [2024-10-07 11:33:28.419242] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.771 [2024-10-07 11:33:28.419279] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.771 [2024-10-07 11:33:28.419302] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.771 [2024-10-07 11:33:28.419315] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.771 [2024-10-07 11:33:28.419328] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.771 [2024-10-07 11:33:28.419350] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.771 [2024-10-07 11:33:28.429432] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.771 [2024-10-07 11:33:28.429542] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.771 [2024-10-07 11:33:28.429624] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.771 [2024-10-07 11:33:28.429668] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.771 [2024-10-07 11:33:28.429688] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.771 [2024-10-07 11:33:28.429745] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.771 [2024-10-07 11:33:28.429770] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.771 [2024-10-07 11:33:28.429786] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.771 [2024-10-07 11:33:28.429804] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.771 [2024-10-07 11:33:28.429827] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.771 [2024-10-07 11:33:28.429844] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.772 [2024-10-07 11:33:28.429857] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.772 [2024-10-07 11:33:28.429871] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.772 [2024-10-07 11:33:28.429910] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.772 [2024-10-07 11:33:28.429928] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.772 [2024-10-07 11:33:28.429941] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.772 [2024-10-07 11:33:28.429955] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.772 [2024-10-07 11:33:28.429975] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.772 [2024-10-07 11:33:28.441381] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.772 [2024-10-07 11:33:28.441431] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.772 [2024-10-07 11:33:28.441581] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.772 [2024-10-07 11:33:28.441612] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.772 [2024-10-07 11:33:28.441629] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.772 [2024-10-07 11:33:28.441700] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.772 [2024-10-07 11:33:28.441726] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.772 [2024-10-07 11:33:28.441758] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.772 [2024-10-07 11:33:28.442002] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.772 [2024-10-07 11:33:28.442033] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.772 [2024-10-07 11:33:28.442161] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.772 [2024-10-07 11:33:28.442184] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.772 [2024-10-07 11:33:28.442198] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.772 [2024-10-07 11:33:28.442216] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.772 [2024-10-07 11:33:28.442231] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.772 [2024-10-07 11:33:28.442244] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.772 [2024-10-07 11:33:28.442303] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.772 [2024-10-07 11:33:28.442325] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.772 [2024-10-07 11:33:28.454881] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.772 [2024-10-07 11:33:28.454931] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.772 [2024-10-07 11:33:28.455018] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.772 [2024-10-07 11:33:28.455047] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.772 [2024-10-07 11:33:28.455063] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.772 [2024-10-07 11:33:28.455109] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.772 [2024-10-07 11:33:28.455132] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.772 [2024-10-07 11:33:28.455148] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.772 [2024-10-07 11:33:28.455171] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.772 [2024-10-07 11:33:28.455214] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.772 [2024-10-07 11:33:28.455237] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.772 [2024-10-07 11:33:28.455252] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.772 [2024-10-07 11:33:28.455265] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.772 [2024-10-07 11:33:28.455281] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.772 [2024-10-07 11:33:28.455295] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.772 [2024-10-07 11:33:28.455308] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.772 [2024-10-07 11:33:28.455330] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.772 [2024-10-07 11:33:28.455344] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.772 [2024-10-07 11:33:28.469777] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.772 [2024-10-07 11:33:28.469857] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.772 [2024-10-07 11:33:28.470087] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.772 [2024-10-07 11:33:28.470119] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.772 [2024-10-07 11:33:28.470136] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.772 [2024-10-07 11:33:28.470184] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.772 [2024-10-07 11:33:28.470207] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.772 [2024-10-07 11:33:28.470223] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.772 [2024-10-07 11:33:28.470247] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.772 [2024-10-07 11:33:28.470268] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.772 [2024-10-07 11:33:28.470287] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.772 [2024-10-07 11:33:28.470302] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.772 [2024-10-07 11:33:28.470316] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.772 [2024-10-07 11:33:28.470333] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.772 [2024-10-07 11:33:28.470347] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.772 [2024-10-07 11:33:28.470360] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.772 [2024-10-07 11:33:28.471108] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.772 [2024-10-07 11:33:28.471146] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.772 [2024-10-07 11:33:28.482628] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.772 [2024-10-07 11:33:28.482693] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.772 [2024-10-07 11:33:28.482785] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.772 [2024-10-07 11:33:28.482815] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.772 [2024-10-07 11:33:28.482831] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.772 [2024-10-07 11:33:28.482878] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.772 [2024-10-07 11:33:28.482901] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.772 [2024-10-07 11:33:28.482917] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.772 [2024-10-07 11:33:28.482940] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.772 [2024-10-07 11:33:28.482960] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.772 [2024-10-07 11:33:28.482980] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.772 [2024-10-07 11:33:28.482994] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.772 [2024-10-07 11:33:28.483007] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.772 [2024-10-07 11:33:28.483039] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.772 [2024-10-07 11:33:28.483055] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.772 [2024-10-07 11:33:28.483068] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.772 [2024-10-07 11:33:28.483091] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.772 [2024-10-07 11:33:28.483106] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.772 [2024-10-07 11:33:28.494031] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.772 [2024-10-07 11:33:28.494081] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.772 [2024-10-07 11:33:28.495919] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.772 [2024-10-07 11:33:28.495964] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.772 [2024-10-07 11:33:28.495984] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.772 [2024-10-07 11:33:28.496034] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.772 [2024-10-07 11:33:28.496058] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.772 [2024-10-07 11:33:28.496073] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.772 [2024-10-07 11:33:28.496718] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.772 [2024-10-07 11:33:28.496760] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.772 [2024-10-07 11:33:28.497039] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.772 [2024-10-07 11:33:28.497075] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.772 [2024-10-07 11:33:28.497092] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.772 [2024-10-07 11:33:28.497110] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.772 [2024-10-07 11:33:28.497124] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.772 [2024-10-07 11:33:28.497137] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.772 [2024-10-07 11:33:28.497297] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.772 [2024-10-07 11:33:28.497322] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.773 [2024-10-07 11:33:28.506484] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.773 [2024-10-07 11:33:28.506540] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.773 [2024-10-07 11:33:28.506801] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.773 [2024-10-07 11:33:28.506838] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.773 [2024-10-07 11:33:28.506856] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.773 [2024-10-07 11:33:28.506909] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.773 [2024-10-07 11:33:28.506933] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.773 [2024-10-07 11:33:28.506948] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.773 [2024-10-07 11:33:28.507070] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.773 [2024-10-07 11:33:28.507095] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.773 [2024-10-07 11:33:28.507206] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.773 [2024-10-07 11:33:28.507227] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.773 [2024-10-07 11:33:28.507241] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.773 [2024-10-07 11:33:28.507257] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.773 [2024-10-07 11:33:28.507272] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.773 [2024-10-07 11:33:28.507285] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.773 [2024-10-07 11:33:28.507385] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.773 [2024-10-07 11:33:28.507404] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.773 [2024-10-07 11:33:28.517328] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.773 [2024-10-07 11:33:28.517378] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.773 [2024-10-07 11:33:28.517562] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.773 [2024-10-07 11:33:28.517594] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.773 [2024-10-07 11:33:28.517612] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.773 [2024-10-07 11:33:28.517676] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.773 [2024-10-07 11:33:28.517701] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.773 [2024-10-07 11:33:28.517717] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.773 [2024-10-07 11:33:28.517832] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.773 [2024-10-07 11:33:28.517858] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.773 [2024-10-07 11:33:28.517975] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.773 [2024-10-07 11:33:28.517997] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.773 [2024-10-07 11:33:28.518011] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.773 [2024-10-07 11:33:28.518027] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.773 [2024-10-07 11:33:28.518041] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.773 [2024-10-07 11:33:28.518055] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.773 [2024-10-07 11:33:28.518441] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.773 [2024-10-07 11:33:28.518465] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.773 [2024-10-07 11:33:28.527699] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.773 [2024-10-07 11:33:28.527746] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.773 [2024-10-07 11:33:28.527851] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.773 [2024-10-07 11:33:28.527881] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.773 [2024-10-07 11:33:28.527897] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.773 [2024-10-07 11:33:28.527945] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.773 [2024-10-07 11:33:28.527968] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.773 [2024-10-07 11:33:28.527983] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.773 [2024-10-07 11:33:28.528006] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.773 [2024-10-07 11:33:28.528026] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.773 [2024-10-07 11:33:28.528045] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.773 [2024-10-07 11:33:28.528059] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.773 [2024-10-07 11:33:28.528073] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.773 [2024-10-07 11:33:28.528089] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.773 [2024-10-07 11:33:28.528104] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.773 [2024-10-07 11:33:28.528117] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.773 [2024-10-07 11:33:28.529697] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.773 [2024-10-07 11:33:28.529737] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.773 [2024-10-07 11:33:28.537829] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.773 [2024-10-07 11:33:28.537890] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.773 [2024-10-07 11:33:28.537965] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.773 [2024-10-07 11:33:28.537993] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.773 [2024-10-07 11:33:28.538010] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.773 [2024-10-07 11:33:28.538064] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.773 [2024-10-07 11:33:28.538088] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.773 [2024-10-07 11:33:28.538103] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.773 [2024-10-07 11:33:28.538121] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.773 [2024-10-07 11:33:28.538594] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.773 [2024-10-07 11:33:28.538624] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.773 [2024-10-07 11:33:28.538638] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.773 [2024-10-07 11:33:28.538668] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.773 [2024-10-07 11:33:28.538876] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.773 [2024-10-07 11:33:28.538913] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.773 [2024-10-07 11:33:28.538929] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.773 [2024-10-07 11:33:28.538942] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.773 [2024-10-07 11:33:28.539084] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.773 [2024-10-07 11:33:28.547908] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.773 [2024-10-07 11:33:28.548019] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.773 [2024-10-07 11:33:28.548050] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.773 [2024-10-07 11:33:28.548066] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.773 [2024-10-07 11:33:28.548101] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.773 [2024-10-07 11:33:28.548145] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.773 [2024-10-07 11:33:28.548176] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.773 [2024-10-07 11:33:28.548193] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.773 [2024-10-07 11:33:28.548206] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.773 [2024-10-07 11:33:28.548228] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.773 [2024-10-07 11:33:28.548280] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.773 [2024-10-07 11:33:28.548304] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.773 [2024-10-07 11:33:28.548320] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.773 [2024-10-07 11:33:28.548342] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.773 [2024-10-07 11:33:28.548364] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.773 [2024-10-07 11:33:28.548378] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.773 [2024-10-07 11:33:28.548391] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.773 [2024-10-07 11:33:28.548412] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.773 [2024-10-07 11:33:28.560933] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.773 [2024-10-07 11:33:28.560983] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.773 [2024-10-07 11:33:28.561180] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.773 [2024-10-07 11:33:28.561211] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.773 [2024-10-07 11:33:28.561228] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.773 [2024-10-07 11:33:28.561277] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.773 [2024-10-07 11:33:28.561300] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.773 [2024-10-07 11:33:28.561315] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.774 [2024-10-07 11:33:28.561887] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.774 [2024-10-07 11:33:28.561944] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.774 [2024-10-07 11:33:28.563096] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.774 [2024-10-07 11:33:28.563130] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.774 [2024-10-07 11:33:28.563146] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.774 [2024-10-07 11:33:28.563163] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.774 [2024-10-07 11:33:28.563177] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.774 [2024-10-07 11:33:28.563207] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.774 [2024-10-07 11:33:28.563764] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.774 [2024-10-07 11:33:28.563795] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.774 [2024-10-07 11:33:28.574429] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.774 [2024-10-07 11:33:28.574479] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.774 [2024-10-07 11:33:28.574901] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.774 [2024-10-07 11:33:28.574945] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.774 [2024-10-07 11:33:28.574966] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.774 [2024-10-07 11:33:28.575017] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.774 [2024-10-07 11:33:28.575040] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.774 [2024-10-07 11:33:28.575055] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.774 [2024-10-07 11:33:28.575219] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.774 [2024-10-07 11:33:28.575249] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.774 [2024-10-07 11:33:28.575346] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.774 [2024-10-07 11:33:28.575365] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.774 [2024-10-07 11:33:28.575380] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.774 [2024-10-07 11:33:28.575396] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.774 [2024-10-07 11:33:28.575411] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.774 [2024-10-07 11:33:28.575424] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.774 [2024-10-07 11:33:28.575476] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.774 [2024-10-07 11:33:28.575494] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.774 [2024-10-07 11:33:28.588596] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.774 [2024-10-07 11:33:28.588659] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.774 [2024-10-07 11:33:28.589409] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.774 [2024-10-07 11:33:28.589471] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.774 [2024-10-07 11:33:28.589494] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.774 [2024-10-07 11:33:28.589547] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.774 [2024-10-07 11:33:28.589570] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.774 [2024-10-07 11:33:28.589585] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.774 [2024-10-07 11:33:28.589694] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.774 [2024-10-07 11:33:28.589722] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.774 [2024-10-07 11:33:28.589743] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.774 [2024-10-07 11:33:28.589758] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.774 [2024-10-07 11:33:28.589771] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.774 [2024-10-07 11:33:28.589788] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.774 [2024-10-07 11:33:28.589802] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.774 [2024-10-07 11:33:28.589814] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.774 [2024-10-07 11:33:28.589837] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.774 [2024-10-07 11:33:28.589851] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.774 [2024-10-07 11:33:28.599067] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.774 [2024-10-07 11:33:28.599117] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.774 [2024-10-07 11:33:28.599306] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.774 [2024-10-07 11:33:28.599338] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.774 [2024-10-07 11:33:28.599355] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.774 [2024-10-07 11:33:28.599404] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.774 [2024-10-07 11:33:28.599427] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.774 [2024-10-07 11:33:28.599442] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.774 [2024-10-07 11:33:28.599545] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.774 [2024-10-07 11:33:28.599570] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.774 [2024-10-07 11:33:28.600422] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.774 [2024-10-07 11:33:28.600458] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.774 [2024-10-07 11:33:28.600476] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.774 [2024-10-07 11:33:28.600493] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.774 [2024-10-07 11:33:28.600508] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.774 [2024-10-07 11:33:28.600537] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.774 [2024-10-07 11:33:28.602406] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.774 [2024-10-07 11:33:28.602444] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.774 [2024-10-07 11:33:28.609180] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.774 [2024-10-07 11:33:28.609241] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.774 [2024-10-07 11:33:28.609316] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.774 [2024-10-07 11:33:28.609345] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.774 [2024-10-07 11:33:28.609361] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.774 [2024-10-07 11:33:28.609416] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.774 [2024-10-07 11:33:28.609439] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.774 [2024-10-07 11:33:28.609455] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.774 [2024-10-07 11:33:28.609472] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.774 [2024-10-07 11:33:28.609496] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.774 [2024-10-07 11:33:28.609512] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.774 [2024-10-07 11:33:28.609526] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.774 [2024-10-07 11:33:28.609539] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.774 [2024-10-07 11:33:28.609562] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.774 [2024-10-07 11:33:28.609576] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.774 [2024-10-07 11:33:28.609589] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.774 [2024-10-07 11:33:28.609602] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.774 [2024-10-07 11:33:28.609622] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.774 [2024-10-07 11:33:28.619256] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.774 [2024-10-07 11:33:28.619365] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.774 [2024-10-07 11:33:28.619396] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.774 [2024-10-07 11:33:28.619412] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.774 [2024-10-07 11:33:28.619450] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.774 [2024-10-07 11:33:28.619479] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.774 [2024-10-07 11:33:28.619505] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.774 [2024-10-07 11:33:28.619521] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.774 [2024-10-07 11:33:28.619534] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.774 [2024-10-07 11:33:28.619555] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.774 [2024-10-07 11:33:28.619623] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.774 [2024-10-07 11:33:28.619663] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.774 [2024-10-07 11:33:28.619682] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.774 [2024-10-07 11:33:28.619705] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.774 [2024-10-07 11:33:28.619727] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.774 [2024-10-07 11:33:28.619741] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.775 [2024-10-07 11:33:28.619754] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.775 [2024-10-07 11:33:28.619777] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.775 [2024-10-07 11:33:28.629337] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.775 [2024-10-07 11:33:28.631237] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.775 [2024-10-07 11:33:28.631283] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.775 [2024-10-07 11:33:28.631304] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.775 [2024-10-07 11:33:28.631677] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.775 [2024-10-07 11:33:28.631765] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.775 [2024-10-07 11:33:28.631801] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.775 [2024-10-07 11:33:28.631817] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.775 [2024-10-07 11:33:28.631831] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.775 [2024-10-07 11:33:28.631854] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.775 [2024-10-07 11:33:28.631911] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.775 [2024-10-07 11:33:28.631937] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.775 [2024-10-07 11:33:28.631953] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.775 [2024-10-07 11:33:28.632661] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.775 [2024-10-07 11:33:28.632880] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.775 [2024-10-07 11:33:28.632907] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.775 [2024-10-07 11:33:28.632922] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.775 [2024-10-07 11:33:28.633055] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.775 [2024-10-07 11:33:28.640426] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.775 [2024-10-07 11:33:28.640545] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.775 [2024-10-07 11:33:28.640576] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.775 [2024-10-07 11:33:28.640593] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.775 [2024-10-07 11:33:28.640639] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.775 [2024-10-07 11:33:28.640681] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.775 [2024-10-07 11:33:28.640696] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.775 [2024-10-07 11:33:28.640710] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.775 [2024-10-07 11:33:28.641377] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.775 [2024-10-07 11:33:28.644138] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.775 [2024-10-07 11:33:28.644299] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.775 [2024-10-07 11:33:28.644330] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.775 [2024-10-07 11:33:28.644346] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.775 [2024-10-07 11:33:28.644370] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.775 [2024-10-07 11:33:28.644392] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.775 [2024-10-07 11:33:28.644407] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.775 [2024-10-07 11:33:28.644420] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.775 [2024-10-07 11:33:28.644443] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.775 [2024-10-07 11:33:28.650694] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.775 [2024-10-07 11:33:28.650799] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.775 [2024-10-07 11:33:28.650828] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.775 [2024-10-07 11:33:28.650845] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.775 [2024-10-07 11:33:28.650868] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.775 [2024-10-07 11:33:28.650890] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.775 [2024-10-07 11:33:28.650904] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.775 [2024-10-07 11:33:28.650917] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.775 [2024-10-07 11:33:28.650941] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.775 [2024-10-07 11:33:28.654215] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.775 [2024-10-07 11:33:28.654315] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.775 [2024-10-07 11:33:28.654345] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.775 [2024-10-07 11:33:28.654361] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.775 [2024-10-07 11:33:28.654384] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.775 [2024-10-07 11:33:28.654406] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.775 [2024-10-07 11:33:28.654421] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.775 [2024-10-07 11:33:28.654449] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.775 [2024-10-07 11:33:28.654474] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.775 [2024-10-07 11:33:28.661364] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.775 [2024-10-07 11:33:28.661574] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.775 [2024-10-07 11:33:28.661606] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.775 [2024-10-07 11:33:28.661624] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.775 [2024-10-07 11:33:28.661781] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.775 [2024-10-07 11:33:28.661914] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.775 [2024-10-07 11:33:28.661947] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.775 [2024-10-07 11:33:28.661964] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.775 [2024-10-07 11:33:28.662460] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.775 [2024-10-07 11:33:28.665393] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.775 [2024-10-07 11:33:28.665610] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.775 [2024-10-07 11:33:28.665642] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.775 [2024-10-07 11:33:28.665676] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.775 [2024-10-07 11:33:28.665804] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.775 [2024-10-07 11:33:28.665921] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.775 [2024-10-07 11:33:28.665948] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.775 [2024-10-07 11:33:28.665964] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.775 [2024-10-07 11:33:28.666074] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.775 [2024-10-07 11:33:28.671478] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.775 [2024-10-07 11:33:28.671581] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.775 [2024-10-07 11:33:28.671612] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.775 [2024-10-07 11:33:28.671628] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.775 [2024-10-07 11:33:28.671667] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.775 [2024-10-07 11:33:28.671693] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.775 [2024-10-07 11:33:28.671707] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.775 [2024-10-07 11:33:28.671721] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.775 [2024-10-07 11:33:28.671743] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.775 [2024-10-07 11:33:28.676509] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.775 [2024-10-07 11:33:28.676613] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.776 [2024-10-07 11:33:28.676675] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.776 [2024-10-07 11:33:28.676696] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.776 [2024-10-07 11:33:28.676721] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.776 [2024-10-07 11:33:28.676744] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.776 [2024-10-07 11:33:28.676758] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.776 [2024-10-07 11:33:28.676771] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.776 [2024-10-07 11:33:28.676794] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.776 [2024-10-07 11:33:28.685552] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.776 [2024-10-07 11:33:28.685670] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.776 [2024-10-07 11:33:28.685701] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.776 [2024-10-07 11:33:28.685718] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.776 [2024-10-07 11:33:28.685741] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.776 [2024-10-07 11:33:28.685764] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.776 [2024-10-07 11:33:28.685778] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.776 [2024-10-07 11:33:28.685792] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.776 [2024-10-07 11:33:28.685816] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.776 [2024-10-07 11:33:28.687758] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.776 [2024-10-07 11:33:28.687863] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.776 [2024-10-07 11:33:28.687893] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.776 [2024-10-07 11:33:28.687910] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.776 [2024-10-07 11:33:28.687933] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.776 [2024-10-07 11:33:28.687955] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.776 [2024-10-07 11:33:28.687969] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.776 [2024-10-07 11:33:28.687983] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.776 [2024-10-07 11:33:28.688005] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.776 [2024-10-07 11:33:28.697432] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.776 [2024-10-07 11:33:28.697540] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.776 [2024-10-07 11:33:28.697571] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.776 [2024-10-07 11:33:28.697588] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.776 [2024-10-07 11:33:28.697611] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.776 [2024-10-07 11:33:28.697663] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.776 [2024-10-07 11:33:28.697682] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.776 [2024-10-07 11:33:28.697695] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.776 [2024-10-07 11:33:28.697719] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.776 [2024-10-07 11:33:28.698182] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.776 [2024-10-07 11:33:28.698285] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.776 [2024-10-07 11:33:28.698314] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.776 [2024-10-07 11:33:28.698330] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.776 [2024-10-07 11:33:28.698354] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.776 [2024-10-07 11:33:28.698376] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.776 [2024-10-07 11:33:28.698390] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.776 [2024-10-07 11:33:28.698403] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.776 [2024-10-07 11:33:28.698425] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.776 [2024-10-07 11:33:28.708463] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.776 [2024-10-07 11:33:28.708607] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.776 [2024-10-07 11:33:28.708700] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.776 [2024-10-07 11:33:28.708729] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.776 [2024-10-07 11:33:28.708746] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.776 [2024-10-07 11:33:28.708895] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.776 [2024-10-07 11:33:28.708923] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.776 [2024-10-07 11:33:28.708940] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.776 [2024-10-07 11:33:28.708958] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.776 [2024-10-07 11:33:28.709535] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.776 [2024-10-07 11:33:28.709574] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.776 [2024-10-07 11:33:28.709592] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.776 [2024-10-07 11:33:28.709606] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.776 [2024-10-07 11:33:28.711532] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.776 [2024-10-07 11:33:28.711570] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.776 [2024-10-07 11:33:28.711587] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.776 [2024-10-07 11:33:28.711602] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.776 [2024-10-07 11:33:28.712248] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.776 [2024-10-07 11:33:28.719739] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.776 [2024-10-07 11:33:28.719787] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.776 [2024-10-07 11:33:28.719981] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.776 [2024-10-07 11:33:28.720012] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.776 [2024-10-07 11:33:28.720028] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.776 [2024-10-07 11:33:28.720078] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.776 [2024-10-07 11:33:28.720102] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.776 [2024-10-07 11:33:28.720116] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.776 [2024-10-07 11:33:28.720229] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.776 [2024-10-07 11:33:28.720255] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.776 [2024-10-07 11:33:28.720361] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.776 [2024-10-07 11:33:28.720382] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.776 [2024-10-07 11:33:28.720396] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.776 [2024-10-07 11:33:28.720413] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.776 [2024-10-07 11:33:28.720427] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.776 [2024-10-07 11:33:28.720440] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.776 [2024-10-07 11:33:28.720539] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.776 [2024-10-07 11:33:28.720557] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.776 [2024-10-07 11:33:28.729960] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.776 [2024-10-07 11:33:28.730008] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.776 [2024-10-07 11:33:28.730092] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.776 [2024-10-07 11:33:28.730121] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.776 [2024-10-07 11:33:28.730137] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.776 [2024-10-07 11:33:28.730183] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.776 [2024-10-07 11:33:28.730206] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.776 [2024-10-07 11:33:28.730221] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.776 [2024-10-07 11:33:28.730243] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.776 [2024-10-07 11:33:28.730263] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.776 [2024-10-07 11:33:28.730282] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.776 [2024-10-07 11:33:28.730313] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.776 [2024-10-07 11:33:28.730328] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.776 [2024-10-07 11:33:28.730344] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.776 [2024-10-07 11:33:28.730358] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.776 [2024-10-07 11:33:28.730370] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.777 [2024-10-07 11:33:28.730393] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.777 [2024-10-07 11:33:28.730407] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.777 [2024-10-07 11:33:28.742735] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.777 [2024-10-07 11:33:28.742779] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.777 [2024-10-07 11:33:28.742958] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.777 [2024-10-07 11:33:28.742989] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.777 [2024-10-07 11:33:28.743006] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.777 [2024-10-07 11:33:28.743053] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.777 [2024-10-07 11:33:28.743077] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.777 [2024-10-07 11:33:28.743092] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.777 [2024-10-07 11:33:28.743335] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.777 [2024-10-07 11:33:28.743456] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.777 [2024-10-07 11:33:28.745298] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.777 [2024-10-07 11:33:28.745420] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.777 [2024-10-07 11:33:28.745500] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.777 [2024-10-07 11:33:28.745571] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.777 [2024-10-07 11:33:28.745637] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.777 [2024-10-07 11:33:28.745726] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.777 [2024-10-07 11:33:28.746453] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.777 [2024-10-07 11:33:28.746563] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.777 [2024-10-07 11:33:28.754186] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.777 [2024-10-07 11:33:28.754304] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.777 [2024-10-07 11:33:28.754566] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.777 [2024-10-07 11:33:28.754678] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.777 [2024-10-07 11:33:28.754764] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.777 [2024-10-07 11:33:28.754837] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.777 [2024-10-07 11:33:28.754878] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.777 [2024-10-07 11:33:28.754896] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.777 [2024-10-07 11:33:28.755021] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.777 [2024-10-07 11:33:28.755049] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.777 [2024-10-07 11:33:28.755216] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.777 [2024-10-07 11:33:28.755238] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.777 [2024-10-07 11:33:28.755252] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.777 [2024-10-07 11:33:28.755269] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.777 [2024-10-07 11:33:28.755284] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.777 [2024-10-07 11:33:28.755297] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.777 [2024-10-07 11:33:28.755400] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.777 [2024-10-07 11:33:28.755418] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.777 [2024-10-07 11:33:28.765770] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.777 [2024-10-07 11:33:28.765884] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.777 [2024-10-07 11:33:28.766054] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.777 [2024-10-07 11:33:28.766148] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.777 [2024-10-07 11:33:28.766219] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.777 [2024-10-07 11:33:28.766343] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.777 [2024-10-07 11:33:28.766425] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.777 [2024-10-07 11:33:28.766492] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.777 [2024-10-07 11:33:28.766568] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.777 [2024-10-07 11:33:28.766661] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.777 [2024-10-07 11:33:28.766765] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.777 [2024-10-07 11:33:28.766838] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.777 [2024-10-07 11:33:28.766903] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.777 [2024-10-07 11:33:28.766971] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.777 [2024-10-07 11:33:28.767035] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.777 [2024-10-07 11:33:28.767096] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.777 [2024-10-07 11:33:28.767201] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.777 [2024-10-07 11:33:28.767281] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.777 [2024-10-07 11:33:28.780582] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.777 [2024-10-07 11:33:28.780720] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.777 [2024-10-07 11:33:28.780876] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.777 [2024-10-07 11:33:28.780967] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.777 [2024-10-07 11:33:28.781037] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.777 [2024-10-07 11:33:28.781144] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.777 [2024-10-07 11:33:28.781244] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.777 [2024-10-07 11:33:28.781314] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.777 [2024-10-07 11:33:28.781390] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.777 [2024-10-07 11:33:28.781464] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.777 [2024-10-07 11:33:28.781542] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.777 [2024-10-07 11:33:28.781619] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.777 [2024-10-07 11:33:28.781701] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.777 [2024-10-07 11:33:28.781772] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.777 [2024-10-07 11:33:28.781858] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.777 [2024-10-07 11:33:28.781935] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.777 [2024-10-07 11:33:28.782014] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.777 [2024-10-07 11:33:28.782081] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.777 [2024-10-07 11:33:28.793486] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.777 [2024-10-07 11:33:28.793599] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.777 [2024-10-07 11:33:28.793777] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.777 [2024-10-07 11:33:28.793870] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.777 [2024-10-07 11:33:28.793941] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.777 [2024-10-07 11:33:28.794049] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.777 [2024-10-07 11:33:28.794129] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.777 [2024-10-07 11:33:28.794214] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.777 [2024-10-07 11:33:28.794295] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.777 [2024-10-07 11:33:28.794370] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.777 [2024-10-07 11:33:28.794462] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.777 [2024-10-07 11:33:28.794536] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.777 [2024-10-07 11:33:28.794629] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.777 [2024-10-07 11:33:28.794723] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.777 [2024-10-07 11:33:28.794792] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.777 [2024-10-07 11:33:28.794855] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.777 [2024-10-07 11:33:28.797309] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.777 [2024-10-07 11:33:28.797409] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.777 [2024-10-07 11:33:28.805351] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.777 [2024-10-07 11:33:28.805463] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.777 [2024-10-07 11:33:28.806296] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.777 [2024-10-07 11:33:28.806419] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.777 [2024-10-07 11:33:28.806495] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.777 [2024-10-07 11:33:28.806604] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.778 [2024-10-07 11:33:28.806713] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.778 [2024-10-07 11:33:28.806785] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.778 [2024-10-07 11:33:28.807026] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.778 [2024-10-07 11:33:28.807115] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.778 [2024-10-07 11:33:28.807942] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.778 [2024-10-07 11:33:28.808038] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.778 [2024-10-07 11:33:28.808105] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.778 [2024-10-07 11:33:28.808173] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.778 [2024-10-07 11:33:28.808237] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.778 [2024-10-07 11:33:28.808314] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.778 [2024-10-07 11:33:28.810220] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.778 [2024-10-07 11:33:28.810316] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.778 [2024-10-07 11:33:28.815760] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.778 [2024-10-07 11:33:28.815870] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.778 [2024-10-07 11:33:28.816024] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.778 [2024-10-07 11:33:28.816115] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.778 [2024-10-07 11:33:28.816186] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.778 [2024-10-07 11:33:28.816296] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.778 [2024-10-07 11:33:28.816377] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.778 [2024-10-07 11:33:28.816465] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.778 [2024-10-07 11:33:28.818998] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.778 [2024-10-07 11:33:28.819110] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.778 [2024-10-07 11:33:28.820027] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.778 [2024-10-07 11:33:28.820141] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.778 [2024-10-07 11:33:28.820212] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.778 [2024-10-07 11:33:28.820286] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.778 [2024-10-07 11:33:28.820350] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.778 [2024-10-07 11:33:28.820411] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.778 [2024-10-07 11:33:28.820701] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.778 [2024-10-07 11:33:28.820791] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.778 [2024-10-07 11:33:28.825991] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.778 [2024-10-07 11:33:28.826121] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.778 [2024-10-07 11:33:28.826262] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.778 [2024-10-07 11:33:28.826363] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.778 [2024-10-07 11:33:28.826476] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.778 [2024-10-07 11:33:28.829193] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.778 [2024-10-07 11:33:28.829315] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.778 [2024-10-07 11:33:28.829391] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.778 [2024-10-07 11:33:28.829462] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.778 [2024-10-07 11:33:28.830511] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.778 [2024-10-07 11:33:28.830615] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.778 [2024-10-07 11:33:28.830731] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.778 [2024-10-07 11:33:28.830804] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.778 [2024-10-07 11:33:28.831055] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.778 [2024-10-07 11:33:28.831137] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.778 [2024-10-07 11:33:28.831218] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.778 [2024-10-07 11:33:28.831285] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.778 [2024-10-07 11:33:28.831452] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.778 [2024-10-07 11:33:28.836148] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.778 [2024-10-07 11:33:28.836337] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.778 [2024-10-07 11:33:28.836449] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.778 [2024-10-07 11:33:28.836523] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.778 [2024-10-07 11:33:28.839402] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.778 [2024-10-07 11:33:28.840164] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.778 [2024-10-07 11:33:28.840278] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.778 [2024-10-07 11:33:28.840350] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.778 [2024-10-07 11:33:28.840433] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.778 [2024-10-07 11:33:28.840763] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.778 [2024-10-07 11:33:28.840904] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.778 [2024-10-07 11:33:28.840989] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.778 [2024-10-07 11:33:28.841056] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.778 [2024-10-07 11:33:28.841239] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.778 [2024-10-07 11:33:28.841409] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.778 [2024-10-07 11:33:28.841499] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.778 [2024-10-07 11:33:28.841567] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.778 [2024-10-07 11:33:28.842266] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.778 [2024-10-07 11:33:28.846426] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.778 [2024-10-07 11:33:28.846596] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.778 [2024-10-07 11:33:28.846717] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.778 [2024-10-07 11:33:28.846793] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.778 [2024-10-07 11:33:28.849482] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.778 [2024-10-07 11:33:28.850360] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.778 [2024-10-07 11:33:28.850458] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.778 [2024-10-07 11:33:28.850552] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.778 [2024-10-07 11:33:28.851322] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.778 [2024-10-07 11:33:28.853134] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.778 [2024-10-07 11:33:28.853904] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.778 [2024-10-07 11:33:28.854024] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.778 [2024-10-07 11:33:28.854098] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.778 [2024-10-07 11:33:28.854301] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.778 [2024-10-07 11:33:28.854399] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.778 [2024-10-07 11:33:28.854467] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.778 [2024-10-07 11:33:28.854529] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.778 [2024-10-07 11:33:28.854614] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.778 [2024-10-07 11:33:28.856563] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.778 [2024-10-07 11:33:28.856776] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.778 [2024-10-07 11:33:28.856874] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.778 [2024-10-07 11:33:28.856978] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.778 [2024-10-07 11:33:28.857058] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.778 [2024-10-07 11:33:28.857134] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.778 [2024-10-07 11:33:28.857211] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.778 [2024-10-07 11:33:28.857285] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.778 [2024-10-07 11:33:28.857361] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.778 [2024-10-07 11:33:28.865187] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.778 [2024-10-07 11:33:28.865445] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.778 [2024-10-07 11:33:28.865542] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.778 [2024-10-07 11:33:28.865614] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.778 [2024-10-07 11:33:28.865803] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.779 [2024-10-07 11:33:28.866186] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.779 [2024-10-07 11:33:28.866271] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.779 [2024-10-07 11:33:28.866369] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.779 [2024-10-07 11:33:28.868357] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.779 [2024-10-07 11:33:28.868536] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.779 [2024-10-07 11:33:28.868706] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.779 [2024-10-07 11:33:28.868820] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.779 [2024-10-07 11:33:28.868892] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.779 [2024-10-07 11:33:28.868969] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.779 [2024-10-07 11:33:28.869046] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.779 [2024-10-07 11:33:28.869111] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.779 [2024-10-07 11:33:28.869154] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.779 [2024-10-07 11:33:28.870025] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.779 [2024-10-07 11:33:28.875332] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.779 [2024-10-07 11:33:28.875518] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.779 [2024-10-07 11:33:28.875612] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.779 [2024-10-07 11:33:28.875715] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.779 [2024-10-07 11:33:28.875802] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.779 [2024-10-07 11:33:28.875899] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.779 [2024-10-07 11:33:28.875989] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.779 [2024-10-07 11:33:28.876055] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.779 [2024-10-07 11:33:28.878564] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.779 [2024-10-07 11:33:28.879692] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.779 [2024-10-07 11:33:28.879953] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.779 [2024-10-07 11:33:28.880049] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.779 [2024-10-07 11:33:28.880121] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.779 [2024-10-07 11:33:28.880998] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.779 [2024-10-07 11:33:28.882868] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.779 [2024-10-07 11:33:28.882964] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.779 [2024-10-07 11:33:28.883032] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.779 [2024-10-07 11:33:28.883357] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.779 [2024-10-07 11:33:28.885488] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.779 [2024-10-07 11:33:28.885669] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.779 [2024-10-07 11:33:28.885784] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.779 [2024-10-07 11:33:28.885858] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.779 [2024-10-07 11:33:28.885936] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.779 [2024-10-07 11:33:28.886014] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.779 [2024-10-07 11:33:28.886080] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.779 [2024-10-07 11:33:28.886142] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.779 [2024-10-07 11:33:28.886217] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.779 [2024-10-07 11:33:28.890961] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.779 [2024-10-07 11:33:28.891238] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.779 [2024-10-07 11:33:28.891354] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.779 [2024-10-07 11:33:28.891427] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.779 [2024-10-07 11:33:28.891587] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.779 [2024-10-07 11:33:28.892289] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.779 [2024-10-07 11:33:28.892400] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.779 [2024-10-07 11:33:28.892470] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.779 [2024-10-07 11:33:28.894611] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.779 [2024-10-07 11:33:28.895989] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.779 [2024-10-07 11:33:28.896185] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.779 [2024-10-07 11:33:28.896280] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.779 [2024-10-07 11:33:28.896352] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.779 [2024-10-07 11:33:28.896429] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.779 [2024-10-07 11:33:28.899020] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.779 [2024-10-07 11:33:28.899135] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.779 [2024-10-07 11:33:28.899222] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.779 [2024-10-07 11:33:28.900080] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.779 [2024-10-07 11:33:28.901109] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.779 [2024-10-07 11:33:28.902783] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.779 [2024-10-07 11:33:28.902918] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.779 [2024-10-07 11:33:28.902996] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.779 [2024-10-07 11:33:28.903717] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.779 8925.75 IOPS, 34.87 MiB/s [2024-10-07T11:33:33.302Z] [2024-10-07 11:33:28.905823] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.779 [2024-10-07 11:33:28.905914] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.779 [2024-10-07 11:33:28.905984] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.779 [2024-10-07 11:33:28.906235] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.779 [2024-10-07 11:33:28.906549] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.779 [2024-10-07 11:33:28.906802] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.779 [2024-10-07 11:33:28.906896] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.779 [2024-10-07 11:33:28.906966] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.779 [2024-10-07 11:33:28.907127] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.779 [2024-10-07 11:33:28.907424] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.779 [2024-10-07 11:33:28.907526] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.779 [2024-10-07 11:33:28.907595] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.779 [2024-10-07 11:33:28.907735] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.779 [2024-10-07 11:33:28.915724] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.779 [2024-10-07 11:33:28.915924] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.779 [2024-10-07 11:33:28.916035] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.779 [2024-10-07 11:33:28.916121] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.779 [2024-10-07 11:33:28.916222] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.779 [2024-10-07 11:33:28.916305] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.779 [2024-10-07 11:33:28.916371] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.779 [2024-10-07 11:33:28.916448] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.779 [2024-10-07 11:33:28.916540] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.779 [2024-10-07 11:33:28.916687] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.780 [2024-10-07 11:33:28.916860] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.780 [2024-10-07 11:33:28.916960] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.780 [2024-10-07 11:33:28.917046] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.780 [2024-10-07 11:33:28.917120] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.780 [2024-10-07 11:33:28.917197] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.780 [2024-10-07 11:33:28.917263] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.780 [2024-10-07 11:33:28.917325] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.780 [2024-10-07 11:33:28.917414] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.780 [2024-10-07 11:33:28.929814] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.780 [2024-10-07 11:33:28.929926] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.780 [2024-10-07 11:33:28.930072] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.780 [2024-10-07 11:33:28.930163] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.780 [2024-10-07 11:33:28.930252] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.780 [2024-10-07 11:33:28.930365] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.780 [2024-10-07 11:33:28.930460] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.780 [2024-10-07 11:33:28.930528] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.780 [2024-10-07 11:33:28.930622] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.780 [2024-10-07 11:33:28.930747] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.780 [2024-10-07 11:33:28.930828] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.780 [2024-10-07 11:33:28.930894] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.780 [2024-10-07 11:33:28.930958] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.780 [2024-10-07 11:33:28.931037] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.780 [2024-10-07 11:33:28.931113] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.780 [2024-10-07 11:33:28.931178] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.780 [2024-10-07 11:33:28.931280] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.780 [2024-10-07 11:33:28.931349] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.780 [2024-10-07 11:33:28.942735] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.780 [2024-10-07 11:33:28.942848] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.780 [2024-10-07 11:33:28.944828] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.780 [2024-10-07 11:33:28.944938] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.780 [2024-10-07 11:33:28.945013] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.780 [2024-10-07 11:33:28.945123] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.780 [2024-10-07 11:33:28.945205] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.780 [2024-10-07 11:33:28.945275] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.780 [2024-10-07 11:33:28.945504] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.780 [2024-10-07 11:33:28.945599] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.780 [2024-10-07 11:33:28.945812] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.780 [2024-10-07 11:33:28.945894] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.780 [2024-10-07 11:33:28.945959] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.780 [2024-10-07 11:33:28.946026] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.780 [2024-10-07 11:33:28.946091] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.780 [2024-10-07 11:33:28.946170] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.780 [2024-10-07 11:33:28.946439] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.780 [2024-10-07 11:33:28.946522] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.780 [2024-10-07 11:33:28.956424] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.780 [2024-10-07 11:33:28.956532] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.780 [2024-10-07 11:33:28.956737] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.780 [2024-10-07 11:33:28.956770] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.780 [2024-10-07 11:33:28.956788] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.780 [2024-10-07 11:33:28.956838] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.780 [2024-10-07 11:33:28.956862] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.780 [2024-10-07 11:33:28.956877] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.780 [2024-10-07 11:33:28.956903] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.780 [2024-10-07 11:33:28.956924] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.780 [2024-10-07 11:33:28.956945] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.780 [2024-10-07 11:33:28.956960] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.780 [2024-10-07 11:33:28.956973] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.780 [2024-10-07 11:33:28.956990] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.780 [2024-10-07 11:33:28.957004] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.780 [2024-10-07 11:33:28.957017] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.780 [2024-10-07 11:33:28.957040] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.780 [2024-10-07 11:33:28.957053] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.780 [2024-10-07 11:33:28.967030] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.780 [2024-10-07 11:33:28.967143] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.780 [2024-10-07 11:33:28.967413] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.780 [2024-10-07 11:33:28.967508] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.780 [2024-10-07 11:33:28.967599] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.780 [2024-10-07 11:33:28.967745] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.780 [2024-10-07 11:33:28.967846] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.780 [2024-10-07 11:33:28.967924] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.780 [2024-10-07 11:33:28.968353] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.780 [2024-10-07 11:33:28.968445] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.780 [2024-10-07 11:33:28.971640] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.780 [2024-10-07 11:33:28.971832] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.780 [2024-10-07 11:33:28.971907] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.780 [2024-10-07 11:33:28.971977] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.780 [2024-10-07 11:33:28.972058] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.780 [2024-10-07 11:33:28.972121] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.780 [2024-10-07 11:33:28.972699] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.780 [2024-10-07 11:33:28.972824] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.780 [2024-10-07 11:33:28.980284] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.780 [2024-10-07 11:33:28.980417] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.780 [2024-10-07 11:33:28.980997] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.780 [2024-10-07 11:33:28.981114] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.780 [2024-10-07 11:33:28.981185] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.780 [2024-10-07 11:33:28.981293] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.780 [2024-10-07 11:33:28.981373] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.780 [2024-10-07 11:33:28.981438] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.780 [2024-10-07 11:33:28.981681] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.780 [2024-10-07 11:33:28.981790] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.780 [2024-10-07 11:33:28.981993] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.780 [2024-10-07 11:33:28.982093] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.780 [2024-10-07 11:33:28.982161] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.780 [2024-10-07 11:33:28.982229] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.780 [2024-10-07 11:33:28.982293] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.780 [2024-10-07 11:33:28.982367] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.780 [2024-10-07 11:33:28.982547] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.781 [2024-10-07 11:33:28.982626] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.781 [2024-10-07 11:33:28.990539] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.781 [2024-10-07 11:33:28.990680] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.781 [2024-10-07 11:33:28.990828] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.781 [2024-10-07 11:33:28.990917] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.781 [2024-10-07 11:33:28.990989] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.781 [2024-10-07 11:33:28.993181] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.781 [2024-10-07 11:33:28.993307] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.781 [2024-10-07 11:33:28.993384] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.781 [2024-10-07 11:33:28.993455] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.781 [2024-10-07 11:33:28.994376] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.781 [2024-10-07 11:33:28.994498] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.781 [2024-10-07 11:33:28.994571] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.781 [2024-10-07 11:33:28.994637] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.781 [2024-10-07 11:33:28.994881] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.781 [2024-10-07 11:33:28.994964] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.781 [2024-10-07 11:33:28.995051] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.781 [2024-10-07 11:33:28.995161] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.781 [2024-10-07 11:33:28.995352] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.781 [2024-10-07 11:33:29.001103] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.781 [2024-10-07 11:33:29.001217] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.781 [2024-10-07 11:33:29.002036] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.781 [2024-10-07 11:33:29.002159] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.781 [2024-10-07 11:33:29.002254] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.781 [2024-10-07 11:33:29.002380] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.781 [2024-10-07 11:33:29.002465] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.781 [2024-10-07 11:33:29.002533] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.781 [2024-10-07 11:33:29.004253] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.781 [2024-10-07 11:33:29.004361] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.781 [2024-10-07 11:33:29.004719] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.781 [2024-10-07 11:33:29.004817] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.781 [2024-10-07 11:33:29.004906] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.781 [2024-10-07 11:33:29.004990] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.781 [2024-10-07 11:33:29.005068] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.781 [2024-10-07 11:33:29.005133] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.781 [2024-10-07 11:33:29.005798] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.781 [2024-10-07 11:33:29.005832] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.781 [2024-10-07 11:33:29.012298] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.781 [2024-10-07 11:33:29.012348] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.781 [2024-10-07 11:33:29.014832] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.781 [2024-10-07 11:33:29.014878] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.781 [2024-10-07 11:33:29.014915] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.781 [2024-10-07 11:33:29.014970] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.781 [2024-10-07 11:33:29.014994] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.781 [2024-10-07 11:33:29.015009] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.781 [2024-10-07 11:33:29.015382] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.781 [2024-10-07 11:33:29.015426] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.781 [2024-10-07 11:33:29.015583] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.781 [2024-10-07 11:33:29.015618] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.781 [2024-10-07 11:33:29.015635] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.781 [2024-10-07 11:33:29.015668] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.781 [2024-10-07 11:33:29.015687] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.781 [2024-10-07 11:33:29.015701] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.781 [2024-10-07 11:33:29.015816] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.781 [2024-10-07 11:33:29.015838] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.781 [2024-10-07 11:33:29.023448] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.781 [2024-10-07 11:33:29.023499] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.781 [2024-10-07 11:33:29.023620] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.781 [2024-10-07 11:33:29.023668] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.781 [2024-10-07 11:33:29.023688] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.781 [2024-10-07 11:33:29.023738] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.781 [2024-10-07 11:33:29.023762] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.781 [2024-10-07 11:33:29.023787] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.781 [2024-10-07 11:33:29.023811] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.781 [2024-10-07 11:33:29.023831] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.781 [2024-10-07 11:33:29.023851] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.781 [2024-10-07 11:33:29.023866] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.781 [2024-10-07 11:33:29.023880] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.781 [2024-10-07 11:33:29.023897] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.781 [2024-10-07 11:33:29.023912] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.781 [2024-10-07 11:33:29.023940] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.781 [2024-10-07 11:33:29.023965] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.781 [2024-10-07 11:33:29.023980] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.781 [2024-10-07 11:33:29.033563] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.781 [2024-10-07 11:33:29.033628] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.781 [2024-10-07 11:33:29.033717] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.781 [2024-10-07 11:33:29.033747] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.781 [2024-10-07 11:33:29.033763] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.781 [2024-10-07 11:33:29.033817] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.781 [2024-10-07 11:33:29.033842] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.781 [2024-10-07 11:33:29.033857] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.781 [2024-10-07 11:33:29.033875] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.781 [2024-10-07 11:33:29.033898] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.781 [2024-10-07 11:33:29.033915] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.781 [2024-10-07 11:33:29.033928] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.781 [2024-10-07 11:33:29.033942] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.781 [2024-10-07 11:33:29.033965] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.781 [2024-10-07 11:33:29.033980] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.781 [2024-10-07 11:33:29.033993] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.781 [2024-10-07 11:33:29.034006] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.781 [2024-10-07 11:33:29.034167] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.781 [2024-10-07 11:33:29.046666] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.781 [2024-10-07 11:33:29.046715] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.781 [2024-10-07 11:33:29.047034] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.781 [2024-10-07 11:33:29.047078] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.781 [2024-10-07 11:33:29.047098] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.781 [2024-10-07 11:33:29.047153] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.781 [2024-10-07 11:33:29.047176] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.782 [2024-10-07 11:33:29.047204] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.782 [2024-10-07 11:33:29.047424] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.782 [2024-10-07 11:33:29.047455] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.782 [2024-10-07 11:33:29.047532] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.782 [2024-10-07 11:33:29.047555] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.782 [2024-10-07 11:33:29.047569] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.782 [2024-10-07 11:33:29.047586] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.782 [2024-10-07 11:33:29.047601] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.782 [2024-10-07 11:33:29.047614] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.782 [2024-10-07 11:33:29.047637] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.782 [2024-10-07 11:33:29.047669] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.782 [2024-10-07 11:33:29.059208] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.782 [2024-10-07 11:33:29.059257] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.782 [2024-10-07 11:33:29.059436] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.782 [2024-10-07 11:33:29.059467] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.782 [2024-10-07 11:33:29.059483] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.782 [2024-10-07 11:33:29.059530] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.782 [2024-10-07 11:33:29.059553] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.782 [2024-10-07 11:33:29.059568] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.782 [2024-10-07 11:33:29.059785] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.782 [2024-10-07 11:33:29.059817] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.782 [2024-10-07 11:33:29.060941] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.782 [2024-10-07 11:33:29.060979] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.782 [2024-10-07 11:33:29.060996] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.782 [2024-10-07 11:33:29.061014] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.782 [2024-10-07 11:33:29.061028] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.782 [2024-10-07 11:33:29.061042] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.782 [2024-10-07 11:33:29.062531] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.782 [2024-10-07 11:33:29.062568] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.782 [2024-10-07 11:33:29.070682] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.782 [2024-10-07 11:33:29.070729] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.782 [2024-10-07 11:33:29.073387] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.782 [2024-10-07 11:33:29.073434] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.782 [2024-10-07 11:33:29.073469] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.782 [2024-10-07 11:33:29.073522] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.782 [2024-10-07 11:33:29.073547] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.782 [2024-10-07 11:33:29.073562] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.782 [2024-10-07 11:33:29.074823] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.782 [2024-10-07 11:33:29.074879] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.782 [2024-10-07 11:33:29.075442] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.782 [2024-10-07 11:33:29.075479] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.782 [2024-10-07 11:33:29.075496] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.782 [2024-10-07 11:33:29.075514] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.782 [2024-10-07 11:33:29.075529] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.782 [2024-10-07 11:33:29.075542] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.782 [2024-10-07 11:33:29.075623] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.782 [2024-10-07 11:33:29.075644] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.782 [2024-10-07 11:33:29.081769] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.782 [2024-10-07 11:33:29.081816] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.782 [2024-10-07 11:33:29.081900] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.782 [2024-10-07 11:33:29.081929] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.782 [2024-10-07 11:33:29.081945] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.782 [2024-10-07 11:33:29.081993] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.782 [2024-10-07 11:33:29.082016] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.782 [2024-10-07 11:33:29.082031] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.782 [2024-10-07 11:33:29.082054] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.782 [2024-10-07 11:33:29.082073] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.782 [2024-10-07 11:33:29.082108] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.782 [2024-10-07 11:33:29.082127] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.782 [2024-10-07 11:33:29.082140] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.782 [2024-10-07 11:33:29.082157] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.782 [2024-10-07 11:33:29.082171] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.782 [2024-10-07 11:33:29.082183] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.782 [2024-10-07 11:33:29.082220] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.782 [2024-10-07 11:33:29.082242] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.782 [2024-10-07 11:33:29.091876] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.782 [2024-10-07 11:33:29.091940] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.782 [2024-10-07 11:33:29.092017] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.782 [2024-10-07 11:33:29.092046] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.782 [2024-10-07 11:33:29.092063] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.782 [2024-10-07 11:33:29.092117] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.782 [2024-10-07 11:33:29.092140] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.782 [2024-10-07 11:33:29.092156] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.782 [2024-10-07 11:33:29.092173] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.782 [2024-10-07 11:33:29.092196] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.782 [2024-10-07 11:33:29.092213] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.782 [2024-10-07 11:33:29.092227] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.782 [2024-10-07 11:33:29.092240] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.782 [2024-10-07 11:33:29.092263] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.782 [2024-10-07 11:33:29.092277] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.782 [2024-10-07 11:33:29.092290] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.782 [2024-10-07 11:33:29.092304] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.782 [2024-10-07 11:33:29.092324] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.782 [2024-10-07 11:33:29.102716] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.782 [2024-10-07 11:33:29.102771] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.782 [2024-10-07 11:33:29.102893] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.782 [2024-10-07 11:33:29.102924] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.782 [2024-10-07 11:33:29.102941] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.782 [2024-10-07 11:33:29.102989] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.782 [2024-10-07 11:33:29.103013] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.782 [2024-10-07 11:33:29.103029] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.782 [2024-10-07 11:33:29.103635] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.782 [2024-10-07 11:33:29.103704] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.782 [2024-10-07 11:33:29.103948] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.782 [2024-10-07 11:33:29.104016] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.782 [2024-10-07 11:33:29.104035] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.782 [2024-10-07 11:33:29.104053] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.782 [2024-10-07 11:33:29.104067] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.783 [2024-10-07 11:33:29.104080] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.783 [2024-10-07 11:33:29.104286] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.783 [2024-10-07 11:33:29.104312] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.783 [2024-10-07 11:33:29.114183] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.783 [2024-10-07 11:33:29.114234] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.783 [2024-10-07 11:33:29.114439] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.783 [2024-10-07 11:33:29.114471] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.783 [2024-10-07 11:33:29.114488] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.783 [2024-10-07 11:33:29.114543] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.783 [2024-10-07 11:33:29.114566] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.783 [2024-10-07 11:33:29.114582] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.783 [2024-10-07 11:33:29.114703] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.783 [2024-10-07 11:33:29.114730] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.783 [2024-10-07 11:33:29.117137] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.783 [2024-10-07 11:33:29.117177] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.783 [2024-10-07 11:33:29.117195] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.783 [2024-10-07 11:33:29.117213] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.783 [2024-10-07 11:33:29.117227] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.783 [2024-10-07 11:33:29.117240] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.783 [2024-10-07 11:33:29.118511] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.783 [2024-10-07 11:33:29.118546] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.783 [2024-10-07 11:33:29.124303] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.783 [2024-10-07 11:33:29.124375] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.783 [2024-10-07 11:33:29.124452] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.783 [2024-10-07 11:33:29.124482] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.783 [2024-10-07 11:33:29.124498] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.783 [2024-10-07 11:33:29.124574] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.783 [2024-10-07 11:33:29.124600] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.783 [2024-10-07 11:33:29.124615] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.783 [2024-10-07 11:33:29.124633] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.783 [2024-10-07 11:33:29.124672] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.783 [2024-10-07 11:33:29.124692] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.783 [2024-10-07 11:33:29.124706] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.783 [2024-10-07 11:33:29.124719] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.783 [2024-10-07 11:33:29.124742] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.783 [2024-10-07 11:33:29.124757] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.783 [2024-10-07 11:33:29.124771] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.783 [2024-10-07 11:33:29.124784] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.783 [2024-10-07 11:33:29.124803] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.783 [2024-10-07 11:33:29.134392] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.783 [2024-10-07 11:33:29.134504] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.783 [2024-10-07 11:33:29.134535] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.783 [2024-10-07 11:33:29.134552] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.783 [2024-10-07 11:33:29.134595] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.783 [2024-10-07 11:33:29.134624] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.783 [2024-10-07 11:33:29.134668] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.783 [2024-10-07 11:33:29.134687] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.783 [2024-10-07 11:33:29.134701] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.783 [2024-10-07 11:33:29.135002] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.783 [2024-10-07 11:33:29.135074] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.783 [2024-10-07 11:33:29.135100] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.783 [2024-10-07 11:33:29.135116] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.783 [2024-10-07 11:33:29.135279] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.783 [2024-10-07 11:33:29.135390] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.783 [2024-10-07 11:33:29.135409] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.783 [2024-10-07 11:33:29.135423] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.783 [2024-10-07 11:33:29.135541] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.783 [2024-10-07 11:33:29.144476] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.783 [2024-10-07 11:33:29.144584] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.783 [2024-10-07 11:33:29.144614] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.783 [2024-10-07 11:33:29.144631] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.783 [2024-10-07 11:33:29.144670] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.783 [2024-10-07 11:33:29.144695] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.783 [2024-10-07 11:33:29.144709] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.783 [2024-10-07 11:33:29.144722] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.783 [2024-10-07 11:33:29.144756] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.783 [2024-10-07 11:33:29.144780] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.783 [2024-10-07 11:33:29.144848] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.783 [2024-10-07 11:33:29.144874] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.783 [2024-10-07 11:33:29.144889] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.783 [2024-10-07 11:33:29.144912] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.783 [2024-10-07 11:33:29.144934] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.783 [2024-10-07 11:33:29.144948] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.783 [2024-10-07 11:33:29.144961] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.783 [2024-10-07 11:33:29.144983] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.783 [2024-10-07 11:33:29.157499] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.783 [2024-10-07 11:33:29.157548] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.783 [2024-10-07 11:33:29.157825] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.783 [2024-10-07 11:33:29.157865] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.783 [2024-10-07 11:33:29.157884] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.783 [2024-10-07 11:33:29.157932] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.783 [2024-10-07 11:33:29.157956] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.783 [2024-10-07 11:33:29.157970] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.783 [2024-10-07 11:33:29.158106] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.783 [2024-10-07 11:33:29.158135] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.783 [2024-10-07 11:33:29.158286] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.783 [2024-10-07 11:33:29.158345] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.783 [2024-10-07 11:33:29.158363] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.783 [2024-10-07 11:33:29.158381] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.783 [2024-10-07 11:33:29.158395] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.783 [2024-10-07 11:33:29.158413] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.783 [2024-10-07 11:33:29.158470] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.783 [2024-10-07 11:33:29.158491] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.783 [2024-10-07 11:33:29.173874] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.783 [2024-10-07 11:33:29.173923] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.783 [2024-10-07 11:33:29.174010] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.783 [2024-10-07 11:33:29.174039] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.783 [2024-10-07 11:33:29.174056] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.784 [2024-10-07 11:33:29.174102] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.784 [2024-10-07 11:33:29.174125] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.784 [2024-10-07 11:33:29.174140] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.784 [2024-10-07 11:33:29.174163] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.784 [2024-10-07 11:33:29.174183] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.784 [2024-10-07 11:33:29.174203] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.784 [2024-10-07 11:33:29.174217] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.784 [2024-10-07 11:33:29.174231] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.784 [2024-10-07 11:33:29.174247] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.784 [2024-10-07 11:33:29.174261] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.784 [2024-10-07 11:33:29.174274] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.784 [2024-10-07 11:33:29.174296] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.784 [2024-10-07 11:33:29.174310] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.784 [2024-10-07 11:33:29.184900] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.784 [2024-10-07 11:33:29.184948] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.784 [2024-10-07 11:33:29.185124] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.784 [2024-10-07 11:33:29.185155] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.784 [2024-10-07 11:33:29.185173] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.784 [2024-10-07 11:33:29.185220] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.784 [2024-10-07 11:33:29.185260] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.784 [2024-10-07 11:33:29.185278] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.784 [2024-10-07 11:33:29.185381] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.784 [2024-10-07 11:33:29.185406] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.784 [2024-10-07 11:33:29.185516] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.784 [2024-10-07 11:33:29.185537] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.784 [2024-10-07 11:33:29.185550] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.784 [2024-10-07 11:33:29.185567] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.784 [2024-10-07 11:33:29.185582] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.784 [2024-10-07 11:33:29.185594] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.784 [2024-10-07 11:33:29.188109] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.784 [2024-10-07 11:33:29.188148] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.784 [2024-10-07 11:33:29.196022] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.784 [2024-10-07 11:33:29.196069] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.784 [2024-10-07 11:33:29.196155] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.784 [2024-10-07 11:33:29.196184] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.784 [2024-10-07 11:33:29.196201] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.784 [2024-10-07 11:33:29.196247] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.784 [2024-10-07 11:33:29.196270] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.784 [2024-10-07 11:33:29.196285] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.784 [2024-10-07 11:33:29.196308] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.784 [2024-10-07 11:33:29.196327] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.784 [2024-10-07 11:33:29.196347] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.784 [2024-10-07 11:33:29.196361] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.784 [2024-10-07 11:33:29.196375] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.784 [2024-10-07 11:33:29.196391] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.784 [2024-10-07 11:33:29.196405] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.784 [2024-10-07 11:33:29.196418] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.784 [2024-10-07 11:33:29.196440] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.784 [2024-10-07 11:33:29.196454] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.784 [2024-10-07 11:33:29.206407] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.784 [2024-10-07 11:33:29.206456] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.784 [2024-10-07 11:33:29.206542] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.784 [2024-10-07 11:33:29.206571] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.784 [2024-10-07 11:33:29.206587] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.784 [2024-10-07 11:33:29.206634] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.784 [2024-10-07 11:33:29.206672] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.784 [2024-10-07 11:33:29.206689] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.784 [2024-10-07 11:33:29.206713] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.784 [2024-10-07 11:33:29.206733] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.784 [2024-10-07 11:33:29.206752] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.784 [2024-10-07 11:33:29.206767] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.784 [2024-10-07 11:33:29.206780] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.784 [2024-10-07 11:33:29.206796] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.784 [2024-10-07 11:33:29.206810] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.784 [2024-10-07 11:33:29.206822] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.784 [2024-10-07 11:33:29.206845] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.784 [2024-10-07 11:33:29.206859] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.784 [2024-10-07 11:33:29.216520] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.784 [2024-10-07 11:33:29.216584] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.784 [2024-10-07 11:33:29.216676] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.784 [2024-10-07 11:33:29.216706] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.784 [2024-10-07 11:33:29.216723] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.784 [2024-10-07 11:33:29.216779] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.784 [2024-10-07 11:33:29.216803] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.784 [2024-10-07 11:33:29.216818] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.784 [2024-10-07 11:33:29.216836] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.784 [2024-10-07 11:33:29.216859] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.784 [2024-10-07 11:33:29.216878] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.784 [2024-10-07 11:33:29.216892] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.784 [2024-10-07 11:33:29.216920] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.784 [2024-10-07 11:33:29.216945] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.784 [2024-10-07 11:33:29.216960] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.784 [2024-10-07 11:33:29.216974] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.784 [2024-10-07 11:33:29.216987] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.784 [2024-10-07 11:33:29.217006] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.785 [2024-10-07 11:33:29.227941] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.785 [2024-10-07 11:33:29.227990] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.785 [2024-10-07 11:33:29.228972] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.785 [2024-10-07 11:33:29.229016] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.785 [2024-10-07 11:33:29.229036] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.785 [2024-10-07 11:33:29.229086] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.785 [2024-10-07 11:33:29.229109] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.785 [2024-10-07 11:33:29.229124] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.785 [2024-10-07 11:33:29.229246] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.785 [2024-10-07 11:33:29.229272] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.785 [2024-10-07 11:33:29.229293] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.785 [2024-10-07 11:33:29.229307] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.785 [2024-10-07 11:33:29.229321] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.785 [2024-10-07 11:33:29.229338] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.785 [2024-10-07 11:33:29.229352] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.785 [2024-10-07 11:33:29.229364] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.785 [2024-10-07 11:33:29.229387] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.785 [2024-10-07 11:33:29.229401] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.785 [2024-10-07 11:33:29.239281] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.785 [2024-10-07 11:33:29.239334] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.785 [2024-10-07 11:33:29.239530] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.785 [2024-10-07 11:33:29.239563] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.785 [2024-10-07 11:33:29.239580] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.785 [2024-10-07 11:33:29.239628] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.785 [2024-10-07 11:33:29.239664] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.785 [2024-10-07 11:33:29.239696] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.785 [2024-10-07 11:33:29.239841] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.785 [2024-10-07 11:33:29.239872] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.785 [2024-10-07 11:33:29.240616] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.785 [2024-10-07 11:33:29.240664] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.785 [2024-10-07 11:33:29.240684] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.785 [2024-10-07 11:33:29.240701] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.785 [2024-10-07 11:33:29.240716] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.785 [2024-10-07 11:33:29.240729] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.785 [2024-10-07 11:33:29.243363] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.785 [2024-10-07 11:33:29.243400] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.785 [2024-10-07 11:33:29.249398] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.785 [2024-10-07 11:33:29.249461] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.785 [2024-10-07 11:33:29.249541] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.785 [2024-10-07 11:33:29.249570] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.785 [2024-10-07 11:33:29.249586] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.785 [2024-10-07 11:33:29.249642] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.785 [2024-10-07 11:33:29.249700] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.785 [2024-10-07 11:33:29.249717] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.785 [2024-10-07 11:33:29.249736] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.785 [2024-10-07 11:33:29.249760] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.785 [2024-10-07 11:33:29.249778] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.785 [2024-10-07 11:33:29.249792] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.785 [2024-10-07 11:33:29.249805] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.785 [2024-10-07 11:33:29.249828] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.785 [2024-10-07 11:33:29.249842] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.785 [2024-10-07 11:33:29.249856] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.785 [2024-10-07 11:33:29.249868] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.785 [2024-10-07 11:33:29.249887] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.785 [2024-10-07 11:33:29.262362] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.785 [2024-10-07 11:33:29.262427] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.785 [2024-10-07 11:33:29.262516] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.785 [2024-10-07 11:33:29.262546] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.785 [2024-10-07 11:33:29.262562] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.785 [2024-10-07 11:33:29.262608] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.785 [2024-10-07 11:33:29.262631] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.785 [2024-10-07 11:33:29.262646] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.785 [2024-10-07 11:33:29.262686] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.785 [2024-10-07 11:33:29.262706] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.785 [2024-10-07 11:33:29.262725] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.785 [2024-10-07 11:33:29.262740] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.785 [2024-10-07 11:33:29.262754] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.785 [2024-10-07 11:33:29.262770] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.785 [2024-10-07 11:33:29.262784] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.785 [2024-10-07 11:33:29.262797] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.785 [2024-10-07 11:33:29.262819] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.785 [2024-10-07 11:33:29.262833] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.785 [2024-10-07 11:33:29.272755] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.785 [2024-10-07 11:33:29.272808] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.785 [2024-10-07 11:33:29.272983] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.785 [2024-10-07 11:33:29.273014] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.785 [2024-10-07 11:33:29.273031] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.785 [2024-10-07 11:33:29.273079] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.785 [2024-10-07 11:33:29.273102] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.785 [2024-10-07 11:33:29.273117] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.785 [2024-10-07 11:33:29.273222] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.785 [2024-10-07 11:33:29.273246] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.785 [2024-10-07 11:33:29.276580] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.785 [2024-10-07 11:33:29.276621] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.785 [2024-10-07 11:33:29.276638] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.785 [2024-10-07 11:33:29.276683] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.785 [2024-10-07 11:33:29.276700] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.785 [2024-10-07 11:33:29.276713] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.785 [2024-10-07 11:33:29.277404] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.785 [2024-10-07 11:33:29.277442] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.785 [2024-10-07 11:33:29.284252] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.785 [2024-10-07 11:33:29.284301] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.785 [2024-10-07 11:33:29.284476] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.785 [2024-10-07 11:33:29.284508] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.785 [2024-10-07 11:33:29.284525] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.785 [2024-10-07 11:33:29.284573] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.785 [2024-10-07 11:33:29.284596] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.785 [2024-10-07 11:33:29.284612] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.786 [2024-10-07 11:33:29.284729] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.786 [2024-10-07 11:33:29.284756] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.786 [2024-10-07 11:33:29.285261] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.786 [2024-10-07 11:33:29.285299] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.786 [2024-10-07 11:33:29.285317] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.786 [2024-10-07 11:33:29.285336] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.786 [2024-10-07 11:33:29.285350] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.786 [2024-10-07 11:33:29.285363] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.786 [2024-10-07 11:33:29.285445] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.786 [2024-10-07 11:33:29.285466] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.786 [2024-10-07 11:33:29.295839] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.786 [2024-10-07 11:33:29.295888] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.786 [2024-10-07 11:33:29.296003] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.786 [2024-10-07 11:33:29.296034] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.786 [2024-10-07 11:33:29.296051] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.786 [2024-10-07 11:33:29.296098] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.786 [2024-10-07 11:33:29.296122] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.786 [2024-10-07 11:33:29.296137] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.786 [2024-10-07 11:33:29.296331] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.786 [2024-10-07 11:33:29.296362] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.786 [2024-10-07 11:33:29.296416] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.786 [2024-10-07 11:33:29.296437] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.786 [2024-10-07 11:33:29.296451] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.786 [2024-10-07 11:33:29.296468] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.786 [2024-10-07 11:33:29.296482] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.786 [2024-10-07 11:33:29.296494] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.786 [2024-10-07 11:33:29.296681] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.786 [2024-10-07 11:33:29.296706] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.786 [2024-10-07 11:33:29.309713] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.786 [2024-10-07 11:33:29.309759] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.786 [2024-10-07 11:33:29.310222] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.786 [2024-10-07 11:33:29.310265] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.786 [2024-10-07 11:33:29.310285] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.786 [2024-10-07 11:33:29.310354] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.786 [2024-10-07 11:33:29.310377] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.786 [2024-10-07 11:33:29.310393] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.786 [2024-10-07 11:33:29.310609] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.786 [2024-10-07 11:33:29.310640] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.786 [2024-10-07 11:33:29.310859] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.786 [2024-10-07 11:33:29.310891] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.786 [2024-10-07 11:33:29.310906] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.786 [2024-10-07 11:33:29.310925] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.786 [2024-10-07 11:33:29.310939] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.786 [2024-10-07 11:33:29.310952] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.786 [2024-10-07 11:33:29.311004] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.786 [2024-10-07 11:33:29.311024] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.786 [2024-10-07 11:33:29.322877] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.786 [2024-10-07 11:33:29.322946] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.786 [2024-10-07 11:33:29.323791] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.786 [2024-10-07 11:33:29.323835] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.786 [2024-10-07 11:33:29.323855] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.786 [2024-10-07 11:33:29.323905] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.786 [2024-10-07 11:33:29.323929] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.786 [2024-10-07 11:33:29.323944] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.786 [2024-10-07 11:33:29.324318] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.786 [2024-10-07 11:33:29.324349] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.786 [2024-10-07 11:33:29.324560] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.786 [2024-10-07 11:33:29.324596] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.786 [2024-10-07 11:33:29.324613] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.786 [2024-10-07 11:33:29.324631] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.786 [2024-10-07 11:33:29.324645] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.786 [2024-10-07 11:33:29.324674] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.786 [2024-10-07 11:33:29.324879] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.786 [2024-10-07 11:33:29.324903] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.786 [2024-10-07 11:33:29.336742] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.786 [2024-10-07 11:33:29.336789] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.786 [2024-10-07 11:33:29.337596] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.786 [2024-10-07 11:33:29.337639] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.786 [2024-10-07 11:33:29.337672] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.786 [2024-10-07 11:33:29.337724] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.786 [2024-10-07 11:33:29.337749] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.786 [2024-10-07 11:33:29.337764] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.786 [2024-10-07 11:33:29.338138] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.786 [2024-10-07 11:33:29.338180] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.786 [2024-10-07 11:33:29.338394] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.786 [2024-10-07 11:33:29.338430] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.786 [2024-10-07 11:33:29.338448] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.786 [2024-10-07 11:33:29.338466] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.786 [2024-10-07 11:33:29.338494] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.786 [2024-10-07 11:33:29.338508] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.786 [2024-10-07 11:33:29.338742] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.786 [2024-10-07 11:33:29.338792] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.786 [2024-10-07 11:33:29.350926] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.786 [2024-10-07 11:33:29.350976] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.786 [2024-10-07 11:33:29.351804] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.786 [2024-10-07 11:33:29.351849] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.786 [2024-10-07 11:33:29.351869] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.786 [2024-10-07 11:33:29.351919] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.786 [2024-10-07 11:33:29.351942] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.786 [2024-10-07 11:33:29.351957] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.786 [2024-10-07 11:33:29.352358] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.786 [2024-10-07 11:33:29.352409] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.786 [2024-10-07 11:33:29.352660] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.786 [2024-10-07 11:33:29.352696] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.786 [2024-10-07 11:33:29.352713] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.787 [2024-10-07 11:33:29.352730] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.787 [2024-10-07 11:33:29.352745] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.787 [2024-10-07 11:33:29.352758] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.787 [2024-10-07 11:33:29.352819] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.787 [2024-10-07 11:33:29.352839] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.787 [2024-10-07 11:33:29.361038] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.787 [2024-10-07 11:33:29.361100] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.787 [2024-10-07 11:33:29.361176] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.787 [2024-10-07 11:33:29.361204] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.787 [2024-10-07 11:33:29.361220] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.787 [2024-10-07 11:33:29.364133] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.787 [2024-10-07 11:33:29.364180] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.787 [2024-10-07 11:33:29.364200] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.787 [2024-10-07 11:33:29.364219] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.787 [2024-10-07 11:33:29.366393] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.787 [2024-10-07 11:33:29.366438] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.787 [2024-10-07 11:33:29.366456] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.787 [2024-10-07 11:33:29.366470] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.787 [2024-10-07 11:33:29.366938] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.787 [2024-10-07 11:33:29.366976] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.787 [2024-10-07 11:33:29.366993] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.787 [2024-10-07 11:33:29.367007] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.787 [2024-10-07 11:33:29.367242] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.787 [2024-10-07 11:33:29.371756] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.787 [2024-10-07 11:33:29.371803] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.787 [2024-10-07 11:33:29.371888] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.787 [2024-10-07 11:33:29.371918] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.787 [2024-10-07 11:33:29.371934] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.787 [2024-10-07 11:33:29.371981] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.787 [2024-10-07 11:33:29.372004] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.787 [2024-10-07 11:33:29.372020] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.787 [2024-10-07 11:33:29.372043] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.787 [2024-10-07 11:33:29.372062] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.787 [2024-10-07 11:33:29.372082] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.787 [2024-10-07 11:33:29.372097] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.787 [2024-10-07 11:33:29.372110] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.787 [2024-10-07 11:33:29.372126] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.787 [2024-10-07 11:33:29.372139] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.787 [2024-10-07 11:33:29.372152] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.787 [2024-10-07 11:33:29.372174] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.787 [2024-10-07 11:33:29.372188] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.787 [2024-10-07 11:33:29.382142] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.787 [2024-10-07 11:33:29.382192] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.787 [2024-10-07 11:33:29.382279] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.787 [2024-10-07 11:33:29.382322] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.787 [2024-10-07 11:33:29.382340] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.787 [2024-10-07 11:33:29.382389] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.787 [2024-10-07 11:33:29.382413] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.787 [2024-10-07 11:33:29.382428] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.787 [2024-10-07 11:33:29.382910] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.787 [2024-10-07 11:33:29.382941] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.787 [2024-10-07 11:33:29.383163] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.787 [2024-10-07 11:33:29.383212] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.787 [2024-10-07 11:33:29.383230] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.787 [2024-10-07 11:33:29.383247] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.787 [2024-10-07 11:33:29.383262] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.787 [2024-10-07 11:33:29.383275] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.787 [2024-10-07 11:33:29.383477] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.787 [2024-10-07 11:33:29.383501] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.787 [2024-10-07 11:33:29.396567] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.787 [2024-10-07 11:33:29.396616] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.787 [2024-10-07 11:33:29.397090] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.787 [2024-10-07 11:33:29.397134] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.787 [2024-10-07 11:33:29.397154] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.787 [2024-10-07 11:33:29.397204] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.787 [2024-10-07 11:33:29.397227] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.787 [2024-10-07 11:33:29.397242] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.787 [2024-10-07 11:33:29.397456] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.787 [2024-10-07 11:33:29.397487] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.787 [2024-10-07 11:33:29.397697] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.787 [2024-10-07 11:33:29.397732] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.787 [2024-10-07 11:33:29.397749] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.787 [2024-10-07 11:33:29.397766] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.787 [2024-10-07 11:33:29.397780] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.787 [2024-10-07 11:33:29.397812] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.787 [2024-10-07 11:33:29.398015] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.787 [2024-10-07 11:33:29.398040] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.787 [2024-10-07 11:33:29.409750] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.787 [2024-10-07 11:33:29.409799] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.787 [2024-10-07 11:33:29.410567] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.787 [2024-10-07 11:33:29.410611] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.787 [2024-10-07 11:33:29.410631] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.787 [2024-10-07 11:33:29.410698] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.788 [2024-10-07 11:33:29.410724] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.788 [2024-10-07 11:33:29.410740] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.788 [2024-10-07 11:33:29.411124] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.788 [2024-10-07 11:33:29.411160] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.788 [2024-10-07 11:33:29.411380] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.788 [2024-10-07 11:33:29.411407] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.788 [2024-10-07 11:33:29.411421] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.788 [2024-10-07 11:33:29.411439] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.788 [2024-10-07 11:33:29.411454] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.788 [2024-10-07 11:33:29.411466] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.788 [2024-10-07 11:33:29.411706] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.788 [2024-10-07 11:33:29.411731] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.788 [2024-10-07 11:33:29.423690] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.788 [2024-10-07 11:33:29.423736] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.788 [2024-10-07 11:33:29.424545] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.788 [2024-10-07 11:33:29.424587] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.788 [2024-10-07 11:33:29.424607] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.788 [2024-10-07 11:33:29.424671] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.788 [2024-10-07 11:33:29.424697] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.788 [2024-10-07 11:33:29.424712] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.788 [2024-10-07 11:33:29.425087] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.788 [2024-10-07 11:33:29.425142] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.788 [2024-10-07 11:33:29.425359] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.788 [2024-10-07 11:33:29.425396] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.788 [2024-10-07 11:33:29.425415] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.788 [2024-10-07 11:33:29.425432] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.788 [2024-10-07 11:33:29.425447] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.788 [2024-10-07 11:33:29.425459] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.788 [2024-10-07 11:33:29.425676] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.788 [2024-10-07 11:33:29.425701] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.788 [2024-10-07 11:33:29.437534] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.788 [2024-10-07 11:33:29.437584] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.788 [2024-10-07 11:33:29.438408] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.788 [2024-10-07 11:33:29.438452] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.788 [2024-10-07 11:33:29.438472] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.788 [2024-10-07 11:33:29.438521] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.788 [2024-10-07 11:33:29.438545] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.788 [2024-10-07 11:33:29.438560] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.788 [2024-10-07 11:33:29.438952] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.788 [2024-10-07 11:33:29.438984] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.788 [2024-10-07 11:33:29.439214] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.788 [2024-10-07 11:33:29.439251] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.788 [2024-10-07 11:33:29.439267] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.788 [2024-10-07 11:33:29.439285] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.788 [2024-10-07 11:33:29.439299] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.788 [2024-10-07 11:33:29.439312] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.788 [2024-10-07 11:33:29.439513] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.788 [2024-10-07 11:33:29.439538] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.788 [2024-10-07 11:33:29.451579] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.788 [2024-10-07 11:33:29.451638] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.788 [2024-10-07 11:33:29.452425] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.788 [2024-10-07 11:33:29.452469] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.788 [2024-10-07 11:33:29.452504] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.788 [2024-10-07 11:33:29.452558] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.788 [2024-10-07 11:33:29.452582] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.788 [2024-10-07 11:33:29.452597] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.788 [2024-10-07 11:33:29.452986] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.788 [2024-10-07 11:33:29.453028] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.788 [2024-10-07 11:33:29.453255] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.788 [2024-10-07 11:33:29.453291] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.788 [2024-10-07 11:33:29.453309] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.788 [2024-10-07 11:33:29.453326] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.788 [2024-10-07 11:33:29.453341] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.788 [2024-10-07 11:33:29.453353] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.788 [2024-10-07 11:33:29.453554] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.788 [2024-10-07 11:33:29.453579] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.788 [2024-10-07 11:33:29.465627] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.788 [2024-10-07 11:33:29.465689] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.788 [2024-10-07 11:33:29.466472] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.788 [2024-10-07 11:33:29.466515] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.788 [2024-10-07 11:33:29.466535] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.788 [2024-10-07 11:33:29.466585] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.788 [2024-10-07 11:33:29.466609] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.788 [2024-10-07 11:33:29.466624] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.788 [2024-10-07 11:33:29.467013] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.789 [2024-10-07 11:33:29.467045] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.789 [2024-10-07 11:33:29.467270] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.789 [2024-10-07 11:33:29.467307] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.789 [2024-10-07 11:33:29.467324] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.789 [2024-10-07 11:33:29.467354] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.789 [2024-10-07 11:33:29.467368] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.789 [2024-10-07 11:33:29.467381] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.789 [2024-10-07 11:33:29.467604] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.789 [2024-10-07 11:33:29.467630] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.789 [2024-10-07 11:33:29.479444] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.789 [2024-10-07 11:33:29.479494] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.789 [2024-10-07 11:33:29.480322] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.789 [2024-10-07 11:33:29.480367] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.789 [2024-10-07 11:33:29.480387] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.789 [2024-10-07 11:33:29.480438] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.789 [2024-10-07 11:33:29.480461] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.789 [2024-10-07 11:33:29.480476] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.789 [2024-10-07 11:33:29.480867] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.789 [2024-10-07 11:33:29.480899] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.789 [2024-10-07 11:33:29.481110] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.789 [2024-10-07 11:33:29.481146] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.789 [2024-10-07 11:33:29.481164] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.789 [2024-10-07 11:33:29.481181] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.789 [2024-10-07 11:33:29.481196] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.789 [2024-10-07 11:33:29.481208] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.789 [2024-10-07 11:33:29.481407] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.789 [2024-10-07 11:33:29.481432] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.789 [2024-10-07 11:33:29.493447] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.789 [2024-10-07 11:33:29.493506] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.789 [2024-10-07 11:33:29.494307] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.789 [2024-10-07 11:33:29.494352] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.789 [2024-10-07 11:33:29.494372] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.789 [2024-10-07 11:33:29.494423] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.789 [2024-10-07 11:33:29.494446] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.789 [2024-10-07 11:33:29.494461] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.789 [2024-10-07 11:33:29.494862] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.789 [2024-10-07 11:33:29.494894] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.789 [2024-10-07 11:33:29.495144] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.789 [2024-10-07 11:33:29.495192] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.789 [2024-10-07 11:33:29.495211] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.789 [2024-10-07 11:33:29.495228] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.789 [2024-10-07 11:33:29.495242] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.789 [2024-10-07 11:33:29.495256] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.789 [2024-10-07 11:33:29.495475] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.789 [2024-10-07 11:33:29.495500] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.789 [2024-10-07 11:33:29.507983] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.789 [2024-10-07 11:33:29.508033] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.789 [2024-10-07 11:33:29.508186] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.789 [2024-10-07 11:33:29.508217] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.789 [2024-10-07 11:33:29.508234] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.789 [2024-10-07 11:33:29.508282] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.789 [2024-10-07 11:33:29.508305] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.789 [2024-10-07 11:33:29.508320] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.789 [2024-10-07 11:33:29.508345] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.789 [2024-10-07 11:33:29.508365] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.789 [2024-10-07 11:33:29.508385] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.789 [2024-10-07 11:33:29.508399] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.789 [2024-10-07 11:33:29.508413] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.789 [2024-10-07 11:33:29.508429] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.789 [2024-10-07 11:33:29.508443] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.789 [2024-10-07 11:33:29.508456] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.789 [2024-10-07 11:33:29.508478] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.789 [2024-10-07 11:33:29.508493] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.789 [2024-10-07 11:33:29.518139] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.789 [2024-10-07 11:33:29.518186] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.789 [2024-10-07 11:33:29.518272] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.789 [2024-10-07 11:33:29.518301] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.789 [2024-10-07 11:33:29.518317] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.789 [2024-10-07 11:33:29.518388] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.789 [2024-10-07 11:33:29.518412] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.789 [2024-10-07 11:33:29.518427] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.789 [2024-10-07 11:33:29.518798] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.789 [2024-10-07 11:33:29.518828] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.789 [2024-10-07 11:33:29.518850] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.789 [2024-10-07 11:33:29.518865] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.789 [2024-10-07 11:33:29.518878] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.789 [2024-10-07 11:33:29.518895] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.789 [2024-10-07 11:33:29.518908] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.789 [2024-10-07 11:33:29.518921] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.789 [2024-10-07 11:33:29.518944] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.789 [2024-10-07 11:33:29.518957] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.789 [2024-10-07 11:33:29.528680] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.789 [2024-10-07 11:33:29.528728] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.789 [2024-10-07 11:33:29.528860] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.789 [2024-10-07 11:33:29.528891] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.789 [2024-10-07 11:33:29.528907] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.789 [2024-10-07 11:33:29.528955] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.789 [2024-10-07 11:33:29.528978] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.789 [2024-10-07 11:33:29.528993] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.790 [2024-10-07 11:33:29.529017] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.790 [2024-10-07 11:33:29.529037] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.790 [2024-10-07 11:33:29.529057] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.790 [2024-10-07 11:33:29.529071] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.790 [2024-10-07 11:33:29.529085] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.790 [2024-10-07 11:33:29.529101] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.790 [2024-10-07 11:33:29.529115] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.790 [2024-10-07 11:33:29.529127] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.790 [2024-10-07 11:33:29.529150] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.790 [2024-10-07 11:33:29.529178] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.790 [2024-10-07 11:33:29.538789] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.790 [2024-10-07 11:33:29.538851] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.790 [2024-10-07 11:33:29.538926] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.790 [2024-10-07 11:33:29.538955] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.790 [2024-10-07 11:33:29.538971] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.790 [2024-10-07 11:33:29.539241] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.790 [2024-10-07 11:33:29.539272] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.790 [2024-10-07 11:33:29.539289] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.790 [2024-10-07 11:33:29.539307] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.790 [2024-10-07 11:33:29.539365] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.790 [2024-10-07 11:33:29.539389] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.790 [2024-10-07 11:33:29.539403] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.790 [2024-10-07 11:33:29.539423] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.790 [2024-10-07 11:33:29.539598] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.790 [2024-10-07 11:33:29.539621] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.790 [2024-10-07 11:33:29.539635] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.790 [2024-10-07 11:33:29.539662] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.790 [2024-10-07 11:33:29.539723] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.790 [2024-10-07 11:33:29.551880] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.790 [2024-10-07 11:33:29.551931] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.790 [2024-10-07 11:33:29.552407] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.790 [2024-10-07 11:33:29.552452] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.790 [2024-10-07 11:33:29.552472] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.790 [2024-10-07 11:33:29.552524] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.790 [2024-10-07 11:33:29.552548] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.790 [2024-10-07 11:33:29.552563] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.790 [2024-10-07 11:33:29.552798] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.790 [2024-10-07 11:33:29.552830] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.790 [2024-10-07 11:33:29.553028] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.790 [2024-10-07 11:33:29.553080] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.790 [2024-10-07 11:33:29.553098] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.790 [2024-10-07 11:33:29.553116] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.790 [2024-10-07 11:33:29.553130] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.790 [2024-10-07 11:33:29.553143] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.790 [2024-10-07 11:33:29.553214] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.790 [2024-10-07 11:33:29.553236] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.790 [2024-10-07 11:33:29.565877] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.790 [2024-10-07 11:33:29.565926] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.790 [2024-10-07 11:33:29.566367] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.790 [2024-10-07 11:33:29.566412] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.790 [2024-10-07 11:33:29.566433] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.790 [2024-10-07 11:33:29.566485] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.790 [2024-10-07 11:33:29.566522] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.790 [2024-10-07 11:33:29.566549] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.790 [2024-10-07 11:33:29.566819] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.790 [2024-10-07 11:33:29.566852] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.790 [2024-10-07 11:33:29.567061] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.790 [2024-10-07 11:33:29.567097] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.790 [2024-10-07 11:33:29.567115] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.790 [2024-10-07 11:33:29.567132] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.790 [2024-10-07 11:33:29.567146] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.790 [2024-10-07 11:33:29.567159] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.790 [2024-10-07 11:33:29.567230] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.790 [2024-10-07 11:33:29.567252] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.790 [2024-10-07 11:33:29.579050] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.790 [2024-10-07 11:33:29.579099] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.790 [2024-10-07 11:33:29.579892] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.790 [2024-10-07 11:33:29.579935] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.790 [2024-10-07 11:33:29.579955] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.790 [2024-10-07 11:33:29.580022] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.790 [2024-10-07 11:33:29.580047] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.790 [2024-10-07 11:33:29.580063] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.790 [2024-10-07 11:33:29.580440] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.790 [2024-10-07 11:33:29.580487] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.790 [2024-10-07 11:33:29.580721] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.790 [2024-10-07 11:33:29.580758] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.790 [2024-10-07 11:33:29.580775] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.790 [2024-10-07 11:33:29.580793] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.790 [2024-10-07 11:33:29.580807] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.790 [2024-10-07 11:33:29.580820] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.790 [2024-10-07 11:33:29.581035] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.790 [2024-10-07 11:33:29.581060] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.790 [2024-10-07 11:33:29.592776] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.790 [2024-10-07 11:33:29.592824] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.790 [2024-10-07 11:33:29.593675] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.790 [2024-10-07 11:33:29.593720] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.791 [2024-10-07 11:33:29.593739] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.791 [2024-10-07 11:33:29.593790] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.791 [2024-10-07 11:33:29.593814] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.791 [2024-10-07 11:33:29.593829] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.791 [2024-10-07 11:33:29.594210] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.791 [2024-10-07 11:33:29.594243] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.791 [2024-10-07 11:33:29.594453] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.791 [2024-10-07 11:33:29.594489] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.791 [2024-10-07 11:33:29.594506] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.791 [2024-10-07 11:33:29.594524] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.791 [2024-10-07 11:33:29.594538] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.791 [2024-10-07 11:33:29.594551] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.791 [2024-10-07 11:33:29.594766] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.791 [2024-10-07 11:33:29.594792] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.791 [2024-10-07 11:33:29.606701] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.791 [2024-10-07 11:33:29.606750] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.791 [2024-10-07 11:33:29.607549] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.791 [2024-10-07 11:33:29.607593] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.791 [2024-10-07 11:33:29.607613] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.791 [2024-10-07 11:33:29.607678] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.791 [2024-10-07 11:33:29.607704] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.791 [2024-10-07 11:33:29.607720] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.791 [2024-10-07 11:33:29.608104] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.791 [2024-10-07 11:33:29.608161] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.791 [2024-10-07 11:33:29.608396] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.791 [2024-10-07 11:33:29.608434] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.791 [2024-10-07 11:33:29.608452] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.791 [2024-10-07 11:33:29.608469] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.791 [2024-10-07 11:33:29.608483] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.791 [2024-10-07 11:33:29.608496] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.791 [2024-10-07 11:33:29.608722] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.791 [2024-10-07 11:33:29.608747] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.791 [2024-10-07 11:33:29.620709] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.791 [2024-10-07 11:33:29.620780] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.791 [2024-10-07 11:33:29.621614] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.791 [2024-10-07 11:33:29.621668] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.791 [2024-10-07 11:33:29.621690] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.791 [2024-10-07 11:33:29.621742] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.791 [2024-10-07 11:33:29.621766] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.791 [2024-10-07 11:33:29.621781] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.791 [2024-10-07 11:33:29.622157] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.791 [2024-10-07 11:33:29.622190] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.791 [2024-10-07 11:33:29.622415] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.791 [2024-10-07 11:33:29.622452] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.791 [2024-10-07 11:33:29.622485] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.791 [2024-10-07 11:33:29.622505] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.791 [2024-10-07 11:33:29.622520] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.791 [2024-10-07 11:33:29.622532] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.791 [2024-10-07 11:33:29.622752] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.791 [2024-10-07 11:33:29.622779] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.791 [2024-10-07 11:33:29.634636] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.791 [2024-10-07 11:33:29.634701] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.791 [2024-10-07 11:33:29.635526] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.791 [2024-10-07 11:33:29.635570] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.791 [2024-10-07 11:33:29.635590] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.791 [2024-10-07 11:33:29.635641] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.791 [2024-10-07 11:33:29.635678] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.791 [2024-10-07 11:33:29.635694] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.791 [2024-10-07 11:33:29.636077] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.791 [2024-10-07 11:33:29.636109] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.791 [2024-10-07 11:33:29.636319] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.791 [2024-10-07 11:33:29.636356] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.791 [2024-10-07 11:33:29.636374] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.791 [2024-10-07 11:33:29.636391] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.791 [2024-10-07 11:33:29.636405] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.791 [2024-10-07 11:33:29.636418] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.791 [2024-10-07 11:33:29.636620] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.791 [2024-10-07 11:33:29.636645] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.791 [2024-10-07 11:33:29.648496] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.791 [2024-10-07 11:33:29.648546] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.791 [2024-10-07 11:33:29.649341] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.791 [2024-10-07 11:33:29.649385] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.791 [2024-10-07 11:33:29.649406] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.791 [2024-10-07 11:33:29.649457] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.791 [2024-10-07 11:33:29.649481] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.791 [2024-10-07 11:33:29.649513] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.791 [2024-10-07 11:33:29.649906] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.791 [2024-10-07 11:33:29.649940] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.791 [2024-10-07 11:33:29.650151] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.791 [2024-10-07 11:33:29.650189] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.791 [2024-10-07 11:33:29.650207] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.791 [2024-10-07 11:33:29.650225] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.791 [2024-10-07 11:33:29.650240] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.791 [2024-10-07 11:33:29.650252] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.791 [2024-10-07 11:33:29.650453] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.791 [2024-10-07 11:33:29.650478] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.791 [2024-10-07 11:33:29.662313] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.791 [2024-10-07 11:33:29.662362] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.791 [2024-10-07 11:33:29.663153] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.792 [2024-10-07 11:33:29.663204] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.792 [2024-10-07 11:33:29.663225] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.792 [2024-10-07 11:33:29.663276] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.792 [2024-10-07 11:33:29.663300] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.792 [2024-10-07 11:33:29.663316] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.792 [2024-10-07 11:33:29.663707] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.792 [2024-10-07 11:33:29.663748] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.792 [2024-10-07 11:33:29.663964] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.792 [2024-10-07 11:33:29.664000] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.792 [2024-10-07 11:33:29.664018] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.792 [2024-10-07 11:33:29.664036] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.792 [2024-10-07 11:33:29.664050] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.792 [2024-10-07 11:33:29.664062] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.792 [2024-10-07 11:33:29.664276] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.792 [2024-10-07 11:33:29.664303] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.792 [2024-10-07 11:33:29.676150] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.792 [2024-10-07 11:33:29.676213] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.792 [2024-10-07 11:33:29.677012] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.792 [2024-10-07 11:33:29.677055] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.792 [2024-10-07 11:33:29.677075] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.792 [2024-10-07 11:33:29.677125] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.792 [2024-10-07 11:33:29.677149] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.792 [2024-10-07 11:33:29.677164] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.792 [2024-10-07 11:33:29.677538] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.792 [2024-10-07 11:33:29.677570] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.792 [2024-10-07 11:33:29.677793] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.792 [2024-10-07 11:33:29.677830] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.792 [2024-10-07 11:33:29.677847] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.792 [2024-10-07 11:33:29.677864] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.792 [2024-10-07 11:33:29.677878] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.792 [2024-10-07 11:33:29.677892] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.792 [2024-10-07 11:33:29.678094] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.792 [2024-10-07 11:33:29.678119] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.792 [2024-10-07 11:33:29.690046] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.792 [2024-10-07 11:33:29.690095] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.792 [2024-10-07 11:33:29.690895] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.792 [2024-10-07 11:33:29.690939] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.792 [2024-10-07 11:33:29.690958] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.792 [2024-10-07 11:33:29.691009] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.792 [2024-10-07 11:33:29.691033] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.792 [2024-10-07 11:33:29.691049] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.792 [2024-10-07 11:33:29.691435] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.792 [2024-10-07 11:33:29.691467] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.792 [2024-10-07 11:33:29.691691] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.792 [2024-10-07 11:33:29.691727] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.792 [2024-10-07 11:33:29.691745] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.792 [2024-10-07 11:33:29.691777] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.792 [2024-10-07 11:33:29.691793] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.792 [2024-10-07 11:33:29.691806] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.792 [2024-10-07 11:33:29.692010] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.792 [2024-10-07 11:33:29.692036] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.792 [2024-10-07 11:33:29.703798] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.792 [2024-10-07 11:33:29.703846] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.792 [2024-10-07 11:33:29.704670] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.792 [2024-10-07 11:33:29.704712] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.792 [2024-10-07 11:33:29.704732] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.792 [2024-10-07 11:33:29.704783] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.792 [2024-10-07 11:33:29.704807] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.792 [2024-10-07 11:33:29.704822] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.792 [2024-10-07 11:33:29.705196] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.792 [2024-10-07 11:33:29.705240] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.792 [2024-10-07 11:33:29.705457] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.792 [2024-10-07 11:33:29.705492] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.792 [2024-10-07 11:33:29.705510] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.792 [2024-10-07 11:33:29.705527] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.792 [2024-10-07 11:33:29.705541] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.792 [2024-10-07 11:33:29.705555] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.792 [2024-10-07 11:33:29.705770] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.792 [2024-10-07 11:33:29.705796] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.792 [2024-10-07 11:33:29.717687] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.792 [2024-10-07 11:33:29.717739] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.792 [2024-10-07 11:33:29.718170] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.792 [2024-10-07 11:33:29.718214] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.792 [2024-10-07 11:33:29.718234] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.792 [2024-10-07 11:33:29.718285] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.792 [2024-10-07 11:33:29.718310] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.792 [2024-10-07 11:33:29.718340] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.792 [2024-10-07 11:33:29.719071] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.792 [2024-10-07 11:33:29.719114] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.792 [2024-10-07 11:33:29.719369] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.792 [2024-10-07 11:33:29.719396] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.792 [2024-10-07 11:33:29.719411] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.792 [2024-10-07 11:33:29.719428] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.793 [2024-10-07 11:33:29.719442] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.793 [2024-10-07 11:33:29.719455] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.793 [2024-10-07 11:33:29.719671] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.793 [2024-10-07 11:33:29.719697] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.793 [2024-10-07 11:33:29.731425] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.793 [2024-10-07 11:33:29.731473] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.793 [2024-10-07 11:33:29.732257] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.793 [2024-10-07 11:33:29.732302] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.793 [2024-10-07 11:33:29.732321] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.793 [2024-10-07 11:33:29.732371] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.793 [2024-10-07 11:33:29.732395] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.793 [2024-10-07 11:33:29.732410] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.793 [2024-10-07 11:33:29.732800] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.793 [2024-10-07 11:33:29.732851] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.793 [2024-10-07 11:33:29.733065] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.793 [2024-10-07 11:33:29.733100] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.793 [2024-10-07 11:33:29.733118] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.793 [2024-10-07 11:33:29.733135] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.793 [2024-10-07 11:33:29.733149] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.793 [2024-10-07 11:33:29.733161] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.793 [2024-10-07 11:33:29.733361] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.793 [2024-10-07 11:33:29.733386] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.793 [2024-10-07 11:33:29.745192] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.793 [2024-10-07 11:33:29.745241] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.793 [2024-10-07 11:33:29.746068] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.793 [2024-10-07 11:33:29.746113] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.793 [2024-10-07 11:33:29.746134] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.793 [2024-10-07 11:33:29.746185] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.793 [2024-10-07 11:33:29.746209] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.793 [2024-10-07 11:33:29.746224] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.793 [2024-10-07 11:33:29.746600] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.793 [2024-10-07 11:33:29.746632] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.793 [2024-10-07 11:33:29.746860] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.793 [2024-10-07 11:33:29.746897] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.793 [2024-10-07 11:33:29.746914] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.793 [2024-10-07 11:33:29.746932] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.793 [2024-10-07 11:33:29.746946] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.793 [2024-10-07 11:33:29.746959] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.793 [2024-10-07 11:33:29.747159] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.793 [2024-10-07 11:33:29.747196] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.793 [2024-10-07 11:33:29.759055] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.793 [2024-10-07 11:33:29.759105] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.793 [2024-10-07 11:33:29.759917] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.793 [2024-10-07 11:33:29.759961] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.793 [2024-10-07 11:33:29.759980] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.793 [2024-10-07 11:33:29.760029] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.793 [2024-10-07 11:33:29.760052] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.793 [2024-10-07 11:33:29.760067] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.793 [2024-10-07 11:33:29.760440] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.793 [2024-10-07 11:33:29.760471] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.793 [2024-10-07 11:33:29.760696] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.793 [2024-10-07 11:33:29.760733] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.793 [2024-10-07 11:33:29.760751] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.793 [2024-10-07 11:33:29.760768] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.793 [2024-10-07 11:33:29.760797] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.793 [2024-10-07 11:33:29.760811] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.793 [2024-10-07 11:33:29.761021] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.793 [2024-10-07 11:33:29.761046] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.793 [2024-10-07 11:33:29.772934] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.793 [2024-10-07 11:33:29.772986] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.793 [2024-10-07 11:33:29.773924] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.793 [2024-10-07 11:33:29.773968] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.793 [2024-10-07 11:33:29.773988] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.793 [2024-10-07 11:33:29.774039] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.793 [2024-10-07 11:33:29.774062] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.793 [2024-10-07 11:33:29.774077] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.793 [2024-10-07 11:33:29.774465] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.793 [2024-10-07 11:33:29.774498] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.793 [2024-10-07 11:33:29.774725] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.793 [2024-10-07 11:33:29.774758] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.793 [2024-10-07 11:33:29.774774] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.793 [2024-10-07 11:33:29.774791] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.793 [2024-10-07 11:33:29.774805] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.793 [2024-10-07 11:33:29.774817] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.793 [2024-10-07 11:33:29.775018] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.793 [2024-10-07 11:33:29.775043] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.793 [2024-10-07 11:33:29.786665] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.793 [2024-10-07 11:33:29.786715] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.793 [2024-10-07 11:33:29.787592] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.793 [2024-10-07 11:33:29.787636] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.793 [2024-10-07 11:33:29.787670] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.793 [2024-10-07 11:33:29.787724] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.793 [2024-10-07 11:33:29.787748] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.793 [2024-10-07 11:33:29.787764] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.793 [2024-10-07 11:33:29.788169] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.793 [2024-10-07 11:33:29.788211] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.794 [2024-10-07 11:33:29.788427] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.794 [2024-10-07 11:33:29.788462] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.794 [2024-10-07 11:33:29.788481] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.794 [2024-10-07 11:33:29.788499] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.794 [2024-10-07 11:33:29.788513] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.794 [2024-10-07 11:33:29.788525] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.794 [2024-10-07 11:33:29.788742] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.794 [2024-10-07 11:33:29.788767] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.794 [2024-10-07 11:33:29.800617] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.794 [2024-10-07 11:33:29.800676] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.794 [2024-10-07 11:33:29.801509] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.794 [2024-10-07 11:33:29.801552] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.794 [2024-10-07 11:33:29.801573] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.794 [2024-10-07 11:33:29.801623] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.794 [2024-10-07 11:33:29.801660] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.794 [2024-10-07 11:33:29.801678] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.794 [2024-10-07 11:33:29.802072] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.794 [2024-10-07 11:33:29.802113] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.794 [2024-10-07 11:33:29.802346] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.794 [2024-10-07 11:33:29.802383] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.794 [2024-10-07 11:33:29.802400] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.794 [2024-10-07 11:33:29.802417] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.794 [2024-10-07 11:33:29.802431] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.794 [2024-10-07 11:33:29.802443] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.794 [2024-10-07 11:33:29.802645] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.794 [2024-10-07 11:33:29.802684] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.794 [2024-10-07 11:33:29.814131] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.794 [2024-10-07 11:33:29.814180] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.794 [2024-10-07 11:33:29.814565] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.794 [2024-10-07 11:33:29.814609] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.794 [2024-10-07 11:33:29.814629] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.794 [2024-10-07 11:33:29.814693] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.794 [2024-10-07 11:33:29.814719] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.794 [2024-10-07 11:33:29.814734] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.794 [2024-10-07 11:33:29.814960] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.794 [2024-10-07 11:33:29.814991] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.794 [2024-10-07 11:33:29.815604] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.794 [2024-10-07 11:33:29.815642] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.794 [2024-10-07 11:33:29.815674] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.794 [2024-10-07 11:33:29.815692] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.794 [2024-10-07 11:33:29.815706] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.794 [2024-10-07 11:33:29.815719] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.794 [2024-10-07 11:33:29.815959] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.794 [2024-10-07 11:33:29.815985] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.794 [2024-10-07 11:33:29.825944] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.794 [2024-10-07 11:33:29.825993] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.794 [2024-10-07 11:33:29.826165] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.794 [2024-10-07 11:33:29.826205] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.794 [2024-10-07 11:33:29.826225] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.794 [2024-10-07 11:33:29.826274] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.794 [2024-10-07 11:33:29.826297] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.794 [2024-10-07 11:33:29.826312] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.794 [2024-10-07 11:33:29.826445] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.794 [2024-10-07 11:33:29.826476] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.794 [2024-10-07 11:33:29.828909] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.794 [2024-10-07 11:33:29.828950] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.794 [2024-10-07 11:33:29.828968] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.794 [2024-10-07 11:33:29.828985] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.794 [2024-10-07 11:33:29.829014] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.794 [2024-10-07 11:33:29.829028] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.794 [2024-10-07 11:33:29.830300] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.794 [2024-10-07 11:33:29.830337] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.794 [2024-10-07 11:33:29.836057] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.794 [2024-10-07 11:33:29.836121] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.794 [2024-10-07 11:33:29.836198] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.794 [2024-10-07 11:33:29.836227] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.794 [2024-10-07 11:33:29.836243] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.794 [2024-10-07 11:33:29.836298] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.794 [2024-10-07 11:33:29.836322] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.794 [2024-10-07 11:33:29.836338] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.794 [2024-10-07 11:33:29.836355] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.794 [2024-10-07 11:33:29.836378] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.794 [2024-10-07 11:33:29.836396] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.794 [2024-10-07 11:33:29.836409] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.794 [2024-10-07 11:33:29.836422] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.794 [2024-10-07 11:33:29.836454] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.794 [2024-10-07 11:33:29.836469] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.794 [2024-10-07 11:33:29.836482] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.794 [2024-10-07 11:33:29.836494] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.794 [2024-10-07 11:33:29.836514] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.794 [2024-10-07 11:33:29.846140] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.794 [2024-10-07 11:33:29.846249] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.794 [2024-10-07 11:33:29.846280] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.794 [2024-10-07 11:33:29.846297] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.794 [2024-10-07 11:33:29.846334] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.794 [2024-10-07 11:33:29.846365] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.795 [2024-10-07 11:33:29.846392] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.795 [2024-10-07 11:33:29.846408] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.795 [2024-10-07 11:33:29.846421] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.795 [2024-10-07 11:33:29.846729] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.795 [2024-10-07 11:33:29.846800] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.795 [2024-10-07 11:33:29.846826] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.795 [2024-10-07 11:33:29.846842] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.795 [2024-10-07 11:33:29.847000] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.795 [2024-10-07 11:33:29.847107] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.795 [2024-10-07 11:33:29.847131] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.795 [2024-10-07 11:33:29.847152] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.795 [2024-10-07 11:33:29.847298] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.795 [2024-10-07 11:33:29.858194] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.795 [2024-10-07 11:33:29.858244] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.795 [2024-10-07 11:33:29.858332] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.795 [2024-10-07 11:33:29.858361] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.795 [2024-10-07 11:33:29.858378] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.795 [2024-10-07 11:33:29.858426] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.795 [2024-10-07 11:33:29.858448] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.795 [2024-10-07 11:33:29.858463] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.795 [2024-10-07 11:33:29.858486] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.795 [2024-10-07 11:33:29.858506] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.795 [2024-10-07 11:33:29.858525] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.795 [2024-10-07 11:33:29.858540] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.795 [2024-10-07 11:33:29.858553] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.795 [2024-10-07 11:33:29.858570] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.795 [2024-10-07 11:33:29.858584] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.795 [2024-10-07 11:33:29.858596] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.795 [2024-10-07 11:33:29.858619] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.795 [2024-10-07 11:33:29.858633] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.795 [2024-10-07 11:33:29.868734] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.795 [2024-10-07 11:33:29.868784] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.795 [2024-10-07 11:33:29.868870] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.795 [2024-10-07 11:33:29.868898] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.795 [2024-10-07 11:33:29.868932] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.795 [2024-10-07 11:33:29.868983] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.795 [2024-10-07 11:33:29.869007] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.795 [2024-10-07 11:33:29.869022] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.795 [2024-10-07 11:33:29.869046] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.795 [2024-10-07 11:33:29.869065] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.795 [2024-10-07 11:33:29.869085] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.795 [2024-10-07 11:33:29.869099] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.795 [2024-10-07 11:33:29.869113] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.795 [2024-10-07 11:33:29.869129] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.795 [2024-10-07 11:33:29.869143] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.795 [2024-10-07 11:33:29.869155] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.795 [2024-10-07 11:33:29.869178] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.795 [2024-10-07 11:33:29.869192] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.795 [2024-10-07 11:33:29.880537] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.795 [2024-10-07 11:33:29.880588] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.795 [2024-10-07 11:33:29.880869] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.795 [2024-10-07 11:33:29.880912] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.795 [2024-10-07 11:33:29.880932] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.795 [2024-10-07 11:33:29.880982] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.795 [2024-10-07 11:33:29.881005] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.795 [2024-10-07 11:33:29.881021] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.795 [2024-10-07 11:33:29.881130] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.795 [2024-10-07 11:33:29.881159] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.795 [2024-10-07 11:33:29.881181] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.795 [2024-10-07 11:33:29.881196] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.795 [2024-10-07 11:33:29.881209] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.795 [2024-10-07 11:33:29.881226] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.795 [2024-10-07 11:33:29.881240] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.795 [2024-10-07 11:33:29.881276] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.795 [2024-10-07 11:33:29.881302] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.795 [2024-10-07 11:33:29.881316] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.795 [2024-10-07 11:33:29.890843] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.795 [2024-10-07 11:33:29.890910] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.795 [2024-10-07 11:33:29.890987] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.795 [2024-10-07 11:33:29.891016] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.795 [2024-10-07 11:33:29.891033] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.795 [2024-10-07 11:33:29.891087] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.795 [2024-10-07 11:33:29.891112] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.795 [2024-10-07 11:33:29.891127] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.795 [2024-10-07 11:33:29.891145] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.795 [2024-10-07 11:33:29.891334] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.795 [2024-10-07 11:33:29.891363] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.795 [2024-10-07 11:33:29.891378] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.795 [2024-10-07 11:33:29.891391] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.795 [2024-10-07 11:33:29.891449] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.795 [2024-10-07 11:33:29.891470] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.795 [2024-10-07 11:33:29.891483] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.795 [2024-10-07 11:33:29.891496] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.795 [2024-10-07 11:33:29.891685] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.795 [2024-10-07 11:33:29.903832] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.795 [2024-10-07 11:33:29.903881] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.795 8939.62 IOPS, 34.92 MiB/s [2024-10-07T11:33:33.318Z] [2024-10-07 11:33:29.907307] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.795 [2024-10-07 11:33:29.907350] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.795 [2024-10-07 11:33:29.907370] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.795 [2024-10-07 11:33:29.907422] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.795 [2024-10-07 11:33:29.907445] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.795 [2024-10-07 11:33:29.907460] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.795 [2024-10-07 11:33:29.908190] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.795 [2024-10-07 11:33:29.908249] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.795 [2024-10-07 11:33:29.908474] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.795 [2024-10-07 11:33:29.908510] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.795 [2024-10-07 11:33:29.908533] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.795 [2024-10-07 11:33:29.908551] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.795 [2024-10-07 11:33:29.908565] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.795 [2024-10-07 11:33:29.908578] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.795 [2024-10-07 11:33:29.908719] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.795 [2024-10-07 11:33:29.908743] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.795 [2024-10-07 11:33:29.918937] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.796 [2024-10-07 11:33:29.918987] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.796 [2024-10-07 11:33:29.919168] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.796 [2024-10-07 11:33:29.919219] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.796 [2024-10-07 11:33:29.919239] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.796 [2024-10-07 11:33:29.919289] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.796 [2024-10-07 11:33:29.919313] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.796 [2024-10-07 11:33:29.919328] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.796 [2024-10-07 11:33:29.919352] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.796 [2024-10-07 11:33:29.919372] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.796 [2024-10-07 11:33:29.919392] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.796 [2024-10-07 11:33:29.919406] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.796 [2024-10-07 11:33:29.919426] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.796 [2024-10-07 11:33:29.919443] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.796 [2024-10-07 11:33:29.919457] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.796 [2024-10-07 11:33:29.919469] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.796 [2024-10-07 11:33:29.919492] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.796 [2024-10-07 11:33:29.919506] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.796 [2024-10-07 11:33:29.929957] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.796 [2024-10-07 11:33:29.930017] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.796 [2024-10-07 11:33:29.930823] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.796 [2024-10-07 11:33:29.930872] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.796 [2024-10-07 11:33:29.930909] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.796 [2024-10-07 11:33:29.930973] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.796 [2024-10-07 11:33:29.930998] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.796 [2024-10-07 11:33:29.931013] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.796 [2024-10-07 11:33:29.933073] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.796 [2024-10-07 11:33:29.933117] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.796 [2024-10-07 11:33:29.933634] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.796 [2024-10-07 11:33:29.933683] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.796 [2024-10-07 11:33:29.933701] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.796 [2024-10-07 11:33:29.933718] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.796 [2024-10-07 11:33:29.933732] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.796 [2024-10-07 11:33:29.933746] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.796 [2024-10-07 11:33:29.933830] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.796 [2024-10-07 11:33:29.933851] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.796 [2024-10-07 11:33:29.942360] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.796 [2024-10-07 11:33:29.942410] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.796 [2024-10-07 11:33:29.942525] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.796 [2024-10-07 11:33:29.942555] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.796 [2024-10-07 11:33:29.942572] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.796 [2024-10-07 11:33:29.942619] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.796 [2024-10-07 11:33:29.942642] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.796 [2024-10-07 11:33:29.942672] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.796 [2024-10-07 11:33:29.942698] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.796 [2024-10-07 11:33:29.942718] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.796 [2024-10-07 11:33:29.942738] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.796 [2024-10-07 11:33:29.942752] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.796 [2024-10-07 11:33:29.942766] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.796 [2024-10-07 11:33:29.942782] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.796 [2024-10-07 11:33:29.942796] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.796 [2024-10-07 11:33:29.942808] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.796 [2024-10-07 11:33:29.942846] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.796 [2024-10-07 11:33:29.942861] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.796 [2024-10-07 11:33:29.952781] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.796 [2024-10-07 11:33:29.952829] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.796 [2024-10-07 11:33:29.954045] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.796 [2024-10-07 11:33:29.954088] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.796 [2024-10-07 11:33:29.954113] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.796 [2024-10-07 11:33:29.954191] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.796 [2024-10-07 11:33:29.954217] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.796 [2024-10-07 11:33:29.954232] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.796 [2024-10-07 11:33:29.956066] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.796 [2024-10-07 11:33:29.956112] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.796 [2024-10-07 11:33:29.956801] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.796 [2024-10-07 11:33:29.956841] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.796 [2024-10-07 11:33:29.956859] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.796 [2024-10-07 11:33:29.956876] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.796 [2024-10-07 11:33:29.956890] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.796 [2024-10-07 11:33:29.956902] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.796 [2024-10-07 11:33:29.957150] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.796 [2024-10-07 11:33:29.957176] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.796 [2024-10-07 11:33:29.964413] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.796 [2024-10-07 11:33:29.964474] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.796 [2024-10-07 11:33:29.964730] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.796 [2024-10-07 11:33:29.964774] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.796 [2024-10-07 11:33:29.964794] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.796 [2024-10-07 11:33:29.964853] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.796 [2024-10-07 11:33:29.964877] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.796 [2024-10-07 11:33:29.964902] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.796 [2024-10-07 11:33:29.965078] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.796 [2024-10-07 11:33:29.965116] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.796 [2024-10-07 11:33:29.965269] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.796 [2024-10-07 11:33:29.965294] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.796 [2024-10-07 11:33:29.965309] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.796 [2024-10-07 11:33:29.965326] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.796 [2024-10-07 11:33:29.965341] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.796 [2024-10-07 11:33:29.965354] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.796 [2024-10-07 11:33:29.965492] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.796 [2024-10-07 11:33:29.965529] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.796 [2024-10-07 11:33:29.974577] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.796 [2024-10-07 11:33:29.974684] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.796 [2024-10-07 11:33:29.974795] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.796 [2024-10-07 11:33:29.974826] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.796 [2024-10-07 11:33:29.974844] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.796 [2024-10-07 11:33:29.974919] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.796 [2024-10-07 11:33:29.974957] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.796 [2024-10-07 11:33:29.974973] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.796 [2024-10-07 11:33:29.974998] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.796 [2024-10-07 11:33:29.975044] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.796 [2024-10-07 11:33:29.975062] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.796 [2024-10-07 11:33:29.975076] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.796 [2024-10-07 11:33:29.975091] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.796 [2024-10-07 11:33:29.975125] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.796 [2024-10-07 11:33:29.975140] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.796 [2024-10-07 11:33:29.975153] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.796 [2024-10-07 11:33:29.975167] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.796 [2024-10-07 11:33:29.975201] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.796 [2024-10-07 11:33:29.985058] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.796 [2024-10-07 11:33:29.985142] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.796 [2024-10-07 11:33:29.985256] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.796 [2024-10-07 11:33:29.985288] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.797 [2024-10-07 11:33:29.985305] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.797 [2024-10-07 11:33:29.985386] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.797 [2024-10-07 11:33:29.985411] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.797 [2024-10-07 11:33:29.985426] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.797 [2024-10-07 11:33:29.985451] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.797 [2024-10-07 11:33:29.985471] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.797 [2024-10-07 11:33:29.985497] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.797 [2024-10-07 11:33:29.985512] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.797 [2024-10-07 11:33:29.985527] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.797 [2024-10-07 11:33:29.985544] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.797 [2024-10-07 11:33:29.985557] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.797 [2024-10-07 11:33:29.985570] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.797 [2024-10-07 11:33:29.985603] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.797 [2024-10-07 11:33:29.985618] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.797 [2024-10-07 11:33:29.995258] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.797 [2024-10-07 11:33:29.995353] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.797 [2024-10-07 11:33:29.995464] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.797 [2024-10-07 11:33:29.995496] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.797 [2024-10-07 11:33:29.995513] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.797 [2024-10-07 11:33:29.995584] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.797 [2024-10-07 11:33:29.995616] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.797 [2024-10-07 11:33:29.995631] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.797 [2024-10-07 11:33:29.995663] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.797 [2024-10-07 11:33:29.995692] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.797 [2024-10-07 11:33:29.995711] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.797 [2024-10-07 11:33:29.995726] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.797 [2024-10-07 11:33:29.995740] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.797 [2024-10-07 11:33:29.995765] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.797 [2024-10-07 11:33:29.995780] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.797 [2024-10-07 11:33:29.995793] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.797 [2024-10-07 11:33:29.995806] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.797 [2024-10-07 11:33:29.995857] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.797 [2024-10-07 11:33:30.009539] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.797 [2024-10-07 11:33:30.009644] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.797 [2024-10-07 11:33:30.010672] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.797 [2024-10-07 11:33:30.010720] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.797 [2024-10-07 11:33:30.010742] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.797 [2024-10-07 11:33:30.010797] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.797 [2024-10-07 11:33:30.010821] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.797 [2024-10-07 11:33:30.010837] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.797 [2024-10-07 11:33:30.011246] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.797 [2024-10-07 11:33:30.011279] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.797 [2024-10-07 11:33:30.011492] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.797 [2024-10-07 11:33:30.011528] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.797 [2024-10-07 11:33:30.011548] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.797 [2024-10-07 11:33:30.011567] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.797 [2024-10-07 11:33:30.011582] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.797 [2024-10-07 11:33:30.011596] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.797 [2024-10-07 11:33:30.011818] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.797 [2024-10-07 11:33:30.011844] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.797 [2024-10-07 11:33:30.020027] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.797 [2024-10-07 11:33:30.020081] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.797 [2024-10-07 11:33:30.020271] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.797 [2024-10-07 11:33:30.020312] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.797 [2024-10-07 11:33:30.020332] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.797 [2024-10-07 11:33:30.020382] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.797 [2024-10-07 11:33:30.020406] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.797 [2024-10-07 11:33:30.020422] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.797 [2024-10-07 11:33:30.020535] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.797 [2024-10-07 11:33:30.020561] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.797 [2024-10-07 11:33:30.020686] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.797 [2024-10-07 11:33:30.020753] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.797 [2024-10-07 11:33:30.020769] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.797 [2024-10-07 11:33:30.020786] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.797 [2024-10-07 11:33:30.020800] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.797 [2024-10-07 11:33:30.020813] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.797 [2024-10-07 11:33:30.021353] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.797 [2024-10-07 11:33:30.021392] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.797 [2024-10-07 11:33:30.030283] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.797 [2024-10-07 11:33:30.030370] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.797 [2024-10-07 11:33:30.030490] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.797 [2024-10-07 11:33:30.030523] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.797 [2024-10-07 11:33:30.030541] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.797 [2024-10-07 11:33:30.030590] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.797 [2024-10-07 11:33:30.030613] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.797 [2024-10-07 11:33:30.030629] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.797 [2024-10-07 11:33:30.030671] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.797 [2024-10-07 11:33:30.030694] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.797 [2024-10-07 11:33:30.030715] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.797 [2024-10-07 11:33:30.030730] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.797 [2024-10-07 11:33:30.030746] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.797 [2024-10-07 11:33:30.030763] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.797 [2024-10-07 11:33:30.030777] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.797 [2024-10-07 11:33:30.030790] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.797 [2024-10-07 11:33:30.030823] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.797 [2024-10-07 11:33:30.030838] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.797 [2024-10-07 11:33:30.040905] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.797 [2024-10-07 11:33:30.040987] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.797 [2024-10-07 11:33:30.041193] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.797 [2024-10-07 11:33:30.041236] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.797 [2024-10-07 11:33:30.041257] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.797 [2024-10-07 11:33:30.041309] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.797 [2024-10-07 11:33:30.041366] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.797 [2024-10-07 11:33:30.041384] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.797 [2024-10-07 11:33:30.041847] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.798 [2024-10-07 11:33:30.041888] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.798 [2024-10-07 11:33:30.042059] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.798 [2024-10-07 11:33:30.042085] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.798 [2024-10-07 11:33:30.042101] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.798 [2024-10-07 11:33:30.042120] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.798 [2024-10-07 11:33:30.042135] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.798 [2024-10-07 11:33:30.042148] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.798 [2024-10-07 11:33:30.042293] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.798 [2024-10-07 11:33:30.042317] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.798 [2024-10-07 11:33:30.051461] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.798 [2024-10-07 11:33:30.051552] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.798 [2024-10-07 11:33:30.051798] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.798 [2024-10-07 11:33:30.051843] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.798 [2024-10-07 11:33:30.051867] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.798 [2024-10-07 11:33:30.051917] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.798 [2024-10-07 11:33:30.051940] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.798 [2024-10-07 11:33:30.051956] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.798 [2024-10-07 11:33:30.052095] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.798 [2024-10-07 11:33:30.052134] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.798 [2024-10-07 11:33:30.052551] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.798 [2024-10-07 11:33:30.052587] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.798 [2024-10-07 11:33:30.052607] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.798 [2024-10-07 11:33:30.052626] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.798 [2024-10-07 11:33:30.052640] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.798 [2024-10-07 11:33:30.052668] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.798 [2024-10-07 11:33:30.052823] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.798 [2024-10-07 11:33:30.052848] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.798 [2024-10-07 11:33:30.062481] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.798 [2024-10-07 11:33:30.062576] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.798 [2024-10-07 11:33:30.062717] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.798 [2024-10-07 11:33:30.062752] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.798 [2024-10-07 11:33:30.062775] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.798 [2024-10-07 11:33:30.062842] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.798 [2024-10-07 11:33:30.062866] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.798 [2024-10-07 11:33:30.062881] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.798 [2024-10-07 11:33:30.062907] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.798 [2024-10-07 11:33:30.062929] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.798 [2024-10-07 11:33:30.062949] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.798 [2024-10-07 11:33:30.062964] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.798 [2024-10-07 11:33:30.062979] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.798 [2024-10-07 11:33:30.062996] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.798 [2024-10-07 11:33:30.063010] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.798 [2024-10-07 11:33:30.063024] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.798 [2024-10-07 11:33:30.063047] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.798 [2024-10-07 11:33:30.063062] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.798 [2024-10-07 11:33:30.074956] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.798 [2024-10-07 11:33:30.075045] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.798 [2024-10-07 11:33:30.075231] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.798 [2024-10-07 11:33:30.075269] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.798 [2024-10-07 11:33:30.075303] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.798 [2024-10-07 11:33:30.075371] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.798 [2024-10-07 11:33:30.075396] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.798 [2024-10-07 11:33:30.075412] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.798 [2024-10-07 11:33:30.075439] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.798 [2024-10-07 11:33:30.075461] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.798 [2024-10-07 11:33:30.075481] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.798 [2024-10-07 11:33:30.075497] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.798 [2024-10-07 11:33:30.075554] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.798 [2024-10-07 11:33:30.075578] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.798 [2024-10-07 11:33:30.075593] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.798 [2024-10-07 11:33:30.075606] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.798 [2024-10-07 11:33:30.075639] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.798 [2024-10-07 11:33:30.075673] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.798 [2024-10-07 11:33:30.085754] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.798 [2024-10-07 11:33:30.085838] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.798 [2024-10-07 11:33:30.085974] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.798 [2024-10-07 11:33:30.086007] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.798 [2024-10-07 11:33:30.086025] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.798 [2024-10-07 11:33:30.086074] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.798 [2024-10-07 11:33:30.086097] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.798 [2024-10-07 11:33:30.086112] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.798 [2024-10-07 11:33:30.086139] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.798 [2024-10-07 11:33:30.086160] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.798 [2024-10-07 11:33:30.086181] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.798 [2024-10-07 11:33:30.086198] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.798 [2024-10-07 11:33:30.086213] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.798 [2024-10-07 11:33:30.086230] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.798 [2024-10-07 11:33:30.086245] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.798 [2024-10-07 11:33:30.086267] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.798 [2024-10-07 11:33:30.086291] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.798 [2024-10-07 11:33:30.086307] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.798 [2024-10-07 11:33:30.098987] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.798 [2024-10-07 11:33:30.099075] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.798 [2024-10-07 11:33:30.099420] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.798 [2024-10-07 11:33:30.099461] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.798 [2024-10-07 11:33:30.099480] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.798 [2024-10-07 11:33:30.099531] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.798 [2024-10-07 11:33:30.099559] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.798 [2024-10-07 11:33:30.099606] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.798 [2024-10-07 11:33:30.099738] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.798 [2024-10-07 11:33:30.099766] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.798 [2024-10-07 11:33:30.099866] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.798 [2024-10-07 11:33:30.099908] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.798 [2024-10-07 11:33:30.099925] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.798 [2024-10-07 11:33:30.099943] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.798 [2024-10-07 11:33:30.099958] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.798 [2024-10-07 11:33:30.099971] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.798 [2024-10-07 11:33:30.100074] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.798 [2024-10-07 11:33:30.100095] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.798 [2024-10-07 11:33:30.109781] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.798 [2024-10-07 11:33:30.109858] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.798 [2024-10-07 11:33:30.110053] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.798 [2024-10-07 11:33:30.110087] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.798 [2024-10-07 11:33:30.110105] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.798 [2024-10-07 11:33:30.110155] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.798 [2024-10-07 11:33:30.110178] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.798 [2024-10-07 11:33:30.110194] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.798 [2024-10-07 11:33:30.110355] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.798 [2024-10-07 11:33:30.110386] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.798 [2024-10-07 11:33:30.110436] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.798 [2024-10-07 11:33:30.110463] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.798 [2024-10-07 11:33:30.110480] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.798 [2024-10-07 11:33:30.110497] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.799 [2024-10-07 11:33:30.110511] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.799 [2024-10-07 11:33:30.110525] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.799 [2024-10-07 11:33:30.110552] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.799 [2024-10-07 11:33:30.110567] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.799 [2024-10-07 11:33:30.121019] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.799 [2024-10-07 11:33:30.121110] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.799 [2024-10-07 11:33:30.121357] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.799 [2024-10-07 11:33:30.121390] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.799 [2024-10-07 11:33:30.121409] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.799 [2024-10-07 11:33:30.121458] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.799 [2024-10-07 11:33:30.121480] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.799 [2024-10-07 11:33:30.121496] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.799 [2024-10-07 11:33:30.121640] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.799 [2024-10-07 11:33:30.121685] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.799 [2024-10-07 11:33:30.121842] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.799 [2024-10-07 11:33:30.121866] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.799 [2024-10-07 11:33:30.121881] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.799 [2024-10-07 11:33:30.121899] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.799 [2024-10-07 11:33:30.121913] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.799 [2024-10-07 11:33:30.121927] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.799 [2024-10-07 11:33:30.122060] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.799 [2024-10-07 11:33:30.122083] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.799 [2024-10-07 11:33:30.131208] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.799 [2024-10-07 11:33:30.131296] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.799 [2024-10-07 11:33:30.131388] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.799 [2024-10-07 11:33:30.131420] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.799 [2024-10-07 11:33:30.131438] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.799 [2024-10-07 11:33:30.131494] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.799 [2024-10-07 11:33:30.131526] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.799 [2024-10-07 11:33:30.131547] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.799 [2024-10-07 11:33:30.131565] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.799 [2024-10-07 11:33:30.131589] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.799 [2024-10-07 11:33:30.131608] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.799 [2024-10-07 11:33:30.131622] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.799 [2024-10-07 11:33:30.131637] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.799 [2024-10-07 11:33:30.131742] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.799 [2024-10-07 11:33:30.131761] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.799 [2024-10-07 11:33:30.131774] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.799 [2024-10-07 11:33:30.131787] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.799 [2024-10-07 11:33:30.131809] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.799 [2024-10-07 11:33:30.145553] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.799 [2024-10-07 11:33:30.145623] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.799 [2024-10-07 11:33:30.145778] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.799 [2024-10-07 11:33:30.145810] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.799 [2024-10-07 11:33:30.145828] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.799 [2024-10-07 11:33:30.145885] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.799 [2024-10-07 11:33:30.145908] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.799 [2024-10-07 11:33:30.145924] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.799 [2024-10-07 11:33:30.145949] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.799 [2024-10-07 11:33:30.145969] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.799 [2024-10-07 11:33:30.145990] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.799 [2024-10-07 11:33:30.146004] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.799 [2024-10-07 11:33:30.146019] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.799 [2024-10-07 11:33:30.146035] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.799 [2024-10-07 11:33:30.146050] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.799 [2024-10-07 11:33:30.146062] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.799 [2024-10-07 11:33:30.146085] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.799 [2024-10-07 11:33:30.146100] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.799 [2024-10-07 11:33:30.159508] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.799 [2024-10-07 11:33:30.159558] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.799 [2024-10-07 11:33:30.159660] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.799 [2024-10-07 11:33:30.159691] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.799 [2024-10-07 11:33:30.159708] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.799 [2024-10-07 11:33:30.159756] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.799 [2024-10-07 11:33:30.159781] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.799 [2024-10-07 11:33:30.159824] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.799 [2024-10-07 11:33:30.159851] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.799 [2024-10-07 11:33:30.159872] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.799 [2024-10-07 11:33:30.159892] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.799 [2024-10-07 11:33:30.159907] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.799 [2024-10-07 11:33:30.159920] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.799 [2024-10-07 11:33:30.159936] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.799 [2024-10-07 11:33:30.159951] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.799 [2024-10-07 11:33:30.159964] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.799 [2024-10-07 11:33:30.159987] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.799 [2024-10-07 11:33:30.160001] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.799 [2024-10-07 11:33:30.174019] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.799 [2024-10-07 11:33:30.174109] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.799 [2024-10-07 11:33:30.174229] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.799 [2024-10-07 11:33:30.174261] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.799 [2024-10-07 11:33:30.174280] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.799 [2024-10-07 11:33:30.174329] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.799 [2024-10-07 11:33:30.174352] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.799 [2024-10-07 11:33:30.174367] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.799 [2024-10-07 11:33:30.174392] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.799 [2024-10-07 11:33:30.174413] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.799 [2024-10-07 11:33:30.174433] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.799 [2024-10-07 11:33:30.174449] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.799 [2024-10-07 11:33:30.174464] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.799 [2024-10-07 11:33:30.174481] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.799 [2024-10-07 11:33:30.174496] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.799 [2024-10-07 11:33:30.174510] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.799 [2024-10-07 11:33:30.174532] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.799 [2024-10-07 11:33:30.174548] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.799 [2024-10-07 11:33:30.188208] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.799 [2024-10-07 11:33:30.188282] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.799 [2024-10-07 11:33:30.188811] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.799 [2024-10-07 11:33:30.188861] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.799 [2024-10-07 11:33:30.188894] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.799 [2024-10-07 11:33:30.188945] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.799 [2024-10-07 11:33:30.188968] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.799 [2024-10-07 11:33:30.188983] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.799 [2024-10-07 11:33:30.190219] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.799 [2024-10-07 11:33:30.190265] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.799 [2024-10-07 11:33:30.190835] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.799 [2024-10-07 11:33:30.190881] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.799 [2024-10-07 11:33:30.190901] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.799 [2024-10-07 11:33:30.190919] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.799 [2024-10-07 11:33:30.190933] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.799 [2024-10-07 11:33:30.190955] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.799 [2024-10-07 11:33:30.191205] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.799 [2024-10-07 11:33:30.191232] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.799 [2024-10-07 11:33:30.199014] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.799 [2024-10-07 11:33:30.199063] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.800 [2024-10-07 11:33:30.199290] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.800 [2024-10-07 11:33:30.199322] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.800 [2024-10-07 11:33:30.199339] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.800 [2024-10-07 11:33:30.199387] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.800 [2024-10-07 11:33:30.199410] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.800 [2024-10-07 11:33:30.199425] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.800 [2024-10-07 11:33:30.199559] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.800 [2024-10-07 11:33:30.199588] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.800 [2024-10-07 11:33:30.199753] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.800 [2024-10-07 11:33:30.199776] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.800 [2024-10-07 11:33:30.199791] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.800 [2024-10-07 11:33:30.199808] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.800 [2024-10-07 11:33:30.199837] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.800 [2024-10-07 11:33:30.199851] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.800 [2024-10-07 11:33:30.199962] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.800 [2024-10-07 11:33:30.199981] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.800 [2024-10-07 11:33:30.209145] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.800 [2024-10-07 11:33:30.209259] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.800 [2024-10-07 11:33:30.209371] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.800 [2024-10-07 11:33:30.209402] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.800 [2024-10-07 11:33:30.209419] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.800 [2024-10-07 11:33:30.209474] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.800 [2024-10-07 11:33:30.209498] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.800 [2024-10-07 11:33:30.209514] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.800 [2024-10-07 11:33:30.209532] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.800 [2024-10-07 11:33:30.209556] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.800 [2024-10-07 11:33:30.209574] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.800 [2024-10-07 11:33:30.209588] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.800 [2024-10-07 11:33:30.209603] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.800 [2024-10-07 11:33:30.209627] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.800 [2024-10-07 11:33:30.209645] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.800 [2024-10-07 11:33:30.209658] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.800 [2024-10-07 11:33:30.209687] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.800 [2024-10-07 11:33:30.209710] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.800 [2024-10-07 11:33:30.219880] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.800 [2024-10-07 11:33:30.219959] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.800 [2024-10-07 11:33:30.220079] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.800 [2024-10-07 11:33:30.220122] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.800 [2024-10-07 11:33:30.220140] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.800 [2024-10-07 11:33:30.220188] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.800 [2024-10-07 11:33:30.220211] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.800 [2024-10-07 11:33:30.220226] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.800 [2024-10-07 11:33:30.220279] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.800 [2024-10-07 11:33:30.220300] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.800 [2024-10-07 11:33:30.220320] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.800 [2024-10-07 11:33:30.220336] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.800 [2024-10-07 11:33:30.220359] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.800 [2024-10-07 11:33:30.220376] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.800 [2024-10-07 11:33:30.220391] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.800 [2024-10-07 11:33:30.220404] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.800 [2024-10-07 11:33:30.220427] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.800 [2024-10-07 11:33:30.220441] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.800 [2024-10-07 11:33:30.230301] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.800 [2024-10-07 11:33:30.230352] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.800 [2024-10-07 11:33:30.230530] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.800 [2024-10-07 11:33:30.230561] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.800 [2024-10-07 11:33:30.230578] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.800 [2024-10-07 11:33:30.230626] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.800 [2024-10-07 11:33:30.230665] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.800 [2024-10-07 11:33:30.230684] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.800 [2024-10-07 11:33:30.231141] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.800 [2024-10-07 11:33:30.231194] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.800 [2024-10-07 11:33:30.232950] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.800 [2024-10-07 11:33:30.232991] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.800 [2024-10-07 11:33:30.233009] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.800 [2024-10-07 11:33:30.233027] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.800 [2024-10-07 11:33:30.233041] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.800 [2024-10-07 11:33:30.233054] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.800 [2024-10-07 11:33:30.233673] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.800 [2024-10-07 11:33:30.233709] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.800 [2024-10-07 11:33:30.242462] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.800 [2024-10-07 11:33:30.242510] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.800 [2024-10-07 11:33:30.242626] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.800 [2024-10-07 11:33:30.242689] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.800 [2024-10-07 11:33:30.242709] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.800 [2024-10-07 11:33:30.242763] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.800 [2024-10-07 11:33:30.242787] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.800 [2024-10-07 11:33:30.242802] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.800 [2024-10-07 11:33:30.245014] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.800 [2024-10-07 11:33:30.245060] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.800 [2024-10-07 11:33:30.245173] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.800 [2024-10-07 11:33:30.245202] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.800 [2024-10-07 11:33:30.245216] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.800 [2024-10-07 11:33:30.245234] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.800 [2024-10-07 11:33:30.245248] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.800 [2024-10-07 11:33:30.245261] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.800 [2024-10-07 11:33:30.245499] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.800 [2024-10-07 11:33:30.245525] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.800 [2024-10-07 11:33:30.252575] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.800 [2024-10-07 11:33:30.252638] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.800 [2024-10-07 11:33:30.252735] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.800 [2024-10-07 11:33:30.252764] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.800 [2024-10-07 11:33:30.252781] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.800 [2024-10-07 11:33:30.252836] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.800 [2024-10-07 11:33:30.252861] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.800 [2024-10-07 11:33:30.252877] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.800 [2024-10-07 11:33:30.252894] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.800 [2024-10-07 11:33:30.252917] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.800 [2024-10-07 11:33:30.252935] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.800 [2024-10-07 11:33:30.252948] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.800 [2024-10-07 11:33:30.252961] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.800 [2024-10-07 11:33:30.252984] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.800 [2024-10-07 11:33:30.252999] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.800 [2024-10-07 11:33:30.253028] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.800 [2024-10-07 11:33:30.253042] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.800 [2024-10-07 11:33:30.253064] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.800 [2024-10-07 11:33:30.264857] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.800 [2024-10-07 11:33:30.264906] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.800 [2024-10-07 11:33:30.264993] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.800 [2024-10-07 11:33:30.265023] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.800 [2024-10-07 11:33:30.265039] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.800 [2024-10-07 11:33:30.265086] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.800 [2024-10-07 11:33:30.265109] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.800 [2024-10-07 11:33:30.265125] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.801 [2024-10-07 11:33:30.265148] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.801 [2024-10-07 11:33:30.265167] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.801 [2024-10-07 11:33:30.265187] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.801 [2024-10-07 11:33:30.265202] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.801 [2024-10-07 11:33:30.265215] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.801 [2024-10-07 11:33:30.265230] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.801 [2024-10-07 11:33:30.265245] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.801 [2024-10-07 11:33:30.265257] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.801 [2024-10-07 11:33:30.265280] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.801 [2024-10-07 11:33:30.265294] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.801 [2024-10-07 11:33:30.278439] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.801 [2024-10-07 11:33:30.278503] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.801 [2024-10-07 11:33:30.278591] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.801 [2024-10-07 11:33:30.278621] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.801 [2024-10-07 11:33:30.278637] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.801 [2024-10-07 11:33:30.278705] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.801 [2024-10-07 11:33:30.278730] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.801 [2024-10-07 11:33:30.278746] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.801 [2024-10-07 11:33:30.278770] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.801 [2024-10-07 11:33:30.278807] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.801 [2024-10-07 11:33:30.278829] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.801 [2024-10-07 11:33:30.278843] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.801 [2024-10-07 11:33:30.278857] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.801 [2024-10-07 11:33:30.278873] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.801 [2024-10-07 11:33:30.278888] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.801 [2024-10-07 11:33:30.278900] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.801 [2024-10-07 11:33:30.278922] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.801 [2024-10-07 11:33:30.278937] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.801 [2024-10-07 11:33:30.289308] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.801 [2024-10-07 11:33:30.289357] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.801 [2024-10-07 11:33:30.289859] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.801 [2024-10-07 11:33:30.289903] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.801 [2024-10-07 11:33:30.289923] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.801 [2024-10-07 11:33:30.289974] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.801 [2024-10-07 11:33:30.289997] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.801 [2024-10-07 11:33:30.290012] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.801 [2024-10-07 11:33:30.292515] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.801 [2024-10-07 11:33:30.292560] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.801 [2024-10-07 11:33:30.293393] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.801 [2024-10-07 11:33:30.293431] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.801 [2024-10-07 11:33:30.293449] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.801 [2024-10-07 11:33:30.293466] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.801 [2024-10-07 11:33:30.293480] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.801 [2024-10-07 11:33:30.293493] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.801 [2024-10-07 11:33:30.293684] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.801 [2024-10-07 11:33:30.293708] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.801 [2024-10-07 11:33:30.301030] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.801 [2024-10-07 11:33:30.301082] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.801 [2024-10-07 11:33:30.303447] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.801 [2024-10-07 11:33:30.303493] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.801 [2024-10-07 11:33:30.303533] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.801 [2024-10-07 11:33:30.303586] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.801 [2024-10-07 11:33:30.303610] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.801 [2024-10-07 11:33:30.303626] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.801 [2024-10-07 11:33:30.303910] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.801 [2024-10-07 11:33:30.303943] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.801 [2024-10-07 11:33:30.304136] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.801 [2024-10-07 11:33:30.304163] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.801 [2024-10-07 11:33:30.304178] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.801 [2024-10-07 11:33:30.304196] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.801 [2024-10-07 11:33:30.304211] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.801 [2024-10-07 11:33:30.304224] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.801 [2024-10-07 11:33:30.304345] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.801 [2024-10-07 11:33:30.304368] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.801 [2024-10-07 11:33:30.312725] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.801 [2024-10-07 11:33:30.312773] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.801 [2024-10-07 11:33:30.312861] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.801 [2024-10-07 11:33:30.312890] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.801 [2024-10-07 11:33:30.312907] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.801 [2024-10-07 11:33:30.312954] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.801 [2024-10-07 11:33:30.312976] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.802 [2024-10-07 11:33:30.312991] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.802 [2024-10-07 11:33:30.313014] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.802 [2024-10-07 11:33:30.313034] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.802 [2024-10-07 11:33:30.313054] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.802 [2024-10-07 11:33:30.313068] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.802 [2024-10-07 11:33:30.313082] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.802 [2024-10-07 11:33:30.313098] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.802 [2024-10-07 11:33:30.313112] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.802 [2024-10-07 11:33:30.313141] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.802 [2024-10-07 11:33:30.313166] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.802 [2024-10-07 11:33:30.313181] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.802 [2024-10-07 11:33:30.323119] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.802 [2024-10-07 11:33:30.323194] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.802 [2024-10-07 11:33:30.323334] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.802 [2024-10-07 11:33:30.323375] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.802 [2024-10-07 11:33:30.323396] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.802 [2024-10-07 11:33:30.323447] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.802 [2024-10-07 11:33:30.323471] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.802 [2024-10-07 11:33:30.323486] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.802 [2024-10-07 11:33:30.323511] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.802 [2024-10-07 11:33:30.323534] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.802 [2024-10-07 11:33:30.323554] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.802 [2024-10-07 11:33:30.323569] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.802 [2024-10-07 11:33:30.323582] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.802 [2024-10-07 11:33:30.323598] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.802 [2024-10-07 11:33:30.323612] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.802 [2024-10-07 11:33:30.323625] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.802 [2024-10-07 11:33:30.323662] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.802 [2024-10-07 11:33:30.323680] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.802 [2024-10-07 11:33:30.337461] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.802 [2024-10-07 11:33:30.337518] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.802 [2024-10-07 11:33:30.337712] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.802 [2024-10-07 11:33:30.337744] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.802 [2024-10-07 11:33:30.337761] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.802 [2024-10-07 11:33:30.337810] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.802 [2024-10-07 11:33:30.337833] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.802 [2024-10-07 11:33:30.337848] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.802 [2024-10-07 11:33:30.337873] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.802 [2024-10-07 11:33:30.337894] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.802 [2024-10-07 11:33:30.337941] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.802 [2024-10-07 11:33:30.337958] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.802 [2024-10-07 11:33:30.337972] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.802 [2024-10-07 11:33:30.337989] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.802 [2024-10-07 11:33:30.338003] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.802 [2024-10-07 11:33:30.338016] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.802 [2024-10-07 11:33:30.338039] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.802 [2024-10-07 11:33:30.338054] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.802 [2024-10-07 11:33:30.351583] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.802 [2024-10-07 11:33:30.351637] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.802 [2024-10-07 11:33:30.351744] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.802 [2024-10-07 11:33:30.351773] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.802 [2024-10-07 11:33:30.351789] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.802 [2024-10-07 11:33:30.351837] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.802 [2024-10-07 11:33:30.351860] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.802 [2024-10-07 11:33:30.351875] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.802 [2024-10-07 11:33:30.351897] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.802 [2024-10-07 11:33:30.351918] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.802 [2024-10-07 11:33:30.351937] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.802 [2024-10-07 11:33:30.351952] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.802 [2024-10-07 11:33:30.351966] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.802 [2024-10-07 11:33:30.351982] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.802 [2024-10-07 11:33:30.351996] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.802 [2024-10-07 11:33:30.352008] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.802 [2024-10-07 11:33:30.352031] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.802 [2024-10-07 11:33:30.352045] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.802 [2024-10-07 11:33:30.363245] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.802 [2024-10-07 11:33:30.363296] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.802 [2024-10-07 11:33:30.363497] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.802 [2024-10-07 11:33:30.363529] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.802 [2024-10-07 11:33:30.363565] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.802 [2024-10-07 11:33:30.363619] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.802 [2024-10-07 11:33:30.363643] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.802 [2024-10-07 11:33:30.363675] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.802 [2024-10-07 11:33:30.363827] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.802 [2024-10-07 11:33:30.363855] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.802 [2024-10-07 11:33:30.363981] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.802 [2024-10-07 11:33:30.364004] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.802 [2024-10-07 11:33:30.364019] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.802 [2024-10-07 11:33:30.364036] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.802 [2024-10-07 11:33:30.364050] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.802 [2024-10-07 11:33:30.364063] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.802 [2024-10-07 11:33:30.364194] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.802 [2024-10-07 11:33:30.364217] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.802 [2024-10-07 11:33:30.374024] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.803 [2024-10-07 11:33:30.374077] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.803 [2024-10-07 11:33:30.374189] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.803 [2024-10-07 11:33:30.374229] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.803 [2024-10-07 11:33:30.374248] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.803 [2024-10-07 11:33:30.374296] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.803 [2024-10-07 11:33:30.374320] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.803 [2024-10-07 11:33:30.374335] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.803 [2024-10-07 11:33:30.374359] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.803 [2024-10-07 11:33:30.374379] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.803 [2024-10-07 11:33:30.374399] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.803 [2024-10-07 11:33:30.374414] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.803 [2024-10-07 11:33:30.374427] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.803 [2024-10-07 11:33:30.374443] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.803 [2024-10-07 11:33:30.374457] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.803 [2024-10-07 11:33:30.374470] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.803 [2024-10-07 11:33:30.374517] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.803 [2024-10-07 11:33:30.374534] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.803 [2024-10-07 11:33:30.386644] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.803 [2024-10-07 11:33:30.386712] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.803 [2024-10-07 11:33:30.386920] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.803 [2024-10-07 11:33:30.386953] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.803 [2024-10-07 11:33:30.386971] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.803 [2024-10-07 11:33:30.387022] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.803 [2024-10-07 11:33:30.387045] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.803 [2024-10-07 11:33:30.387060] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.803 [2024-10-07 11:33:30.387085] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.803 [2024-10-07 11:33:30.387105] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.803 [2024-10-07 11:33:30.387124] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.803 [2024-10-07 11:33:30.387139] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.803 [2024-10-07 11:33:30.387152] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.803 [2024-10-07 11:33:30.387169] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.803 [2024-10-07 11:33:30.387196] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.803 [2024-10-07 11:33:30.387211] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.803 [2024-10-07 11:33:30.387235] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.803 [2024-10-07 11:33:30.387250] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.803 [2024-10-07 11:33:30.398100] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.803 [2024-10-07 11:33:30.398151] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.803 [2024-10-07 11:33:30.398240] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.803 [2024-10-07 11:33:30.398270] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.803 [2024-10-07 11:33:30.398286] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.803 [2024-10-07 11:33:30.398333] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.803 [2024-10-07 11:33:30.398356] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.803 [2024-10-07 11:33:30.398371] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.803 [2024-10-07 11:33:30.398644] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.803 [2024-10-07 11:33:30.398691] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.803 [2024-10-07 11:33:30.398883] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.803 [2024-10-07 11:33:30.398930] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.803 [2024-10-07 11:33:30.398946] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.803 [2024-10-07 11:33:30.398963] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.803 [2024-10-07 11:33:30.398978] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.803 [2024-10-07 11:33:30.398991] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.803 [2024-10-07 11:33:30.399126] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.803 [2024-10-07 11:33:30.399148] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.803 [2024-10-07 11:33:30.408216] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.803 [2024-10-07 11:33:30.408281] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.803 [2024-10-07 11:33:30.408358] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.803 [2024-10-07 11:33:30.408388] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.803 [2024-10-07 11:33:30.408404] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.803 [2024-10-07 11:33:30.408459] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.803 [2024-10-07 11:33:30.408483] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.803 [2024-10-07 11:33:30.408498] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.803 [2024-10-07 11:33:30.408516] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.803 [2024-10-07 11:33:30.408540] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.803 [2024-10-07 11:33:30.408558] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.803 [2024-10-07 11:33:30.408571] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.803 [2024-10-07 11:33:30.408584] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.803 [2024-10-07 11:33:30.408607] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.803 [2024-10-07 11:33:30.408622] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.803 [2024-10-07 11:33:30.408635] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.803 [2024-10-07 11:33:30.408662] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.803 [2024-10-07 11:33:30.408687] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.803 [2024-10-07 11:33:30.419597] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.803 [2024-10-07 11:33:30.419662] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.803 [2024-10-07 11:33:30.419904] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.803 [2024-10-07 11:33:30.419948] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.803 [2024-10-07 11:33:30.419968] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.803 [2024-10-07 11:33:30.420036] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.803 [2024-10-07 11:33:30.420061] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.803 [2024-10-07 11:33:30.420076] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.803 [2024-10-07 11:33:30.420205] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.803 [2024-10-07 11:33:30.420234] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.803 [2024-10-07 11:33:30.420584] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.804 [2024-10-07 11:33:30.420619] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.804 [2024-10-07 11:33:30.420637] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.804 [2024-10-07 11:33:30.420669] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.804 [2024-10-07 11:33:30.420686] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.804 [2024-10-07 11:33:30.420699] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.804 [2024-10-07 11:33:30.422562] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.804 [2024-10-07 11:33:30.422599] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.804 [2024-10-07 11:33:30.429729] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.804 [2024-10-07 11:33:30.431896] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.804 [2024-10-07 11:33:30.431992] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.804 [2024-10-07 11:33:30.432022] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.804 [2024-10-07 11:33:30.432038] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.804 [2024-10-07 11:33:30.432788] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.804 [2024-10-07 11:33:30.432830] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.804 [2024-10-07 11:33:30.432849] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.804 [2024-10-07 11:33:30.432868] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.804 [2024-10-07 11:33:30.432966] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.804 [2024-10-07 11:33:30.432991] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.804 [2024-10-07 11:33:30.433004] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.804 [2024-10-07 11:33:30.433018] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.804 [2024-10-07 11:33:30.433043] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.804 [2024-10-07 11:33:30.433058] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.804 [2024-10-07 11:33:30.433070] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.804 [2024-10-07 11:33:30.433083] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.804 [2024-10-07 11:33:30.433118] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.804 [2024-10-07 11:33:30.439813] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.804 [2024-10-07 11:33:30.439946] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.804 [2024-10-07 11:33:30.439986] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.804 [2024-10-07 11:33:30.440003] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.804 [2024-10-07 11:33:30.440026] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.804 [2024-10-07 11:33:30.440049] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.804 [2024-10-07 11:33:30.440063] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.804 [2024-10-07 11:33:30.440077] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.804 [2024-10-07 11:33:30.440101] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.804 [2024-10-07 11:33:30.445274] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.804 [2024-10-07 11:33:30.445593] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.804 [2024-10-07 11:33:30.445636] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.804 [2024-10-07 11:33:30.445670] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.804 [2024-10-07 11:33:30.447856] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.804 [2024-10-07 11:33:30.447978] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.804 [2024-10-07 11:33:30.448003] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.804 [2024-10-07 11:33:30.448017] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.804 [2024-10-07 11:33:30.448042] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.804 [2024-10-07 11:33:30.453894] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.804 [2024-10-07 11:33:30.454236] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.804 [2024-10-07 11:33:30.454280] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.804 [2024-10-07 11:33:30.454300] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.804 [2024-10-07 11:33:30.454955] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.804 [2024-10-07 11:33:30.455374] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.804 [2024-10-07 11:33:30.455410] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.804 [2024-10-07 11:33:30.455428] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.804 [2024-10-07 11:33:30.455695] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.804 [2024-10-07 11:33:30.455778] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.804 [2024-10-07 11:33:30.455870] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.804 [2024-10-07 11:33:30.455904] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.804 [2024-10-07 11:33:30.455941] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.804 [2024-10-07 11:33:30.456131] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.804 [2024-10-07 11:33:30.456209] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.804 [2024-10-07 11:33:30.456233] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.804 [2024-10-07 11:33:30.456247] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.804 [2024-10-07 11:33:30.456271] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.804 [2024-10-07 11:33:30.464277] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.804 [2024-10-07 11:33:30.464483] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.804 [2024-10-07 11:33:30.464515] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.804 [2024-10-07 11:33:30.464532] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.804 [2024-10-07 11:33:30.464638] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.804 [2024-10-07 11:33:30.464761] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.804 [2024-10-07 11:33:30.464781] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.804 [2024-10-07 11:33:30.464795] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.804 [2024-10-07 11:33:30.465894] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.804 [2024-10-07 11:33:30.469577] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.804 [2024-10-07 11:33:30.469928] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.804 [2024-10-07 11:33:30.469972] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.804 [2024-10-07 11:33:30.469993] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.804 [2024-10-07 11:33:30.470229] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.804 [2024-10-07 11:33:30.470319] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.804 [2024-10-07 11:33:30.470343] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.804 [2024-10-07 11:33:30.470359] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.804 [2024-10-07 11:33:30.470383] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.804 [2024-10-07 11:33:30.474366] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.804 [2024-10-07 11:33:30.474467] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.804 [2024-10-07 11:33:30.474496] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.804 [2024-10-07 11:33:30.474513] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.804 [2024-10-07 11:33:30.474985] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.804 [2024-10-07 11:33:30.475197] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.804 [2024-10-07 11:33:30.475258] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.805 [2024-10-07 11:33:30.475284] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.805 [2024-10-07 11:33:30.475446] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.805 [2024-10-07 11:33:30.480129] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.805 [2024-10-07 11:33:30.480335] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.805 [2024-10-07 11:33:30.480368] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.805 [2024-10-07 11:33:30.480386] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.805 [2024-10-07 11:33:30.480502] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.805 [2024-10-07 11:33:30.480728] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.805 [2024-10-07 11:33:30.480763] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.805 [2024-10-07 11:33:30.480780] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.805 [2024-10-07 11:33:30.481278] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.805 [2024-10-07 11:33:30.487309] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.805 [2024-10-07 11:33:30.487531] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.805 [2024-10-07 11:33:30.487564] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.805 [2024-10-07 11:33:30.487582] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.805 [2024-10-07 11:33:30.487829] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.805 [2024-10-07 11:33:30.487984] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.805 [2024-10-07 11:33:30.488018] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.805 [2024-10-07 11:33:30.488035] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.805 [2024-10-07 11:33:30.488141] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.805 [2024-10-07 11:33:30.493855] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.805 [2024-10-07 11:33:30.494074] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.805 [2024-10-07 11:33:30.494106] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.805 [2024-10-07 11:33:30.494123] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.805 [2024-10-07 11:33:30.494237] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.805 [2024-10-07 11:33:30.494344] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.805 [2024-10-07 11:33:30.494363] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.805 [2024-10-07 11:33:30.494377] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.805 [2024-10-07 11:33:30.494493] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.805 [2024-10-07 11:33:30.498561] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.805 [2024-10-07 11:33:30.498680] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.805 [2024-10-07 11:33:30.498712] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.805 [2024-10-07 11:33:30.498729] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.805 [2024-10-07 11:33:30.498753] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.805 [2024-10-07 11:33:30.498776] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.805 [2024-10-07 11:33:30.498790] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.805 [2024-10-07 11:33:30.498804] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.805 [2024-10-07 11:33:30.498828] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.805 [2024-10-07 11:33:30.504107] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.805 [2024-10-07 11:33:30.504230] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.805 [2024-10-07 11:33:30.504261] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.805 [2024-10-07 11:33:30.504278] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.805 [2024-10-07 11:33:30.504307] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.805 [2024-10-07 11:33:30.504329] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.805 [2024-10-07 11:33:30.504344] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.805 [2024-10-07 11:33:30.504358] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.805 [2024-10-07 11:33:30.504381] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.805 [2024-10-07 11:33:30.513222] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.805 [2024-10-07 11:33:30.513534] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.805 [2024-10-07 11:33:30.513578] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.805 [2024-10-07 11:33:30.513603] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.805 [2024-10-07 11:33:30.514095] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.805 [2024-10-07 11:33:30.514342] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.805 [2024-10-07 11:33:30.514377] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.805 [2024-10-07 11:33:30.514395] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.805 [2024-10-07 11:33:30.514464] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.805 [2024-10-07 11:33:30.514494] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.805 [2024-10-07 11:33:30.514567] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.805 [2024-10-07 11:33:30.514595] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.805 [2024-10-07 11:33:30.514611] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.805 [2024-10-07 11:33:30.514819] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.805 [2024-10-07 11:33:30.514976] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.805 [2024-10-07 11:33:30.515008] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.805 [2024-10-07 11:33:30.515024] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.805 [2024-10-07 11:33:30.515080] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.805 [2024-10-07 11:33:30.527086] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.805 [2024-10-07 11:33:30.527135] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.805 [2024-10-07 11:33:30.527232] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.805 [2024-10-07 11:33:30.527262] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.805 [2024-10-07 11:33:30.527279] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.805 [2024-10-07 11:33:30.527326] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.805 [2024-10-07 11:33:30.527349] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.805 [2024-10-07 11:33:30.527364] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.805 [2024-10-07 11:33:30.527387] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.805 [2024-10-07 11:33:30.527407] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.805 [2024-10-07 11:33:30.527426] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.805 [2024-10-07 11:33:30.527441] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.805 [2024-10-07 11:33:30.527465] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.805 [2024-10-07 11:33:30.527481] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.806 [2024-10-07 11:33:30.527495] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.806 [2024-10-07 11:33:30.527508] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.806 [2024-10-07 11:33:30.527530] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.806 [2024-10-07 11:33:30.527544] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.806 [2024-10-07 11:33:30.542043] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.806 [2024-10-07 11:33:30.542093] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.806 [2024-10-07 11:33:30.542181] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.806 [2024-10-07 11:33:30.542210] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.806 [2024-10-07 11:33:30.542226] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.806 [2024-10-07 11:33:30.542274] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.806 [2024-10-07 11:33:30.542297] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.806 [2024-10-07 11:33:30.542331] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.806 [2024-10-07 11:33:30.542357] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.806 [2024-10-07 11:33:30.542377] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.806 [2024-10-07 11:33:30.542397] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.806 [2024-10-07 11:33:30.542411] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.806 [2024-10-07 11:33:30.542425] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.806 [2024-10-07 11:33:30.542441] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.806 [2024-10-07 11:33:30.542455] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.806 [2024-10-07 11:33:30.542468] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.806 [2024-10-07 11:33:30.543125] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.806 [2024-10-07 11:33:30.543152] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.806 [2024-10-07 11:33:30.553032] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.806 [2024-10-07 11:33:30.553080] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.806 [2024-10-07 11:33:30.553266] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.806 [2024-10-07 11:33:30.553297] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.806 [2024-10-07 11:33:30.553314] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.806 [2024-10-07 11:33:30.553362] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.806 [2024-10-07 11:33:30.553385] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.806 [2024-10-07 11:33:30.553400] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.806 [2024-10-07 11:33:30.554864] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.806 [2024-10-07 11:33:30.554906] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.806 [2024-10-07 11:33:30.557145] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.806 [2024-10-07 11:33:30.557185] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.806 [2024-10-07 11:33:30.557204] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.806 [2024-10-07 11:33:30.557221] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.806 [2024-10-07 11:33:30.557235] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.806 [2024-10-07 11:33:30.557248] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.806 [2024-10-07 11:33:30.558462] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.806 [2024-10-07 11:33:30.558502] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.806 [2024-10-07 11:33:30.563706] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.806 [2024-10-07 11:33:30.563775] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.806 [2024-10-07 11:33:30.563971] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.806 [2024-10-07 11:33:30.564003] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.806 [2024-10-07 11:33:30.564021] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.806 [2024-10-07 11:33:30.564068] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.806 [2024-10-07 11:33:30.564091] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.806 [2024-10-07 11:33:30.564106] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.806 [2024-10-07 11:33:30.564224] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.806 [2024-10-07 11:33:30.564251] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.806 [2024-10-07 11:33:30.564350] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.806 [2024-10-07 11:33:30.564369] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.806 [2024-10-07 11:33:30.564383] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.806 [2024-10-07 11:33:30.564399] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.806 [2024-10-07 11:33:30.564414] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.806 [2024-10-07 11:33:30.564426] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.806 [2024-10-07 11:33:30.564538] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.806 [2024-10-07 11:33:30.564559] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.806 [2024-10-07 11:33:30.573837] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.806 [2024-10-07 11:33:30.573902] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.806 [2024-10-07 11:33:30.573978] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.806 [2024-10-07 11:33:30.574007] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.806 [2024-10-07 11:33:30.574023] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.806 [2024-10-07 11:33:30.574076] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.806 [2024-10-07 11:33:30.574101] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.806 [2024-10-07 11:33:30.574116] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.806 [2024-10-07 11:33:30.574134] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.806 [2024-10-07 11:33:30.574157] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.806 [2024-10-07 11:33:30.574174] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.806 [2024-10-07 11:33:30.574187] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.806 [2024-10-07 11:33:30.574201] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.806 [2024-10-07 11:33:30.574239] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.806 [2024-10-07 11:33:30.574256] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.806 [2024-10-07 11:33:30.574269] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.806 [2024-10-07 11:33:30.574282] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.806 [2024-10-07 11:33:30.574302] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.806 [2024-10-07 11:33:30.586686] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.806 [2024-10-07 11:33:30.586756] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.806 [2024-10-07 11:33:30.587233] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.806 [2024-10-07 11:33:30.587280] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.807 [2024-10-07 11:33:30.587300] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.807 [2024-10-07 11:33:30.587350] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.807 [2024-10-07 11:33:30.587374] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.807 [2024-10-07 11:33:30.587389] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.807 [2024-10-07 11:33:30.587675] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.807 [2024-10-07 11:33:30.587707] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.807 [2024-10-07 11:33:30.587783] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.807 [2024-10-07 11:33:30.587807] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.807 [2024-10-07 11:33:30.587831] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.807 [2024-10-07 11:33:30.587848] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.807 [2024-10-07 11:33:30.587862] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.807 [2024-10-07 11:33:30.587875] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.807 [2024-10-07 11:33:30.587898] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.807 [2024-10-07 11:33:30.587913] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.807 [2024-10-07 11:33:30.601313] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.807 [2024-10-07 11:33:30.601365] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.807 [2024-10-07 11:33:30.601671] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.807 [2024-10-07 11:33:30.601704] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.807 [2024-10-07 11:33:30.601722] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.807 [2024-10-07 11:33:30.601772] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.807 [2024-10-07 11:33:30.601795] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.807 [2024-10-07 11:33:30.601811] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.807 [2024-10-07 11:33:30.602037] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.807 [2024-10-07 11:33:30.602069] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.807 [2024-10-07 11:33:30.602266] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.807 [2024-10-07 11:33:30.602302] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.807 [2024-10-07 11:33:30.602320] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.807 [2024-10-07 11:33:30.602338] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.807 [2024-10-07 11:33:30.602353] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.807 [2024-10-07 11:33:30.602365] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.807 [2024-10-07 11:33:30.602430] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.807 [2024-10-07 11:33:30.602450] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.807 [2024-10-07 11:33:30.615956] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.807 [2024-10-07 11:33:30.616006] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.807 [2024-10-07 11:33:30.616337] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.807 [2024-10-07 11:33:30.616381] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.807 [2024-10-07 11:33:30.616409] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.807 [2024-10-07 11:33:30.616468] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.807 [2024-10-07 11:33:30.616492] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.807 [2024-10-07 11:33:30.616507] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.807 [2024-10-07 11:33:30.616731] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.807 [2024-10-07 11:33:30.616763] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.807 [2024-10-07 11:33:30.616812] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.807 [2024-10-07 11:33:30.616833] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.807 [2024-10-07 11:33:30.616847] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.807 [2024-10-07 11:33:30.616863] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.807 [2024-10-07 11:33:30.616877] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.807 [2024-10-07 11:33:30.616890] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.807 [2024-10-07 11:33:30.616913] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.807 [2024-10-07 11:33:30.616927] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.807 [2024-10-07 11:33:30.630236] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.807 [2024-10-07 11:33:30.630285] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.807 [2024-10-07 11:33:30.630582] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.807 [2024-10-07 11:33:30.630616] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.807 [2024-10-07 11:33:30.630634] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.807 [2024-10-07 11:33:30.630698] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.807 [2024-10-07 11:33:30.630724] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.807 [2024-10-07 11:33:30.630739] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.807 [2024-10-07 11:33:30.630943] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.807 [2024-10-07 11:33:30.630974] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.807 [2024-10-07 11:33:30.631030] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.807 [2024-10-07 11:33:30.631052] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.807 [2024-10-07 11:33:30.631066] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.807 [2024-10-07 11:33:30.631083] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.807 [2024-10-07 11:33:30.631097] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.807 [2024-10-07 11:33:30.631109] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.807 [2024-10-07 11:33:30.631132] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.807 [2024-10-07 11:33:30.631146] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.807 [2024-10-07 11:33:30.644582] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.807 [2024-10-07 11:33:30.644637] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.807 [2024-10-07 11:33:30.644738] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.807 [2024-10-07 11:33:30.644767] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.807 [2024-10-07 11:33:30.644784] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.807 [2024-10-07 11:33:30.644830] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.807 [2024-10-07 11:33:30.644853] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.807 [2024-10-07 11:33:30.644869] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.807 [2024-10-07 11:33:30.644891] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.807 [2024-10-07 11:33:30.644911] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.807 [2024-10-07 11:33:30.644931] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.807 [2024-10-07 11:33:30.644945] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.807 [2024-10-07 11:33:30.644959] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.807 [2024-10-07 11:33:30.644975] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.807 [2024-10-07 11:33:30.645009] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.807 [2024-10-07 11:33:30.645023] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.807 [2024-10-07 11:33:30.645047] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.807 [2024-10-07 11:33:30.645062] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.807 [2024-10-07 11:33:30.655715] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.808 [2024-10-07 11:33:30.655764] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.808 [2024-10-07 11:33:30.658353] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.808 [2024-10-07 11:33:30.658399] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.808 [2024-10-07 11:33:30.658420] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.808 [2024-10-07 11:33:30.658470] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.808 [2024-10-07 11:33:30.658494] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.808 [2024-10-07 11:33:30.658510] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.808 [2024-10-07 11:33:30.659250] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.808 [2024-10-07 11:33:30.659294] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.808 [2024-10-07 11:33:30.659460] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.808 [2024-10-07 11:33:30.659485] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.808 [2024-10-07 11:33:30.659499] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.808 [2024-10-07 11:33:30.659517] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.808 [2024-10-07 11:33:30.659532] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.808 [2024-10-07 11:33:30.659545] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.808 [2024-10-07 11:33:30.659788] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.808 [2024-10-07 11:33:30.659813] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.808 [2024-10-07 11:33:30.666364] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.808 [2024-10-07 11:33:30.666413] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.808 [2024-10-07 11:33:30.666500] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.808 [2024-10-07 11:33:30.666530] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.808 [2024-10-07 11:33:30.666546] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.808 [2024-10-07 11:33:30.666594] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.808 [2024-10-07 11:33:30.666616] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.808 [2024-10-07 11:33:30.666631] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.808 [2024-10-07 11:33:30.666671] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.808 [2024-10-07 11:33:30.666713] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.808 [2024-10-07 11:33:30.666734] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.808 [2024-10-07 11:33:30.666749] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.808 [2024-10-07 11:33:30.666763] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.808 [2024-10-07 11:33:30.666779] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.808 [2024-10-07 11:33:30.666793] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.808 [2024-10-07 11:33:30.666806] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.808 [2024-10-07 11:33:30.666828] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.808 [2024-10-07 11:33:30.666843] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.808 [2024-10-07 11:33:30.678034] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.808 [2024-10-07 11:33:30.678086] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.808 [2024-10-07 11:33:30.678352] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.808 [2024-10-07 11:33:30.678385] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.808 [2024-10-07 11:33:30.678402] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.808 [2024-10-07 11:33:30.678451] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.808 [2024-10-07 11:33:30.678474] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.808 [2024-10-07 11:33:30.678497] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.808 [2024-10-07 11:33:30.678711] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.808 [2024-10-07 11:33:30.678743] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.808 [2024-10-07 11:33:30.678806] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.808 [2024-10-07 11:33:30.678828] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.808 [2024-10-07 11:33:30.678843] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.808 [2024-10-07 11:33:30.678859] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.808 [2024-10-07 11:33:30.678874] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.808 [2024-10-07 11:33:30.678886] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.808 [2024-10-07 11:33:30.678909] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.808 [2024-10-07 11:33:30.678924] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.808 [2024-10-07 11:33:30.690563] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.808 [2024-10-07 11:33:30.690614] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.808 [2024-10-07 11:33:30.690842] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.808 [2024-10-07 11:33:30.690895] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.808 [2024-10-07 11:33:30.690927] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.808 [2024-10-07 11:33:30.690998] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.808 [2024-10-07 11:33:30.691024] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.808 [2024-10-07 11:33:30.691040] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.808 [2024-10-07 11:33:30.691167] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.808 [2024-10-07 11:33:30.691209] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.808 [2024-10-07 11:33:30.691327] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.808 [2024-10-07 11:33:30.691349] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.808 [2024-10-07 11:33:30.691366] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.808 [2024-10-07 11:33:30.691384] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.808 [2024-10-07 11:33:30.691398] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.808 [2024-10-07 11:33:30.691411] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.808 [2024-10-07 11:33:30.691512] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.808 [2024-10-07 11:33:30.691530] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.808 [2024-10-07 11:33:30.702357] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.808 [2024-10-07 11:33:30.702409] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.808 [2024-10-07 11:33:30.702528] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.808 [2024-10-07 11:33:30.702559] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.808 [2024-10-07 11:33:30.702576] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.808 [2024-10-07 11:33:30.702624] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.808 [2024-10-07 11:33:30.702661] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.808 [2024-10-07 11:33:30.702680] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.808 [2024-10-07 11:33:30.702705] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.808 [2024-10-07 11:33:30.702726] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.809 [2024-10-07 11:33:30.702745] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.809 [2024-10-07 11:33:30.702760] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.809 [2024-10-07 11:33:30.702773] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.809 [2024-10-07 11:33:30.702790] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.809 [2024-10-07 11:33:30.702804] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.809 [2024-10-07 11:33:30.702832] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.809 [2024-10-07 11:33:30.702858] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.809 [2024-10-07 11:33:30.702872] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.809 [2024-10-07 11:33:30.713413] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.809 [2024-10-07 11:33:30.713463] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.809 [2024-10-07 11:33:30.713584] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.809 [2024-10-07 11:33:30.713615] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.809 [2024-10-07 11:33:30.713632] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.809 [2024-10-07 11:33:30.713698] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.809 [2024-10-07 11:33:30.713723] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.809 [2024-10-07 11:33:30.713738] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.809 [2024-10-07 11:33:30.713763] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.809 [2024-10-07 11:33:30.713783] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.809 [2024-10-07 11:33:30.713803] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.809 [2024-10-07 11:33:30.713818] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.809 [2024-10-07 11:33:30.713833] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.809 [2024-10-07 11:33:30.713850] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.809 [2024-10-07 11:33:30.713864] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.809 [2024-10-07 11:33:30.713877] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.809 [2024-10-07 11:33:30.713899] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.809 [2024-10-07 11:33:30.713913] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.809 [2024-10-07 11:33:30.725266] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.809 [2024-10-07 11:33:30.725317] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.809 [2024-10-07 11:33:30.725493] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.809 [2024-10-07 11:33:30.725524] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.809 [2024-10-07 11:33:30.725541] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.809 [2024-10-07 11:33:30.725589] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.809 [2024-10-07 11:33:30.725612] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.809 [2024-10-07 11:33:30.725627] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.809 [2024-10-07 11:33:30.725826] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.809 [2024-10-07 11:33:30.725871] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.809 [2024-10-07 11:33:30.727015] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.809 [2024-10-07 11:33:30.727053] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.809 [2024-10-07 11:33:30.727071] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.809 [2024-10-07 11:33:30.727089] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.809 [2024-10-07 11:33:30.727103] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.809 [2024-10-07 11:33:30.727117] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.809 [2024-10-07 11:33:30.728632] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.809 [2024-10-07 11:33:30.728679] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.809 [2024-10-07 11:33:30.735964] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.809 [2024-10-07 11:33:30.736011] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.809 [2024-10-07 11:33:30.736808] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.809 [2024-10-07 11:33:30.736851] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.809 [2024-10-07 11:33:30.736878] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.809 [2024-10-07 11:33:30.736928] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.809 [2024-10-07 11:33:30.736954] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.809 [2024-10-07 11:33:30.736969] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.809 [2024-10-07 11:33:30.737177] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.809 [2024-10-07 11:33:30.737209] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.809 [2024-10-07 11:33:30.737316] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.809 [2024-10-07 11:33:30.737335] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.809 [2024-10-07 11:33:30.737349] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.809 [2024-10-07 11:33:30.737367] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.809 [2024-10-07 11:33:30.737381] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.809 [2024-10-07 11:33:30.737393] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.809 [2024-10-07 11:33:30.740200] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.809 [2024-10-07 11:33:30.740243] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.809 [2024-10-07 11:33:30.746075] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.809 [2024-10-07 11:33:30.746550] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.809 [2024-10-07 11:33:30.746667] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.809 [2024-10-07 11:33:30.746699] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.809 [2024-10-07 11:33:30.746767] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.809 [2024-10-07 11:33:30.746958] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.809 [2024-10-07 11:33:30.746989] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.809 [2024-10-07 11:33:30.747006] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.809 [2024-10-07 11:33:30.747024] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.809 [2024-10-07 11:33:30.747218] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.809 [2024-10-07 11:33:30.747248] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.809 [2024-10-07 11:33:30.747264] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.809 [2024-10-07 11:33:30.747277] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.809 [2024-10-07 11:33:30.747335] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.809 [2024-10-07 11:33:30.747356] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.809 [2024-10-07 11:33:30.747369] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.809 [2024-10-07 11:33:30.747383] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.809 [2024-10-07 11:33:30.747404] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.809 [2024-10-07 11:33:30.758582] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.809 [2024-10-07 11:33:30.758634] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.809 [2024-10-07 11:33:30.758923] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.809 [2024-10-07 11:33:30.758968] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.809 [2024-10-07 11:33:30.758988] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.809 [2024-10-07 11:33:30.759040] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.809 [2024-10-07 11:33:30.759063] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.809 [2024-10-07 11:33:30.759079] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.809 [2024-10-07 11:33:30.759242] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.809 [2024-10-07 11:33:30.759274] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.809 [2024-10-07 11:33:30.759339] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.810 [2024-10-07 11:33:30.759363] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.810 [2024-10-07 11:33:30.759377] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.810 [2024-10-07 11:33:30.759394] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.810 [2024-10-07 11:33:30.759409] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.810 [2024-10-07 11:33:30.759422] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.810 [2024-10-07 11:33:30.759460] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.810 [2024-10-07 11:33:30.759477] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.810 [2024-10-07 11:33:30.769746] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.810 [2024-10-07 11:33:30.769795] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.810 [2024-10-07 11:33:30.772105] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.810 [2024-10-07 11:33:30.772150] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.810 [2024-10-07 11:33:30.772171] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.810 [2024-10-07 11:33:30.772220] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.810 [2024-10-07 11:33:30.772244] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.810 [2024-10-07 11:33:30.772259] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.810 [2024-10-07 11:33:30.772679] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.810 [2024-10-07 11:33:30.772712] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.810 [2024-10-07 11:33:30.772794] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.810 [2024-10-07 11:33:30.772818] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.810 [2024-10-07 11:33:30.772832] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.810 [2024-10-07 11:33:30.772849] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.810 [2024-10-07 11:33:30.772863] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.810 [2024-10-07 11:33:30.772876] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.810 [2024-10-07 11:33:30.773127] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.810 [2024-10-07 11:33:30.773157] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.810 [2024-10-07 11:33:30.782331] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.810 [2024-10-07 11:33:30.782380] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.810 [2024-10-07 11:33:30.782541] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.810 [2024-10-07 11:33:30.782573] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.810 [2024-10-07 11:33:30.782589] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.810 [2024-10-07 11:33:30.782637] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.810 [2024-10-07 11:33:30.782675] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.810 [2024-10-07 11:33:30.782692] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.810 [2024-10-07 11:33:30.782716] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.810 [2024-10-07 11:33:30.782735] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.810 [2024-10-07 11:33:30.782770] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.810 [2024-10-07 11:33:30.782791] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.810 [2024-10-07 11:33:30.782804] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.810 [2024-10-07 11:33:30.782820] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.810 [2024-10-07 11:33:30.782834] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.810 [2024-10-07 11:33:30.782847] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.810 [2024-10-07 11:33:30.782870] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.810 [2024-10-07 11:33:30.782884] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.810 [2024-10-07 11:33:30.793324] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.810 [2024-10-07 11:33:30.793374] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.810 [2024-10-07 11:33:30.793559] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.810 [2024-10-07 11:33:30.793590] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.810 [2024-10-07 11:33:30.793607] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.810 [2024-10-07 11:33:30.793671] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.810 [2024-10-07 11:33:30.793697] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.810 [2024-10-07 11:33:30.793712] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.810 [2024-10-07 11:33:30.793826] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.810 [2024-10-07 11:33:30.793853] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.810 [2024-10-07 11:33:30.793967] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.810 [2024-10-07 11:33:30.793989] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.810 [2024-10-07 11:33:30.794003] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.810 [2024-10-07 11:33:30.794020] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.810 [2024-10-07 11:33:30.794034] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.810 [2024-10-07 11:33:30.794046] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.810 [2024-10-07 11:33:30.794164] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.810 [2024-10-07 11:33:30.794185] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.810 [2024-10-07 11:33:30.803592] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.810 [2024-10-07 11:33:30.803640] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.810 [2024-10-07 11:33:30.803759] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.810 [2024-10-07 11:33:30.803789] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.810 [2024-10-07 11:33:30.803805] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.810 [2024-10-07 11:33:30.803870] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.810 [2024-10-07 11:33:30.803894] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.810 [2024-10-07 11:33:30.803909] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.810 [2024-10-07 11:33:30.803933] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.810 [2024-10-07 11:33:30.803953] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.810 [2024-10-07 11:33:30.803973] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.810 [2024-10-07 11:33:30.803987] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.810 [2024-10-07 11:33:30.804001] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.810 [2024-10-07 11:33:30.804017] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.810 [2024-10-07 11:33:30.804031] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.810 [2024-10-07 11:33:30.804048] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.810 [2024-10-07 11:33:30.804071] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.810 [2024-10-07 11:33:30.804085] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.810 [2024-10-07 11:33:30.813706] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.810 [2024-10-07 11:33:30.813853] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.810 [2024-10-07 11:33:30.813885] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.811 [2024-10-07 11:33:30.813901] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.811 [2024-10-07 11:33:30.813927] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.811 [2024-10-07 11:33:30.813956] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.811 [2024-10-07 11:33:30.814018] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.811 [2024-10-07 11:33:30.814044] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.811 [2024-10-07 11:33:30.814059] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.811 [2024-10-07 11:33:30.814074] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.811 [2024-10-07 11:33:30.814086] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.811 [2024-10-07 11:33:30.814100] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.811 [2024-10-07 11:33:30.814124] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.811 [2024-10-07 11:33:30.814142] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.811 [2024-10-07 11:33:30.814178] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.811 [2024-10-07 11:33:30.814197] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.811 [2024-10-07 11:33:30.814210] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.811 [2024-10-07 11:33:30.814248] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.811 [2024-10-07 11:33:30.826157] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.811 [2024-10-07 11:33:30.826207] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.811 [2024-10-07 11:33:30.826293] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.811 [2024-10-07 11:33:30.826322] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.811 [2024-10-07 11:33:30.826339] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.811 [2024-10-07 11:33:30.826394] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.811 [2024-10-07 11:33:30.826416] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.811 [2024-10-07 11:33:30.826432] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.811 [2024-10-07 11:33:30.826454] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.811 [2024-10-07 11:33:30.826475] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.811 [2024-10-07 11:33:30.826494] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.811 [2024-10-07 11:33:30.826509] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.811 [2024-10-07 11:33:30.826522] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.811 [2024-10-07 11:33:30.826538] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.811 [2024-10-07 11:33:30.826558] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.811 [2024-10-07 11:33:30.826571] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.811 [2024-10-07 11:33:30.826593] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.811 [2024-10-07 11:33:30.826607] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.811 [2024-10-07 11:33:30.838149] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.811 [2024-10-07 11:33:30.838200] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.811 [2024-10-07 11:33:30.838919] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.811 [2024-10-07 11:33:30.838963] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.811 [2024-10-07 11:33:30.838983] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.811 [2024-10-07 11:33:30.839033] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.811 [2024-10-07 11:33:30.839057] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.811 [2024-10-07 11:33:30.839072] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.811 [2024-10-07 11:33:30.841318] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.811 [2024-10-07 11:33:30.841363] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.811 [2024-10-07 11:33:30.841690] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.811 [2024-10-07 11:33:30.841745] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.811 [2024-10-07 11:33:30.841764] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.811 [2024-10-07 11:33:30.841782] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.811 [2024-10-07 11:33:30.841797] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.811 [2024-10-07 11:33:30.841809] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.811 [2024-10-07 11:33:30.841944] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.811 [2024-10-07 11:33:30.841967] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.811 [2024-10-07 11:33:30.848430] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.811 [2024-10-07 11:33:30.848479] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.811 [2024-10-07 11:33:30.848733] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.811 [2024-10-07 11:33:30.848766] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.811 [2024-10-07 11:33:30.848783] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.811 [2024-10-07 11:33:30.848832] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.811 [2024-10-07 11:33:30.848856] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.811 [2024-10-07 11:33:30.848871] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.811 [2024-10-07 11:33:30.848925] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.811 [2024-10-07 11:33:30.848952] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.811 [2024-10-07 11:33:30.849124] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.811 [2024-10-07 11:33:30.849148] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.811 [2024-10-07 11:33:30.849163] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.811 [2024-10-07 11:33:30.849179] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.811 [2024-10-07 11:33:30.849194] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.811 [2024-10-07 11:33:30.849207] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.811 [2024-10-07 11:33:30.849270] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.811 [2024-10-07 11:33:30.849291] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.811 [2024-10-07 11:33:30.861674] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.811 [2024-10-07 11:33:30.861725] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.811 [2024-10-07 11:33:30.862077] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.811 [2024-10-07 11:33:30.862121] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.811 [2024-10-07 11:33:30.862141] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.811 [2024-10-07 11:33:30.862193] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.811 [2024-10-07 11:33:30.862234] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.811 [2024-10-07 11:33:30.862251] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.811 [2024-10-07 11:33:30.862483] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.811 [2024-10-07 11:33:30.862515] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.811 [2024-10-07 11:33:30.863153] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.811 [2024-10-07 11:33:30.863199] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.811 [2024-10-07 11:33:30.863218] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.811 [2024-10-07 11:33:30.863236] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.811 [2024-10-07 11:33:30.863251] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.811 [2024-10-07 11:33:30.863264] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.811 [2024-10-07 11:33:30.863510] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.811 [2024-10-07 11:33:30.863535] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.811 [2024-10-07 11:33:30.874254] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.811 [2024-10-07 11:33:30.874304] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.811 [2024-10-07 11:33:30.874389] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.811 [2024-10-07 11:33:30.874419] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.811 [2024-10-07 11:33:30.874435] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.811 [2024-10-07 11:33:30.874482] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.811 [2024-10-07 11:33:30.874505] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.811 [2024-10-07 11:33:30.874520] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.811 [2024-10-07 11:33:30.874543] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.812 [2024-10-07 11:33:30.874562] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.812 [2024-10-07 11:33:30.875176] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.812 [2024-10-07 11:33:30.875225] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.812 [2024-10-07 11:33:30.875243] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.812 [2024-10-07 11:33:30.875260] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.812 [2024-10-07 11:33:30.875275] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.812 [2024-10-07 11:33:30.875287] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.812 [2024-10-07 11:33:30.875386] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.812 [2024-10-07 11:33:30.875408] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.812 [2024-10-07 11:33:30.884367] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.812 [2024-10-07 11:33:30.884432] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.812 [2024-10-07 11:33:30.884511] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.812 [2024-10-07 11:33:30.884540] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.812 [2024-10-07 11:33:30.884557] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.812 [2024-10-07 11:33:30.884611] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.812 [2024-10-07 11:33:30.884636] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.812 [2024-10-07 11:33:30.884664] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.812 [2024-10-07 11:33:30.884685] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.812 [2024-10-07 11:33:30.884708] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.812 [2024-10-07 11:33:30.884726] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.812 [2024-10-07 11:33:30.884739] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.812 [2024-10-07 11:33:30.884753] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.812 [2024-10-07 11:33:30.884775] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.812 [2024-10-07 11:33:30.884797] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.812 [2024-10-07 11:33:30.884810] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.812 [2024-10-07 11:33:30.884823] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.812 [2024-10-07 11:33:30.884843] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.812 [2024-10-07 11:33:30.896904] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.812 [2024-10-07 11:33:30.896951] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.812 [2024-10-07 11:33:30.897190] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.812 [2024-10-07 11:33:30.897221] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.812 [2024-10-07 11:33:30.897239] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.812 [2024-10-07 11:33:30.897290] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.812 [2024-10-07 11:33:30.897313] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.812 [2024-10-07 11:33:30.897328] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.812 [2024-10-07 11:33:30.897353] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.812 [2024-10-07 11:33:30.897374] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.812 [2024-10-07 11:33:30.897394] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.812 [2024-10-07 11:33:30.897408] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.812 [2024-10-07 11:33:30.897438] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.812 [2024-10-07 11:33:30.897455] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.812 [2024-10-07 11:33:30.897470] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.812 [2024-10-07 11:33:30.897483] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.812 [2024-10-07 11:33:30.897505] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.812 [2024-10-07 11:33:30.897520] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.812 8936.43 IOPS, 34.91 MiB/s [2024-10-07T11:33:33.335Z] [2024-10-07 11:33:30.907222] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.812 [2024-10-07 11:33:30.907270] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.812 [2024-10-07 11:33:30.909272] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.812 [2024-10-07 11:33:30.909318] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.812 [2024-10-07 11:33:30.909339] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.812 [2024-10-07 11:33:30.909389] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.812 [2024-10-07 11:33:30.909413] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.812 [2024-10-07 11:33:30.909428] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.812 [2024-10-07 11:33:30.912682] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.812 [2024-10-07 11:33:30.912727] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.812 [2024-10-07 11:33:30.913596] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.812 [2024-10-07 11:33:30.913634] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.812 [2024-10-07 11:33:30.913664] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.812 [2024-10-07 11:33:30.913685] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.812 [2024-10-07 11:33:30.913698] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.812 [2024-10-07 11:33:30.913711] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.812 [2024-10-07 11:33:30.913826] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.812 [2024-10-07 11:33:30.913848] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.812 [2024-10-07 11:33:30.918785] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.812 [2024-10-07 11:33:30.918835] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.812 [2024-10-07 11:33:30.919026] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.812 [2024-10-07 11:33:30.919058] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.812 [2024-10-07 11:33:30.919075] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.812 [2024-10-07 11:33:30.919122] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.812 [2024-10-07 11:33:30.919169] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.812 [2024-10-07 11:33:30.919203] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.812 [2024-10-07 11:33:30.919331] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.812 [2024-10-07 11:33:30.919359] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.812 [2024-10-07 11:33:30.919476] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.812 [2024-10-07 11:33:30.919498] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.812 [2024-10-07 11:33:30.919512] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.812 [2024-10-07 11:33:30.919529] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.812 [2024-10-07 11:33:30.919543] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.812 [2024-10-07 11:33:30.919556] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.812 [2024-10-07 11:33:30.919671] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.812 [2024-10-07 11:33:30.919692] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.812 [2024-10-07 11:33:30.928897] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.812 [2024-10-07 11:33:30.928961] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.812 [2024-10-07 11:33:30.929038] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.812 [2024-10-07 11:33:30.929067] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.812 [2024-10-07 11:33:30.929083] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.812 [2024-10-07 11:33:30.929147] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.812 [2024-10-07 11:33:30.929172] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.812 [2024-10-07 11:33:30.929187] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.812 [2024-10-07 11:33:30.929204] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.812 [2024-10-07 11:33:30.929228] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.812 [2024-10-07 11:33:30.929245] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.812 [2024-10-07 11:33:30.929259] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.812 [2024-10-07 11:33:30.929272] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.812 [2024-10-07 11:33:30.929296] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.812 [2024-10-07 11:33:30.929310] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.812 [2024-10-07 11:33:30.929323] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.813 [2024-10-07 11:33:30.929336] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.813 [2024-10-07 11:33:30.929355] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.813 [2024-10-07 11:33:30.940638] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.813 [2024-10-07 11:33:30.940716] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.813 [2024-10-07 11:33:30.941085] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.813 [2024-10-07 11:33:30.941130] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.813 [2024-10-07 11:33:30.941151] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.813 [2024-10-07 11:33:30.941201] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.813 [2024-10-07 11:33:30.941224] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.813 [2024-10-07 11:33:30.941239] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.813 [2024-10-07 11:33:30.941452] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.813 [2024-10-07 11:33:30.941483] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.813 [2024-10-07 11:33:30.941534] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.813 [2024-10-07 11:33:30.941555] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.813 [2024-10-07 11:33:30.941569] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.813 [2024-10-07 11:33:30.941586] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.813 [2024-10-07 11:33:30.941600] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.813 [2024-10-07 11:33:30.941613] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.813 [2024-10-07 11:33:30.941636] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.813 [2024-10-07 11:33:30.941666] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.813 [2024-10-07 11:33:30.951155] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.813 [2024-10-07 11:33:30.951215] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.813 [2024-10-07 11:33:30.951393] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.813 [2024-10-07 11:33:30.951424] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.813 [2024-10-07 11:33:30.951441] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.813 [2024-10-07 11:33:30.951490] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.813 [2024-10-07 11:33:30.951513] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.813 [2024-10-07 11:33:30.951528] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.813 [2024-10-07 11:33:30.952476] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.813 [2024-10-07 11:33:30.952521] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.813 [2024-10-07 11:33:30.954420] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.813 [2024-10-07 11:33:30.954459] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.813 [2024-10-07 11:33:30.954492] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.813 [2024-10-07 11:33:30.954512] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.813 [2024-10-07 11:33:30.954527] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.813 [2024-10-07 11:33:30.954540] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.813 [2024-10-07 11:33:30.955287] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.813 [2024-10-07 11:33:30.955324] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.813 [2024-10-07 11:33:30.961588] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.813 [2024-10-07 11:33:30.961638] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.813 [2024-10-07 11:33:30.961817] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.813 [2024-10-07 11:33:30.961848] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.813 [2024-10-07 11:33:30.961865] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.813 [2024-10-07 11:33:30.961912] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.813 [2024-10-07 11:33:30.961935] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.813 [2024-10-07 11:33:30.961950] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.813 [2024-10-07 11:33:30.962054] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.813 [2024-10-07 11:33:30.962080] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.813 [2024-10-07 11:33:30.963721] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.813 [2024-10-07 11:33:30.963761] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.813 [2024-10-07 11:33:30.963779] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.813 [2024-10-07 11:33:30.963796] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.813 [2024-10-07 11:33:30.963811] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.813 [2024-10-07 11:33:30.963824] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.813 [2024-10-07 11:33:30.964102] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.813 [2024-10-07 11:33:30.964129] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.813 [2024-10-07 11:33:30.971717] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.813 [2024-10-07 11:33:30.971783] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.813 [2024-10-07 11:33:30.971860] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.813 [2024-10-07 11:33:30.971888] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.813 [2024-10-07 11:33:30.971905] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.813 [2024-10-07 11:33:30.971959] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.813 [2024-10-07 11:33:30.971984] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.813 [2024-10-07 11:33:30.972018] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.813 [2024-10-07 11:33:30.972037] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.813 [2024-10-07 11:33:30.972061] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.813 [2024-10-07 11:33:30.972078] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.813 [2024-10-07 11:33:30.972092] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.813 [2024-10-07 11:33:30.972105] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.813 [2024-10-07 11:33:30.972128] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.813 [2024-10-07 11:33:30.972143] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.813 [2024-10-07 11:33:30.972156] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.813 [2024-10-07 11:33:30.972169] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.813 [2024-10-07 11:33:30.972189] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.813 [2024-10-07 11:33:30.982512] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.813 [2024-10-07 11:33:30.982565] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.813 [2024-10-07 11:33:30.982666] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.813 [2024-10-07 11:33:30.982696] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.813 [2024-10-07 11:33:30.982712] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.813 [2024-10-07 11:33:30.982761] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.813 [2024-10-07 11:33:30.982784] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.813 [2024-10-07 11:33:30.982800] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.813 [2024-10-07 11:33:30.982824] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.813 [2024-10-07 11:33:30.982844] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.813 [2024-10-07 11:33:30.982864] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.813 [2024-10-07 11:33:30.982878] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.813 [2024-10-07 11:33:30.982892] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.813 [2024-10-07 11:33:30.982908] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.813 [2024-10-07 11:33:30.982921] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.813 [2024-10-07 11:33:30.982934] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.813 [2024-10-07 11:33:30.982957] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.813 [2024-10-07 11:33:30.982971] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.813 [2024-10-07 11:33:30.992759] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.814 [2024-10-07 11:33:30.992827] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.814 [2024-10-07 11:33:30.992916] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.814 [2024-10-07 11:33:30.992946] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.814 [2024-10-07 11:33:30.992963] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.814 [2024-10-07 11:33:30.993010] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.814 [2024-10-07 11:33:30.993032] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.814 [2024-10-07 11:33:30.993047] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.814 [2024-10-07 11:33:30.995920] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.814 [2024-10-07 11:33:30.995968] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.814 [2024-10-07 11:33:30.997225] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.814 [2024-10-07 11:33:30.997263] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.814 [2024-10-07 11:33:30.997282] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.814 [2024-10-07 11:33:30.997300] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.814 [2024-10-07 11:33:30.997315] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.814 [2024-10-07 11:33:30.997327] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.814 [2024-10-07 11:33:30.998539] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.814 [2024-10-07 11:33:30.998575] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.814 [2024-10-07 11:33:31.002889] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.814 [2024-10-07 11:33:31.002949] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.814 [2024-10-07 11:33:31.003025] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.814 [2024-10-07 11:33:31.003055] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.814 [2024-10-07 11:33:31.003072] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.814 [2024-10-07 11:33:31.003127] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.814 [2024-10-07 11:33:31.003152] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.814 [2024-10-07 11:33:31.003167] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.814 [2024-10-07 11:33:31.003196] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.814 [2024-10-07 11:33:31.003224] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.814 [2024-10-07 11:33:31.003241] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.814 [2024-10-07 11:33:31.003255] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.814 [2024-10-07 11:33:31.003268] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.814 [2024-10-07 11:33:31.003307] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.814 [2024-10-07 11:33:31.003324] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.814 [2024-10-07 11:33:31.003336] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.814 [2024-10-07 11:33:31.003349] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.814 [2024-10-07 11:33:31.003376] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.814 [2024-10-07 11:33:31.014491] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.814 [2024-10-07 11:33:31.014543] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.814 [2024-10-07 11:33:31.014847] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.814 [2024-10-07 11:33:31.014880] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.814 [2024-10-07 11:33:31.014898] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.814 [2024-10-07 11:33:31.014952] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.814 [2024-10-07 11:33:31.014976] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.814 [2024-10-07 11:33:31.014991] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.814 [2024-10-07 11:33:31.015208] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.814 [2024-10-07 11:33:31.015240] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.814 [2024-10-07 11:33:31.015298] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.814 [2024-10-07 11:33:31.015320] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.814 [2024-10-07 11:33:31.015335] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.814 [2024-10-07 11:33:31.015351] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.814 [2024-10-07 11:33:31.015365] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.814 [2024-10-07 11:33:31.015378] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.814 [2024-10-07 11:33:31.015560] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.814 [2024-10-07 11:33:31.015583] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.814 [2024-10-07 11:33:31.028421] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.814 [2024-10-07 11:33:31.028472] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.814 [2024-10-07 11:33:31.028702] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.814 [2024-10-07 11:33:31.028746] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.814 [2024-10-07 11:33:31.028767] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.814 [2024-10-07 11:33:31.028818] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.814 [2024-10-07 11:33:31.028841] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.814 [2024-10-07 11:33:31.028857] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.814 [2024-10-07 11:33:31.030493] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.814 [2024-10-07 11:33:31.030538] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.814 [2024-10-07 11:33:31.031162] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.814 [2024-10-07 11:33:31.031210] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.814 [2024-10-07 11:33:31.031228] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.814 [2024-10-07 11:33:31.031246] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.814 [2024-10-07 11:33:31.031260] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.814 [2024-10-07 11:33:31.031273] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.814 [2024-10-07 11:33:31.031517] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.814 [2024-10-07 11:33:31.031552] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.814 [2024-10-07 11:33:31.044831] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.814 [2024-10-07 11:33:31.044882] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.814 [2024-10-07 11:33:31.045052] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.814 [2024-10-07 11:33:31.045082] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.814 [2024-10-07 11:33:31.045099] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.814 [2024-10-07 11:33:31.045147] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.814 [2024-10-07 11:33:31.045170] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.814 [2024-10-07 11:33:31.045185] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.814 [2024-10-07 11:33:31.045209] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.814 [2024-10-07 11:33:31.045229] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.814 [2024-10-07 11:33:31.045254] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.814 [2024-10-07 11:33:31.045284] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.814 [2024-10-07 11:33:31.045309] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.814 [2024-10-07 11:33:31.045330] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.814 [2024-10-07 11:33:31.045344] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.814 [2024-10-07 11:33:31.045357] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.814 [2024-10-07 11:33:31.045380] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.814 [2024-10-07 11:33:31.045394] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.814 [2024-10-07 11:33:31.059884] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.814 [2024-10-07 11:33:31.059935] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.814 [2024-10-07 11:33:31.060049] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.814 [2024-10-07 11:33:31.060080] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.814 [2024-10-07 11:33:31.060097] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.814 [2024-10-07 11:33:31.060144] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.814 [2024-10-07 11:33:31.060167] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.814 [2024-10-07 11:33:31.060183] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.815 [2024-10-07 11:33:31.060206] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.815 [2024-10-07 11:33:31.060226] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.815 [2024-10-07 11:33:31.060246] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.815 [2024-10-07 11:33:31.060266] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.815 [2024-10-07 11:33:31.060280] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.815 [2024-10-07 11:33:31.060296] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.815 [2024-10-07 11:33:31.060310] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.815 [2024-10-07 11:33:31.060323] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.815 [2024-10-07 11:33:31.060345] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.815 [2024-10-07 11:33:31.060360] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.815 [2024-10-07 11:33:31.071001] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.815 [2024-10-07 11:33:31.071051] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.815 [2024-10-07 11:33:31.071243] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.815 [2024-10-07 11:33:31.071276] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.815 [2024-10-07 11:33:31.071293] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.815 [2024-10-07 11:33:31.071352] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.815 [2024-10-07 11:33:31.071375] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.815 [2024-10-07 11:33:31.071391] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.815 [2024-10-07 11:33:31.071525] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.815 [2024-10-07 11:33:31.071549] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.815 [2024-10-07 11:33:31.071664] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.815 [2024-10-07 11:33:31.071685] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.815 [2024-10-07 11:33:31.071699] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.815 [2024-10-07 11:33:31.071716] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.815 [2024-10-07 11:33:31.071748] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.815 [2024-10-07 11:33:31.071762] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.815 [2024-10-07 11:33:31.074262] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.815 [2024-10-07 11:33:31.074301] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.815 [2024-10-07 11:33:31.081115] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.815 [2024-10-07 11:33:31.081760] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.815 [2024-10-07 11:33:31.081859] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.815 [2024-10-07 11:33:31.081889] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.815 [2024-10-07 11:33:31.081906] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.815 [2024-10-07 11:33:31.082145] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.815 [2024-10-07 11:33:31.082185] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.815 [2024-10-07 11:33:31.082205] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.815 [2024-10-07 11:33:31.082224] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.815 [2024-10-07 11:33:31.082353] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.815 [2024-10-07 11:33:31.082378] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.815 [2024-10-07 11:33:31.082393] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.815 [2024-10-07 11:33:31.082406] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.815 [2024-10-07 11:33:31.082526] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.815 [2024-10-07 11:33:31.082547] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.815 [2024-10-07 11:33:31.082561] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.815 [2024-10-07 11:33:31.082574] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.815 [2024-10-07 11:33:31.082701] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.815 [2024-10-07 11:33:31.091209] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.815 [2024-10-07 11:33:31.091316] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.815 [2024-10-07 11:33:31.091347] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.815 [2024-10-07 11:33:31.091364] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.815 [2024-10-07 11:33:31.091388] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.815 [2024-10-07 11:33:31.091410] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.815 [2024-10-07 11:33:31.091425] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.815 [2024-10-07 11:33:31.091439] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.815 [2024-10-07 11:33:31.091462] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.815 [2024-10-07 11:33:31.091834] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.815 [2024-10-07 11:33:31.091914] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.815 [2024-10-07 11:33:31.091941] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.815 [2024-10-07 11:33:31.091957] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.815 [2024-10-07 11:33:31.091980] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.815 [2024-10-07 11:33:31.092001] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.815 [2024-10-07 11:33:31.092016] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.815 [2024-10-07 11:33:31.092036] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.815 [2024-10-07 11:33:31.092077] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.815 [2024-10-07 11:33:31.103287] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.815 [2024-10-07 11:33:31.103806] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.815 [2024-10-07 11:33:31.103903] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.815 [2024-10-07 11:33:31.103933] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.815 [2024-10-07 11:33:31.103949] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.815 [2024-10-07 11:33:31.104223] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.815 [2024-10-07 11:33:31.104264] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.815 [2024-10-07 11:33:31.104284] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.815 [2024-10-07 11:33:31.104303] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.815 [2024-10-07 11:33:31.104523] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.815 [2024-10-07 11:33:31.104577] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.815 [2024-10-07 11:33:31.104596] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.815 [2024-10-07 11:33:31.104611] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.815 [2024-10-07 11:33:31.104687] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.815 [2024-10-07 11:33:31.104710] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.815 [2024-10-07 11:33:31.104724] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.815 [2024-10-07 11:33:31.104737] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.816 [2024-10-07 11:33:31.104759] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.816 [2024-10-07 11:33:31.116470] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.816 [2024-10-07 11:33:31.116823] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.816 [2024-10-07 11:33:31.116921] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.816 [2024-10-07 11:33:31.116967] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.816 [2024-10-07 11:33:31.116986] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.816 [2024-10-07 11:33:31.117209] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.816 [2024-10-07 11:33:31.117261] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.816 [2024-10-07 11:33:31.117283] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.816 [2024-10-07 11:33:31.117302] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.816 [2024-10-07 11:33:31.117421] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.816 [2024-10-07 11:33:31.117446] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.816 [2024-10-07 11:33:31.117460] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.816 [2024-10-07 11:33:31.117474] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.816 [2024-10-07 11:33:31.117587] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.816 [2024-10-07 11:33:31.117609] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.816 [2024-10-07 11:33:31.117622] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.816 [2024-10-07 11:33:31.117636] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.816 [2024-10-07 11:33:31.117752] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.816 [2024-10-07 11:33:31.126814] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.816 [2024-10-07 11:33:31.127145] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.816 [2024-10-07 11:33:31.127195] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.816 [2024-10-07 11:33:31.127217] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.816 [2024-10-07 11:33:31.127257] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.816 [2024-10-07 11:33:31.127287] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.816 [2024-10-07 11:33:31.127313] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.816 [2024-10-07 11:33:31.127328] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.816 [2024-10-07 11:33:31.127342] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.816 [2024-10-07 11:33:31.127363] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.816 [2024-10-07 11:33:31.127417] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.816 [2024-10-07 11:33:31.127442] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.816 [2024-10-07 11:33:31.127458] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.816 [2024-10-07 11:33:31.127481] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.816 [2024-10-07 11:33:31.127502] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.816 [2024-10-07 11:33:31.127532] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.816 [2024-10-07 11:33:31.127546] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.816 [2024-10-07 11:33:31.127569] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.816 [2024-10-07 11:33:31.136894] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.816 [2024-10-07 11:33:31.137001] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.816 [2024-10-07 11:33:31.137031] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.816 [2024-10-07 11:33:31.137048] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.816 [2024-10-07 11:33:31.137071] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.816 [2024-10-07 11:33:31.137093] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.816 [2024-10-07 11:33:31.137108] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.816 [2024-10-07 11:33:31.137121] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.816 [2024-10-07 11:33:31.137144] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.816 [2024-10-07 11:33:31.137333] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.816 [2024-10-07 11:33:31.137402] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.816 [2024-10-07 11:33:31.137428] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.816 [2024-10-07 11:33:31.137444] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.816 [2024-10-07 11:33:31.137467] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.816 [2024-10-07 11:33:31.137493] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.816 [2024-10-07 11:33:31.137507] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.816 [2024-10-07 11:33:31.137520] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.816 [2024-10-07 11:33:31.137542] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.816 [2024-10-07 11:33:31.149234] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.816 [2024-10-07 11:33:31.149282] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.816 [2024-10-07 11:33:31.149370] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.816 [2024-10-07 11:33:31.149398] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.816 [2024-10-07 11:33:31.149415] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.816 [2024-10-07 11:33:31.149461] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.816 [2024-10-07 11:33:31.149484] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.816 [2024-10-07 11:33:31.149499] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.816 [2024-10-07 11:33:31.149521] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.816 [2024-10-07 11:33:31.149541] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.816 [2024-10-07 11:33:31.149576] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.816 [2024-10-07 11:33:31.149591] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.816 [2024-10-07 11:33:31.149605] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.816 [2024-10-07 11:33:31.149621] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.816 [2024-10-07 11:33:31.149635] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.816 [2024-10-07 11:33:31.149661] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.816 [2024-10-07 11:33:31.149689] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.816 [2024-10-07 11:33:31.149703] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.816 [2024-10-07 11:33:31.161173] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.816 [2024-10-07 11:33:31.161224] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.816 [2024-10-07 11:33:31.161408] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.816 [2024-10-07 11:33:31.161439] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.816 [2024-10-07 11:33:31.161456] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.816 [2024-10-07 11:33:31.161503] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.816 [2024-10-07 11:33:31.161526] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.816 [2024-10-07 11:33:31.161541] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.816 [2024-10-07 11:33:31.161704] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.816 [2024-10-07 11:33:31.161736] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.816 [2024-10-07 11:33:31.161851] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.816 [2024-10-07 11:33:31.161873] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.816 [2024-10-07 11:33:31.161888] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.816 [2024-10-07 11:33:31.161906] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.816 [2024-10-07 11:33:31.161920] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.817 [2024-10-07 11:33:31.161932] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.817 [2024-10-07 11:33:31.162033] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.817 [2024-10-07 11:33:31.162052] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.817 [2024-10-07 11:33:31.171697] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.817 [2024-10-07 11:33:31.171746] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.817 [2024-10-07 11:33:31.171924] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.817 [2024-10-07 11:33:31.171965] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.817 [2024-10-07 11:33:31.172000] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.817 [2024-10-07 11:33:31.172054] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.817 [2024-10-07 11:33:31.172078] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.817 [2024-10-07 11:33:31.172093] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.817 [2024-10-07 11:33:31.172197] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.817 [2024-10-07 11:33:31.172221] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.817 [2024-10-07 11:33:31.172321] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.817 [2024-10-07 11:33:31.172341] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.817 [2024-10-07 11:33:31.172355] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.817 [2024-10-07 11:33:31.172372] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.817 [2024-10-07 11:33:31.172386] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.817 [2024-10-07 11:33:31.172398] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.817 [2024-10-07 11:33:31.175560] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.817 [2024-10-07 11:33:31.175600] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.817 [2024-10-07 11:33:31.181809] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.817 [2024-10-07 11:33:31.181873] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.817 [2024-10-07 11:33:31.181949] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.817 [2024-10-07 11:33:31.181979] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.817 [2024-10-07 11:33:31.181995] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.817 [2024-10-07 11:33:31.182050] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.817 [2024-10-07 11:33:31.182075] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.817 [2024-10-07 11:33:31.182090] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.817 [2024-10-07 11:33:31.182108] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.817 [2024-10-07 11:33:31.182131] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.817 [2024-10-07 11:33:31.182148] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.817 [2024-10-07 11:33:31.182161] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.817 [2024-10-07 11:33:31.182175] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.817 [2024-10-07 11:33:31.182198] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.817 [2024-10-07 11:33:31.182212] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.817 [2024-10-07 11:33:31.182225] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.817 [2024-10-07 11:33:31.182253] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.817 [2024-10-07 11:33:31.182276] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.817 [2024-10-07 11:33:31.194496] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.817 [2024-10-07 11:33:31.194547] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.817 [2024-10-07 11:33:31.194866] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.817 [2024-10-07 11:33:31.194910] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.817 [2024-10-07 11:33:31.194931] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.817 [2024-10-07 11:33:31.194982] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.817 [2024-10-07 11:33:31.195006] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.817 [2024-10-07 11:33:31.195021] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.817 [2024-10-07 11:33:31.195298] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.817 [2024-10-07 11:33:31.195340] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.817 [2024-10-07 11:33:31.195400] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.817 [2024-10-07 11:33:31.195422] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.817 [2024-10-07 11:33:31.195436] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.817 [2024-10-07 11:33:31.195453] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.817 [2024-10-07 11:33:31.195467] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.817 [2024-10-07 11:33:31.195480] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.817 [2024-10-07 11:33:31.195504] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.817 [2024-10-07 11:33:31.195518] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.817 [2024-10-07 11:33:31.208638] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.817 [2024-10-07 11:33:31.208714] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.817 [2024-10-07 11:33:31.209287] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.817 [2024-10-07 11:33:31.209331] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.817 [2024-10-07 11:33:31.209352] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.817 [2024-10-07 11:33:31.209403] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.817 [2024-10-07 11:33:31.209427] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.817 [2024-10-07 11:33:31.209442] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.817 [2024-10-07 11:33:31.209690] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.817 [2024-10-07 11:33:31.209739] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.817 [2024-10-07 11:33:31.210245] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.817 [2024-10-07 11:33:31.210283] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.817 [2024-10-07 11:33:31.210301] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.817 [2024-10-07 11:33:31.210318] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.817 [2024-10-07 11:33:31.210333] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.817 [2024-10-07 11:33:31.210346] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.817 [2024-10-07 11:33:31.210568] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.817 [2024-10-07 11:33:31.210603] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.817 [2024-10-07 11:33:31.222245] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.817 [2024-10-07 11:33:31.222297] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.817 [2024-10-07 11:33:31.222385] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.817 [2024-10-07 11:33:31.222415] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.817 [2024-10-07 11:33:31.222431] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.817 [2024-10-07 11:33:31.222479] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.817 [2024-10-07 11:33:31.222517] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.817 [2024-10-07 11:33:31.222534] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.817 [2024-10-07 11:33:31.222558] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.817 [2024-10-07 11:33:31.222577] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.817 [2024-10-07 11:33:31.222601] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.817 [2024-10-07 11:33:31.222615] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.817 [2024-10-07 11:33:31.222629] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.817 [2024-10-07 11:33:31.222645] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.817 [2024-10-07 11:33:31.222675] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.817 [2024-10-07 11:33:31.222688] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.817 [2024-10-07 11:33:31.222712] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.817 [2024-10-07 11:33:31.222727] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.817 [2024-10-07 11:33:31.234417] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.817 [2024-10-07 11:33:31.234465] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.817 [2024-10-07 11:33:31.235729] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.817 [2024-10-07 11:33:31.235806] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.817 [2024-10-07 11:33:31.235826] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.818 [2024-10-07 11:33:31.235897] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.818 [2024-10-07 11:33:31.235922] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.818 [2024-10-07 11:33:31.235943] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.818 [2024-10-07 11:33:31.236241] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.818 [2024-10-07 11:33:31.236284] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.818 [2024-10-07 11:33:31.236340] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.818 [2024-10-07 11:33:31.236360] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.818 [2024-10-07 11:33:31.236374] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.818 [2024-10-07 11:33:31.236392] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.818 [2024-10-07 11:33:31.236406] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.818 [2024-10-07 11:33:31.236419] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.818 [2024-10-07 11:33:31.236442] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.818 [2024-10-07 11:33:31.236457] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.818 [2024-10-07 11:33:31.248238] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.818 [2024-10-07 11:33:31.248290] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.818 [2024-10-07 11:33:31.248901] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.818 [2024-10-07 11:33:31.248961] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.818 [2024-10-07 11:33:31.248981] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.818 [2024-10-07 11:33:31.249031] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.818 [2024-10-07 11:33:31.249054] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.818 [2024-10-07 11:33:31.249070] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.818 [2024-10-07 11:33:31.249151] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.818 [2024-10-07 11:33:31.249177] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.818 [2024-10-07 11:33:31.249198] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.818 [2024-10-07 11:33:31.249213] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.818 [2024-10-07 11:33:31.249226] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.818 [2024-10-07 11:33:31.249243] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.818 [2024-10-07 11:33:31.249257] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.818 [2024-10-07 11:33:31.249270] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.818 [2024-10-07 11:33:31.249293] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.818 [2024-10-07 11:33:31.249322] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.818 [2024-10-07 11:33:31.261650] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.818 [2024-10-07 11:33:31.261725] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.818 [2024-10-07 11:33:31.262026] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.818 [2024-10-07 11:33:31.262087] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.818 [2024-10-07 11:33:31.262107] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.818 [2024-10-07 11:33:31.262157] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.818 [2024-10-07 11:33:31.262181] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.818 [2024-10-07 11:33:31.262196] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.818 [2024-10-07 11:33:31.262508] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.818 [2024-10-07 11:33:31.262549] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.818 [2024-10-07 11:33:31.263265] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.818 [2024-10-07 11:33:31.263302] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.818 [2024-10-07 11:33:31.263320] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.818 [2024-10-07 11:33:31.263338] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.818 [2024-10-07 11:33:31.263352] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.818 [2024-10-07 11:33:31.263364] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.818 [2024-10-07 11:33:31.263801] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.818 [2024-10-07 11:33:31.263838] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.818 [2024-10-07 11:33:31.273726] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.818 [2024-10-07 11:33:31.273775] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.818 [2024-10-07 11:33:31.273962] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.818 [2024-10-07 11:33:31.273995] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.818 [2024-10-07 11:33:31.274012] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.818 [2024-10-07 11:33:31.274059] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.818 [2024-10-07 11:33:31.274083] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.818 [2024-10-07 11:33:31.274098] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.818 [2024-10-07 11:33:31.274203] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.818 [2024-10-07 11:33:31.274227] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.818 [2024-10-07 11:33:31.274989] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.818 [2024-10-07 11:33:31.275040] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.818 [2024-10-07 11:33:31.275059] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.818 [2024-10-07 11:33:31.275076] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.818 [2024-10-07 11:33:31.275090] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.818 [2024-10-07 11:33:31.275103] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.818 [2024-10-07 11:33:31.277838] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.818 [2024-10-07 11:33:31.277878] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.818 [2024-10-07 11:33:31.283835] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.818 [2024-10-07 11:33:31.283896] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.818 [2024-10-07 11:33:31.283976] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.818 [2024-10-07 11:33:31.284005] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.818 [2024-10-07 11:33:31.284021] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.818 [2024-10-07 11:33:31.284075] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.818 [2024-10-07 11:33:31.284099] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.818 [2024-10-07 11:33:31.284114] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.818 [2024-10-07 11:33:31.284132] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.818 [2024-10-07 11:33:31.284165] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.818 [2024-10-07 11:33:31.284183] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.818 [2024-10-07 11:33:31.284196] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.818 [2024-10-07 11:33:31.284210] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.818 [2024-10-07 11:33:31.284232] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.818 [2024-10-07 11:33:31.284247] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.818 [2024-10-07 11:33:31.284260] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.818 [2024-10-07 11:33:31.284273] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.818 [2024-10-07 11:33:31.284292] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.818 [2024-10-07 11:33:31.294701] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.818 [2024-10-07 11:33:31.294750] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.818 [2024-10-07 11:33:31.295873] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.818 [2024-10-07 11:33:31.295918] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.818 [2024-10-07 11:33:31.295938] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.818 [2024-10-07 11:33:31.295988] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.818 [2024-10-07 11:33:31.296038] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.818 [2024-10-07 11:33:31.296055] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.818 [2024-10-07 11:33:31.296480] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.818 [2024-10-07 11:33:31.296527] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.818 [2024-10-07 11:33:31.296760] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.819 [2024-10-07 11:33:31.296788] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.819 [2024-10-07 11:33:31.296803] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.819 [2024-10-07 11:33:31.296821] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.819 [2024-10-07 11:33:31.296835] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.819 [2024-10-07 11:33:31.296847] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.819 [2024-10-07 11:33:31.297069] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.819 [2024-10-07 11:33:31.297095] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.819 [2024-10-07 11:33:31.305692] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.819 [2024-10-07 11:33:31.305740] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.819 [2024-10-07 11:33:31.305946] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.819 [2024-10-07 11:33:31.305978] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.819 [2024-10-07 11:33:31.305994] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.819 [2024-10-07 11:33:31.306048] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.819 [2024-10-07 11:33:31.306072] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.819 [2024-10-07 11:33:31.306087] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.819 [2024-10-07 11:33:31.306214] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.819 [2024-10-07 11:33:31.306243] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.819 [2024-10-07 11:33:31.306353] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.819 [2024-10-07 11:33:31.306374] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.819 [2024-10-07 11:33:31.306388] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.819 [2024-10-07 11:33:31.306405] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.819 [2024-10-07 11:33:31.306419] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.819 [2024-10-07 11:33:31.306431] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.819 [2024-10-07 11:33:31.306534] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.819 [2024-10-07 11:33:31.306559] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.819 [2024-10-07 11:33:31.316705] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.819 [2024-10-07 11:33:31.316804] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.819 [2024-10-07 11:33:31.316885] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.819 [2024-10-07 11:33:31.316914] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.819 [2024-10-07 11:33:31.316930] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.819 [2024-10-07 11:33:31.316985] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.819 [2024-10-07 11:33:31.317010] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.819 [2024-10-07 11:33:31.317025] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.819 [2024-10-07 11:33:31.317043] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.819 [2024-10-07 11:33:31.317066] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.819 [2024-10-07 11:33:31.317083] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.819 [2024-10-07 11:33:31.317097] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.819 [2024-10-07 11:33:31.317110] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.819 [2024-10-07 11:33:31.317134] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.819 [2024-10-07 11:33:31.317157] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.819 [2024-10-07 11:33:31.317170] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.819 [2024-10-07 11:33:31.317183] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.819 [2024-10-07 11:33:31.317202] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.819 [2024-10-07 11:33:31.328666] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.819 [2024-10-07 11:33:31.328727] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.819 [2024-10-07 11:33:31.329052] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.819 [2024-10-07 11:33:31.329096] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.819 [2024-10-07 11:33:31.329117] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.819 [2024-10-07 11:33:31.329168] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.819 [2024-10-07 11:33:31.329191] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.819 [2024-10-07 11:33:31.329206] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.819 [2024-10-07 11:33:31.329366] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.819 [2024-10-07 11:33:31.329395] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.819 [2024-10-07 11:33:31.329435] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.819 [2024-10-07 11:33:31.329454] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.819 [2024-10-07 11:33:31.329484] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.819 [2024-10-07 11:33:31.329509] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.819 [2024-10-07 11:33:31.329524] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.819 [2024-10-07 11:33:31.329537] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.819 [2024-10-07 11:33:31.329560] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.819 [2024-10-07 11:33:31.329574] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.819 [2024-10-07 11:33:31.340605] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.819 [2024-10-07 11:33:31.340666] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.819 [2024-10-07 11:33:31.340869] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.819 [2024-10-07 11:33:31.340901] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.819 [2024-10-07 11:33:31.340918] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.819 [2024-10-07 11:33:31.340966] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.819 [2024-10-07 11:33:31.340990] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.819 [2024-10-07 11:33:31.341005] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.819 [2024-10-07 11:33:31.341149] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.819 [2024-10-07 11:33:31.341177] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.819 [2024-10-07 11:33:31.341285] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.819 [2024-10-07 11:33:31.341306] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.819 [2024-10-07 11:33:31.341319] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.819 [2024-10-07 11:33:31.341351] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.819 [2024-10-07 11:33:31.341365] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.819 [2024-10-07 11:33:31.341378] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.819 [2024-10-07 11:33:31.341617] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.819 [2024-10-07 11:33:31.341641] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.819 [2024-10-07 11:33:31.350747] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.820 [2024-10-07 11:33:31.350809] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.820 [2024-10-07 11:33:31.350904] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.820 [2024-10-07 11:33:31.350933] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.820 [2024-10-07 11:33:31.350949] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.820 [2024-10-07 11:33:31.351002] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.820 [2024-10-07 11:33:31.351025] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.820 [2024-10-07 11:33:31.351056] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.820 [2024-10-07 11:33:31.351075] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.820 [2024-10-07 11:33:31.351098] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.820 [2024-10-07 11:33:31.351115] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.820 [2024-10-07 11:33:31.351128] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.820 [2024-10-07 11:33:31.351141] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.820 [2024-10-07 11:33:31.351164] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.820 [2024-10-07 11:33:31.351190] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.820 [2024-10-07 11:33:31.351221] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.820 [2024-10-07 11:33:31.351235] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.820 [2024-10-07 11:33:31.351256] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.820 [2024-10-07 11:33:31.363839] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.820 [2024-10-07 11:33:31.363887] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.820 [2024-10-07 11:33:31.364014] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.820 [2024-10-07 11:33:31.364045] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.820 [2024-10-07 11:33:31.364061] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.820 [2024-10-07 11:33:31.364109] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.820 [2024-10-07 11:33:31.364132] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.820 [2024-10-07 11:33:31.364147] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.820 [2024-10-07 11:33:31.364171] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.820 [2024-10-07 11:33:31.364191] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.820 [2024-10-07 11:33:31.364211] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.820 [2024-10-07 11:33:31.364226] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.820 [2024-10-07 11:33:31.364239] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.820 [2024-10-07 11:33:31.364255] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.820 [2024-10-07 11:33:31.364269] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.820 [2024-10-07 11:33:31.364282] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.820 [2024-10-07 11:33:31.364481] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.820 [2024-10-07 11:33:31.364507] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.820 [2024-10-07 11:33:31.376083] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.820 [2024-10-07 11:33:31.376175] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.820 [2024-10-07 11:33:31.377628] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.820 [2024-10-07 11:33:31.377697] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.820 [2024-10-07 11:33:31.377718] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.820 [2024-10-07 11:33:31.377768] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.820 [2024-10-07 11:33:31.377792] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.820 [2024-10-07 11:33:31.377806] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.820 [2024-10-07 11:33:31.378415] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.820 [2024-10-07 11:33:31.378458] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.820 [2024-10-07 11:33:31.378742] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.820 [2024-10-07 11:33:31.378778] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.820 [2024-10-07 11:33:31.378795] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.820 [2024-10-07 11:33:31.378812] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.820 [2024-10-07 11:33:31.378826] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.820 [2024-10-07 11:33:31.378838] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.820 [2024-10-07 11:33:31.378892] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.820 [2024-10-07 11:33:31.378912] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.820 [2024-10-07 11:33:31.387089] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.820 [2024-10-07 11:33:31.387135] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.820 [2024-10-07 11:33:31.387378] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.820 [2024-10-07 11:33:31.387410] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.820 [2024-10-07 11:33:31.387426] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.820 [2024-10-07 11:33:31.387474] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.820 [2024-10-07 11:33:31.387497] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.820 [2024-10-07 11:33:31.387512] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.820 [2024-10-07 11:33:31.387639] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.820 [2024-10-07 11:33:31.387681] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.820 [2024-10-07 11:33:31.387797] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.820 [2024-10-07 11:33:31.387818] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.820 [2024-10-07 11:33:31.387832] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.820 [2024-10-07 11:33:31.387863] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.820 [2024-10-07 11:33:31.387881] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.820 [2024-10-07 11:33:31.387894] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.820 [2024-10-07 11:33:31.387996] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.820 [2024-10-07 11:33:31.388015] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.820 [2024-10-07 11:33:31.397743] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.820 [2024-10-07 11:33:31.397807] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.820 [2024-10-07 11:33:31.397919] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.820 [2024-10-07 11:33:31.397950] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.820 [2024-10-07 11:33:31.397967] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.820 [2024-10-07 11:33:31.398014] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.820 [2024-10-07 11:33:31.398038] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.820 [2024-10-07 11:33:31.398053] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.820 [2024-10-07 11:33:31.398077] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.820 [2024-10-07 11:33:31.398097] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.820 [2024-10-07 11:33:31.398116] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.820 [2024-10-07 11:33:31.398130] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.820 [2024-10-07 11:33:31.398144] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.820 [2024-10-07 11:33:31.398159] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.820 [2024-10-07 11:33:31.398174] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.820 [2024-10-07 11:33:31.398186] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.820 [2024-10-07 11:33:31.398209] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.820 [2024-10-07 11:33:31.398223] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.820 [2024-10-07 11:33:31.408353] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.820 [2024-10-07 11:33:31.408401] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.820 [2024-10-07 11:33:31.408566] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.820 [2024-10-07 11:33:31.408605] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.820 [2024-10-07 11:33:31.408622] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.820 [2024-10-07 11:33:31.408686] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.820 [2024-10-07 11:33:31.408712] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.820 [2024-10-07 11:33:31.408727] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.821 [2024-10-07 11:33:31.410235] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.821 [2024-10-07 11:33:31.410280] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.821 [2024-10-07 11:33:31.410350] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.821 [2024-10-07 11:33:31.410375] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.821 [2024-10-07 11:33:31.410389] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.821 [2024-10-07 11:33:31.410406] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.821 [2024-10-07 11:33:31.410421] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.821 [2024-10-07 11:33:31.410434] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.821 [2024-10-07 11:33:31.410457] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.821 [2024-10-07 11:33:31.410471] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.821 [2024-10-07 11:33:31.418462] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.821 [2024-10-07 11:33:31.418525] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.821 [2024-10-07 11:33:31.418603] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.821 [2024-10-07 11:33:31.418632] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.821 [2024-10-07 11:33:31.418661] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.821 [2024-10-07 11:33:31.418730] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.821 [2024-10-07 11:33:31.418755] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.821 [2024-10-07 11:33:31.418786] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.821 [2024-10-07 11:33:31.418804] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.821 [2024-10-07 11:33:31.418828] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.821 [2024-10-07 11:33:31.418845] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.821 [2024-10-07 11:33:31.418859] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.821 [2024-10-07 11:33:31.418872] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.821 [2024-10-07 11:33:31.418896] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.821 [2024-10-07 11:33:31.418910] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.821 [2024-10-07 11:33:31.418923] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.821 [2024-10-07 11:33:31.418936] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.821 [2024-10-07 11:33:31.418959] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.821 [2024-10-07 11:33:31.431502] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.821 [2024-10-07 11:33:31.431551] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.821 [2024-10-07 11:33:31.431669] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.821 [2024-10-07 11:33:31.431701] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.821 [2024-10-07 11:33:31.431718] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.821 [2024-10-07 11:33:31.431768] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.821 [2024-10-07 11:33:31.431791] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.821 [2024-10-07 11:33:31.431806] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.821 [2024-10-07 11:33:31.432374] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.821 [2024-10-07 11:33:31.432417] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.821 [2024-10-07 11:33:31.432532] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.821 [2024-10-07 11:33:31.432557] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.821 [2024-10-07 11:33:31.432580] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.821 [2024-10-07 11:33:31.432597] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.821 [2024-10-07 11:33:31.432611] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.821 [2024-10-07 11:33:31.432624] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.821 [2024-10-07 11:33:31.432660] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.821 [2024-10-07 11:33:31.432678] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.821 [2024-10-07 11:33:31.442051] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.821 [2024-10-07 11:33:31.442099] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.821 [2024-10-07 11:33:31.442264] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.821 [2024-10-07 11:33:31.442294] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.821 [2024-10-07 11:33:31.442311] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.821 [2024-10-07 11:33:31.442358] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.821 [2024-10-07 11:33:31.442381] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.821 [2024-10-07 11:33:31.442406] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.821 [2024-10-07 11:33:31.442519] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.821 [2024-10-07 11:33:31.442543] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.821 [2024-10-07 11:33:31.442641] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.821 [2024-10-07 11:33:31.442677] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.821 [2024-10-07 11:33:31.442692] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.821 [2024-10-07 11:33:31.442708] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.821 [2024-10-07 11:33:31.442738] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.821 [2024-10-07 11:33:31.442752] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.821 [2024-10-07 11:33:31.443073] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.821 [2024-10-07 11:33:31.443099] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.821 [2024-10-07 11:33:31.453086] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.821 [2024-10-07 11:33:31.453135] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.821 [2024-10-07 11:33:31.453342] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.821 [2024-10-07 11:33:31.453384] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.821 [2024-10-07 11:33:31.453401] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.821 [2024-10-07 11:33:31.453461] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.821 [2024-10-07 11:33:31.453484] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.821 [2024-10-07 11:33:31.453499] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.821 [2024-10-07 11:33:31.453614] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.821 [2024-10-07 11:33:31.453640] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.821 [2024-10-07 11:33:31.453767] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.821 [2024-10-07 11:33:31.453788] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.821 [2024-10-07 11:33:31.453802] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.821 [2024-10-07 11:33:31.453819] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.821 [2024-10-07 11:33:31.453833] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.821 [2024-10-07 11:33:31.453846] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.821 [2024-10-07 11:33:31.453950] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.821 [2024-10-07 11:33:31.453969] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.821 [2024-10-07 11:33:31.464492] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.821 [2024-10-07 11:33:31.464541] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.821 [2024-10-07 11:33:31.464831] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.821 [2024-10-07 11:33:31.464877] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.821 [2024-10-07 11:33:31.464897] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.821 [2024-10-07 11:33:31.464948] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.821 [2024-10-07 11:33:31.464971] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.821 [2024-10-07 11:33:31.464987] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.821 [2024-10-07 11:33:31.465061] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.821 [2024-10-07 11:33:31.465088] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.821 [2024-10-07 11:33:31.465260] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.821 [2024-10-07 11:33:31.465285] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.821 [2024-10-07 11:33:31.465300] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.821 [2024-10-07 11:33:31.465317] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.821 [2024-10-07 11:33:31.465333] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.822 [2024-10-07 11:33:31.465345] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.822 [2024-10-07 11:33:31.465401] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.822 [2024-10-07 11:33:31.465422] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.822 [2024-10-07 11:33:31.474618] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.822 [2024-10-07 11:33:31.474708] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.822 [2024-10-07 11:33:31.474795] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.822 [2024-10-07 11:33:31.474825] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.822 [2024-10-07 11:33:31.474842] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.822 [2024-10-07 11:33:31.474896] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.822 [2024-10-07 11:33:31.474920] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.822 [2024-10-07 11:33:31.474936] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.822 [2024-10-07 11:33:31.474953] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.822 [2024-10-07 11:33:31.474976] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.822 [2024-10-07 11:33:31.474993] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.822 [2024-10-07 11:33:31.475013] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.822 [2024-10-07 11:33:31.475027] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.822 [2024-10-07 11:33:31.475050] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.822 [2024-10-07 11:33:31.475064] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.822 [2024-10-07 11:33:31.475077] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.822 [2024-10-07 11:33:31.475090] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.822 [2024-10-07 11:33:31.475111] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.822 [2024-10-07 11:33:31.484897] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.822 [2024-10-07 11:33:31.484945] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.822 [2024-10-07 11:33:31.485040] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.822 [2024-10-07 11:33:31.485086] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.822 [2024-10-07 11:33:31.485104] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.822 [2024-10-07 11:33:31.485165] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.822 [2024-10-07 11:33:31.485189] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.822 [2024-10-07 11:33:31.485204] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.822 [2024-10-07 11:33:31.485382] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.822 [2024-10-07 11:33:31.485413] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.822 [2024-10-07 11:33:31.485469] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.822 [2024-10-07 11:33:31.485490] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.822 [2024-10-07 11:33:31.485504] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.822 [2024-10-07 11:33:31.485526] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.822 [2024-10-07 11:33:31.485541] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.822 [2024-10-07 11:33:31.485553] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.822 [2024-10-07 11:33:31.485576] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.822 [2024-10-07 11:33:31.485591] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.822 [2024-10-07 11:33:31.495448] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.822 [2024-10-07 11:33:31.495497] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.822 [2024-10-07 11:33:31.495694] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.822 [2024-10-07 11:33:31.495726] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.822 [2024-10-07 11:33:31.495743] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.822 [2024-10-07 11:33:31.495792] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.822 [2024-10-07 11:33:31.495815] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.822 [2024-10-07 11:33:31.495830] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.822 [2024-10-07 11:33:31.495936] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.822 [2024-10-07 11:33:31.495961] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.822 [2024-10-07 11:33:31.496083] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.822 [2024-10-07 11:33:31.496105] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.822 [2024-10-07 11:33:31.496119] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.822 [2024-10-07 11:33:31.496136] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.822 [2024-10-07 11:33:31.496151] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.822 [2024-10-07 11:33:31.496178] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.822 [2024-10-07 11:33:31.496899] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.822 [2024-10-07 11:33:31.496935] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.822 [2024-10-07 11:33:31.505743] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.822 [2024-10-07 11:33:31.506091] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.822 [2024-10-07 11:33:31.506189] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.822 [2024-10-07 11:33:31.506218] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.822 [2024-10-07 11:33:31.506235] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.822 [2024-10-07 11:33:31.506320] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.822 [2024-10-07 11:33:31.506347] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.822 [2024-10-07 11:33:31.506363] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.822 [2024-10-07 11:33:31.506381] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.822 [2024-10-07 11:33:31.506406] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.822 [2024-10-07 11:33:31.506423] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.822 [2024-10-07 11:33:31.506437] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.822 [2024-10-07 11:33:31.506451] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.822 [2024-10-07 11:33:31.506474] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.822 [2024-10-07 11:33:31.506489] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.822 [2024-10-07 11:33:31.506501] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.822 [2024-10-07 11:33:31.506514] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.822 [2024-10-07 11:33:31.506535] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.822 [2024-10-07 11:33:31.515923] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.822 [2024-10-07 11:33:31.516029] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.822 [2024-10-07 11:33:31.516059] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.822 [2024-10-07 11:33:31.516076] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.822 [2024-10-07 11:33:31.516100] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.822 [2024-10-07 11:33:31.516122] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.822 [2024-10-07 11:33:31.516136] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.822 [2024-10-07 11:33:31.516149] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.822 [2024-10-07 11:33:31.516172] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.822 [2024-10-07 11:33:31.516232] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.822 [2024-10-07 11:33:31.516306] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.822 [2024-10-07 11:33:31.516333] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.822 [2024-10-07 11:33:31.516349] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.822 [2024-10-07 11:33:31.516372] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.822 [2024-10-07 11:33:31.516394] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.822 [2024-10-07 11:33:31.516408] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.822 [2024-10-07 11:33:31.516421] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.822 [2024-10-07 11:33:31.516459] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.822 [2024-10-07 11:33:31.526359] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.822 [2024-10-07 11:33:31.526594] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.822 [2024-10-07 11:33:31.526629] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.823 [2024-10-07 11:33:31.526663] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.823 [2024-10-07 11:33:31.526775] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.823 [2024-10-07 11:33:31.526810] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.823 [2024-10-07 11:33:31.527229] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.823 [2024-10-07 11:33:31.527270] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.823 [2024-10-07 11:33:31.527289] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.823 [2024-10-07 11:33:31.527304] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.823 [2024-10-07 11:33:31.527317] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.823 [2024-10-07 11:33:31.527330] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.823 [2024-10-07 11:33:31.527398] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.823 [2024-10-07 11:33:31.527422] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.823 [2024-10-07 11:33:31.527447] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.823 [2024-10-07 11:33:31.527462] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.823 [2024-10-07 11:33:31.527475] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.823 [2024-10-07 11:33:31.527497] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.823 [2024-10-07 11:33:31.536761] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.823 [2024-10-07 11:33:31.537008] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.823 [2024-10-07 11:33:31.537052] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.823 [2024-10-07 11:33:31.537073] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.823 [2024-10-07 11:33:31.537423] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.823 [2024-10-07 11:33:31.539025] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.823 [2024-10-07 11:33:31.539078] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.823 [2024-10-07 11:33:31.539097] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.823 [2024-10-07 11:33:31.539111] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.823 [2024-10-07 11:33:31.539737] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.823 [2024-10-07 11:33:31.539820] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.823 [2024-10-07 11:33:31.539848] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.823 [2024-10-07 11:33:31.539864] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.823 [2024-10-07 11:33:31.540133] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.823 [2024-10-07 11:33:31.540209] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.823 [2024-10-07 11:33:31.540231] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.823 [2024-10-07 11:33:31.540245] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.823 [2024-10-07 11:33:31.540270] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.823 [2024-10-07 11:33:31.547777] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.823 [2024-10-07 11:33:31.548017] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.823 [2024-10-07 11:33:31.548051] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.823 [2024-10-07 11:33:31.548069] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.823 [2024-10-07 11:33:31.548185] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.823 [2024-10-07 11:33:31.548300] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.823 [2024-10-07 11:33:31.548320] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.823 [2024-10-07 11:33:31.548334] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.823 [2024-10-07 11:33:31.548442] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.823 [2024-10-07 11:33:31.552021] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.823 [2024-10-07 11:33:31.552203] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.823 [2024-10-07 11:33:31.552234] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.823 [2024-10-07 11:33:31.552251] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.823 [2024-10-07 11:33:31.552378] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.823 [2024-10-07 11:33:31.552497] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.823 [2024-10-07 11:33:31.552520] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.823 [2024-10-07 11:33:31.552549] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.823 [2024-10-07 11:33:31.552670] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.823 [2024-10-07 11:33:31.558215] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.823 [2024-10-07 11:33:31.558374] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.823 [2024-10-07 11:33:31.558405] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.823 [2024-10-07 11:33:31.558422] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.823 [2024-10-07 11:33:31.558446] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.823 [2024-10-07 11:33:31.558468] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.823 [2024-10-07 11:33:31.558482] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.823 [2024-10-07 11:33:31.558496] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.823 [2024-10-07 11:33:31.558519] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.823 [2024-10-07 11:33:31.563309] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.823 [2024-10-07 11:33:31.563434] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.823 [2024-10-07 11:33:31.563465] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.823 [2024-10-07 11:33:31.563482] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.823 [2024-10-07 11:33:31.563506] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.823 [2024-10-07 11:33:31.563539] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.823 [2024-10-07 11:33:31.563553] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.823 [2024-10-07 11:33:31.563566] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.823 [2024-10-07 11:33:31.563590] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.823 [2024-10-07 11:33:31.568298] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.823 [2024-10-07 11:33:31.568403] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.823 [2024-10-07 11:33:31.568433] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.823 [2024-10-07 11:33:31.568450] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.823 [2024-10-07 11:33:31.568474] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.823 [2024-10-07 11:33:31.568497] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.823 [2024-10-07 11:33:31.568512] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.823 [2024-10-07 11:33:31.568532] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.823 [2024-10-07 11:33:31.568564] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.823 [2024-10-07 11:33:31.573981] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.823 [2024-10-07 11:33:31.574137] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.823 [2024-10-07 11:33:31.574168] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.823 [2024-10-07 11:33:31.574185] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.823 [2024-10-07 11:33:31.574209] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.823 [2024-10-07 11:33:31.574231] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.823 [2024-10-07 11:33:31.574246] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.823 [2024-10-07 11:33:31.574259] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.823 [2024-10-07 11:33:31.574282] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.823 [2024-10-07 11:33:31.578717] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.823 [2024-10-07 11:33:31.578857] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.823 [2024-10-07 11:33:31.578889] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.823 [2024-10-07 11:33:31.578906] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.824 [2024-10-07 11:33:31.578929] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.824 [2024-10-07 11:33:31.578952] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.824 [2024-10-07 11:33:31.578966] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.824 [2024-10-07 11:33:31.578979] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.824 [2024-10-07 11:33:31.579002] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.824 [2024-10-07 11:33:31.584456] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.824 [2024-10-07 11:33:31.584660] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.824 [2024-10-07 11:33:31.584692] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.824 [2024-10-07 11:33:31.584709] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.824 [2024-10-07 11:33:31.585620] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.824 [2024-10-07 11:33:31.586009] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.824 [2024-10-07 11:33:31.586047] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.824 [2024-10-07 11:33:31.586065] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.824 [2024-10-07 11:33:31.588393] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.824 [2024-10-07 11:33:31.588987] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.824 [2024-10-07 11:33:31.589227] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.824 [2024-10-07 11:33:31.589275] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.824 [2024-10-07 11:33:31.589296] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.824 [2024-10-07 11:33:31.589365] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.824 [2024-10-07 11:33:31.589396] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.824 [2024-10-07 11:33:31.589411] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.824 [2024-10-07 11:33:31.589424] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.824 [2024-10-07 11:33:31.589448] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.824 [2024-10-07 11:33:31.597700] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.824 [2024-10-07 11:33:31.597967] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.824 [2024-10-07 11:33:31.598012] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.824 [2024-10-07 11:33:31.598032] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.824 [2024-10-07 11:33:31.598212] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.824 [2024-10-07 11:33:31.598332] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.824 [2024-10-07 11:33:31.598363] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.824 [2024-10-07 11:33:31.598380] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.824 [2024-10-07 11:33:31.598484] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.824 [2024-10-07 11:33:31.601212] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.824 [2024-10-07 11:33:31.601446] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.824 [2024-10-07 11:33:31.601482] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.824 [2024-10-07 11:33:31.601501] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.824 [2024-10-07 11:33:31.601594] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.824 [2024-10-07 11:33:31.601621] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.824 [2024-10-07 11:33:31.601635] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.824 [2024-10-07 11:33:31.601662] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.824 [2024-10-07 11:33:31.601689] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.824 [2024-10-07 11:33:31.609855] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.824 [2024-10-07 11:33:31.610316] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.824 [2024-10-07 11:33:31.610359] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.824 [2024-10-07 11:33:31.610379] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.824 [2024-10-07 11:33:31.610472] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.824 [2024-10-07 11:33:31.610781] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.824 [2024-10-07 11:33:31.610816] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.824 [2024-10-07 11:33:31.610849] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.824 [2024-10-07 11:33:31.611037] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.824 [2024-10-07 11:33:31.611363] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.824 [2024-10-07 11:33:31.612579] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.824 [2024-10-07 11:33:31.612635] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.824 [2024-10-07 11:33:31.612655] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.824 [2024-10-07 11:33:31.614880] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.824 [2024-10-07 11:33:31.615353] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.824 [2024-10-07 11:33:31.615391] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.824 [2024-10-07 11:33:31.615408] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.824 [2024-10-07 11:33:31.615582] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.824 [2024-10-07 11:33:31.619948] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.824 [2024-10-07 11:33:31.620065] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.824 [2024-10-07 11:33:31.620094] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.824 [2024-10-07 11:33:31.620111] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.824 [2024-10-07 11:33:31.620134] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.824 [2024-10-07 11:33:31.620156] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.824 [2024-10-07 11:33:31.620171] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.824 [2024-10-07 11:33:31.620184] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.824 [2024-10-07 11:33:31.620207] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.824 [2024-10-07 11:33:31.621670] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.824 [2024-10-07 11:33:31.621902] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.824 [2024-10-07 11:33:31.621932] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.824 [2024-10-07 11:33:31.621948] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.824 [2024-10-07 11:33:31.622128] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.824 [2024-10-07 11:33:31.622284] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.824 [2024-10-07 11:33:31.622333] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.824 [2024-10-07 11:33:31.622350] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.824 [2024-10-07 11:33:31.622453] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.824 [2024-10-07 11:33:31.630037] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.824 [2024-10-07 11:33:31.630155] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.824 [2024-10-07 11:33:31.630201] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.824 [2024-10-07 11:33:31.630218] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.824 [2024-10-07 11:33:31.630241] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.824 [2024-10-07 11:33:31.630263] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.824 [2024-10-07 11:33:31.630277] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.824 [2024-10-07 11:33:31.630290] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.824 [2024-10-07 11:33:31.630313] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.824 [2024-10-07 11:33:31.631794] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.824 [2024-10-07 11:33:31.631894] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.824 [2024-10-07 11:33:31.631923] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.824 [2024-10-07 11:33:31.631940] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.824 [2024-10-07 11:33:31.631963] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.825 [2024-10-07 11:33:31.631984] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.825 [2024-10-07 11:33:31.631998] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.825 [2024-10-07 11:33:31.632012] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.825 [2024-10-07 11:33:31.632037] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.825 [2024-10-07 11:33:31.641961] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.825 [2024-10-07 11:33:31.642196] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.825 [2024-10-07 11:33:31.642231] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.825 [2024-10-07 11:33:31.642248] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.825 [2024-10-07 11:33:31.642364] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.825 [2024-10-07 11:33:31.642401] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.825 [2024-10-07 11:33:31.642543] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.825 [2024-10-07 11:33:31.642572] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.825 [2024-10-07 11:33:31.642588] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.825 [2024-10-07 11:33:31.642602] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.825 [2024-10-07 11:33:31.642615] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.825 [2024-10-07 11:33:31.642628] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.825 [2024-10-07 11:33:31.643001] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.825 [2024-10-07 11:33:31.643042] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.825 [2024-10-07 11:33:31.645242] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.825 [2024-10-07 11:33:31.645281] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.825 [2024-10-07 11:33:31.645315] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.825 [2024-10-07 11:33:31.646100] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.825 [2024-10-07 11:33:31.653182] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.825 [2024-10-07 11:33:31.653393] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.825 [2024-10-07 11:33:31.653474] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.825 [2024-10-07 11:33:31.653503] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.825 [2024-10-07 11:33:31.653520] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.825 [2024-10-07 11:33:31.653713] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.825 [2024-10-07 11:33:31.653741] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.825 [2024-10-07 11:33:31.653758] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.825 [2024-10-07 11:33:31.653775] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.825 [2024-10-07 11:33:31.653887] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.825 [2024-10-07 11:33:31.653910] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.825 [2024-10-07 11:33:31.653924] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.825 [2024-10-07 11:33:31.653937] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.825 [2024-10-07 11:33:31.654063] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.825 [2024-10-07 11:33:31.654083] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.825 [2024-10-07 11:33:31.654096] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.825 [2024-10-07 11:33:31.654110] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.825 [2024-10-07 11:33:31.654207] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.825 [2024-10-07 11:33:31.664132] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.825 [2024-10-07 11:33:31.664194] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.825 [2024-10-07 11:33:31.664294] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.825 [2024-10-07 11:33:31.664323] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.825 [2024-10-07 11:33:31.664340] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.825 [2024-10-07 11:33:31.664386] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.825 [2024-10-07 11:33:31.664409] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.825 [2024-10-07 11:33:31.664423] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.825 [2024-10-07 11:33:31.664463] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.825 [2024-10-07 11:33:31.664485] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.825 [2024-10-07 11:33:31.664504] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.825 [2024-10-07 11:33:31.664519] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.825 [2024-10-07 11:33:31.664532] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.825 [2024-10-07 11:33:31.664548] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.825 [2024-10-07 11:33:31.664563] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.825 [2024-10-07 11:33:31.664575] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.825 [2024-10-07 11:33:31.664598] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.825 [2024-10-07 11:33:31.664612] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.825 [2024-10-07 11:33:31.675525] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.825 [2024-10-07 11:33:31.675574] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.825 [2024-10-07 11:33:31.675716] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.825 [2024-10-07 11:33:31.675747] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.825 [2024-10-07 11:33:31.675765] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.825 [2024-10-07 11:33:31.675811] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.825 [2024-10-07 11:33:31.675834] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.825 [2024-10-07 11:33:31.675850] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.825 [2024-10-07 11:33:31.675873] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.825 [2024-10-07 11:33:31.675893] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.825 [2024-10-07 11:33:31.675913] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.825 [2024-10-07 11:33:31.675927] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.825 [2024-10-07 11:33:31.675941] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.825 [2024-10-07 11:33:31.675956] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.825 [2024-10-07 11:33:31.675971] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.825 [2024-10-07 11:33:31.675984] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.825 [2024-10-07 11:33:31.676006] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.825 [2024-10-07 11:33:31.676021] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.825 [2024-10-07 11:33:31.687197] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.825 [2024-10-07 11:33:31.687246] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.825 [2024-10-07 11:33:31.687524] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.825 [2024-10-07 11:33:31.687573] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.825 [2024-10-07 11:33:31.687592] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.825 [2024-10-07 11:33:31.687642] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.825 [2024-10-07 11:33:31.687681] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.825 [2024-10-07 11:33:31.687697] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.825 [2024-10-07 11:33:31.687831] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.825 [2024-10-07 11:33:31.687860] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.825 [2024-10-07 11:33:31.689735] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.825 [2024-10-07 11:33:31.689774] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.825 [2024-10-07 11:33:31.689792] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.825 [2024-10-07 11:33:31.689809] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.825 [2024-10-07 11:33:31.689824] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.825 [2024-10-07 11:33:31.689837] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.825 [2024-10-07 11:33:31.690581] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.825 [2024-10-07 11:33:31.690616] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.825 [2024-10-07 11:33:31.697939] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.825 [2024-10-07 11:33:31.697982] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.825 [2024-10-07 11:33:31.698079] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.826 [2024-10-07 11:33:31.698107] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.826 [2024-10-07 11:33:31.698122] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.826 [2024-10-07 11:33:31.698166] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.826 [2024-10-07 11:33:31.698188] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.826 [2024-10-07 11:33:31.698203] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.826 [2024-10-07 11:33:31.698224] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.826 [2024-10-07 11:33:31.698242] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.826 [2024-10-07 11:33:31.698261] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.826 [2024-10-07 11:33:31.698275] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.826 [2024-10-07 11:33:31.698287] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.826 [2024-10-07 11:33:31.698302] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.826 [2024-10-07 11:33:31.698315] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.826 [2024-10-07 11:33:31.698349] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.826 [2024-10-07 11:33:31.701249] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.826 [2024-10-07 11:33:31.701289] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.826 [2024-10-07 11:33:31.708055] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.826 [2024-10-07 11:33:31.708128] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.826 [2024-10-07 11:33:31.708212] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.826 [2024-10-07 11:33:31.708240] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.826 [2024-10-07 11:33:31.708256] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.826 [2024-10-07 11:33:31.708307] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.826 [2024-10-07 11:33:31.708330] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.826 [2024-10-07 11:33:31.708344] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.826 [2024-10-07 11:33:31.708361] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.826 [2024-10-07 11:33:31.708383] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.826 [2024-10-07 11:33:31.708399] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.826 [2024-10-07 11:33:31.708412] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.826 [2024-10-07 11:33:31.708425] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.826 [2024-10-07 11:33:31.708447] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.826 [2024-10-07 11:33:31.708460] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.826 [2024-10-07 11:33:31.708472] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.826 [2024-10-07 11:33:31.708485] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.826 [2024-10-07 11:33:31.708504] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.826 [2024-10-07 11:33:31.718253] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.826 [2024-10-07 11:33:31.718300] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.826 [2024-10-07 11:33:31.718399] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.826 [2024-10-07 11:33:31.718428] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.826 [2024-10-07 11:33:31.718445] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.826 [2024-10-07 11:33:31.718491] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.826 [2024-10-07 11:33:31.718513] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.826 [2024-10-07 11:33:31.718528] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.826 [2024-10-07 11:33:31.718551] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.826 [2024-10-07 11:33:31.718587] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.826 [2024-10-07 11:33:31.718609] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.826 [2024-10-07 11:33:31.718624] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.826 [2024-10-07 11:33:31.718637] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.826 [2024-10-07 11:33:31.718653] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.826 [2024-10-07 11:33:31.718699] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.826 [2024-10-07 11:33:31.718713] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.826 [2024-10-07 11:33:31.718736] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.826 [2024-10-07 11:33:31.718750] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.826 [2024-10-07 11:33:31.731785] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.826 [2024-10-07 11:33:31.731864] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.826 [2024-10-07 11:33:31.732041] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.826 [2024-10-07 11:33:31.732072] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.826 [2024-10-07 11:33:31.732088] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.826 [2024-10-07 11:33:31.732151] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.826 [2024-10-07 11:33:31.732174] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.826 [2024-10-07 11:33:31.732188] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.826 [2024-10-07 11:33:31.732211] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.826 [2024-10-07 11:33:31.732231] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.826 [2024-10-07 11:33:31.732251] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.826 [2024-10-07 11:33:31.732266] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.826 [2024-10-07 11:33:31.732279] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.826 [2024-10-07 11:33:31.732295] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.826 [2024-10-07 11:33:31.732310] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.826 [2024-10-07 11:33:31.732322] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.826 [2024-10-07 11:33:31.732345] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.826 [2024-10-07 11:33:31.732360] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.826 [2024-10-07 11:33:31.743727] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.826 [2024-10-07 11:33:31.743773] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.826 [2024-10-07 11:33:31.743988] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.826 [2024-10-07 11:33:31.744020] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.826 [2024-10-07 11:33:31.744053] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.826 [2024-10-07 11:33:31.744106] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.826 [2024-10-07 11:33:31.744130] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.826 [2024-10-07 11:33:31.744145] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.826 [2024-10-07 11:33:31.744273] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.826 [2024-10-07 11:33:31.744318] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.826 [2024-10-07 11:33:31.744439] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.826 [2024-10-07 11:33:31.744462] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.826 [2024-10-07 11:33:31.744476] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.826 [2024-10-07 11:33:31.744493] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.826 [2024-10-07 11:33:31.744508] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.826 [2024-10-07 11:33:31.744520] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.826 [2024-10-07 11:33:31.744633] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.826 [2024-10-07 11:33:31.744676] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.826 [2024-10-07 11:33:31.754078] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.826 [2024-10-07 11:33:31.754126] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.826 [2024-10-07 11:33:31.754227] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.826 [2024-10-07 11:33:31.754256] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.826 [2024-10-07 11:33:31.754272] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.826 [2024-10-07 11:33:31.754319] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.826 [2024-10-07 11:33:31.754342] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.826 [2024-10-07 11:33:31.754356] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.826 [2024-10-07 11:33:31.754380] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.826 [2024-10-07 11:33:31.754400] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.827 [2024-10-07 11:33:31.754419] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.827 [2024-10-07 11:33:31.754433] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.827 [2024-10-07 11:33:31.754447] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.827 [2024-10-07 11:33:31.754463] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.827 [2024-10-07 11:33:31.754477] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.827 [2024-10-07 11:33:31.754489] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.827 [2024-10-07 11:33:31.754772] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.827 [2024-10-07 11:33:31.754800] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.827 [2024-10-07 11:33:31.764206] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.827 [2024-10-07 11:33:31.764269] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.827 [2024-10-07 11:33:31.764344] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.827 [2024-10-07 11:33:31.764373] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.827 [2024-10-07 11:33:31.764390] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.827 [2024-10-07 11:33:31.764444] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.827 [2024-10-07 11:33:31.764468] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.827 [2024-10-07 11:33:31.764483] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.827 [2024-10-07 11:33:31.764501] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.827 [2024-10-07 11:33:31.764524] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.827 [2024-10-07 11:33:31.764541] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.827 [2024-10-07 11:33:31.764554] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.827 [2024-10-07 11:33:31.764567] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.827 [2024-10-07 11:33:31.764590] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.827 [2024-10-07 11:33:31.764605] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.827 [2024-10-07 11:33:31.764618] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.827 [2024-10-07 11:33:31.764630] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.827 [2024-10-07 11:33:31.764665] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.827 [2024-10-07 11:33:31.776563] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.827 [2024-10-07 11:33:31.776612] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.827 [2024-10-07 11:33:31.776921] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.827 [2024-10-07 11:33:31.776965] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.827 [2024-10-07 11:33:31.776986] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.827 [2024-10-07 11:33:31.777037] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.827 [2024-10-07 11:33:31.777060] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.827 [2024-10-07 11:33:31.777075] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.827 [2024-10-07 11:33:31.777129] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.827 [2024-10-07 11:33:31.777155] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.827 [2024-10-07 11:33:31.777199] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.827 [2024-10-07 11:33:31.777215] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.827 [2024-10-07 11:33:31.777228] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.827 [2024-10-07 11:33:31.777245] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.827 [2024-10-07 11:33:31.777260] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.827 [2024-10-07 11:33:31.777273] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.827 [2024-10-07 11:33:31.777523] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.827 [2024-10-07 11:33:31.777547] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.827 [2024-10-07 11:33:31.791153] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.827 [2024-10-07 11:33:31.791213] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.827 [2024-10-07 11:33:31.791304] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.827 [2024-10-07 11:33:31.791333] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.827 [2024-10-07 11:33:31.791349] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.827 [2024-10-07 11:33:31.791396] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.827 [2024-10-07 11:33:31.791420] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.827 [2024-10-07 11:33:31.791435] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.827 [2024-10-07 11:33:31.791458] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.827 [2024-10-07 11:33:31.791478] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.827 [2024-10-07 11:33:31.791498] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.827 [2024-10-07 11:33:31.791513] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.827 [2024-10-07 11:33:31.791526] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.827 [2024-10-07 11:33:31.791542] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.827 [2024-10-07 11:33:31.791556] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.827 [2024-10-07 11:33:31.791568] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.827 [2024-10-07 11:33:31.791591] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.827 [2024-10-07 11:33:31.791605] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.827 [2024-10-07 11:33:31.805324] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.827 [2024-10-07 11:33:31.805375] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.827 [2024-10-07 11:33:31.806580] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.827 [2024-10-07 11:33:31.806625] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.827 [2024-10-07 11:33:31.806660] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.827 [2024-10-07 11:33:31.806735] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.827 [2024-10-07 11:33:31.806760] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.827 [2024-10-07 11:33:31.806776] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.827 [2024-10-07 11:33:31.807389] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.827 [2024-10-07 11:33:31.807433] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.827 [2024-10-07 11:33:31.807684] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.827 [2024-10-07 11:33:31.807720] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.827 [2024-10-07 11:33:31.807737] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.827 [2024-10-07 11:33:31.807756] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.827 [2024-10-07 11:33:31.807770] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.827 [2024-10-07 11:33:31.807783] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.827 [2024-10-07 11:33:31.807837] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.827 [2024-10-07 11:33:31.807857] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.827 [2024-10-07 11:33:31.815670] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.827 [2024-10-07 11:33:31.815732] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.827 [2024-10-07 11:33:31.815891] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.827 [2024-10-07 11:33:31.815921] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.827 [2024-10-07 11:33:31.815937] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.827 [2024-10-07 11:33:31.815983] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.827 [2024-10-07 11:33:31.816006] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.827 [2024-10-07 11:33:31.816021] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.827 [2024-10-07 11:33:31.816129] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.827 [2024-10-07 11:33:31.816155] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.827 [2024-10-07 11:33:31.816871] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.827 [2024-10-07 11:33:31.816899] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.828 [2024-10-07 11:33:31.816914] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.828 [2024-10-07 11:33:31.816930] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.828 [2024-10-07 11:33:31.816946] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.828 [2024-10-07 11:33:31.816958] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.828 [2024-10-07 11:33:31.820238] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.828 [2024-10-07 11:33:31.820295] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.828 [2024-10-07 11:33:31.825972] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.828 [2024-10-07 11:33:31.826025] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.828 [2024-10-07 11:33:31.826110] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.828 [2024-10-07 11:33:31.826139] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.828 [2024-10-07 11:33:31.826156] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.828 [2024-10-07 11:33:31.826203] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.828 [2024-10-07 11:33:31.826226] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.828 [2024-10-07 11:33:31.826241] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.828 [2024-10-07 11:33:31.826264] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.828 [2024-10-07 11:33:31.826284] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.828 [2024-10-07 11:33:31.826533] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.828 [2024-10-07 11:33:31.826559] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.828 [2024-10-07 11:33:31.826574] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.828 [2024-10-07 11:33:31.826590] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.828 [2024-10-07 11:33:31.826604] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.828 [2024-10-07 11:33:31.826618] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.828 [2024-10-07 11:33:31.826689] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.828 [2024-10-07 11:33:31.826712] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.828 [2024-10-07 11:33:31.836088] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.828 [2024-10-07 11:33:31.836169] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.828 [2024-10-07 11:33:31.836249] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.828 [2024-10-07 11:33:31.836278] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.828 [2024-10-07 11:33:31.836294] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.828 [2024-10-07 11:33:31.836349] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.828 [2024-10-07 11:33:31.836374] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.828 [2024-10-07 11:33:31.836389] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.828 [2024-10-07 11:33:31.836406] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.828 [2024-10-07 11:33:31.836429] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.828 [2024-10-07 11:33:31.836447] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.828 [2024-10-07 11:33:31.836476] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.828 [2024-10-07 11:33:31.836490] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.828 [2024-10-07 11:33:31.836514] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.828 [2024-10-07 11:33:31.836529] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.828 [2024-10-07 11:33:31.836542] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.828 [2024-10-07 11:33:31.836555] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.828 [2024-10-07 11:33:31.836575] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.828 [2024-10-07 11:33:31.849659] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.828 [2024-10-07 11:33:31.849708] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.828 [2024-10-07 11:33:31.850021] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.828 [2024-10-07 11:33:31.850064] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.828 [2024-10-07 11:33:31.850085] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.828 [2024-10-07 11:33:31.850136] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.828 [2024-10-07 11:33:31.850160] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.828 [2024-10-07 11:33:31.850175] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.828 [2024-10-07 11:33:31.850943] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.828 [2024-10-07 11:33:31.850985] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.828 [2024-10-07 11:33:31.851418] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.828 [2024-10-07 11:33:31.851467] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.828 [2024-10-07 11:33:31.851489] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.828 [2024-10-07 11:33:31.851507] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.828 [2024-10-07 11:33:31.851521] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.828 [2024-10-07 11:33:31.851534] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.828 [2024-10-07 11:33:31.851772] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.828 [2024-10-07 11:33:31.851798] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.828 [2024-10-07 11:33:31.860327] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.828 [2024-10-07 11:33:31.860376] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.828 [2024-10-07 11:33:31.860494] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.828 [2024-10-07 11:33:31.860525] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.828 [2024-10-07 11:33:31.860541] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.828 [2024-10-07 11:33:31.860608] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.828 [2024-10-07 11:33:31.860633] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.828 [2024-10-07 11:33:31.860662] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.828 [2024-10-07 11:33:31.862864] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.828 [2024-10-07 11:33:31.862920] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.828 [2024-10-07 11:33:31.863610] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.828 [2024-10-07 11:33:31.863658] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.828 [2024-10-07 11:33:31.863678] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.828 [2024-10-07 11:33:31.863696] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.828 [2024-10-07 11:33:31.863709] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.828 [2024-10-07 11:33:31.863723] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.828 [2024-10-07 11:33:31.863819] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.828 [2024-10-07 11:33:31.863840] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.828 [2024-10-07 11:33:31.870438] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.828 [2024-10-07 11:33:31.870508] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.828 [2024-10-07 11:33:31.870586] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.828 [2024-10-07 11:33:31.870614] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.828 [2024-10-07 11:33:31.870630] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.828 [2024-10-07 11:33:31.870701] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.829 [2024-10-07 11:33:31.870728] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.829 [2024-10-07 11:33:31.870744] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.829 [2024-10-07 11:33:31.870762] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.829 [2024-10-07 11:33:31.870785] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.829 [2024-10-07 11:33:31.870802] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.829 [2024-10-07 11:33:31.870816] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.829 [2024-10-07 11:33:31.870830] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.829 [2024-10-07 11:33:31.870852] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.829 [2024-10-07 11:33:31.870867] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.829 [2024-10-07 11:33:31.870880] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.829 [2024-10-07 11:33:31.870893] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.829 [2024-10-07 11:33:31.870913] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.829 [2024-10-07 11:33:31.883537] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.829 [2024-10-07 11:33:31.883586] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.829 [2024-10-07 11:33:31.884001] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.829 [2024-10-07 11:33:31.884045] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.829 [2024-10-07 11:33:31.884065] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.829 [2024-10-07 11:33:31.884118] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.829 [2024-10-07 11:33:31.884142] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.829 [2024-10-07 11:33:31.884157] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.829 [2024-10-07 11:33:31.884292] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.829 [2024-10-07 11:33:31.884320] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.829 [2024-10-07 11:33:31.884410] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.829 [2024-10-07 11:33:31.884430] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.829 [2024-10-07 11:33:31.884444] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.829 [2024-10-07 11:33:31.884461] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.829 [2024-10-07 11:33:31.884475] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.829 [2024-10-07 11:33:31.884488] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.829 [2024-10-07 11:33:31.884522] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.829 [2024-10-07 11:33:31.884537] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.829 [2024-10-07 11:33:31.898671] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.829 [2024-10-07 11:33:31.898735] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.829 [2024-10-07 11:33:31.898870] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.829 [2024-10-07 11:33:31.898902] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.829 [2024-10-07 11:33:31.898919] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.829 [2024-10-07 11:33:31.898966] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.829 [2024-10-07 11:33:31.898989] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.829 [2024-10-07 11:33:31.899004] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.829 [2024-10-07 11:33:31.899028] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.829 [2024-10-07 11:33:31.899047] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.829 [2024-10-07 11:33:31.899067] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.829 [2024-10-07 11:33:31.899082] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.829 [2024-10-07 11:33:31.899112] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.829 [2024-10-07 11:33:31.899130] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.829 [2024-10-07 11:33:31.899144] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.829 [2024-10-07 11:33:31.899157] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.829 [2024-10-07 11:33:31.899191] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.829 [2024-10-07 11:33:31.899209] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.829 8943.53 IOPS, 34.94 MiB/s 00:22:37.829 Latency(us) 00:22:37.829 [2024-10-07T11:33:33.352Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:22:37.829 Job: NVMe0n1 (Core Mask 0x1, workload: verify, depth: 128, IO size: 4096) 00:22:37.829 Verification LBA range: start 0x0 length 0x4000 00:22:37.829 NVMe0n1 : 15.01 8941.87 34.93 0.00 0.00 14282.61 860.16 23712.12 00:22:37.829 [2024-10-07T11:33:33.352Z] =================================================================================================================== 00:22:37.829 [2024-10-07T11:33:33.352Z] Total : 8941.87 34.93 0.00 0.00 14282.61 860.16 23712.12 00:22:37.829 [2024-10-07 11:33:31.910904] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.829 [2024-10-07 11:33:31.910953] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.829 [2024-10-07 11:33:31.911697] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.829 [2024-10-07 11:33:31.911739] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.829 [2024-10-07 11:33:31.911760] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.829 [2024-10-07 11:33:31.911810] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.829 [2024-10-07 11:33:31.911834] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.829 [2024-10-07 11:33:31.911849] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.829 [2024-10-07 11:33:31.911869] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.829 [2024-10-07 11:33:31.911888] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.829 [2024-10-07 11:33:31.911905] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.829 [2024-10-07 11:33:31.911919] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.829 [2024-10-07 11:33:31.911933] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.829 [2024-10-07 11:33:31.911949] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.829 [2024-10-07 11:33:31.911962] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.829 [2024-10-07 11:33:31.911975] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.829 [2024-10-07 11:33:31.911991] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.829 [2024-10-07 11:33:31.912004] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.829 [2024-10-07 11:33:31.920998] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.829 [2024-10-07 11:33:31.921068] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.829 [2024-10-07 11:33:31.921138] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.829 [2024-10-07 11:33:31.921166] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.829 [2024-10-07 11:33:31.921182] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.829 [2024-10-07 11:33:31.921231] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.829 [2024-10-07 11:33:31.921254] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.829 [2024-10-07 11:33:31.921269] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.829 [2024-10-07 11:33:31.921287] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.829 [2024-10-07 11:33:31.921307] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.829 [2024-10-07 11:33:31.921323] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.829 [2024-10-07 11:33:31.921337] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.829 [2024-10-07 11:33:31.921350] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.829 [2024-10-07 11:33:31.921367] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.829 [2024-10-07 11:33:31.921381] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.829 [2024-10-07 11:33:31.921394] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.829 [2024-10-07 11:33:31.921406] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.829 [2024-10-07 11:33:31.921420] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.829 [2024-10-07 11:33:31.931077] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.829 [2024-10-07 11:33:31.931166] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.829 [2024-10-07 11:33:31.931205] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.829 [2024-10-07 11:33:31.931223] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.829 [2024-10-07 11:33:31.931255] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.829 [2024-10-07 11:33:31.931278] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.830 [2024-10-07 11:33:31.931302] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.830 [2024-10-07 11:33:31.931317] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.830 [2024-10-07 11:33:31.931330] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.830 [2024-10-07 11:33:31.931345] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.830 [2024-10-07 11:33:31.931394] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.830 [2024-10-07 11:33:31.931419] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.830 [2024-10-07 11:33:31.931434] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.830 [2024-10-07 11:33:31.931468] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.830 [2024-10-07 11:33:31.931487] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.830 [2024-10-07 11:33:31.931507] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.830 [2024-10-07 11:33:31.931520] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.830 [2024-10-07 11:33:31.931536] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.830 [2024-10-07 11:33:31.941135] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.830 [2024-10-07 11:33:31.941236] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.830 [2024-10-07 11:33:31.941263] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.830 [2024-10-07 11:33:31.941279] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.830 [2024-10-07 11:33:31.941298] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.830 [2024-10-07 11:33:31.941321] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.830 [2024-10-07 11:33:31.941335] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.830 [2024-10-07 11:33:31.941348] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.830 [2024-10-07 11:33:31.941372] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.830 [2024-10-07 11:33:31.941392] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.830 [2024-10-07 11:33:31.941451] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.830 [2024-10-07 11:33:31.941477] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.830 [2024-10-07 11:33:31.941492] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.830 [2024-10-07 11:33:31.941511] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.830 [2024-10-07 11:33:31.941529] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.830 [2024-10-07 11:33:31.941542] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.830 [2024-10-07 11:33:31.941555] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.830 [2024-10-07 11:33:31.941572] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.830 [2024-10-07 11:33:31.951194] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.830 [2024-10-07 11:33:31.951294] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.830 [2024-10-07 11:33:31.951321] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.830 [2024-10-07 11:33:31.951337] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.830 [2024-10-07 11:33:31.951356] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.830 [2024-10-07 11:33:31.951377] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.830 [2024-10-07 11:33:31.951392] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.830 [2024-10-07 11:33:31.951419] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.830 [2024-10-07 11:33:31.951438] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.830 [2024-10-07 11:33:31.951463] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.830 [2024-10-07 11:33:31.951527] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.830 [2024-10-07 11:33:31.951553] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.830 [2024-10-07 11:33:31.951568] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.830 [2024-10-07 11:33:31.951587] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.830 [2024-10-07 11:33:31.951605] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.830 [2024-10-07 11:33:31.951619] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.830 [2024-10-07 11:33:31.951634] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.830 [2024-10-07 11:33:31.951669] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.830 Received shutdown signal, test time was about 15.000000 seconds 00:22:37.830 00:22:37.830 Latency(us) 00:22:37.830 [2024-10-07T11:33:33.353Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:22:37.830 [2024-10-07T11:33:33.353Z] =================================================================================================================== 00:22:37.830 [2024-10-07T11:33:33.353Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:22:37.830 11:33:32 nvmf_tcp.nvmf_host.nvmf_failover -- host/failover.sh@65 -- # grep -c 'Resetting controller successful' 00:22:37.830 11:33:32 nvmf_tcp.nvmf_host.nvmf_failover -- host/failover.sh@65 -- # count=1 00:22:37.830 11:33:32 nvmf_tcp.nvmf_host.nvmf_failover -- host/failover.sh@67 -- # (( count != 3 )) 00:22:37.830 11:33:32 nvmf_tcp.nvmf_host.nvmf_failover -- host/failover.sh@68 -- # false 00:22:37.830 11:33:32 nvmf_tcp.nvmf_host.nvmf_failover -- host/failover.sh@68 -- # trap - ERR 00:22:37.830 11:33:32 nvmf_tcp.nvmf_host.nvmf_failover -- host/failover.sh@68 -- # print_backtrace 00:22:37.830 11:33:32 nvmf_tcp.nvmf_host.nvmf_failover -- common/autotest_common.sh@1153 -- # [[ ehxBET =~ e ]] 00:22:37.830 11:33:32 nvmf_tcp.nvmf_host.nvmf_failover -- common/autotest_common.sh@1155 -- # args=('--transport=tcp') 00:22:37.830 11:33:32 nvmf_tcp.nvmf_host.nvmf_failover -- common/autotest_common.sh@1155 -- # local args 00:22:37.830 11:33:32 nvmf_tcp.nvmf_host.nvmf_failover -- common/autotest_common.sh@1157 -- # xtrace_disable 00:22:37.830 11:33:32 nvmf_tcp.nvmf_host.nvmf_failover -- common/autotest_common.sh@10 -- # set +x 00:22:37.830 ========== Backtrace start: ========== 00:22:37.830 00:22:37.830 in /home/vagrant/spdk_repo/spdk/test/nvmf/host/failover.sh:68 -> main(["--transport=tcp"]) 00:22:37.830 ... 00:22:37.830 63 cat $testdir/try.txt 00:22:37.830 64 # if this test fails it means we didn't fail over to the second 00:22:37.830 65 count="$(grep -c "Resetting controller successful" < $testdir/try.txt)" 00:22:37.830 66 00:22:37.830 67 if ((count != 3)); then 00:22:37.830 => 68 false 00:22:37.830 69 fi 00:22:37.830 70 00:22:37.830 71 # Part 2 of the test. Start removing ports, starting with the one we are connected to, confirm that the ctrlr remains active until the final trid is removed. 00:22:37.830 72 $rootdir/build/examples/bdevperf -z -r $bdevperf_rpc_sock -q 128 -o 4096 -w verify -t 1 -f &> $testdir/try.txt & 00:22:37.830 73 bdevperf_pid=$! 00:22:37.830 ... 00:22:37.830 00:22:37.830 ========== Backtrace end ========== 00:22:37.830 11:33:32 nvmf_tcp.nvmf_host.nvmf_failover -- common/autotest_common.sh@1194 -- # return 0 00:22:37.830 11:33:32 nvmf_tcp.nvmf_host.nvmf_failover -- host/failover.sh@1 -- # process_shm --id 0 00:22:37.830 11:33:32 nvmf_tcp.nvmf_host.nvmf_failover -- common/autotest_common.sh@808 -- # type=--id 00:22:37.830 11:33:32 nvmf_tcp.nvmf_host.nvmf_failover -- common/autotest_common.sh@809 -- # id=0 00:22:37.830 11:33:32 nvmf_tcp.nvmf_host.nvmf_failover -- common/autotest_common.sh@810 -- # '[' --id = --pid ']' 00:22:37.830 11:33:32 nvmf_tcp.nvmf_host.nvmf_failover -- common/autotest_common.sh@814 -- # find /dev/shm -name '*.0' -printf '%f\n' 00:22:37.830 11:33:32 nvmf_tcp.nvmf_host.nvmf_failover -- common/autotest_common.sh@814 -- # shm_files=nvmf_trace.0 00:22:37.830 11:33:32 nvmf_tcp.nvmf_host.nvmf_failover -- common/autotest_common.sh@816 -- # [[ -z nvmf_trace.0 ]] 00:22:37.830 11:33:32 nvmf_tcp.nvmf_host.nvmf_failover -- common/autotest_common.sh@820 -- # for n in $shm_files 00:22:37.830 11:33:32 nvmf_tcp.nvmf_host.nvmf_failover -- common/autotest_common.sh@821 -- # tar -C /dev/shm/ -cvzf /home/vagrant/spdk_repo/spdk/../output/nvmf_trace.0_shm.tar.gz nvmf_trace.0 00:22:37.830 nvmf_trace.0 00:22:37.830 11:33:32 nvmf_tcp.nvmf_host.nvmf_failover -- common/autotest_common.sh@823 -- # return 0 00:22:37.830 11:33:32 nvmf_tcp.nvmf_host.nvmf_failover -- host/failover.sh@1 -- # cat /home/vagrant/spdk_repo/spdk/test/nvmf/host/try.txt 00:22:37.830 [2024-10-07 11:33:15.047444] Starting SPDK v25.01-pre git sha1 2a4f56c54 / DPDK 24.03.0 initialization... 00:22:37.830 [2024-10-07 11:33:15.047639] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --iova-mode=pa --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid89088 ] 00:22:37.830 [2024-10-07 11:33:15.187646] app.c: 917:spdk_app_start: *NOTICE*: Total cores available: 1 00:22:37.830 [2024-10-07 11:33:15.317426] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 0 00:22:37.830 Running I/O for 15 seconds... 00:22:37.830 8644.00 IOPS, 33.77 MiB/s [2024-10-07T11:33:33.353Z] [2024-10-07 11:33:18.025183] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:118 nsid:1 lba:78736 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:22:37.830 [2024-10-07 11:33:18.025238] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:37.830 [2024-10-07 11:33:18.025298] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:25 nsid:1 lba:78744 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:22:37.830 [2024-10-07 11:33:18.025314] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:37.830 [2024-10-07 11:33:18.025330] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:120 nsid:1 lba:78752 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:22:37.830 [2024-10-07 11:33:18.025344] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:37.830 [2024-10-07 11:33:18.025359] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:22 nsid:1 lba:78760 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:22:37.830 [2024-10-07 11:33:18.025373] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:37.830 [2024-10-07 11:33:18.025403] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:100 nsid:1 lba:78768 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:22:37.830 [2024-10-07 11:33:18.025416] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:37.830 [2024-10-07 11:33:18.025430] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:117 nsid:1 lba:78776 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:22:37.831 [2024-10-07 11:33:18.025443] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:37.831 [2024-10-07 11:33:18.025482] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:109 nsid:1 lba:78784 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:22:37.831 [2024-10-07 11:33:18.025495] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:37.831 [2024-10-07 11:33:18.025510] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:77 nsid:1 lba:78792 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:22:37.831 [2024-10-07 11:33:18.025523] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:37.831 [2024-10-07 11:33:18.025538] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:122 nsid:1 lba:78800 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:22:37.831 [2024-10-07 11:33:18.025551] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:37.831 [2024-10-07 11:33:18.025565] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:9 nsid:1 lba:78808 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:22:37.831 [2024-10-07 11:33:18.025579] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:37.831 [2024-10-07 11:33:18.025594] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:69 nsid:1 lba:78816 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:22:37.831 [2024-10-07 11:33:18.025608] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:37.831 [2024-10-07 11:33:18.025653] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:89 nsid:1 lba:78824 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:22:37.831 [2024-10-07 11:33:18.025669] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:37.831 [2024-10-07 11:33:18.025684] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:90 nsid:1 lba:78832 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:22:37.831 [2024-10-07 11:33:18.025698] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:37.831 [2024-10-07 11:33:18.025730] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:50 nsid:1 lba:78840 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:22:37.831 [2024-10-07 11:33:18.025778] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:37.831 [2024-10-07 11:33:18.025795] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:86 nsid:1 lba:78848 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:22:37.831 [2024-10-07 11:33:18.025809] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:37.831 [2024-10-07 11:33:18.025842] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:14 nsid:1 lba:78856 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:22:37.831 [2024-10-07 11:33:18.025864] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:37.831 [2024-10-07 11:33:18.025879] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:119 nsid:1 lba:78864 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:22:37.831 [2024-10-07 11:33:18.025893] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:37.831 [2024-10-07 11:33:18.025908] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:108 nsid:1 lba:78872 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:22:37.831 [2024-10-07 11:33:18.025921] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:37.831 [2024-10-07 11:33:18.025936] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:12 nsid:1 lba:78880 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:22:37.831 [2024-10-07 11:33:18.025949] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:37.831 [2024-10-07 11:33:18.025964] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:93 nsid:1 lba:78888 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:22:37.831 [2024-10-07 11:33:18.025977] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:37.831 [2024-10-07 11:33:18.025992] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:105 nsid:1 lba:78896 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:22:37.831 [2024-10-07 11:33:18.026014] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:37.831 [2024-10-07 11:33:18.026029] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:53 nsid:1 lba:78288 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:37.831 [2024-10-07 11:33:18.026042] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:37.831 [2024-10-07 11:33:18.026057] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:111 nsid:1 lba:78296 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:37.831 [2024-10-07 11:33:18.026071] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:37.831 [2024-10-07 11:33:18.026086] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:43 nsid:1 lba:78304 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:37.831 [2024-10-07 11:33:18.026123] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:37.831 [2024-10-07 11:33:18.026148] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:24 nsid:1 lba:78312 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:37.831 [2024-10-07 11:33:18.026178] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:37.831 [2024-10-07 11:33:18.026192] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:107 nsid:1 lba:78320 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:37.831 [2024-10-07 11:33:18.026205] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:37.831 [2024-10-07 11:33:18.026219] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:42 nsid:1 lba:78328 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:37.831 [2024-10-07 11:33:18.026231] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:37.831 [2024-10-07 11:33:18.026246] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:92 nsid:1 lba:78336 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:37.831 [2024-10-07 11:33:18.026259] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:37.831 [2024-10-07 11:33:18.026273] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:78344 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:37.831 [2024-10-07 11:33:18.026287] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:37.831 [2024-10-07 11:33:18.026301] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:16 nsid:1 lba:78352 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:37.831 [2024-10-07 11:33:18.026314] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:37.831 [2024-10-07 11:33:18.026328] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:64 nsid:1 lba:78360 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:37.831 [2024-10-07 11:33:18.026341] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:37.831 [2024-10-07 11:33:18.026355] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:78368 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:37.831 [2024-10-07 11:33:18.026368] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:37.831 [2024-10-07 11:33:18.026381] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:49 nsid:1 lba:78376 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:37.831 [2024-10-07 11:33:18.026394] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:37.831 [2024-10-07 11:33:18.026408] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:115 nsid:1 lba:78384 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:37.831 [2024-10-07 11:33:18.026421] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:37.831 [2024-10-07 11:33:18.026452] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:78392 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:37.831 [2024-10-07 11:33:18.026476] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:37.831 [2024-10-07 11:33:18.026492] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:62 nsid:1 lba:78400 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:37.831 [2024-10-07 11:33:18.026506] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:37.831 [2024-10-07 11:33:18.026540] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:23 nsid:1 lba:78408 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:37.831 [2024-10-07 11:33:18.026554] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:37.831 [2024-10-07 11:33:18.026570] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:46 nsid:1 lba:78416 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:37.831 [2024-10-07 11:33:18.026584] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:37.831 [2024-10-07 11:33:18.026599] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:35 nsid:1 lba:78424 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:37.831 [2024-10-07 11:33:18.026613] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:37.831 [2024-10-07 11:33:18.026629] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:72 nsid:1 lba:78432 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:37.831 [2024-10-07 11:33:18.026642] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:37.831 [2024-10-07 11:33:18.026663] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:37 nsid:1 lba:78440 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:37.831 [2024-10-07 11:33:18.026677] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:37.831 [2024-10-07 11:33:18.026693] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:44 nsid:1 lba:78448 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:37.831 [2024-10-07 11:33:18.026707] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:37.831 [2024-10-07 11:33:18.026735] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:116 nsid:1 lba:78456 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:37.831 [2024-10-07 11:33:18.026752] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:37.831 [2024-10-07 11:33:18.026769] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:29 nsid:1 lba:78464 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:37.831 [2024-10-07 11:33:18.026784] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:37.831 [2024-10-07 11:33:18.026800] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:17 nsid:1 lba:78472 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:37.831 [2024-10-07 11:33:18.026814] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:37.831 [2024-10-07 11:33:18.026873] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:34 nsid:1 lba:78480 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:37.831 [2024-10-07 11:33:18.026886] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:37.831 [2024-10-07 11:33:18.026901] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:78488 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:37.831 [2024-10-07 11:33:18.026913] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:37.831 [2024-10-07 11:33:18.026927] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:48 nsid:1 lba:78496 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:37.832 [2024-10-07 11:33:18.026940] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:37.832 [2024-10-07 11:33:18.026955] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:28 nsid:1 lba:78504 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:37.832 [2024-10-07 11:33:18.026983] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:37.832 [2024-10-07 11:33:18.026998] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:41 nsid:1 lba:78512 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:37.832 [2024-10-07 11:33:18.027011] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:37.832 [2024-10-07 11:33:18.027026] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:84 nsid:1 lba:78520 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:37.832 [2024-10-07 11:33:18.027038] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:37.832 [2024-10-07 11:33:18.027052] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:78 nsid:1 lba:78528 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:37.832 [2024-10-07 11:33:18.027065] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:37.832 [2024-10-07 11:33:18.027079] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:57 nsid:1 lba:78536 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:37.832 [2024-10-07 11:33:18.027091] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:37.832 [2024-10-07 11:33:18.027105] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:75 nsid:1 lba:78904 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:22:37.832 [2024-10-07 11:33:18.027118] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:37.832 [2024-10-07 11:33:18.027132] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:7 nsid:1 lba:78912 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:22:37.832 [2024-10-07 11:33:18.027146] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:37.832 [2024-10-07 11:33:18.027160] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:91 nsid:1 lba:78920 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:22:37.832 [2024-10-07 11:33:18.027173] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:37.832 [2024-10-07 11:33:18.027200] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:88 nsid:1 lba:78928 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:22:37.832 [2024-10-07 11:33:18.027246] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:37.832 [2024-10-07 11:33:18.027261] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:47 nsid:1 lba:78936 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:22:37.832 [2024-10-07 11:33:18.027275] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:37.832 [2024-10-07 11:33:18.027291] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:33 nsid:1 lba:78944 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:22:37.832 [2024-10-07 11:33:18.027305] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:37.832 [2024-10-07 11:33:18.027321] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:52 nsid:1 lba:78952 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:22:37.832 [2024-10-07 11:33:18.027335] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:37.832 [2024-10-07 11:33:18.027350] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:94 nsid:1 lba:78960 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:22:37.832 [2024-10-07 11:33:18.027364] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:37.832 [2024-10-07 11:33:18.027380] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:80 nsid:1 lba:78544 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:37.832 [2024-10-07 11:33:18.027401] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:37.832 [2024-10-07 11:33:18.027417] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:51 nsid:1 lba:78552 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:37.832 [2024-10-07 11:33:18.027431] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:37.832 [2024-10-07 11:33:18.027447] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:113 nsid:1 lba:78560 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:37.832 [2024-10-07 11:33:18.027461] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:37.832 [2024-10-07 11:33:18.027476] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:63 nsid:1 lba:78568 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:37.832 [2024-10-07 11:33:18.027490] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:37.832 [2024-10-07 11:33:18.027505] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:38 nsid:1 lba:78576 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:37.832 [2024-10-07 11:33:18.027519] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:37.832 [2024-10-07 11:33:18.027535] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:54 nsid:1 lba:78584 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:37.832 [2024-10-07 11:33:18.027564] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:37.832 [2024-10-07 11:33:18.027579] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:78592 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:37.832 [2024-10-07 11:33:18.027592] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:37.832 [2024-10-07 11:33:18.027607] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:61 nsid:1 lba:78600 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:37.832 [2024-10-07 11:33:18.027621] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:37.832 [2024-10-07 11:33:18.027635] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:78608 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:37.832 [2024-10-07 11:33:18.027649] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:37.832 [2024-10-07 11:33:18.027664] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:78616 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:37.832 [2024-10-07 11:33:18.027693] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:37.832 [2024-10-07 11:33:18.027722] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:114 nsid:1 lba:78624 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:37.832 [2024-10-07 11:33:18.027739] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:37.832 [2024-10-07 11:33:18.027759] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:56 nsid:1 lba:78632 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:37.832 [2024-10-07 11:33:18.027793] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:37.832 [2024-10-07 11:33:18.027807] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:78640 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:37.832 [2024-10-07 11:33:18.027820] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:37.832 [2024-10-07 11:33:18.027842] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:95 nsid:1 lba:78648 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:37.832 [2024-10-07 11:33:18.027855] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:37.832 [2024-10-07 11:33:18.027870] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:78656 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:37.832 [2024-10-07 11:33:18.027882] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:37.832 [2024-10-07 11:33:18.027896] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:30 nsid:1 lba:78664 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:37.832 [2024-10-07 11:33:18.027909] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:37.832 [2024-10-07 11:33:18.027923] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:96 nsid:1 lba:78672 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:37.832 [2024-10-07 11:33:18.027936] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:37.832 [2024-10-07 11:33:18.027950] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:27 nsid:1 lba:78680 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:37.832 [2024-10-07 11:33:18.027962] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:37.832 [2024-10-07 11:33:18.027977] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:70 nsid:1 lba:78688 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:37.832 [2024-10-07 11:33:18.027990] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:37.832 [2024-10-07 11:33:18.028004] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:123 nsid:1 lba:78696 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:37.832 [2024-10-07 11:33:18.028016] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:37.832 [2024-10-07 11:33:18.028030] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:71 nsid:1 lba:78704 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:37.832 [2024-10-07 11:33:18.028043] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:37.832 [2024-10-07 11:33:18.028057] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:45 nsid:1 lba:78712 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:37.832 [2024-10-07 11:33:18.028070] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:37.832 [2024-10-07 11:33:18.028084] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:21 nsid:1 lba:78720 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:37.832 [2024-10-07 11:33:18.028096] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:37.833 [2024-10-07 11:33:18.028110] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:40 nsid:1 lba:78728 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:37.833 [2024-10-07 11:33:18.028123] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:37.833 [2024-10-07 11:33:18.028137] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:31 nsid:1 lba:78968 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:22:37.833 [2024-10-07 11:33:18.028150] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:37.833 [2024-10-07 11:33:18.028165] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:121 nsid:1 lba:78976 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:22:37.833 [2024-10-07 11:33:18.028188] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:37.833 [2024-10-07 11:33:18.028203] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:59 nsid:1 lba:78984 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:22:37.833 [2024-10-07 11:33:18.028216] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:37.833 [2024-10-07 11:33:18.028235] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:60 nsid:1 lba:78992 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:22:37.833 [2024-10-07 11:33:18.028248] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:37.833 [2024-10-07 11:33:18.028262] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:104 nsid:1 lba:79000 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:22:37.833 [2024-10-07 11:33:18.028274] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:37.833 [2024-10-07 11:33:18.028288] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:32 nsid:1 lba:79008 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:22:37.833 [2024-10-07 11:33:18.028301] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:37.833 [2024-10-07 11:33:18.028315] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:126 nsid:1 lba:79016 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:22:37.833 [2024-10-07 11:33:18.028327] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:37.833 [2024-10-07 11:33:18.028341] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:26 nsid:1 lba:79024 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:22:37.833 [2024-10-07 11:33:18.028354] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:37.833 [2024-10-07 11:33:18.028368] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:110 nsid:1 lba:79032 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:22:37.833 [2024-10-07 11:33:18.028381] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:37.833 [2024-10-07 11:33:18.028395] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:68 nsid:1 lba:79040 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:22:37.833 [2024-10-07 11:33:18.028407] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:37.833 [2024-10-07 11:33:18.028430] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:36 nsid:1 lba:79048 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:22:37.833 [2024-10-07 11:33:18.028443] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:37.833 [2024-10-07 11:33:18.028490] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:112 nsid:1 lba:79056 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:22:37.833 [2024-10-07 11:33:18.028504] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:37.833 [2024-10-07 11:33:18.028518] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:81 nsid:1 lba:79064 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:22:37.833 [2024-10-07 11:33:18.028531] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:37.833 [2024-10-07 11:33:18.028546] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:19 nsid:1 lba:79072 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:22:37.833 [2024-10-07 11:33:18.028559] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:37.833 [2024-10-07 11:33:18.028576] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:103 nsid:1 lba:79080 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:22:37.833 [2024-10-07 11:33:18.028593] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:37.833 [2024-10-07 11:33:18.028607] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:39 nsid:1 lba:79088 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:22:37.833 [2024-10-07 11:33:18.028621] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:37.833 [2024-10-07 11:33:18.028635] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:76 nsid:1 lba:79096 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:22:37.833 [2024-10-07 11:33:18.028648] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:37.833 [2024-10-07 11:33:18.028680] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:58 nsid:1 lba:79104 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:22:37.833 [2024-10-07 11:33:18.028693] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:37.833 [2024-10-07 11:33:18.028721] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:74 nsid:1 lba:79112 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:22:37.833 [2024-10-07 11:33:18.028736] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:37.833 [2024-10-07 11:33:18.028756] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:101 nsid:1 lba:79120 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:22:37.833 [2024-10-07 11:33:18.028770] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:37.833 [2024-10-07 11:33:18.028785] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:20 nsid:1 lba:79128 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:22:37.833 [2024-10-07 11:33:18.028798] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:37.833 [2024-10-07 11:33:18.028828] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:79 nsid:1 lba:79136 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:22:37.833 [2024-10-07 11:33:18.028842] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:37.833 [2024-10-07 11:33:18.028856] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:87 nsid:1 lba:79144 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:22:37.833 [2024-10-07 11:33:18.028869] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:37.833 [2024-10-07 11:33:18.028884] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:82 nsid:1 lba:79152 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:22:37.833 [2024-10-07 11:33:18.028897] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:37.833 [2024-10-07 11:33:18.028911] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:98 nsid:1 lba:79160 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:22:37.833 [2024-10-07 11:33:18.028923] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:37.833 [2024-10-07 11:33:18.028938] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:85 nsid:1 lba:79168 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:22:37.833 [2024-10-07 11:33:18.028951] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:37.833 [2024-10-07 11:33:18.028966] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:83 nsid:1 lba:79176 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:22:37.833 [2024-10-07 11:33:18.028979] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:37.833 [2024-10-07 11:33:18.029000] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:125 nsid:1 lba:79184 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:22:37.833 [2024-10-07 11:33:18.029045] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:37.833 [2024-10-07 11:33:18.029059] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:8 nsid:1 lba:79192 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:22:37.833 [2024-10-07 11:33:18.029072] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:37.833 [2024-10-07 11:33:18.029087] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:67 nsid:1 lba:79200 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:22:37.833 [2024-10-07 11:33:18.029099] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:37.833 [2024-10-07 11:33:18.029114] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:73 nsid:1 lba:79208 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:22:37.833 [2024-10-07 11:33:18.029127] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:37.833 [2024-10-07 11:33:18.029141] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:66 nsid:1 lba:79216 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:22:37.833 [2024-10-07 11:33:18.029154] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:37.833 [2024-10-07 11:33:18.029168] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:102 nsid:1 lba:79224 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:22:37.833 [2024-10-07 11:33:18.029181] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:37.833 [2024-10-07 11:33:18.029195] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:18 nsid:1 lba:79232 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:22:37.833 [2024-10-07 11:33:18.029208] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:37.833 [2024-10-07 11:33:18.029222] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:124 nsid:1 lba:79240 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:22:37.833 [2024-10-07 11:33:18.029235] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:37.833 [2024-10-07 11:33:18.029255] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:65 nsid:1 lba:79248 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:22:37.833 [2024-10-07 11:33:18.029268] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:37.833 [2024-10-07 11:33:18.029282] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:55 nsid:1 lba:79256 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:22:37.833 [2024-10-07 11:33:18.029295] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:37.833 [2024-10-07 11:33:18.029310] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:4 nsid:1 lba:79264 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:22:37.833 [2024-10-07 11:33:18.029323] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:37.833 [2024-10-07 11:33:18.029336] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:13 nsid:1 lba:79272 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:22:37.833 [2024-10-07 11:33:18.029349] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:37.833 [2024-10-07 11:33:18.029364] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:99 nsid:1 lba:79280 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:22:37.833 [2024-10-07 11:33:18.029383] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:37.833 [2024-10-07 11:33:18.029398] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:97 nsid:1 lba:79288 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:22:37.833 [2024-10-07 11:33:18.029411] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:37.833 [2024-10-07 11:33:18.029440] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:106 nsid:1 lba:79296 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:22:37.833 [2024-10-07 11:33:18.029470] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:37.833 [2024-10-07 11:33:18.029483] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a29b30 is same with the state(6) to be set 00:22:37.833 [2024-10-07 11:33:18.029499] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:22:37.833 [2024-10-07 11:33:18.029509] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:22:37.834 [2024-10-07 11:33:18.029519] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:79304 len:8 PRP1 0x0 PRP2 0x0 00:22:37.834 [2024-10-07 11:33:18.029532] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:37.834 [2024-10-07 11:33:18.029594] bdev_nvme.c:1730:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0x1a29b30 was disconnected and freed. reset controller. 00:22:37.834 [2024-10-07 11:33:18.031095] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.834 [2024-10-07 11:33:18.031184] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.834 [2024-10-07 11:33:18.031374] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.834 [2024-10-07 11:33:18.031407] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.834 [2024-10-07 11:33:18.031424] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.834 [2024-10-07 11:33:18.031449] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.834 [2024-10-07 11:33:18.031472] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.834 [2024-10-07 11:33:18.031487] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.834 [2024-10-07 11:33:18.031502] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.834 [2024-10-07 11:33:18.031528] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.834 [2024-10-07 11:33:18.042132] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.834 [2024-10-07 11:33:18.042263] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.834 [2024-10-07 11:33:18.042294] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.834 [2024-10-07 11:33:18.042311] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.834 [2024-10-07 11:33:18.044162] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.834 [2024-10-07 11:33:18.044412] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.834 [2024-10-07 11:33:18.044445] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.834 [2024-10-07 11:33:18.044514] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.834 [2024-10-07 11:33:18.044574] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.834 [2024-10-07 11:33:18.052211] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.834 [2024-10-07 11:33:18.052357] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.834 [2024-10-07 11:33:18.052395] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.834 [2024-10-07 11:33:18.052413] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.834 [2024-10-07 11:33:18.052465] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.834 [2024-10-07 11:33:18.052488] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.834 [2024-10-07 11:33:18.052502] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.834 [2024-10-07 11:33:18.052516] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.834 [2024-10-07 11:33:18.052539] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.834 [2024-10-07 11:33:18.065191] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.834 [2024-10-07 11:33:18.065371] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.834 [2024-10-07 11:33:18.065404] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.834 [2024-10-07 11:33:18.065436] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.834 [2024-10-07 11:33:18.065461] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.834 [2024-10-07 11:33:18.065484] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.834 [2024-10-07 11:33:18.065498] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.834 [2024-10-07 11:33:18.065513] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.834 [2024-10-07 11:33:18.065537] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.834 [2024-10-07 11:33:18.076050] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.834 [2024-10-07 11:33:18.076282] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.834 [2024-10-07 11:33:18.076314] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.834 [2024-10-07 11:33:18.076330] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.834 [2024-10-07 11:33:18.077605] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.834 [2024-10-07 11:33:18.079696] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.834 [2024-10-07 11:33:18.079744] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.834 [2024-10-07 11:33:18.079779] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.834 [2024-10-07 11:33:18.080138] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.834 [2024-10-07 11:33:18.086386] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.834 [2024-10-07 11:33:18.086645] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.834 [2024-10-07 11:33:18.086728] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.834 [2024-10-07 11:33:18.086750] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.834 [2024-10-07 11:33:18.086897] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.834 [2024-10-07 11:33:18.087673] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.834 [2024-10-07 11:33:18.087753] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.834 [2024-10-07 11:33:18.087773] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.834 [2024-10-07 11:33:18.088225] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.834 [2024-10-07 11:33:18.096627] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.834 [2024-10-07 11:33:18.096775] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.834 [2024-10-07 11:33:18.096805] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.834 [2024-10-07 11:33:18.096821] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.834 [2024-10-07 11:33:18.096843] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.834 [2024-10-07 11:33:18.096865] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.834 [2024-10-07 11:33:18.096878] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.834 [2024-10-07 11:33:18.096891] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.834 [2024-10-07 11:33:18.096913] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.834 [2024-10-07 11:33:18.109255] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.834 [2024-10-07 11:33:18.109495] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.834 [2024-10-07 11:33:18.109528] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.834 [2024-10-07 11:33:18.109544] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.834 [2024-10-07 11:33:18.109568] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.834 [2024-10-07 11:33:18.109590] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.834 [2024-10-07 11:33:18.109604] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.834 [2024-10-07 11:33:18.109618] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.834 [2024-10-07 11:33:18.109641] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.834 [2024-10-07 11:33:18.119733] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.834 [2024-10-07 11:33:18.119975] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.834 [2024-10-07 11:33:18.120006] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.834 [2024-10-07 11:33:18.120023] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.834 [2024-10-07 11:33:18.120148] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.834 [2024-10-07 11:33:18.120298] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.834 [2024-10-07 11:33:18.120321] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.834 [2024-10-07 11:33:18.120336] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.834 [2024-10-07 11:33:18.120462] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.834 [2024-10-07 11:33:18.130103] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.834 [2024-10-07 11:33:18.130236] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.834 [2024-10-07 11:33:18.130282] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.834 [2024-10-07 11:33:18.130299] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.834 [2024-10-07 11:33:18.130323] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.834 [2024-10-07 11:33:18.130345] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.834 [2024-10-07 11:33:18.130359] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.834 [2024-10-07 11:33:18.130373] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.834 [2024-10-07 11:33:18.130396] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.834 [2024-10-07 11:33:18.142353] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.834 [2024-10-07 11:33:18.142631] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.834 [2024-10-07 11:33:18.142669] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.835 [2024-10-07 11:33:18.142703] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.835 [2024-10-07 11:33:18.143179] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.835 [2024-10-07 11:33:18.143343] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.835 [2024-10-07 11:33:18.143369] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.835 [2024-10-07 11:33:18.143385] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.835 [2024-10-07 11:33:18.145232] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.835 [2024-10-07 11:33:18.152451] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.835 [2024-10-07 11:33:18.152586] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.835 [2024-10-07 11:33:18.152617] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.835 [2024-10-07 11:33:18.152632] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.835 [2024-10-07 11:33:18.152655] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.835 [2024-10-07 11:33:18.152692] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.835 [2024-10-07 11:33:18.152709] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.835 [2024-10-07 11:33:18.152723] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.835 [2024-10-07 11:33:18.152774] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.835 [2024-10-07 11:33:18.165417] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.835 [2024-10-07 11:33:18.165577] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.835 [2024-10-07 11:33:18.165608] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.835 [2024-10-07 11:33:18.165624] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.835 [2024-10-07 11:33:18.165647] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.835 [2024-10-07 11:33:18.165684] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.835 [2024-10-07 11:33:18.165702] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.835 [2024-10-07 11:33:18.165715] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.835 [2024-10-07 11:33:18.165738] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.835 [2024-10-07 11:33:18.178503] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.835 [2024-10-07 11:33:18.178638] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.835 [2024-10-07 11:33:18.178687] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.835 [2024-10-07 11:33:18.178706] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.835 [2024-10-07 11:33:18.178732] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.835 [2024-10-07 11:33:18.178755] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.835 [2024-10-07 11:33:18.178770] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.835 [2024-10-07 11:33:18.178785] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.835 [2024-10-07 11:33:18.178809] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.835 [2024-10-07 11:33:18.192152] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.835 [2024-10-07 11:33:18.192412] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.835 [2024-10-07 11:33:18.192452] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.835 [2024-10-07 11:33:18.192471] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.835 [2024-10-07 11:33:18.192685] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.835 [2024-10-07 11:33:18.192754] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.835 [2024-10-07 11:33:18.192777] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.835 [2024-10-07 11:33:18.192792] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.835 [2024-10-07 11:33:18.192817] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.835 [2024-10-07 11:33:18.203971] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.835 [2024-10-07 11:33:18.204297] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.835 [2024-10-07 11:33:18.204342] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.835 [2024-10-07 11:33:18.204408] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.835 [2024-10-07 11:33:18.204524] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.835 [2024-10-07 11:33:18.204580] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.835 [2024-10-07 11:33:18.204601] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.835 [2024-10-07 11:33:18.204616] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.835 [2024-10-07 11:33:18.204641] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.835 [2024-10-07 11:33:18.216609] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.835 [2024-10-07 11:33:18.217100] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.835 [2024-10-07 11:33:18.217147] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.835 [2024-10-07 11:33:18.217168] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.835 [2024-10-07 11:33:18.218734] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.835 [2024-10-07 11:33:18.219279] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.835 [2024-10-07 11:33:18.219317] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.835 [2024-10-07 11:33:18.219336] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.835 [2024-10-07 11:33:18.219588] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.835 [2024-10-07 11:33:18.227876] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.835 [2024-10-07 11:33:18.228119] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.835 [2024-10-07 11:33:18.228168] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.835 [2024-10-07 11:33:18.228188] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.835 [2024-10-07 11:33:18.228349] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.835 [2024-10-07 11:33:18.228468] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.835 [2024-10-07 11:33:18.228512] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.835 [2024-10-07 11:33:18.228530] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.835 [2024-10-07 11:33:18.228638] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.835 [2024-10-07 11:33:18.238863] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.835 [2024-10-07 11:33:18.239130] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.835 [2024-10-07 11:33:18.239170] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.835 [2024-10-07 11:33:18.239190] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.835 [2024-10-07 11:33:18.239273] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.835 [2024-10-07 11:33:18.239302] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.835 [2024-10-07 11:33:18.239344] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.835 [2024-10-07 11:33:18.239360] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.835 [2024-10-07 11:33:18.239386] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.835 [2024-10-07 11:33:18.248984] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.835 [2024-10-07 11:33:18.249112] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.835 [2024-10-07 11:33:18.249146] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.835 [2024-10-07 11:33:18.249163] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.835 [2024-10-07 11:33:18.249188] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.835 [2024-10-07 11:33:18.249212] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.835 [2024-10-07 11:33:18.249227] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.835 [2024-10-07 11:33:18.249241] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.835 [2024-10-07 11:33:18.249265] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.835 [2024-10-07 11:33:18.261143] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.835 [2024-10-07 11:33:18.261435] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.835 [2024-10-07 11:33:18.261493] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.835 [2024-10-07 11:33:18.261513] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.835 [2024-10-07 11:33:18.262258] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.835 [2024-10-07 11:33:18.262498] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.835 [2024-10-07 11:33:18.262529] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.835 [2024-10-07 11:33:18.262547] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.835 [2024-10-07 11:33:18.262574] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.835 [2024-10-07 11:33:18.271256] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.835 [2024-10-07 11:33:18.271383] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.835 [2024-10-07 11:33:18.271415] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.835 [2024-10-07 11:33:18.271432] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.835 [2024-10-07 11:33:18.273716] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.835 [2024-10-07 11:33:18.273996] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.835 [2024-10-07 11:33:18.274035] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.836 [2024-10-07 11:33:18.274054] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.836 [2024-10-07 11:33:18.274312] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.836 [2024-10-07 11:33:18.283203] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.836 [2024-10-07 11:33:18.283335] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.836 [2024-10-07 11:33:18.283368] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.836 [2024-10-07 11:33:18.283384] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.836 [2024-10-07 11:33:18.283410] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.836 [2024-10-07 11:33:18.283433] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.836 [2024-10-07 11:33:18.283448] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.836 [2024-10-07 11:33:18.283463] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.836 [2024-10-07 11:33:18.283487] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.836 [2024-10-07 11:33:18.295167] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.836 [2024-10-07 11:33:18.295565] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.836 [2024-10-07 11:33:18.295609] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.836 [2024-10-07 11:33:18.295645] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.836 [2024-10-07 11:33:18.295713] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.836 [2024-10-07 11:33:18.295750] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.836 [2024-10-07 11:33:18.295765] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.836 [2024-10-07 11:33:18.295780] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.836 [2024-10-07 11:33:18.295804] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.836 [2024-10-07 11:33:18.305946] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.836 [2024-10-07 11:33:18.306073] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.836 [2024-10-07 11:33:18.306105] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.836 [2024-10-07 11:33:18.306122] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.836 [2024-10-07 11:33:18.306145] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.836 [2024-10-07 11:33:18.306168] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.836 [2024-10-07 11:33:18.306182] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.836 [2024-10-07 11:33:18.306196] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.836 [2024-10-07 11:33:18.306219] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.836 [2024-10-07 11:33:18.318591] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.836 [2024-10-07 11:33:18.319365] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.836 [2024-10-07 11:33:18.319412] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.836 [2024-10-07 11:33:18.319434] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.836 [2024-10-07 11:33:18.319599] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.836 [2024-10-07 11:33:18.319632] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.836 [2024-10-07 11:33:18.319648] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.836 [2024-10-07 11:33:18.319678] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.836 [2024-10-07 11:33:18.319718] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.836 [2024-10-07 11:33:18.328848] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.836 [2024-10-07 11:33:18.328982] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.836 [2024-10-07 11:33:18.329029] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.836 [2024-10-07 11:33:18.329046] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.836 [2024-10-07 11:33:18.329070] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.836 [2024-10-07 11:33:18.329093] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.836 [2024-10-07 11:33:18.329107] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.836 [2024-10-07 11:33:18.329122] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.836 [2024-10-07 11:33:18.329146] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.836 [2024-10-07 11:33:18.338940] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.836 [2024-10-07 11:33:18.339095] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.836 [2024-10-07 11:33:18.339125] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.836 [2024-10-07 11:33:18.339142] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.836 [2024-10-07 11:33:18.339166] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.836 [2024-10-07 11:33:18.339187] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.836 [2024-10-07 11:33:18.339229] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.836 [2024-10-07 11:33:18.339244] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.836 [2024-10-07 11:33:18.339270] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.836 [2024-10-07 11:33:18.350202] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.836 [2024-10-07 11:33:18.350480] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.836 [2024-10-07 11:33:18.350515] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.836 [2024-10-07 11:33:18.350533] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.836 [2024-10-07 11:33:18.350654] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.836 [2024-10-07 11:33:18.351820] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.836 [2024-10-07 11:33:18.351856] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.836 [2024-10-07 11:33:18.351919] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.836 [2024-10-07 11:33:18.352180] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.836 [2024-10-07 11:33:18.360306] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.836 [2024-10-07 11:33:18.360455] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.836 [2024-10-07 11:33:18.360486] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.836 [2024-10-07 11:33:18.360503] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.836 [2024-10-07 11:33:18.360529] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.836 [2024-10-07 11:33:18.360551] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.836 [2024-10-07 11:33:18.360566] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.836 [2024-10-07 11:33:18.360581] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.836 [2024-10-07 11:33:18.360605] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.836 [2024-10-07 11:33:18.372929] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.836 [2024-10-07 11:33:18.374998] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.836 [2024-10-07 11:33:18.375117] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.836 [2024-10-07 11:33:18.375170] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.836 [2024-10-07 11:33:18.375528] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.836 [2024-10-07 11:33:18.375809] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.836 [2024-10-07 11:33:18.375868] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.836 [2024-10-07 11:33:18.375900] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.836 [2024-10-07 11:33:18.376056] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.836 [2024-10-07 11:33:18.383090] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.836 [2024-10-07 11:33:18.383311] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.836 [2024-10-07 11:33:18.383348] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.836 [2024-10-07 11:33:18.383368] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.836 [2024-10-07 11:33:18.383409] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.836 [2024-10-07 11:33:18.383452] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.836 [2024-10-07 11:33:18.383482] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.836 [2024-10-07 11:33:18.383508] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.836 [2024-10-07 11:33:18.387620] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.836 [2024-10-07 11:33:18.393199] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.836 [2024-10-07 11:33:18.393356] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.836 [2024-10-07 11:33:18.393406] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.836 [2024-10-07 11:33:18.393424] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.836 [2024-10-07 11:33:18.393450] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.836 [2024-10-07 11:33:18.393472] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.836 [2024-10-07 11:33:18.393487] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.836 [2024-10-07 11:33:18.393502] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.836 [2024-10-07 11:33:18.393525] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.836 [2024-10-07 11:33:18.405064] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.837 [2024-10-07 11:33:18.405247] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.837 [2024-10-07 11:33:18.405281] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.837 [2024-10-07 11:33:18.405299] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.837 [2024-10-07 11:33:18.405325] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.837 [2024-10-07 11:33:18.405348] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.837 [2024-10-07 11:33:18.405363] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.837 [2024-10-07 11:33:18.405385] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.837 [2024-10-07 11:33:18.405409] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.837 [2024-10-07 11:33:18.415834] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.837 [2024-10-07 11:33:18.416147] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.837 [2024-10-07 11:33:18.416185] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.837 [2024-10-07 11:33:18.416205] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.837 [2024-10-07 11:33:18.416318] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.837 [2024-10-07 11:33:18.416725] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.837 [2024-10-07 11:33:18.416762] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.837 [2024-10-07 11:33:18.416780] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.837 [2024-10-07 11:33:18.417535] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.837 [2024-10-07 11:33:18.425939] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.837 [2024-10-07 11:33:18.426084] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.837 [2024-10-07 11:33:18.426116] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.837 [2024-10-07 11:33:18.426133] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.837 [2024-10-07 11:33:18.426158] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.837 [2024-10-07 11:33:18.426204] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.837 [2024-10-07 11:33:18.426219] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.837 [2024-10-07 11:33:18.426233] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.837 [2024-10-07 11:33:18.426256] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.837 [2024-10-07 11:33:18.436036] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.837 [2024-10-07 11:33:18.436178] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.837 [2024-10-07 11:33:18.436209] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.837 [2024-10-07 11:33:18.436226] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.837 [2024-10-07 11:33:18.436250] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.837 [2024-10-07 11:33:18.436273] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.837 [2024-10-07 11:33:18.436287] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.837 [2024-10-07 11:33:18.436302] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.837 [2024-10-07 11:33:18.436325] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.837 [2024-10-07 11:33:18.448908] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.837 [2024-10-07 11:33:18.449706] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.837 [2024-10-07 11:33:18.449765] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.837 [2024-10-07 11:33:18.449786] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.837 [2024-10-07 11:33:18.451007] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.837 [2024-10-07 11:33:18.452550] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.837 [2024-10-07 11:33:18.452586] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.837 [2024-10-07 11:33:18.452622] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.837 [2024-10-07 11:33:18.453047] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.837 [2024-10-07 11:33:18.460349] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.837 [2024-10-07 11:33:18.460584] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.837 [2024-10-07 11:33:18.460618] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.837 [2024-10-07 11:33:18.460636] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.837 [2024-10-07 11:33:18.460779] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.837 [2024-10-07 11:33:18.460909] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.837 [2024-10-07 11:33:18.460940] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.837 [2024-10-07 11:33:18.460959] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.837 [2024-10-07 11:33:18.462000] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.837 [2024-10-07 11:33:18.470933] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.837 [2024-10-07 11:33:18.471167] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.837 [2024-10-07 11:33:18.471238] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.837 [2024-10-07 11:33:18.471260] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.837 [2024-10-07 11:33:18.472730] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.837 [2024-10-07 11:33:18.472826] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.837 [2024-10-07 11:33:18.472849] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.837 [2024-10-07 11:33:18.472864] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.837 [2024-10-07 11:33:18.472888] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.837 [2024-10-07 11:33:18.481025] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.837 [2024-10-07 11:33:18.481164] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.837 [2024-10-07 11:33:18.481195] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.837 [2024-10-07 11:33:18.481211] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.837 [2024-10-07 11:33:18.481235] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.837 [2024-10-07 11:33:18.481257] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.837 [2024-10-07 11:33:18.481271] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.837 [2024-10-07 11:33:18.481285] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.837 [2024-10-07 11:33:18.481317] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.837 [2024-10-07 11:33:18.493246] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.837 [2024-10-07 11:33:18.493396] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.837 [2024-10-07 11:33:18.493428] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.837 [2024-10-07 11:33:18.493445] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.837 [2024-10-07 11:33:18.493469] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.837 [2024-10-07 11:33:18.493491] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.837 [2024-10-07 11:33:18.493512] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.837 [2024-10-07 11:33:18.493525] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.837 [2024-10-07 11:33:18.493807] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.837 [2024-10-07 11:33:18.507960] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.837 [2024-10-07 11:33:18.508176] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.837 [2024-10-07 11:33:18.508208] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.837 [2024-10-07 11:33:18.508248] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.837 [2024-10-07 11:33:18.508273] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.837 [2024-10-07 11:33:18.508296] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.837 [2024-10-07 11:33:18.508310] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.837 [2024-10-07 11:33:18.508323] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.837 [2024-10-07 11:33:18.508346] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.837 [2024-10-07 11:33:18.518555] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.837 [2024-10-07 11:33:18.518837] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.837 [2024-10-07 11:33:18.518885] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.837 [2024-10-07 11:33:18.518901] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.837 [2024-10-07 11:33:18.519291] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.837 [2024-10-07 11:33:18.520099] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.837 [2024-10-07 11:33:18.520134] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.837 [2024-10-07 11:33:18.520169] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.837 [2024-10-07 11:33:18.522195] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.837 [2024-10-07 11:33:18.528668] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.837 [2024-10-07 11:33:18.528805] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.837 [2024-10-07 11:33:18.528835] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.837 [2024-10-07 11:33:18.528851] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.837 [2024-10-07 11:33:18.528874] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.837 [2024-10-07 11:33:18.528896] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.837 [2024-10-07 11:33:18.528910] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.837 [2024-10-07 11:33:18.528924] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.837 [2024-10-07 11:33:18.528947] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.837 [2024-10-07 11:33:18.541199] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.837 [2024-10-07 11:33:18.541365] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.837 [2024-10-07 11:33:18.541396] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.837 [2024-10-07 11:33:18.541412] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.837 [2024-10-07 11:33:18.541435] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.837 [2024-10-07 11:33:18.541481] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.838 [2024-10-07 11:33:18.541497] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.838 [2024-10-07 11:33:18.541510] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.838 [2024-10-07 11:33:18.542385] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.838 [2024-10-07 11:33:18.556206] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.838 [2024-10-07 11:33:18.556423] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.838 [2024-10-07 11:33:18.556456] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.838 [2024-10-07 11:33:18.556472] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.838 [2024-10-07 11:33:18.556495] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.838 [2024-10-07 11:33:18.556518] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.838 [2024-10-07 11:33:18.556532] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.838 [2024-10-07 11:33:18.556546] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.838 [2024-10-07 11:33:18.556569] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.838 [2024-10-07 11:33:18.569361] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.838 [2024-10-07 11:33:18.570044] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.838 [2024-10-07 11:33:18.570102] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.838 [2024-10-07 11:33:18.570138] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.838 [2024-10-07 11:33:18.570347] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.838 [2024-10-07 11:33:18.570506] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.838 [2024-10-07 11:33:18.570530] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.838 [2024-10-07 11:33:18.570553] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.838 [2024-10-07 11:33:18.570772] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.838 [2024-10-07 11:33:18.580233] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.838 [2024-10-07 11:33:18.580368] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.838 [2024-10-07 11:33:18.580399] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.838 [2024-10-07 11:33:18.580416] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.838 [2024-10-07 11:33:18.580713] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.838 [2024-10-07 11:33:18.580869] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.838 [2024-10-07 11:33:18.580903] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.838 [2024-10-07 11:33:18.580921] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.838 [2024-10-07 11:33:18.581063] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.838 [2024-10-07 11:33:18.590323] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.838 [2024-10-07 11:33:18.590512] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.838 [2024-10-07 11:33:18.590544] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.838 [2024-10-07 11:33:18.590572] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.838 [2024-10-07 11:33:18.590744] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.838 [2024-10-07 11:33:18.590894] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.838 [2024-10-07 11:33:18.590917] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.838 [2024-10-07 11:33:18.590932] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.838 [2024-10-07 11:33:18.591120] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.838 [2024-10-07 11:33:18.602059] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.838 [2024-10-07 11:33:18.603575] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.838 [2024-10-07 11:33:18.603626] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.838 [2024-10-07 11:33:18.603660] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.838 [2024-10-07 11:33:18.603849] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.838 [2024-10-07 11:33:18.603900] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.838 [2024-10-07 11:33:18.603917] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.838 [2024-10-07 11:33:18.603932] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.838 [2024-10-07 11:33:18.603956] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.838 [2024-10-07 11:33:18.612150] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.838 [2024-10-07 11:33:18.612271] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.838 [2024-10-07 11:33:18.612302] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.838 [2024-10-07 11:33:18.612329] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.838 [2024-10-07 11:33:18.612364] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.838 [2024-10-07 11:33:18.612403] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.838 [2024-10-07 11:33:18.612417] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.838 [2024-10-07 11:33:18.612446] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.838 [2024-10-07 11:33:18.613985] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.838 [2024-10-07 11:33:18.622442] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.838 [2024-10-07 11:33:18.622583] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.838 [2024-10-07 11:33:18.622615] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.838 [2024-10-07 11:33:18.622673] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.838 [2024-10-07 11:33:18.622702] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.838 [2024-10-07 11:33:18.622725] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.838 [2024-10-07 11:33:18.622739] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.838 [2024-10-07 11:33:18.622754] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.838 [2024-10-07 11:33:18.622778] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.838 [2024-10-07 11:33:18.634018] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.838 [2024-10-07 11:33:18.634154] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.838 [2024-10-07 11:33:18.634195] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.838 [2024-10-07 11:33:18.634211] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.838 [2024-10-07 11:33:18.634234] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.838 [2024-10-07 11:33:18.634257] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.838 [2024-10-07 11:33:18.634270] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.838 [2024-10-07 11:33:18.634283] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.838 [2024-10-07 11:33:18.634305] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.838 [2024-10-07 11:33:18.644409] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.838 [2024-10-07 11:33:18.644650] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.838 [2024-10-07 11:33:18.644721] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.838 [2024-10-07 11:33:18.644743] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.838 [2024-10-07 11:33:18.644874] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.838 [2024-10-07 11:33:18.644979] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.838 [2024-10-07 11:33:18.645000] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.838 [2024-10-07 11:33:18.645030] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.838 [2024-10-07 11:33:18.647572] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.838 [2024-10-07 11:33:18.654505] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.838 [2024-10-07 11:33:18.654614] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.838 [2024-10-07 11:33:18.654645] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.838 [2024-10-07 11:33:18.654678] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.838 [2024-10-07 11:33:18.654704] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.838 [2024-10-07 11:33:18.654726] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.838 [2024-10-07 11:33:18.654765] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.838 [2024-10-07 11:33:18.654780] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.838 [2024-10-07 11:33:18.654804] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.838 [2024-10-07 11:33:18.664582] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.838 [2024-10-07 11:33:18.664720] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.838 [2024-10-07 11:33:18.664750] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.838 [2024-10-07 11:33:18.664765] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.838 [2024-10-07 11:33:18.664788] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.838 [2024-10-07 11:33:18.664808] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.838 [2024-10-07 11:33:18.664822] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.838 [2024-10-07 11:33:18.664835] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.838 [2024-10-07 11:33:18.664856] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.838 [2024-10-07 11:33:18.678333] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.838 [2024-10-07 11:33:18.678598] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.838 [2024-10-07 11:33:18.678632] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.838 [2024-10-07 11:33:18.678649] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.838 [2024-10-07 11:33:18.678673] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.838 [2024-10-07 11:33:18.678697] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.838 [2024-10-07 11:33:18.678728] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.838 [2024-10-07 11:33:18.678742] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.838 [2024-10-07 11:33:18.678767] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.838 [2024-10-07 11:33:18.692417] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.838 [2024-10-07 11:33:18.692534] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.838 [2024-10-07 11:33:18.692563] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.839 [2024-10-07 11:33:18.692579] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.839 [2024-10-07 11:33:18.692601] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.839 [2024-10-07 11:33:18.692621] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.839 [2024-10-07 11:33:18.692634] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.839 [2024-10-07 11:33:18.692647] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.839 [2024-10-07 11:33:18.692682] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.839 [2024-10-07 11:33:18.703967] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.839 [2024-10-07 11:33:18.704207] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.839 [2024-10-07 11:33:18.704238] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.839 [2024-10-07 11:33:18.704254] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.839 [2024-10-07 11:33:18.704349] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.839 [2024-10-07 11:33:18.704445] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.839 [2024-10-07 11:33:18.704463] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.839 [2024-10-07 11:33:18.704476] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.839 [2024-10-07 11:33:18.706783] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.839 [2024-10-07 11:33:18.714453] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.839 [2024-10-07 11:33:18.715393] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.839 [2024-10-07 11:33:18.715437] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.839 [2024-10-07 11:33:18.715457] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.839 [2024-10-07 11:33:18.715635] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.839 [2024-10-07 11:33:18.715768] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.839 [2024-10-07 11:33:18.715789] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.839 [2024-10-07 11:33:18.715802] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.839 [2024-10-07 11:33:18.715895] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.839 [2024-10-07 11:33:18.725192] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.839 [2024-10-07 11:33:18.725310] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.839 [2024-10-07 11:33:18.725339] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.839 [2024-10-07 11:33:18.725355] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.839 [2024-10-07 11:33:18.725376] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.839 [2024-10-07 11:33:18.725398] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.839 [2024-10-07 11:33:18.725411] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.839 [2024-10-07 11:33:18.725424] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.839 [2024-10-07 11:33:18.725446] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.839 [2024-10-07 11:33:18.735287] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.839 [2024-10-07 11:33:18.735406] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.839 [2024-10-07 11:33:18.735453] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.839 [2024-10-07 11:33:18.735471] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.839 [2024-10-07 11:33:18.735524] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.839 [2024-10-07 11:33:18.735572] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.839 [2024-10-07 11:33:18.735586] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.839 [2024-10-07 11:33:18.735600] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.839 [2024-10-07 11:33:18.735623] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.839 [2024-10-07 11:33:18.745369] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.839 [2024-10-07 11:33:18.745626] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.839 [2024-10-07 11:33:18.745675] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.839 [2024-10-07 11:33:18.745695] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.839 [2024-10-07 11:33:18.745832] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.839 [2024-10-07 11:33:18.745944] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.839 [2024-10-07 11:33:18.745965] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.839 [2024-10-07 11:33:18.745978] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.839 [2024-10-07 11:33:18.746121] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.839 [2024-10-07 11:33:18.756534] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.839 [2024-10-07 11:33:18.756780] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.839 [2024-10-07 11:33:18.756818] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.839 [2024-10-07 11:33:18.756837] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.839 [2024-10-07 11:33:18.756991] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.839 [2024-10-07 11:33:18.757134] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.839 [2024-10-07 11:33:18.757168] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.839 [2024-10-07 11:33:18.757185] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.839 [2024-10-07 11:33:18.757285] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.839 [2024-10-07 11:33:18.766631] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.839 [2024-10-07 11:33:18.766772] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.839 [2024-10-07 11:33:18.766803] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.839 [2024-10-07 11:33:18.766845] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.839 [2024-10-07 11:33:18.766868] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.839 [2024-10-07 11:33:18.766889] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.839 [2024-10-07 11:33:18.766903] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.839 [2024-10-07 11:33:18.766942] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.839 [2024-10-07 11:33:18.766966] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.839 [2024-10-07 11:33:18.776951] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.839 [2024-10-07 11:33:18.777077] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.839 [2024-10-07 11:33:18.777107] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.839 [2024-10-07 11:33:18.777123] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.839 [2024-10-07 11:33:18.777146] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.839 [2024-10-07 11:33:18.777167] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.839 [2024-10-07 11:33:18.777182] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.839 [2024-10-07 11:33:18.777195] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.839 [2024-10-07 11:33:18.777217] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.839 [2024-10-07 11:33:18.787173] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.839 [2024-10-07 11:33:18.787326] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.839 [2024-10-07 11:33:18.787358] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.839 [2024-10-07 11:33:18.787376] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.839 [2024-10-07 11:33:18.787401] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.839 [2024-10-07 11:33:18.787424] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.839 [2024-10-07 11:33:18.787439] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.839 [2024-10-07 11:33:18.787453] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.839 [2024-10-07 11:33:18.787477] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.839 [2024-10-07 11:33:18.799788] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.839 [2024-10-07 11:33:18.799914] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.839 [2024-10-07 11:33:18.799944] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.839 [2024-10-07 11:33:18.799967] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.839 [2024-10-07 11:33:18.799990] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.839 [2024-10-07 11:33:18.800012] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.839 [2024-10-07 11:33:18.800026] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.839 [2024-10-07 11:33:18.800039] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.839 [2024-10-07 11:33:18.800061] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.839 [2024-10-07 11:33:18.814303] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.839 [2024-10-07 11:33:18.815082] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.839 [2024-10-07 11:33:18.815164] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.839 [2024-10-07 11:33:18.815201] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.839 [2024-10-07 11:33:18.815624] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.839 [2024-10-07 11:33:18.815765] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.839 [2024-10-07 11:33:18.815796] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.839 [2024-10-07 11:33:18.815812] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.839 [2024-10-07 11:33:18.815978] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.839 [2024-10-07 11:33:18.829328] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.839 [2024-10-07 11:33:18.829466] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.839 [2024-10-07 11:33:18.829498] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.839 [2024-10-07 11:33:18.829515] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.839 [2024-10-07 11:33:18.829539] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.839 [2024-10-07 11:33:18.829566] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.839 [2024-10-07 11:33:18.829581] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.839 [2024-10-07 11:33:18.829610] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.839 [2024-10-07 11:33:18.829632] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.840 [2024-10-07 11:33:18.841125] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.840 [2024-10-07 11:33:18.841258] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.840 [2024-10-07 11:33:18.841290] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.840 [2024-10-07 11:33:18.841306] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.840 [2024-10-07 11:33:18.841329] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.840 [2024-10-07 11:33:18.841351] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.840 [2024-10-07 11:33:18.841364] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.840 [2024-10-07 11:33:18.841378] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.840 [2024-10-07 11:33:18.841400] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.840 [2024-10-07 11:33:18.851650] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.840 [2024-10-07 11:33:18.851837] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.840 [2024-10-07 11:33:18.851873] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.840 [2024-10-07 11:33:18.851889] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.840 [2024-10-07 11:33:18.851912] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.840 [2024-10-07 11:33:18.851968] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.840 [2024-10-07 11:33:18.851983] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.840 [2024-10-07 11:33:18.851996] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.840 [2024-10-07 11:33:18.852018] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.840 [2024-10-07 11:33:18.863842] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.840 [2024-10-07 11:33:18.864084] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.840 [2024-10-07 11:33:18.864127] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.840 [2024-10-07 11:33:18.864146] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.840 [2024-10-07 11:33:18.864275] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.840 [2024-10-07 11:33:18.864412] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.840 [2024-10-07 11:33:18.864434] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.840 [2024-10-07 11:33:18.864449] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.840 [2024-10-07 11:33:18.864558] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.840 [2024-10-07 11:33:18.875047] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.840 [2024-10-07 11:33:18.875363] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.840 [2024-10-07 11:33:18.875408] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.840 [2024-10-07 11:33:18.875429] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.840 [2024-10-07 11:33:18.875598] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.840 [2024-10-07 11:33:18.875766] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.840 [2024-10-07 11:33:18.875793] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.840 [2024-10-07 11:33:18.875807] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.840 [2024-10-07 11:33:18.875923] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.840 [2024-10-07 11:33:18.885469] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.840 [2024-10-07 11:33:18.885593] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.840 [2024-10-07 11:33:18.885623] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.840 [2024-10-07 11:33:18.885639] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.840 [2024-10-07 11:33:18.886085] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.840 [2024-10-07 11:33:18.886323] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.840 [2024-10-07 11:33:18.886366] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.840 [2024-10-07 11:33:18.886383] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.840 [2024-10-07 11:33:18.886495] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.840 8754.00 IOPS, 34.20 MiB/s [2024-10-07T11:33:33.363Z] [2024-10-07 11:33:18.900574] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.840 [2024-10-07 11:33:18.900904] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.840 [2024-10-07 11:33:18.900945] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.840 [2024-10-07 11:33:18.900969] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.840 [2024-10-07 11:33:18.901032] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.840 [2024-10-07 11:33:18.901061] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.840 [2024-10-07 11:33:18.901076] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.840 [2024-10-07 11:33:18.901089] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.840 [2024-10-07 11:33:18.901111] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.840 [2024-10-07 11:33:18.911794] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.840 [2024-10-07 11:33:18.912064] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.840 [2024-10-07 11:33:18.912097] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.840 [2024-10-07 11:33:18.912114] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.840 [2024-10-07 11:33:18.912539] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.840 [2024-10-07 11:33:18.913787] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.840 [2024-10-07 11:33:18.913824] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.840 [2024-10-07 11:33:18.913853] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.840 [2024-10-07 11:33:18.914206] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.840 [2024-10-07 11:33:18.923129] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.840 [2024-10-07 11:33:18.923426] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.840 [2024-10-07 11:33:18.923473] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.840 [2024-10-07 11:33:18.923493] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.840 [2024-10-07 11:33:18.923857] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.840 [2024-10-07 11:33:18.924086] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.840 [2024-10-07 11:33:18.924122] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.840 [2024-10-07 11:33:18.924140] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.840 [2024-10-07 11:33:18.924253] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.840 [2024-10-07 11:33:18.933413] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.840 [2024-10-07 11:33:18.933557] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.840 [2024-10-07 11:33:18.933611] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.840 [2024-10-07 11:33:18.933630] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.840 [2024-10-07 11:33:18.933656] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.840 [2024-10-07 11:33:18.933698] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.840 [2024-10-07 11:33:18.933714] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.840 [2024-10-07 11:33:18.933729] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.840 [2024-10-07 11:33:18.933753] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.840 [2024-10-07 11:33:18.949131] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.840 [2024-10-07 11:33:18.950060] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.840 [2024-10-07 11:33:18.950121] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.840 [2024-10-07 11:33:18.950142] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.840 [2024-10-07 11:33:18.950706] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.840 [2024-10-07 11:33:18.950950] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.840 [2024-10-07 11:33:18.951038] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.840 [2024-10-07 11:33:18.951057] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.840 [2024-10-07 11:33:18.951285] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.840 [2024-10-07 11:33:18.960318] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.840 [2024-10-07 11:33:18.962574] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.840 [2024-10-07 11:33:18.962636] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.840 [2024-10-07 11:33:18.962656] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.840 [2024-10-07 11:33:18.963152] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.840 [2024-10-07 11:33:18.963586] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.840 [2024-10-07 11:33:18.963635] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.841 [2024-10-07 11:33:18.963693] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.841 [2024-10-07 11:33:18.963917] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.841 [2024-10-07 11:33:18.971010] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.841 [2024-10-07 11:33:18.971136] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.841 [2024-10-07 11:33:18.971166] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.841 [2024-10-07 11:33:18.971182] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.841 [2024-10-07 11:33:18.971239] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.841 [2024-10-07 11:33:18.971307] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.841 [2024-10-07 11:33:18.971327] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.841 [2024-10-07 11:33:18.971342] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.841 [2024-10-07 11:33:18.971366] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.841 [2024-10-07 11:33:18.981108] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.841 [2024-10-07 11:33:18.981259] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.841 [2024-10-07 11:33:18.981291] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.841 [2024-10-07 11:33:18.981308] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.841 [2024-10-07 11:33:18.981332] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.841 [2024-10-07 11:33:18.981354] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.841 [2024-10-07 11:33:18.981369] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.841 [2024-10-07 11:33:18.981383] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.841 [2024-10-07 11:33:18.981406] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.841 [2024-10-07 11:33:18.994498] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.841 [2024-10-07 11:33:18.994824] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.841 [2024-10-07 11:33:18.994885] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.841 [2024-10-07 11:33:18.994906] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.841 [2024-10-07 11:33:18.995035] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.841 [2024-10-07 11:33:18.995269] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.841 [2024-10-07 11:33:18.995307] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.841 [2024-10-07 11:33:18.995326] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.841 [2024-10-07 11:33:18.995383] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.841 [2024-10-07 11:33:19.009288] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.841 [2024-10-07 11:33:19.009433] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.841 [2024-10-07 11:33:19.009464] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.841 [2024-10-07 11:33:19.009481] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.841 [2024-10-07 11:33:19.009505] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.841 [2024-10-07 11:33:19.009527] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.841 [2024-10-07 11:33:19.009541] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.841 [2024-10-07 11:33:19.009555] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.841 [2024-10-07 11:33:19.009577] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.841 [2024-10-07 11:33:19.024967] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.841 [2024-10-07 11:33:19.025123] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.841 [2024-10-07 11:33:19.025158] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.841 [2024-10-07 11:33:19.025175] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.841 [2024-10-07 11:33:19.025200] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.841 [2024-10-07 11:33:19.025223] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.841 [2024-10-07 11:33:19.025239] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.841 [2024-10-07 11:33:19.025255] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.841 [2024-10-07 11:33:19.025280] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.841 [2024-10-07 11:33:19.036650] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.841 [2024-10-07 11:33:19.036910] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.841 [2024-10-07 11:33:19.036946] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.841 [2024-10-07 11:33:19.036972] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.841 [2024-10-07 11:33:19.037154] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.841 [2024-10-07 11:33:19.037284] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.841 [2024-10-07 11:33:19.037307] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.841 [2024-10-07 11:33:19.037324] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.841 [2024-10-07 11:33:19.039230] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.841 [2024-10-07 11:33:19.046773] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.841 [2024-10-07 11:33:19.046939] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.841 [2024-10-07 11:33:19.046971] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.841 [2024-10-07 11:33:19.046988] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.841 [2024-10-07 11:33:19.047013] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.841 [2024-10-07 11:33:19.047036] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.841 [2024-10-07 11:33:19.047050] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.841 [2024-10-07 11:33:19.047064] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.841 [2024-10-07 11:33:19.047086] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.841 [2024-10-07 11:33:19.056889] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.841 [2024-10-07 11:33:19.057017] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.841 [2024-10-07 11:33:19.057049] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.841 [2024-10-07 11:33:19.057103] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.841 [2024-10-07 11:33:19.057130] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.841 [2024-10-07 11:33:19.057153] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.841 [2024-10-07 11:33:19.057168] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.841 [2024-10-07 11:33:19.057182] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.841 [2024-10-07 11:33:19.057206] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.841 [2024-10-07 11:33:19.068349] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.841 [2024-10-07 11:33:19.068691] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.841 [2024-10-07 11:33:19.068736] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.841 [2024-10-07 11:33:19.068757] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.841 [2024-10-07 11:33:19.068913] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.841 [2024-10-07 11:33:19.069147] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.841 [2024-10-07 11:33:19.069183] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.841 [2024-10-07 11:33:19.069200] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.841 [2024-10-07 11:33:19.069699] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.841 [2024-10-07 11:33:19.078481] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.841 [2024-10-07 11:33:19.078600] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.841 [2024-10-07 11:33:19.078632] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.841 [2024-10-07 11:33:19.078665] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.841 [2024-10-07 11:33:19.078693] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.841 [2024-10-07 11:33:19.078716] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.841 [2024-10-07 11:33:19.078731] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.841 [2024-10-07 11:33:19.078746] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.841 [2024-10-07 11:33:19.078771] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.841 [2024-10-07 11:33:19.088560] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.841 [2024-10-07 11:33:19.088705] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.841 [2024-10-07 11:33:19.088737] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.841 [2024-10-07 11:33:19.088754] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.841 [2024-10-07 11:33:19.088778] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.841 [2024-10-07 11:33:19.088800] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.841 [2024-10-07 11:33:19.088838] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.841 [2024-10-07 11:33:19.088853] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.841 [2024-10-07 11:33:19.088877] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.841 [2024-10-07 11:33:19.100093] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.841 [2024-10-07 11:33:19.100391] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.841 [2024-10-07 11:33:19.100434] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.841 [2024-10-07 11:33:19.100454] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.841 [2024-10-07 11:33:19.100642] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.841 [2024-10-07 11:33:19.100737] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.841 [2024-10-07 11:33:19.100759] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.841 [2024-10-07 11:33:19.100772] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.841 [2024-10-07 11:33:19.100795] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.841 [2024-10-07 11:33:19.112837] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.841 [2024-10-07 11:33:19.113079] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.841 [2024-10-07 11:33:19.113118] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.841 [2024-10-07 11:33:19.113136] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.841 [2024-10-07 11:33:19.113260] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.841 [2024-10-07 11:33:19.113370] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.841 [2024-10-07 11:33:19.113391] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.841 [2024-10-07 11:33:19.113406] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.841 [2024-10-07 11:33:19.113513] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.841 [2024-10-07 11:33:19.123178] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.841 [2024-10-07 11:33:19.123427] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.841 [2024-10-07 11:33:19.123462] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.842 [2024-10-07 11:33:19.123479] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.842 [2024-10-07 11:33:19.123608] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.842 [2024-10-07 11:33:19.125465] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.842 [2024-10-07 11:33:19.125501] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.842 [2024-10-07 11:33:19.125536] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.842 [2024-10-07 11:33:19.127606] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.842 [2024-10-07 11:33:19.133298] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.842 [2024-10-07 11:33:19.133461] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.842 [2024-10-07 11:33:19.133491] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.842 [2024-10-07 11:33:19.133506] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.842 [2024-10-07 11:33:19.133764] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.842 [2024-10-07 11:33:19.133910] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.842 [2024-10-07 11:33:19.133943] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.842 [2024-10-07 11:33:19.133966] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.842 [2024-10-07 11:33:19.134120] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.842 [2024-10-07 11:33:19.143422] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.842 [2024-10-07 11:33:19.143563] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.842 [2024-10-07 11:33:19.143594] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.842 [2024-10-07 11:33:19.143611] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.842 [2024-10-07 11:33:19.143633] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.842 [2024-10-07 11:33:19.143655] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.842 [2024-10-07 11:33:19.143684] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.842 [2024-10-07 11:33:19.143714] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.842 [2024-10-07 11:33:19.143736] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.842 [2024-10-07 11:33:19.154210] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.842 [2024-10-07 11:33:19.156711] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.842 [2024-10-07 11:33:19.156751] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.842 [2024-10-07 11:33:19.156769] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.842 [2024-10-07 11:33:19.157094] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.842 [2024-10-07 11:33:19.157266] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.842 [2024-10-07 11:33:19.157300] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.842 [2024-10-07 11:33:19.157317] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.842 [2024-10-07 11:33:19.157427] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.842 [2024-10-07 11:33:19.166193] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.842 [2024-10-07 11:33:19.166558] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.842 [2024-10-07 11:33:19.166602] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.842 [2024-10-07 11:33:19.166623] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.842 [2024-10-07 11:33:19.166740] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.842 [2024-10-07 11:33:19.166771] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.842 [2024-10-07 11:33:19.166787] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.842 [2024-10-07 11:33:19.166801] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.842 [2024-10-07 11:33:19.166858] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.842 [2024-10-07 11:33:19.177020] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.842 [2024-10-07 11:33:19.177263] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.842 [2024-10-07 11:33:19.177294] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.842 [2024-10-07 11:33:19.177310] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.842 [2024-10-07 11:33:19.177394] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.842 [2024-10-07 11:33:19.177446] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.842 [2024-10-07 11:33:19.177467] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.842 [2024-10-07 11:33:19.177480] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.842 [2024-10-07 11:33:19.177503] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.842 [2024-10-07 11:33:19.191122] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.842 [2024-10-07 11:33:19.191576] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.842 [2024-10-07 11:33:19.191619] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.842 [2024-10-07 11:33:19.191639] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.842 [2024-10-07 11:33:19.191709] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.842 [2024-10-07 11:33:19.191753] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.842 [2024-10-07 11:33:19.191768] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.842 [2024-10-07 11:33:19.191782] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.842 [2024-10-07 11:33:19.191804] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.842 [2024-10-07 11:33:19.204615] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.842 [2024-10-07 11:33:19.204762] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.842 [2024-10-07 11:33:19.204793] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.842 [2024-10-07 11:33:19.204809] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.842 [2024-10-07 11:33:19.204833] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.842 [2024-10-07 11:33:19.204855] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.842 [2024-10-07 11:33:19.204869] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.842 [2024-10-07 11:33:19.204912] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.842 [2024-10-07 11:33:19.204936] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.842 [2024-10-07 11:33:19.214726] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.842 [2024-10-07 11:33:19.215530] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.842 [2024-10-07 11:33:19.215605] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.842 [2024-10-07 11:33:19.215624] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.842 [2024-10-07 11:33:19.215824] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.842 [2024-10-07 11:33:19.215867] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.842 [2024-10-07 11:33:19.215884] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.842 [2024-10-07 11:33:19.215898] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.842 [2024-10-07 11:33:19.215921] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.842 [2024-10-07 11:33:19.226398] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.842 [2024-10-07 11:33:19.226778] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.842 [2024-10-07 11:33:19.226824] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.842 [2024-10-07 11:33:19.226844] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.842 [2024-10-07 11:33:19.227101] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.842 [2024-10-07 11:33:19.227188] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.842 [2024-10-07 11:33:19.227241] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.842 [2024-10-07 11:33:19.227257] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.842 [2024-10-07 11:33:19.227283] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.842 [2024-10-07 11:33:19.238332] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.842 [2024-10-07 11:33:19.238497] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.842 [2024-10-07 11:33:19.238529] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.842 [2024-10-07 11:33:19.238546] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.842 [2024-10-07 11:33:19.238793] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.842 [2024-10-07 11:33:19.239039] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.842 [2024-10-07 11:33:19.239072] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.842 [2024-10-07 11:33:19.239089] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.842 [2024-10-07 11:33:19.239241] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.842 [2024-10-07 11:33:19.248427] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.842 [2024-10-07 11:33:19.248553] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.842 [2024-10-07 11:33:19.248608] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.842 [2024-10-07 11:33:19.248626] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.842 [2024-10-07 11:33:19.248855] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.842 [2024-10-07 11:33:19.249055] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.842 [2024-10-07 11:33:19.249089] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.842 [2024-10-07 11:33:19.249106] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.842 [2024-10-07 11:33:19.249213] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.842 [2024-10-07 11:33:19.261169] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.843 [2024-10-07 11:33:19.261346] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.843 [2024-10-07 11:33:19.261393] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.843 [2024-10-07 11:33:19.261411] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.843 [2024-10-07 11:33:19.261435] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.843 [2024-10-07 11:33:19.261459] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.843 [2024-10-07 11:33:19.261474] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.843 [2024-10-07 11:33:19.261488] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.843 [2024-10-07 11:33:19.261512] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.843 [2024-10-07 11:33:19.276499] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.843 [2024-10-07 11:33:19.276864] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.843 [2024-10-07 11:33:19.276910] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.843 [2024-10-07 11:33:19.276932] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.843 [2024-10-07 11:33:19.277175] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.843 [2024-10-07 11:33:19.277252] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.843 [2024-10-07 11:33:19.277276] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.843 [2024-10-07 11:33:19.277292] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.843 [2024-10-07 11:33:19.277316] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.843 [2024-10-07 11:33:19.289003] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.843 [2024-10-07 11:33:19.289309] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.843 [2024-10-07 11:33:19.289343] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.843 [2024-10-07 11:33:19.289376] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.843 [2024-10-07 11:33:19.289497] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.843 [2024-10-07 11:33:19.291461] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.843 [2024-10-07 11:33:19.291509] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.843 [2024-10-07 11:33:19.291529] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.843 [2024-10-07 11:33:19.293655] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.843 [2024-10-07 11:33:19.299129] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.843 [2024-10-07 11:33:19.299599] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.843 [2024-10-07 11:33:19.299643] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.843 [2024-10-07 11:33:19.299680] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.843 [2024-10-07 11:33:19.299873] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.843 [2024-10-07 11:33:19.300001] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.843 [2024-10-07 11:33:19.300032] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.843 [2024-10-07 11:33:19.300049] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.843 [2024-10-07 11:33:19.300166] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.843 [2024-10-07 11:33:19.309224] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.843 [2024-10-07 11:33:19.309365] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.843 [2024-10-07 11:33:19.309396] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.843 [2024-10-07 11:33:19.309412] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.843 [2024-10-07 11:33:19.309435] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.843 [2024-10-07 11:33:19.309457] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.843 [2024-10-07 11:33:19.309471] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.843 [2024-10-07 11:33:19.309484] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.843 [2024-10-07 11:33:19.309506] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.843 [2024-10-07 11:33:19.321645] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.843 [2024-10-07 11:33:19.322363] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.843 [2024-10-07 11:33:19.322421] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.843 [2024-10-07 11:33:19.322462] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.843 [2024-10-07 11:33:19.323146] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.843 [2024-10-07 11:33:19.323300] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.843 [2024-10-07 11:33:19.323326] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.843 [2024-10-07 11:33:19.323342] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.843 [2024-10-07 11:33:19.323390] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.843 [2024-10-07 11:33:19.333619] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.843 [2024-10-07 11:33:19.334086] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.843 [2024-10-07 11:33:19.334130] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.843 [2024-10-07 11:33:19.334150] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.843 [2024-10-07 11:33:19.335326] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.843 [2024-10-07 11:33:19.335975] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.843 [2024-10-07 11:33:19.336013] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.843 [2024-10-07 11:33:19.336031] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.843 [2024-10-07 11:33:19.336305] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.843 [2024-10-07 11:33:19.344538] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.843 [2024-10-07 11:33:19.344800] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.843 [2024-10-07 11:33:19.344833] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.843 [2024-10-07 11:33:19.344850] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.843 [2024-10-07 11:33:19.344975] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.843 [2024-10-07 11:33:19.345100] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.843 [2024-10-07 11:33:19.345124] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.843 [2024-10-07 11:33:19.345139] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.843 [2024-10-07 11:33:19.345255] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.843 [2024-10-07 11:33:19.354815] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.843 [2024-10-07 11:33:19.355001] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.843 [2024-10-07 11:33:19.355034] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.843 [2024-10-07 11:33:19.355051] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.843 [2024-10-07 11:33:19.355075] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.843 [2024-10-07 11:33:19.355097] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.843 [2024-10-07 11:33:19.355111] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.843 [2024-10-07 11:33:19.355125] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.844 [2024-10-07 11:33:19.355177] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.844 [2024-10-07 11:33:19.364949] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.844 [2024-10-07 11:33:19.365065] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.844 [2024-10-07 11:33:19.365096] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.844 [2024-10-07 11:33:19.365135] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.844 [2024-10-07 11:33:19.365159] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.844 [2024-10-07 11:33:19.365180] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.844 [2024-10-07 11:33:19.365194] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.844 [2024-10-07 11:33:19.365207] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.844 [2024-10-07 11:33:19.365229] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.844 [2024-10-07 11:33:19.375048] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.844 [2024-10-07 11:33:19.375189] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.844 [2024-10-07 11:33:19.375259] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.844 [2024-10-07 11:33:19.375276] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.844 [2024-10-07 11:33:19.375300] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.844 [2024-10-07 11:33:19.377596] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.844 [2024-10-07 11:33:19.377633] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.844 [2024-10-07 11:33:19.377696] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.844 [2024-10-07 11:33:19.377977] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.844 [2024-10-07 11:33:19.385154] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.844 [2024-10-07 11:33:19.385286] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.844 [2024-10-07 11:33:19.385317] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.844 [2024-10-07 11:33:19.385333] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.844 [2024-10-07 11:33:19.385355] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.844 [2024-10-07 11:33:19.385376] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.844 [2024-10-07 11:33:19.385390] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.844 [2024-10-07 11:33:19.385403] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.844 [2024-10-07 11:33:19.385424] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.844 [2024-10-07 11:33:19.398521] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.844 [2024-10-07 11:33:19.398661] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.844 [2024-10-07 11:33:19.398706] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.844 [2024-10-07 11:33:19.398723] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.844 [2024-10-07 11:33:19.398748] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.844 [2024-10-07 11:33:19.398770] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.844 [2024-10-07 11:33:19.398815] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.844 [2024-10-07 11:33:19.398832] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.844 [2024-10-07 11:33:19.398865] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.844 [2024-10-07 11:33:19.411511] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.844 [2024-10-07 11:33:19.411957] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.844 [2024-10-07 11:33:19.412003] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.844 [2024-10-07 11:33:19.412023] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.844 [2024-10-07 11:33:19.412078] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.844 [2024-10-07 11:33:19.412106] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.844 [2024-10-07 11:33:19.412121] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.844 [2024-10-07 11:33:19.412135] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.844 [2024-10-07 11:33:19.412343] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.844 [2024-10-07 11:33:19.422806] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.844 [2024-10-07 11:33:19.423084] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.844 [2024-10-07 11:33:19.423118] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.844 [2024-10-07 11:33:19.423136] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.844 [2024-10-07 11:33:19.423285] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.844 [2024-10-07 11:33:19.423425] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.844 [2024-10-07 11:33:19.423458] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.844 [2024-10-07 11:33:19.423477] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.844 [2024-10-07 11:33:19.424289] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.844 [2024-10-07 11:33:19.432940] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.844 [2024-10-07 11:33:19.433086] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.844 [2024-10-07 11:33:19.433118] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.844 [2024-10-07 11:33:19.433135] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.844 [2024-10-07 11:33:19.433159] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.844 [2024-10-07 11:33:19.433184] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.844 [2024-10-07 11:33:19.433199] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.844 [2024-10-07 11:33:19.433213] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.844 [2024-10-07 11:33:19.433236] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.844 [2024-10-07 11:33:19.444562] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.844 [2024-10-07 11:33:19.446268] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.844 [2024-10-07 11:33:19.446318] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.844 [2024-10-07 11:33:19.446340] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.844 [2024-10-07 11:33:19.446592] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.844 [2024-10-07 11:33:19.446672] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.844 [2024-10-07 11:33:19.446697] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.844 [2024-10-07 11:33:19.446712] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.844 [2024-10-07 11:33:19.446739] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.844 [2024-10-07 11:33:19.456506] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.844 [2024-10-07 11:33:19.456783] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.844 [2024-10-07 11:33:19.456818] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.844 [2024-10-07 11:33:19.456836] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.844 [2024-10-07 11:33:19.456978] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.844 [2024-10-07 11:33:19.457099] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.845 [2024-10-07 11:33:19.457130] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.845 [2024-10-07 11:33:19.457149] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.845 [2024-10-07 11:33:19.457254] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.845 [2024-10-07 11:33:19.467742] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.845 [2024-10-07 11:33:19.467969] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.845 [2024-10-07 11:33:19.468012] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.845 [2024-10-07 11:33:19.468032] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.845 [2024-10-07 11:33:19.468145] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.845 [2024-10-07 11:33:19.468249] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.845 [2024-10-07 11:33:19.468274] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.845 [2024-10-07 11:33:19.468290] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.845 [2024-10-07 11:33:19.468382] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.845 [2024-10-07 11:33:19.477826] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.845 [2024-10-07 11:33:19.477938] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.845 [2024-10-07 11:33:19.477969] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.845 [2024-10-07 11:33:19.478015] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.845 [2024-10-07 11:33:19.478042] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.845 [2024-10-07 11:33:19.478065] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.845 [2024-10-07 11:33:19.478080] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.845 [2024-10-07 11:33:19.478094] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.845 [2024-10-07 11:33:19.478132] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.845 [2024-10-07 11:33:19.490855] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.845 [2024-10-07 11:33:19.491125] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.845 [2024-10-07 11:33:19.491162] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.845 [2024-10-07 11:33:19.491181] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.845 [2024-10-07 11:33:19.491312] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.845 [2024-10-07 11:33:19.491703] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.845 [2024-10-07 11:33:19.491738] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.845 [2024-10-07 11:33:19.491755] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.845 [2024-10-07 11:33:19.493686] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.845 [2024-10-07 11:33:19.503127] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.845 [2024-10-07 11:33:19.505663] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.845 [2024-10-07 11:33:19.505750] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.845 [2024-10-07 11:33:19.505774] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.845 [2024-10-07 11:33:19.506035] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.845 [2024-10-07 11:33:19.506102] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.845 [2024-10-07 11:33:19.506124] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.845 [2024-10-07 11:33:19.506141] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.845 [2024-10-07 11:33:19.506167] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.845 [2024-10-07 11:33:19.513233] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.845 [2024-10-07 11:33:19.513384] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.845 [2024-10-07 11:33:19.513418] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.845 [2024-10-07 11:33:19.513436] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.845 [2024-10-07 11:33:19.513462] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.845 [2024-10-07 11:33:19.513485] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.845 [2024-10-07 11:33:19.513511] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.845 [2024-10-07 11:33:19.513541] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.845 [2024-10-07 11:33:19.513567] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.845 [2024-10-07 11:33:19.526342] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.845 [2024-10-07 11:33:19.526520] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.845 [2024-10-07 11:33:19.526555] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.845 [2024-10-07 11:33:19.526573] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.845 [2024-10-07 11:33:19.526599] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.845 [2024-10-07 11:33:19.526623] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.845 [2024-10-07 11:33:19.526639] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.845 [2024-10-07 11:33:19.526655] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.845 [2024-10-07 11:33:19.526695] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.845 [2024-10-07 11:33:19.538373] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.845 [2024-10-07 11:33:19.538803] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.845 [2024-10-07 11:33:19.538871] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.845 [2024-10-07 11:33:19.538920] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.845 [2024-10-07 11:33:19.539105] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.845 [2024-10-07 11:33:19.539307] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.845 [2024-10-07 11:33:19.539363] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.845 [2024-10-07 11:33:19.539401] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.845 [2024-10-07 11:33:19.543606] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.845 [2024-10-07 11:33:19.550456] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.845 [2024-10-07 11:33:19.550660] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.845 [2024-10-07 11:33:19.550696] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.845 [2024-10-07 11:33:19.550716] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.845 [2024-10-07 11:33:19.550745] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.845 [2024-10-07 11:33:19.550770] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.845 [2024-10-07 11:33:19.550786] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.845 [2024-10-07 11:33:19.550801] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.845 [2024-10-07 11:33:19.550826] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.845 [2024-10-07 11:33:19.560947] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.845 [2024-10-07 11:33:19.561135] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.845 [2024-10-07 11:33:19.561169] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.845 [2024-10-07 11:33:19.561188] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.845 [2024-10-07 11:33:19.561214] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.845 [2024-10-07 11:33:19.561238] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.845 [2024-10-07 11:33:19.561253] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.845 [2024-10-07 11:33:19.561268] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.845 [2024-10-07 11:33:19.561292] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.845 [2024-10-07 11:33:19.572096] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.845 [2024-10-07 11:33:19.572772] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.845 [2024-10-07 11:33:19.572821] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.845 [2024-10-07 11:33:19.572853] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.845 [2024-10-07 11:33:19.574089] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.845 [2024-10-07 11:33:19.574683] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.845 [2024-10-07 11:33:19.574721] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.845 [2024-10-07 11:33:19.574741] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.845 [2024-10-07 11:33:19.574983] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.845 [2024-10-07 11:33:19.583266] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.845 [2024-10-07 11:33:19.583537] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.845 [2024-10-07 11:33:19.583575] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.845 [2024-10-07 11:33:19.583595] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.846 [2024-10-07 11:33:19.583746] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.846 [2024-10-07 11:33:19.583894] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.846 [2024-10-07 11:33:19.583928] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.846 [2024-10-07 11:33:19.583948] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.846 [2024-10-07 11:33:19.584057] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.846 [2024-10-07 11:33:19.594015] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.846 [2024-10-07 11:33:19.594415] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.846 [2024-10-07 11:33:19.594479] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.846 [2024-10-07 11:33:19.594501] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.846 [2024-10-07 11:33:19.594592] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.846 [2024-10-07 11:33:19.594625] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.846 [2024-10-07 11:33:19.594641] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.846 [2024-10-07 11:33:19.594674] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.846 [2024-10-07 11:33:19.594702] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.846 [2024-10-07 11:33:19.608099] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.846 [2024-10-07 11:33:19.608393] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.846 [2024-10-07 11:33:19.608430] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.846 [2024-10-07 11:33:19.608450] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.846 [2024-10-07 11:33:19.608808] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.846 [2024-10-07 11:33:19.609970] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.846 [2024-10-07 11:33:19.610013] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.846 [2024-10-07 11:33:19.610044] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.846 [2024-10-07 11:33:19.610797] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.846 [2024-10-07 11:33:19.619631] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.846 [2024-10-07 11:33:19.619870] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.846 [2024-10-07 11:33:19.619920] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.846 [2024-10-07 11:33:19.619953] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.846 [2024-10-07 11:33:19.619994] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.846 [2024-10-07 11:33:19.620043] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.846 [2024-10-07 11:33:19.620069] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.846 [2024-10-07 11:33:19.620094] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.846 [2024-10-07 11:33:19.620131] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.846 [2024-10-07 11:33:19.632217] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.846 [2024-10-07 11:33:19.632755] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.846 [2024-10-07 11:33:19.632806] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.846 [2024-10-07 11:33:19.632828] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.846 [2024-10-07 11:33:19.632972] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.846 [2024-10-07 11:33:19.633135] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.846 [2024-10-07 11:33:19.633176] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.846 [2024-10-07 11:33:19.633226] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.846 [2024-10-07 11:33:19.633295] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.846 [2024-10-07 11:33:19.646500] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.846 [2024-10-07 11:33:19.647179] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.846 [2024-10-07 11:33:19.647255] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.846 [2024-10-07 11:33:19.647278] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.846 [2024-10-07 11:33:19.647515] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.846 [2024-10-07 11:33:19.648078] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.846 [2024-10-07 11:33:19.648115] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.846 [2024-10-07 11:33:19.648158] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.846 [2024-10-07 11:33:19.648404] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.846 [2024-10-07 11:33:19.660440] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.846 [2024-10-07 11:33:19.660625] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.846 [2024-10-07 11:33:19.660659] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.846 [2024-10-07 11:33:19.660695] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.846 [2024-10-07 11:33:19.660722] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.846 [2024-10-07 11:33:19.660746] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.846 [2024-10-07 11:33:19.660761] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.846 [2024-10-07 11:33:19.660777] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.846 [2024-10-07 11:33:19.660802] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.846 [2024-10-07 11:33:19.673488] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.846 [2024-10-07 11:33:19.674539] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.846 [2024-10-07 11:33:19.674589] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.846 [2024-10-07 11:33:19.674612] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.846 [2024-10-07 11:33:19.674910] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.846 [2024-10-07 11:33:19.674976] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.846 [2024-10-07 11:33:19.674999] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.846 [2024-10-07 11:33:19.675031] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.846 [2024-10-07 11:33:19.675075] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.846 [2024-10-07 11:33:19.686420] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.846 [2024-10-07 11:33:19.686814] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.846 [2024-10-07 11:33:19.686907] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.846 [2024-10-07 11:33:19.686931] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.846 [2024-10-07 11:33:19.686995] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.846 [2024-10-07 11:33:19.687042] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.846 [2024-10-07 11:33:19.687058] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.846 [2024-10-07 11:33:19.687073] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.846 [2024-10-07 11:33:19.687099] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.846 [2024-10-07 11:33:19.698223] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.846 [2024-10-07 11:33:19.698556] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.846 [2024-10-07 11:33:19.698593] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.846 [2024-10-07 11:33:19.698612] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.846 [2024-10-07 11:33:19.698748] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.846 [2024-10-07 11:33:19.699337] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.846 [2024-10-07 11:33:19.699376] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.846 [2024-10-07 11:33:19.699395] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.846 [2024-10-07 11:33:19.701794] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.846 [2024-10-07 11:33:19.710849] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.846 [2024-10-07 11:33:19.711290] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.846 [2024-10-07 11:33:19.711339] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.846 [2024-10-07 11:33:19.711361] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.846 [2024-10-07 11:33:19.713534] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.846 [2024-10-07 11:33:19.713874] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.846 [2024-10-07 11:33:19.713911] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.846 [2024-10-07 11:33:19.713930] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.846 [2024-10-07 11:33:19.714510] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.846 [2024-10-07 11:33:19.721055] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.846 [2024-10-07 11:33:19.721223] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.846 [2024-10-07 11:33:19.721255] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.847 [2024-10-07 11:33:19.721273] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.847 [2024-10-07 11:33:19.721298] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.847 [2024-10-07 11:33:19.721516] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.847 [2024-10-07 11:33:19.721541] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.847 [2024-10-07 11:33:19.721557] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.847 [2024-10-07 11:33:19.721617] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.847 [2024-10-07 11:33:19.733767] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.847 [2024-10-07 11:33:19.733982] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.847 [2024-10-07 11:33:19.734050] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.847 [2024-10-07 11:33:19.734069] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.847 [2024-10-07 11:33:19.734097] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.847 [2024-10-07 11:33:19.734122] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.847 [2024-10-07 11:33:19.734137] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.847 [2024-10-07 11:33:19.734153] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.847 [2024-10-07 11:33:19.734178] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.847 [2024-10-07 11:33:19.748828] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.847 [2024-10-07 11:33:19.749242] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.847 [2024-10-07 11:33:19.749289] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.847 [2024-10-07 11:33:19.749311] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.847 [2024-10-07 11:33:19.749371] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.847 [2024-10-07 11:33:19.749430] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.847 [2024-10-07 11:33:19.749446] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.847 [2024-10-07 11:33:19.749461] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.847 [2024-10-07 11:33:19.749485] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.847 [2024-10-07 11:33:19.761296] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.847 [2024-10-07 11:33:19.761468] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.847 [2024-10-07 11:33:19.761502] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.847 [2024-10-07 11:33:19.761535] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.847 [2024-10-07 11:33:19.762108] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.847 [2024-10-07 11:33:19.762224] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.847 [2024-10-07 11:33:19.762249] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.847 [2024-10-07 11:33:19.762265] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.847 [2024-10-07 11:33:19.762325] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.847 [2024-10-07 11:33:19.772069] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.847 [2024-10-07 11:33:19.772303] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.847 [2024-10-07 11:33:19.772337] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.847 [2024-10-07 11:33:19.772359] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.847 [2024-10-07 11:33:19.772461] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.847 [2024-10-07 11:33:19.772822] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.847 [2024-10-07 11:33:19.772859] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.847 [2024-10-07 11:33:19.772878] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.847 [2024-10-07 11:33:19.772946] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.847 [2024-10-07 11:33:19.782186] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.847 [2024-10-07 11:33:19.782333] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.847 [2024-10-07 11:33:19.782366] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.847 [2024-10-07 11:33:19.782383] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.847 [2024-10-07 11:33:19.782423] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.847 [2024-10-07 11:33:19.782472] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.847 [2024-10-07 11:33:19.782486] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.847 [2024-10-07 11:33:19.782501] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.847 [2024-10-07 11:33:19.782524] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.847 [2024-10-07 11:33:19.792310] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.847 [2024-10-07 11:33:19.792469] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.847 [2024-10-07 11:33:19.792500] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.847 [2024-10-07 11:33:19.792517] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.847 [2024-10-07 11:33:19.792541] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.847 [2024-10-07 11:33:19.792563] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.847 [2024-10-07 11:33:19.792577] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.847 [2024-10-07 11:33:19.792592] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.847 [2024-10-07 11:33:19.792614] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.847 [2024-10-07 11:33:19.803092] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.847 [2024-10-07 11:33:19.803282] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.847 [2024-10-07 11:33:19.803316] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.847 [2024-10-07 11:33:19.803365] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.847 [2024-10-07 11:33:19.803986] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.847 [2024-10-07 11:33:19.804112] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.847 [2024-10-07 11:33:19.804136] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.847 [2024-10-07 11:33:19.804151] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.847 [2024-10-07 11:33:19.804190] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.847 [2024-10-07 11:33:19.813561] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.847 [2024-10-07 11:33:19.813805] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.847 [2024-10-07 11:33:19.813838] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.847 [2024-10-07 11:33:19.813855] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.847 [2024-10-07 11:33:19.813956] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.847 [2024-10-07 11:33:19.814073] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.847 [2024-10-07 11:33:19.814092] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.847 [2024-10-07 11:33:19.814107] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.847 [2024-10-07 11:33:19.814410] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.847 [2024-10-07 11:33:19.823677] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.847 [2024-10-07 11:33:19.823843] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.847 [2024-10-07 11:33:19.823874] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.847 [2024-10-07 11:33:19.823891] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.847 [2024-10-07 11:33:19.823915] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.847 [2024-10-07 11:33:19.823937] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.847 [2024-10-07 11:33:19.823960] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.847 [2024-10-07 11:33:19.823975] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.847 [2024-10-07 11:33:19.823998] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.847 [2024-10-07 11:33:19.834116] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.847 [2024-10-07 11:33:19.834265] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.847 [2024-10-07 11:33:19.834297] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.847 [2024-10-07 11:33:19.834315] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.847 [2024-10-07 11:33:19.834348] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.847 [2024-10-07 11:33:19.834371] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.847 [2024-10-07 11:33:19.834409] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.847 [2024-10-07 11:33:19.834439] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.847 [2024-10-07 11:33:19.834490] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.847 [2024-10-07 11:33:19.844844] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.847 [2024-10-07 11:33:19.845007] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.848 [2024-10-07 11:33:19.845039] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.848 [2024-10-07 11:33:19.845055] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.848 [2024-10-07 11:33:19.845080] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.848 [2024-10-07 11:33:19.845103] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.848 [2024-10-07 11:33:19.845116] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.848 [2024-10-07 11:33:19.845146] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.848 [2024-10-07 11:33:19.845758] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.848 [2024-10-07 11:33:19.856479] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.848 [2024-10-07 11:33:19.856856] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.848 [2024-10-07 11:33:19.856900] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.848 [2024-10-07 11:33:19.856920] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.848 [2024-10-07 11:33:19.857062] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.848 [2024-10-07 11:33:19.858898] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.848 [2024-10-07 11:33:19.858936] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.848 [2024-10-07 11:33:19.858954] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.848 [2024-10-07 11:33:19.859640] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.848 [2024-10-07 11:33:19.866576] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.848 [2024-10-07 11:33:19.866729] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.848 [2024-10-07 11:33:19.866761] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.848 [2024-10-07 11:33:19.866779] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.848 [2024-10-07 11:33:19.869213] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.848 [2024-10-07 11:33:19.871430] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.848 [2024-10-07 11:33:19.871471] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.848 [2024-10-07 11:33:19.871492] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.848 [2024-10-07 11:33:19.873371] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.848 [2024-10-07 11:33:19.876681] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.848 [2024-10-07 11:33:19.876953] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.848 [2024-10-07 11:33:19.876996] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.848 [2024-10-07 11:33:19.877015] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.848 [2024-10-07 11:33:19.877071] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.848 [2024-10-07 11:33:19.877098] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.848 [2024-10-07 11:33:19.877114] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.848 [2024-10-07 11:33:19.877127] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.848 [2024-10-07 11:33:19.877149] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.848 [2024-10-07 11:33:19.887477] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.848 [2024-10-07 11:33:19.887639] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.848 [2024-10-07 11:33:19.887701] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.848 [2024-10-07 11:33:19.887718] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.848 [2024-10-07 11:33:19.888236] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.848 [2024-10-07 11:33:19.888346] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.848 [2024-10-07 11:33:19.888374] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.848 [2024-10-07 11:33:19.888390] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.848 [2024-10-07 11:33:19.888413] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.848 8783.00 IOPS, 34.31 MiB/s [2024-10-07T11:33:33.371Z] [2024-10-07 11:33:19.899274] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.848 [2024-10-07 11:33:19.899503] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.848 [2024-10-07 11:33:19.899569] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.848 [2024-10-07 11:33:19.899590] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.848 [2024-10-07 11:33:19.899751] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.848 [2024-10-07 11:33:19.900455] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.848 [2024-10-07 11:33:19.900488] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.848 [2024-10-07 11:33:19.900522] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.848 [2024-10-07 11:33:19.903467] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.848 [2024-10-07 11:33:19.912936] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.848 [2024-10-07 11:33:19.913112] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.848 [2024-10-07 11:33:19.913160] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.848 [2024-10-07 11:33:19.913200] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.848 [2024-10-07 11:33:19.913227] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.848 [2024-10-07 11:33:19.913249] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.848 [2024-10-07 11:33:19.913262] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.848 [2024-10-07 11:33:19.913276] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.848 [2024-10-07 11:33:19.913300] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.848 [2024-10-07 11:33:19.924302] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.848 [2024-10-07 11:33:19.924541] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.848 [2024-10-07 11:33:19.924575] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.848 [2024-10-07 11:33:19.924593] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.848 [2024-10-07 11:33:19.925175] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.848 [2024-10-07 11:33:19.926683] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.848 [2024-10-07 11:33:19.926726] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.848 [2024-10-07 11:33:19.926746] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.848 [2024-10-07 11:33:19.927167] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.848 [2024-10-07 11:33:19.934408] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.848 [2024-10-07 11:33:19.934566] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.848 [2024-10-07 11:33:19.934597] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.848 [2024-10-07 11:33:19.934613] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.848 [2024-10-07 11:33:19.934637] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.848 [2024-10-07 11:33:19.934660] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.848 [2024-10-07 11:33:19.934689] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.848 [2024-10-07 11:33:19.934703] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.848 [2024-10-07 11:33:19.934726] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.848 [2024-10-07 11:33:19.945253] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.848 [2024-10-07 11:33:19.945409] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.848 [2024-10-07 11:33:19.945442] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.848 [2024-10-07 11:33:19.945459] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.849 [2024-10-07 11:33:19.945482] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.849 [2024-10-07 11:33:19.945505] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.849 [2024-10-07 11:33:19.945542] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.849 [2024-10-07 11:33:19.945558] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.849 [2024-10-07 11:33:19.945580] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.849 [2024-10-07 11:33:19.955400] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.849 [2024-10-07 11:33:19.955568] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.849 [2024-10-07 11:33:19.955600] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.849 [2024-10-07 11:33:19.955616] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.849 [2024-10-07 11:33:19.955640] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.849 [2024-10-07 11:33:19.955678] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.849 [2024-10-07 11:33:19.955707] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.849 [2024-10-07 11:33:19.955724] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.849 [2024-10-07 11:33:19.957984] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.849 [2024-10-07 11:33:19.965485] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.849 [2024-10-07 11:33:19.965627] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.849 [2024-10-07 11:33:19.965658] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.849 [2024-10-07 11:33:19.965690] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.849 [2024-10-07 11:33:19.965716] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.849 [2024-10-07 11:33:19.965738] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.849 [2024-10-07 11:33:19.965752] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.849 [2024-10-07 11:33:19.965766] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.849 [2024-10-07 11:33:19.965789] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.849 [2024-10-07 11:33:19.975597] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.849 [2024-10-07 11:33:19.975873] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.849 [2024-10-07 11:33:19.975927] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.849 [2024-10-07 11:33:19.975962] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.849 [2024-10-07 11:33:19.976003] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.849 [2024-10-07 11:33:19.976031] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.849 [2024-10-07 11:33:19.976050] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.849 [2024-10-07 11:33:19.976076] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.849 [2024-10-07 11:33:19.976118] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.849 [2024-10-07 11:33:19.986161] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.849 [2024-10-07 11:33:19.986474] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.849 [2024-10-07 11:33:19.986522] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.849 [2024-10-07 11:33:19.986552] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.849 [2024-10-07 11:33:19.986591] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.849 [2024-10-07 11:33:19.986627] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.849 [2024-10-07 11:33:19.986653] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.849 [2024-10-07 11:33:19.986677] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.849 [2024-10-07 11:33:19.986737] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.849 [2024-10-07 11:33:19.996761] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.849 [2024-10-07 11:33:19.997106] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.849 [2024-10-07 11:33:19.997157] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.849 [2024-10-07 11:33:19.997191] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.849 [2024-10-07 11:33:19.997360] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.849 [2024-10-07 11:33:19.997501] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.849 [2024-10-07 11:33:19.997536] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.849 [2024-10-07 11:33:19.997560] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.849 [2024-10-07 11:33:19.997596] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.849 [2024-10-07 11:33:20.007443] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.849 [2024-10-07 11:33:20.008476] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.849 [2024-10-07 11:33:20.008575] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.849 [2024-10-07 11:33:20.008612] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.849 [2024-10-07 11:33:20.009517] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.849 [2024-10-07 11:33:20.009819] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.849 [2024-10-07 11:33:20.009875] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.849 [2024-10-07 11:33:20.009910] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.849 [2024-10-07 11:33:20.012216] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.849 [2024-10-07 11:33:20.019567] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.849 [2024-10-07 11:33:20.020686] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.849 [2024-10-07 11:33:20.020763] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.849 [2024-10-07 11:33:20.020786] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.849 [2024-10-07 11:33:20.022818] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.849 [2024-10-07 11:33:20.023586] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.849 [2024-10-07 11:33:20.023625] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.849 [2024-10-07 11:33:20.023662] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.849 [2024-10-07 11:33:20.023920] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.849 [2024-10-07 11:33:20.029671] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.849 [2024-10-07 11:33:20.029845] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.849 [2024-10-07 11:33:20.029878] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.849 [2024-10-07 11:33:20.029894] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.849 [2024-10-07 11:33:20.029917] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.849 [2024-10-07 11:33:20.029938] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.849 [2024-10-07 11:33:20.029952] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.849 [2024-10-07 11:33:20.029964] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.849 [2024-10-07 11:33:20.029986] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.849 [2024-10-07 11:33:20.040474] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.849 [2024-10-07 11:33:20.040611] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.849 [2024-10-07 11:33:20.040643] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.849 [2024-10-07 11:33:20.040661] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.849 [2024-10-07 11:33:20.040705] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.849 [2024-10-07 11:33:20.040728] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.849 [2024-10-07 11:33:20.040742] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.849 [2024-10-07 11:33:20.040756] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.849 [2024-10-07 11:33:20.040779] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.849 [2024-10-07 11:33:20.053740] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.849 [2024-10-07 11:33:20.053956] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.849 [2024-10-07 11:33:20.053992] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.849 [2024-10-07 11:33:20.054010] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.849 [2024-10-07 11:33:20.056481] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.849 [2024-10-07 11:33:20.056766] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.849 [2024-10-07 11:33:20.056807] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.849 [2024-10-07 11:33:20.056873] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.849 [2024-10-07 11:33:20.057151] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.849 [2024-10-07 11:33:20.064478] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.849 [2024-10-07 11:33:20.064611] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.850 [2024-10-07 11:33:20.064644] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.850 [2024-10-07 11:33:20.064660] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.850 [2024-10-07 11:33:20.064703] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.850 [2024-10-07 11:33:20.064725] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.850 [2024-10-07 11:33:20.064739] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.850 [2024-10-07 11:33:20.064752] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.850 [2024-10-07 11:33:20.064775] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.850 [2024-10-07 11:33:20.080117] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.850 [2024-10-07 11:33:20.080495] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.850 [2024-10-07 11:33:20.080539] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.850 [2024-10-07 11:33:20.080559] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.850 [2024-10-07 11:33:20.080773] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.850 [2024-10-07 11:33:20.080871] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.850 [2024-10-07 11:33:20.080894] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.850 [2024-10-07 11:33:20.080908] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.850 [2024-10-07 11:33:20.080932] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.850 [2024-10-07 11:33:20.095021] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.850 [2024-10-07 11:33:20.095177] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.850 [2024-10-07 11:33:20.095250] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.850 [2024-10-07 11:33:20.095268] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.850 [2024-10-07 11:33:20.095293] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.850 [2024-10-07 11:33:20.095330] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.850 [2024-10-07 11:33:20.095347] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.850 [2024-10-07 11:33:20.095361] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.850 [2024-10-07 11:33:20.095385] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.850 [2024-10-07 11:33:20.107439] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.850 [2024-10-07 11:33:20.107687] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.850 [2024-10-07 11:33:20.107770] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.850 [2024-10-07 11:33:20.107790] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.850 [2024-10-07 11:33:20.107931] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.850 [2024-10-07 11:33:20.108057] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.850 [2024-10-07 11:33:20.108090] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.850 [2024-10-07 11:33:20.108106] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.850 [2024-10-07 11:33:20.108228] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.850 [2024-10-07 11:33:20.117519] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.850 [2024-10-07 11:33:20.117775] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.850 [2024-10-07 11:33:20.117824] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.850 [2024-10-07 11:33:20.117842] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.850 [2024-10-07 11:33:20.117960] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.850 [2024-10-07 11:33:20.118059] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.850 [2024-10-07 11:33:20.118078] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.850 [2024-10-07 11:33:20.118090] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.850 [2024-10-07 11:33:20.118239] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.850 [2024-10-07 11:33:20.129726] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.850 [2024-10-07 11:33:20.130015] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.850 [2024-10-07 11:33:20.130068] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.850 [2024-10-07 11:33:20.130091] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.850 [2024-10-07 11:33:20.130118] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.850 [2024-10-07 11:33:20.130141] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.850 [2024-10-07 11:33:20.130156] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.850 [2024-10-07 11:33:20.130170] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.850 [2024-10-07 11:33:20.130195] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.850 [2024-10-07 11:33:20.142876] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.850 [2024-10-07 11:33:20.143048] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.850 [2024-10-07 11:33:20.143081] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.850 [2024-10-07 11:33:20.143100] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.850 [2024-10-07 11:33:20.143124] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.850 [2024-10-07 11:33:20.143164] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.850 [2024-10-07 11:33:20.143180] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.850 [2024-10-07 11:33:20.143207] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.850 [2024-10-07 11:33:20.143374] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.850 [2024-10-07 11:33:20.154226] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.850 [2024-10-07 11:33:20.154450] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.850 [2024-10-07 11:33:20.154488] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.850 [2024-10-07 11:33:20.154506] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.850 [2024-10-07 11:33:20.154640] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.850 [2024-10-07 11:33:20.154845] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.850 [2024-10-07 11:33:20.154880] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.850 [2024-10-07 11:33:20.154897] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.850 [2024-10-07 11:33:20.155027] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.850 [2024-10-07 11:33:20.164318] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.850 [2024-10-07 11:33:20.164454] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.850 [2024-10-07 11:33:20.164484] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.850 [2024-10-07 11:33:20.164500] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.850 [2024-10-07 11:33:20.164523] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.850 [2024-10-07 11:33:20.164544] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.850 [2024-10-07 11:33:20.164558] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.850 [2024-10-07 11:33:20.164571] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.850 [2024-10-07 11:33:20.164594] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.850 [2024-10-07 11:33:20.177388] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.850 [2024-10-07 11:33:20.177742] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.850 [2024-10-07 11:33:20.177786] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.850 [2024-10-07 11:33:20.177807] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.850 [2024-10-07 11:33:20.177862] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.850 [2024-10-07 11:33:20.177890] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.850 [2024-10-07 11:33:20.177905] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.850 [2024-10-07 11:33:20.177918] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.850 [2024-10-07 11:33:20.177961] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.850 [2024-10-07 11:33:20.189131] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.850 [2024-10-07 11:33:20.189425] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.850 [2024-10-07 11:33:20.189470] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.850 [2024-10-07 11:33:20.189491] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.850 [2024-10-07 11:33:20.189636] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.850 [2024-10-07 11:33:20.189788] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.850 [2024-10-07 11:33:20.189819] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.850 [2024-10-07 11:33:20.189836] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.850 [2024-10-07 11:33:20.189953] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.851 [2024-10-07 11:33:20.199257] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.851 [2024-10-07 11:33:20.199365] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.851 [2024-10-07 11:33:20.199395] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.851 [2024-10-07 11:33:20.199412] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.851 [2024-10-07 11:33:20.199435] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.851 [2024-10-07 11:33:20.199470] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.851 [2024-10-07 11:33:20.199488] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.851 [2024-10-07 11:33:20.199501] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.851 [2024-10-07 11:33:20.199524] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.851 [2024-10-07 11:33:20.209664] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.851 [2024-10-07 11:33:20.209789] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.851 [2024-10-07 11:33:20.209819] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.851 [2024-10-07 11:33:20.209836] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.851 [2024-10-07 11:33:20.209859] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.851 [2024-10-07 11:33:20.209881] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.851 [2024-10-07 11:33:20.209895] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.851 [2024-10-07 11:33:20.209909] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.851 [2024-10-07 11:33:20.209931] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.851 [2024-10-07 11:33:20.222318] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.851 [2024-10-07 11:33:20.222444] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.851 [2024-10-07 11:33:20.222476] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.851 [2024-10-07 11:33:20.222516] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.851 [2024-10-07 11:33:20.222542] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.851 [2024-10-07 11:33:20.222564] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.851 [2024-10-07 11:33:20.222579] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.851 [2024-10-07 11:33:20.222592] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.851 [2024-10-07 11:33:20.222616] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.851 [2024-10-07 11:33:20.232969] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.851 [2024-10-07 11:33:20.233205] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.851 [2024-10-07 11:33:20.233240] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.851 [2024-10-07 11:33:20.233257] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.851 [2024-10-07 11:33:20.233359] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.851 [2024-10-07 11:33:20.233455] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.851 [2024-10-07 11:33:20.233474] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.851 [2024-10-07 11:33:20.233487] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.851 [2024-10-07 11:33:20.233512] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.851 [2024-10-07 11:33:20.243065] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.851 [2024-10-07 11:33:20.243175] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.851 [2024-10-07 11:33:20.243225] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.851 [2024-10-07 11:33:20.243243] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.851 [2024-10-07 11:33:20.243268] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.851 [2024-10-07 11:33:20.243291] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.851 [2024-10-07 11:33:20.243305] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.851 [2024-10-07 11:33:20.243319] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.851 [2024-10-07 11:33:20.243342] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.851 [2024-10-07 11:33:20.256364] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.851 [2024-10-07 11:33:20.256471] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.851 [2024-10-07 11:33:20.256502] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.851 [2024-10-07 11:33:20.256519] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.851 [2024-10-07 11:33:20.256542] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.851 [2024-10-07 11:33:20.256564] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.851 [2024-10-07 11:33:20.256596] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.851 [2024-10-07 11:33:20.256611] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.851 [2024-10-07 11:33:20.256635] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.851 [2024-10-07 11:33:20.270677] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.851 [2024-10-07 11:33:20.270796] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.851 [2024-10-07 11:33:20.270828] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.851 [2024-10-07 11:33:20.270845] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.851 [2024-10-07 11:33:20.270881] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.851 [2024-10-07 11:33:20.270909] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.851 [2024-10-07 11:33:20.270924] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.851 [2024-10-07 11:33:20.270938] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.851 [2024-10-07 11:33:20.270962] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.851 [2024-10-07 11:33:20.282993] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.851 [2024-10-07 11:33:20.283247] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.851 [2024-10-07 11:33:20.283280] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.851 [2024-10-07 11:33:20.283298] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.851 [2024-10-07 11:33:20.283419] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.851 [2024-10-07 11:33:20.283525] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.851 [2024-10-07 11:33:20.283555] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.851 [2024-10-07 11:33:20.283572] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.851 [2024-10-07 11:33:20.283693] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.851 [2024-10-07 11:33:20.293072] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.851 [2024-10-07 11:33:20.293181] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.851 [2024-10-07 11:33:20.293214] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.851 [2024-10-07 11:33:20.293231] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.851 [2024-10-07 11:33:20.293255] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.851 [2024-10-07 11:33:20.293279] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.851 [2024-10-07 11:33:20.293294] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.851 [2024-10-07 11:33:20.293308] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.851 [2024-10-07 11:33:20.293332] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.851 [2024-10-07 11:33:20.303965] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.851 [2024-10-07 11:33:20.304072] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.851 [2024-10-07 11:33:20.304103] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.851 [2024-10-07 11:33:20.304120] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.851 [2024-10-07 11:33:20.304396] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.851 [2024-10-07 11:33:20.304568] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.851 [2024-10-07 11:33:20.304602] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.851 [2024-10-07 11:33:20.304620] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.851 [2024-10-07 11:33:20.304767] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.851 [2024-10-07 11:33:20.314077] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.851 [2024-10-07 11:33:20.314193] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.851 [2024-10-07 11:33:20.314222] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.851 [2024-10-07 11:33:20.314238] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.851 [2024-10-07 11:33:20.314260] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.851 [2024-10-07 11:33:20.314281] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.851 [2024-10-07 11:33:20.314295] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.851 [2024-10-07 11:33:20.314307] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.852 [2024-10-07 11:33:20.314329] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.852 [2024-10-07 11:33:20.324165] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.852 [2024-10-07 11:33:20.324284] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.852 [2024-10-07 11:33:20.324321] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.852 [2024-10-07 11:33:20.324337] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.852 [2024-10-07 11:33:20.324359] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.852 [2024-10-07 11:33:20.324380] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.852 [2024-10-07 11:33:20.324394] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.852 [2024-10-07 11:33:20.324407] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.852 [2024-10-07 11:33:20.324430] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.852 [2024-10-07 11:33:20.334523] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.852 [2024-10-07 11:33:20.334760] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.852 [2024-10-07 11:33:20.334809] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.852 [2024-10-07 11:33:20.334827] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.852 [2024-10-07 11:33:20.336387] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.852 [2024-10-07 11:33:20.339313] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.852 [2024-10-07 11:33:20.339355] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.852 [2024-10-07 11:33:20.339373] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.852 [2024-10-07 11:33:20.339762] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.852 [2024-10-07 11:33:20.344981] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.852 [2024-10-07 11:33:20.345120] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.852 [2024-10-07 11:33:20.345153] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.852 [2024-10-07 11:33:20.345184] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.852 [2024-10-07 11:33:20.345208] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.852 [2024-10-07 11:33:20.345230] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.852 [2024-10-07 11:33:20.345244] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.852 [2024-10-07 11:33:20.345257] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.852 [2024-10-07 11:33:20.345286] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.852 [2024-10-07 11:33:20.355086] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.852 [2024-10-07 11:33:20.355252] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.852 [2024-10-07 11:33:20.355284] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.852 [2024-10-07 11:33:20.355301] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.852 [2024-10-07 11:33:20.355325] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.852 [2024-10-07 11:33:20.355348] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.852 [2024-10-07 11:33:20.355363] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.852 [2024-10-07 11:33:20.355377] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.852 [2024-10-07 11:33:20.355401] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.852 [2024-10-07 11:33:20.368194] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.852 [2024-10-07 11:33:20.368317] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.852 [2024-10-07 11:33:20.368355] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.852 [2024-10-07 11:33:20.368372] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.852 [2024-10-07 11:33:20.368869] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.852 [2024-10-07 11:33:20.369425] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.852 [2024-10-07 11:33:20.369460] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.852 [2024-10-07 11:33:20.369509] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.852 [2024-10-07 11:33:20.369742] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.852 [2024-10-07 11:33:20.380491] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.852 [2024-10-07 11:33:20.380611] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.852 [2024-10-07 11:33:20.380642] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.852 [2024-10-07 11:33:20.380658] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.852 [2024-10-07 11:33:20.381229] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.852 [2024-10-07 11:33:20.381372] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.852 [2024-10-07 11:33:20.381396] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.852 [2024-10-07 11:33:20.381424] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.852 [2024-10-07 11:33:20.381447] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.852 [2024-10-07 11:33:20.392391] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.852 [2024-10-07 11:33:20.392570] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.852 [2024-10-07 11:33:20.392602] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.852 [2024-10-07 11:33:20.392619] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.852 [2024-10-07 11:33:20.392643] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.852 [2024-10-07 11:33:20.392665] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.852 [2024-10-07 11:33:20.392695] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.852 [2024-10-07 11:33:20.392711] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.852 [2024-10-07 11:33:20.392735] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.852 [2024-10-07 11:33:20.404596] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.852 [2024-10-07 11:33:20.406588] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.852 [2024-10-07 11:33:20.406672] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.852 [2024-10-07 11:33:20.406693] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.852 [2024-10-07 11:33:20.407355] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.852 [2024-10-07 11:33:20.407638] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.852 [2024-10-07 11:33:20.407690] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.852 [2024-10-07 11:33:20.407727] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.852 [2024-10-07 11:33:20.407798] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.852 [2024-10-07 11:33:20.415514] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.852 [2024-10-07 11:33:20.415931] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.852 [2024-10-07 11:33:20.415986] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.852 [2024-10-07 11:33:20.416057] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.852 [2024-10-07 11:33:20.416240] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.852 [2024-10-07 11:33:20.416466] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.852 [2024-10-07 11:33:20.416510] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.852 [2024-10-07 11:33:20.416534] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.852 [2024-10-07 11:33:20.416694] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.852 [2024-10-07 11:33:20.425704] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.852 [2024-10-07 11:33:20.425827] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.852 [2024-10-07 11:33:20.425858] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.852 [2024-10-07 11:33:20.425875] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.852 [2024-10-07 11:33:20.426045] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.852 [2024-10-07 11:33:20.426296] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.852 [2024-10-07 11:33:20.426334] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.853 [2024-10-07 11:33:20.426368] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.853 [2024-10-07 11:33:20.426421] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.853 [2024-10-07 11:33:20.435981] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.853 [2024-10-07 11:33:20.436263] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.853 [2024-10-07 11:33:20.436298] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.853 [2024-10-07 11:33:20.436315] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.853 [2024-10-07 11:33:20.436847] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.853 [2024-10-07 11:33:20.439226] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.853 [2024-10-07 11:33:20.439283] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.853 [2024-10-07 11:33:20.439320] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.853 [2024-10-07 11:33:20.440273] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.853 [2024-10-07 11:33:20.446381] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.853 [2024-10-07 11:33:20.446594] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.853 [2024-10-07 11:33:20.446629] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.853 [2024-10-07 11:33:20.446660] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.853 [2024-10-07 11:33:20.448917] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.853 [2024-10-07 11:33:20.450868] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.853 [2024-10-07 11:33:20.450911] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.853 [2024-10-07 11:33:20.450930] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.853 [2024-10-07 11:33:20.451091] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.853 [2024-10-07 11:33:20.456543] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.853 [2024-10-07 11:33:20.456718] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.853 [2024-10-07 11:33:20.456767] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.853 [2024-10-07 11:33:20.456797] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.853 [2024-10-07 11:33:20.458676] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.853 [2024-10-07 11:33:20.460390] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.853 [2024-10-07 11:33:20.460437] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.853 [2024-10-07 11:33:20.460456] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.853 [2024-10-07 11:33:20.460525] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.853 [2024-10-07 11:33:20.467284] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.853 [2024-10-07 11:33:20.467495] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.853 [2024-10-07 11:33:20.467529] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.853 [2024-10-07 11:33:20.467547] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.853 [2024-10-07 11:33:20.467621] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.853 [2024-10-07 11:33:20.467664] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.853 [2024-10-07 11:33:20.467684] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.853 [2024-10-07 11:33:20.467698] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.853 [2024-10-07 11:33:20.468862] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.853 [2024-10-07 11:33:20.477761] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.853 [2024-10-07 11:33:20.478119] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.853 [2024-10-07 11:33:20.478164] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.853 [2024-10-07 11:33:20.478185] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.853 [2024-10-07 11:33:20.478232] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.853 [2024-10-07 11:33:20.478261] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.853 [2024-10-07 11:33:20.478277] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.853 [2024-10-07 11:33:20.478309] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.853 [2024-10-07 11:33:20.478337] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.853 [2024-10-07 11:33:20.491169] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.853 [2024-10-07 11:33:20.491366] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.853 [2024-10-07 11:33:20.491399] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.853 [2024-10-07 11:33:20.491416] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.853 [2024-10-07 11:33:20.491441] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.853 [2024-10-07 11:33:20.491464] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.853 [2024-10-07 11:33:20.491479] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.853 [2024-10-07 11:33:20.491493] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.853 [2024-10-07 11:33:20.491517] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.853 [2024-10-07 11:33:20.501342] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.853 [2024-10-07 11:33:20.501471] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.853 [2024-10-07 11:33:20.501502] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.853 [2024-10-07 11:33:20.501519] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.853 [2024-10-07 11:33:20.501706] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.853 [2024-10-07 11:33:20.501870] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.853 [2024-10-07 11:33:20.501906] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.853 [2024-10-07 11:33:20.501924] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.853 [2024-10-07 11:33:20.502053] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.853 [2024-10-07 11:33:20.515292] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.853 [2024-10-07 11:33:20.515491] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.853 [2024-10-07 11:33:20.515543] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.853 [2024-10-07 11:33:20.515560] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.853 [2024-10-07 11:33:20.516204] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.853 [2024-10-07 11:33:20.516884] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.853 [2024-10-07 11:33:20.516921] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.853 [2024-10-07 11:33:20.516938] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.853 [2024-10-07 11:33:20.517063] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.853 [2024-10-07 11:33:20.529260] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.853 [2024-10-07 11:33:20.529607] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.853 [2024-10-07 11:33:20.529696] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.853 [2024-10-07 11:33:20.529728] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.853 [2024-10-07 11:33:20.529986] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.853 [2024-10-07 11:33:20.530129] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.853 [2024-10-07 11:33:20.530162] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.853 [2024-10-07 11:33:20.530187] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.853 [2024-10-07 11:33:20.530224] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.853 [2024-10-07 11:33:20.544492] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.853 [2024-10-07 11:33:20.545867] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.853 [2024-10-07 11:33:20.545924] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.853 [2024-10-07 11:33:20.545954] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.853 [2024-10-07 11:33:20.547742] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.853 [2024-10-07 11:33:20.548167] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.853 [2024-10-07 11:33:20.548218] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.853 [2024-10-07 11:33:20.548245] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.853 [2024-10-07 11:33:20.548405] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.854 [2024-10-07 11:33:20.558684] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.854 [2024-10-07 11:33:20.558916] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.854 [2024-10-07 11:33:20.558959] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.854 [2024-10-07 11:33:20.558986] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.854 [2024-10-07 11:33:20.559023] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.854 [2024-10-07 11:33:20.559058] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.854 [2024-10-07 11:33:20.559083] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.854 [2024-10-07 11:33:20.559106] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.854 [2024-10-07 11:33:20.559143] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.854 [2024-10-07 11:33:20.568819] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.854 [2024-10-07 11:33:20.568971] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.854 [2024-10-07 11:33:20.569011] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.854 [2024-10-07 11:33:20.569039] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.854 [2024-10-07 11:33:20.569360] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.854 [2024-10-07 11:33:20.569631] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.854 [2024-10-07 11:33:20.569690] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.854 [2024-10-07 11:33:20.569717] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.854 [2024-10-07 11:33:20.569890] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.854 [2024-10-07 11:33:20.579701] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.854 [2024-10-07 11:33:20.579924] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.854 [2024-10-07 11:33:20.579956] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.854 [2024-10-07 11:33:20.579972] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.854 [2024-10-07 11:33:20.580120] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.854 [2024-10-07 11:33:20.580340] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.854 [2024-10-07 11:33:20.580391] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.854 [2024-10-07 11:33:20.580408] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.854 [2024-10-07 11:33:20.580465] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.854 [2024-10-07 11:33:20.593449] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.854 [2024-10-07 11:33:20.594599] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.854 [2024-10-07 11:33:20.594660] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.854 [2024-10-07 11:33:20.594694] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.854 [2024-10-07 11:33:20.594820] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.854 [2024-10-07 11:33:20.594850] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.854 [2024-10-07 11:33:20.594865] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.854 [2024-10-07 11:33:20.594879] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.854 [2024-10-07 11:33:20.594904] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.854 [2024-10-07 11:33:20.603556] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.854 [2024-10-07 11:33:20.603709] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.854 [2024-10-07 11:33:20.603749] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.854 [2024-10-07 11:33:20.603766] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.854 [2024-10-07 11:33:20.603788] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.854 [2024-10-07 11:33:20.603810] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.854 [2024-10-07 11:33:20.603823] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.854 [2024-10-07 11:33:20.603836] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.854 [2024-10-07 11:33:20.603875] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.854 [2024-10-07 11:33:20.617008] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.854 [2024-10-07 11:33:20.617351] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.854 [2024-10-07 11:33:20.617413] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.854 [2024-10-07 11:33:20.617433] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.854 [2024-10-07 11:33:20.617635] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.854 [2024-10-07 11:33:20.617734] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.854 [2024-10-07 11:33:20.617759] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.854 [2024-10-07 11:33:20.617774] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.854 [2024-10-07 11:33:20.617799] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.854 [2024-10-07 11:33:20.632051] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.854 [2024-10-07 11:33:20.632175] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.854 [2024-10-07 11:33:20.632215] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.854 [2024-10-07 11:33:20.632233] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.854 [2024-10-07 11:33:20.632258] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.854 [2024-10-07 11:33:20.632296] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.854 [2024-10-07 11:33:20.632314] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.854 [2024-10-07 11:33:20.632328] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.854 [2024-10-07 11:33:20.632353] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.854 [2024-10-07 11:33:20.647601] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.854 [2024-10-07 11:33:20.647736] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.854 [2024-10-07 11:33:20.647770] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.854 [2024-10-07 11:33:20.647788] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.854 [2024-10-07 11:33:20.647813] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.854 [2024-10-07 11:33:20.647836] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.854 [2024-10-07 11:33:20.647851] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.854 [2024-10-07 11:33:20.647865] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.854 [2024-10-07 11:33:20.647890] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.854 [2024-10-07 11:33:20.663324] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.854 [2024-10-07 11:33:20.663562] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.854 [2024-10-07 11:33:20.663607] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.854 [2024-10-07 11:33:20.663669] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.854 [2024-10-07 11:33:20.663700] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.854 [2024-10-07 11:33:20.663724] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.854 [2024-10-07 11:33:20.663739] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.854 [2024-10-07 11:33:20.663753] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.854 [2024-10-07 11:33:20.663778] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.854 [2024-10-07 11:33:20.673694] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.854 [2024-10-07 11:33:20.673937] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.854 [2024-10-07 11:33:20.673982] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.854 [2024-10-07 11:33:20.674003] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.854 [2024-10-07 11:33:20.674137] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.854 [2024-10-07 11:33:20.674274] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.854 [2024-10-07 11:33:20.674307] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.854 [2024-10-07 11:33:20.674324] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.854 [2024-10-07 11:33:20.674460] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.854 [2024-10-07 11:33:20.683787] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.854 [2024-10-07 11:33:20.683908] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.855 [2024-10-07 11:33:20.683942] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.855 [2024-10-07 11:33:20.683966] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.855 [2024-10-07 11:33:20.684003] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.855 [2024-10-07 11:33:20.684030] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.855 [2024-10-07 11:33:20.684045] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.855 [2024-10-07 11:33:20.684058] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.855 [2024-10-07 11:33:20.684083] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.855 [2024-10-07 11:33:20.694772] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.855 [2024-10-07 11:33:20.694890] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.855 [2024-10-07 11:33:20.694923] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.855 [2024-10-07 11:33:20.694951] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.855 [2024-10-07 11:33:20.694976] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.855 [2024-10-07 11:33:20.694999] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.855 [2024-10-07 11:33:20.695040] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.855 [2024-10-07 11:33:20.695055] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.855 [2024-10-07 11:33:20.695079] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.855 [2024-10-07 11:33:20.707091] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.855 [2024-10-07 11:33:20.707380] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.855 [2024-10-07 11:33:20.707430] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.855 [2024-10-07 11:33:20.707452] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.855 [2024-10-07 11:33:20.707633] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.855 [2024-10-07 11:33:20.707719] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.855 [2024-10-07 11:33:20.707742] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.855 [2024-10-07 11:33:20.707757] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.855 [2024-10-07 11:33:20.707783] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.855 [2024-10-07 11:33:20.718136] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.855 [2024-10-07 11:33:20.718349] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.855 [2024-10-07 11:33:20.718392] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.855 [2024-10-07 11:33:20.718413] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.855 [2024-10-07 11:33:20.719061] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.855 [2024-10-07 11:33:20.719324] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.855 [2024-10-07 11:33:20.719360] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.855 [2024-10-07 11:33:20.719378] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.855 [2024-10-07 11:33:20.719405] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.855 [2024-10-07 11:33:20.728338] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.855 [2024-10-07 11:33:20.728453] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.855 [2024-10-07 11:33:20.728485] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.855 [2024-10-07 11:33:20.728502] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.855 [2024-10-07 11:33:20.728526] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.855 [2024-10-07 11:33:20.728549] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.855 [2024-10-07 11:33:20.728564] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.855 [2024-10-07 11:33:20.728577] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.855 [2024-10-07 11:33:20.728602] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.855 [2024-10-07 11:33:20.738865] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.855 [2024-10-07 11:33:20.738990] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.855 [2024-10-07 11:33:20.739032] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.855 [2024-10-07 11:33:20.739052] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.855 [2024-10-07 11:33:20.739077] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.855 [2024-10-07 11:33:20.739100] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.855 [2024-10-07 11:33:20.739116] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.855 [2024-10-07 11:33:20.739129] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.855 [2024-10-07 11:33:20.739153] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.855 [2024-10-07 11:33:20.748946] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.855 [2024-10-07 11:33:20.749063] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.855 [2024-10-07 11:33:20.749105] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.855 [2024-10-07 11:33:20.749126] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.855 [2024-10-07 11:33:20.749150] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.855 [2024-10-07 11:33:20.749179] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.855 [2024-10-07 11:33:20.749195] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.855 [2024-10-07 11:33:20.749209] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.855 [2024-10-07 11:33:20.749233] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.855 [2024-10-07 11:33:20.759687] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.855 [2024-10-07 11:33:20.759856] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.855 [2024-10-07 11:33:20.759889] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.855 [2024-10-07 11:33:20.759906] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.855 [2024-10-07 11:33:20.760836] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.855 [2024-10-07 11:33:20.760968] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.855 [2024-10-07 11:33:20.760993] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.855 [2024-10-07 11:33:20.761008] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.855 [2024-10-07 11:33:20.761033] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.855 [2024-10-07 11:33:20.769771] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.855 [2024-10-07 11:33:20.770340] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.855 [2024-10-07 11:33:20.770384] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.855 [2024-10-07 11:33:20.770404] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.855 [2024-10-07 11:33:20.770458] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.855 [2024-10-07 11:33:20.770482] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.855 [2024-10-07 11:33:20.770497] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.855 [2024-10-07 11:33:20.770511] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.855 [2024-10-07 11:33:20.770535] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.855 [2024-10-07 11:33:20.779854] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.855 [2024-10-07 11:33:20.779977] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.855 [2024-10-07 11:33:20.780008] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.855 [2024-10-07 11:33:20.780026] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.855 [2024-10-07 11:33:20.780050] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.855 [2024-10-07 11:33:20.780072] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.855 [2024-10-07 11:33:20.780086] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.855 [2024-10-07 11:33:20.780100] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.855 [2024-10-07 11:33:20.780124] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.855 [2024-10-07 11:33:20.790504] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.855 [2024-10-07 11:33:20.790616] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.855 [2024-10-07 11:33:20.790660] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.855 [2024-10-07 11:33:20.790680] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.856 [2024-10-07 11:33:20.790859] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.856 [2024-10-07 11:33:20.790926] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.856 [2024-10-07 11:33:20.790949] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.856 [2024-10-07 11:33:20.790963] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.856 [2024-10-07 11:33:20.790988] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.856 [2024-10-07 11:33:20.800935] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.856 [2024-10-07 11:33:20.801139] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.856 [2024-10-07 11:33:20.801171] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.856 [2024-10-07 11:33:20.801189] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.856 [2024-10-07 11:33:20.801846] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.856 [2024-10-07 11:33:20.804630] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.856 [2024-10-07 11:33:20.804697] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.856 [2024-10-07 11:33:20.804739] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.856 [2024-10-07 11:33:20.805291] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.856 [2024-10-07 11:33:20.811297] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.856 [2024-10-07 11:33:20.811413] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.856 [2024-10-07 11:33:20.811445] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.856 [2024-10-07 11:33:20.811462] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.856 [2024-10-07 11:33:20.811487] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.856 [2024-10-07 11:33:20.811510] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.856 [2024-10-07 11:33:20.811524] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.856 [2024-10-07 11:33:20.811537] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.856 [2024-10-07 11:33:20.811561] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.856 [2024-10-07 11:33:20.822059] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.856 [2024-10-07 11:33:20.822184] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.856 [2024-10-07 11:33:20.822215] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.856 [2024-10-07 11:33:20.822232] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.856 [2024-10-07 11:33:20.822255] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.856 [2024-10-07 11:33:20.822277] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.856 [2024-10-07 11:33:20.822292] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.856 [2024-10-07 11:33:20.822306] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.856 [2024-10-07 11:33:20.822330] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.856 [2024-10-07 11:33:20.832330] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.856 [2024-10-07 11:33:20.832439] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.856 [2024-10-07 11:33:20.832471] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.856 [2024-10-07 11:33:20.832488] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.856 [2024-10-07 11:33:20.832511] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.856 [2024-10-07 11:33:20.832533] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.856 [2024-10-07 11:33:20.832547] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.856 [2024-10-07 11:33:20.832561] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.856 [2024-10-07 11:33:20.832585] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.856 [2024-10-07 11:33:20.844634] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.856 [2024-10-07 11:33:20.844991] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.856 [2024-10-07 11:33:20.845037] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.856 [2024-10-07 11:33:20.845058] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.856 [2024-10-07 11:33:20.845128] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.856 [2024-10-07 11:33:20.845161] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.856 [2024-10-07 11:33:20.845177] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.856 [2024-10-07 11:33:20.845191] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.856 [2024-10-07 11:33:20.845215] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.856 [2024-10-07 11:33:20.859486] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.856 [2024-10-07 11:33:20.859968] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.856 [2024-10-07 11:33:20.860014] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.856 [2024-10-07 11:33:20.860034] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.856 [2024-10-07 11:33:20.860105] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.856 [2024-10-07 11:33:20.860135] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.856 [2024-10-07 11:33:20.860150] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.856 [2024-10-07 11:33:20.860164] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.856 [2024-10-07 11:33:20.860189] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.856 [2024-10-07 11:33:20.870418] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.856 [2024-10-07 11:33:20.870627] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.856 [2024-10-07 11:33:20.870675] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.856 [2024-10-07 11:33:20.870695] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.856 [2024-10-07 11:33:20.872011] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.856 [2024-10-07 11:33:20.873802] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.856 [2024-10-07 11:33:20.873842] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.856 [2024-10-07 11:33:20.873876] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.856 [2024-10-07 11:33:20.874361] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.856 [2024-10-07 11:33:20.880515] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.856 [2024-10-07 11:33:20.880638] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.856 [2024-10-07 11:33:20.880681] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.856 [2024-10-07 11:33:20.880701] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.856 [2024-10-07 11:33:20.880742] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.856 [2024-10-07 11:33:20.880766] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.856 [2024-10-07 11:33:20.880781] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.856 [2024-10-07 11:33:20.880794] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.856 [2024-10-07 11:33:20.880818] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.856 [2024-10-07 11:33:20.893616] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.856 [2024-10-07 11:33:20.893948] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.856 [2024-10-07 11:33:20.894010] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.856 [2024-10-07 11:33:20.894062] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.856 [2024-10-07 11:33:20.894247] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.856 [2024-10-07 11:33:20.894434] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.856 [2024-10-07 11:33:20.894490] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.856 [2024-10-07 11:33:20.894526] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.856 [2024-10-07 11:33:20.896218] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.856 8792.25 IOPS, 34.34 MiB/s [2024-10-07T11:33:33.379Z] [2024-10-07 11:33:20.905859] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.856 [2024-10-07 11:33:20.906088] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.856 [2024-10-07 11:33:20.906130] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.856 [2024-10-07 11:33:20.906150] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.856 [2024-10-07 11:33:20.906286] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.856 [2024-10-07 11:33:20.906459] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.856 [2024-10-07 11:33:20.906496] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.856 [2024-10-07 11:33:20.906515] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.856 [2024-10-07 11:33:20.906710] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.857 [2024-10-07 11:33:20.915944] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.857 [2024-10-07 11:33:20.916072] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.857 [2024-10-07 11:33:20.916104] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.857 [2024-10-07 11:33:20.916121] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.857 [2024-10-07 11:33:20.916145] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.857 [2024-10-07 11:33:20.916168] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.857 [2024-10-07 11:33:20.916191] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.857 [2024-10-07 11:33:20.916222] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.857 [2024-10-07 11:33:20.916247] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.857 [2024-10-07 11:33:20.928882] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.857 [2024-10-07 11:33:20.929052] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.857 [2024-10-07 11:33:20.929102] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.857 [2024-10-07 11:33:20.929136] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.857 [2024-10-07 11:33:20.929181] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.857 [2024-10-07 11:33:20.929224] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.857 [2024-10-07 11:33:20.929252] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.857 [2024-10-07 11:33:20.929288] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.857 [2024-10-07 11:33:20.929330] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.857 [2024-10-07 11:33:20.943963] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.857 [2024-10-07 11:33:20.944121] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.857 [2024-10-07 11:33:20.944156] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.857 [2024-10-07 11:33:20.944174] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.857 [2024-10-07 11:33:20.944209] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.857 [2024-10-07 11:33:20.944233] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.857 [2024-10-07 11:33:20.944248] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.857 [2024-10-07 11:33:20.944261] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.857 [2024-10-07 11:33:20.944285] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.857 [2024-10-07 11:33:20.954331] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.857 [2024-10-07 11:33:20.954568] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.857 [2024-10-07 11:33:20.954602] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.857 [2024-10-07 11:33:20.954620] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.857 [2024-10-07 11:33:20.954739] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.857 [2024-10-07 11:33:20.954849] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.857 [2024-10-07 11:33:20.954868] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.857 [2024-10-07 11:33:20.954883] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.857 [2024-10-07 11:33:20.957424] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.857 [2024-10-07 11:33:20.964441] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.857 [2024-10-07 11:33:20.964563] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.857 [2024-10-07 11:33:20.964613] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.857 [2024-10-07 11:33:20.964632] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.857 [2024-10-07 11:33:20.964656] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.857 [2024-10-07 11:33:20.964694] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.857 [2024-10-07 11:33:20.964710] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.857 [2024-10-07 11:33:20.964723] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.857 [2024-10-07 11:33:20.964746] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.857 [2024-10-07 11:33:20.974534] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.857 [2024-10-07 11:33:20.974674] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.857 [2024-10-07 11:33:20.974706] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.857 [2024-10-07 11:33:20.974724] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.857 [2024-10-07 11:33:20.974747] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.857 [2024-10-07 11:33:20.974770] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.857 [2024-10-07 11:33:20.974784] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.857 [2024-10-07 11:33:20.974798] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.857 [2024-10-07 11:33:20.974836] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.857 [2024-10-07 11:33:20.986947] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.857 [2024-10-07 11:33:20.987964] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.857 [2024-10-07 11:33:20.988038] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.857 [2024-10-07 11:33:20.988067] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.857 [2024-10-07 11:33:20.988178] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.857 [2024-10-07 11:33:20.988210] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.857 [2024-10-07 11:33:20.988226] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.857 [2024-10-07 11:33:20.988240] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.857 [2024-10-07 11:33:20.988265] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.857 [2024-10-07 11:33:20.997671] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.857 [2024-10-07 11:33:20.997968] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.857 [2024-10-07 11:33:20.998013] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.857 [2024-10-07 11:33:20.998034] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.857 [2024-10-07 11:33:20.998095] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.857 [2024-10-07 11:33:20.998294] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.857 [2024-10-07 11:33:20.998318] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.857 [2024-10-07 11:33:20.998333] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.857 [2024-10-07 11:33:20.998409] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.857 [2024-10-07 11:33:21.012283] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.857 [2024-10-07 11:33:21.012774] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.857 [2024-10-07 11:33:21.012820] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.857 [2024-10-07 11:33:21.012841] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.857 [2024-10-07 11:33:21.012913] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.857 [2024-10-07 11:33:21.012942] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.857 [2024-10-07 11:33:21.012958] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.857 [2024-10-07 11:33:21.012971] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.857 [2024-10-07 11:33:21.012996] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.857 [2024-10-07 11:33:21.028042] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.857 [2024-10-07 11:33:21.028217] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.858 [2024-10-07 11:33:21.028262] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.858 [2024-10-07 11:33:21.028282] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.858 [2024-10-07 11:33:21.028310] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.858 [2024-10-07 11:33:21.028350] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.858 [2024-10-07 11:33:21.028380] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.858 [2024-10-07 11:33:21.028405] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.858 [2024-10-07 11:33:21.028446] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.858 [2024-10-07 11:33:21.043736] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.858 [2024-10-07 11:33:21.043893] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.858 [2024-10-07 11:33:21.043941] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.858 [2024-10-07 11:33:21.043987] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.858 [2024-10-07 11:33:21.045105] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.858 [2024-10-07 11:33:21.046026] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.858 [2024-10-07 11:33:21.046088] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.858 [2024-10-07 11:33:21.046124] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.858 [2024-10-07 11:33:21.046498] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.858 [2024-10-07 11:33:21.061002] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.858 [2024-10-07 11:33:21.061322] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.858 [2024-10-07 11:33:21.061369] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.858 [2024-10-07 11:33:21.061399] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.858 [2024-10-07 11:33:21.062140] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.858 [2024-10-07 11:33:21.062596] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.858 [2024-10-07 11:33:21.062639] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.858 [2024-10-07 11:33:21.062689] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.858 [2024-10-07 11:33:21.062787] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.858 [2024-10-07 11:33:21.073970] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.858 [2024-10-07 11:33:21.074249] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.858 [2024-10-07 11:33:21.074363] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.858 [2024-10-07 11:33:21.074478] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.858 [2024-10-07 11:33:21.074576] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.858 [2024-10-07 11:33:21.074687] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.858 [2024-10-07 11:33:21.074781] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.858 [2024-10-07 11:33:21.074870] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.858 [2024-10-07 11:33:21.074960] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.858 [2024-10-07 11:33:21.085461] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.858 [2024-10-07 11:33:21.085791] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.858 [2024-10-07 11:33:21.085934] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.858 [2024-10-07 11:33:21.086025] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.858 [2024-10-07 11:33:21.086251] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.858 [2024-10-07 11:33:21.086497] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.858 [2024-10-07 11:33:21.086594] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.858 [2024-10-07 11:33:21.086701] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.858 [2024-10-07 11:33:21.086937] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.858 [2024-10-07 11:33:21.097394] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.858 [2024-10-07 11:33:21.098156] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.858 [2024-10-07 11:33:21.098279] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.858 [2024-10-07 11:33:21.098394] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.858 [2024-10-07 11:33:21.098651] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.858 [2024-10-07 11:33:21.098943] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.858 [2024-10-07 11:33:21.099043] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.858 [2024-10-07 11:33:21.099143] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.858 [2024-10-07 11:33:21.099315] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.858 [2024-10-07 11:33:21.110587] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.858 [2024-10-07 11:33:21.111633] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.858 [2024-10-07 11:33:21.111782] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.858 [2024-10-07 11:33:21.111872] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.858 [2024-10-07 11:33:21.112079] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.858 [2024-10-07 11:33:21.112198] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.858 [2024-10-07 11:33:21.112280] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.858 [2024-10-07 11:33:21.112348] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.858 [2024-10-07 11:33:21.112436] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.858 [2024-10-07 11:33:21.125494] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.858 [2024-10-07 11:33:21.125813] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.858 [2024-10-07 11:33:21.125930] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.858 [2024-10-07 11:33:21.126030] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.858 [2024-10-07 11:33:21.126646] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.858 [2024-10-07 11:33:21.127018] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.858 [2024-10-07 11:33:21.127115] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.858 [2024-10-07 11:33:21.127233] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.858 [2024-10-07 11:33:21.127833] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.858 [2024-10-07 11:33:21.139248] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.858 [2024-10-07 11:33:21.139445] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.858 [2024-10-07 11:33:21.139543] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.858 [2024-10-07 11:33:21.139631] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.858 [2024-10-07 11:33:21.140322] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.858 [2024-10-07 11:33:21.140511] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.858 [2024-10-07 11:33:21.140631] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.858 [2024-10-07 11:33:21.140744] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.858 [2024-10-07 11:33:21.140832] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.858 [2024-10-07 11:33:21.150146] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.858 [2024-10-07 11:33:21.150521] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.858 [2024-10-07 11:33:21.150641] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.858 [2024-10-07 11:33:21.150757] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.858 [2024-10-07 11:33:21.150909] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.858 [2024-10-07 11:33:21.151068] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.858 [2024-10-07 11:33:21.151094] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.858 [2024-10-07 11:33:21.151109] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.858 [2024-10-07 11:33:21.151169] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.858 [2024-10-07 11:33:21.160480] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.858 [2024-10-07 11:33:21.161093] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.858 [2024-10-07 11:33:21.161213] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.858 [2024-10-07 11:33:21.161299] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.858 [2024-10-07 11:33:21.161518] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.858 [2024-10-07 11:33:21.164147] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.858 [2024-10-07 11:33:21.164259] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.859 [2024-10-07 11:33:21.164340] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.859 [2024-10-07 11:33:21.166777] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.859 [2024-10-07 11:33:21.170638] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.859 [2024-10-07 11:33:21.170855] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.859 [2024-10-07 11:33:21.170971] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.859 [2024-10-07 11:33:21.171053] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.859 [2024-10-07 11:33:21.171155] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.859 [2024-10-07 11:33:21.171287] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.859 [2024-10-07 11:33:21.171369] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.859 [2024-10-07 11:33:21.171444] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.859 [2024-10-07 11:33:21.171791] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.859 [2024-10-07 11:33:21.181236] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.859 [2024-10-07 11:33:21.181433] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.859 [2024-10-07 11:33:21.181541] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.859 [2024-10-07 11:33:21.181626] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.859 [2024-10-07 11:33:21.181915] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.859 [2024-10-07 11:33:21.182136] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.859 [2024-10-07 11:33:21.182229] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.859 [2024-10-07 11:33:21.182307] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.859 [2024-10-07 11:33:21.182520] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.859 [2024-10-07 11:33:21.195183] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.859 [2024-10-07 11:33:21.195491] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.859 [2024-10-07 11:33:21.195625] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.859 [2024-10-07 11:33:21.195754] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.859 [2024-10-07 11:33:21.196445] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.859 [2024-10-07 11:33:21.196838] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.859 [2024-10-07 11:33:21.196958] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.859 [2024-10-07 11:33:21.197053] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.859 [2024-10-07 11:33:21.197177] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.859 [2024-10-07 11:33:21.205595] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.859 [2024-10-07 11:33:21.206297] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.859 [2024-10-07 11:33:21.206401] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.859 [2024-10-07 11:33:21.206502] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.859 [2024-10-07 11:33:21.209497] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.859 [2024-10-07 11:33:21.210189] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.859 [2024-10-07 11:33:21.210305] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.859 [2024-10-07 11:33:21.210395] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.859 [2024-10-07 11:33:21.210712] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.859 [2024-10-07 11:33:21.216824] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.859 [2024-10-07 11:33:21.217383] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.859 [2024-10-07 11:33:21.217494] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.859 [2024-10-07 11:33:21.217576] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.859 [2024-10-07 11:33:21.220766] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.859 [2024-10-07 11:33:21.221233] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.859 [2024-10-07 11:33:21.221341] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.859 [2024-10-07 11:33:21.221426] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.859 [2024-10-07 11:33:21.223353] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.859 [2024-10-07 11:33:21.226980] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.859 [2024-10-07 11:33:21.227245] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.859 [2024-10-07 11:33:21.227347] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.859 [2024-10-07 11:33:21.227434] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.859 [2024-10-07 11:33:21.228296] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.859 [2024-10-07 11:33:21.228500] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.859 [2024-10-07 11:33:21.228580] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.859 [2024-10-07 11:33:21.228697] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.859 [2024-10-07 11:33:21.230356] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.859 [2024-10-07 11:33:21.238540] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.859 [2024-10-07 11:33:21.239463] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.859 [2024-10-07 11:33:21.239511] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.859 [2024-10-07 11:33:21.239533] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.859 [2024-10-07 11:33:21.239945] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.859 [2024-10-07 11:33:21.240177] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.859 [2024-10-07 11:33:21.240213] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.859 [2024-10-07 11:33:21.240230] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.859 [2024-10-07 11:33:21.240292] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.859 [2024-10-07 11:33:21.249010] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.859 [2024-10-07 11:33:21.249259] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.859 [2024-10-07 11:33:21.249292] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.859 [2024-10-07 11:33:21.249309] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.859 [2024-10-07 11:33:21.249440] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.859 [2024-10-07 11:33:21.249559] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.859 [2024-10-07 11:33:21.249599] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.859 [2024-10-07 11:33:21.249635] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.859 [2024-10-07 11:33:21.249769] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.859 [2024-10-07 11:33:21.259354] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.859 [2024-10-07 11:33:21.259465] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.859 [2024-10-07 11:33:21.259496] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.859 [2024-10-07 11:33:21.259513] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.859 [2024-10-07 11:33:21.259537] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.859 [2024-10-07 11:33:21.259559] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.859 [2024-10-07 11:33:21.259574] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.859 [2024-10-07 11:33:21.259588] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.859 [2024-10-07 11:33:21.259611] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.859 [2024-10-07 11:33:21.269431] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.859 [2024-10-07 11:33:21.269551] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.859 [2024-10-07 11:33:21.269581] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.859 [2024-10-07 11:33:21.269598] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.859 [2024-10-07 11:33:21.269625] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.859 [2024-10-07 11:33:21.269647] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.859 [2024-10-07 11:33:21.269661] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.859 [2024-10-07 11:33:21.269692] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.859 [2024-10-07 11:33:21.269941] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.859 [2024-10-07 11:33:21.279758] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.859 [2024-10-07 11:33:21.279881] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.859 [2024-10-07 11:33:21.279912] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.859 [2024-10-07 11:33:21.279929] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.859 [2024-10-07 11:33:21.279952] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.859 [2024-10-07 11:33:21.279976] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.860 [2024-10-07 11:33:21.279990] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.860 [2024-10-07 11:33:21.280003] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.860 [2024-10-07 11:33:21.280026] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.860 [2024-10-07 11:33:21.294127] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.860 [2024-10-07 11:33:21.294271] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.860 [2024-10-07 11:33:21.294304] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.860 [2024-10-07 11:33:21.294321] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.860 [2024-10-07 11:33:21.294344] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.860 [2024-10-07 11:33:21.294367] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.860 [2024-10-07 11:33:21.294382] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.860 [2024-10-07 11:33:21.294396] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.860 [2024-10-07 11:33:21.294450] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.860 [2024-10-07 11:33:21.308953] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.860 [2024-10-07 11:33:21.309055] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.860 [2024-10-07 11:33:21.309086] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.860 [2024-10-07 11:33:21.309102] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.860 [2024-10-07 11:33:21.309126] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.860 [2024-10-07 11:33:21.309148] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.860 [2024-10-07 11:33:21.309163] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.860 [2024-10-07 11:33:21.309176] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.860 [2024-10-07 11:33:21.309200] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.860 [2024-10-07 11:33:21.319029] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.860 [2024-10-07 11:33:21.319139] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.860 [2024-10-07 11:33:21.319170] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.860 [2024-10-07 11:33:21.319187] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.860 [2024-10-07 11:33:21.322005] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.860 [2024-10-07 11:33:21.324511] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.860 [2024-10-07 11:33:21.324547] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.860 [2024-10-07 11:33:21.324564] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.860 [2024-10-07 11:33:21.325533] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.860 [2024-10-07 11:33:21.329106] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.860 [2024-10-07 11:33:21.329206] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.860 [2024-10-07 11:33:21.329236] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.860 [2024-10-07 11:33:21.329252] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.860 [2024-10-07 11:33:21.329294] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.860 [2024-10-07 11:33:21.329319] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.860 [2024-10-07 11:33:21.329333] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.860 [2024-10-07 11:33:21.329347] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.860 [2024-10-07 11:33:21.329370] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.860 [2024-10-07 11:33:21.340090] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.860 [2024-10-07 11:33:21.340194] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.860 [2024-10-07 11:33:21.340226] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.860 [2024-10-07 11:33:21.340242] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.860 [2024-10-07 11:33:21.340266] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.860 [2024-10-07 11:33:21.340289] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.860 [2024-10-07 11:33:21.340303] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.860 [2024-10-07 11:33:21.340316] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.860 [2024-10-07 11:33:21.340340] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.860 [2024-10-07 11:33:21.355002] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.860 [2024-10-07 11:33:21.357375] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.860 [2024-10-07 11:33:21.357416] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.860 [2024-10-07 11:33:21.357435] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.860 [2024-10-07 11:33:21.357922] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.860 [2024-10-07 11:33:21.358112] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.860 [2024-10-07 11:33:21.358144] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.860 [2024-10-07 11:33:21.358161] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.860 [2024-10-07 11:33:21.358266] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.860 [2024-10-07 11:33:21.366994] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.860 [2024-10-07 11:33:21.367223] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.860 [2024-10-07 11:33:21.367263] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.860 [2024-10-07 11:33:21.367283] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.860 [2024-10-07 11:33:21.367308] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.860 [2024-10-07 11:33:21.367330] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.860 [2024-10-07 11:33:21.367345] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.860 [2024-10-07 11:33:21.367375] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.860 [2024-10-07 11:33:21.367402] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.860 [2024-10-07 11:33:21.377226] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.860 [2024-10-07 11:33:21.377327] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.860 [2024-10-07 11:33:21.377357] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.860 [2024-10-07 11:33:21.377373] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.860 [2024-10-07 11:33:21.377397] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.860 [2024-10-07 11:33:21.377418] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.860 [2024-10-07 11:33:21.377432] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.860 [2024-10-07 11:33:21.377445] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.860 [2024-10-07 11:33:21.377469] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.860 [2024-10-07 11:33:21.389878] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.860 [2024-10-07 11:33:21.390039] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.860 [2024-10-07 11:33:21.390076] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.860 [2024-10-07 11:33:21.390095] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.860 [2024-10-07 11:33:21.390151] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.860 [2024-10-07 11:33:21.390197] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.860 [2024-10-07 11:33:21.390217] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.860 [2024-10-07 11:33:21.390231] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.860 [2024-10-07 11:33:21.390256] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.860 [2024-10-07 11:33:21.401722] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.860 [2024-10-07 11:33:21.401928] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.860 [2024-10-07 11:33:21.401966] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.860 [2024-10-07 11:33:21.401984] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.860 [2024-10-07 11:33:21.402131] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.860 [2024-10-07 11:33:21.402256] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.860 [2024-10-07 11:33:21.402282] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.860 [2024-10-07 11:33:21.402297] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.860 [2024-10-07 11:33:21.402487] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.860 [2024-10-07 11:33:21.411798] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.860 [2024-10-07 11:33:21.411899] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.860 [2024-10-07 11:33:21.411957] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.861 [2024-10-07 11:33:21.411977] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.861 [2024-10-07 11:33:21.412001] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.861 [2024-10-07 11:33:21.412025] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.861 [2024-10-07 11:33:21.412040] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.861 [2024-10-07 11:33:21.412053] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.861 [2024-10-07 11:33:21.412077] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.861 [2024-10-07 11:33:21.422836] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.861 [2024-10-07 11:33:21.423045] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.861 [2024-10-07 11:33:21.423084] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.861 [2024-10-07 11:33:21.423103] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.861 [2024-10-07 11:33:21.423220] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.861 [2024-10-07 11:33:21.424562] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.861 [2024-10-07 11:33:21.424597] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.861 [2024-10-07 11:33:21.424613] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.861 [2024-10-07 11:33:21.425739] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.861 [2024-10-07 11:33:21.433261] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.861 [2024-10-07 11:33:21.433461] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.861 [2024-10-07 11:33:21.433499] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.861 [2024-10-07 11:33:21.433518] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.861 [2024-10-07 11:33:21.433635] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.861 [2024-10-07 11:33:21.433793] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.861 [2024-10-07 11:33:21.433823] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.861 [2024-10-07 11:33:21.433838] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.861 [2024-10-07 11:33:21.434717] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.861 [2024-10-07 11:33:21.443379] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.861 [2024-10-07 11:33:21.443487] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.861 [2024-10-07 11:33:21.443522] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.861 [2024-10-07 11:33:21.443539] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.861 [2024-10-07 11:33:21.443585] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.861 [2024-10-07 11:33:21.443637] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.861 [2024-10-07 11:33:21.443669] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.861 [2024-10-07 11:33:21.443685] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.861 [2024-10-07 11:33:21.443710] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.861 [2024-10-07 11:33:21.456135] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.861 [2024-10-07 11:33:21.456279] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.861 [2024-10-07 11:33:21.456317] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.861 [2024-10-07 11:33:21.456337] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.861 [2024-10-07 11:33:21.456362] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.861 [2024-10-07 11:33:21.456385] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.861 [2024-10-07 11:33:21.456399] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.861 [2024-10-07 11:33:21.456413] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.861 [2024-10-07 11:33:21.456438] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.861 [2024-10-07 11:33:21.470490] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.861 [2024-10-07 11:33:21.470605] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.861 [2024-10-07 11:33:21.470641] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.861 [2024-10-07 11:33:21.470675] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.861 [2024-10-07 11:33:21.470702] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.861 [2024-10-07 11:33:21.470725] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.861 [2024-10-07 11:33:21.470740] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.861 [2024-10-07 11:33:21.470754] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.861 [2024-10-07 11:33:21.470778] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.861 [2024-10-07 11:33:21.485233] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.861 [2024-10-07 11:33:21.485437] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.861 [2024-10-07 11:33:21.485475] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.861 [2024-10-07 11:33:21.485494] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.861 [2024-10-07 11:33:21.486007] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.861 [2024-10-07 11:33:21.486128] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.861 [2024-10-07 11:33:21.486158] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.861 [2024-10-07 11:33:21.486174] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.861 [2024-10-07 11:33:21.486217] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.861 [2024-10-07 11:33:21.498606] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.861 [2024-10-07 11:33:21.498728] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.861 [2024-10-07 11:33:21.498759] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.861 [2024-10-07 11:33:21.498776] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.861 [2024-10-07 11:33:21.499357] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.861 [2024-10-07 11:33:21.499473] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.861 [2024-10-07 11:33:21.499497] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.861 [2024-10-07 11:33:21.499512] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.861 [2024-10-07 11:33:21.499537] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.861 [2024-10-07 11:33:21.509268] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.861 [2024-10-07 11:33:21.509484] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.861 [2024-10-07 11:33:21.509517] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.861 [2024-10-07 11:33:21.509535] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.861 [2024-10-07 11:33:21.509703] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.861 [2024-10-07 11:33:21.509855] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.861 [2024-10-07 11:33:21.509892] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.861 [2024-10-07 11:33:21.509910] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.861 [2024-10-07 11:33:21.510092] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.861 [2024-10-07 11:33:21.519523] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.861 [2024-10-07 11:33:21.519852] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.861 [2024-10-07 11:33:21.519897] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.861 [2024-10-07 11:33:21.519917] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.861 [2024-10-07 11:33:21.519974] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.861 [2024-10-07 11:33:21.520003] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.861 [2024-10-07 11:33:21.520019] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.862 [2024-10-07 11:33:21.520033] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.862 [2024-10-07 11:33:21.520057] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.862 [2024-10-07 11:33:21.530047] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.862 [2024-10-07 11:33:21.530155] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.862 [2024-10-07 11:33:21.530185] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.862 [2024-10-07 11:33:21.530229] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.862 [2024-10-07 11:33:21.530255] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.862 [2024-10-07 11:33:21.530278] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.862 [2024-10-07 11:33:21.530296] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.862 [2024-10-07 11:33:21.530309] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.862 [2024-10-07 11:33:21.530334] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.862 [2024-10-07 11:33:21.541189] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.862 [2024-10-07 11:33:21.542583] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.862 [2024-10-07 11:33:21.542628] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.862 [2024-10-07 11:33:21.542661] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.862 [2024-10-07 11:33:21.543223] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.862 [2024-10-07 11:33:21.543470] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.862 [2024-10-07 11:33:21.543499] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.862 [2024-10-07 11:33:21.543514] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.862 [2024-10-07 11:33:21.543739] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.862 [2024-10-07 11:33:21.551289] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.862 [2024-10-07 11:33:21.551395] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.862 [2024-10-07 11:33:21.551426] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.862 [2024-10-07 11:33:21.551451] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.862 [2024-10-07 11:33:21.554261] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.862 [2024-10-07 11:33:21.556881] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.862 [2024-10-07 11:33:21.556920] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.862 [2024-10-07 11:33:21.556955] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.862 [2024-10-07 11:33:21.557421] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.862 [2024-10-07 11:33:21.561365] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.862 [2024-10-07 11:33:21.561484] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.862 [2024-10-07 11:33:21.561514] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.862 [2024-10-07 11:33:21.561530] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.862 [2024-10-07 11:33:21.561553] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.862 [2024-10-07 11:33:21.561577] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.862 [2024-10-07 11:33:21.561611] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.862 [2024-10-07 11:33:21.561626] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.862 [2024-10-07 11:33:21.561649] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.862 [2024-10-07 11:33:21.571456] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.862 [2024-10-07 11:33:21.571563] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.862 [2024-10-07 11:33:21.571593] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.862 [2024-10-07 11:33:21.571610] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.862 [2024-10-07 11:33:21.571636] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.862 [2024-10-07 11:33:21.571676] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.862 [2024-10-07 11:33:21.571692] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.862 [2024-10-07 11:33:21.571706] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.862 [2024-10-07 11:33:21.571730] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.862 [2024-10-07 11:33:21.585702] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.862 [2024-10-07 11:33:21.585820] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.862 [2024-10-07 11:33:21.585850] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.862 [2024-10-07 11:33:21.585867] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.862 [2024-10-07 11:33:21.585890] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.862 [2024-10-07 11:33:21.585912] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.862 [2024-10-07 11:33:21.585926] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.862 [2024-10-07 11:33:21.585939] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.862 [2024-10-07 11:33:21.585962] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.862 [2024-10-07 11:33:21.600505] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.862 [2024-10-07 11:33:21.600717] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.862 [2024-10-07 11:33:21.600749] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.862 [2024-10-07 11:33:21.600767] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.862 [2024-10-07 11:33:21.600791] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.862 [2024-10-07 11:33:21.600814] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.862 [2024-10-07 11:33:21.600829] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.862 [2024-10-07 11:33:21.600843] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.862 [2024-10-07 11:33:21.600867] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.862 [2024-10-07 11:33:21.610918] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.862 [2024-10-07 11:33:21.611160] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.862 [2024-10-07 11:33:21.611229] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.862 [2024-10-07 11:33:21.611249] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.862 [2024-10-07 11:33:21.611384] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.862 [2024-10-07 11:33:21.611504] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.862 [2024-10-07 11:33:21.611526] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.862 [2024-10-07 11:33:21.611541] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.862 [2024-10-07 11:33:21.611642] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.862 [2024-10-07 11:33:21.621015] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.862 [2024-10-07 11:33:21.621149] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.862 [2024-10-07 11:33:21.621179] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.862 [2024-10-07 11:33:21.621195] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.862 [2024-10-07 11:33:21.621219] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.862 [2024-10-07 11:33:21.621241] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.862 [2024-10-07 11:33:21.621255] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.862 [2024-10-07 11:33:21.621268] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.862 [2024-10-07 11:33:21.621291] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.862 [2024-10-07 11:33:21.633067] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.862 [2024-10-07 11:33:21.633744] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.862 [2024-10-07 11:33:21.633788] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.862 [2024-10-07 11:33:21.633809] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.862 [2024-10-07 11:33:21.633891] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.862 [2024-10-07 11:33:21.633921] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.862 [2024-10-07 11:33:21.633937] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.862 [2024-10-07 11:33:21.633950] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.862 [2024-10-07 11:33:21.633975] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.862 [2024-10-07 11:33:21.644141] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.862 [2024-10-07 11:33:21.644329] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.862 [2024-10-07 11:33:21.644362] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.862 [2024-10-07 11:33:21.644379] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.862 [2024-10-07 11:33:21.645257] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.863 [2024-10-07 11:33:21.645394] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.863 [2024-10-07 11:33:21.645418] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.863 [2024-10-07 11:33:21.645433] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.863 [2024-10-07 11:33:21.645458] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.863 [2024-10-07 11:33:21.654224] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.863 [2024-10-07 11:33:21.654331] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.863 [2024-10-07 11:33:21.654362] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.863 [2024-10-07 11:33:21.654379] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.863 [2024-10-07 11:33:21.656607] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.863 [2024-10-07 11:33:21.657297] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.863 [2024-10-07 11:33:21.657350] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.863 [2024-10-07 11:33:21.657368] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.863 [2024-10-07 11:33:21.657500] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.863 [2024-10-07 11:33:21.664309] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.863 [2024-10-07 11:33:21.664426] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.863 [2024-10-07 11:33:21.664459] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.863 [2024-10-07 11:33:21.664476] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.863 [2024-10-07 11:33:21.664501] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.863 [2024-10-07 11:33:21.664524] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.863 [2024-10-07 11:33:21.664539] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.863 [2024-10-07 11:33:21.664552] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.863 [2024-10-07 11:33:21.664577] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.863 [2024-10-07 11:33:21.674520] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.863 [2024-10-07 11:33:21.674664] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.863 [2024-10-07 11:33:21.674697] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.863 [2024-10-07 11:33:21.674715] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.863 [2024-10-07 11:33:21.674741] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.863 [2024-10-07 11:33:21.674764] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.863 [2024-10-07 11:33:21.674780] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.863 [2024-10-07 11:33:21.674812] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.863 [2024-10-07 11:33:21.676746] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.863 [2024-10-07 11:33:21.684628] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.863 [2024-10-07 11:33:21.684759] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.863 [2024-10-07 11:33:21.684799] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.863 [2024-10-07 11:33:21.684818] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.863 [2024-10-07 11:33:21.684843] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.863 [2024-10-07 11:33:21.684866] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.863 [2024-10-07 11:33:21.684881] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.863 [2024-10-07 11:33:21.684894] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.863 [2024-10-07 11:33:21.684918] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.863 [2024-10-07 11:33:21.697642] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.863 [2024-10-07 11:33:21.698223] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.863 [2024-10-07 11:33:21.698268] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.863 [2024-10-07 11:33:21.698289] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.863 [2024-10-07 11:33:21.698399] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.863 [2024-10-07 11:33:21.698433] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.863 [2024-10-07 11:33:21.698451] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.863 [2024-10-07 11:33:21.698465] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.863 [2024-10-07 11:33:21.698490] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.863 [2024-10-07 11:33:21.708627] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.863 [2024-10-07 11:33:21.708879] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.863 [2024-10-07 11:33:21.708913] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.863 [2024-10-07 11:33:21.708931] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.863 [2024-10-07 11:33:21.709064] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.863 [2024-10-07 11:33:21.709198] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.863 [2024-10-07 11:33:21.709232] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.863 [2024-10-07 11:33:21.709250] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.863 [2024-10-07 11:33:21.709380] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.863 [2024-10-07 11:33:21.718737] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.863 [2024-10-07 11:33:21.718895] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.863 [2024-10-07 11:33:21.718926] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.863 [2024-10-07 11:33:21.718942] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.863 [2024-10-07 11:33:21.718966] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.863 [2024-10-07 11:33:21.718989] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.863 [2024-10-07 11:33:21.719003] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.863 [2024-10-07 11:33:21.719016] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.863 [2024-10-07 11:33:21.719039] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.863 [2024-10-07 11:33:21.729846] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.863 [2024-10-07 11:33:21.730054] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.863 [2024-10-07 11:33:21.730087] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.863 [2024-10-07 11:33:21.730104] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.863 [2024-10-07 11:33:21.730220] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.863 [2024-10-07 11:33:21.730346] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.863 [2024-10-07 11:33:21.730369] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.863 [2024-10-07 11:33:21.730383] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.863 [2024-10-07 11:33:21.730488] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.863 [2024-10-07 11:33:21.742369] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.863 [2024-10-07 11:33:21.742584] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.863 [2024-10-07 11:33:21.742631] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.863 [2024-10-07 11:33:21.742668] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.863 [2024-10-07 11:33:21.742698] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.863 [2024-10-07 11:33:21.742721] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.863 [2024-10-07 11:33:21.742736] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.863 [2024-10-07 11:33:21.742750] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.863 [2024-10-07 11:33:21.742775] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.863 [2024-10-07 11:33:21.754382] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.863 [2024-10-07 11:33:21.754554] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.863 [2024-10-07 11:33:21.754587] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.863 [2024-10-07 11:33:21.754605] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.863 [2024-10-07 11:33:21.754802] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.863 [2024-10-07 11:33:21.754889] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.863 [2024-10-07 11:33:21.754913] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.863 [2024-10-07 11:33:21.754927] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.863 [2024-10-07 11:33:21.754952] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.863 [2024-10-07 11:33:21.767308] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.863 [2024-10-07 11:33:21.767534] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.864 [2024-10-07 11:33:21.767579] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.864 [2024-10-07 11:33:21.767600] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.864 [2024-10-07 11:33:21.767778] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.864 [2024-10-07 11:33:21.767915] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.864 [2024-10-07 11:33:21.767944] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.864 [2024-10-07 11:33:21.767961] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.864 [2024-10-07 11:33:21.768100] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.864 [2024-10-07 11:33:21.778049] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.864 [2024-10-07 11:33:21.778327] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.864 [2024-10-07 11:33:21.778379] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.864 [2024-10-07 11:33:21.778416] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.864 [2024-10-07 11:33:21.778575] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.864 [2024-10-07 11:33:21.778747] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.864 [2024-10-07 11:33:21.778783] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.864 [2024-10-07 11:33:21.778801] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.864 [2024-10-07 11:33:21.782423] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.864 [2024-10-07 11:33:21.783819] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:28 nsid:1 lba:81440 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:37.864 [2024-10-07 11:33:21.783854] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:37.864 [2024-10-07 11:33:21.783879] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:19 nsid:1 lba:81448 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:37.864 [2024-10-07 11:33:21.783896] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:37.864 [2024-10-07 11:33:21.783912] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:95 nsid:1 lba:81456 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:37.864 [2024-10-07 11:33:21.783926] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:37.864 [2024-10-07 11:33:21.783942] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:18 nsid:1 lba:81464 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:37.864 [2024-10-07 11:33:21.783974] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:37.864 [2024-10-07 11:33:21.783992] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:30 nsid:1 lba:81472 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:37.864 [2024-10-07 11:33:21.784006] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:37.864 [2024-10-07 11:33:21.784021] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:75 nsid:1 lba:81480 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:37.864 [2024-10-07 11:33:21.784036] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:37.864 [2024-10-07 11:33:21.784051] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:68 nsid:1 lba:81488 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:37.864 [2024-10-07 11:33:21.784065] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:37.864 [2024-10-07 11:33:21.784080] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:27 nsid:1 lba:81496 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:37.864 [2024-10-07 11:33:21.784094] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:37.864 [2024-10-07 11:33:21.784110] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:79 nsid:1 lba:81504 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:37.864 [2024-10-07 11:33:21.784123] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:37.864 [2024-10-07 11:33:21.784138] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:108 nsid:1 lba:81512 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:37.864 [2024-10-07 11:33:21.784153] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:37.864 [2024-10-07 11:33:21.784168] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:81520 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:37.864 [2024-10-07 11:33:21.784182] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:37.864 [2024-10-07 11:33:21.784203] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:72 nsid:1 lba:81528 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:37.864 [2024-10-07 11:33:21.784217] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:37.864 [2024-10-07 11:33:21.784233] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:102 nsid:1 lba:81536 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:37.864 [2024-10-07 11:33:21.784247] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:37.864 [2024-10-07 11:33:21.784263] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:81544 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:37.864 [2024-10-07 11:33:21.784277] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:37.864 [2024-10-07 11:33:21.784292] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:42 nsid:1 lba:81552 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:37.864 [2024-10-07 11:33:21.784306] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:37.864 [2024-10-07 11:33:21.784321] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:81560 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:37.864 [2024-10-07 11:33:21.784335] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:37.864 [2024-10-07 11:33:21.784358] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:29 nsid:1 lba:81568 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:37.864 [2024-10-07 11:33:21.784379] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:37.864 [2024-10-07 11:33:21.784395] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:84 nsid:1 lba:81576 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:37.864 [2024-10-07 11:33:21.784409] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:37.864 [2024-10-07 11:33:21.784425] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:83 nsid:1 lba:81584 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:37.864 [2024-10-07 11:33:21.784439] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:37.864 [2024-10-07 11:33:21.784455] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:125 nsid:1 lba:81592 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:37.864 [2024-10-07 11:33:21.784469] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:37.864 [2024-10-07 11:33:21.784485] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:81600 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:37.864 [2024-10-07 11:33:21.784499] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:37.864 [2024-10-07 11:33:21.784515] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:86 nsid:1 lba:81608 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:37.864 [2024-10-07 11:33:21.784529] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:37.864 [2024-10-07 11:33:21.784545] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:41 nsid:1 lba:81616 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:37.864 [2024-10-07 11:33:21.784559] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:37.864 [2024-10-07 11:33:21.784574] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:34 nsid:1 lba:81624 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:37.864 [2024-10-07 11:33:21.784589] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:37.864 [2024-10-07 11:33:21.784604] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:88 nsid:1 lba:81632 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:37.864 [2024-10-07 11:33:21.784619] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:37.864 [2024-10-07 11:33:21.784634] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:82 nsid:1 lba:81640 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:37.864 [2024-10-07 11:33:21.784662] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:37.864 [2024-10-07 11:33:21.784682] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:123 nsid:1 lba:81648 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:37.864 [2024-10-07 11:33:21.784696] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:37.864 [2024-10-07 11:33:21.784712] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:16 nsid:1 lba:81656 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:37.864 [2024-10-07 11:33:21.784726] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:37.864 [2024-10-07 11:33:21.784744] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:35 nsid:1 lba:81664 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:37.864 [2024-10-07 11:33:21.784767] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:37.864 [2024-10-07 11:33:21.784784] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:56 nsid:1 lba:81672 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:37.864 [2024-10-07 11:33:21.784798] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:37.864 [2024-10-07 11:33:21.784814] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:81680 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:37.864 [2024-10-07 11:33:21.784829] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:37.864 [2024-10-07 11:33:21.784844] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:90 nsid:1 lba:81688 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:37.864 [2024-10-07 11:33:21.784859] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:37.864 [2024-10-07 11:33:21.784874] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:59 nsid:1 lba:81696 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:37.864 [2024-10-07 11:33:21.784893] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:37.864 [2024-10-07 11:33:21.784911] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:52 nsid:1 lba:81704 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:37.864 [2024-10-07 11:33:21.784925] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:37.865 [2024-10-07 11:33:21.784941] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:43 nsid:1 lba:81712 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:37.865 [2024-10-07 11:33:21.784955] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:37.865 [2024-10-07 11:33:21.784971] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:17 nsid:1 lba:81720 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:37.865 [2024-10-07 11:33:21.784995] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:37.865 [2024-10-07 11:33:21.785011] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:55 nsid:1 lba:81856 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:22:37.865 [2024-10-07 11:33:21.785025] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:37.865 [2024-10-07 11:33:21.785041] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:114 nsid:1 lba:81864 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:22:37.865 [2024-10-07 11:33:21.785056] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:37.865 [2024-10-07 11:33:21.785072] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:70 nsid:1 lba:81872 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:22:37.865 [2024-10-07 11:33:21.785086] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:37.865 [2024-10-07 11:33:21.785102] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:54 nsid:1 lba:81880 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:22:37.865 [2024-10-07 11:33:21.785116] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:37.865 [2024-10-07 11:33:21.785131] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:126 nsid:1 lba:81888 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:22:37.865 [2024-10-07 11:33:21.785146] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:37.865 [2024-10-07 11:33:21.785168] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:92 nsid:1 lba:81896 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:22:37.865 [2024-10-07 11:33:21.785183] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:37.865 [2024-10-07 11:33:21.785199] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:64 nsid:1 lba:81904 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:22:37.865 [2024-10-07 11:33:21.785213] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:37.865 [2024-10-07 11:33:21.785229] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:85 nsid:1 lba:81912 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:22:37.865 [2024-10-07 11:33:21.785243] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:37.865 [2024-10-07 11:33:21.785259] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:4 nsid:1 lba:81920 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:22:37.865 [2024-10-07 11:33:21.785274] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:37.865 [2024-10-07 11:33:21.785289] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:39 nsid:1 lba:81928 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:22:37.865 [2024-10-07 11:33:21.785303] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:37.865 [2024-10-07 11:33:21.785319] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:71 nsid:1 lba:81936 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:22:37.865 [2024-10-07 11:33:21.785333] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:37.865 [2024-10-07 11:33:21.785348] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:50 nsid:1 lba:81944 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:22:37.865 [2024-10-07 11:33:21.785363] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:37.865 [2024-10-07 11:33:21.785379] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:36 nsid:1 lba:81952 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:22:37.865 [2024-10-07 11:33:21.785398] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:37.865 [2024-10-07 11:33:21.785414] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:40 nsid:1 lba:81960 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:22:37.865 [2024-10-07 11:33:21.785428] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:37.865 [2024-10-07 11:33:21.785444] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:13 nsid:1 lba:81968 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:22:37.865 [2024-10-07 11:33:21.785459] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:37.865 [2024-10-07 11:33:21.785474] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:119 nsid:1 lba:81976 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:22:37.865 [2024-10-07 11:33:21.785488] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:37.865 [2024-10-07 11:33:21.785504] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:115 nsid:1 lba:81984 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:22:37.865 [2024-10-07 11:33:21.785518] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:37.865 [2024-10-07 11:33:21.785535] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:100 nsid:1 lba:81992 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:22:37.865 [2024-10-07 11:33:21.785548] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:37.865 [2024-10-07 11:33:21.785571] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:101 nsid:1 lba:82000 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:22:37.865 [2024-10-07 11:33:21.785586] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:37.865 [2024-10-07 11:33:21.785603] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:78 nsid:1 lba:82008 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:22:37.865 [2024-10-07 11:33:21.785617] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:37.865 [2024-10-07 11:33:21.785633] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:23 nsid:1 lba:82016 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:22:37.865 [2024-10-07 11:33:21.785660] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:37.865 [2024-10-07 11:33:21.785680] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:21 nsid:1 lba:82024 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:22:37.865 [2024-10-07 11:33:21.785694] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:37.865 [2024-10-07 11:33:21.785710] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:89 nsid:1 lba:82032 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:22:37.865 [2024-10-07 11:33:21.785724] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:37.865 [2024-10-07 11:33:21.785740] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:111 nsid:1 lba:82040 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:22:37.865 [2024-10-07 11:33:21.785754] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:37.865 [2024-10-07 11:33:21.785776] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:117 nsid:1 lba:82048 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:22:37.865 [2024-10-07 11:33:21.785791] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:37.865 [2024-10-07 11:33:21.785807] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:33 nsid:1 lba:82056 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:22:37.865 [2024-10-07 11:33:21.785822] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:37.865 [2024-10-07 11:33:21.785838] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:51 nsid:1 lba:81728 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:37.865 [2024-10-07 11:33:21.785852] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:37.865 [2024-10-07 11:33:21.785868] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:58 nsid:1 lba:81736 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:37.865 [2024-10-07 11:33:21.785882] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:37.865 [2024-10-07 11:33:21.785898] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:67 nsid:1 lba:81744 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:37.865 [2024-10-07 11:33:21.785917] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:37.865 [2024-10-07 11:33:21.785933] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:80 nsid:1 lba:81752 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:37.865 [2024-10-07 11:33:21.785947] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:37.865 [2024-10-07 11:33:21.785963] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:81760 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:37.865 [2024-10-07 11:33:21.785984] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:37.865 [2024-10-07 11:33:21.786001] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:81768 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:37.865 [2024-10-07 11:33:21.786015] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:37.865 [2024-10-07 11:33:21.786031] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:53 nsid:1 lba:81776 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:37.865 [2024-10-07 11:33:21.786045] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:37.865 [2024-10-07 11:33:21.786061] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:81784 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:37.865 [2024-10-07 11:33:21.786075] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:37.865 [2024-10-07 11:33:21.786090] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:24 nsid:1 lba:82064 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:22:37.865 [2024-10-07 11:33:21.786104] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:37.865 [2024-10-07 11:33:21.786120] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:116 nsid:1 lba:82072 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:22:37.865 [2024-10-07 11:33:21.786135] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:37.865 [2024-10-07 11:33:21.786150] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:60 nsid:1 lba:82080 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:22:37.865 [2024-10-07 11:33:21.786164] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:37.865 [2024-10-07 11:33:21.786179] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:104 nsid:1 lba:82088 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:22:37.865 [2024-10-07 11:33:21.786194] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:37.865 [2024-10-07 11:33:21.786218] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:48 nsid:1 lba:82096 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:22:37.866 [2024-10-07 11:33:21.786232] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:37.866 [2024-10-07 11:33:21.786248] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:103 nsid:1 lba:82104 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:22:37.866 [2024-10-07 11:33:21.786261] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:37.866 [2024-10-07 11:33:21.786282] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:106 nsid:1 lba:82112 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:22:37.866 [2024-10-07 11:33:21.786297] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:37.866 [2024-10-07 11:33:21.786313] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:73 nsid:1 lba:82120 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:22:37.866 [2024-10-07 11:33:21.786327] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:37.866 [2024-10-07 11:33:21.786342] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:74 nsid:1 lba:82128 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:22:37.866 [2024-10-07 11:33:21.786356] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:37.866 [2024-10-07 11:33:21.786379] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:113 nsid:1 lba:82136 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:22:37.866 [2024-10-07 11:33:21.786394] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:37.866 [2024-10-07 11:33:21.786410] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:109 nsid:1 lba:82144 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:22:37.866 [2024-10-07 11:33:21.786440] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:37.866 [2024-10-07 11:33:21.786456] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:120 nsid:1 lba:82152 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:22:37.866 [2024-10-07 11:33:21.786470] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:37.866 [2024-10-07 11:33:21.786486] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:94 nsid:1 lba:82160 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:22:37.866 [2024-10-07 11:33:21.786500] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:37.866 [2024-10-07 11:33:21.786516] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:107 nsid:1 lba:82168 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:22:37.866 [2024-10-07 11:33:21.786530] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:37.866 [2024-10-07 11:33:21.786548] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:87 nsid:1 lba:82176 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:22:37.866 [2024-10-07 11:33:21.786574] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:37.866 [2024-10-07 11:33:21.786607] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:37 nsid:1 lba:82184 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:22:37.866 [2024-10-07 11:33:21.786635] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:37.866 [2024-10-07 11:33:21.786688] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:26 nsid:1 lba:82192 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:22:37.866 [2024-10-07 11:33:21.786716] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:37.866 [2024-10-07 11:33:21.786734] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:46 nsid:1 lba:82200 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:22:37.866 [2024-10-07 11:33:21.786749] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:37.866 [2024-10-07 11:33:21.786765] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:98 nsid:1 lba:82208 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:22:37.866 [2024-10-07 11:33:21.786789] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:37.866 [2024-10-07 11:33:21.786804] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:61 nsid:1 lba:82216 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:22:37.866 [2024-10-07 11:33:21.786825] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:37.866 [2024-10-07 11:33:21.786855] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:118 nsid:1 lba:82224 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:22:37.866 [2024-10-07 11:33:21.786885] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:37.866 [2024-10-07 11:33:21.786915] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:25 nsid:1 lba:82232 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:22:37.866 [2024-10-07 11:33:21.786959] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:37.866 [2024-10-07 11:33:21.786994] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:110 nsid:1 lba:82240 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:22:37.866 [2024-10-07 11:33:21.787013] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:37.866 [2024-10-07 11:33:21.787034] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:122 nsid:1 lba:82248 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:22:37.866 [2024-10-07 11:33:21.787057] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:37.866 [2024-10-07 11:33:21.787073] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:62 nsid:1 lba:82256 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:22:37.866 [2024-10-07 11:33:21.787087] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:37.866 [2024-10-07 11:33:21.787103] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:38 nsid:1 lba:82264 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:22:37.866 [2024-10-07 11:33:21.787117] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:37.866 [2024-10-07 11:33:21.787133] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:6 nsid:1 lba:82272 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:22:37.866 [2024-10-07 11:33:21.787152] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:37.866 [2024-10-07 11:33:21.787169] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:77 nsid:1 lba:82280 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:22:37.866 [2024-10-07 11:33:21.787184] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:37.866 [2024-10-07 11:33:21.787216] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:81 nsid:1 lba:82288 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:22:37.866 [2024-10-07 11:33:21.787232] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:37.866 [2024-10-07 11:33:21.787248] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:3 nsid:1 lba:82296 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:22:37.866 [2024-10-07 11:33:21.787262] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:37.866 [2024-10-07 11:33:21.787277] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:65 nsid:1 lba:82304 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:22:37.866 [2024-10-07 11:33:21.787291] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:37.866 [2024-10-07 11:33:21.787307] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:112 nsid:1 lba:82312 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:22:37.866 [2024-10-07 11:33:21.787321] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:37.866 [2024-10-07 11:33:21.787347] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:121 nsid:1 lba:82320 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:22:37.866 [2024-10-07 11:33:21.787361] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:37.866 [2024-10-07 11:33:21.787377] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:32 nsid:1 lba:82328 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:22:37.866 [2024-10-07 11:33:21.787391] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:37.866 [2024-10-07 11:33:21.787407] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:105 nsid:1 lba:82336 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:22:37.866 [2024-10-07 11:33:21.787434] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:37.866 [2024-10-07 11:33:21.787451] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:57 nsid:1 lba:82344 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:22:37.866 [2024-10-07 11:33:21.787466] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:37.866 [2024-10-07 11:33:21.787482] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:44 nsid:1 lba:82352 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:22:37.866 [2024-10-07 11:33:21.787496] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:37.866 [2024-10-07 11:33:21.787512] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:63 nsid:1 lba:82360 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:22:37.866 [2024-10-07 11:33:21.787526] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:37.866 [2024-10-07 11:33:21.787542] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:22 nsid:1 lba:81792 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:37.866 [2024-10-07 11:33:21.787556] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:37.866 [2024-10-07 11:33:21.787573] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:66 nsid:1 lba:82368 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:22:37.866 [2024-10-07 11:33:21.787587] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:37.866 [2024-10-07 11:33:21.787603] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:99 nsid:1 lba:82376 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:22:37.866 [2024-10-07 11:33:21.787617] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:37.866 [2024-10-07 11:33:21.787632] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:45 nsid:1 lba:82384 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:22:37.866 [2024-10-07 11:33:21.787646] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:37.866 [2024-10-07 11:33:21.787680] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:93 nsid:1 lba:82392 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:22:37.867 [2024-10-07 11:33:21.787700] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:37.867 [2024-10-07 11:33:21.787717] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:31 nsid:1 lba:82400 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:22:37.867 [2024-10-07 11:33:21.787731] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:37.867 [2024-10-07 11:33:21.787747] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:47 nsid:1 lba:82408 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:22:37.867 [2024-10-07 11:33:21.787761] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:37.867 [2024-10-07 11:33:21.787777] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:10 nsid:1 lba:82416 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:22:37.867 [2024-10-07 11:33:21.787791] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:37.867 [2024-10-07 11:33:21.787806] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:76 nsid:1 lba:82424 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:22:37.867 [2024-10-07 11:33:21.787820] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:37.867 [2024-10-07 11:33:21.787844] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:97 nsid:1 lba:82432 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:22:37.867 [2024-10-07 11:33:21.787859] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:37.867 [2024-10-07 11:33:21.787875] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:96 nsid:1 lba:82440 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:22:37.867 [2024-10-07 11:33:21.787889] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:37.867 [2024-10-07 11:33:21.787905] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:91 nsid:1 lba:82448 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:22:37.867 [2024-10-07 11:33:21.787919] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:37.867 [2024-10-07 11:33:21.787934] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:124 nsid:1 lba:82456 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:22:37.867 [2024-10-07 11:33:21.787948] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:37.867 [2024-10-07 11:33:21.787965] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:81800 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:37.867 [2024-10-07 11:33:21.787979] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:37.867 [2024-10-07 11:33:21.787994] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:20 nsid:1 lba:81808 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:37.867 [2024-10-07 11:33:21.788009] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:37.867 [2024-10-07 11:33:21.788024] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:69 nsid:1 lba:81816 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:37.867 [2024-10-07 11:33:21.788039] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:37.867 [2024-10-07 11:33:21.788055] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:81824 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:37.867 [2024-10-07 11:33:21.788069] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:37.867 [2024-10-07 11:33:21.788085] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:49 nsid:1 lba:81832 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:37.867 [2024-10-07 11:33:21.788099] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:37.867 [2024-10-07 11:33:21.788116] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:81840 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:37.867 [2024-10-07 11:33:21.788130] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:37.867 [2024-10-07 11:33:21.788145] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a29fb0 is same with the state(6) to be set 00:22:37.867 [2024-10-07 11:33:21.788161] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:22:37.867 [2024-10-07 11:33:21.788173] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:22:37.867 [2024-10-07 11:33:21.788189] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:81848 len:8 PRP1 0x0 PRP2 0x0 00:22:37.867 [2024-10-07 11:33:21.788205] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:37.867 [2024-10-07 11:33:21.788264] bdev_nvme.c:1730:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0x1a29fb0 was disconnected and freed. reset controller. 00:22:37.867 [2024-10-07 11:33:21.788363] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:22:37.867 [2024-10-07 11:33:21.788390] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:37.867 [2024-10-07 11:33:21.788406] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:22:37.867 [2024-10-07 11:33:21.788420] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:37.867 [2024-10-07 11:33:21.788434] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:22:37.867 [2024-10-07 11:33:21.788448] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:37.867 [2024-10-07 11:33:21.788463] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:22:37.867 [2024-10-07 11:33:21.788477] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:37.867 [2024-10-07 11:33:21.788491] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.867 [2024-10-07 11:33:21.789827] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.867 [2024-10-07 11:33:21.789866] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.867 [2024-10-07 11:33:21.789897] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.867 [2024-10-07 11:33:21.789988] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.867 [2024-10-07 11:33:21.790018] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.867 [2024-10-07 11:33:21.790035] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.867 [2024-10-07 11:33:21.790085] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.867 [2024-10-07 11:33:21.790109] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.867 [2024-10-07 11:33:21.790124] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.867 [2024-10-07 11:33:21.790147] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.867 [2024-10-07 11:33:21.790167] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.867 [2024-10-07 11:33:21.790188] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.867 [2024-10-07 11:33:21.790202] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.867 [2024-10-07 11:33:21.790216] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.867 [2024-10-07 11:33:21.790232] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.867 [2024-10-07 11:33:21.790247] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.867 [2024-10-07 11:33:21.790260] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.867 [2024-10-07 11:33:21.790283] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.867 [2024-10-07 11:33:21.790297] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.867 [2024-10-07 11:33:21.799963] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.867 [2024-10-07 11:33:21.800034] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.867 [2024-10-07 11:33:21.800113] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.867 [2024-10-07 11:33:21.800143] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.867 [2024-10-07 11:33:21.800160] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.867 [2024-10-07 11:33:21.800215] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.867 [2024-10-07 11:33:21.800240] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.867 [2024-10-07 11:33:21.800255] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.867 [2024-10-07 11:33:21.800273] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.867 [2024-10-07 11:33:21.800519] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.867 [2024-10-07 11:33:21.800560] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.867 [2024-10-07 11:33:21.800578] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.867 [2024-10-07 11:33:21.800592] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.867 [2024-10-07 11:33:21.800766] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.867 [2024-10-07 11:33:21.800801] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.867 [2024-10-07 11:33:21.800818] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.867 [2024-10-07 11:33:21.800832] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.867 [2024-10-07 11:33:21.800973] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.867 [2024-10-07 11:33:21.810365] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.867 [2024-10-07 11:33:21.810962] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.867 [2024-10-07 11:33:21.811062] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.867 [2024-10-07 11:33:21.811092] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.867 [2024-10-07 11:33:21.811110] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.867 [2024-10-07 11:33:21.811241] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.867 [2024-10-07 11:33:21.811282] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.867 [2024-10-07 11:33:21.811302] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.867 [2024-10-07 11:33:21.811320] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.867 [2024-10-07 11:33:21.811346] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.868 [2024-10-07 11:33:21.811364] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.868 [2024-10-07 11:33:21.811378] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.868 [2024-10-07 11:33:21.811406] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.868 [2024-10-07 11:33:21.811434] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.868 [2024-10-07 11:33:21.811450] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.868 [2024-10-07 11:33:21.811463] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.868 [2024-10-07 11:33:21.811476] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.868 [2024-10-07 11:33:21.811496] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.868 [2024-10-07 11:33:21.823498] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.868 [2024-10-07 11:33:21.823549] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.868 [2024-10-07 11:33:21.824481] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.868 [2024-10-07 11:33:21.824526] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.868 [2024-10-07 11:33:21.824564] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.868 [2024-10-07 11:33:21.824616] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.868 [2024-10-07 11:33:21.824640] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.868 [2024-10-07 11:33:21.824656] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.868 [2024-10-07 11:33:21.824985] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.868 [2024-10-07 11:33:21.825029] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.868 [2024-10-07 11:33:21.825089] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.868 [2024-10-07 11:33:21.825119] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.868 [2024-10-07 11:33:21.825136] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.868 [2024-10-07 11:33:21.825154] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.868 [2024-10-07 11:33:21.825168] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.868 [2024-10-07 11:33:21.825181] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.868 [2024-10-07 11:33:21.825205] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.868 [2024-10-07 11:33:21.825219] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.868 [2024-10-07 11:33:21.839348] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.868 [2024-10-07 11:33:21.839403] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.868 [2024-10-07 11:33:21.839745] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.868 [2024-10-07 11:33:21.839804] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.868 [2024-10-07 11:33:21.839824] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.868 [2024-10-07 11:33:21.839875] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.868 [2024-10-07 11:33:21.839899] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.868 [2024-10-07 11:33:21.839929] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.868 [2024-10-07 11:33:21.840412] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.868 [2024-10-07 11:33:21.840486] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.868 [2024-10-07 11:33:21.840734] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.868 [2024-10-07 11:33:21.840771] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.868 [2024-10-07 11:33:21.840788] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.868 [2024-10-07 11:33:21.840807] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.868 [2024-10-07 11:33:21.840822] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.868 [2024-10-07 11:33:21.840835] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.868 [2024-10-07 11:33:21.841039] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.868 [2024-10-07 11:33:21.841064] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.868 [2024-10-07 11:33:21.851972] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.868 [2024-10-07 11:33:21.852022] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.868 [2024-10-07 11:33:21.852127] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.868 [2024-10-07 11:33:21.852156] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.868 [2024-10-07 11:33:21.852173] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.868 [2024-10-07 11:33:21.852221] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.868 [2024-10-07 11:33:21.852244] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.868 [2024-10-07 11:33:21.852260] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.868 [2024-10-07 11:33:21.852856] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.868 [2024-10-07 11:33:21.852897] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.868 [2024-10-07 11:33:21.853058] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.868 [2024-10-07 11:33:21.853083] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.868 [2024-10-07 11:33:21.853098] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.868 [2024-10-07 11:33:21.853115] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.868 [2024-10-07 11:33:21.853129] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.868 [2024-10-07 11:33:21.853142] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.868 [2024-10-07 11:33:21.853166] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.868 [2024-10-07 11:33:21.853181] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.868 [2024-10-07 11:33:21.862384] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.868 [2024-10-07 11:33:21.862450] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.868 [2024-10-07 11:33:21.862570] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.868 [2024-10-07 11:33:21.862601] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.868 [2024-10-07 11:33:21.862618] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.868 [2024-10-07 11:33:21.862684] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.868 [2024-10-07 11:33:21.862710] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.868 [2024-10-07 11:33:21.862726] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.868 [2024-10-07 11:33:21.862750] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.868 [2024-10-07 11:33:21.862771] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.868 [2024-10-07 11:33:21.862791] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.868 [2024-10-07 11:33:21.862806] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.868 [2024-10-07 11:33:21.862819] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.868 [2024-10-07 11:33:21.862837] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.868 [2024-10-07 11:33:21.862851] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.868 [2024-10-07 11:33:21.862864] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.868 [2024-10-07 11:33:21.862888] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.868 [2024-10-07 11:33:21.862902] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.868 [2024-10-07 11:33:21.875995] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.868 [2024-10-07 11:33:21.876043] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.868 [2024-10-07 11:33:21.876410] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.868 [2024-10-07 11:33:21.876454] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.868 [2024-10-07 11:33:21.876474] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.868 [2024-10-07 11:33:21.876531] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.868 [2024-10-07 11:33:21.876555] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.868 [2024-10-07 11:33:21.876570] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.868 [2024-10-07 11:33:21.876825] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.868 [2024-10-07 11:33:21.876860] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.868 [2024-10-07 11:33:21.876989] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.868 [2024-10-07 11:33:21.877019] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.868 [2024-10-07 11:33:21.877035] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.868 [2024-10-07 11:33:21.877071] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.868 [2024-10-07 11:33:21.877088] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.868 [2024-10-07 11:33:21.877101] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.868 [2024-10-07 11:33:21.877257] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.868 [2024-10-07 11:33:21.877281] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.869 [2024-10-07 11:33:21.889748] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.869 [2024-10-07 11:33:21.889798] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.869 [2024-10-07 11:33:21.890144] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.869 [2024-10-07 11:33:21.890188] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.869 [2024-10-07 11:33:21.890209] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.869 [2024-10-07 11:33:21.890261] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.869 [2024-10-07 11:33:21.890284] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.869 [2024-10-07 11:33:21.890300] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.869 [2024-10-07 11:33:21.890360] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.869 [2024-10-07 11:33:21.890387] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.869 [2024-10-07 11:33:21.890414] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.869 [2024-10-07 11:33:21.890429] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.869 [2024-10-07 11:33:21.890443] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.869 [2024-10-07 11:33:21.890459] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.869 [2024-10-07 11:33:21.890473] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.869 [2024-10-07 11:33:21.890487] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.869 [2024-10-07 11:33:21.890510] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.869 [2024-10-07 11:33:21.890525] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.869 8778.80 IOPS, 34.29 MiB/s [2024-10-07T11:33:33.392Z] [2024-10-07 11:33:21.902871] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.869 [2024-10-07 11:33:21.902918] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.869 [2024-10-07 11:33:21.903125] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.869 [2024-10-07 11:33:21.903157] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.869 [2024-10-07 11:33:21.903174] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.869 [2024-10-07 11:33:21.903238] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.869 [2024-10-07 11:33:21.903263] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.869 [2024-10-07 11:33:21.903278] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.869 [2024-10-07 11:33:21.903545] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.869 [2024-10-07 11:33:21.903577] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.869 [2024-10-07 11:33:21.904230] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.869 [2024-10-07 11:33:21.904269] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.869 [2024-10-07 11:33:21.904287] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.869 [2024-10-07 11:33:21.904305] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.869 [2024-10-07 11:33:21.904320] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.869 [2024-10-07 11:33:21.904332] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.869 [2024-10-07 11:33:21.904973] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.869 [2024-10-07 11:33:21.905009] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.869 [2024-10-07 11:33:21.912997] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.869 [2024-10-07 11:33:21.913502] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.869 [2024-10-07 11:33:21.913603] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.869 [2024-10-07 11:33:21.913632] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.869 [2024-10-07 11:33:21.913663] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.869 [2024-10-07 11:33:21.913932] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.869 [2024-10-07 11:33:21.913973] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.869 [2024-10-07 11:33:21.913993] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.869 [2024-10-07 11:33:21.914012] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.869 [2024-10-07 11:33:21.914217] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.869 [2024-10-07 11:33:21.914261] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.869 [2024-10-07 11:33:21.914279] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.869 [2024-10-07 11:33:21.914293] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.869 [2024-10-07 11:33:21.914354] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.869 [2024-10-07 11:33:21.914376] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.869 [2024-10-07 11:33:21.914390] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.869 [2024-10-07 11:33:21.914403] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.869 [2024-10-07 11:33:21.914425] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.869 [2024-10-07 11:33:21.926051] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.869 [2024-10-07 11:33:21.926099] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.869 [2024-10-07 11:33:21.926683] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.869 [2024-10-07 11:33:21.926726] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.869 [2024-10-07 11:33:21.926747] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.869 [2024-10-07 11:33:21.926799] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.869 [2024-10-07 11:33:21.926823] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.869 [2024-10-07 11:33:21.926839] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.869 [2024-10-07 11:33:21.926924] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.869 [2024-10-07 11:33:21.926952] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.869 [2024-10-07 11:33:21.926972] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.869 [2024-10-07 11:33:21.926987] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.869 [2024-10-07 11:33:21.927001] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.869 [2024-10-07 11:33:21.927018] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.869 [2024-10-07 11:33:21.927032] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.869 [2024-10-07 11:33:21.927045] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.869 [2024-10-07 11:33:21.927068] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.869 [2024-10-07 11:33:21.927083] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.869 [2024-10-07 11:33:21.936967] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.869 [2024-10-07 11:33:21.937029] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.869 [2024-10-07 11:33:21.937211] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.869 [2024-10-07 11:33:21.937241] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.869 [2024-10-07 11:33:21.937258] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.869 [2024-10-07 11:33:21.937306] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.869 [2024-10-07 11:33:21.937330] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.869 [2024-10-07 11:33:21.937345] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.869 [2024-10-07 11:33:21.937506] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.869 [2024-10-07 11:33:21.937535] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.869 [2024-10-07 11:33:21.937588] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.869 [2024-10-07 11:33:21.937610] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.869 [2024-10-07 11:33:21.937624] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.869 [2024-10-07 11:33:21.937640] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.869 [2024-10-07 11:33:21.937669] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.869 [2024-10-07 11:33:21.937683] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.869 [2024-10-07 11:33:21.937723] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.869 [2024-10-07 11:33:21.937740] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.869 [2024-10-07 11:33:21.948750] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.869 [2024-10-07 11:33:21.948797] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.869 [2024-10-07 11:33:21.948898] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.869 [2024-10-07 11:33:21.948927] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.869 [2024-10-07 11:33:21.948944] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.869 [2024-10-07 11:33:21.948991] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.869 [2024-10-07 11:33:21.949014] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.870 [2024-10-07 11:33:21.949029] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.870 [2024-10-07 11:33:21.949053] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.870 [2024-10-07 11:33:21.949073] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.870 [2024-10-07 11:33:21.949109] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.870 [2024-10-07 11:33:21.949127] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.870 [2024-10-07 11:33:21.949141] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.870 [2024-10-07 11:33:21.949157] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.870 [2024-10-07 11:33:21.949172] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.870 [2024-10-07 11:33:21.949185] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.870 [2024-10-07 11:33:21.949208] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.870 [2024-10-07 11:33:21.949222] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.870 [2024-10-07 11:33:21.960256] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.870 [2024-10-07 11:33:21.960304] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.870 [2024-10-07 11:33:21.960460] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.870 [2024-10-07 11:33:21.960493] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.870 [2024-10-07 11:33:21.960510] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.870 [2024-10-07 11:33:21.960557] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.870 [2024-10-07 11:33:21.960581] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.870 [2024-10-07 11:33:21.960596] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.870 [2024-10-07 11:33:21.960634] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.870 [2024-10-07 11:33:21.960671] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.870 [2024-10-07 11:33:21.960694] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.870 [2024-10-07 11:33:21.960709] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.870 [2024-10-07 11:33:21.960723] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.870 [2024-10-07 11:33:21.960739] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.870 [2024-10-07 11:33:21.960754] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.870 [2024-10-07 11:33:21.960767] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.870 [2024-10-07 11:33:21.960789] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.870 [2024-10-07 11:33:21.960803] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.870 [2024-10-07 11:33:21.974987] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.870 [2024-10-07 11:33:21.975036] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.870 [2024-10-07 11:33:21.975275] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.870 [2024-10-07 11:33:21.975308] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.870 [2024-10-07 11:33:21.975326] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.870 [2024-10-07 11:33:21.975374] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.870 [2024-10-07 11:33:21.975398] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.870 [2024-10-07 11:33:21.975413] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.870 [2024-10-07 11:33:21.975524] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.870 [2024-10-07 11:33:21.975549] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.870 [2024-10-07 11:33:21.977088] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.870 [2024-10-07 11:33:21.977128] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.870 [2024-10-07 11:33:21.977146] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.870 [2024-10-07 11:33:21.977164] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.870 [2024-10-07 11:33:21.977179] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.870 [2024-10-07 11:33:21.977198] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.870 [2024-10-07 11:33:21.977809] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.870 [2024-10-07 11:33:21.977845] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.870 [2024-10-07 11:33:21.985610] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.870 [2024-10-07 11:33:21.985683] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.870 [2024-10-07 11:33:21.985876] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.870 [2024-10-07 11:33:21.985925] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.870 [2024-10-07 11:33:21.985944] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.870 [2024-10-07 11:33:21.985996] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.870 [2024-10-07 11:33:21.986019] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.870 [2024-10-07 11:33:21.986035] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.870 [2024-10-07 11:33:21.986164] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.870 [2024-10-07 11:33:21.986193] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.870 [2024-10-07 11:33:21.986317] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.870 [2024-10-07 11:33:21.986341] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.870 [2024-10-07 11:33:21.986356] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.870 [2024-10-07 11:33:21.986373] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.870 [2024-10-07 11:33:21.986387] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.870 [2024-10-07 11:33:21.986399] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.870 [2024-10-07 11:33:21.986523] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.870 [2024-10-07 11:33:21.986546] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.870 [2024-10-07 11:33:21.996329] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.870 [2024-10-07 11:33:21.996377] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.870 [2024-10-07 11:33:21.996501] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.870 [2024-10-07 11:33:21.996532] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.870 [2024-10-07 11:33:21.996550] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.870 [2024-10-07 11:33:21.996598] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.870 [2024-10-07 11:33:21.996622] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.870 [2024-10-07 11:33:21.996637] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.870 [2024-10-07 11:33:21.996661] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.870 [2024-10-07 11:33:21.996700] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.870 [2024-10-07 11:33:21.996721] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.870 [2024-10-07 11:33:21.996736] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.870 [2024-10-07 11:33:21.996750] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.870 [2024-10-07 11:33:21.996766] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.870 [2024-10-07 11:33:21.996780] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.870 [2024-10-07 11:33:21.996809] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.870 [2024-10-07 11:33:21.996835] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.870 [2024-10-07 11:33:21.996850] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.870 [2024-10-07 11:33:22.009176] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.870 [2024-10-07 11:33:22.009226] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.871 [2024-10-07 11:33:22.009750] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.871 [2024-10-07 11:33:22.009824] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.871 [2024-10-07 11:33:22.009844] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.871 [2024-10-07 11:33:22.009895] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.871 [2024-10-07 11:33:22.009919] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.871 [2024-10-07 11:33:22.009934] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.871 [2024-10-07 11:33:22.010081] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.871 [2024-10-07 11:33:22.010110] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.871 [2024-10-07 11:33:22.010220] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.871 [2024-10-07 11:33:22.010247] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.871 [2024-10-07 11:33:22.010262] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.871 [2024-10-07 11:33:22.010278] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.871 [2024-10-07 11:33:22.010293] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.871 [2024-10-07 11:33:22.010305] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.871 [2024-10-07 11:33:22.010357] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.871 [2024-10-07 11:33:22.010378] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.871 [2024-10-07 11:33:22.021514] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.871 [2024-10-07 11:33:22.021562] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.871 [2024-10-07 11:33:22.021984] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.871 [2024-10-07 11:33:22.022029] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.871 [2024-10-07 11:33:22.022050] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.871 [2024-10-07 11:33:22.022102] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.871 [2024-10-07 11:33:22.022128] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.871 [2024-10-07 11:33:22.022143] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.871 [2024-10-07 11:33:22.022207] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.871 [2024-10-07 11:33:22.022249] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.871 [2024-10-07 11:33:22.022271] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.871 [2024-10-07 11:33:22.022287] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.871 [2024-10-07 11:33:22.022301] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.871 [2024-10-07 11:33:22.022318] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.871 [2024-10-07 11:33:22.022332] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.871 [2024-10-07 11:33:22.022345] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.871 [2024-10-07 11:33:22.022369] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.871 [2024-10-07 11:33:22.022383] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.871 [2024-10-07 11:33:22.033346] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.871 [2024-10-07 11:33:22.033396] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.871 [2024-10-07 11:33:22.033580] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.871 [2024-10-07 11:33:22.033612] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.871 [2024-10-07 11:33:22.033629] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.871 [2024-10-07 11:33:22.033698] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.871 [2024-10-07 11:33:22.033724] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.871 [2024-10-07 11:33:22.033740] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.871 [2024-10-07 11:33:22.035576] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.871 [2024-10-07 11:33:22.035621] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.871 [2024-10-07 11:33:22.036201] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.871 [2024-10-07 11:33:22.036252] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.871 [2024-10-07 11:33:22.036285] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.871 [2024-10-07 11:33:22.036302] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.871 [2024-10-07 11:33:22.036316] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.871 [2024-10-07 11:33:22.036328] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.871 [2024-10-07 11:33:22.036954] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.871 [2024-10-07 11:33:22.036989] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.871 [2024-10-07 11:33:22.044900] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.871 [2024-10-07 11:33:22.044945] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.871 [2024-10-07 11:33:22.045111] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.871 [2024-10-07 11:33:22.045142] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.871 [2024-10-07 11:33:22.045179] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.871 [2024-10-07 11:33:22.045232] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.871 [2024-10-07 11:33:22.045256] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.871 [2024-10-07 11:33:22.045271] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.871 [2024-10-07 11:33:22.045295] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.871 [2024-10-07 11:33:22.045316] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.871 [2024-10-07 11:33:22.045335] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.871 [2024-10-07 11:33:22.045350] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.871 [2024-10-07 11:33:22.045364] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.871 [2024-10-07 11:33:22.045380] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.871 [2024-10-07 11:33:22.045394] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.871 [2024-10-07 11:33:22.045421] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.871 [2024-10-07 11:33:22.045449] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.871 [2024-10-07 11:33:22.045462] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.871 [2024-10-07 11:33:22.055023] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.871 [2024-10-07 11:33:22.055115] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.871 [2024-10-07 11:33:22.055215] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.871 [2024-10-07 11:33:22.055246] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.871 [2024-10-07 11:33:22.055263] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.871 [2024-10-07 11:33:22.057643] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.871 [2024-10-07 11:33:22.057710] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.871 [2024-10-07 11:33:22.057731] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.871 [2024-10-07 11:33:22.057750] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.871 [2024-10-07 11:33:22.058848] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.871 [2024-10-07 11:33:22.058906] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.871 [2024-10-07 11:33:22.058941] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.871 [2024-10-07 11:33:22.058956] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.871 [2024-10-07 11:33:22.059210] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.871 [2024-10-07 11:33:22.059254] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.871 [2024-10-07 11:33:22.059269] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.871 [2024-10-07 11:33:22.059297] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.871 [2024-10-07 11:33:22.061958] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.871 [2024-10-07 11:33:22.066116] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.871 [2024-10-07 11:33:22.066159] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.871 [2024-10-07 11:33:22.066258] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.871 [2024-10-07 11:33:22.066286] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.871 [2024-10-07 11:33:22.066302] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.871 [2024-10-07 11:33:22.066346] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.871 [2024-10-07 11:33:22.066368] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.871 [2024-10-07 11:33:22.066382] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.871 [2024-10-07 11:33:22.066404] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.872 [2024-10-07 11:33:22.066440] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.872 [2024-10-07 11:33:22.066476] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.872 [2024-10-07 11:33:22.066490] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.872 [2024-10-07 11:33:22.066504] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.872 [2024-10-07 11:33:22.066520] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.872 [2024-10-07 11:33:22.066535] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.872 [2024-10-07 11:33:22.066548] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.872 [2024-10-07 11:33:22.066571] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.872 [2024-10-07 11:33:22.066585] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.872 [2024-10-07 11:33:22.077747] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.872 [2024-10-07 11:33:22.077793] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.872 [2024-10-07 11:33:22.078016] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.872 [2024-10-07 11:33:22.078047] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.872 [2024-10-07 11:33:22.078063] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.872 [2024-10-07 11:33:22.078109] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.872 [2024-10-07 11:33:22.078131] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.872 [2024-10-07 11:33:22.078146] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.872 [2024-10-07 11:33:22.078268] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.872 [2024-10-07 11:33:22.078295] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.872 [2024-10-07 11:33:22.078436] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.872 [2024-10-07 11:33:22.078492] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.872 [2024-10-07 11:33:22.078507] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.872 [2024-10-07 11:33:22.078523] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.872 [2024-10-07 11:33:22.078538] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.872 [2024-10-07 11:33:22.078551] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.872 [2024-10-07 11:33:22.078667] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.872 [2024-10-07 11:33:22.078688] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.872 [2024-10-07 11:33:22.088751] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.872 [2024-10-07 11:33:22.088797] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.872 [2024-10-07 11:33:22.089000] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.872 [2024-10-07 11:33:22.089047] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.872 [2024-10-07 11:33:22.089064] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.872 [2024-10-07 11:33:22.089112] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.872 [2024-10-07 11:33:22.089135] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.872 [2024-10-07 11:33:22.089151] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.872 [2024-10-07 11:33:22.089277] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.872 [2024-10-07 11:33:22.089305] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.872 [2024-10-07 11:33:22.089430] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.872 [2024-10-07 11:33:22.089452] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.872 [2024-10-07 11:33:22.089466] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.872 [2024-10-07 11:33:22.089483] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.872 [2024-10-07 11:33:22.089497] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.872 [2024-10-07 11:33:22.089509] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.872 [2024-10-07 11:33:22.089608] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.872 [2024-10-07 11:33:22.089627] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.872 [2024-10-07 11:33:22.099288] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.872 [2024-10-07 11:33:22.099513] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.872 [2024-10-07 11:33:22.099604] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.872 [2024-10-07 11:33:22.099634] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.872 [2024-10-07 11:33:22.099668] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.872 [2024-10-07 11:33:22.099844] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.872 [2024-10-07 11:33:22.099874] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.872 [2024-10-07 11:33:22.099891] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.872 [2024-10-07 11:33:22.099909] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.872 [2024-10-07 11:33:22.100013] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.872 [2024-10-07 11:33:22.100036] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.872 [2024-10-07 11:33:22.100051] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.872 [2024-10-07 11:33:22.100073] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.872 [2024-10-07 11:33:22.100166] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.872 [2024-10-07 11:33:22.100192] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.872 [2024-10-07 11:33:22.100206] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.872 [2024-10-07 11:33:22.100219] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.872 [2024-10-07 11:33:22.100265] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.872 [2024-10-07 11:33:22.110039] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.872 [2024-10-07 11:33:22.110137] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.872 [2024-10-07 11:33:22.110222] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.872 [2024-10-07 11:33:22.110256] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.872 [2024-10-07 11:33:22.110285] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.872 [2024-10-07 11:33:22.110369] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.872 [2024-10-07 11:33:22.110397] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.872 [2024-10-07 11:33:22.110412] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.872 [2024-10-07 11:33:22.110431] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.872 [2024-10-07 11:33:22.110455] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.872 [2024-10-07 11:33:22.110472] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.872 [2024-10-07 11:33:22.110487] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.872 [2024-10-07 11:33:22.110500] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.872 [2024-10-07 11:33:22.110524] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.872 [2024-10-07 11:33:22.110538] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.872 [2024-10-07 11:33:22.110551] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.872 [2024-10-07 11:33:22.110579] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.872 [2024-10-07 11:33:22.110603] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.872 [2024-10-07 11:33:22.123763] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.872 [2024-10-07 11:33:22.123816] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.872 [2024-10-07 11:33:22.124424] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.872 [2024-10-07 11:33:22.124470] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.872 [2024-10-07 11:33:22.124491] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.872 [2024-10-07 11:33:22.124543] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.872 [2024-10-07 11:33:22.124568] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.872 [2024-10-07 11:33:22.124584] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.872 [2024-10-07 11:33:22.124925] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.872 [2024-10-07 11:33:22.124960] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.872 [2024-10-07 11:33:22.125106] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.872 [2024-10-07 11:33:22.125133] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.872 [2024-10-07 11:33:22.125149] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.872 [2024-10-07 11:33:22.125166] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.872 [2024-10-07 11:33:22.125189] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.872 [2024-10-07 11:33:22.125203] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.873 [2024-10-07 11:33:22.125249] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.873 [2024-10-07 11:33:22.125280] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.873 [2024-10-07 11:33:22.137200] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.873 [2024-10-07 11:33:22.137252] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.873 [2024-10-07 11:33:22.137343] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.873 [2024-10-07 11:33:22.137373] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.873 [2024-10-07 11:33:22.137390] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.873 [2024-10-07 11:33:22.137438] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.873 [2024-10-07 11:33:22.137461] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.873 [2024-10-07 11:33:22.137476] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.873 [2024-10-07 11:33:22.137500] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.873 [2024-10-07 11:33:22.137520] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.873 [2024-10-07 11:33:22.137540] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.873 [2024-10-07 11:33:22.137574] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.873 [2024-10-07 11:33:22.137590] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.873 [2024-10-07 11:33:22.137607] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.873 [2024-10-07 11:33:22.137621] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.873 [2024-10-07 11:33:22.137634] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.873 [2024-10-07 11:33:22.137672] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.873 [2024-10-07 11:33:22.137691] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.873 [2024-10-07 11:33:22.149011] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.873 [2024-10-07 11:33:22.149069] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.873 [2024-10-07 11:33:22.149247] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.873 [2024-10-07 11:33:22.149279] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.873 [2024-10-07 11:33:22.149297] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.873 [2024-10-07 11:33:22.149345] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.873 [2024-10-07 11:33:22.149369] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.873 [2024-10-07 11:33:22.149385] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.873 [2024-10-07 11:33:22.150106] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.873 [2024-10-07 11:33:22.150152] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.873 [2024-10-07 11:33:22.150263] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.873 [2024-10-07 11:33:22.150287] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.873 [2024-10-07 11:33:22.150301] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.873 [2024-10-07 11:33:22.150318] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.873 [2024-10-07 11:33:22.150333] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.873 [2024-10-07 11:33:22.150346] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.873 [2024-10-07 11:33:22.150399] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.873 [2024-10-07 11:33:22.150426] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.873 [2024-10-07 11:33:22.162273] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.873 [2024-10-07 11:33:22.162330] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.873 [2024-10-07 11:33:22.162430] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.873 [2024-10-07 11:33:22.162461] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.873 [2024-10-07 11:33:22.162478] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.873 [2024-10-07 11:33:22.162547] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.873 [2024-10-07 11:33:22.162572] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.873 [2024-10-07 11:33:22.162588] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.873 [2024-10-07 11:33:22.162613] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.873 [2024-10-07 11:33:22.162633] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.873 [2024-10-07 11:33:22.162668] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.873 [2024-10-07 11:33:22.162686] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.873 [2024-10-07 11:33:22.162701] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.873 [2024-10-07 11:33:22.162717] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.873 [2024-10-07 11:33:22.162760] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.873 [2024-10-07 11:33:22.162776] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.873 [2024-10-07 11:33:22.162801] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.873 [2024-10-07 11:33:22.162816] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.873 [2024-10-07 11:33:22.176511] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.873 [2024-10-07 11:33:22.176565] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.873 [2024-10-07 11:33:22.176675] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.873 [2024-10-07 11:33:22.176707] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.873 [2024-10-07 11:33:22.176725] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.873 [2024-10-07 11:33:22.176780] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.873 [2024-10-07 11:33:22.176804] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.873 [2024-10-07 11:33:22.176820] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.873 [2024-10-07 11:33:22.176845] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.873 [2024-10-07 11:33:22.176866] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.873 [2024-10-07 11:33:22.176886] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.873 [2024-10-07 11:33:22.176901] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.873 [2024-10-07 11:33:22.176915] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.873 [2024-10-07 11:33:22.176940] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.873 [2024-10-07 11:33:22.176955] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.873 [2024-10-07 11:33:22.176968] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.873 [2024-10-07 11:33:22.176991] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.873 [2024-10-07 11:33:22.177022] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.873 [2024-10-07 11:33:22.186812] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.873 [2024-10-07 11:33:22.186864] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.873 [2024-10-07 11:33:22.189434] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.873 [2024-10-07 11:33:22.189483] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.873 [2024-10-07 11:33:22.189505] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.873 [2024-10-07 11:33:22.189559] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.873 [2024-10-07 11:33:22.189583] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.873 [2024-10-07 11:33:22.189598] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.873 [2024-10-07 11:33:22.191980] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.873 [2024-10-07 11:33:22.192030] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.873 [2024-10-07 11:33:22.192169] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.873 [2024-10-07 11:33:22.192195] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.873 [2024-10-07 11:33:22.192210] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.873 [2024-10-07 11:33:22.192228] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.873 [2024-10-07 11:33:22.192243] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.873 [2024-10-07 11:33:22.192256] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.873 [2024-10-07 11:33:22.193320] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.873 [2024-10-07 11:33:22.193361] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.873 [2024-10-07 11:33:22.196928] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.873 [2024-10-07 11:33:22.196990] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.873 [2024-10-07 11:33:22.197069] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.873 [2024-10-07 11:33:22.197099] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.873 [2024-10-07 11:33:22.197116] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.873 [2024-10-07 11:33:22.197171] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.873 [2024-10-07 11:33:22.197207] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.873 [2024-10-07 11:33:22.197232] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.873 [2024-10-07 11:33:22.197252] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.873 [2024-10-07 11:33:22.197277] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.873 [2024-10-07 11:33:22.197295] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.874 [2024-10-07 11:33:22.197308] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.874 [2024-10-07 11:33:22.197342] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.874 [2024-10-07 11:33:22.197368] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.874 [2024-10-07 11:33:22.197383] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.874 [2024-10-07 11:33:22.197397] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.874 [2024-10-07 11:33:22.197410] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.874 [2024-10-07 11:33:22.197430] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.874 [2024-10-07 11:33:22.207268] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.874 [2024-10-07 11:33:22.207319] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.874 [2024-10-07 11:33:22.207410] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.874 [2024-10-07 11:33:22.207441] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.874 [2024-10-07 11:33:22.207458] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.874 [2024-10-07 11:33:22.207506] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.874 [2024-10-07 11:33:22.207529] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.874 [2024-10-07 11:33:22.207544] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.874 [2024-10-07 11:33:22.207568] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.874 [2024-10-07 11:33:22.207588] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.874 [2024-10-07 11:33:22.207608] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.874 [2024-10-07 11:33:22.207623] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.874 [2024-10-07 11:33:22.207637] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.874 [2024-10-07 11:33:22.207670] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.874 [2024-10-07 11:33:22.207688] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.874 [2024-10-07 11:33:22.207701] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.874 [2024-10-07 11:33:22.207725] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.874 [2024-10-07 11:33:22.207740] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.874 [2024-10-07 11:33:22.217927] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.874 [2024-10-07 11:33:22.217979] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.874 [2024-10-07 11:33:22.218375] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.874 [2024-10-07 11:33:22.218419] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.874 [2024-10-07 11:33:22.218439] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.874 [2024-10-07 11:33:22.218534] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.874 [2024-10-07 11:33:22.218560] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.874 [2024-10-07 11:33:22.218590] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.874 [2024-10-07 11:33:22.218787] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.874 [2024-10-07 11:33:22.218821] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.874 [2024-10-07 11:33:22.219555] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.874 [2024-10-07 11:33:22.219595] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.874 [2024-10-07 11:33:22.219613] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.874 [2024-10-07 11:33:22.219631] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.874 [2024-10-07 11:33:22.219645] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.874 [2024-10-07 11:33:22.219675] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.874 [2024-10-07 11:33:22.222168] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.874 [2024-10-07 11:33:22.222209] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.874 [2024-10-07 11:33:22.228050] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.874 [2024-10-07 11:33:22.228115] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.874 [2024-10-07 11:33:22.228205] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.874 [2024-10-07 11:33:22.228234] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.874 [2024-10-07 11:33:22.228251] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.874 [2024-10-07 11:33:22.228310] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.874 [2024-10-07 11:33:22.228335] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.874 [2024-10-07 11:33:22.228350] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.874 [2024-10-07 11:33:22.228368] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.874 [2024-10-07 11:33:22.228392] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.874 [2024-10-07 11:33:22.228410] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.874 [2024-10-07 11:33:22.228424] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.874 [2024-10-07 11:33:22.228437] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.874 [2024-10-07 11:33:22.228461] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.874 [2024-10-07 11:33:22.228475] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.874 [2024-10-07 11:33:22.228488] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.874 [2024-10-07 11:33:22.228502] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.874 [2024-10-07 11:33:22.228522] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.874 [2024-10-07 11:33:22.238247] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.874 [2024-10-07 11:33:22.238298] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.874 [2024-10-07 11:33:22.238386] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.874 [2024-10-07 11:33:22.238416] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.874 [2024-10-07 11:33:22.238444] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.874 [2024-10-07 11:33:22.238516] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.874 [2024-10-07 11:33:22.238548] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.874 [2024-10-07 11:33:22.238564] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.874 [2024-10-07 11:33:22.238589] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.874 [2024-10-07 11:33:22.238610] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.874 [2024-10-07 11:33:22.238660] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.874 [2024-10-07 11:33:22.238682] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.874 [2024-10-07 11:33:22.238696] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.874 [2024-10-07 11:33:22.238713] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.874 [2024-10-07 11:33:22.238727] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.874 [2024-10-07 11:33:22.238741] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.874 [2024-10-07 11:33:22.238764] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.874 [2024-10-07 11:33:22.238779] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.874 [2024-10-07 11:33:22.248785] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.874 [2024-10-07 11:33:22.248837] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.874 [2024-10-07 11:33:22.249033] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.874 [2024-10-07 11:33:22.249067] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.874 [2024-10-07 11:33:22.249084] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.874 [2024-10-07 11:33:22.249134] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.874 [2024-10-07 11:33:22.249158] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.874 [2024-10-07 11:33:22.249173] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.874 [2024-10-07 11:33:22.249250] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.874 [2024-10-07 11:33:22.249280] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.874 [2024-10-07 11:33:22.249326] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.874 [2024-10-07 11:33:22.249347] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.874 [2024-10-07 11:33:22.249380] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.874 [2024-10-07 11:33:22.249400] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.875 [2024-10-07 11:33:22.249415] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.875 [2024-10-07 11:33:22.249428] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.875 [2024-10-07 11:33:22.249452] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.875 [2024-10-07 11:33:22.249466] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.875 [2024-10-07 11:33:22.259059] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.875 [2024-10-07 11:33:22.259111] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.875 [2024-10-07 11:33:22.260429] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.875 [2024-10-07 11:33:22.260476] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.875 [2024-10-07 11:33:22.260497] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.875 [2024-10-07 11:33:22.260549] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.875 [2024-10-07 11:33:22.260573] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.875 [2024-10-07 11:33:22.260589] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.875 [2024-10-07 11:33:22.262161] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.875 [2024-10-07 11:33:22.262208] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.875 [2024-10-07 11:33:22.262624] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.875 [2024-10-07 11:33:22.262673] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.875 [2024-10-07 11:33:22.262693] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.875 [2024-10-07 11:33:22.262711] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.875 [2024-10-07 11:33:22.262726] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.875 [2024-10-07 11:33:22.262738] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.875 [2024-10-07 11:33:22.262811] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.875 [2024-10-07 11:33:22.262832] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.875 [2024-10-07 11:33:22.269175] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.875 [2024-10-07 11:33:22.269257] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.875 [2024-10-07 11:33:22.269337] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.875 [2024-10-07 11:33:22.269366] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.875 [2024-10-07 11:33:22.269383] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.875 [2024-10-07 11:33:22.269439] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.875 [2024-10-07 11:33:22.269464] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.875 [2024-10-07 11:33:22.269505] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.875 [2024-10-07 11:33:22.269525] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.875 [2024-10-07 11:33:22.269552] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.875 [2024-10-07 11:33:22.269582] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.875 [2024-10-07 11:33:22.269607] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.875 [2024-10-07 11:33:22.269626] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.875 [2024-10-07 11:33:22.269666] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.875 [2024-10-07 11:33:22.269685] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.875 [2024-10-07 11:33:22.269699] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.875 [2024-10-07 11:33:22.269712] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.875 [2024-10-07 11:33:22.269733] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.875 [2024-10-07 11:33:22.279276] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.875 [2024-10-07 11:33:22.279412] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.875 [2024-10-07 11:33:22.279451] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.875 [2024-10-07 11:33:22.279470] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.875 [2024-10-07 11:33:22.279509] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.875 [2024-10-07 11:33:22.279539] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.875 [2024-10-07 11:33:22.279567] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.875 [2024-10-07 11:33:22.279583] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.875 [2024-10-07 11:33:22.279596] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.875 [2024-10-07 11:33:22.279618] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.875 [2024-10-07 11:33:22.279698] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.875 [2024-10-07 11:33:22.279726] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.875 [2024-10-07 11:33:22.279742] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.875 [2024-10-07 11:33:22.279766] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.875 [2024-10-07 11:33:22.279788] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.875 [2024-10-07 11:33:22.279802] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.875 [2024-10-07 11:33:22.279816] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.875 [2024-10-07 11:33:22.279838] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.875 [2024-10-07 11:33:22.291410] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.875 [2024-10-07 11:33:22.291481] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.875 [2024-10-07 11:33:22.291573] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.875 [2024-10-07 11:33:22.291604] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.875 [2024-10-07 11:33:22.291622] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.875 [2024-10-07 11:33:22.291686] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.875 [2024-10-07 11:33:22.291711] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.875 [2024-10-07 11:33:22.291727] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.875 [2024-10-07 11:33:22.291751] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.875 [2024-10-07 11:33:22.291771] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.875 [2024-10-07 11:33:22.291810] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.875 [2024-10-07 11:33:22.291829] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.875 [2024-10-07 11:33:22.291843] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.875 [2024-10-07 11:33:22.291860] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.875 [2024-10-07 11:33:22.291874] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.875 [2024-10-07 11:33:22.291887] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.875 [2024-10-07 11:33:22.291910] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.875 [2024-10-07 11:33:22.291925] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.875 [2024-10-07 11:33:22.305856] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.875 [2024-10-07 11:33:22.305910] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.875 [2024-10-07 11:33:22.306008] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.875 [2024-10-07 11:33:22.306038] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.875 [2024-10-07 11:33:22.306055] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.875 [2024-10-07 11:33:22.306103] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.875 [2024-10-07 11:33:22.306127] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.875 [2024-10-07 11:33:22.306142] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.875 [2024-10-07 11:33:22.306166] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.875 [2024-10-07 11:33:22.306186] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.875 [2024-10-07 11:33:22.306206] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.875 [2024-10-07 11:33:22.306220] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.875 [2024-10-07 11:33:22.306233] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.875 [2024-10-07 11:33:22.306266] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.875 [2024-10-07 11:33:22.306293] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.875 [2024-10-07 11:33:22.306319] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.875 [2024-10-07 11:33:22.306354] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.875 [2024-10-07 11:33:22.306373] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.875 [2024-10-07 11:33:22.318176] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.875 [2024-10-07 11:33:22.318228] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.875 [2024-10-07 11:33:22.318421] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.875 [2024-10-07 11:33:22.318467] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.875 [2024-10-07 11:33:22.318498] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.875 [2024-10-07 11:33:22.318570] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.875 [2024-10-07 11:33:22.318598] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.875 [2024-10-07 11:33:22.318614] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.875 [2024-10-07 11:33:22.318784] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.875 [2024-10-07 11:33:22.318816] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.875 [2024-10-07 11:33:22.318940] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.876 [2024-10-07 11:33:22.318962] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.876 [2024-10-07 11:33:22.318977] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.876 [2024-10-07 11:33:22.318994] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.876 [2024-10-07 11:33:22.319008] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.876 [2024-10-07 11:33:22.319021] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.876 [2024-10-07 11:33:22.319126] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.876 [2024-10-07 11:33:22.319145] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.876 [2024-10-07 11:33:22.328670] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.876 [2024-10-07 11:33:22.328716] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.876 [2024-10-07 11:33:22.328882] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.876 [2024-10-07 11:33:22.328914] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.876 [2024-10-07 11:33:22.328931] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.876 [2024-10-07 11:33:22.328980] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.876 [2024-10-07 11:33:22.329004] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.876 [2024-10-07 11:33:22.329019] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.876 [2024-10-07 11:33:22.329906] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.876 [2024-10-07 11:33:22.329951] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.876 [2024-10-07 11:33:22.331594] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.876 [2024-10-07 11:33:22.331635] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.876 [2024-10-07 11:33:22.331675] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.876 [2024-10-07 11:33:22.331695] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.876 [2024-10-07 11:33:22.331710] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.876 [2024-10-07 11:33:22.331723] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.876 [2024-10-07 11:33:22.331780] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.876 [2024-10-07 11:33:22.331801] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.876 [2024-10-07 11:33:22.338780] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.876 [2024-10-07 11:33:22.338852] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.876 [2024-10-07 11:33:22.338929] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.876 [2024-10-07 11:33:22.338958] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.876 [2024-10-07 11:33:22.338975] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.876 [2024-10-07 11:33:22.339031] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.876 [2024-10-07 11:33:22.339056] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.876 [2024-10-07 11:33:22.339072] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.876 [2024-10-07 11:33:22.339091] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.876 [2024-10-07 11:33:22.339115] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.876 [2024-10-07 11:33:22.339132] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.876 [2024-10-07 11:33:22.339146] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.876 [2024-10-07 11:33:22.339159] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.876 [2024-10-07 11:33:22.339182] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.876 [2024-10-07 11:33:22.339216] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.876 [2024-10-07 11:33:22.339230] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.876 [2024-10-07 11:33:22.339243] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.876 [2024-10-07 11:33:22.339264] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.876 [2024-10-07 11:33:22.351065] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.876 [2024-10-07 11:33:22.351116] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.876 [2024-10-07 11:33:22.351485] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.876 [2024-10-07 11:33:22.351550] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.876 [2024-10-07 11:33:22.351571] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.876 [2024-10-07 11:33:22.351623] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.876 [2024-10-07 11:33:22.351663] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.876 [2024-10-07 11:33:22.351682] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.876 [2024-10-07 11:33:22.351811] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.876 [2024-10-07 11:33:22.351842] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.876 [2024-10-07 11:33:22.351863] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.876 [2024-10-07 11:33:22.351878] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.876 [2024-10-07 11:33:22.351892] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.876 [2024-10-07 11:33:22.351909] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.876 [2024-10-07 11:33:22.351924] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.876 [2024-10-07 11:33:22.351936] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.876 [2024-10-07 11:33:22.351959] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.876 [2024-10-07 11:33:22.351974] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.876 [2024-10-07 11:33:22.367266] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.876 [2024-10-07 11:33:22.367756] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.876 [2024-10-07 11:33:22.367859] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.876 [2024-10-07 11:33:22.367890] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.876 [2024-10-07 11:33:22.367907] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.876 [2024-10-07 11:33:22.368890] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.876 [2024-10-07 11:33:22.368936] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.876 [2024-10-07 11:33:22.368957] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.876 [2024-10-07 11:33:22.368977] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.876 [2024-10-07 11:33:22.369207] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.876 [2024-10-07 11:33:22.369237] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.876 [2024-10-07 11:33:22.369252] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.876 [2024-10-07 11:33:22.369266] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.876 [2024-10-07 11:33:22.369390] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.876 [2024-10-07 11:33:22.369434] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.876 [2024-10-07 11:33:22.369456] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.876 [2024-10-07 11:33:22.369470] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.876 [2024-10-07 11:33:22.369634] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.876 [2024-10-07 11:33:22.377928] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.876 [2024-10-07 11:33:22.378538] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.876 [2024-10-07 11:33:22.378640] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.876 [2024-10-07 11:33:22.378697] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.876 [2024-10-07 11:33:22.378716] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.876 [2024-10-07 11:33:22.378960] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.876 [2024-10-07 11:33:22.378990] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.876 [2024-10-07 11:33:22.379006] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.876 [2024-10-07 11:33:22.379025] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.876 [2024-10-07 11:33:22.379154] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.876 [2024-10-07 11:33:22.379180] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.876 [2024-10-07 11:33:22.379209] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.876 [2024-10-07 11:33:22.379225] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.876 [2024-10-07 11:33:22.380307] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.876 [2024-10-07 11:33:22.380350] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.876 [2024-10-07 11:33:22.380367] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.876 [2024-10-07 11:33:22.380381] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.876 [2024-10-07 11:33:22.382365] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.876 [2024-10-07 11:33:22.389506] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.876 [2024-10-07 11:33:22.389556] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.876 [2024-10-07 11:33:22.389764] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.876 [2024-10-07 11:33:22.389797] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.876 [2024-10-07 11:33:22.389814] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.876 [2024-10-07 11:33:22.389875] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.876 [2024-10-07 11:33:22.389906] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.876 [2024-10-07 11:33:22.389922] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.876 [2024-10-07 11:33:22.390059] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.876 [2024-10-07 11:33:22.390106] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.876 [2024-10-07 11:33:22.390233] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.876 [2024-10-07 11:33:22.390258] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.876 [2024-10-07 11:33:22.390273] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.876 [2024-10-07 11:33:22.390291] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.876 [2024-10-07 11:33:22.390305] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.877 [2024-10-07 11:33:22.390317] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.877 [2024-10-07 11:33:22.391073] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.877 [2024-10-07 11:33:22.391113] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.877 [2024-10-07 11:33:22.399806] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.877 [2024-10-07 11:33:22.399869] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.877 [2024-10-07 11:33:22.399997] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.877 [2024-10-07 11:33:22.400030] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.877 [2024-10-07 11:33:22.400047] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.877 [2024-10-07 11:33:22.400099] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.877 [2024-10-07 11:33:22.400124] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.877 [2024-10-07 11:33:22.400139] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.877 [2024-10-07 11:33:22.400319] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.877 [2024-10-07 11:33:22.400350] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.877 [2024-10-07 11:33:22.400406] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.877 [2024-10-07 11:33:22.400428] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.877 [2024-10-07 11:33:22.400442] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.877 [2024-10-07 11:33:22.400460] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.877 [2024-10-07 11:33:22.400474] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.877 [2024-10-07 11:33:22.400487] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.877 [2024-10-07 11:33:22.400510] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.877 [2024-10-07 11:33:22.400524] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.877 [2024-10-07 11:33:22.412832] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.877 [2024-10-07 11:33:22.412884] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.877 [2024-10-07 11:33:22.413129] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.877 [2024-10-07 11:33:22.413188] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.877 [2024-10-07 11:33:22.413210] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.877 [2024-10-07 11:33:22.413264] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.877 [2024-10-07 11:33:22.413288] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.877 [2024-10-07 11:33:22.413304] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.877 [2024-10-07 11:33:22.413418] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.877 [2024-10-07 11:33:22.413446] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.877 [2024-10-07 11:33:22.413544] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.877 [2024-10-07 11:33:22.413564] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.877 [2024-10-07 11:33:22.413578] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.877 [2024-10-07 11:33:22.413596] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.877 [2024-10-07 11:33:22.413610] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.877 [2024-10-07 11:33:22.413623] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.877 [2024-10-07 11:33:22.413953] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.877 [2024-10-07 11:33:22.413984] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.877 [2024-10-07 11:33:22.424644] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.877 [2024-10-07 11:33:22.424711] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.877 [2024-10-07 11:33:22.424922] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.877 [2024-10-07 11:33:22.424961] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.877 [2024-10-07 11:33:22.424980] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.877 [2024-10-07 11:33:22.425031] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.877 [2024-10-07 11:33:22.425055] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.877 [2024-10-07 11:33:22.425070] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.877 [2024-10-07 11:33:22.425225] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.877 [2024-10-07 11:33:22.425256] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.877 [2024-10-07 11:33:22.425379] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.877 [2024-10-07 11:33:22.425403] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.877 [2024-10-07 11:33:22.425418] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.877 [2024-10-07 11:33:22.425435] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.877 [2024-10-07 11:33:22.425454] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.877 [2024-10-07 11:33:22.425501] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.877 [2024-10-07 11:33:22.425623] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.877 [2024-10-07 11:33:22.425645] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.877 [2024-10-07 11:33:22.434777] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.877 [2024-10-07 11:33:22.434856] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.877 [2024-10-07 11:33:22.434940] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.877 [2024-10-07 11:33:22.434970] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.877 [2024-10-07 11:33:22.434987] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.877 [2024-10-07 11:33:22.435042] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.877 [2024-10-07 11:33:22.435067] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.877 [2024-10-07 11:33:22.435083] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.877 [2024-10-07 11:33:22.435101] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.877 [2024-10-07 11:33:22.435166] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.877 [2024-10-07 11:33:22.435201] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.877 [2024-10-07 11:33:22.435219] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.877 [2024-10-07 11:33:22.435232] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.877 [2024-10-07 11:33:22.435257] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.877 [2024-10-07 11:33:22.435272] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.877 [2024-10-07 11:33:22.435285] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.877 [2024-10-07 11:33:22.435298] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.877 [2024-10-07 11:33:22.435318] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.877 [2024-10-07 11:33:22.448888] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.877 [2024-10-07 11:33:22.448943] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.877 [2024-10-07 11:33:22.449153] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.877 [2024-10-07 11:33:22.449201] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.877 [2024-10-07 11:33:22.449229] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.877 [2024-10-07 11:33:22.449316] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.877 [2024-10-07 11:33:22.449343] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.877 [2024-10-07 11:33:22.449359] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.877 [2024-10-07 11:33:22.449527] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.877 [2024-10-07 11:33:22.449557] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.877 [2024-10-07 11:33:22.449631] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.877 [2024-10-07 11:33:22.449675] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.877 [2024-10-07 11:33:22.449691] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.877 [2024-10-07 11:33:22.449709] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.877 [2024-10-07 11:33:22.449723] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.877 [2024-10-07 11:33:22.449736] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.877 [2024-10-07 11:33:22.449761] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.877 [2024-10-07 11:33:22.449776] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.877 [2024-10-07 11:33:22.463437] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.877 [2024-10-07 11:33:22.463493] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.877 [2024-10-07 11:33:22.463821] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.877 [2024-10-07 11:33:22.463865] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.877 [2024-10-07 11:33:22.463884] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.877 [2024-10-07 11:33:22.463935] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.877 [2024-10-07 11:33:22.463959] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.877 [2024-10-07 11:33:22.463975] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.877 [2024-10-07 11:33:22.465041] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.877 [2024-10-07 11:33:22.465088] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.877 [2024-10-07 11:33:22.465747] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.877 [2024-10-07 11:33:22.465787] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.877 [2024-10-07 11:33:22.465805] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.877 [2024-10-07 11:33:22.465823] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.877 [2024-10-07 11:33:22.465838] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.877 [2024-10-07 11:33:22.465851] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.877 [2024-10-07 11:33:22.466089] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.877 [2024-10-07 11:33:22.466115] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.877 [2024-10-07 11:33:22.474834] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.877 [2024-10-07 11:33:22.474907] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.877 [2024-10-07 11:33:22.475145] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.878 [2024-10-07 11:33:22.475178] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.878 [2024-10-07 11:33:22.475226] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.878 [2024-10-07 11:33:22.475308] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.878 [2024-10-07 11:33:22.475338] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.878 [2024-10-07 11:33:22.475355] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.878 [2024-10-07 11:33:22.475477] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.878 [2024-10-07 11:33:22.475505] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.878 [2024-10-07 11:33:22.475604] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.878 [2024-10-07 11:33:22.475623] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.878 [2024-10-07 11:33:22.475637] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.878 [2024-10-07 11:33:22.475670] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.878 [2024-10-07 11:33:22.475688] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.878 [2024-10-07 11:33:22.475701] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.878 [2024-10-07 11:33:22.475820] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.878 [2024-10-07 11:33:22.475840] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.878 [2024-10-07 11:33:22.485890] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.878 [2024-10-07 11:33:22.485940] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.878 [2024-10-07 11:33:22.486030] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.878 [2024-10-07 11:33:22.486060] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.878 [2024-10-07 11:33:22.486076] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.878 [2024-10-07 11:33:22.486125] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.878 [2024-10-07 11:33:22.486148] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.878 [2024-10-07 11:33:22.486163] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.878 [2024-10-07 11:33:22.486186] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.878 [2024-10-07 11:33:22.486239] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.878 [2024-10-07 11:33:22.486267] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.878 [2024-10-07 11:33:22.486283] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.878 [2024-10-07 11:33:22.486297] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.878 [2024-10-07 11:33:22.486313] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.878 [2024-10-07 11:33:22.486328] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.878 [2024-10-07 11:33:22.486340] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.878 [2024-10-07 11:33:22.486381] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.878 [2024-10-07 11:33:22.486397] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.878 [2024-10-07 11:33:22.498060] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.878 [2024-10-07 11:33:22.498113] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.878 [2024-10-07 11:33:22.498258] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.878 [2024-10-07 11:33:22.498291] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.878 [2024-10-07 11:33:22.498308] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.878 [2024-10-07 11:33:22.498357] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.878 [2024-10-07 11:33:22.498381] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.878 [2024-10-07 11:33:22.498396] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.878 [2024-10-07 11:33:22.498421] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.878 [2024-10-07 11:33:22.498443] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.878 [2024-10-07 11:33:22.498463] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.878 [2024-10-07 11:33:22.498477] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.878 [2024-10-07 11:33:22.498509] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.878 [2024-10-07 11:33:22.498541] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.878 [2024-10-07 11:33:22.498565] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.878 [2024-10-07 11:33:22.498586] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.878 [2024-10-07 11:33:22.498619] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.878 [2024-10-07 11:33:22.498634] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.878 [2024-10-07 11:33:22.508181] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.878 [2024-10-07 11:33:22.509047] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.878 [2024-10-07 11:33:22.509149] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.878 [2024-10-07 11:33:22.509179] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.878 [2024-10-07 11:33:22.509196] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.878 [2024-10-07 11:33:22.511240] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.878 [2024-10-07 11:33:22.511280] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.878 [2024-10-07 11:33:22.511299] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.878 [2024-10-07 11:33:22.511319] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.878 [2024-10-07 11:33:22.511978] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.878 [2024-10-07 11:33:22.512037] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.878 [2024-10-07 11:33:22.512057] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.878 [2024-10-07 11:33:22.512071] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.878 [2024-10-07 11:33:22.512167] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.878 [2024-10-07 11:33:22.512189] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.878 [2024-10-07 11:33:22.512203] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.878 [2024-10-07 11:33:22.512216] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.878 [2024-10-07 11:33:22.512238] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.878 [2024-10-07 11:33:22.518509] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.878 [2024-10-07 11:33:22.518714] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.878 [2024-10-07 11:33:22.518747] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.878 [2024-10-07 11:33:22.518764] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.878 [2024-10-07 11:33:22.519256] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.878 [2024-10-07 11:33:22.519349] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.878 [2024-10-07 11:33:22.519374] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.878 [2024-10-07 11:33:22.519388] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.878 [2024-10-07 11:33:22.519414] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.878 [2024-10-07 11:33:22.519434] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.878 [2024-10-07 11:33:22.519502] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.878 [2024-10-07 11:33:22.519541] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.878 [2024-10-07 11:33:22.519557] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.878 [2024-10-07 11:33:22.522358] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.878 [2024-10-07 11:33:22.522825] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.878 [2024-10-07 11:33:22.522862] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.878 [2024-10-07 11:33:22.522880] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.878 [2024-10-07 11:33:22.523221] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.878 [2024-10-07 11:33:22.528800] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.878 [2024-10-07 11:33:22.528905] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.878 [2024-10-07 11:33:22.528935] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.878 [2024-10-07 11:33:22.528952] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.878 [2024-10-07 11:33:22.528976] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.878 [2024-10-07 11:33:22.529016] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.878 [2024-10-07 11:33:22.529031] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.878 [2024-10-07 11:33:22.529045] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.878 [2024-10-07 11:33:22.529068] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.878 [2024-10-07 11:33:22.529793] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.878 [2024-10-07 11:33:22.529894] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.878 [2024-10-07 11:33:22.529924] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.879 [2024-10-07 11:33:22.529940] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.879 [2024-10-07 11:33:22.529963] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.879 [2024-10-07 11:33:22.529986] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.879 [2024-10-07 11:33:22.530001] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.879 [2024-10-07 11:33:22.530014] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.879 [2024-10-07 11:33:22.530037] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.879 [2024-10-07 11:33:22.539401] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.879 [2024-10-07 11:33:22.539601] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.879 [2024-10-07 11:33:22.539633] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.879 [2024-10-07 11:33:22.539666] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.879 [2024-10-07 11:33:22.539776] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.879 [2024-10-07 11:33:22.539880] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.879 [2024-10-07 11:33:22.539900] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.879 [2024-10-07 11:33:22.539914] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.879 [2024-10-07 11:33:22.540299] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.879 [2024-10-07 11:33:22.540388] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.879 [2024-10-07 11:33:22.540471] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.879 [2024-10-07 11:33:22.540501] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.879 [2024-10-07 11:33:22.540524] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.879 [2024-10-07 11:33:22.542707] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.879 [2024-10-07 11:33:22.543521] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.879 [2024-10-07 11:33:22.543559] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.879 [2024-10-07 11:33:22.543576] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.879 [2024-10-07 11:33:22.543737] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.879 [2024-10-07 11:33:22.549541] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.879 [2024-10-07 11:33:22.549660] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.879 [2024-10-07 11:33:22.549691] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.879 [2024-10-07 11:33:22.549708] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.879 [2024-10-07 11:33:22.549732] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.879 [2024-10-07 11:33:22.549755] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.879 [2024-10-07 11:33:22.549769] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.879 [2024-10-07 11:33:22.549783] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.879 [2024-10-07 11:33:22.549806] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.879 [2024-10-07 11:33:22.550443] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.879 [2024-10-07 11:33:22.550527] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.879 [2024-10-07 11:33:22.550555] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.879 [2024-10-07 11:33:22.550571] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.879 [2024-10-07 11:33:22.555049] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.879 [2024-10-07 11:33:22.557380] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.879 [2024-10-07 11:33:22.557421] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.879 [2024-10-07 11:33:22.557440] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.879 [2024-10-07 11:33:22.557551] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.879 [2024-10-07 11:33:22.559619] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.879 [2024-10-07 11:33:22.559734] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.879 [2024-10-07 11:33:22.559765] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.879 [2024-10-07 11:33:22.559781] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.879 [2024-10-07 11:33:22.559805] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.879 [2024-10-07 11:33:22.559827] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.879 [2024-10-07 11:33:22.559841] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.879 [2024-10-07 11:33:22.559854] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.879 [2024-10-07 11:33:22.559878] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.879 [2024-10-07 11:33:22.560498] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.879 [2024-10-07 11:33:22.560583] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.879 [2024-10-07 11:33:22.560611] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.879 [2024-10-07 11:33:22.560645] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.879 [2024-10-07 11:33:22.560685] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.879 [2024-10-07 11:33:22.560708] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.879 [2024-10-07 11:33:22.560722] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.879 [2024-10-07 11:33:22.560735] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.879 [2024-10-07 11:33:22.560758] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.879 [2024-10-07 11:33:22.571944] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.879 [2024-10-07 11:33:22.572232] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.879 [2024-10-07 11:33:22.572337] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.879 [2024-10-07 11:33:22.572368] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.879 [2024-10-07 11:33:22.572385] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.879 [2024-10-07 11:33:22.572627] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.879 [2024-10-07 11:33:22.572692] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.879 [2024-10-07 11:33:22.572713] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.879 [2024-10-07 11:33:22.572733] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.879 [2024-10-07 11:33:22.572794] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.879 [2024-10-07 11:33:22.572818] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.879 [2024-10-07 11:33:22.572833] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.879 [2024-10-07 11:33:22.572847] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.879 [2024-10-07 11:33:22.572889] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.879 [2024-10-07 11:33:22.572908] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.879 [2024-10-07 11:33:22.572921] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.879 [2024-10-07 11:33:22.572935] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.879 [2024-10-07 11:33:22.572956] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.879 [2024-10-07 11:33:22.584867] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.879 [2024-10-07 11:33:22.584918] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.879 [2024-10-07 11:33:22.585010] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.879 [2024-10-07 11:33:22.585039] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.879 [2024-10-07 11:33:22.585056] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.879 [2024-10-07 11:33:22.585104] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.879 [2024-10-07 11:33:22.585141] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.879 [2024-10-07 11:33:22.585158] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.879 [2024-10-07 11:33:22.585743] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.879 [2024-10-07 11:33:22.585785] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.879 [2024-10-07 11:33:22.585902] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.879 [2024-10-07 11:33:22.585927] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.879 [2024-10-07 11:33:22.585941] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.879 [2024-10-07 11:33:22.585958] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.879 [2024-10-07 11:33:22.585973] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.879 [2024-10-07 11:33:22.585985] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.879 [2024-10-07 11:33:22.586009] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.879 [2024-10-07 11:33:22.586023] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.879 [2024-10-07 11:33:22.595550] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.879 [2024-10-07 11:33:22.595605] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.879 [2024-10-07 11:33:22.595815] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.879 [2024-10-07 11:33:22.595847] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.879 [2024-10-07 11:33:22.595864] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.879 [2024-10-07 11:33:22.595912] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.879 [2024-10-07 11:33:22.595936] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.879 [2024-10-07 11:33:22.595951] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.879 [2024-10-07 11:33:22.596074] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.879 [2024-10-07 11:33:22.596102] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.879 [2024-10-07 11:33:22.596201] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.879 [2024-10-07 11:33:22.596219] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.879 [2024-10-07 11:33:22.596234] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.879 [2024-10-07 11:33:22.596251] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.879 [2024-10-07 11:33:22.596265] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.879 [2024-10-07 11:33:22.596286] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.879 [2024-10-07 11:33:22.596389] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.879 [2024-10-07 11:33:22.596409] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.880 [2024-10-07 11:33:22.605923] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.880 [2024-10-07 11:33:22.605971] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.880 [2024-10-07 11:33:22.606154] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.880 [2024-10-07 11:33:22.606186] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.880 [2024-10-07 11:33:22.606203] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.880 [2024-10-07 11:33:22.606251] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.880 [2024-10-07 11:33:22.606274] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.880 [2024-10-07 11:33:22.606289] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.880 [2024-10-07 11:33:22.606391] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.880 [2024-10-07 11:33:22.606416] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.880 [2024-10-07 11:33:22.608366] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.880 [2024-10-07 11:33:22.608407] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.880 [2024-10-07 11:33:22.608425] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.880 [2024-10-07 11:33:22.608443] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.880 [2024-10-07 11:33:22.608457] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.880 [2024-10-07 11:33:22.608470] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.880 [2024-10-07 11:33:22.610419] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.880 [2024-10-07 11:33:22.610459] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.880 [2024-10-07 11:33:22.616136] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.880 [2024-10-07 11:33:22.616184] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.880 [2024-10-07 11:33:22.616271] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.880 [2024-10-07 11:33:22.616301] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.880 [2024-10-07 11:33:22.616318] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.880 [2024-10-07 11:33:22.616365] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.880 [2024-10-07 11:33:22.616387] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.880 [2024-10-07 11:33:22.616403] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.880 [2024-10-07 11:33:22.616427] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.880 [2024-10-07 11:33:22.616447] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.880 [2024-10-07 11:33:22.616481] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.880 [2024-10-07 11:33:22.616498] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.880 [2024-10-07 11:33:22.616541] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.880 [2024-10-07 11:33:22.616558] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.880 [2024-10-07 11:33:22.616573] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.880 [2024-10-07 11:33:22.616586] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.880 [2024-10-07 11:33:22.616609] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.880 [2024-10-07 11:33:22.616623] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.880 [2024-10-07 11:33:22.627621] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.880 [2024-10-07 11:33:22.627684] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.880 [2024-10-07 11:33:22.627962] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.880 [2024-10-07 11:33:22.628006] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.880 [2024-10-07 11:33:22.628026] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.880 [2024-10-07 11:33:22.628077] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.880 [2024-10-07 11:33:22.628101] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.880 [2024-10-07 11:33:22.628116] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.880 [2024-10-07 11:33:22.628170] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.880 [2024-10-07 11:33:22.628197] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.880 [2024-10-07 11:33:22.628218] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.880 [2024-10-07 11:33:22.628233] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.880 [2024-10-07 11:33:22.628246] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.880 [2024-10-07 11:33:22.628263] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.880 [2024-10-07 11:33:22.628278] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.880 [2024-10-07 11:33:22.628291] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.880 [2024-10-07 11:33:22.628314] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.880 [2024-10-07 11:33:22.628327] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.880 [2024-10-07 11:33:22.639612] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.880 [2024-10-07 11:33:22.639673] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.880 [2024-10-07 11:33:22.639928] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.880 [2024-10-07 11:33:22.639971] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.880 [2024-10-07 11:33:22.639991] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.880 [2024-10-07 11:33:22.640042] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.880 [2024-10-07 11:33:22.640066] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.880 [2024-10-07 11:33:22.640099] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.880 [2024-10-07 11:33:22.640232] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.880 [2024-10-07 11:33:22.640261] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.880 [2024-10-07 11:33:22.640382] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.880 [2024-10-07 11:33:22.640405] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.880 [2024-10-07 11:33:22.640420] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.880 [2024-10-07 11:33:22.640437] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.880 [2024-10-07 11:33:22.640452] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.880 [2024-10-07 11:33:22.640465] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.880 [2024-10-07 11:33:22.640580] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.880 [2024-10-07 11:33:22.640601] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.880 [2024-10-07 11:33:22.649740] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.880 [2024-10-07 11:33:22.649806] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.880 [2024-10-07 11:33:22.649887] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.880 [2024-10-07 11:33:22.649916] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.880 [2024-10-07 11:33:22.649933] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.880 [2024-10-07 11:33:22.649987] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.880 [2024-10-07 11:33:22.650011] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.880 [2024-10-07 11:33:22.650026] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.880 [2024-10-07 11:33:22.650043] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.880 [2024-10-07 11:33:22.650067] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.880 [2024-10-07 11:33:22.650085] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.880 [2024-10-07 11:33:22.650098] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.880 [2024-10-07 11:33:22.650111] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.880 [2024-10-07 11:33:22.650134] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.880 [2024-10-07 11:33:22.650149] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.880 [2024-10-07 11:33:22.650162] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.880 [2024-10-07 11:33:22.650174] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.880 [2024-10-07 11:33:22.650194] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.880 [2024-10-07 11:33:22.661413] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.880 [2024-10-07 11:33:22.661479] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.880 [2024-10-07 11:33:22.661724] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.880 [2024-10-07 11:33:22.661756] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.880 [2024-10-07 11:33:22.661774] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.880 [2024-10-07 11:33:22.661821] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.880 [2024-10-07 11:33:22.661844] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.880 [2024-10-07 11:33:22.661859] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.880 [2024-10-07 11:33:22.661883] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.880 [2024-10-07 11:33:22.661903] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.880 [2024-10-07 11:33:22.661923] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.880 [2024-10-07 11:33:22.661938] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.880 [2024-10-07 11:33:22.661951] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.880 [2024-10-07 11:33:22.661968] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.880 [2024-10-07 11:33:22.661982] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.880 [2024-10-07 11:33:22.661995] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.880 [2024-10-07 11:33:22.662018] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.880 [2024-10-07 11:33:22.662032] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.880 [2024-10-07 11:33:22.671559] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.880 [2024-10-07 11:33:22.671624] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.880 [2024-10-07 11:33:22.671716] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.880 [2024-10-07 11:33:22.671746] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.880 [2024-10-07 11:33:22.671763] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.880 [2024-10-07 11:33:22.671818] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.881 [2024-10-07 11:33:22.671844] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.881 [2024-10-07 11:33:22.671859] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.881 [2024-10-07 11:33:22.671876] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.881 [2024-10-07 11:33:22.671900] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.881 [2024-10-07 11:33:22.671917] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.881 [2024-10-07 11:33:22.671931] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.881 [2024-10-07 11:33:22.671944] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.881 [2024-10-07 11:33:22.671982] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.881 [2024-10-07 11:33:22.671999] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.881 [2024-10-07 11:33:22.672012] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.881 [2024-10-07 11:33:22.672026] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.881 [2024-10-07 11:33:22.672046] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.881 [2024-10-07 11:33:22.686150] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.881 [2024-10-07 11:33:22.686203] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.881 [2024-10-07 11:33:22.687320] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.881 [2024-10-07 11:33:22.687366] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.881 [2024-10-07 11:33:22.687387] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.881 [2024-10-07 11:33:22.687439] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.881 [2024-10-07 11:33:22.687463] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.881 [2024-10-07 11:33:22.687478] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.881 [2024-10-07 11:33:22.687902] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.881 [2024-10-07 11:33:22.687946] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.881 [2024-10-07 11:33:22.688171] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.881 [2024-10-07 11:33:22.688208] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.881 [2024-10-07 11:33:22.688226] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.881 [2024-10-07 11:33:22.688244] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.881 [2024-10-07 11:33:22.688258] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.881 [2024-10-07 11:33:22.688271] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.881 [2024-10-07 11:33:22.688407] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.881 [2024-10-07 11:33:22.688433] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.881 [2024-10-07 11:33:22.703293] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.881 [2024-10-07 11:33:22.703351] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.881 [2024-10-07 11:33:22.703529] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.881 [2024-10-07 11:33:22.703561] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.881 [2024-10-07 11:33:22.703579] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.881 [2024-10-07 11:33:22.703628] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.881 [2024-10-07 11:33:22.703669] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.881 [2024-10-07 11:33:22.703689] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.881 [2024-10-07 11:33:22.703743] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.881 [2024-10-07 11:33:22.703765] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.881 [2024-10-07 11:33:22.703785] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.881 [2024-10-07 11:33:22.703800] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.881 [2024-10-07 11:33:22.703814] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.881 [2024-10-07 11:33:22.703831] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.881 [2024-10-07 11:33:22.703845] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.881 [2024-10-07 11:33:22.703858] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.881 [2024-10-07 11:33:22.703881] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.881 [2024-10-07 11:33:22.703895] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.881 [2024-10-07 11:33:22.719226] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.881 [2024-10-07 11:33:22.719279] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.881 [2024-10-07 11:33:22.719635] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.881 [2024-10-07 11:33:22.719696] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.881 [2024-10-07 11:33:22.719717] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.881 [2024-10-07 11:33:22.719772] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.881 [2024-10-07 11:33:22.719796] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.881 [2024-10-07 11:33:22.719812] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.881 [2024-10-07 11:33:22.720020] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.881 [2024-10-07 11:33:22.720064] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.881 [2024-10-07 11:33:22.720279] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.881 [2024-10-07 11:33:22.720316] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.881 [2024-10-07 11:33:22.720334] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.881 [2024-10-07 11:33:22.720351] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.881 [2024-10-07 11:33:22.720367] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.881 [2024-10-07 11:33:22.720380] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.881 [2024-10-07 11:33:22.720585] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.881 [2024-10-07 11:33:22.720610] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.881 [2024-10-07 11:33:22.734399] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.881 [2024-10-07 11:33:22.734451] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.881 [2024-10-07 11:33:22.734590] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.881 [2024-10-07 11:33:22.734622] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.881 [2024-10-07 11:33:22.734639] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.881 [2024-10-07 11:33:22.734708] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.881 [2024-10-07 11:33:22.734732] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.881 [2024-10-07 11:33:22.734748] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.881 [2024-10-07 11:33:22.734772] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.881 [2024-10-07 11:33:22.734793] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.881 [2024-10-07 11:33:22.734812] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.881 [2024-10-07 11:33:22.734827] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.881 [2024-10-07 11:33:22.734841] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.881 [2024-10-07 11:33:22.734857] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.881 [2024-10-07 11:33:22.734872] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.881 [2024-10-07 11:33:22.734884] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.881 [2024-10-07 11:33:22.734907] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.881 [2024-10-07 11:33:22.734922] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.881 [2024-10-07 11:33:22.750002] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.881 [2024-10-07 11:33:22.750059] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.881 [2024-10-07 11:33:22.750210] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.881 [2024-10-07 11:33:22.750246] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.881 [2024-10-07 11:33:22.750264] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.881 [2024-10-07 11:33:22.750319] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.881 [2024-10-07 11:33:22.750343] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.881 [2024-10-07 11:33:22.750359] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.881 [2024-10-07 11:33:22.750383] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.881 [2024-10-07 11:33:22.750403] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.881 [2024-10-07 11:33:22.750423] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.881 [2024-10-07 11:33:22.750437] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.881 [2024-10-07 11:33:22.750451] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.881 [2024-10-07 11:33:22.750467] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.881 [2024-10-07 11:33:22.750498] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.881 [2024-10-07 11:33:22.750512] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.881 [2024-10-07 11:33:22.750537] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.881 [2024-10-07 11:33:22.750551] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.881 [2024-10-07 11:33:22.766111] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.882 [2024-10-07 11:33:22.766162] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.882 [2024-10-07 11:33:22.766251] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.882 [2024-10-07 11:33:22.766281] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.882 [2024-10-07 11:33:22.766298] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.882 [2024-10-07 11:33:22.766346] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.882 [2024-10-07 11:33:22.766392] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.882 [2024-10-07 11:33:22.766430] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.882 [2024-10-07 11:33:22.766459] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.882 [2024-10-07 11:33:22.766479] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.882 [2024-10-07 11:33:22.766499] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.882 [2024-10-07 11:33:22.766514] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.882 [2024-10-07 11:33:22.766528] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.882 [2024-10-07 11:33:22.766544] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.882 [2024-10-07 11:33:22.766558] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.882 [2024-10-07 11:33:22.766571] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.882 [2024-10-07 11:33:22.766594] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.882 [2024-10-07 11:33:22.766608] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.882 [2024-10-07 11:33:22.782084] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.882 [2024-10-07 11:33:22.782136] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.882 [2024-10-07 11:33:22.782227] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.882 [2024-10-07 11:33:22.782257] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.882 [2024-10-07 11:33:22.782274] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.882 [2024-10-07 11:33:22.782335] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.882 [2024-10-07 11:33:22.782371] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.882 [2024-10-07 11:33:22.782391] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.882 [2024-10-07 11:33:22.782446] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.882 [2024-10-07 11:33:22.782468] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.882 [2024-10-07 11:33:22.782489] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.882 [2024-10-07 11:33:22.782503] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.882 [2024-10-07 11:33:22.782527] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.882 [2024-10-07 11:33:22.782549] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.882 [2024-10-07 11:33:22.782564] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.882 [2024-10-07 11:33:22.782577] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.882 [2024-10-07 11:33:22.782601] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.882 [2024-10-07 11:33:22.782615] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.882 [2024-10-07 11:33:22.797918] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.882 [2024-10-07 11:33:22.797971] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.882 [2024-10-07 11:33:22.798071] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.882 [2024-10-07 11:33:22.798113] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.882 [2024-10-07 11:33:22.798146] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.882 [2024-10-07 11:33:22.798221] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.882 [2024-10-07 11:33:22.798255] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.882 [2024-10-07 11:33:22.798276] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.882 [2024-10-07 11:33:22.798301] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.882 [2024-10-07 11:33:22.798321] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.882 [2024-10-07 11:33:22.798340] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.882 [2024-10-07 11:33:22.798355] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.882 [2024-10-07 11:33:22.798369] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.882 [2024-10-07 11:33:22.798386] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.882 [2024-10-07 11:33:22.798400] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.882 [2024-10-07 11:33:22.798413] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.882 [2024-10-07 11:33:22.798435] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.882 [2024-10-07 11:33:22.798450] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.882 [2024-10-07 11:33:22.813685] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.882 [2024-10-07 11:33:22.813737] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.882 [2024-10-07 11:33:22.813830] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.882 [2024-10-07 11:33:22.813881] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.882 [2024-10-07 11:33:22.813900] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.882 [2024-10-07 11:33:22.813951] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.882 [2024-10-07 11:33:22.813990] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.882 [2024-10-07 11:33:22.814005] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.882 [2024-10-07 11:33:22.814029] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.882 [2024-10-07 11:33:22.814049] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.882 [2024-10-07 11:33:22.814068] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.882 [2024-10-07 11:33:22.814082] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.882 [2024-10-07 11:33:22.814095] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.882 [2024-10-07 11:33:22.814111] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.882 [2024-10-07 11:33:22.814140] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.882 [2024-10-07 11:33:22.814153] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.882 [2024-10-07 11:33:22.814177] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.882 [2024-10-07 11:33:22.814191] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.882 [2024-10-07 11:33:22.830732] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.882 [2024-10-07 11:33:22.830784] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.882 [2024-10-07 11:33:22.831308] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.882 [2024-10-07 11:33:22.831354] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.882 [2024-10-07 11:33:22.831375] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.882 [2024-10-07 11:33:22.831427] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.882 [2024-10-07 11:33:22.831452] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.882 [2024-10-07 11:33:22.831468] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.882 [2024-10-07 11:33:22.831703] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.882 [2024-10-07 11:33:22.831735] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.882 [2024-10-07 11:33:22.831935] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.882 [2024-10-07 11:33:22.831971] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.882 [2024-10-07 11:33:22.831989] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.882 [2024-10-07 11:33:22.832007] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.882 [2024-10-07 11:33:22.832021] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.882 [2024-10-07 11:33:22.832055] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.882 [2024-10-07 11:33:22.832309] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.882 [2024-10-07 11:33:22.832336] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.882 [2024-10-07 11:33:22.846708] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.882 [2024-10-07 11:33:22.846763] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.882 [2024-10-07 11:33:22.847084] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.882 [2024-10-07 11:33:22.847118] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.882 [2024-10-07 11:33:22.847135] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.882 [2024-10-07 11:33:22.847184] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.882 [2024-10-07 11:33:22.847227] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.882 [2024-10-07 11:33:22.847245] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.882 [2024-10-07 11:33:22.847466] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.882 [2024-10-07 11:33:22.847498] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.882 [2024-10-07 11:33:22.847750] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.882 [2024-10-07 11:33:22.847786] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.882 [2024-10-07 11:33:22.847803] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.882 [2024-10-07 11:33:22.847823] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.882 [2024-10-07 11:33:22.847837] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.882 [2024-10-07 11:33:22.847850] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.882 [2024-10-07 11:33:22.848062] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.882 [2024-10-07 11:33:22.848087] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.882 [2024-10-07 11:33:22.857099] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.882 [2024-10-07 11:33:22.857151] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.882 [2024-10-07 11:33:22.857351] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.882 [2024-10-07 11:33:22.857384] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.882 [2024-10-07 11:33:22.857402] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.882 [2024-10-07 11:33:22.857450] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.882 [2024-10-07 11:33:22.857474] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.882 [2024-10-07 11:33:22.857497] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.882 [2024-10-07 11:33:22.857613] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.882 [2024-10-07 11:33:22.857676] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.882 [2024-10-07 11:33:22.857785] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.883 [2024-10-07 11:33:22.857806] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.883 [2024-10-07 11:33:22.857820] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.883 [2024-10-07 11:33:22.857837] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.883 [2024-10-07 11:33:22.857851] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.883 [2024-10-07 11:33:22.857865] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.883 [2024-10-07 11:33:22.858294] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.883 [2024-10-07 11:33:22.858339] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.883 [2024-10-07 11:33:22.868295] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.883 [2024-10-07 11:33:22.868345] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.883 [2024-10-07 11:33:22.868435] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.883 [2024-10-07 11:33:22.868465] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.883 [2024-10-07 11:33:22.868482] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.883 [2024-10-07 11:33:22.868530] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.883 [2024-10-07 11:33:22.868553] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.883 [2024-10-07 11:33:22.868568] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.883 [2024-10-07 11:33:22.868592] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.883 [2024-10-07 11:33:22.868612] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.883 [2024-10-07 11:33:22.868632] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.883 [2024-10-07 11:33:22.868661] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.883 [2024-10-07 11:33:22.868678] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.883 [2024-10-07 11:33:22.868695] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.883 [2024-10-07 11:33:22.868709] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.883 [2024-10-07 11:33:22.868722] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.883 [2024-10-07 11:33:22.868745] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.883 [2024-10-07 11:33:22.868760] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.883 [2024-10-07 11:33:22.879883] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.883 [2024-10-07 11:33:22.879938] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.883 [2024-10-07 11:33:22.881048] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.883 [2024-10-07 11:33:22.881107] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.883 [2024-10-07 11:33:22.881160] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.883 [2024-10-07 11:33:22.881214] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.883 [2024-10-07 11:33:22.881238] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.883 [2024-10-07 11:33:22.881254] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.883 [2024-10-07 11:33:22.882415] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.883 [2024-10-07 11:33:22.882462] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.883 [2024-10-07 11:33:22.882587] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.883 [2024-10-07 11:33:22.882612] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.884 [2024-10-07 11:33:22.882627] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.884 [2024-10-07 11:33:22.882645] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.884 [2024-10-07 11:33:22.882679] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.884 [2024-10-07 11:33:22.882693] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.884 [2024-10-07 11:33:22.883268] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.884 [2024-10-07 11:33:22.883307] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.884 [2024-10-07 11:33:22.890007] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.884 [2024-10-07 11:33:22.890074] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.884 [2024-10-07 11:33:22.890155] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.884 [2024-10-07 11:33:22.890185] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.884 [2024-10-07 11:33:22.890208] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.884 [2024-10-07 11:33:22.890264] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.884 [2024-10-07 11:33:22.890288] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.884 [2024-10-07 11:33:22.890303] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.884 [2024-10-07 11:33:22.890321] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.884 [2024-10-07 11:33:22.890344] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.884 [2024-10-07 11:33:22.890362] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.884 [2024-10-07 11:33:22.890375] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.884 [2024-10-07 11:33:22.890389] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.884 [2024-10-07 11:33:22.890412] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.884 [2024-10-07 11:33:22.890426] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.884 [2024-10-07 11:33:22.890439] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.884 [2024-10-07 11:33:22.890466] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.884 [2024-10-07 11:33:22.890489] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.884 8792.17 IOPS, 34.34 MiB/s [2024-10-07T11:33:33.407Z] [2024-10-07 11:33:22.905447] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.884 [2024-10-07 11:33:22.905495] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.884 [2024-10-07 11:33:22.906471] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.884 [2024-10-07 11:33:22.906516] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.884 [2024-10-07 11:33:22.906537] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.884 [2024-10-07 11:33:22.906588] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.884 [2024-10-07 11:33:22.906613] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.884 [2024-10-07 11:33:22.906639] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.884 [2024-10-07 11:33:22.907326] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.884 [2024-10-07 11:33:22.907372] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.884 [2024-10-07 11:33:22.907436] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.884 [2024-10-07 11:33:22.907459] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.884 [2024-10-07 11:33:22.907475] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.884 [2024-10-07 11:33:22.907499] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.884 [2024-10-07 11:33:22.907516] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.884 [2024-10-07 11:33:22.907529] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.884 [2024-10-07 11:33:22.907554] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.884 [2024-10-07 11:33:22.907568] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.884 [2024-10-07 11:33:22.917981] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.884 [2024-10-07 11:33:22.918037] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.884 [2024-10-07 11:33:22.918289] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.884 [2024-10-07 11:33:22.918322] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.884 [2024-10-07 11:33:22.918340] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.884 [2024-10-07 11:33:22.918389] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.884 [2024-10-07 11:33:22.918413] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.884 [2024-10-07 11:33:22.918428] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.884 [2024-10-07 11:33:22.918682] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.884 [2024-10-07 11:33:22.918719] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.884 [2024-10-07 11:33:22.918947] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.884 [2024-10-07 11:33:22.919006] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.884 [2024-10-07 11:33:22.919041] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.884 [2024-10-07 11:33:22.919074] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.884 [2024-10-07 11:33:22.919094] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.884 [2024-10-07 11:33:22.919108] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.884 [2024-10-07 11:33:22.919160] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.884 [2024-10-07 11:33:22.919182] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.884 [2024-10-07 11:33:22.928228] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.884 [2024-10-07 11:33:22.928284] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.884 [2024-10-07 11:33:22.928376] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.884 [2024-10-07 11:33:22.928406] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.884 [2024-10-07 11:33:22.928423] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.884 [2024-10-07 11:33:22.928472] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.884 [2024-10-07 11:33:22.928496] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.884 [2024-10-07 11:33:22.928511] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.884 [2024-10-07 11:33:22.931057] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.884 [2024-10-07 11:33:22.931105] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.884 [2024-10-07 11:33:22.932002] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.884 [2024-10-07 11:33:22.932041] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.884 [2024-10-07 11:33:22.932059] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.884 [2024-10-07 11:33:22.932077] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.884 [2024-10-07 11:33:22.932091] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.884 [2024-10-07 11:33:22.932104] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.884 [2024-10-07 11:33:22.932232] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.884 [2024-10-07 11:33:22.932257] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.884 [2024-10-07 11:33:22.939113] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.884 [2024-10-07 11:33:22.939165] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.884 [2024-10-07 11:33:22.939275] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.884 [2024-10-07 11:33:22.939306] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.884 [2024-10-07 11:33:22.939339] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.884 [2024-10-07 11:33:22.939392] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.884 [2024-10-07 11:33:22.939416] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.884 [2024-10-07 11:33:22.939431] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.884 [2024-10-07 11:33:22.939455] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.884 [2024-10-07 11:33:22.939475] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.884 [2024-10-07 11:33:22.939495] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.884 [2024-10-07 11:33:22.939509] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.884 [2024-10-07 11:33:22.939523] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.884 [2024-10-07 11:33:22.939540] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.884 [2024-10-07 11:33:22.939554] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.884 [2024-10-07 11:33:22.939567] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.884 [2024-10-07 11:33:22.939596] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.884 [2024-10-07 11:33:22.939615] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.884 [2024-10-07 11:33:22.949230] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.884 [2024-10-07 11:33:22.949362] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.884 [2024-10-07 11:33:22.949395] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.884 [2024-10-07 11:33:22.949412] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.884 [2024-10-07 11:33:22.949438] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.884 [2024-10-07 11:33:22.949469] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.884 [2024-10-07 11:33:22.949532] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.884 [2024-10-07 11:33:22.949558] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.884 [2024-10-07 11:33:22.949574] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.884 [2024-10-07 11:33:22.949589] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.884 [2024-10-07 11:33:22.949602] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.884 [2024-10-07 11:33:22.949615] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.884 [2024-10-07 11:33:22.949639] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.884 [2024-10-07 11:33:22.949688] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.884 [2024-10-07 11:33:22.949710] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.884 [2024-10-07 11:33:22.949725] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.884 [2024-10-07 11:33:22.949759] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.884 [2024-10-07 11:33:22.949783] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.884 [2024-10-07 11:33:22.959830] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.884 [2024-10-07 11:33:22.959880] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.884 [2024-10-07 11:33:22.959981] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.884 [2024-10-07 11:33:22.960010] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.884 [2024-10-07 11:33:22.960042] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.885 [2024-10-07 11:33:22.960087] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.885 [2024-10-07 11:33:22.960109] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.885 [2024-10-07 11:33:22.960124] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.885 [2024-10-07 11:33:22.960737] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.885 [2024-10-07 11:33:22.960780] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.885 [2024-10-07 11:33:22.960878] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.885 [2024-10-07 11:33:22.960900] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.885 [2024-10-07 11:33:22.960914] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.885 [2024-10-07 11:33:22.960931] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.885 [2024-10-07 11:33:22.960945] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.885 [2024-10-07 11:33:22.960958] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.885 [2024-10-07 11:33:22.960981] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.885 [2024-10-07 11:33:22.960995] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.885 [2024-10-07 11:33:22.970803] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.885 [2024-10-07 11:33:22.970894] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.885 [2024-10-07 11:33:22.971112] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.885 [2024-10-07 11:33:22.971145] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.885 [2024-10-07 11:33:22.971162] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.885 [2024-10-07 11:33:22.971222] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.885 [2024-10-07 11:33:22.971247] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.885 [2024-10-07 11:33:22.971262] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.885 [2024-10-07 11:33:22.971379] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.885 [2024-10-07 11:33:22.971406] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.885 [2024-10-07 11:33:22.971506] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.885 [2024-10-07 11:33:22.971548] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.885 [2024-10-07 11:33:22.971563] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.885 [2024-10-07 11:33:22.971581] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.885 [2024-10-07 11:33:22.971595] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.885 [2024-10-07 11:33:22.971607] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.885 [2024-10-07 11:33:22.971974] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.885 [2024-10-07 11:33:22.972001] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.885 [2024-10-07 11:33:22.983611] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.885 [2024-10-07 11:33:22.983684] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.885 [2024-10-07 11:33:22.984008] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.885 [2024-10-07 11:33:22.984066] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.885 [2024-10-07 11:33:22.984085] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.885 [2024-10-07 11:33:22.984136] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.885 [2024-10-07 11:33:22.984159] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.885 [2024-10-07 11:33:22.984174] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.885 [2024-10-07 11:33:22.986388] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.885 [2024-10-07 11:33:22.986445] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.885 [2024-10-07 11:33:22.986808] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.885 [2024-10-07 11:33:22.986837] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.885 [2024-10-07 11:33:22.986852] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.885 [2024-10-07 11:33:22.986870] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.885 [2024-10-07 11:33:22.986891] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.885 [2024-10-07 11:33:22.986904] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.885 [2024-10-07 11:33:22.987067] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.885 [2024-10-07 11:33:22.987092] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.885 [2024-10-07 11:33:22.995152] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.885 [2024-10-07 11:33:22.995242] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.885 [2024-10-07 11:33:22.995544] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.885 [2024-10-07 11:33:22.995589] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.885 [2024-10-07 11:33:22.995610] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.885 [2024-10-07 11:33:22.995696] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.885 [2024-10-07 11:33:22.995723] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.885 [2024-10-07 11:33:22.995739] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.885 [2024-10-07 11:33:22.995795] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.885 [2024-10-07 11:33:22.995822] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.885 [2024-10-07 11:33:22.995843] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.885 [2024-10-07 11:33:22.995858] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.885 [2024-10-07 11:33:22.995871] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.885 [2024-10-07 11:33:22.995888] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.885 [2024-10-07 11:33:22.995903] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.885 [2024-10-07 11:33:22.995915] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.885 [2024-10-07 11:33:22.995953] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.885 [2024-10-07 11:33:22.995967] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.885 [2024-10-07 11:33:23.007964] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.885 [2024-10-07 11:33:23.008028] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.885 [2024-10-07 11:33:23.008468] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.885 [2024-10-07 11:33:23.008512] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.885 [2024-10-07 11:33:23.008533] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.885 [2024-10-07 11:33:23.008584] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.885 [2024-10-07 11:33:23.008608] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.885 [2024-10-07 11:33:23.008623] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.885 [2024-10-07 11:33:23.008707] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.885 [2024-10-07 11:33:23.008735] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.885 [2024-10-07 11:33:23.008756] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.885 [2024-10-07 11:33:23.008771] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.885 [2024-10-07 11:33:23.008784] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.885 [2024-10-07 11:33:23.008801] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.885 [2024-10-07 11:33:23.008815] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.885 [2024-10-07 11:33:23.008828] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.885 [2024-10-07 11:33:23.008869] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.885 [2024-10-07 11:33:23.008901] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.885 [2024-10-07 11:33:23.019382] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.885 [2024-10-07 11:33:23.019430] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.885 [2024-10-07 11:33:23.019618] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.885 [2024-10-07 11:33:23.019664] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.885 [2024-10-07 11:33:23.019685] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.885 [2024-10-07 11:33:23.019736] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.885 [2024-10-07 11:33:23.019760] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.885 [2024-10-07 11:33:23.019775] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.885 [2024-10-07 11:33:23.019931] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.885 [2024-10-07 11:33:23.019964] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.885 [2024-10-07 11:33:23.021255] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.885 [2024-10-07 11:33:23.021292] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.885 [2024-10-07 11:33:23.021326] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.885 [2024-10-07 11:33:23.021343] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.885 [2024-10-07 11:33:23.021356] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.885 [2024-10-07 11:33:23.021369] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.885 [2024-10-07 11:33:23.022209] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.885 [2024-10-07 11:33:23.022244] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.885 [2024-10-07 11:33:23.030372] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.885 [2024-10-07 11:33:23.030976] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.885 [2024-10-07 11:33:23.031084] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.885 [2024-10-07 11:33:23.031114] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.885 [2024-10-07 11:33:23.031131] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.885 [2024-10-07 11:33:23.031442] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.885 [2024-10-07 11:33:23.031488] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.885 [2024-10-07 11:33:23.031519] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.885 [2024-10-07 11:33:23.031553] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.885 [2024-10-07 11:33:23.031638] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.885 [2024-10-07 11:33:23.031683] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.885 [2024-10-07 11:33:23.031715] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.885 [2024-10-07 11:33:23.031730] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.885 [2024-10-07 11:33:23.031758] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.885 [2024-10-07 11:33:23.031774] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.885 [2024-10-07 11:33:23.031787] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.885 [2024-10-07 11:33:23.031800] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.885 [2024-10-07 11:33:23.031820] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.885 [2024-10-07 11:33:23.044380] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.886 [2024-10-07 11:33:23.044436] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.886 [2024-10-07 11:33:23.044898] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.886 [2024-10-07 11:33:23.044943] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.886 [2024-10-07 11:33:23.044964] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.886 [2024-10-07 11:33:23.045026] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.886 [2024-10-07 11:33:23.045057] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.886 [2024-10-07 11:33:23.045074] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.886 [2024-10-07 11:33:23.045307] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.886 [2024-10-07 11:33:23.045340] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.886 [2024-10-07 11:33:23.045397] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.886 [2024-10-07 11:33:23.045419] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.886 [2024-10-07 11:33:23.045434] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.886 [2024-10-07 11:33:23.045452] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.886 [2024-10-07 11:33:23.045466] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.886 [2024-10-07 11:33:23.045479] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.886 [2024-10-07 11:33:23.045668] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.886 [2024-10-07 11:33:23.045693] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.886 [2024-10-07 11:33:23.058042] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.886 [2024-10-07 11:33:23.058100] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.886 [2024-10-07 11:33:23.058910] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.886 [2024-10-07 11:33:23.058956] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.886 [2024-10-07 11:33:23.058977] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.886 [2024-10-07 11:33:23.059030] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.886 [2024-10-07 11:33:23.059071] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.886 [2024-10-07 11:33:23.059088] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.886 [2024-10-07 11:33:23.059278] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.886 [2024-10-07 11:33:23.059309] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.886 [2024-10-07 11:33:23.059409] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.886 [2024-10-07 11:33:23.059428] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.886 [2024-10-07 11:33:23.059443] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.886 [2024-10-07 11:33:23.059460] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.886 [2024-10-07 11:33:23.059475] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.886 [2024-10-07 11:33:23.059489] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.886 [2024-10-07 11:33:23.059981] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.886 [2024-10-07 11:33:23.060019] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.886 [2024-10-07 11:33:23.069099] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.886 [2024-10-07 11:33:23.069150] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.886 [2024-10-07 11:33:23.069334] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.886 [2024-10-07 11:33:23.069365] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.886 [2024-10-07 11:33:23.069383] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.886 [2024-10-07 11:33:23.069432] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.886 [2024-10-07 11:33:23.069471] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.886 [2024-10-07 11:33:23.069487] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.886 [2024-10-07 11:33:23.069591] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.886 [2024-10-07 11:33:23.069616] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.886 [2024-10-07 11:33:23.069854] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.886 [2024-10-07 11:33:23.069881] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.886 [2024-10-07 11:33:23.069896] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.886 [2024-10-07 11:33:23.069913] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.886 [2024-10-07 11:33:23.069928] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.886 [2024-10-07 11:33:23.069942] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.886 [2024-10-07 11:33:23.071826] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.886 [2024-10-07 11:33:23.071865] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.886 [2024-10-07 11:33:23.083279] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.886 [2024-10-07 11:33:23.083330] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.886 [2024-10-07 11:33:23.083501] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.886 [2024-10-07 11:33:23.083533] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.886 [2024-10-07 11:33:23.083551] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.886 [2024-10-07 11:33:23.083600] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.886 [2024-10-07 11:33:23.083623] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.886 [2024-10-07 11:33:23.083638] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.886 [2024-10-07 11:33:23.084883] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.886 [2024-10-07 11:33:23.084927] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.886 [2024-10-07 11:33:23.086789] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.886 [2024-10-07 11:33:23.086828] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.886 [2024-10-07 11:33:23.086847] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.886 [2024-10-07 11:33:23.086865] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.886 [2024-10-07 11:33:23.086880] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.886 [2024-10-07 11:33:23.086892] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.886 [2024-10-07 11:33:23.087536] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.886 [2024-10-07 11:33:23.087572] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.886 [2024-10-07 11:33:23.094501] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.886 [2024-10-07 11:33:23.094548] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.886 [2024-10-07 11:33:23.094759] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.886 [2024-10-07 11:33:23.094791] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.886 [2024-10-07 11:33:23.094808] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.886 [2024-10-07 11:33:23.094857] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.886 [2024-10-07 11:33:23.094880] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.886 [2024-10-07 11:33:23.094896] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.886 [2024-10-07 11:33:23.095048] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.886 [2024-10-07 11:33:23.095077] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.886 [2024-10-07 11:33:23.095240] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.886 [2024-10-07 11:33:23.095266] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.886 [2024-10-07 11:33:23.095297] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.886 [2024-10-07 11:33:23.095315] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.886 [2024-10-07 11:33:23.095330] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.886 [2024-10-07 11:33:23.095343] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.886 [2024-10-07 11:33:23.095459] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.886 [2024-10-07 11:33:23.095481] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.886 [2024-10-07 11:33:23.105459] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.886 [2024-10-07 11:33:23.105512] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.886 [2024-10-07 11:33:23.105866] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.886 [2024-10-07 11:33:23.105937] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.886 [2024-10-07 11:33:23.105983] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.886 [2024-10-07 11:33:23.106079] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.886 [2024-10-07 11:33:23.106118] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.886 [2024-10-07 11:33:23.106146] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.886 [2024-10-07 11:33:23.106303] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.886 [2024-10-07 11:33:23.106344] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.886 [2024-10-07 11:33:23.106510] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.886 [2024-10-07 11:33:23.106565] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.886 [2024-10-07 11:33:23.106595] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.886 [2024-10-07 11:33:23.106627] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.886 [2024-10-07 11:33:23.106710] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.886 [2024-10-07 11:33:23.106738] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.886 [2024-10-07 11:33:23.106908] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.887 [2024-10-07 11:33:23.106937] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.887 [2024-10-07 11:33:23.115893] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.887 [2024-10-07 11:33:23.115947] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.887 [2024-10-07 11:33:23.116131] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.887 [2024-10-07 11:33:23.116165] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.887 [2024-10-07 11:33:23.116182] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.887 [2024-10-07 11:33:23.116231] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.887 [2024-10-07 11:33:23.116255] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.887 [2024-10-07 11:33:23.116287] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.887 [2024-10-07 11:33:23.116394] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.887 [2024-10-07 11:33:23.116421] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.887 [2024-10-07 11:33:23.116487] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.887 [2024-10-07 11:33:23.116507] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.887 [2024-10-07 11:33:23.116521] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.887 [2024-10-07 11:33:23.116538] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.887 [2024-10-07 11:33:23.116553] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.887 [2024-10-07 11:33:23.116566] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.887 [2024-10-07 11:33:23.116590] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.887 [2024-10-07 11:33:23.116604] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.887 [2024-10-07 11:33:23.126439] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.887 [2024-10-07 11:33:23.126491] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.887 [2024-10-07 11:33:23.126582] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.887 [2024-10-07 11:33:23.126612] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.887 [2024-10-07 11:33:23.126628] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.887 [2024-10-07 11:33:23.126694] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.887 [2024-10-07 11:33:23.126719] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.887 [2024-10-07 11:33:23.126735] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.887 [2024-10-07 11:33:23.126759] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.887 [2024-10-07 11:33:23.126780] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.887 [2024-10-07 11:33:23.126800] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.887 [2024-10-07 11:33:23.126814] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.887 [2024-10-07 11:33:23.126827] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.887 [2024-10-07 11:33:23.126843] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.887 [2024-10-07 11:33:23.126858] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.887 [2024-10-07 11:33:23.126871] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.887 [2024-10-07 11:33:23.126893] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.887 [2024-10-07 11:33:23.126908] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.887 [2024-10-07 11:33:23.136881] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.887 [2024-10-07 11:33:23.136953] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.887 [2024-10-07 11:33:23.137043] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.887 [2024-10-07 11:33:23.137074] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.887 [2024-10-07 11:33:23.137090] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.887 [2024-10-07 11:33:23.137138] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.887 [2024-10-07 11:33:23.137162] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.887 [2024-10-07 11:33:23.137177] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.887 [2024-10-07 11:33:23.137356] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.887 [2024-10-07 11:33:23.137387] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.887 [2024-10-07 11:33:23.137441] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.887 [2024-10-07 11:33:23.137463] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.887 [2024-10-07 11:33:23.137477] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.887 [2024-10-07 11:33:23.137494] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.887 [2024-10-07 11:33:23.137508] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.887 [2024-10-07 11:33:23.137521] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.887 [2024-10-07 11:33:23.137544] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.887 [2024-10-07 11:33:23.137558] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.887 [2024-10-07 11:33:23.148982] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.887 [2024-10-07 11:33:23.149031] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.887 [2024-10-07 11:33:23.149226] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.887 [2024-10-07 11:33:23.149264] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.887 [2024-10-07 11:33:23.149295] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.887 [2024-10-07 11:33:23.149386] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.887 [2024-10-07 11:33:23.149432] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.887 [2024-10-07 11:33:23.149465] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.887 [2024-10-07 11:33:23.149520] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.887 [2024-10-07 11:33:23.149545] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.887 [2024-10-07 11:33:23.149574] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.887 [2024-10-07 11:33:23.149604] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.887 [2024-10-07 11:33:23.149634] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.887 [2024-10-07 11:33:23.149708] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.887 [2024-10-07 11:33:23.149741] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.887 [2024-10-07 11:33:23.149769] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.887 [2024-10-07 11:33:23.149814] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.887 [2024-10-07 11:33:23.149843] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.887 [2024-10-07 11:33:23.163456] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.887 [2024-10-07 11:33:23.163510] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.887 [2024-10-07 11:33:23.163605] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.887 [2024-10-07 11:33:23.163636] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.887 [2024-10-07 11:33:23.163671] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.887 [2024-10-07 11:33:23.163725] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.887 [2024-10-07 11:33:23.163750] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.887 [2024-10-07 11:33:23.163765] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.887 [2024-10-07 11:33:23.163789] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.887 [2024-10-07 11:33:23.163809] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.887 [2024-10-07 11:33:23.163829] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.887 [2024-10-07 11:33:23.163843] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.887 [2024-10-07 11:33:23.163857] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.887 [2024-10-07 11:33:23.163873] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.887 [2024-10-07 11:33:23.163887] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.887 [2024-10-07 11:33:23.163900] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.887 [2024-10-07 11:33:23.163923] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.887 [2024-10-07 11:33:23.163938] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.887 [2024-10-07 11:33:23.175952] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.887 [2024-10-07 11:33:23.176005] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.887 [2024-10-07 11:33:23.176112] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.887 [2024-10-07 11:33:23.176141] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.887 [2024-10-07 11:33:23.176158] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.887 [2024-10-07 11:33:23.176205] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.887 [2024-10-07 11:33:23.176229] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.887 [2024-10-07 11:33:23.176244] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.887 [2024-10-07 11:33:23.176296] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.887 [2024-10-07 11:33:23.176317] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.887 [2024-10-07 11:33:23.176337] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.887 [2024-10-07 11:33:23.176352] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.887 [2024-10-07 11:33:23.176366] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.887 [2024-10-07 11:33:23.176383] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.887 [2024-10-07 11:33:23.176397] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.887 [2024-10-07 11:33:23.176410] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.887 [2024-10-07 11:33:23.176433] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.887 [2024-10-07 11:33:23.176447] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.887 [2024-10-07 11:33:23.186453] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.887 [2024-10-07 11:33:23.186503] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.887 [2024-10-07 11:33:23.186689] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.887 [2024-10-07 11:33:23.186723] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.887 [2024-10-07 11:33:23.186741] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.887 [2024-10-07 11:33:23.186791] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.887 [2024-10-07 11:33:23.186815] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.887 [2024-10-07 11:33:23.186830] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.887 [2024-10-07 11:33:23.186876] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.887 [2024-10-07 11:33:23.186903] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.887 [2024-10-07 11:33:23.186924] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.887 [2024-10-07 11:33:23.186939] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.888 [2024-10-07 11:33:23.186952] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.888 [2024-10-07 11:33:23.186969] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.888 [2024-10-07 11:33:23.186983] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.888 [2024-10-07 11:33:23.186997] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.888 [2024-10-07 11:33:23.187020] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.888 [2024-10-07 11:33:23.187034] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.888 [2024-10-07 11:33:23.200421] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.888 [2024-10-07 11:33:23.200470] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.888 [2024-10-07 11:33:23.201105] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.888 [2024-10-07 11:33:23.201179] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.888 [2024-10-07 11:33:23.201200] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.888 [2024-10-07 11:33:23.201252] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.888 [2024-10-07 11:33:23.201277] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.888 [2024-10-07 11:33:23.201291] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.888 [2024-10-07 11:33:23.201370] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.888 [2024-10-07 11:33:23.201397] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.888 [2024-10-07 11:33:23.201418] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.888 [2024-10-07 11:33:23.201432] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.888 [2024-10-07 11:33:23.201446] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.888 [2024-10-07 11:33:23.201463] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.888 [2024-10-07 11:33:23.201477] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.888 [2024-10-07 11:33:23.201490] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.888 [2024-10-07 11:33:23.201513] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.888 [2024-10-07 11:33:23.201527] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.888 [2024-10-07 11:33:23.215462] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.888 [2024-10-07 11:33:23.215525] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.888 [2024-10-07 11:33:23.215617] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.888 [2024-10-07 11:33:23.215662] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.888 [2024-10-07 11:33:23.215682] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.888 [2024-10-07 11:33:23.215732] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.888 [2024-10-07 11:33:23.215756] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.888 [2024-10-07 11:33:23.215771] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.888 [2024-10-07 11:33:23.216162] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.888 [2024-10-07 11:33:23.216194] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.888 [2024-10-07 11:33:23.216331] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.888 [2024-10-07 11:33:23.216366] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.888 [2024-10-07 11:33:23.216384] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.888 [2024-10-07 11:33:23.216401] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.888 [2024-10-07 11:33:23.216431] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.888 [2024-10-07 11:33:23.216445] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.888 [2024-10-07 11:33:23.216472] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.888 [2024-10-07 11:33:23.216487] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.888 [2024-10-07 11:33:23.229919] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.888 [2024-10-07 11:33:23.229968] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.888 [2024-10-07 11:33:23.230500] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.888 [2024-10-07 11:33:23.230545] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.888 [2024-10-07 11:33:23.230565] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.888 [2024-10-07 11:33:23.230616] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.888 [2024-10-07 11:33:23.230641] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.888 [2024-10-07 11:33:23.230673] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.888 [2024-10-07 11:33:23.231019] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.888 [2024-10-07 11:33:23.231062] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.888 [2024-10-07 11:33:23.231660] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.888 [2024-10-07 11:33:23.231696] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.888 [2024-10-07 11:33:23.231713] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.888 [2024-10-07 11:33:23.231731] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.888 [2024-10-07 11:33:23.231745] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.888 [2024-10-07 11:33:23.231758] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.888 [2024-10-07 11:33:23.232122] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.888 [2024-10-07 11:33:23.232148] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.888 [2024-10-07 11:33:23.243443] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.888 [2024-10-07 11:33:23.243492] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.888 [2024-10-07 11:33:23.243852] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.888 [2024-10-07 11:33:23.243895] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.888 [2024-10-07 11:33:23.243915] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.888 [2024-10-07 11:33:23.243966] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.888 [2024-10-07 11:33:23.243989] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.888 [2024-10-07 11:33:23.244004] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.888 [2024-10-07 11:33:23.244280] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.888 [2024-10-07 11:33:23.244323] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.888 [2024-10-07 11:33:23.244381] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.888 [2024-10-07 11:33:23.244404] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.888 [2024-10-07 11:33:23.244419] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.888 [2024-10-07 11:33:23.244436] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.888 [2024-10-07 11:33:23.244451] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.888 [2024-10-07 11:33:23.244463] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.888 [2024-10-07 11:33:23.244486] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.888 [2024-10-07 11:33:23.244501] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.888 [2024-10-07 11:33:23.253829] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.888 [2024-10-07 11:33:23.253876] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.888 [2024-10-07 11:33:23.255082] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.888 [2024-10-07 11:33:23.255126] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.888 [2024-10-07 11:33:23.255146] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.888 [2024-10-07 11:33:23.255209] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.888 [2024-10-07 11:33:23.255235] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.888 [2024-10-07 11:33:23.255250] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.888 [2024-10-07 11:33:23.256776] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.888 [2024-10-07 11:33:23.256821] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.888 [2024-10-07 11:33:23.257324] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.888 [2024-10-07 11:33:23.257362] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.888 [2024-10-07 11:33:23.257379] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.888 [2024-10-07 11:33:23.257397] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.888 [2024-10-07 11:33:23.257413] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.888 [2024-10-07 11:33:23.257426] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.888 [2024-10-07 11:33:23.257743] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.888 [2024-10-07 11:33:23.257770] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.888 [2024-10-07 11:33:23.267838] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.888 [2024-10-07 11:33:23.267883] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.888 [2024-10-07 11:33:23.268197] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.888 [2024-10-07 11:33:23.268256] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.888 [2024-10-07 11:33:23.268278] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.888 [2024-10-07 11:33:23.268331] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.888 [2024-10-07 11:33:23.268354] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.888 [2024-10-07 11:33:23.268369] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.888 [2024-10-07 11:33:23.268496] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.888 [2024-10-07 11:33:23.268523] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.888 [2024-10-07 11:33:23.268615] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.888 [2024-10-07 11:33:23.268633] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.888 [2024-10-07 11:33:23.268647] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.888 [2024-10-07 11:33:23.268693] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.888 [2024-10-07 11:33:23.268711] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.888 [2024-10-07 11:33:23.268724] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.888 [2024-10-07 11:33:23.269660] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.888 [2024-10-07 11:33:23.269720] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.888 [2024-10-07 11:33:23.278336] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.888 [2024-10-07 11:33:23.278384] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.888 [2024-10-07 11:33:23.278636] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.888 [2024-10-07 11:33:23.278668] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.888 [2024-10-07 11:33:23.278685] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.888 [2024-10-07 11:33:23.278753] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.888 [2024-10-07 11:33:23.278777] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.888 [2024-10-07 11:33:23.278792] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.889 [2024-10-07 11:33:23.278896] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.889 [2024-10-07 11:33:23.278936] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.889 [2024-10-07 11:33:23.279030] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.889 [2024-10-07 11:33:23.279048] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.889 [2024-10-07 11:33:23.279062] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.889 [2024-10-07 11:33:23.279078] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.889 [2024-10-07 11:33:23.279093] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.889 [2024-10-07 11:33:23.279120] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.889 [2024-10-07 11:33:23.279313] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.889 [2024-10-07 11:33:23.279339] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.889 [2024-10-07 11:33:23.291487] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.889 [2024-10-07 11:33:23.291551] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.889 [2024-10-07 11:33:23.291926] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.889 [2024-10-07 11:33:23.291967] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.889 [2024-10-07 11:33:23.291986] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.889 [2024-10-07 11:33:23.292052] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.889 [2024-10-07 11:33:23.292076] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.889 [2024-10-07 11:33:23.292091] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.889 [2024-10-07 11:33:23.292145] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.889 [2024-10-07 11:33:23.292170] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.889 [2024-10-07 11:33:23.292190] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.889 [2024-10-07 11:33:23.292204] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.889 [2024-10-07 11:33:23.292217] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.889 [2024-10-07 11:33:23.292233] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.889 [2024-10-07 11:33:23.292247] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.889 [2024-10-07 11:33:23.292259] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.889 [2024-10-07 11:33:23.292281] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.889 [2024-10-07 11:33:23.292295] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.889 [2024-10-07 11:33:23.305669] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.889 [2024-10-07 11:33:23.305746] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.889 [2024-10-07 11:33:23.306515] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.889 [2024-10-07 11:33:23.306559] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.889 [2024-10-07 11:33:23.306580] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.889 [2024-10-07 11:33:23.306631] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.889 [2024-10-07 11:33:23.306670] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.889 [2024-10-07 11:33:23.306688] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.889 [2024-10-07 11:33:23.307121] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.889 [2024-10-07 11:33:23.307179] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.889 [2024-10-07 11:33:23.307432] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.889 [2024-10-07 11:33:23.307469] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.889 [2024-10-07 11:33:23.307487] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.889 [2024-10-07 11:33:23.307504] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.889 [2024-10-07 11:33:23.307519] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.889 [2024-10-07 11:33:23.307547] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.889 [2024-10-07 11:33:23.307618] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.889 [2024-10-07 11:33:23.307639] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.889 [2024-10-07 11:33:23.316901] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.889 [2024-10-07 11:33:23.316948] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.889 [2024-10-07 11:33:23.317148] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.889 [2024-10-07 11:33:23.317180] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.889 [2024-10-07 11:33:23.317197] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.889 [2024-10-07 11:33:23.317246] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.889 [2024-10-07 11:33:23.317269] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.889 [2024-10-07 11:33:23.317285] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.889 [2024-10-07 11:33:23.317401] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.889 [2024-10-07 11:33:23.317425] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.889 [2024-10-07 11:33:23.318185] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.889 [2024-10-07 11:33:23.318221] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.889 [2024-10-07 11:33:23.318254] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.889 [2024-10-07 11:33:23.318271] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.889 [2024-10-07 11:33:23.318285] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.889 [2024-10-07 11:33:23.318297] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.889 [2024-10-07 11:33:23.321063] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.889 [2024-10-07 11:33:23.321101] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.889 [2024-10-07 11:33:23.327026] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.889 [2024-10-07 11:33:23.329321] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.889 [2024-10-07 11:33:23.329449] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.889 [2024-10-07 11:33:23.329479] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.889 [2024-10-07 11:33:23.329510] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.889 [2024-10-07 11:33:23.330267] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.889 [2024-10-07 11:33:23.330323] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.889 [2024-10-07 11:33:23.330342] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.889 [2024-10-07 11:33:23.330361] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.889 [2024-10-07 11:33:23.330693] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.889 [2024-10-07 11:33:23.330724] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.889 [2024-10-07 11:33:23.330739] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.889 [2024-10-07 11:33:23.330753] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.889 [2024-10-07 11:33:23.330915] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.889 [2024-10-07 11:33:23.330940] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.889 [2024-10-07 11:33:23.330954] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.889 [2024-10-07 11:33:23.330968] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.889 [2024-10-07 11:33:23.331091] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.889 [2024-10-07 11:33:23.337119] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.889 [2024-10-07 11:33:23.337249] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.889 [2024-10-07 11:33:23.337280] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.889 [2024-10-07 11:33:23.337296] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.889 [2024-10-07 11:33:23.337320] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.889 [2024-10-07 11:33:23.337342] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.889 [2024-10-07 11:33:23.337356] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.889 [2024-10-07 11:33:23.337370] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.889 [2024-10-07 11:33:23.337422] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.889 [2024-10-07 11:33:23.340919] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.889 [2024-10-07 11:33:23.341159] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.889 [2024-10-07 11:33:23.341197] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.889 [2024-10-07 11:33:23.341216] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.889 [2024-10-07 11:33:23.341345] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.889 [2024-10-07 11:33:23.341489] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.889 [2024-10-07 11:33:23.341511] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.889 [2024-10-07 11:33:23.341541] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.889 [2024-10-07 11:33:23.342661] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.889 [2024-10-07 11:33:23.349703] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.889 [2024-10-07 11:33:23.350071] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.889 [2024-10-07 11:33:23.350116] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.889 [2024-10-07 11:33:23.350137] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.889 [2024-10-07 11:33:23.350198] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.889 [2024-10-07 11:33:23.350228] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.889 [2024-10-07 11:33:23.350243] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.890 [2024-10-07 11:33:23.350257] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.890 [2024-10-07 11:33:23.350281] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.890 [2024-10-07 11:33:23.351494] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.890 [2024-10-07 11:33:23.351598] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.890 [2024-10-07 11:33:23.351627] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.890 [2024-10-07 11:33:23.351643] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.890 [2024-10-07 11:33:23.351694] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.890 [2024-10-07 11:33:23.351718] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.890 [2024-10-07 11:33:23.351733] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.890 [2024-10-07 11:33:23.351747] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.890 [2024-10-07 11:33:23.351770] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.890 [2024-10-07 11:33:23.361107] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.890 [2024-10-07 11:33:23.362313] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.890 [2024-10-07 11:33:23.362347] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.890 [2024-10-07 11:33:23.362365] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.890 [2024-10-07 11:33:23.363998] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.890 [2024-10-07 11:33:23.364312] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.890 [2024-10-07 11:33:23.364369] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.890 [2024-10-07 11:33:23.364388] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.890 [2024-10-07 11:33:23.364402] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.890 [2024-10-07 11:33:23.364459] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.890 [2024-10-07 11:33:23.364539] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.890 [2024-10-07 11:33:23.364566] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.890 [2024-10-07 11:33:23.364583] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.890 [2024-10-07 11:33:23.364607] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.890 [2024-10-07 11:33:23.364630] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.890 [2024-10-07 11:33:23.364644] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.890 [2024-10-07 11:33:23.364675] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.890 [2024-10-07 11:33:23.364700] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.890 [2024-10-07 11:33:23.371178] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.890 [2024-10-07 11:33:23.371312] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.890 [2024-10-07 11:33:23.371343] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.890 [2024-10-07 11:33:23.371359] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.890 [2024-10-07 11:33:23.371383] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.890 [2024-10-07 11:33:23.371406] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.890 [2024-10-07 11:33:23.371420] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.890 [2024-10-07 11:33:23.371434] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.890 [2024-10-07 11:33:23.371457] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.890 [2024-10-07 11:33:23.375125] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.890 [2024-10-07 11:33:23.376328] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.890 [2024-10-07 11:33:23.376387] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.890 [2024-10-07 11:33:23.376407] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.890 [2024-10-07 11:33:23.376609] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.890 [2024-10-07 11:33:23.376813] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.890 [2024-10-07 11:33:23.376840] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.890 [2024-10-07 11:33:23.376855] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.890 [2024-10-07 11:33:23.376911] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.890 [2024-10-07 11:33:23.381905] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.890 [2024-10-07 11:33:23.382084] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.890 [2024-10-07 11:33:23.382114] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.890 [2024-10-07 11:33:23.382129] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.890 [2024-10-07 11:33:23.382152] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.890 [2024-10-07 11:33:23.382188] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.890 [2024-10-07 11:33:23.382203] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.890 [2024-10-07 11:33:23.382215] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.890 [2024-10-07 11:33:23.382238] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.890 [2024-10-07 11:33:23.385223] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.890 [2024-10-07 11:33:23.385340] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.890 [2024-10-07 11:33:23.385369] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.890 [2024-10-07 11:33:23.385385] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.890 [2024-10-07 11:33:23.386138] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.890 [2024-10-07 11:33:23.386528] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.890 [2024-10-07 11:33:23.386567] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.890 [2024-10-07 11:33:23.386585] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.890 [2024-10-07 11:33:23.386754] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.890 [2024-10-07 11:33:23.392973] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.890 [2024-10-07 11:33:23.393095] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.890 [2024-10-07 11:33:23.393125] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.890 [2024-10-07 11:33:23.393142] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.890 [2024-10-07 11:33:23.393166] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.890 [2024-10-07 11:33:23.393188] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.890 [2024-10-07 11:33:23.393202] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.890 [2024-10-07 11:33:23.393216] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.890 [2024-10-07 11:33:23.393239] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.890 [2024-10-07 11:33:23.395779] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.890 [2024-10-07 11:33:23.395908] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.890 [2024-10-07 11:33:23.395938] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.890 [2024-10-07 11:33:23.395955] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.890 [2024-10-07 11:33:23.395994] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.890 [2024-10-07 11:33:23.396016] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.890 [2024-10-07 11:33:23.396031] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.890 [2024-10-07 11:33:23.396045] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.890 [2024-10-07 11:33:23.396083] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.890 [2024-10-07 11:33:23.405636] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.890 [2024-10-07 11:33:23.405815] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.890 [2024-10-07 11:33:23.405847] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.890 [2024-10-07 11:33:23.405864] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.890 [2024-10-07 11:33:23.406514] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.890 [2024-10-07 11:33:23.407522] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.890 [2024-10-07 11:33:23.407560] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.890 [2024-10-07 11:33:23.407577] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.890 [2024-10-07 11:33:23.407996] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.890 [2024-10-07 11:33:23.408038] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.890 [2024-10-07 11:33:23.408327] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.890 [2024-10-07 11:33:23.408369] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.890 [2024-10-07 11:33:23.408388] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.890 [2024-10-07 11:33:23.408441] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.890 [2024-10-07 11:33:23.408469] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.890 [2024-10-07 11:33:23.408484] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.890 [2024-10-07 11:33:23.408497] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.890 [2024-10-07 11:33:23.408520] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.890 [2024-10-07 11:33:23.420954] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.890 [2024-10-07 11:33:23.420999] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.890 [2024-10-07 11:33:23.421159] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.890 [2024-10-07 11:33:23.421189] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.890 [2024-10-07 11:33:23.421206] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.890 [2024-10-07 11:33:23.421254] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.890 [2024-10-07 11:33:23.421277] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.890 [2024-10-07 11:33:23.421292] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.890 [2024-10-07 11:33:23.421326] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.890 [2024-10-07 11:33:23.421348] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.890 [2024-10-07 11:33:23.421367] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.890 [2024-10-07 11:33:23.421395] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.890 [2024-10-07 11:33:23.421410] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.890 [2024-10-07 11:33:23.421440] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.890 [2024-10-07 11:33:23.421455] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.890 [2024-10-07 11:33:23.421467] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.890 [2024-10-07 11:33:23.421623] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.890 [2024-10-07 11:33:23.421648] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.890 [2024-10-07 11:33:23.431402] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.890 [2024-10-07 11:33:23.431450] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.890 [2024-10-07 11:33:23.431551] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.891 [2024-10-07 11:33:23.431580] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.891 [2024-10-07 11:33:23.431596] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.891 [2024-10-07 11:33:23.431642] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.891 [2024-10-07 11:33:23.431690] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.891 [2024-10-07 11:33:23.431723] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.891 [2024-10-07 11:33:23.431747] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.891 [2024-10-07 11:33:23.431766] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.891 [2024-10-07 11:33:23.431785] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.891 [2024-10-07 11:33:23.431799] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.891 [2024-10-07 11:33:23.431812] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.891 [2024-10-07 11:33:23.431827] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.891 [2024-10-07 11:33:23.431841] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.891 [2024-10-07 11:33:23.431854] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.891 [2024-10-07 11:33:23.431875] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.891 [2024-10-07 11:33:23.431889] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.891 [2024-10-07 11:33:23.442028] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.891 [2024-10-07 11:33:23.442078] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.891 [2024-10-07 11:33:23.442192] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.891 [2024-10-07 11:33:23.442223] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.891 [2024-10-07 11:33:23.442240] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.891 [2024-10-07 11:33:23.442307] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.891 [2024-10-07 11:33:23.442332] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.891 [2024-10-07 11:33:23.442348] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.891 [2024-10-07 11:33:23.442372] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.891 [2024-10-07 11:33:23.442392] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.891 [2024-10-07 11:33:23.442412] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.891 [2024-10-07 11:33:23.442426] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.891 [2024-10-07 11:33:23.442441] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.891 [2024-10-07 11:33:23.442458] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.891 [2024-10-07 11:33:23.442473] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.891 [2024-10-07 11:33:23.442485] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.891 [2024-10-07 11:33:23.442509] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.891 [2024-10-07 11:33:23.442523] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.891 [2024-10-07 11:33:23.452925] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.891 [2024-10-07 11:33:23.452983] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.891 [2024-10-07 11:33:23.453141] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.891 [2024-10-07 11:33:23.453200] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.891 [2024-10-07 11:33:23.453224] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.891 [2024-10-07 11:33:23.453282] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.891 [2024-10-07 11:33:23.453307] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.891 [2024-10-07 11:33:23.453323] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.891 [2024-10-07 11:33:23.453365] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.891 [2024-10-07 11:33:23.453391] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.891 [2024-10-07 11:33:23.453411] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.891 [2024-10-07 11:33:23.453426] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.891 [2024-10-07 11:33:23.453451] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.891 [2024-10-07 11:33:23.453468] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.891 [2024-10-07 11:33:23.453482] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.891 [2024-10-07 11:33:23.453495] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.891 [2024-10-07 11:33:23.453518] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.891 [2024-10-07 11:33:23.453533] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.891 [2024-10-07 11:33:23.466226] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.891 [2024-10-07 11:33:23.466281] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.891 [2024-10-07 11:33:23.466526] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.891 [2024-10-07 11:33:23.466570] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.891 [2024-10-07 11:33:23.466591] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.891 [2024-10-07 11:33:23.466643] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.891 [2024-10-07 11:33:23.466682] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.891 [2024-10-07 11:33:23.466698] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.891 [2024-10-07 11:33:23.467312] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.891 [2024-10-07 11:33:23.467367] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.891 [2024-10-07 11:33:23.468299] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.891 [2024-10-07 11:33:23.468352] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.891 [2024-10-07 11:33:23.468376] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.891 [2024-10-07 11:33:23.468399] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.891 [2024-10-07 11:33:23.468419] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.891 [2024-10-07 11:33:23.468437] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.891 [2024-10-07 11:33:23.469157] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.891 [2024-10-07 11:33:23.469197] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.891 [2024-10-07 11:33:23.476775] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.891 [2024-10-07 11:33:23.476827] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.891 [2024-10-07 11:33:23.477013] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.891 [2024-10-07 11:33:23.477060] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.891 [2024-10-07 11:33:23.477081] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.891 [2024-10-07 11:33:23.477135] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.891 [2024-10-07 11:33:23.477159] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.891 [2024-10-07 11:33:23.477174] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.891 [2024-10-07 11:33:23.477289] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.891 [2024-10-07 11:33:23.477317] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.891 [2024-10-07 11:33:23.477913] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.891 [2024-10-07 11:33:23.477959] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.891 [2024-10-07 11:33:23.478000] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.891 [2024-10-07 11:33:23.478033] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.891 [2024-10-07 11:33:23.478053] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.891 [2024-10-07 11:33:23.478070] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.891 [2024-10-07 11:33:23.480370] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.891 [2024-10-07 11:33:23.480410] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.891 [2024-10-07 11:33:23.486899] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.891 [2024-10-07 11:33:23.487307] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.891 [2024-10-07 11:33:23.487414] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.891 [2024-10-07 11:33:23.487445] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.891 [2024-10-07 11:33:23.487461] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.891 [2024-10-07 11:33:23.487696] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.891 [2024-10-07 11:33:23.487737] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.891 [2024-10-07 11:33:23.487756] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.891 [2024-10-07 11:33:23.487776] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.891 [2024-10-07 11:33:23.487909] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.891 [2024-10-07 11:33:23.487936] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.891 [2024-10-07 11:33:23.487951] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.891 [2024-10-07 11:33:23.487965] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.891 [2024-10-07 11:33:23.488083] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.891 [2024-10-07 11:33:23.488130] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.891 [2024-10-07 11:33:23.488153] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.891 [2024-10-07 11:33:23.488176] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.891 [2024-10-07 11:33:23.488295] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.891 [2024-10-07 11:33:23.500973] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.891 [2024-10-07 11:33:23.501038] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.891 [2024-10-07 11:33:23.501874] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.891 [2024-10-07 11:33:23.501923] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.891 [2024-10-07 11:33:23.501953] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.891 [2024-10-07 11:33:23.502019] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.891 [2024-10-07 11:33:23.502049] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.891 [2024-10-07 11:33:23.502091] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.891 [2024-10-07 11:33:23.502234] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.891 [2024-10-07 11:33:23.502272] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.891 [2024-10-07 11:33:23.502313] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.891 [2024-10-07 11:33:23.502335] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.891 [2024-10-07 11:33:23.502355] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.891 [2024-10-07 11:33:23.502376] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.891 [2024-10-07 11:33:23.502396] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.891 [2024-10-07 11:33:23.502418] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.891 [2024-10-07 11:33:23.502451] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.892 [2024-10-07 11:33:23.502469] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.892 [2024-10-07 11:33:23.514325] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.892 [2024-10-07 11:33:23.514380] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.892 [2024-10-07 11:33:23.514664] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.892 [2024-10-07 11:33:23.514708] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.892 [2024-10-07 11:33:23.514753] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.892 [2024-10-07 11:33:23.514813] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.892 [2024-10-07 11:33:23.514838] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.892 [2024-10-07 11:33:23.514854] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.892 [2024-10-07 11:33:23.516037] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.892 [2024-10-07 11:33:23.516087] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.892 [2024-10-07 11:33:23.516218] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.892 [2024-10-07 11:33:23.516242] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.892 [2024-10-07 11:33:23.516257] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.892 [2024-10-07 11:33:23.516274] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.892 [2024-10-07 11:33:23.516288] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.892 [2024-10-07 11:33:23.516302] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.892 [2024-10-07 11:33:23.516326] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.892 [2024-10-07 11:33:23.516341] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.892 [2024-10-07 11:33:23.524451] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.892 [2024-10-07 11:33:23.524549] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.892 [2024-10-07 11:33:23.524643] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.892 [2024-10-07 11:33:23.524690] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.892 [2024-10-07 11:33:23.524707] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.892 [2024-10-07 11:33:23.524767] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.892 [2024-10-07 11:33:23.524793] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.892 [2024-10-07 11:33:23.524808] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.892 [2024-10-07 11:33:23.524826] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.892 [2024-10-07 11:33:23.526125] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.892 [2024-10-07 11:33:23.526169] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.892 [2024-10-07 11:33:23.526187] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.892 [2024-10-07 11:33:23.526201] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.892 [2024-10-07 11:33:23.528097] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.892 [2024-10-07 11:33:23.528146] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.892 [2024-10-07 11:33:23.528170] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.892 [2024-10-07 11:33:23.528190] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.892 [2024-10-07 11:33:23.528222] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.892 [2024-10-07 11:33:23.535944] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.892 [2024-10-07 11:33:23.536001] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.892 [2024-10-07 11:33:23.536104] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.892 [2024-10-07 11:33:23.536144] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.892 [2024-10-07 11:33:23.536161] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.892 [2024-10-07 11:33:23.536208] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.892 [2024-10-07 11:33:23.536231] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.892 [2024-10-07 11:33:23.536246] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.892 [2024-10-07 11:33:23.536280] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.892 [2024-10-07 11:33:23.536306] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.892 [2024-10-07 11:33:23.536332] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.892 [2024-10-07 11:33:23.536351] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.892 [2024-10-07 11:33:23.536370] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.892 [2024-10-07 11:33:23.536411] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.892 [2024-10-07 11:33:23.536433] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.892 [2024-10-07 11:33:23.536451] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.892 [2024-10-07 11:33:23.536480] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.892 [2024-10-07 11:33:23.536499] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.892 [2024-10-07 11:33:23.548689] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.892 [2024-10-07 11:33:23.548753] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.892 [2024-10-07 11:33:23.549453] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.892 [2024-10-07 11:33:23.549507] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.892 [2024-10-07 11:33:23.549533] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.892 [2024-10-07 11:33:23.549599] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.892 [2024-10-07 11:33:23.549632] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.892 [2024-10-07 11:33:23.549677] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.892 [2024-10-07 11:33:23.550386] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.892 [2024-10-07 11:33:23.550430] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.892 [2024-10-07 11:33:23.550527] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.892 [2024-10-07 11:33:23.550550] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.892 [2024-10-07 11:33:23.550572] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.892 [2024-10-07 11:33:23.550595] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.892 [2024-10-07 11:33:23.550614] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.892 [2024-10-07 11:33:23.550632] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.892 [2024-10-07 11:33:23.550689] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.892 [2024-10-07 11:33:23.550710] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.892 [2024-10-07 11:33:23.560273] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.892 [2024-10-07 11:33:23.560326] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.892 [2024-10-07 11:33:23.560520] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.892 [2024-10-07 11:33:23.560563] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.892 [2024-10-07 11:33:23.560583] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.892 [2024-10-07 11:33:23.560635] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.892 [2024-10-07 11:33:23.560673] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.892 [2024-10-07 11:33:23.560702] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.892 [2024-10-07 11:33:23.560829] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.892 [2024-10-07 11:33:23.560857] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.892 [2024-10-07 11:33:23.560967] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.892 [2024-10-07 11:33:23.560995] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.892 [2024-10-07 11:33:23.561014] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.892 [2024-10-07 11:33:23.561035] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.892 [2024-10-07 11:33:23.561055] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.892 [2024-10-07 11:33:23.561082] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.892 [2024-10-07 11:33:23.562834] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.892 [2024-10-07 11:33:23.562886] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.892 [2024-10-07 11:33:23.570399] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.892 [2024-10-07 11:33:23.570475] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.892 [2024-10-07 11:33:23.570576] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.892 [2024-10-07 11:33:23.570611] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.892 [2024-10-07 11:33:23.570632] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.892 [2024-10-07 11:33:23.570884] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.892 [2024-10-07 11:33:23.570928] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.892 [2024-10-07 11:33:23.570948] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.892 [2024-10-07 11:33:23.570967] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.892 [2024-10-07 11:33:23.571111] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.892 [2024-10-07 11:33:23.571153] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.892 [2024-10-07 11:33:23.571172] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.892 [2024-10-07 11:33:23.571199] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.892 [2024-10-07 11:33:23.571338] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.892 [2024-10-07 11:33:23.571361] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.892 [2024-10-07 11:33:23.571375] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.892 [2024-10-07 11:33:23.571388] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.892 [2024-10-07 11:33:23.571515] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.892 [2024-10-07 11:33:23.580614] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.893 [2024-10-07 11:33:23.580704] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.893 [2024-10-07 11:33:23.580814] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.893 [2024-10-07 11:33:23.580846] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.893 [2024-10-07 11:33:23.580862] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.893 [2024-10-07 11:33:23.580911] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.893 [2024-10-07 11:33:23.580935] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.893 [2024-10-07 11:33:23.580951] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.893 [2024-10-07 11:33:23.580975] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.893 [2024-10-07 11:33:23.580996] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.893 [2024-10-07 11:33:23.581016] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.893 [2024-10-07 11:33:23.581030] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.893 [2024-10-07 11:33:23.581044] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.893 [2024-10-07 11:33:23.581060] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.893 [2024-10-07 11:33:23.581074] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.893 [2024-10-07 11:33:23.581087] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.893 [2024-10-07 11:33:23.581109] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.893 [2024-10-07 11:33:23.581124] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.893 [2024-10-07 11:33:23.591345] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.893 [2024-10-07 11:33:23.591406] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.893 [2024-10-07 11:33:23.591642] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.893 [2024-10-07 11:33:23.591711] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.893 [2024-10-07 11:33:23.591739] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.893 [2024-10-07 11:33:23.591801] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.893 [2024-10-07 11:33:23.591826] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.893 [2024-10-07 11:33:23.591842] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.893 [2024-10-07 11:33:23.591962] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.893 [2024-10-07 11:33:23.591990] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.893 [2024-10-07 11:33:23.592097] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.893 [2024-10-07 11:33:23.592125] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.893 [2024-10-07 11:33:23.592139] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.893 [2024-10-07 11:33:23.592156] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.893 [2024-10-07 11:33:23.592189] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.893 [2024-10-07 11:33:23.592204] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.893 [2024-10-07 11:33:23.593451] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.893 [2024-10-07 11:33:23.593490] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.893 [2024-10-07 11:33:23.601995] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.893 [2024-10-07 11:33:23.602045] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.893 [2024-10-07 11:33:23.602223] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.893 [2024-10-07 11:33:23.602271] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.893 [2024-10-07 11:33:23.602291] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.893 [2024-10-07 11:33:23.602354] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.893 [2024-10-07 11:33:23.602384] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.893 [2024-10-07 11:33:23.602409] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.893 [2024-10-07 11:33:23.602547] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.893 [2024-10-07 11:33:23.602584] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.893 [2024-10-07 11:33:23.605891] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.893 [2024-10-07 11:33:23.605945] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.893 [2024-10-07 11:33:23.605969] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.893 [2024-10-07 11:33:23.605992] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.893 [2024-10-07 11:33:23.606011] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.893 [2024-10-07 11:33:23.606030] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.893 [2024-10-07 11:33:23.606258] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.893 [2024-10-07 11:33:23.606286] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.893 [2024-10-07 11:33:23.612453] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.893 [2024-10-07 11:33:23.612512] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.893 [2024-10-07 11:33:23.612669] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.893 [2024-10-07 11:33:23.612712] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.893 [2024-10-07 11:33:23.612742] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.893 [2024-10-07 11:33:23.612830] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.893 [2024-10-07 11:33:23.612868] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.893 [2024-10-07 11:33:23.612896] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.893 [2024-10-07 11:33:23.612957] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.893 [2024-10-07 11:33:23.612994] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.893 [2024-10-07 11:33:23.613029] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.893 [2024-10-07 11:33:23.613055] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.893 [2024-10-07 11:33:23.613078] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.893 [2024-10-07 11:33:23.613105] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.893 [2024-10-07 11:33:23.613129] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.893 [2024-10-07 11:33:23.613151] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.893 [2024-10-07 11:33:23.613188] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.893 [2024-10-07 11:33:23.613213] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.893 [2024-10-07 11:33:23.624807] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.893 [2024-10-07 11:33:23.624874] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.893 [2024-10-07 11:33:23.625217] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.893 [2024-10-07 11:33:23.625267] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.893 [2024-10-07 11:33:23.625300] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.893 [2024-10-07 11:33:23.625386] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.893 [2024-10-07 11:33:23.625429] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.893 [2024-10-07 11:33:23.625456] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.893 [2024-10-07 11:33:23.625523] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.893 [2024-10-07 11:33:23.625562] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.893 [2024-10-07 11:33:23.625903] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.893 [2024-10-07 11:33:23.625945] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.893 [2024-10-07 11:33:23.625975] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.893 [2024-10-07 11:33:23.626011] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.893 [2024-10-07 11:33:23.626035] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.893 [2024-10-07 11:33:23.626057] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.893 [2024-10-07 11:33:23.626263] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.893 [2024-10-07 11:33:23.626297] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.893 [2024-10-07 11:33:23.639674] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.893 [2024-10-07 11:33:23.639730] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.893 [2024-10-07 11:33:23.639962] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.893 [2024-10-07 11:33:23.640013] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.893 [2024-10-07 11:33:23.640045] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.893 [2024-10-07 11:33:23.640128] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.893 [2024-10-07 11:33:23.640165] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.893 [2024-10-07 11:33:23.640193] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.893 [2024-10-07 11:33:23.640232] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.893 [2024-10-07 11:33:23.640266] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.893 [2024-10-07 11:33:23.640318] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.893 [2024-10-07 11:33:23.640343] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.893 [2024-10-07 11:33:23.640367] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.893 [2024-10-07 11:33:23.640393] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.893 [2024-10-07 11:33:23.640418] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.893 [2024-10-07 11:33:23.640440] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.893 [2024-10-07 11:33:23.640478] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.893 [2024-10-07 11:33:23.640503] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.893 [2024-10-07 11:33:23.652759] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.893 [2024-10-07 11:33:23.652817] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.893 [2024-10-07 11:33:23.653009] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.893 [2024-10-07 11:33:23.653058] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.893 [2024-10-07 11:33:23.653090] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.893 [2024-10-07 11:33:23.653173] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.893 [2024-10-07 11:33:23.653211] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.893 [2024-10-07 11:33:23.653239] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.893 [2024-10-07 11:33:23.653280] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.893 [2024-10-07 11:33:23.653315] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.893 [2024-10-07 11:33:23.653347] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.893 [2024-10-07 11:33:23.653373] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.894 [2024-10-07 11:33:23.653402] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.894 [2024-10-07 11:33:23.653429] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.894 [2024-10-07 11:33:23.653473] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.894 [2024-10-07 11:33:23.653498] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.894 [2024-10-07 11:33:23.653537] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.894 [2024-10-07 11:33:23.653563] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.894 [2024-10-07 11:33:23.663828] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.894 [2024-10-07 11:33:23.663890] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.894 [2024-10-07 11:33:23.664015] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.894 [2024-10-07 11:33:23.664046] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.894 [2024-10-07 11:33:23.664063] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.894 [2024-10-07 11:33:23.664113] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.894 [2024-10-07 11:33:23.664137] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.894 [2024-10-07 11:33:23.664152] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.894 [2024-10-07 11:33:23.664176] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.894 [2024-10-07 11:33:23.664196] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.894 [2024-10-07 11:33:23.664216] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.894 [2024-10-07 11:33:23.664230] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.894 [2024-10-07 11:33:23.664244] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.894 [2024-10-07 11:33:23.664261] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.894 [2024-10-07 11:33:23.664275] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.894 [2024-10-07 11:33:23.664288] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.894 [2024-10-07 11:33:23.664311] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.894 [2024-10-07 11:33:23.664326] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.894 [2024-10-07 11:33:23.675011] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.894 [2024-10-07 11:33:23.675081] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.894 [2024-10-07 11:33:23.675368] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.894 [2024-10-07 11:33:23.675424] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.894 [2024-10-07 11:33:23.675457] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.894 [2024-10-07 11:33:23.675542] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.894 [2024-10-07 11:33:23.675580] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.894 [2024-10-07 11:33:23.675608] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.894 [2024-10-07 11:33:23.675792] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.894 [2024-10-07 11:33:23.675871] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.894 [2024-10-07 11:33:23.676034] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.894 [2024-10-07 11:33:23.676079] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.894 [2024-10-07 11:33:23.676108] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.894 [2024-10-07 11:33:23.676138] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.894 [2024-10-07 11:33:23.676180] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.894 [2024-10-07 11:33:23.676203] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.894 [2024-10-07 11:33:23.677243] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.894 [2024-10-07 11:33:23.677286] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.894 [2024-10-07 11:33:23.685168] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.894 [2024-10-07 11:33:23.685243] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.894 [2024-10-07 11:33:23.685356] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.894 [2024-10-07 11:33:23.685399] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.894 [2024-10-07 11:33:23.685431] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.894 [2024-10-07 11:33:23.685764] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.894 [2024-10-07 11:33:23.685812] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.894 [2024-10-07 11:33:23.685843] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.894 [2024-10-07 11:33:23.685876] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.894 [2024-10-07 11:33:23.686113] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.894 [2024-10-07 11:33:23.686158] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.894 [2024-10-07 11:33:23.686186] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.894 [2024-10-07 11:33:23.686212] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.894 [2024-10-07 11:33:23.686368] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.894 [2024-10-07 11:33:23.686410] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.894 [2024-10-07 11:33:23.686438] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.894 [2024-10-07 11:33:23.686463] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.894 [2024-10-07 11:33:23.686602] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.894 [2024-10-07 11:33:23.695852] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.894 [2024-10-07 11:33:23.695907] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.894 [2024-10-07 11:33:23.696230] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.894 [2024-10-07 11:33:23.696281] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.894 [2024-10-07 11:33:23.696337] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.894 [2024-10-07 11:33:23.696422] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.894 [2024-10-07 11:33:23.696461] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.894 [2024-10-07 11:33:23.696489] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.894 [2024-10-07 11:33:23.696690] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.894 [2024-10-07 11:33:23.696742] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.894 [2024-10-07 11:33:23.696947] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.894 [2024-10-07 11:33:23.696988] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.894 [2024-10-07 11:33:23.697017] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.894 [2024-10-07 11:33:23.697047] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.894 [2024-10-07 11:33:23.697073] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.894 [2024-10-07 11:33:23.697096] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.894 [2024-10-07 11:33:23.697179] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.894 [2024-10-07 11:33:23.697216] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.894 [2024-10-07 11:33:23.711968] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.894 [2024-10-07 11:33:23.712030] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.894 [2024-10-07 11:33:23.712298] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.894 [2024-10-07 11:33:23.712355] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.894 [2024-10-07 11:33:23.712382] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.894 [2024-10-07 11:33:23.712451] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.894 [2024-10-07 11:33:23.712483] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.894 [2024-10-07 11:33:23.712505] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.894 [2024-10-07 11:33:23.712537] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.894 [2024-10-07 11:33:23.712564] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.894 [2024-10-07 11:33:23.712596] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.894 [2024-10-07 11:33:23.712615] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.894 [2024-10-07 11:33:23.712635] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.894 [2024-10-07 11:33:23.712674] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.894 [2024-10-07 11:33:23.712697] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.894 [2024-10-07 11:33:23.712738] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.894 [2024-10-07 11:33:23.712770] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.894 [2024-10-07 11:33:23.712790] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.894 [2024-10-07 11:33:23.725916] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.894 [2024-10-07 11:33:23.725972] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.894 [2024-10-07 11:33:23.726063] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.894 [2024-10-07 11:33:23.726094] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.894 [2024-10-07 11:33:23.726111] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.894 [2024-10-07 11:33:23.726159] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.894 [2024-10-07 11:33:23.726182] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.894 [2024-10-07 11:33:23.726198] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.894 [2024-10-07 11:33:23.726221] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.894 [2024-10-07 11:33:23.726241] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.894 [2024-10-07 11:33:23.726261] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.894 [2024-10-07 11:33:23.726275] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.894 [2024-10-07 11:33:23.726289] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.894 [2024-10-07 11:33:23.726305] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.894 [2024-10-07 11:33:23.726320] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.894 [2024-10-07 11:33:23.726332] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.894 [2024-10-07 11:33:23.726355] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.894 [2024-10-07 11:33:23.726369] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.894 [2024-10-07 11:33:23.740347] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.894 [2024-10-07 11:33:23.740402] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.894 [2024-10-07 11:33:23.740674] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.894 [2024-10-07 11:33:23.740718] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.894 [2024-10-07 11:33:23.740739] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.894 [2024-10-07 11:33:23.740790] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.894 [2024-10-07 11:33:23.740814] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.894 [2024-10-07 11:33:23.740830] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.895 [2024-10-07 11:33:23.740856] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.895 [2024-10-07 11:33:23.740876] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.895 [2024-10-07 11:33:23.740915] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.895 [2024-10-07 11:33:23.740931] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.895 [2024-10-07 11:33:23.740945] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.895 [2024-10-07 11:33:23.740963] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.895 [2024-10-07 11:33:23.740977] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.895 [2024-10-07 11:33:23.740990] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.895 [2024-10-07 11:33:23.741013] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.895 [2024-10-07 11:33:23.741028] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.895 [2024-10-07 11:33:23.755579] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.895 [2024-10-07 11:33:23.755630] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.895 [2024-10-07 11:33:23.755759] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.895 [2024-10-07 11:33:23.755791] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.895 [2024-10-07 11:33:23.755808] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.895 [2024-10-07 11:33:23.755855] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.895 [2024-10-07 11:33:23.755878] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.895 [2024-10-07 11:33:23.755893] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.895 [2024-10-07 11:33:23.755917] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.895 [2024-10-07 11:33:23.755938] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.895 [2024-10-07 11:33:23.755971] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.895 [2024-10-07 11:33:23.755989] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.895 [2024-10-07 11:33:23.756002] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.895 [2024-10-07 11:33:23.756019] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.895 [2024-10-07 11:33:23.756033] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.895 [2024-10-07 11:33:23.756045] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.895 [2024-10-07 11:33:23.756068] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.895 [2024-10-07 11:33:23.756082] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.895 [2024-10-07 11:33:23.766012] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.895 [2024-10-07 11:33:23.766064] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.895 [2024-10-07 11:33:23.766272] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.895 [2024-10-07 11:33:23.766321] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.895 [2024-10-07 11:33:23.766356] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.895 [2024-10-07 11:33:23.766412] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.895 [2024-10-07 11:33:23.766437] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.895 [2024-10-07 11:33:23.766453] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.895 [2024-10-07 11:33:23.766606] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.895 [2024-10-07 11:33:23.766636] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.895 [2024-10-07 11:33:23.766779] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.895 [2024-10-07 11:33:23.766805] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.895 [2024-10-07 11:33:23.766820] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.895 [2024-10-07 11:33:23.766837] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.895 [2024-10-07 11:33:23.766851] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.895 [2024-10-07 11:33:23.766865] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.895 [2024-10-07 11:33:23.766995] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.895 [2024-10-07 11:33:23.767017] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.895 [2024-10-07 11:33:23.776127] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.895 [2024-10-07 11:33:23.776192] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.895 [2024-10-07 11:33:23.776306] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.895 [2024-10-07 11:33:23.776342] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.895 [2024-10-07 11:33:23.776364] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.895 [2024-10-07 11:33:23.776439] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.895 [2024-10-07 11:33:23.776467] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.895 [2024-10-07 11:33:23.776482] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.895 [2024-10-07 11:33:23.776500] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.895 [2024-10-07 11:33:23.776524] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.895 [2024-10-07 11:33:23.776541] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.895 [2024-10-07 11:33:23.776554] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.895 [2024-10-07 11:33:23.776568] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.895 [2024-10-07 11:33:23.776592] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.895 [2024-10-07 11:33:23.776606] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.895 [2024-10-07 11:33:23.776619] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.895 [2024-10-07 11:33:23.776665] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.895 [2024-10-07 11:33:23.776692] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.895 [2024-10-07 11:33:23.788687] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.895 [2024-10-07 11:33:23.788737] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.895 [2024-10-07 11:33:23.788858] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.895 [2024-10-07 11:33:23.788889] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.895 [2024-10-07 11:33:23.788907] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.895 [2024-10-07 11:33:23.788956] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.895 [2024-10-07 11:33:23.788979] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.895 [2024-10-07 11:33:23.788995] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.895 [2024-10-07 11:33:23.789034] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.895 [2024-10-07 11:33:23.789054] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.895 [2024-10-07 11:33:23.789074] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.895 [2024-10-07 11:33:23.789088] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.895 [2024-10-07 11:33:23.789103] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.895 [2024-10-07 11:33:23.789119] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.895 [2024-10-07 11:33:23.789134] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.895 [2024-10-07 11:33:23.789146] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.895 [2024-10-07 11:33:23.789169] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.895 [2024-10-07 11:33:23.789184] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.895 [2024-10-07 11:33:23.799956] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.895 [2024-10-07 11:33:23.800016] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.895 [2024-10-07 11:33:23.800124] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.895 [2024-10-07 11:33:23.800161] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.895 [2024-10-07 11:33:23.800187] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.895 [2024-10-07 11:33:23.800249] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.895 [2024-10-07 11:33:23.800277] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.895 [2024-10-07 11:33:23.800298] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.895 [2024-10-07 11:33:23.800328] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.895 [2024-10-07 11:33:23.800354] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.895 [2024-10-07 11:33:23.800401] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.895 [2024-10-07 11:33:23.800423] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.895 [2024-10-07 11:33:23.800442] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.895 [2024-10-07 11:33:23.800463] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.895 [2024-10-07 11:33:23.800482] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.895 [2024-10-07 11:33:23.800499] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.895 [2024-10-07 11:33:23.800528] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.895 [2024-10-07 11:33:23.800547] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.895 [2024-10-07 11:33:23.810085] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.895 [2024-10-07 11:33:23.810150] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.895 [2024-10-07 11:33:23.810240] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.895 [2024-10-07 11:33:23.810271] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.895 [2024-10-07 11:33:23.810288] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.895 [2024-10-07 11:33:23.812253] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.895 [2024-10-07 11:33:23.812301] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.895 [2024-10-07 11:33:23.812323] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.895 [2024-10-07 11:33:23.812343] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.895 [2024-10-07 11:33:23.812852] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.895 [2024-10-07 11:33:23.812894] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.895 [2024-10-07 11:33:23.812923] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.895 [2024-10-07 11:33:23.812946] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.895 [2024-10-07 11:33:23.813166] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.895 [2024-10-07 11:33:23.813202] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.895 [2024-10-07 11:33:23.813219] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.895 [2024-10-07 11:33:23.813233] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.895 [2024-10-07 11:33:23.813390] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.895 [2024-10-07 11:33:23.822043] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.895 [2024-10-07 11:33:23.822093] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.895 [2024-10-07 11:33:23.822183] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.895 [2024-10-07 11:33:23.822214] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.896 [2024-10-07 11:33:23.822231] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.896 [2024-10-07 11:33:23.822301] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.896 [2024-10-07 11:33:23.822326] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.896 [2024-10-07 11:33:23.822342] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.896 [2024-10-07 11:33:23.822948] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.896 [2024-10-07 11:33:23.822991] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.896 [2024-10-07 11:33:23.823108] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.896 [2024-10-07 11:33:23.823133] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.896 [2024-10-07 11:33:23.823148] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.896 [2024-10-07 11:33:23.823165] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.896 [2024-10-07 11:33:23.823179] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.896 [2024-10-07 11:33:23.823204] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.896 [2024-10-07 11:33:23.823231] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.896 [2024-10-07 11:33:23.823245] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.896 [2024-10-07 11:33:23.833250] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.896 [2024-10-07 11:33:23.833303] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.896 [2024-10-07 11:33:23.833484] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.896 [2024-10-07 11:33:23.833518] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.896 [2024-10-07 11:33:23.833535] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.896 [2024-10-07 11:33:23.833584] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.896 [2024-10-07 11:33:23.833613] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.896 [2024-10-07 11:33:23.833635] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.896 [2024-10-07 11:33:23.833775] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.896 [2024-10-07 11:33:23.833808] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.896 [2024-10-07 11:33:23.833928] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.896 [2024-10-07 11:33:23.833961] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.896 [2024-10-07 11:33:23.833978] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.896 [2024-10-07 11:33:23.833995] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.896 [2024-10-07 11:33:23.834009] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.896 [2024-10-07 11:33:23.834022] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.896 [2024-10-07 11:33:23.834328] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.896 [2024-10-07 11:33:23.834376] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.896 [2024-10-07 11:33:23.845231] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.896 [2024-10-07 11:33:23.845282] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.896 [2024-10-07 11:33:23.845507] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.896 [2024-10-07 11:33:23.845551] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.896 [2024-10-07 11:33:23.845571] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.896 [2024-10-07 11:33:23.845632] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.896 [2024-10-07 11:33:23.845671] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.896 [2024-10-07 11:33:23.845689] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.896 [2024-10-07 11:33:23.845829] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.896 [2024-10-07 11:33:23.845857] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.896 [2024-10-07 11:33:23.845977] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.896 [2024-10-07 11:33:23.846001] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.896 [2024-10-07 11:33:23.846016] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.896 [2024-10-07 11:33:23.846036] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.896 [2024-10-07 11:33:23.846058] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.896 [2024-10-07 11:33:23.846075] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.896 [2024-10-07 11:33:23.846215] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.896 [2024-10-07 11:33:23.846241] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.896 [2024-10-07 11:33:23.856577] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.896 [2024-10-07 11:33:23.856640] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.896 [2024-10-07 11:33:23.856752] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.896 [2024-10-07 11:33:23.856783] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.896 [2024-10-07 11:33:23.856799] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.896 [2024-10-07 11:33:23.856847] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.896 [2024-10-07 11:33:23.856871] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.896 [2024-10-07 11:33:23.856886] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.896 [2024-10-07 11:33:23.856910] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.896 [2024-10-07 11:33:23.856930] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.896 [2024-10-07 11:33:23.856950] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.896 [2024-10-07 11:33:23.856986] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.896 [2024-10-07 11:33:23.857001] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.896 [2024-10-07 11:33:23.857024] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.896 [2024-10-07 11:33:23.857043] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.896 [2024-10-07 11:33:23.857057] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.896 [2024-10-07 11:33:23.857081] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.896 [2024-10-07 11:33:23.857096] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.896 [2024-10-07 11:33:23.870271] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.896 [2024-10-07 11:33:23.870330] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.896 [2024-10-07 11:33:23.870440] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.896 [2024-10-07 11:33:23.870471] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.896 [2024-10-07 11:33:23.870493] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.896 [2024-10-07 11:33:23.870543] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.896 [2024-10-07 11:33:23.870567] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.896 [2024-10-07 11:33:23.870582] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.896 [2024-10-07 11:33:23.870606] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.896 [2024-10-07 11:33:23.870626] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.896 [2024-10-07 11:33:23.870660] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.896 [2024-10-07 11:33:23.870678] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.896 [2024-10-07 11:33:23.870692] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.896 [2024-10-07 11:33:23.870709] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.896 [2024-10-07 11:33:23.870723] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.896 [2024-10-07 11:33:23.870735] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.896 [2024-10-07 11:33:23.870758] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.896 [2024-10-07 11:33:23.870773] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.896 [2024-10-07 11:33:23.885722] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.896 [2024-10-07 11:33:23.885772] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.896 [2024-10-07 11:33:23.885863] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.896 [2024-10-07 11:33:23.885894] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.896 [2024-10-07 11:33:23.885910] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.896 [2024-10-07 11:33:23.885971] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.896 [2024-10-07 11:33:23.886021] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.896 [2024-10-07 11:33:23.886044] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.896 [2024-10-07 11:33:23.886075] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.896 [2024-10-07 11:33:23.886101] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.896 [2024-10-07 11:33:23.886126] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.896 [2024-10-07 11:33:23.886146] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.896 [2024-10-07 11:33:23.886165] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.896 [2024-10-07 11:33:23.886188] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.896 [2024-10-07 11:33:23.886210] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.896 [2024-10-07 11:33:23.886225] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.896 [2024-10-07 11:33:23.886250] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.896 [2024-10-07 11:33:23.886265] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.896 8798.43 IOPS, 34.37 MiB/s [2024-10-07T11:33:33.419Z] [2024-10-07 11:33:23.902787] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.896 [2024-10-07 11:33:23.902838] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.896 [2024-10-07 11:33:23.902953] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.896 [2024-10-07 11:33:23.902989] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.897 [2024-10-07 11:33:23.903011] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.897 [2024-10-07 11:33:23.903071] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.897 [2024-10-07 11:33:23.903105] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.897 [2024-10-07 11:33:23.903125] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.897 [2024-10-07 11:33:23.903149] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.897 [2024-10-07 11:33:23.903170] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.897 [2024-10-07 11:33:23.903201] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.897 [2024-10-07 11:33:23.903218] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.897 [2024-10-07 11:33:23.903231] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.897 [2024-10-07 11:33:23.903248] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.897 [2024-10-07 11:33:23.903261] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.897 [2024-10-07 11:33:23.903274] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.897 [2024-10-07 11:33:23.903297] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.897 [2024-10-07 11:33:23.903311] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.897 [2024-10-07 11:33:23.913145] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.897 [2024-10-07 11:33:23.913198] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.897 [2024-10-07 11:33:23.913365] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.897 [2024-10-07 11:33:23.913398] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.897 [2024-10-07 11:33:23.913416] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.897 [2024-10-07 11:33:23.913467] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.897 [2024-10-07 11:33:23.913491] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.897 [2024-10-07 11:33:23.913506] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.897 [2024-10-07 11:33:23.916053] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.897 [2024-10-07 11:33:23.916101] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.897 [2024-10-07 11:33:23.917758] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.897 [2024-10-07 11:33:23.917800] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.897 [2024-10-07 11:33:23.917819] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.897 [2024-10-07 11:33:23.917837] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.897 [2024-10-07 11:33:23.917851] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.897 [2024-10-07 11:33:23.917864] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.897 [2024-10-07 11:33:23.918082] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.897 [2024-10-07 11:33:23.918110] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.897 [2024-10-07 11:33:23.923271] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.897 [2024-10-07 11:33:23.923354] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.897 [2024-10-07 11:33:23.923456] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.897 [2024-10-07 11:33:23.923491] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.897 [2024-10-07 11:33:23.923513] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.897 [2024-10-07 11:33:23.924205] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.897 [2024-10-07 11:33:23.924251] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.897 [2024-10-07 11:33:23.924272] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.897 [2024-10-07 11:33:23.924291] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.897 [2024-10-07 11:33:23.924506] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.897 [2024-10-07 11:33:23.924547] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.897 [2024-10-07 11:33:23.924576] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.897 [2024-10-07 11:33:23.924605] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.897 [2024-10-07 11:33:23.924769] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.897 [2024-10-07 11:33:23.924794] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.897 [2024-10-07 11:33:23.924809] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.897 [2024-10-07 11:33:23.924822] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.897 [2024-10-07 11:33:23.924961] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.897 [2024-10-07 11:33:23.933694] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.897 [2024-10-07 11:33:23.933748] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.897 [2024-10-07 11:33:23.933856] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.897 [2024-10-07 11:33:23.933892] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.897 [2024-10-07 11:33:23.933914] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.897 [2024-10-07 11:33:23.933974] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.897 [2024-10-07 11:33:23.934003] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.897 [2024-10-07 11:33:23.934023] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.897 [2024-10-07 11:33:23.934056] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.897 [2024-10-07 11:33:23.934084] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.897 [2024-10-07 11:33:23.934104] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.897 [2024-10-07 11:33:23.934119] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.897 [2024-10-07 11:33:23.934132] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.897 [2024-10-07 11:33:23.934148] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.897 [2024-10-07 11:33:23.934163] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.897 [2024-10-07 11:33:23.934175] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.897 [2024-10-07 11:33:23.934198] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.897 [2024-10-07 11:33:23.934218] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.897 [2024-10-07 11:33:23.945829] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.897 [2024-10-07 11:33:23.945889] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.897 [2024-10-07 11:33:23.946159] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.897 [2024-10-07 11:33:23.946214] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.897 [2024-10-07 11:33:23.946234] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.897 [2024-10-07 11:33:23.946288] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.897 [2024-10-07 11:33:23.946313] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.897 [2024-10-07 11:33:23.946343] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.897 [2024-10-07 11:33:23.946414] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.897 [2024-10-07 11:33:23.946442] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.897 [2024-10-07 11:33:23.946463] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.897 [2024-10-07 11:33:23.946478] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.897 [2024-10-07 11:33:23.946493] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.897 [2024-10-07 11:33:23.946517] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.897 [2024-10-07 11:33:23.946533] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.897 [2024-10-07 11:33:23.946546] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.897 [2024-10-07 11:33:23.946570] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.897 [2024-10-07 11:33:23.946584] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.897 [2024-10-07 11:33:23.959851] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.897 [2024-10-07 11:33:23.959911] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.897 [2024-10-07 11:33:23.960018] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.897 [2024-10-07 11:33:23.960053] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.897 [2024-10-07 11:33:23.960075] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.897 [2024-10-07 11:33:23.960140] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.897 [2024-10-07 11:33:23.960167] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.897 [2024-10-07 11:33:23.960182] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.897 [2024-10-07 11:33:23.960207] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.897 [2024-10-07 11:33:23.960227] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.897 [2024-10-07 11:33:23.960247] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.897 [2024-10-07 11:33:23.960261] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.897 [2024-10-07 11:33:23.960275] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.897 [2024-10-07 11:33:23.960292] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.897 [2024-10-07 11:33:23.960306] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.897 [2024-10-07 11:33:23.960319] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.897 [2024-10-07 11:33:23.961209] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.897 [2024-10-07 11:33:23.961254] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.897 [2024-10-07 11:33:23.971094] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.897 [2024-10-07 11:33:23.971163] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.897 [2024-10-07 11:33:23.971456] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.897 [2024-10-07 11:33:23.971509] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.897 [2024-10-07 11:33:23.971535] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.897 [2024-10-07 11:33:23.971599] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.897 [2024-10-07 11:33:23.971640] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.897 [2024-10-07 11:33:23.971683] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.897 [2024-10-07 11:33:23.971825] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.897 [2024-10-07 11:33:23.971872] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.897 [2024-10-07 11:33:23.972050] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.897 [2024-10-07 11:33:23.972094] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.897 [2024-10-07 11:33:23.972117] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.897 [2024-10-07 11:33:23.972140] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.897 [2024-10-07 11:33:23.972166] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.897 [2024-10-07 11:33:23.972184] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.897 [2024-10-07 11:33:23.972249] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.897 [2024-10-07 11:33:23.972276] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.898 [2024-10-07 11:33:23.981615] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.898 [2024-10-07 11:33:23.981680] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.898 [2024-10-07 11:33:23.981795] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.898 [2024-10-07 11:33:23.981832] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.898 [2024-10-07 11:33:23.981854] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.898 [2024-10-07 11:33:23.981916] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.898 [2024-10-07 11:33:23.981944] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.898 [2024-10-07 11:33:23.981965] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.898 [2024-10-07 11:33:23.982470] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.898 [2024-10-07 11:33:23.982521] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.898 [2024-10-07 11:33:23.982553] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.898 [2024-10-07 11:33:23.982574] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.898 [2024-10-07 11:33:23.982592] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.898 [2024-10-07 11:33:23.982631] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.898 [2024-10-07 11:33:23.982681] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.898 [2024-10-07 11:33:23.982702] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.898 [2024-10-07 11:33:23.982733] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.898 [2024-10-07 11:33:23.982751] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.898 [2024-10-07 11:33:23.992640] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.898 [2024-10-07 11:33:23.992703] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.898 [2024-10-07 11:33:23.992886] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.898 [2024-10-07 11:33:23.992935] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.898 [2024-10-07 11:33:23.992961] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.898 [2024-10-07 11:33:23.993030] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.898 [2024-10-07 11:33:23.993064] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.898 [2024-10-07 11:33:23.993080] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.898 [2024-10-07 11:33:23.993106] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.898 [2024-10-07 11:33:23.993126] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.898 [2024-10-07 11:33:23.993163] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.898 [2024-10-07 11:33:23.993182] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.898 [2024-10-07 11:33:23.993196] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.898 [2024-10-07 11:33:23.993212] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.898 [2024-10-07 11:33:23.993227] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.898 [2024-10-07 11:33:23.993239] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.898 [2024-10-07 11:33:23.993263] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.898 [2024-10-07 11:33:23.993277] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.898 [2024-10-07 11:33:24.003707] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.898 [2024-10-07 11:33:24.003758] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.898 [2024-10-07 11:33:24.004375] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.898 [2024-10-07 11:33:24.004420] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.898 [2024-10-07 11:33:24.004440] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.898 [2024-10-07 11:33:24.004491] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.898 [2024-10-07 11:33:24.004516] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.898 [2024-10-07 11:33:24.004549] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.898 [2024-10-07 11:33:24.004804] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.898 [2024-10-07 11:33:24.004853] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.898 [2024-10-07 11:33:24.005364] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.898 [2024-10-07 11:33:24.005402] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.898 [2024-10-07 11:33:24.005420] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.898 [2024-10-07 11:33:24.005437] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.898 [2024-10-07 11:33:24.005452] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.898 [2024-10-07 11:33:24.005465] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.898 [2024-10-07 11:33:24.005749] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.898 [2024-10-07 11:33:24.005782] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.898 [2024-10-07 11:33:24.017307] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.898 [2024-10-07 11:33:24.017359] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.898 [2024-10-07 11:33:24.017449] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.898 [2024-10-07 11:33:24.017480] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.898 [2024-10-07 11:33:24.017497] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.898 [2024-10-07 11:33:24.017552] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.898 [2024-10-07 11:33:24.017575] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.898 [2024-10-07 11:33:24.017590] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.898 [2024-10-07 11:33:24.018220] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.898 [2024-10-07 11:33:24.018265] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.898 [2024-10-07 11:33:24.018365] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.898 [2024-10-07 11:33:24.018388] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.898 [2024-10-07 11:33:24.018402] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.898 [2024-10-07 11:33:24.018419] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.898 [2024-10-07 11:33:24.018433] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.898 [2024-10-07 11:33:24.018446] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.898 [2024-10-07 11:33:24.018470] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.898 [2024-10-07 11:33:24.018484] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.898 [2024-10-07 11:33:24.027923] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.898 [2024-10-07 11:33:24.027984] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.898 [2024-10-07 11:33:24.028217] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.898 [2024-10-07 11:33:24.028263] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.898 [2024-10-07 11:33:24.028284] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.898 [2024-10-07 11:33:24.028336] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.898 [2024-10-07 11:33:24.028360] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.898 [2024-10-07 11:33:24.028376] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.898 [2024-10-07 11:33:24.028482] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.898 [2024-10-07 11:33:24.028508] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.898 [2024-10-07 11:33:24.028752] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.898 [2024-10-07 11:33:24.028790] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.898 [2024-10-07 11:33:24.028807] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.898 [2024-10-07 11:33:24.028825] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.898 [2024-10-07 11:33:24.028840] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.898 [2024-10-07 11:33:24.028864] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.898 [2024-10-07 11:33:24.028924] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.898 [2024-10-07 11:33:24.028945] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.898 [2024-10-07 11:33:24.041813] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.898 [2024-10-07 11:33:24.041875] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.898 [2024-10-07 11:33:24.042065] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.898 [2024-10-07 11:33:24.042098] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.898 [2024-10-07 11:33:24.042115] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.898 [2024-10-07 11:33:24.042164] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.898 [2024-10-07 11:33:24.042188] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.898 [2024-10-07 11:33:24.042203] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.898 [2024-10-07 11:33:24.042227] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.898 [2024-10-07 11:33:24.042248] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.898 [2024-10-07 11:33:24.042268] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.898 [2024-10-07 11:33:24.042283] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.898 [2024-10-07 11:33:24.042296] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.898 [2024-10-07 11:33:24.042323] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.898 [2024-10-07 11:33:24.042354] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.898 [2024-10-07 11:33:24.042369] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.898 [2024-10-07 11:33:24.042394] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.898 [2024-10-07 11:33:24.042409] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.898 [2024-10-07 11:33:24.053208] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.898 [2024-10-07 11:33:24.053264] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.898 [2024-10-07 11:33:24.053451] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.898 [2024-10-07 11:33:24.053483] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.898 [2024-10-07 11:33:24.053500] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.898 [2024-10-07 11:33:24.053549] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.898 [2024-10-07 11:33:24.053572] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.898 [2024-10-07 11:33:24.053588] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.898 [2024-10-07 11:33:24.053707] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.898 [2024-10-07 11:33:24.053735] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.898 [2024-10-07 11:33:24.053845] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.898 [2024-10-07 11:33:24.053867] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.898 [2024-10-07 11:33:24.053882] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.899 [2024-10-07 11:33:24.053899] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.899 [2024-10-07 11:33:24.053913] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.899 [2024-10-07 11:33:24.053926] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.899 [2024-10-07 11:33:24.055218] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.899 [2024-10-07 11:33:24.055260] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.899 [2024-10-07 11:33:24.063939] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.899 [2024-10-07 11:33:24.063989] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.899 [2024-10-07 11:33:24.064087] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.899 [2024-10-07 11:33:24.064117] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.899 [2024-10-07 11:33:24.064133] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.899 [2024-10-07 11:33:24.064182] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.899 [2024-10-07 11:33:24.064206] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.899 [2024-10-07 11:33:24.064221] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.899 [2024-10-07 11:33:24.064260] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.899 [2024-10-07 11:33:24.064282] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.899 [2024-10-07 11:33:24.064301] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.899 [2024-10-07 11:33:24.064315] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.899 [2024-10-07 11:33:24.064335] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.899 [2024-10-07 11:33:24.064357] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.899 [2024-10-07 11:33:24.064377] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.899 [2024-10-07 11:33:24.064395] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.899 [2024-10-07 11:33:24.064425] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.899 [2024-10-07 11:33:24.064444] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.899 [2024-10-07 11:33:24.074053] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.899 [2024-10-07 11:33:24.074121] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.899 [2024-10-07 11:33:24.074203] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.899 [2024-10-07 11:33:24.074233] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.899 [2024-10-07 11:33:24.074250] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.899 [2024-10-07 11:33:24.074313] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.899 [2024-10-07 11:33:24.074344] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.899 [2024-10-07 11:33:24.074365] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.899 [2024-10-07 11:33:24.074389] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.899 [2024-10-07 11:33:24.074419] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.899 [2024-10-07 11:33:24.074441] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.899 [2024-10-07 11:33:24.074461] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.899 [2024-10-07 11:33:24.074480] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.899 [2024-10-07 11:33:24.074528] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.899 [2024-10-07 11:33:24.074551] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.899 [2024-10-07 11:33:24.074570] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.899 [2024-10-07 11:33:24.074588] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.899 [2024-10-07 11:33:24.074614] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.899 [2024-10-07 11:33:24.087182] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.899 [2024-10-07 11:33:24.087259] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.899 [2024-10-07 11:33:24.088027] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.899 [2024-10-07 11:33:24.088089] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.899 [2024-10-07 11:33:24.088112] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.899 [2024-10-07 11:33:24.088166] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.899 [2024-10-07 11:33:24.088191] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.899 [2024-10-07 11:33:24.088207] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.899 [2024-10-07 11:33:24.088957] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.899 [2024-10-07 11:33:24.089002] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.899 [2024-10-07 11:33:24.089101] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.899 [2024-10-07 11:33:24.089124] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.899 [2024-10-07 11:33:24.089139] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.899 [2024-10-07 11:33:24.089156] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.899 [2024-10-07 11:33:24.089171] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.899 [2024-10-07 11:33:24.089184] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.899 [2024-10-07 11:33:24.089207] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.899 [2024-10-07 11:33:24.089221] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.899 [2024-10-07 11:33:24.098853] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.899 [2024-10-07 11:33:24.098904] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.899 [2024-10-07 11:33:24.100495] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.899 [2024-10-07 11:33:24.100542] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.899 [2024-10-07 11:33:24.100563] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.899 [2024-10-07 11:33:24.100625] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.899 [2024-10-07 11:33:24.100665] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.899 [2024-10-07 11:33:24.100696] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.899 [2024-10-07 11:33:24.101382] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.899 [2024-10-07 11:33:24.101427] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.899 [2024-10-07 11:33:24.101693] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.899 [2024-10-07 11:33:24.101738] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.899 [2024-10-07 11:33:24.101756] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.899 [2024-10-07 11:33:24.101774] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.899 [2024-10-07 11:33:24.101788] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.899 [2024-10-07 11:33:24.101815] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.899 [2024-10-07 11:33:24.101887] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.899 [2024-10-07 11:33:24.101909] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.899 [2024-10-07 11:33:24.110489] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.899 [2024-10-07 11:33:24.110540] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.899 [2024-10-07 11:33:24.110751] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.899 [2024-10-07 11:33:24.110783] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.899 [2024-10-07 11:33:24.110801] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.899 [2024-10-07 11:33:24.110849] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.899 [2024-10-07 11:33:24.110873] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.899 [2024-10-07 11:33:24.110887] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.899 [2024-10-07 11:33:24.111047] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.899 [2024-10-07 11:33:24.111089] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.899 [2024-10-07 11:33:24.111254] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.899 [2024-10-07 11:33:24.111289] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.899 [2024-10-07 11:33:24.111306] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.899 [2024-10-07 11:33:24.111324] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.899 [2024-10-07 11:33:24.111338] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.899 [2024-10-07 11:33:24.111351] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.899 [2024-10-07 11:33:24.111476] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.899 [2024-10-07 11:33:24.111498] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.899 [2024-10-07 11:33:24.121932] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.899 [2024-10-07 11:33:24.121985] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.899 [2024-10-07 11:33:24.122173] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.899 [2024-10-07 11:33:24.122206] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.899 [2024-10-07 11:33:24.122223] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.899 [2024-10-07 11:33:24.122272] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.899 [2024-10-07 11:33:24.122296] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.899 [2024-10-07 11:33:24.122322] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.899 [2024-10-07 11:33:24.122493] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.899 [2024-10-07 11:33:24.122550] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.899 [2024-10-07 11:33:24.122626] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.899 [2024-10-07 11:33:24.122666] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.899 [2024-10-07 11:33:24.122682] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.900 [2024-10-07 11:33:24.122700] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.900 [2024-10-07 11:33:24.122714] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.900 [2024-10-07 11:33:24.122728] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.900 [2024-10-07 11:33:24.122752] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.900 [2024-10-07 11:33:24.122767] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.900 [2024-10-07 11:33:24.132443] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.900 [2024-10-07 11:33:24.132503] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.900 [2024-10-07 11:33:24.132612] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.900 [2024-10-07 11:33:24.132662] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.900 [2024-10-07 11:33:24.132683] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.900 [2024-10-07 11:33:24.132737] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.900 [2024-10-07 11:33:24.132761] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.900 [2024-10-07 11:33:24.132783] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.900 [2024-10-07 11:33:24.132807] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.900 [2024-10-07 11:33:24.132830] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.900 [2024-10-07 11:33:24.132850] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.900 [2024-10-07 11:33:24.132865] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.900 [2024-10-07 11:33:24.132878] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.900 [2024-10-07 11:33:24.132894] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.900 [2024-10-07 11:33:24.132908] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.900 [2024-10-07 11:33:24.132921] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.900 [2024-10-07 11:33:24.132944] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.900 [2024-10-07 11:33:24.132958] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.900 [2024-10-07 11:33:24.144672] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.900 [2024-10-07 11:33:24.144723] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.900 [2024-10-07 11:33:24.144813] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.900 [2024-10-07 11:33:24.144844] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.900 [2024-10-07 11:33:24.144875] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.900 [2024-10-07 11:33:24.144934] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.900 [2024-10-07 11:33:24.144970] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.900 [2024-10-07 11:33:24.144993] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.900 [2024-10-07 11:33:24.145028] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.900 [2024-10-07 11:33:24.145055] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.900 [2024-10-07 11:33:24.145076] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.900 [2024-10-07 11:33:24.145101] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.900 [2024-10-07 11:33:24.145115] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.900 [2024-10-07 11:33:24.145131] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.900 [2024-10-07 11:33:24.145145] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.900 [2024-10-07 11:33:24.145158] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.900 [2024-10-07 11:33:24.145181] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.900 [2024-10-07 11:33:24.145195] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.900 [2024-10-07 11:33:24.157513] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.900 [2024-10-07 11:33:24.157565] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.900 [2024-10-07 11:33:24.157763] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.900 [2024-10-07 11:33:24.157800] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.900 [2024-10-07 11:33:24.157835] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.900 [2024-10-07 11:33:24.157899] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.900 [2024-10-07 11:33:24.157929] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.900 [2024-10-07 11:33:24.157949] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.900 [2024-10-07 11:33:24.158074] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.900 [2024-10-07 11:33:24.158114] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.900 [2024-10-07 11:33:24.158269] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.900 [2024-10-07 11:33:24.158307] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.900 [2024-10-07 11:33:24.158324] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.900 [2024-10-07 11:33:24.158342] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.900 [2024-10-07 11:33:24.158357] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.900 [2024-10-07 11:33:24.158392] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.900 [2024-10-07 11:33:24.158789] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.900 [2024-10-07 11:33:24.158833] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.900 [2024-10-07 11:33:24.167634] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.900 [2024-10-07 11:33:24.167735] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.900 [2024-10-07 11:33:24.167821] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.900 [2024-10-07 11:33:24.167851] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.900 [2024-10-07 11:33:24.167867] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.900 [2024-10-07 11:33:24.167924] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.900 [2024-10-07 11:33:24.167949] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.900 [2024-10-07 11:33:24.167964] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.900 [2024-10-07 11:33:24.167982] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.900 [2024-10-07 11:33:24.168006] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.900 [2024-10-07 11:33:24.168023] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.900 [2024-10-07 11:33:24.168037] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.900 [2024-10-07 11:33:24.168050] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.900 [2024-10-07 11:33:24.168073] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.900 [2024-10-07 11:33:24.168088] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.900 [2024-10-07 11:33:24.168101] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.900 [2024-10-07 11:33:24.168114] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.900 [2024-10-07 11:33:24.168134] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.900 [2024-10-07 11:33:24.178078] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.900 [2024-10-07 11:33:24.178153] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.900 [2024-10-07 11:33:24.178247] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.900 [2024-10-07 11:33:24.178279] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.900 [2024-10-07 11:33:24.178296] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.900 [2024-10-07 11:33:24.178347] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.900 [2024-10-07 11:33:24.178372] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.900 [2024-10-07 11:33:24.178387] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.900 [2024-10-07 11:33:24.180259] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.900 [2024-10-07 11:33:24.180308] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.900 [2024-10-07 11:33:24.180818] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.900 [2024-10-07 11:33:24.180857] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.900 [2024-10-07 11:33:24.180883] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.900 [2024-10-07 11:33:24.180909] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.900 [2024-10-07 11:33:24.180930] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.900 [2024-10-07 11:33:24.180950] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.900 [2024-10-07 11:33:24.181337] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.900 [2024-10-07 11:33:24.181374] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.900 [2024-10-07 11:33:24.188829] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.900 [2024-10-07 11:33:24.188883] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.900 [2024-10-07 11:33:24.189082] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.900 [2024-10-07 11:33:24.189131] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.900 [2024-10-07 11:33:24.189159] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.900 [2024-10-07 11:33:24.189224] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.900 [2024-10-07 11:33:24.189253] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.900 [2024-10-07 11:33:24.189275] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.900 [2024-10-07 11:33:24.189414] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.900 [2024-10-07 11:33:24.189454] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.900 [2024-10-07 11:33:24.189736] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.900 [2024-10-07 11:33:24.189773] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.900 [2024-10-07 11:33:24.189791] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.900 [2024-10-07 11:33:24.189810] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.900 [2024-10-07 11:33:24.189835] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.900 [2024-10-07 11:33:24.189849] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.900 [2024-10-07 11:33:24.189989] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.900 [2024-10-07 11:33:24.190013] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.900 [2024-10-07 11:33:24.200004] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.900 [2024-10-07 11:33:24.200058] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.900 [2024-10-07 11:33:24.200233] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.900 [2024-10-07 11:33:24.200276] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.900 [2024-10-07 11:33:24.200313] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.900 [2024-10-07 11:33:24.200370] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.900 [2024-10-07 11:33:24.200397] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.901 [2024-10-07 11:33:24.200413] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.901 [2024-10-07 11:33:24.200572] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.901 [2024-10-07 11:33:24.200614] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.901 [2024-10-07 11:33:24.200687] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.901 [2024-10-07 11:33:24.200720] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.901 [2024-10-07 11:33:24.200735] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.901 [2024-10-07 11:33:24.200751] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.901 [2024-10-07 11:33:24.200765] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.901 [2024-10-07 11:33:24.200778] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.901 [2024-10-07 11:33:24.200802] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.901 [2024-10-07 11:33:24.200816] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.901 [2024-10-07 11:33:24.214756] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.901 [2024-10-07 11:33:24.214818] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.901 [2024-10-07 11:33:24.215010] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.901 [2024-10-07 11:33:24.215053] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.901 [2024-10-07 11:33:24.215073] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.901 [2024-10-07 11:33:24.215125] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.901 [2024-10-07 11:33:24.215148] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.901 [2024-10-07 11:33:24.215164] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.901 [2024-10-07 11:33:24.215201] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.901 [2024-10-07 11:33:24.215227] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.901 [2024-10-07 11:33:24.215247] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.901 [2024-10-07 11:33:24.215262] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.901 [2024-10-07 11:33:24.215275] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.901 [2024-10-07 11:33:24.215292] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.901 [2024-10-07 11:33:24.215307] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.901 [2024-10-07 11:33:24.215319] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.901 [2024-10-07 11:33:24.215360] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.901 [2024-10-07 11:33:24.215376] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.901 [2024-10-07 11:33:24.228527] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.901 [2024-10-07 11:33:24.228584] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.901 [2024-10-07 11:33:24.228691] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.901 [2024-10-07 11:33:24.228723] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.901 [2024-10-07 11:33:24.228740] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.901 [2024-10-07 11:33:24.228802] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.901 [2024-10-07 11:33:24.228826] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.901 [2024-10-07 11:33:24.228844] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.901 [2024-10-07 11:33:24.229434] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.901 [2024-10-07 11:33:24.229484] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.901 [2024-10-07 11:33:24.229603] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.901 [2024-10-07 11:33:24.229633] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.901 [2024-10-07 11:33:24.229670] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.901 [2024-10-07 11:33:24.229696] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.901 [2024-10-07 11:33:24.229715] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.901 [2024-10-07 11:33:24.229737] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.901 [2024-10-07 11:33:24.229766] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.901 [2024-10-07 11:33:24.229781] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.901 [2024-10-07 11:33:24.239739] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.901 [2024-10-07 11:33:24.239793] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.901 [2024-10-07 11:33:24.239971] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.901 [2024-10-07 11:33:24.240013] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.901 [2024-10-07 11:33:24.240034] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.901 [2024-10-07 11:33:24.240085] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.901 [2024-10-07 11:33:24.240110] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.901 [2024-10-07 11:33:24.240125] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.901 [2024-10-07 11:33:24.240230] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.901 [2024-10-07 11:33:24.240255] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.901 [2024-10-07 11:33:24.240390] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.901 [2024-10-07 11:33:24.240444] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.901 [2024-10-07 11:33:24.240465] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.901 [2024-10-07 11:33:24.240484] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.901 [2024-10-07 11:33:24.240498] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.901 [2024-10-07 11:33:24.240511] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.901 [2024-10-07 11:33:24.242980] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.901 [2024-10-07 11:33:24.243025] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.901 [2024-10-07 11:33:24.250100] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.901 [2024-10-07 11:33:24.250162] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.901 [2024-10-07 11:33:24.250363] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.901 [2024-10-07 11:33:24.250403] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.901 [2024-10-07 11:33:24.250426] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.901 [2024-10-07 11:33:24.250487] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.901 [2024-10-07 11:33:24.250513] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.901 [2024-10-07 11:33:24.250528] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.901 [2024-10-07 11:33:24.250578] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.901 [2024-10-07 11:33:24.250604] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.901 [2024-10-07 11:33:24.250625] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.901 [2024-10-07 11:33:24.250640] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.901 [2024-10-07 11:33:24.250670] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.901 [2024-10-07 11:33:24.250689] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.901 [2024-10-07 11:33:24.250703] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.901 [2024-10-07 11:33:24.250716] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.901 [2024-10-07 11:33:24.250740] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.901 [2024-10-07 11:33:24.250754] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.901 [2024-10-07 11:33:24.260233] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.901 [2024-10-07 11:33:24.260302] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.901 [2024-10-07 11:33:24.260381] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.901 [2024-10-07 11:33:24.260411] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.901 [2024-10-07 11:33:24.260428] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.901 [2024-10-07 11:33:24.260505] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.901 [2024-10-07 11:33:24.260532] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.901 [2024-10-07 11:33:24.260547] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.901 [2024-10-07 11:33:24.260565] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.901 [2024-10-07 11:33:24.260589] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.901 [2024-10-07 11:33:24.260607] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.901 [2024-10-07 11:33:24.260620] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.901 [2024-10-07 11:33:24.260634] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.901 [2024-10-07 11:33:24.260674] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.901 [2024-10-07 11:33:24.260693] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.901 [2024-10-07 11:33:24.260717] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.901 [2024-10-07 11:33:24.260730] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.901 [2024-10-07 11:33:24.260751] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.901 [2024-10-07 11:33:24.275372] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.901 [2024-10-07 11:33:24.275431] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.901 [2024-10-07 11:33:24.275709] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.901 [2024-10-07 11:33:24.275761] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.901 [2024-10-07 11:33:24.275787] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.901 [2024-10-07 11:33:24.275855] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.901 [2024-10-07 11:33:24.275882] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.901 [2024-10-07 11:33:24.275898] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.901 [2024-10-07 11:33:24.275924] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.901 [2024-10-07 11:33:24.275944] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.901 [2024-10-07 11:33:24.275965] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.901 [2024-10-07 11:33:24.275979] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.901 [2024-10-07 11:33:24.276003] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.901 [2024-10-07 11:33:24.276020] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.901 [2024-10-07 11:33:24.276035] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.901 [2024-10-07 11:33:24.276048] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.901 [2024-10-07 11:33:24.276071] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.901 [2024-10-07 11:33:24.276100] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.901 [2024-10-07 11:33:24.286734] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.901 [2024-10-07 11:33:24.286786] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.902 [2024-10-07 11:33:24.286991] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.902 [2024-10-07 11:33:24.287034] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.902 [2024-10-07 11:33:24.287055] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.902 [2024-10-07 11:33:24.287106] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.902 [2024-10-07 11:33:24.287130] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.902 [2024-10-07 11:33:24.287146] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.902 [2024-10-07 11:33:24.287306] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.902 [2024-10-07 11:33:24.287341] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.902 [2024-10-07 11:33:24.287699] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.902 [2024-10-07 11:33:24.287736] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.902 [2024-10-07 11:33:24.287754] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.902 [2024-10-07 11:33:24.287771] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.902 [2024-10-07 11:33:24.287786] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.902 [2024-10-07 11:33:24.287799] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.902 [2024-10-07 11:33:24.288010] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.902 [2024-10-07 11:33:24.288037] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.902 [2024-10-07 11:33:24.296861] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.902 [2024-10-07 11:33:24.296931] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.902 [2024-10-07 11:33:24.297011] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.902 [2024-10-07 11:33:24.297041] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.902 [2024-10-07 11:33:24.297058] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.902 [2024-10-07 11:33:24.297114] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.902 [2024-10-07 11:33:24.297139] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.902 [2024-10-07 11:33:24.297155] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.902 [2024-10-07 11:33:24.297172] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.902 [2024-10-07 11:33:24.297196] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.902 [2024-10-07 11:33:24.297214] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.902 [2024-10-07 11:33:24.297243] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.902 [2024-10-07 11:33:24.297258] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.902 [2024-10-07 11:33:24.297454] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.902 [2024-10-07 11:33:24.297501] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.902 [2024-10-07 11:33:24.297524] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.902 [2024-10-07 11:33:24.297543] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.902 [2024-10-07 11:33:24.297745] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.902 [2024-10-07 11:33:24.310944] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.902 [2024-10-07 11:33:24.311009] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.902 [2024-10-07 11:33:24.311126] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.902 [2024-10-07 11:33:24.311163] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.902 [2024-10-07 11:33:24.311185] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.902 [2024-10-07 11:33:24.311265] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.902 [2024-10-07 11:33:24.311298] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.902 [2024-10-07 11:33:24.311326] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.902 [2024-10-07 11:33:24.312249] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.902 [2024-10-07 11:33:24.312296] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.902 [2024-10-07 11:33:24.312508] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.902 [2024-10-07 11:33:24.312552] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.902 [2024-10-07 11:33:24.312571] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.902 [2024-10-07 11:33:24.312589] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.902 [2024-10-07 11:33:24.312604] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.902 [2024-10-07 11:33:24.312616] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.902 [2024-10-07 11:33:24.312673] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.902 [2024-10-07 11:33:24.312694] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.902 [2024-10-07 11:33:24.322323] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.902 [2024-10-07 11:33:24.322377] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.902 [2024-10-07 11:33:24.322577] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.902 [2024-10-07 11:33:24.322621] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.902 [2024-10-07 11:33:24.322642] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.902 [2024-10-07 11:33:24.322710] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.902 [2024-10-07 11:33:24.322755] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.902 [2024-10-07 11:33:24.322772] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.902 [2024-10-07 11:33:24.324077] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.902 [2024-10-07 11:33:24.324133] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.902 [2024-10-07 11:33:24.324401] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.902 [2024-10-07 11:33:24.324447] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.902 [2024-10-07 11:33:24.324471] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.902 [2024-10-07 11:33:24.324494] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.902 [2024-10-07 11:33:24.324514] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.902 [2024-10-07 11:33:24.324531] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.902 [2024-10-07 11:33:24.326075] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.902 [2024-10-07 11:33:24.326115] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.902 [2024-10-07 11:33:24.332802] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.902 [2024-10-07 11:33:24.332854] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.902 [2024-10-07 11:33:24.333848] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.902 [2024-10-07 11:33:24.333897] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.902 [2024-10-07 11:33:24.333918] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.902 [2024-10-07 11:33:24.333971] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.902 [2024-10-07 11:33:24.333995] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.902 [2024-10-07 11:33:24.334010] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.902 [2024-10-07 11:33:24.334237] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.902 [2024-10-07 11:33:24.334303] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.902 [2024-10-07 11:33:24.334473] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.902 [2024-10-07 11:33:24.334515] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.902 [2024-10-07 11:33:24.334538] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.902 [2024-10-07 11:33:24.334560] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.902 [2024-10-07 11:33:24.334579] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.902 [2024-10-07 11:33:24.334598] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.902 [2024-10-07 11:33:24.334728] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.902 [2024-10-07 11:33:24.334752] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.902 [2024-10-07 11:33:24.343155] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.902 [2024-10-07 11:33:24.343214] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.902 [2024-10-07 11:33:24.343314] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.902 [2024-10-07 11:33:24.343354] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.902 [2024-10-07 11:33:24.343378] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.902 [2024-10-07 11:33:24.343507] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.902 [2024-10-07 11:33:24.343534] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.902 [2024-10-07 11:33:24.343550] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.902 [2024-10-07 11:33:24.343578] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.902 [2024-10-07 11:33:24.343600] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.902 [2024-10-07 11:33:24.344217] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.902 [2024-10-07 11:33:24.344263] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.902 [2024-10-07 11:33:24.344282] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.902 [2024-10-07 11:33:24.344302] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.902 [2024-10-07 11:33:24.344316] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.902 [2024-10-07 11:33:24.344337] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.902 [2024-10-07 11:33:24.344504] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.902 [2024-10-07 11:33:24.344528] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.902 [2024-10-07 11:33:24.353283] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.902 [2024-10-07 11:33:24.353385] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.902 [2024-10-07 11:33:24.353472] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.902 [2024-10-07 11:33:24.353502] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.902 [2024-10-07 11:33:24.353519] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.902 [2024-10-07 11:33:24.353575] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.902 [2024-10-07 11:33:24.353600] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.902 [2024-10-07 11:33:24.353615] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.902 [2024-10-07 11:33:24.353634] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.902 [2024-10-07 11:33:24.353678] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.902 [2024-10-07 11:33:24.353699] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.902 [2024-10-07 11:33:24.353712] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.902 [2024-10-07 11:33:24.353743] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.903 [2024-10-07 11:33:24.354986] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.903 [2024-10-07 11:33:24.355035] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.903 [2024-10-07 11:33:24.355062] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.903 [2024-10-07 11:33:24.355078] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.903 [2024-10-07 11:33:24.355313] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.903 [2024-10-07 11:33:24.363388] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.903 [2024-10-07 11:33:24.363503] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.903 [2024-10-07 11:33:24.363539] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.903 [2024-10-07 11:33:24.363570] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.903 [2024-10-07 11:33:24.363618] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.903 [2024-10-07 11:33:24.363676] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.903 [2024-10-07 11:33:24.363714] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.903 [2024-10-07 11:33:24.363740] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.903 [2024-10-07 11:33:24.363756] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.903 [2024-10-07 11:33:24.363797] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.903 [2024-10-07 11:33:24.363857] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.903 [2024-10-07 11:33:24.363883] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.903 [2024-10-07 11:33:24.363900] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.903 [2024-10-07 11:33:24.363922] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.903 [2024-10-07 11:33:24.363945] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.903 [2024-10-07 11:33:24.363959] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.903 [2024-10-07 11:33:24.363972] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.903 [2024-10-07 11:33:24.363995] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.903 [2024-10-07 11:33:24.373483] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.903 [2024-10-07 11:33:24.373618] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.903 [2024-10-07 11:33:24.373667] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.903 [2024-10-07 11:33:24.373688] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.903 [2024-10-07 11:33:24.373714] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.903 [2024-10-07 11:33:24.373736] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.903 [2024-10-07 11:33:24.373751] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.903 [2024-10-07 11:33:24.373782] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.903 [2024-10-07 11:33:24.373820] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.903 [2024-10-07 11:33:24.373844] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.903 [2024-10-07 11:33:24.373918] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.903 [2024-10-07 11:33:24.373945] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.903 [2024-10-07 11:33:24.373965] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.903 [2024-10-07 11:33:24.373994] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.903 [2024-10-07 11:33:24.374016] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.903 [2024-10-07 11:33:24.374031] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.903 [2024-10-07 11:33:24.374044] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.903 [2024-10-07 11:33:24.374067] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.903 [2024-10-07 11:33:24.383834] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.903 [2024-10-07 11:33:24.383963] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.903 [2024-10-07 11:33:24.384000] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.903 [2024-10-07 11:33:24.384023] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.903 [2024-10-07 11:33:24.384071] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.903 [2024-10-07 11:33:24.384108] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.903 [2024-10-07 11:33:24.384142] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.903 [2024-10-07 11:33:24.384167] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.903 [2024-10-07 11:33:24.384188] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.903 [2024-10-07 11:33:24.384211] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.903 [2024-10-07 11:33:24.384267] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.903 [2024-10-07 11:33:24.384294] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.903 [2024-10-07 11:33:24.384310] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.903 [2024-10-07 11:33:24.384334] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.903 [2024-10-07 11:33:24.384356] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.903 [2024-10-07 11:33:24.384370] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.903 [2024-10-07 11:33:24.384383] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.903 [2024-10-07 11:33:24.384405] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.903 [2024-10-07 11:33:24.393926] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.903 [2024-10-07 11:33:24.394340] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.903 [2024-10-07 11:33:24.394395] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.903 [2024-10-07 11:33:24.394429] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.903 [2024-10-07 11:33:24.394700] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.903 [2024-10-07 11:33:24.394927] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.903 [2024-10-07 11:33:24.394982] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.903 [2024-10-07 11:33:24.395001] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.903 [2024-10-07 11:33:24.395014] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.903 [2024-10-07 11:33:24.395145] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.903 [2024-10-07 11:33:24.395223] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.903 [2024-10-07 11:33:24.395251] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.903 [2024-10-07 11:33:24.395268] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.903 [2024-10-07 11:33:24.395384] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.903 [2024-10-07 11:33:24.395504] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.903 [2024-10-07 11:33:24.395523] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.903 [2024-10-07 11:33:24.395537] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.903 [2024-10-07 11:33:24.395690] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.903 [2024-10-07 11:33:24.404024] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.903 [2024-10-07 11:33:24.404136] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.903 [2024-10-07 11:33:24.404166] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.903 [2024-10-07 11:33:24.404184] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.903 [2024-10-07 11:33:24.404208] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.903 [2024-10-07 11:33:24.404230] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.903 [2024-10-07 11:33:24.404245] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.903 [2024-10-07 11:33:24.404258] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.903 [2024-10-07 11:33:24.404283] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.903 [2024-10-07 11:33:24.405005] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.903 [2024-10-07 11:33:24.405114] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.903 [2024-10-07 11:33:24.405149] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.903 [2024-10-07 11:33:24.405170] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.903 [2024-10-07 11:33:24.405217] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.903 [2024-10-07 11:33:24.405247] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.903 [2024-10-07 11:33:24.405267] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.903 [2024-10-07 11:33:24.405285] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.903 [2024-10-07 11:33:24.405314] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.903 [2024-10-07 11:33:24.416677] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.903 [2024-10-07 11:33:24.416739] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.903 [2024-10-07 11:33:24.416831] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.903 [2024-10-07 11:33:24.416861] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.903 [2024-10-07 11:33:24.416878] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.903 [2024-10-07 11:33:24.416933] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.903 [2024-10-07 11:33:24.416957] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.903 [2024-10-07 11:33:24.416972] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.903 [2024-10-07 11:33:24.417550] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.903 [2024-10-07 11:33:24.417600] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.903 [2024-10-07 11:33:24.417733] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.904 [2024-10-07 11:33:24.417759] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.904 [2024-10-07 11:33:24.417773] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.904 [2024-10-07 11:33:24.417791] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.904 [2024-10-07 11:33:24.417805] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.904 [2024-10-07 11:33:24.417817] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.904 [2024-10-07 11:33:24.417841] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.904 [2024-10-07 11:33:24.417855] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.904 [2024-10-07 11:33:24.427637] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.904 [2024-10-07 11:33:24.427702] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.904 [2024-10-07 11:33:24.427890] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.904 [2024-10-07 11:33:24.427938] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.904 [2024-10-07 11:33:24.427965] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.904 [2024-10-07 11:33:24.428030] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.904 [2024-10-07 11:33:24.428064] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.904 [2024-10-07 11:33:24.428087] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.904 [2024-10-07 11:33:24.428211] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.904 [2024-10-07 11:33:24.428238] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.904 [2024-10-07 11:33:24.428335] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.904 [2024-10-07 11:33:24.428355] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.904 [2024-10-07 11:33:24.428369] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.904 [2024-10-07 11:33:24.428386] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.904 [2024-10-07 11:33:24.428400] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.904 [2024-10-07 11:33:24.428413] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.904 [2024-10-07 11:33:24.428784] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.904 [2024-10-07 11:33:24.428831] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.904 [2024-10-07 11:33:24.438031] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.904 [2024-10-07 11:33:24.438080] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.904 [2024-10-07 11:33:24.438267] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.904 [2024-10-07 11:33:24.438309] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.904 [2024-10-07 11:33:24.438329] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.904 [2024-10-07 11:33:24.438380] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.904 [2024-10-07 11:33:24.438405] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.904 [2024-10-07 11:33:24.438420] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.904 [2024-10-07 11:33:24.438553] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.904 [2024-10-07 11:33:24.438592] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.904 [2024-10-07 11:33:24.440276] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.904 [2024-10-07 11:33:24.440319] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.904 [2024-10-07 11:33:24.440337] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.904 [2024-10-07 11:33:24.440355] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.904 [2024-10-07 11:33:24.440369] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.904 [2024-10-07 11:33:24.440382] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.904 [2024-10-07 11:33:24.443336] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.904 [2024-10-07 11:33:24.443376] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.904 [2024-10-07 11:33:24.448430] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.904 [2024-10-07 11:33:24.448477] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.904 [2024-10-07 11:33:24.448629] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.904 [2024-10-07 11:33:24.448660] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.904 [2024-10-07 11:33:24.448695] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.904 [2024-10-07 11:33:24.448747] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.904 [2024-10-07 11:33:24.448771] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.904 [2024-10-07 11:33:24.448786] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.904 [2024-10-07 11:33:24.448810] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.904 [2024-10-07 11:33:24.448830] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.904 [2024-10-07 11:33:24.448849] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.904 [2024-10-07 11:33:24.448863] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.904 [2024-10-07 11:33:24.448876] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.904 [2024-10-07 11:33:24.448892] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.904 [2024-10-07 11:33:24.448906] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.904 [2024-10-07 11:33:24.448918] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.904 [2024-10-07 11:33:24.448940] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.904 [2024-10-07 11:33:24.448954] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.904 [2024-10-07 11:33:24.461123] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.904 [2024-10-07 11:33:24.461186] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.904 [2024-10-07 11:33:24.461290] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.904 [2024-10-07 11:33:24.461319] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.904 [2024-10-07 11:33:24.461336] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.904 [2024-10-07 11:33:24.461394] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.904 [2024-10-07 11:33:24.461418] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.904 [2024-10-07 11:33:24.461433] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.904 [2024-10-07 11:33:24.462501] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.904 [2024-10-07 11:33:24.462545] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.904 [2024-10-07 11:33:24.463109] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.904 [2024-10-07 11:33:24.463146] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.904 [2024-10-07 11:33:24.463178] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.904 [2024-10-07 11:33:24.463221] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.904 [2024-10-07 11:33:24.463252] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.904 [2024-10-07 11:33:24.463266] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.904 [2024-10-07 11:33:24.463684] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.904 [2024-10-07 11:33:24.463724] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.904 [2024-10-07 11:33:24.474477] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.904 [2024-10-07 11:33:24.474524] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.904 [2024-10-07 11:33:24.474625] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.904 [2024-10-07 11:33:24.474652] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.904 [2024-10-07 11:33:24.474684] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.904 [2024-10-07 11:33:24.474734] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.904 [2024-10-07 11:33:24.474774] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.904 [2024-10-07 11:33:24.474790] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.904 [2024-10-07 11:33:24.475402] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.904 [2024-10-07 11:33:24.475446] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.904 [2024-10-07 11:33:24.475543] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.904 [2024-10-07 11:33:24.475566] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.904 [2024-10-07 11:33:24.475580] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.904 [2024-10-07 11:33:24.475597] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.904 [2024-10-07 11:33:24.475611] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.904 [2024-10-07 11:33:24.475623] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.904 [2024-10-07 11:33:24.475667] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.904 [2024-10-07 11:33:24.475687] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.904 [2024-10-07 11:33:24.485558] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.904 [2024-10-07 11:33:24.485623] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.904 [2024-10-07 11:33:24.485857] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.904 [2024-10-07 11:33:24.485908] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.904 [2024-10-07 11:33:24.485928] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.904 [2024-10-07 11:33:24.485979] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.904 [2024-10-07 11:33:24.486003] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.904 [2024-10-07 11:33:24.486018] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.904 [2024-10-07 11:33:24.486157] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.904 [2024-10-07 11:33:24.486200] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.904 [2024-10-07 11:33:24.486309] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.904 [2024-10-07 11:33:24.486330] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.904 [2024-10-07 11:33:24.486344] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.904 [2024-10-07 11:33:24.486360] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.904 [2024-10-07 11:33:24.486373] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.904 [2024-10-07 11:33:24.486386] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.904 [2024-10-07 11:33:24.488962] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.904 [2024-10-07 11:33:24.488999] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.904 [2024-10-07 11:33:24.496696] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.904 [2024-10-07 11:33:24.496910] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.904 [2024-10-07 11:33:24.496994] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.904 [2024-10-07 11:33:24.497023] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.904 [2024-10-07 11:33:24.497040] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.904 [2024-10-07 11:33:24.497197] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.904 [2024-10-07 11:33:24.497242] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.905 [2024-10-07 11:33:24.497259] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.905 [2024-10-07 11:33:24.497277] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.905 [2024-10-07 11:33:24.497392] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.905 [2024-10-07 11:33:24.497415] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.905 [2024-10-07 11:33:24.497429] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.905 [2024-10-07 11:33:24.497442] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.905 [2024-10-07 11:33:24.497570] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.905 [2024-10-07 11:33:24.497591] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.905 [2024-10-07 11:33:24.497604] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.905 [2024-10-07 11:33:24.497617] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.905 [2024-10-07 11:33:24.497715] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.905 [2024-10-07 11:33:24.506909] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.905 [2024-10-07 11:33:24.507018] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.905 [2024-10-07 11:33:24.507049] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.905 [2024-10-07 11:33:24.507084] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.905 [2024-10-07 11:33:24.507626] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.905 [2024-10-07 11:33:24.507851] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.905 [2024-10-07 11:33:24.507898] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.905 [2024-10-07 11:33:24.507916] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.905 [2024-10-07 11:33:24.507930] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.905 [2024-10-07 11:33:24.508042] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.905 [2024-10-07 11:33:24.508107] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.905 [2024-10-07 11:33:24.508135] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.905 [2024-10-07 11:33:24.508151] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.905 [2024-10-07 11:33:24.508353] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.905 [2024-10-07 11:33:24.508414] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.905 [2024-10-07 11:33:24.508436] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.905 [2024-10-07 11:33:24.508450] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.905 [2024-10-07 11:33:24.508474] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.905 [2024-10-07 11:33:24.520162] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.905 [2024-10-07 11:33:24.520226] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.905 [2024-10-07 11:33:24.520343] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.905 [2024-10-07 11:33:24.520374] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.905 [2024-10-07 11:33:24.520391] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.905 [2024-10-07 11:33:24.520440] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.905 [2024-10-07 11:33:24.520464] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.905 [2024-10-07 11:33:24.520479] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.905 [2024-10-07 11:33:24.521083] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.905 [2024-10-07 11:33:24.521129] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.905 [2024-10-07 11:33:24.521309] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.905 [2024-10-07 11:33:24.521344] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.905 [2024-10-07 11:33:24.521361] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.905 [2024-10-07 11:33:24.521379] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.905 [2024-10-07 11:33:24.521393] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.905 [2024-10-07 11:33:24.521421] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.905 [2024-10-07 11:33:24.521526] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.905 [2024-10-07 11:33:24.521545] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.905 [2024-10-07 11:33:24.530864] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.905 [2024-10-07 11:33:24.530913] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.905 [2024-10-07 11:33:24.533208] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.905 [2024-10-07 11:33:24.533268] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.905 [2024-10-07 11:33:24.533304] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.905 [2024-10-07 11:33:24.533355] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.905 [2024-10-07 11:33:24.533379] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.905 [2024-10-07 11:33:24.533395] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.905 [2024-10-07 11:33:24.534602] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.905 [2024-10-07 11:33:24.534663] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.905 [2024-10-07 11:33:24.535094] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.905 [2024-10-07 11:33:24.535134] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.905 [2024-10-07 11:33:24.535153] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.905 [2024-10-07 11:33:24.535170] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.905 [2024-10-07 11:33:24.535185] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.905 [2024-10-07 11:33:24.535209] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.905 [2024-10-07 11:33:24.535353] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.905 [2024-10-07 11:33:24.535377] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.905 [2024-10-07 11:33:24.541007] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.905 [2024-10-07 11:33:24.541457] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.905 [2024-10-07 11:33:24.541571] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.905 [2024-10-07 11:33:24.541602] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.905 [2024-10-07 11:33:24.541619] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.905 [2024-10-07 11:33:24.541718] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.905 [2024-10-07 11:33:24.541747] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.905 [2024-10-07 11:33:24.541763] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.905 [2024-10-07 11:33:24.541781] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.905 [2024-10-07 11:33:24.544387] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.905 [2024-10-07 11:33:24.544430] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.905 [2024-10-07 11:33:24.544448] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.905 [2024-10-07 11:33:24.544461] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.905 [2024-10-07 11:33:24.545043] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.905 [2024-10-07 11:33:24.545084] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.905 [2024-10-07 11:33:24.545101] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.905 [2024-10-07 11:33:24.545115] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.905 [2024-10-07 11:33:24.545306] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.905 [2024-10-07 11:33:24.551091] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.905 [2024-10-07 11:33:24.551210] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.905 [2024-10-07 11:33:24.551242] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.905 [2024-10-07 11:33:24.551259] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.905 [2024-10-07 11:33:24.551283] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.905 [2024-10-07 11:33:24.551305] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.905 [2024-10-07 11:33:24.551319] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.905 [2024-10-07 11:33:24.551333] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.905 [2024-10-07 11:33:24.551356] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.905 [2024-10-07 11:33:24.551528] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.905 [2024-10-07 11:33:24.551600] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.905 [2024-10-07 11:33:24.551628] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.905 [2024-10-07 11:33:24.551643] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.905 [2024-10-07 11:33:24.551683] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.905 [2024-10-07 11:33:24.551706] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.905 [2024-10-07 11:33:24.551720] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.905 [2024-10-07 11:33:24.551733] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.905 [2024-10-07 11:33:24.551756] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.905 [2024-10-07 11:33:24.562662] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.905 [2024-10-07 11:33:24.563100] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.905 [2024-10-07 11:33:24.563224] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.905 [2024-10-07 11:33:24.563255] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.905 [2024-10-07 11:33:24.563290] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.905 [2024-10-07 11:33:24.563552] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.905 [2024-10-07 11:33:24.563594] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.905 [2024-10-07 11:33:24.563614] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.905 [2024-10-07 11:33:24.563633] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.905 [2024-10-07 11:33:24.563877] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.905 [2024-10-07 11:33:24.563919] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.905 [2024-10-07 11:33:24.563935] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.905 [2024-10-07 11:33:24.563949] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.905 [2024-10-07 11:33:24.564145] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.905 [2024-10-07 11:33:24.564170] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.905 [2024-10-07 11:33:24.564185] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.905 [2024-10-07 11:33:24.564198] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.905 [2024-10-07 11:33:24.564255] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.905 [2024-10-07 11:33:24.572951] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.905 [2024-10-07 11:33:24.573667] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.905 [2024-10-07 11:33:24.573721] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.905 [2024-10-07 11:33:24.573757] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.905 [2024-10-07 11:33:24.576442] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.905 [2024-10-07 11:33:24.577150] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.905 [2024-10-07 11:33:24.577203] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.906 [2024-10-07 11:33:24.577223] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.906 [2024-10-07 11:33:24.577237] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.906 [2024-10-07 11:33:24.577440] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.906 [2024-10-07 11:33:24.577507] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.906 [2024-10-07 11:33:24.577534] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.906 [2024-10-07 11:33:24.577549] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.906 [2024-10-07 11:33:24.577701] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.906 [2024-10-07 11:33:24.577842] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.906 [2024-10-07 11:33:24.577866] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.906 [2024-10-07 11:33:24.577896] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.906 [2024-10-07 11:33:24.578000] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.906 [2024-10-07 11:33:24.583043] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.906 [2024-10-07 11:33:24.583162] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.906 [2024-10-07 11:33:24.583223] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.906 [2024-10-07 11:33:24.583242] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.906 [2024-10-07 11:33:24.583266] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.906 [2024-10-07 11:33:24.583289] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.906 [2024-10-07 11:33:24.583304] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.906 [2024-10-07 11:33:24.583318] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.906 [2024-10-07 11:33:24.585487] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.906 [2024-10-07 11:33:24.587242] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.906 [2024-10-07 11:33:24.587346] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.906 [2024-10-07 11:33:24.587376] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.906 [2024-10-07 11:33:24.587393] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.906 [2024-10-07 11:33:24.587417] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.906 [2024-10-07 11:33:24.587439] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.906 [2024-10-07 11:33:24.587453] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.906 [2024-10-07 11:33:24.587467] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.906 [2024-10-07 11:33:24.589074] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.906 [2024-10-07 11:33:24.593133] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.906 [2024-10-07 11:33:24.593262] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.906 [2024-10-07 11:33:24.593292] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.906 [2024-10-07 11:33:24.593308] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.906 [2024-10-07 11:33:24.593331] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.906 [2024-10-07 11:33:24.593353] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.906 [2024-10-07 11:33:24.593367] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.906 [2024-10-07 11:33:24.593380] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.906 [2024-10-07 11:33:24.593402] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.906 [2024-10-07 11:33:24.597647] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.906 [2024-10-07 11:33:24.597905] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.906 [2024-10-07 11:33:24.597937] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.906 [2024-10-07 11:33:24.597954] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.906 [2024-10-07 11:33:24.598058] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.906 [2024-10-07 11:33:24.599044] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.906 [2024-10-07 11:33:24.599083] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.906 [2024-10-07 11:33:24.599116] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.906 [2024-10-07 11:33:24.601675] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.906 [2024-10-07 11:33:24.605857] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.906 [2024-10-07 11:33:24.606004] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.906 [2024-10-07 11:33:24.606050] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.906 [2024-10-07 11:33:24.606067] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.906 [2024-10-07 11:33:24.606091] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.906 [2024-10-07 11:33:24.606114] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.906 [2024-10-07 11:33:24.606129] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.906 [2024-10-07 11:33:24.606142] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.906 [2024-10-07 11:33:24.606166] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.906 [2024-10-07 11:33:24.607767] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.906 [2024-10-07 11:33:24.607900] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.906 [2024-10-07 11:33:24.607929] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.906 [2024-10-07 11:33:24.607962] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.906 [2024-10-07 11:33:24.607985] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.906 [2024-10-07 11:33:24.608007] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.906 [2024-10-07 11:33:24.608022] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.906 [2024-10-07 11:33:24.608036] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.906 [2024-10-07 11:33:24.608059] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.906 [2024-10-07 11:33:24.618815] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.906 [2024-10-07 11:33:24.619596] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.906 [2024-10-07 11:33:24.619656] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.906 [2024-10-07 11:33:24.619691] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.906 [2024-10-07 11:33:24.619951] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.906 [2024-10-07 11:33:24.620019] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.906 [2024-10-07 11:33:24.620120] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.906 [2024-10-07 11:33:24.620148] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.906 [2024-10-07 11:33:24.620164] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.906 [2024-10-07 11:33:24.620179] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.906 [2024-10-07 11:33:24.620192] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.906 [2024-10-07 11:33:24.620205] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.906 [2024-10-07 11:33:24.620229] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.906 [2024-10-07 11:33:24.620248] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.906 [2024-10-07 11:33:24.620268] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.906 [2024-10-07 11:33:24.620282] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.906 [2024-10-07 11:33:24.620295] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.906 [2024-10-07 11:33:24.620315] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.906 [2024-10-07 11:33:24.629169] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.906 [2024-10-07 11:33:24.629378] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.906 [2024-10-07 11:33:24.629409] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.906 [2024-10-07 11:33:24.629426] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.906 [2024-10-07 11:33:24.631957] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.906 [2024-10-07 11:33:24.633959] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.906 [2024-10-07 11:33:24.633997] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.906 [2024-10-07 11:33:24.634030] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.906 [2024-10-07 11:33:24.634145] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.906 [2024-10-07 11:33:24.634175] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.906 [2024-10-07 11:33:24.634245] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.906 [2024-10-07 11:33:24.634274] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.906 [2024-10-07 11:33:24.634290] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.906 [2024-10-07 11:33:24.634314] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.906 [2024-10-07 11:33:24.634336] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.906 [2024-10-07 11:33:24.634350] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.906 [2024-10-07 11:33:24.634363] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.906 [2024-10-07 11:33:24.634400] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.906 [2024-10-07 11:33:24.639263] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.906 [2024-10-07 11:33:24.639367] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.906 [2024-10-07 11:33:24.639397] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.906 [2024-10-07 11:33:24.639414] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.906 [2024-10-07 11:33:24.639437] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.906 [2024-10-07 11:33:24.639460] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.906 [2024-10-07 11:33:24.639474] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.906 [2024-10-07 11:33:24.639487] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.906 [2024-10-07 11:33:24.639509] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.906 [2024-10-07 11:33:24.648056] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.906 [2024-10-07 11:33:24.648175] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.906 [2024-10-07 11:33:24.648205] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.906 [2024-10-07 11:33:24.648222] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.906 [2024-10-07 11:33:24.648245] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.907 [2024-10-07 11:33:24.648840] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.907 [2024-10-07 11:33:24.648877] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.907 [2024-10-07 11:33:24.648926] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.907 [2024-10-07 11:33:24.649038] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.907 [2024-10-07 11:33:24.649337] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.907 [2024-10-07 11:33:24.649423] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.907 [2024-10-07 11:33:24.649452] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.907 [2024-10-07 11:33:24.649468] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.907 [2024-10-07 11:33:24.649491] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.907 [2024-10-07 11:33:24.649512] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.907 [2024-10-07 11:33:24.649526] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.907 [2024-10-07 11:33:24.649539] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.907 [2024-10-07 11:33:24.649561] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.907 [2024-10-07 11:33:24.660538] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.907 [2024-10-07 11:33:24.660588] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.907 [2024-10-07 11:33:24.662975] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.907 [2024-10-07 11:33:24.663035] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.907 [2024-10-07 11:33:24.663056] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.907 [2024-10-07 11:33:24.663107] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.907 [2024-10-07 11:33:24.663130] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.907 [2024-10-07 11:33:24.663145] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.907 [2024-10-07 11:33:24.663716] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.907 [2024-10-07 11:33:24.663760] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.907 [2024-10-07 11:33:24.663858] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.907 [2024-10-07 11:33:24.663880] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.907 [2024-10-07 11:33:24.663895] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.907 [2024-10-07 11:33:24.663912] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.907 [2024-10-07 11:33:24.663925] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.907 [2024-10-07 11:33:24.663937] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.907 [2024-10-07 11:33:24.664193] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.907 [2024-10-07 11:33:24.664219] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.907 [2024-10-07 11:33:24.670676] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.907 [2024-10-07 11:33:24.670760] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.907 [2024-10-07 11:33:24.670863] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.907 [2024-10-07 11:33:24.670892] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.907 [2024-10-07 11:33:24.670907] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.907 [2024-10-07 11:33:24.670960] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.907 [2024-10-07 11:33:24.670983] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.907 [2024-10-07 11:33:24.670997] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.907 [2024-10-07 11:33:24.671014] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.907 [2024-10-07 11:33:24.671036] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.907 [2024-10-07 11:33:24.671052] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.907 [2024-10-07 11:33:24.671065] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.907 [2024-10-07 11:33:24.671077] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.907 [2024-10-07 11:33:24.671099] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.907 [2024-10-07 11:33:24.671128] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.907 [2024-10-07 11:33:24.671142] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.907 [2024-10-07 11:33:24.671154] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.907 [2024-10-07 11:33:24.671174] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.907 [2024-10-07 11:33:24.683842] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.907 [2024-10-07 11:33:24.683890] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.907 [2024-10-07 11:33:24.684105] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.907 [2024-10-07 11:33:24.684137] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.907 [2024-10-07 11:33:24.684154] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.907 [2024-10-07 11:33:24.684202] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.907 [2024-10-07 11:33:24.684225] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.907 [2024-10-07 11:33:24.684239] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.907 [2024-10-07 11:33:24.684470] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.907 [2024-10-07 11:33:24.684501] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.907 [2024-10-07 11:33:24.684555] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.907 [2024-10-07 11:33:24.684576] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.907 [2024-10-07 11:33:24.684590] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.907 [2024-10-07 11:33:24.684607] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.907 [2024-10-07 11:33:24.684620] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.907 [2024-10-07 11:33:24.684633] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.907 [2024-10-07 11:33:24.684655] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.907 [2024-10-07 11:33:24.684686] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.907 [2024-10-07 11:33:24.697713] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.907 [2024-10-07 11:33:24.697771] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.907 [2024-10-07 11:33:24.698116] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.907 [2024-10-07 11:33:24.698160] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.907 [2024-10-07 11:33:24.698180] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.907 [2024-10-07 11:33:24.698231] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.907 [2024-10-07 11:33:24.698253] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.907 [2024-10-07 11:33:24.698268] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.907 [2024-10-07 11:33:24.698321] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.907 [2024-10-07 11:33:24.698363] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.907 [2024-10-07 11:33:24.698385] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.907 [2024-10-07 11:33:24.698399] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.907 [2024-10-07 11:33:24.698413] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.907 [2024-10-07 11:33:24.698460] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.907 [2024-10-07 11:33:24.698474] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.907 [2024-10-07 11:33:24.698487] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.907 [2024-10-07 11:33:24.698514] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.907 [2024-10-07 11:33:24.698529] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.907 [2024-10-07 11:33:24.711418] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.907 [2024-10-07 11:33:24.711467] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.907 [2024-10-07 11:33:24.711553] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.907 [2024-10-07 11:33:24.711582] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.907 [2024-10-07 11:33:24.711599] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.907 [2024-10-07 11:33:24.711660] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.907 [2024-10-07 11:33:24.711686] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.907 [2024-10-07 11:33:24.711702] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.907 [2024-10-07 11:33:24.711727] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.907 [2024-10-07 11:33:24.711747] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.907 [2024-10-07 11:33:24.711767] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.907 [2024-10-07 11:33:24.711781] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.907 [2024-10-07 11:33:24.711794] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.907 [2024-10-07 11:33:24.711810] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.907 [2024-10-07 11:33:24.711825] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.907 [2024-10-07 11:33:24.711837] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.907 [2024-10-07 11:33:24.711860] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.907 [2024-10-07 11:33:24.711875] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.907 [2024-10-07 11:33:24.726344] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.907 [2024-10-07 11:33:24.726394] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.907 [2024-10-07 11:33:24.726586] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.907 [2024-10-07 11:33:24.726633] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.907 [2024-10-07 11:33:24.726668] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.907 [2024-10-07 11:33:24.726723] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.907 [2024-10-07 11:33:24.726747] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.907 [2024-10-07 11:33:24.726762] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.907 [2024-10-07 11:33:24.726786] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.907 [2024-10-07 11:33:24.726806] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.907 [2024-10-07 11:33:24.726826] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.907 [2024-10-07 11:33:24.726841] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.907 [2024-10-07 11:33:24.726855] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.907 [2024-10-07 11:33:24.726871] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.907 [2024-10-07 11:33:24.726885] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.907 [2024-10-07 11:33:24.726898] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.907 [2024-10-07 11:33:24.726921] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.907 [2024-10-07 11:33:24.726936] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.907 [2024-10-07 11:33:24.741065] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.907 [2024-10-07 11:33:24.741115] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.907 [2024-10-07 11:33:24.741202] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.907 [2024-10-07 11:33:24.741232] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.907 [2024-10-07 11:33:24.741249] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.907 [2024-10-07 11:33:24.741297] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.907 [2024-10-07 11:33:24.741320] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.907 [2024-10-07 11:33:24.741336] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.907 [2024-10-07 11:33:24.742314] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.908 [2024-10-07 11:33:24.742358] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.908 [2024-10-07 11:33:24.743034] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.908 [2024-10-07 11:33:24.743084] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.908 [2024-10-07 11:33:24.743102] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.908 [2024-10-07 11:33:24.743119] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.908 [2024-10-07 11:33:24.743133] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.908 [2024-10-07 11:33:24.743169] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.908 [2024-10-07 11:33:24.743436] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.908 [2024-10-07 11:33:24.743463] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.908 [2024-10-07 11:33:24.753967] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.908 [2024-10-07 11:33:24.754015] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.908 [2024-10-07 11:33:24.754738] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.908 [2024-10-07 11:33:24.754782] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.908 [2024-10-07 11:33:24.754802] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.908 [2024-10-07 11:33:24.754854] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.908 [2024-10-07 11:33:24.754877] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.908 [2024-10-07 11:33:24.754893] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.908 [2024-10-07 11:33:24.754986] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.908 [2024-10-07 11:33:24.755013] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.908 [2024-10-07 11:33:24.755033] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.908 [2024-10-07 11:33:24.755048] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.908 [2024-10-07 11:33:24.755062] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.908 [2024-10-07 11:33:24.755079] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.908 [2024-10-07 11:33:24.755093] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.908 [2024-10-07 11:33:24.755106] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.908 [2024-10-07 11:33:24.755129] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.908 [2024-10-07 11:33:24.755144] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.908 [2024-10-07 11:33:24.765030] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.908 [2024-10-07 11:33:24.765081] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.908 [2024-10-07 11:33:24.765214] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.908 [2024-10-07 11:33:24.765246] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.908 [2024-10-07 11:33:24.765263] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.908 [2024-10-07 11:33:24.765311] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.908 [2024-10-07 11:33:24.765335] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.908 [2024-10-07 11:33:24.765352] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.908 [2024-10-07 11:33:24.765375] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.908 [2024-10-07 11:33:24.765396] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.908 [2024-10-07 11:33:24.765432] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.908 [2024-10-07 11:33:24.765447] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.908 [2024-10-07 11:33:24.765461] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.908 [2024-10-07 11:33:24.765478] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.908 [2024-10-07 11:33:24.765492] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.908 [2024-10-07 11:33:24.765505] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.908 [2024-10-07 11:33:24.765528] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.908 [2024-10-07 11:33:24.765542] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.908 [2024-10-07 11:33:24.775937] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.908 [2024-10-07 11:33:24.775987] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.908 [2024-10-07 11:33:24.776867] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.908 [2024-10-07 11:33:24.776928] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.908 [2024-10-07 11:33:24.776949] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.908 [2024-10-07 11:33:24.777002] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.908 [2024-10-07 11:33:24.777026] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.908 [2024-10-07 11:33:24.777041] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.908 [2024-10-07 11:33:24.777424] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.908 [2024-10-07 11:33:24.777471] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.908 [2024-10-07 11:33:24.777734] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.908 [2024-10-07 11:33:24.777771] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.908 [2024-10-07 11:33:24.777788] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.908 [2024-10-07 11:33:24.777805] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.908 [2024-10-07 11:33:24.777819] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.908 [2024-10-07 11:33:24.777848] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.908 [2024-10-07 11:33:24.778054] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.908 [2024-10-07 11:33:24.778080] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.908 [2024-10-07 11:33:24.789423] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.908 [2024-10-07 11:33:24.789472] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.908 [2024-10-07 11:33:24.789701] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.908 [2024-10-07 11:33:24.789735] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.908 [2024-10-07 11:33:24.789767] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.908 [2024-10-07 11:33:24.789833] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.908 [2024-10-07 11:33:24.789856] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.908 [2024-10-07 11:33:24.789871] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.908 [2024-10-07 11:33:24.789931] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.908 [2024-10-07 11:33:24.789958] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.908 [2024-10-07 11:33:24.789979] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.908 [2024-10-07 11:33:24.789993] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.908 [2024-10-07 11:33:24.790006] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.908 [2024-10-07 11:33:24.790022] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.908 [2024-10-07 11:33:24.790035] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.908 [2024-10-07 11:33:24.790048] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.908 [2024-10-07 11:33:24.790070] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.908 [2024-10-07 11:33:24.790084] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.908 [2024-10-07 11:33:24.803386] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.908 [2024-10-07 11:33:24.803434] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.908 [2024-10-07 11:33:24.803521] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.908 [2024-10-07 11:33:24.803550] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.908 [2024-10-07 11:33:24.803567] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.908 [2024-10-07 11:33:24.803614] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.908 [2024-10-07 11:33:24.803637] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.908 [2024-10-07 11:33:24.803682] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.908 [2024-10-07 11:33:24.803707] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.908 [2024-10-07 11:33:24.803726] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.908 [2024-10-07 11:33:24.804545] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.908 [2024-10-07 11:33:24.804581] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.908 [2024-10-07 11:33:24.804616] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.908 [2024-10-07 11:33:24.804633] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.908 [2024-10-07 11:33:24.804647] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.908 [2024-10-07 11:33:24.804659] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.908 [2024-10-07 11:33:24.805208] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.908 [2024-10-07 11:33:24.805245] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.908 [2024-10-07 11:33:24.817642] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.908 [2024-10-07 11:33:24.817720] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.908 [2024-10-07 11:33:24.818008] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.908 [2024-10-07 11:33:24.818052] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.908 [2024-10-07 11:33:24.818073] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.908 [2024-10-07 11:33:24.818125] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.908 [2024-10-07 11:33:24.818148] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.908 [2024-10-07 11:33:24.818163] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.908 [2024-10-07 11:33:24.818355] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.908 [2024-10-07 11:33:24.818385] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.908 [2024-10-07 11:33:24.818583] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.908 [2024-10-07 11:33:24.818616] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.908 [2024-10-07 11:33:24.818632] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.908 [2024-10-07 11:33:24.818663] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.908 [2024-10-07 11:33:24.818680] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.908 [2024-10-07 11:33:24.818693] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.908 [2024-10-07 11:33:24.818885] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.908 [2024-10-07 11:33:24.818910] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.908 [2024-10-07 11:33:24.832260] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.908 [2024-10-07 11:33:24.832310] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.908 [2024-10-07 11:33:24.832396] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.908 [2024-10-07 11:33:24.832426] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.908 [2024-10-07 11:33:24.832442] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.908 [2024-10-07 11:33:24.832490] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.908 [2024-10-07 11:33:24.832514] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.908 [2024-10-07 11:33:24.832529] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.908 [2024-10-07 11:33:24.832553] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.908 [2024-10-07 11:33:24.832573] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.908 [2024-10-07 11:33:24.832611] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.908 [2024-10-07 11:33:24.832627] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.909 [2024-10-07 11:33:24.832640] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.909 [2024-10-07 11:33:24.832672] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.909 [2024-10-07 11:33:24.832688] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.909 [2024-10-07 11:33:24.832701] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.909 [2024-10-07 11:33:24.832724] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.909 [2024-10-07 11:33:24.832738] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.909 [2024-10-07 11:33:24.842635] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.909 [2024-10-07 11:33:24.842700] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.909 [2024-10-07 11:33:24.842787] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.909 [2024-10-07 11:33:24.842817] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.909 [2024-10-07 11:33:24.842834] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.909 [2024-10-07 11:33:24.842882] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.909 [2024-10-07 11:33:24.842905] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.909 [2024-10-07 11:33:24.842921] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.909 [2024-10-07 11:33:24.842944] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.909 [2024-10-07 11:33:24.842964] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.909 [2024-10-07 11:33:24.845784] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.909 [2024-10-07 11:33:24.845825] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.909 [2024-10-07 11:33:24.845844] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.909 [2024-10-07 11:33:24.845862] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.909 [2024-10-07 11:33:24.845876] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.909 [2024-10-07 11:33:24.845888] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.909 [2024-10-07 11:33:24.848221] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.909 [2024-10-07 11:33:24.848260] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.909 [2024-10-07 11:33:24.852760] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.909 [2024-10-07 11:33:24.852821] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.909 [2024-10-07 11:33:24.852897] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.909 [2024-10-07 11:33:24.852926] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.909 [2024-10-07 11:33:24.852943] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.909 [2024-10-07 11:33:24.853017] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.909 [2024-10-07 11:33:24.853043] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.909 [2024-10-07 11:33:24.853058] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.909 [2024-10-07 11:33:24.853076] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.909 [2024-10-07 11:33:24.853100] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.909 [2024-10-07 11:33:24.853117] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.909 [2024-10-07 11:33:24.853130] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.909 [2024-10-07 11:33:24.853144] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.909 [2024-10-07 11:33:24.853168] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.909 [2024-10-07 11:33:24.853182] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.909 [2024-10-07 11:33:24.853195] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.909 [2024-10-07 11:33:24.853208] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.909 [2024-10-07 11:33:24.853228] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.909 [2024-10-07 11:33:24.862852] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.909 [2024-10-07 11:33:24.862987] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.909 [2024-10-07 11:33:24.863019] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.909 [2024-10-07 11:33:24.863036] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.909 [2024-10-07 11:33:24.863060] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.909 [2024-10-07 11:33:24.863091] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.909 [2024-10-07 11:33:24.863153] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.909 [2024-10-07 11:33:24.863178] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.909 [2024-10-07 11:33:24.863206] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.909 [2024-10-07 11:33:24.863221] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.909 [2024-10-07 11:33:24.863233] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.909 [2024-10-07 11:33:24.863247] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.909 [2024-10-07 11:33:24.863272] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.909 [2024-10-07 11:33:24.863290] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.909 [2024-10-07 11:33:24.863311] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.909 [2024-10-07 11:33:24.863325] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.909 [2024-10-07 11:33:24.863338] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.909 [2024-10-07 11:33:24.863375] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.909 [2024-10-07 11:33:24.874447] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.909 [2024-10-07 11:33:24.874500] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.909 [2024-10-07 11:33:24.874898] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.909 [2024-10-07 11:33:24.874944] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.909 [2024-10-07 11:33:24.874964] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.909 [2024-10-07 11:33:24.875016] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.909 [2024-10-07 11:33:24.875041] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.909 [2024-10-07 11:33:24.875056] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.909 [2024-10-07 11:33:24.875598] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.909 [2024-10-07 11:33:24.875642] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.909 [2024-10-07 11:33:24.875755] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.909 [2024-10-07 11:33:24.875780] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.909 [2024-10-07 11:33:24.875795] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.909 [2024-10-07 11:33:24.875812] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.909 [2024-10-07 11:33:24.875826] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.909 [2024-10-07 11:33:24.875839] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.909 [2024-10-07 11:33:24.875862] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.909 [2024-10-07 11:33:24.875876] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.909 [2024-10-07 11:33:24.884884] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.909 [2024-10-07 11:33:24.885040] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.909 [2024-10-07 11:33:24.885121] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.909 [2024-10-07 11:33:24.885150] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.909 [2024-10-07 11:33:24.885167] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.909 [2024-10-07 11:33:24.885318] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.909 [2024-10-07 11:33:24.885346] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.909 [2024-10-07 11:33:24.885362] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.909 [2024-10-07 11:33:24.885380] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.909 [2024-10-07 11:33:24.886525] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.909 [2024-10-07 11:33:24.886565] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.909 [2024-10-07 11:33:24.886598] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.909 [2024-10-07 11:33:24.886614] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.909 [2024-10-07 11:33:24.889546] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.909 [2024-10-07 11:33:24.889587] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.909 [2024-10-07 11:33:24.889604] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.909 [2024-10-07 11:33:24.889619] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.909 [2024-10-07 11:33:24.890500] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.909 [2024-10-07 11:33:24.894967] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.909 [2024-10-07 11:33:24.895074] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.909 [2024-10-07 11:33:24.895104] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.909 [2024-10-07 11:33:24.895121] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.909 [2024-10-07 11:33:24.895144] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.909 [2024-10-07 11:33:24.895181] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.909 [2024-10-07 11:33:24.895213] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.909 [2024-10-07 11:33:24.895227] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.909 [2024-10-07 11:33:24.896348] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.909 [2024-10-07 11:33:24.896393] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.909 [2024-10-07 11:33:24.896677] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.910 [2024-10-07 11:33:24.896710] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.910 [2024-10-07 11:33:24.896727] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.910 [2024-10-07 11:33:24.896843] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.910 [2024-10-07 11:33:24.896973] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.910 [2024-10-07 11:33:24.897000] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.910 [2024-10-07 11:33:24.897015] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.910 [2024-10-07 11:33:24.897062] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.910 8795.75 IOPS, 34.36 MiB/s [2024-10-07T11:33:33.433Z] [2024-10-07 11:33:24.906004] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.910 [2024-10-07 11:33:24.906111] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.910 [2024-10-07 11:33:24.906142] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.910 [2024-10-07 11:33:24.906160] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.910 [2024-10-07 11:33:24.906184] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.910 [2024-10-07 11:33:24.906222] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.910 [2024-10-07 11:33:24.906237] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.910 [2024-10-07 11:33:24.906251] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.910 [2024-10-07 11:33:24.906274] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.910 [2024-10-07 11:33:24.906440] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.910 [2024-10-07 11:33:24.906515] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.910 [2024-10-07 11:33:24.906542] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.910 [2024-10-07 11:33:24.906558] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.910 [2024-10-07 11:33:24.906581] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.910 [2024-10-07 11:33:24.907331] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.910 [2024-10-07 11:33:24.907370] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.910 [2024-10-07 11:33:24.907388] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.910 [2024-10-07 11:33:24.907581] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.910 [2024-10-07 11:33:24.917465] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.910 [2024-10-07 11:33:24.917515] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.910 [2024-10-07 11:33:24.917632] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.910 [2024-10-07 11:33:24.917680] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.910 [2024-10-07 11:33:24.917699] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.910 [2024-10-07 11:33:24.917752] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.910 [2024-10-07 11:33:24.917776] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.910 [2024-10-07 11:33:24.917791] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.910 [2024-10-07 11:33:24.917969] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.910 [2024-10-07 11:33:24.917999] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.910 [2024-10-07 11:33:24.918055] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.910 [2024-10-07 11:33:24.918077] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.910 [2024-10-07 11:33:24.918091] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.910 [2024-10-07 11:33:24.918108] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.910 [2024-10-07 11:33:24.918122] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.910 [2024-10-07 11:33:24.918135] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.910 [2024-10-07 11:33:24.918587] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.910 [2024-10-07 11:33:24.918634] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.910 [2024-10-07 11:33:24.930664] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.910 [2024-10-07 11:33:24.930714] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.910 [2024-10-07 11:33:24.930938] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.910 [2024-10-07 11:33:24.930972] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.910 [2024-10-07 11:33:24.930989] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.910 [2024-10-07 11:33:24.931038] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.910 [2024-10-07 11:33:24.931065] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.910 [2024-10-07 11:33:24.931081] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.910 [2024-10-07 11:33:24.931293] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.910 [2024-10-07 11:33:24.931326] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.910 [2024-10-07 11:33:24.931446] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.910 [2024-10-07 11:33:24.931470] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.910 [2024-10-07 11:33:24.931484] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.910 [2024-10-07 11:33:24.931502] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.910 [2024-10-07 11:33:24.931516] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.910 [2024-10-07 11:33:24.931529] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.910 [2024-10-07 11:33:24.931630] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.910 [2024-10-07 11:33:24.931662] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.910 [2024-10-07 11:33:24.944265] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.910 [2024-10-07 11:33:24.944315] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.910 [2024-10-07 11:33:24.944402] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.910 [2024-10-07 11:33:24.944433] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.910 [2024-10-07 11:33:24.944450] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.910 [2024-10-07 11:33:24.944497] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.910 [2024-10-07 11:33:24.944521] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.910 [2024-10-07 11:33:24.944536] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.910 [2024-10-07 11:33:24.944559] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.910 [2024-10-07 11:33:24.944579] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.910 [2024-10-07 11:33:24.944599] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.910 [2024-10-07 11:33:24.944613] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.910 [2024-10-07 11:33:24.944662] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.910 [2024-10-07 11:33:24.944684] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.910 [2024-10-07 11:33:24.944698] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.910 [2024-10-07 11:33:24.944711] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.910 [2024-10-07 11:33:24.944735] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.910 [2024-10-07 11:33:24.944750] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.910 [2024-10-07 11:33:24.959312] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.910 [2024-10-07 11:33:24.959365] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.910 [2024-10-07 11:33:24.959538] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.910 [2024-10-07 11:33:24.959572] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.910 [2024-10-07 11:33:24.959589] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.910 [2024-10-07 11:33:24.959638] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.910 [2024-10-07 11:33:24.959688] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.910 [2024-10-07 11:33:24.959705] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.910 [2024-10-07 11:33:24.959730] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.910 [2024-10-07 11:33:24.959751] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.910 [2024-10-07 11:33:24.959771] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.910 [2024-10-07 11:33:24.959785] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.910 [2024-10-07 11:33:24.959799] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.910 [2024-10-07 11:33:24.959816] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.910 [2024-10-07 11:33:24.959830] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.910 [2024-10-07 11:33:24.959843] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.910 [2024-10-07 11:33:24.959866] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.910 [2024-10-07 11:33:24.959881] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.910 [2024-10-07 11:33:24.973255] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.910 [2024-10-07 11:33:24.973307] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.910 [2024-10-07 11:33:24.973399] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.910 [2024-10-07 11:33:24.973428] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.910 [2024-10-07 11:33:24.973445] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.910 [2024-10-07 11:33:24.973492] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.910 [2024-10-07 11:33:24.973515] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.910 [2024-10-07 11:33:24.973550] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.910 [2024-10-07 11:33:24.973575] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.910 [2024-10-07 11:33:24.973595] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.910 [2024-10-07 11:33:24.973615] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.910 [2024-10-07 11:33:24.973629] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.910 [2024-10-07 11:33:24.973643] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.910 [2024-10-07 11:33:24.973678] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.910 [2024-10-07 11:33:24.973693] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.910 [2024-10-07 11:33:24.973706] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.910 [2024-10-07 11:33:24.973730] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.910 [2024-10-07 11:33:24.973745] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.910 [2024-10-07 11:33:24.983595] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.910 [2024-10-07 11:33:24.983744] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.910 [2024-10-07 11:33:24.983943] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.910 [2024-10-07 11:33:24.984023] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.910 [2024-10-07 11:33:24.984064] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.910 [2024-10-07 11:33:24.984171] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.910 [2024-10-07 11:33:24.984220] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.910 [2024-10-07 11:33:24.984254] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.910 [2024-10-07 11:33:24.984306] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.910 [2024-10-07 11:33:24.984349] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.910 [2024-10-07 11:33:24.990089] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.910 [2024-10-07 11:33:24.990171] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.910 [2024-10-07 11:33:24.990209] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.910 [2024-10-07 11:33:24.990247] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.910 [2024-10-07 11:33:24.990278] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.910 [2024-10-07 11:33:24.990306] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.910 [2024-10-07 11:33:24.991540] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.910 [2024-10-07 11:33:24.991614] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.910 [2024-10-07 11:33:24.997877] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.910 [2024-10-07 11:33:24.997953] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.911 [2024-10-07 11:33:24.998318] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.911 [2024-10-07 11:33:24.998369] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.911 [2024-10-07 11:33:24.998393] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.911 [2024-10-07 11:33:24.998457] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.911 [2024-10-07 11:33:24.998485] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.911 [2024-10-07 11:33:24.998504] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.911 [2024-10-07 11:33:25.001863] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.911 [2024-10-07 11:33:25.001921] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.911 [2024-10-07 11:33:25.002563] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.911 [2024-10-07 11:33:25.002608] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.911 [2024-10-07 11:33:25.002630] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.911 [2024-10-07 11:33:25.002668] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.911 [2024-10-07 11:33:25.002689] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.911 [2024-10-07 11:33:25.002705] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.911 [2024-10-07 11:33:25.006608] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.911 [2024-10-07 11:33:25.006667] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.911 [2024-10-07 11:33:25.011129] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.911 [2024-10-07 11:33:25.011194] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.911 [2024-10-07 11:33:25.011949] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.911 [2024-10-07 11:33:25.012002] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.911 [2024-10-07 11:33:25.012027] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.911 [2024-10-07 11:33:25.012089] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.911 [2024-10-07 11:33:25.012118] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.911 [2024-10-07 11:33:25.012136] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.911 [2024-10-07 11:33:25.012459] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.911 [2024-10-07 11:33:25.012510] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.911 [2024-10-07 11:33:25.012724] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.911 [2024-10-07 11:33:25.012757] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.911 [2024-10-07 11:33:25.012775] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.911 [2024-10-07 11:33:25.012813] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.911 [2024-10-07 11:33:25.012833] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.911 [2024-10-07 11:33:25.012849] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.911 [2024-10-07 11:33:25.013010] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.911 [2024-10-07 11:33:25.013037] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.911 [2024-10-07 11:33:25.022703] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.911 [2024-10-07 11:33:25.022760] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.911 [2024-10-07 11:33:25.022977] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.911 [2024-10-07 11:33:25.023026] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.911 [2024-10-07 11:33:25.023050] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.911 [2024-10-07 11:33:25.023112] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.911 [2024-10-07 11:33:25.023141] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.911 [2024-10-07 11:33:25.023160] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.911 [2024-10-07 11:33:25.023302] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.911 [2024-10-07 11:33:25.023333] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.911 [2024-10-07 11:33:25.023578] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.911 [2024-10-07 11:33:25.023610] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.911 [2024-10-07 11:33:25.023628] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.911 [2024-10-07 11:33:25.023666] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.911 [2024-10-07 11:33:25.023688] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.911 [2024-10-07 11:33:25.023704] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.911 [2024-10-07 11:33:25.023793] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.911 [2024-10-07 11:33:25.023818] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.911 [2024-10-07 11:33:25.037635] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.911 [2024-10-07 11:33:25.037708] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.911 [2024-10-07 11:33:25.038029] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.911 [2024-10-07 11:33:25.038081] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.911 [2024-10-07 11:33:25.038105] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.911 [2024-10-07 11:33:25.038166] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.911 [2024-10-07 11:33:25.038194] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.911 [2024-10-07 11:33:25.038233] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.911 [2024-10-07 11:33:25.040137] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.911 [2024-10-07 11:33:25.040190] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.911 [2024-10-07 11:33:25.040679] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.911 [2024-10-07 11:33:25.040725] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.911 [2024-10-07 11:33:25.040745] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.911 [2024-10-07 11:33:25.040767] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.911 [2024-10-07 11:33:25.040784] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.911 [2024-10-07 11:33:25.040799] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.911 [2024-10-07 11:33:25.040916] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.911 [2024-10-07 11:33:25.040944] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.911 [2024-10-07 11:33:25.051501] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.911 [2024-10-07 11:33:25.051561] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.911 [2024-10-07 11:33:25.052085] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.911 [2024-10-07 11:33:25.052138] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.911 [2024-10-07 11:33:25.052163] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.911 [2024-10-07 11:33:25.052224] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.911 [2024-10-07 11:33:25.052252] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.911 [2024-10-07 11:33:25.052271] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.911 [2024-10-07 11:33:25.053195] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.911 [2024-10-07 11:33:25.053247] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.911 [2024-10-07 11:33:25.055858] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.911 [2024-10-07 11:33:25.055903] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.911 [2024-10-07 11:33:25.055925] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.911 [2024-10-07 11:33:25.055947] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.911 [2024-10-07 11:33:25.055965] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.911 [2024-10-07 11:33:25.055980] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.911 [2024-10-07 11:33:25.056719] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.911 [2024-10-07 11:33:25.056762] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.911 [2024-10-07 11:33:25.062058] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.911 [2024-10-07 11:33:25.062114] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.911 [2024-10-07 11:33:25.062247] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.911 [2024-10-07 11:33:25.062283] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.911 [2024-10-07 11:33:25.062303] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.911 [2024-10-07 11:33:25.062360] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.911 [2024-10-07 11:33:25.062389] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.911 [2024-10-07 11:33:25.062407] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.911 [2024-10-07 11:33:25.062436] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.911 [2024-10-07 11:33:25.062460] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.911 [2024-10-07 11:33:25.062484] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.911 [2024-10-07 11:33:25.062502] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.911 [2024-10-07 11:33:25.062518] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.911 [2024-10-07 11:33:25.062538] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.911 [2024-10-07 11:33:25.062555] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.911 [2024-10-07 11:33:25.062571] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.911 [2024-10-07 11:33:25.064517] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.911 [2024-10-07 11:33:25.064563] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.911 [2024-10-07 11:33:25.074789] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.911 [2024-10-07 11:33:25.074849] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.911 [2024-10-07 11:33:25.074956] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.911 [2024-10-07 11:33:25.074990] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.911 [2024-10-07 11:33:25.075011] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.911 [2024-10-07 11:33:25.075068] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.911 [2024-10-07 11:33:25.075095] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.911 [2024-10-07 11:33:25.075114] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.911 [2024-10-07 11:33:25.075483] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.911 [2024-10-07 11:33:25.075535] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.911 [2024-10-07 11:33:25.075788] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.911 [2024-10-07 11:33:25.075828] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.911 [2024-10-07 11:33:25.075849] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.911 [2024-10-07 11:33:25.075870] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.911 [2024-10-07 11:33:25.075906] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.911 [2024-10-07 11:33:25.075924] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.911 [2024-10-07 11:33:25.076068] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.912 [2024-10-07 11:33:25.076095] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.912 [2024-10-07 11:33:25.085351] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.912 [2024-10-07 11:33:25.085408] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.912 [2024-10-07 11:33:25.085512] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.912 [2024-10-07 11:33:25.085547] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.912 [2024-10-07 11:33:25.085567] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.912 [2024-10-07 11:33:25.085623] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.912 [2024-10-07 11:33:25.085667] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.912 [2024-10-07 11:33:25.085690] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.912 [2024-10-07 11:33:25.085718] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.912 [2024-10-07 11:33:25.085743] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.912 [2024-10-07 11:33:25.085767] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.912 [2024-10-07 11:33:25.085784] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.912 [2024-10-07 11:33:25.085801] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.912 [2024-10-07 11:33:25.085821] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.912 [2024-10-07 11:33:25.085838] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.912 [2024-10-07 11:33:25.085855] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.912 [2024-10-07 11:33:25.085883] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.912 [2024-10-07 11:33:25.085900] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.912 [2024-10-07 11:33:25.099576] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.912 [2024-10-07 11:33:25.099635] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.912 [2024-10-07 11:33:25.099870] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.912 [2024-10-07 11:33:25.099920] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.912 [2024-10-07 11:33:25.099944] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.912 [2024-10-07 11:33:25.100004] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.912 [2024-10-07 11:33:25.100032] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ab2c0 with addr=10.0.0.3, port=4420 00:22:37.912 [2024-10-07 11:33:25.100051] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19ab2c0 is same with the state(6) to be set 00:22:37.912 [2024-10-07 11:33:25.100098] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.912 [2024-10-07 11:33:25.100124] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19ab2c0 (9): Bad file descriptor 00:22:37.912 [2024-10-07 11:33:25.100148] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.912 [2024-10-07 11:33:25.100166] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.912 [2024-10-07 11:33:25.100182] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.912 [2024-10-07 11:33:25.100202] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.912 [2024-10-07 11:33:25.100219] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.912 [2024-10-07 11:33:25.100234] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.912 [2024-10-07 11:33:25.100263] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.912 [2024-10-07 11:33:25.100280] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.912 [2024-10-07 11:33:25.113221] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.912 [2024-10-07 11:33:25.113280] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.912 [2024-10-07 11:33:25.113584] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.912 [2024-10-07 11:33:25.113635] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.912 [2024-10-07 11:33:25.113676] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.912 [2024-10-07 11:33:25.115250] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.912 [2024-10-07 11:33:25.116206] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.912 [2024-10-07 11:33:25.116251] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.912 [2024-10-07 11:33:25.116272] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.912 [2024-10-07 11:33:25.116581] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.912 [2024-10-07 11:33:25.124362] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.912 [2024-10-07 11:33:25.124530] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.912 [2024-10-07 11:33:25.124570] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.912 [2024-10-07 11:33:25.124591] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.912 [2024-10-07 11:33:25.127789] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.912 [2024-10-07 11:33:25.128823] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.912 [2024-10-07 11:33:25.128858] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.912 [2024-10-07 11:33:25.128877] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.912 [2024-10-07 11:33:25.129150] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.912 [2024-10-07 11:33:25.134463] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.912 [2024-10-07 11:33:25.134613] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.912 [2024-10-07 11:33:25.134673] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.912 [2024-10-07 11:33:25.134698] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.912 [2024-10-07 11:33:25.134942] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.912 [2024-10-07 11:33:25.135165] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.912 [2024-10-07 11:33:25.135219] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.912 [2024-10-07 11:33:25.135240] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.912 [2024-10-07 11:33:25.135388] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.912 [2024-10-07 11:33:25.135771] bdev_nvme.c:2183:_bdev_nvme_reset_ctrlr_complete: *NOTICE*: Resetting controller successful. 00:22:37.912 [2024-10-07 11:33:25.146262] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.912 [2024-10-07 11:33:25.147048] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.912 [2024-10-07 11:33:25.147102] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.912 [2024-10-07 11:33:25.147127] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.912 [2024-10-07 11:33:25.147270] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.912 [2024-10-07 11:33:25.147321] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.912 [2024-10-07 11:33:25.147343] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.912 [2024-10-07 11:33:25.147360] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.912 [2024-10-07 11:33:25.147390] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.912 [2024-10-07 11:33:25.159100] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.912 [2024-10-07 11:33:25.159240] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.912 [2024-10-07 11:33:25.159277] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.912 [2024-10-07 11:33:25.159298] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.912 [2024-10-07 11:33:25.159327] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.912 [2024-10-07 11:33:25.159355] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.912 [2024-10-07 11:33:25.159373] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.912 [2024-10-07 11:33:25.159390] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.912 [2024-10-07 11:33:25.159418] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.912 [2024-10-07 11:33:25.169862] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.912 [2024-10-07 11:33:25.170113] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.912 [2024-10-07 11:33:25.170162] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.912 [2024-10-07 11:33:25.170185] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.912 [2024-10-07 11:33:25.170337] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.912 [2024-10-07 11:33:25.170481] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.912 [2024-10-07 11:33:25.170514] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.912 [2024-10-07 11:33:25.170542] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.912 [2024-10-07 11:33:25.171635] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.912 [2024-10-07 11:33:25.180454] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.912 [2024-10-07 11:33:25.180700] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.912 [2024-10-07 11:33:25.180750] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.912 [2024-10-07 11:33:25.180774] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.912 [2024-10-07 11:33:25.180930] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.912 [2024-10-07 11:33:25.185074] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.912 [2024-10-07 11:33:25.185122] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.912 [2024-10-07 11:33:25.185144] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.912 [2024-10-07 11:33:25.185554] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.912 [2024-10-07 11:33:25.191858] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.912 [2024-10-07 11:33:25.191999] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.912 [2024-10-07 11:33:25.192035] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.912 [2024-10-07 11:33:25.192055] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.912 [2024-10-07 11:33:25.192084] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.912 [2024-10-07 11:33:25.195348] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.912 [2024-10-07 11:33:25.195395] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.912 [2024-10-07 11:33:25.195417] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.912 [2024-10-07 11:33:25.195825] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.912 [2024-10-07 11:33:25.205349] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.912 [2024-10-07 11:33:25.205586] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.912 [2024-10-07 11:33:25.205635] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.912 [2024-10-07 11:33:25.205678] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.912 [2024-10-07 11:33:25.205710] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.912 [2024-10-07 11:33:25.205738] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.912 [2024-10-07 11:33:25.205756] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.912 [2024-10-07 11:33:25.205795] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.912 [2024-10-07 11:33:25.206175] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.912 [2024-10-07 11:33:25.218629] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.912 [2024-10-07 11:33:25.219790] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.912 [2024-10-07 11:33:25.219842] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.912 [2024-10-07 11:33:25.219867] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.912 [2024-10-07 11:33:25.219999] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.912 [2024-10-07 11:33:25.220047] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.912 [2024-10-07 11:33:25.220065] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.912 [2024-10-07 11:33:25.220082] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.912 [2024-10-07 11:33:25.220111] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.912 [2024-10-07 11:33:25.231198] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.912 [2024-10-07 11:33:25.232368] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.912 [2024-10-07 11:33:25.232432] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.912 [2024-10-07 11:33:25.232457] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.912 [2024-10-07 11:33:25.233152] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.912 [2024-10-07 11:33:25.233511] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.912 [2024-10-07 11:33:25.233554] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.912 [2024-10-07 11:33:25.233576] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.912 [2024-10-07 11:33:25.233692] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.912 [2024-10-07 11:33:25.245449] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.912 [2024-10-07 11:33:25.246833] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.912 [2024-10-07 11:33:25.246886] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.912 [2024-10-07 11:33:25.246917] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.912 [2024-10-07 11:33:25.247062] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.913 [2024-10-07 11:33:25.247098] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.913 [2024-10-07 11:33:25.247117] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.913 [2024-10-07 11:33:25.247134] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.913 [2024-10-07 11:33:25.247176] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.913 [2024-10-07 11:33:25.257313] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.913 [2024-10-07 11:33:25.257557] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.913 [2024-10-07 11:33:25.257618] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.913 [2024-10-07 11:33:25.257642] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.913 [2024-10-07 11:33:25.257793] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.913 [2024-10-07 11:33:25.258686] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.913 [2024-10-07 11:33:25.258728] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.913 [2024-10-07 11:33:25.258748] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.913 [2024-10-07 11:33:25.259589] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.913 [2024-10-07 11:33:25.269641] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.913 [2024-10-07 11:33:25.269932] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.913 [2024-10-07 11:33:25.269991] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.913 [2024-10-07 11:33:25.270015] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.913 [2024-10-07 11:33:25.270146] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.913 [2024-10-07 11:33:25.272692] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.913 [2024-10-07 11:33:25.272738] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.913 [2024-10-07 11:33:25.272773] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.913 [2024-10-07 11:33:25.273569] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.913 [2024-10-07 11:33:25.280918] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.913 [2024-10-07 11:33:25.281194] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.913 [2024-10-07 11:33:25.281243] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.913 [2024-10-07 11:33:25.281267] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.913 [2024-10-07 11:33:25.281441] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.913 [2024-10-07 11:33:25.281602] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.913 [2024-10-07 11:33:25.281662] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.913 [2024-10-07 11:33:25.281684] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.913 [2024-10-07 11:33:25.281815] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.913 [2024-10-07 11:33:25.292182] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.913 [2024-10-07 11:33:25.292433] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.913 [2024-10-07 11:33:25.292482] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.913 [2024-10-07 11:33:25.292506] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.913 [2024-10-07 11:33:25.292665] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.913 [2024-10-07 11:33:25.295588] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.913 [2024-10-07 11:33:25.295635] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.913 [2024-10-07 11:33:25.295676] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.913 [2024-10-07 11:33:25.296507] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.913 [2024-10-07 11:33:25.304994] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.913 [2024-10-07 11:33:25.305147] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.913 [2024-10-07 11:33:25.305195] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.913 [2024-10-07 11:33:25.305215] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.913 [2024-10-07 11:33:25.305244] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.913 [2024-10-07 11:33:25.305272] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.913 [2024-10-07 11:33:25.305290] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.913 [2024-10-07 11:33:25.305306] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.913 [2024-10-07 11:33:25.305335] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.913 [2024-10-07 11:33:25.319129] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.913 [2024-10-07 11:33:25.319391] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.913 [2024-10-07 11:33:25.319442] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.913 [2024-10-07 11:33:25.319467] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.913 [2024-10-07 11:33:25.319603] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.913 [2024-10-07 11:33:25.319770] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.913 [2024-10-07 11:33:25.319808] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.913 [2024-10-07 11:33:25.319828] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.913 [2024-10-07 11:33:25.322263] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.913 [2024-10-07 11:33:25.333805] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.913 [2024-10-07 11:33:25.334126] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.913 [2024-10-07 11:33:25.334178] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.913 [2024-10-07 11:33:25.334202] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.913 [2024-10-07 11:33:25.334376] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.913 [2024-10-07 11:33:25.334971] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.913 [2024-10-07 11:33:25.335015] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.913 [2024-10-07 11:33:25.335037] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.913 [2024-10-07 11:33:25.335283] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.913 [2024-10-07 11:33:25.345813] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.913 [2024-10-07 11:33:25.346067] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.913 [2024-10-07 11:33:25.346117] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.913 [2024-10-07 11:33:25.346141] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.913 [2024-10-07 11:33:25.346293] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.913 [2024-10-07 11:33:25.346436] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.913 [2024-10-07 11:33:25.346469] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.913 [2024-10-07 11:33:25.346490] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.913 [2024-10-07 11:33:25.346621] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.913 [2024-10-07 11:33:25.356724] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.913 [2024-10-07 11:33:25.356979] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.913 [2024-10-07 11:33:25.357029] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.913 [2024-10-07 11:33:25.357054] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.913 [2024-10-07 11:33:25.357484] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.913 [2024-10-07 11:33:25.358979] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.913 [2024-10-07 11:33:25.359017] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.913 [2024-10-07 11:33:25.359034] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.913 [2024-10-07 11:33:25.359248] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.913 [2024-10-07 11:33:25.366813] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.913 [2024-10-07 11:33:25.366918] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.913 [2024-10-07 11:33:25.366949] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.913 [2024-10-07 11:33:25.366965] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.913 [2024-10-07 11:33:25.366989] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.913 [2024-10-07 11:33:25.367011] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.913 [2024-10-07 11:33:25.367025] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.913 [2024-10-07 11:33:25.367038] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.913 [2024-10-07 11:33:25.367062] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.913 [2024-10-07 11:33:25.377198] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.913 [2024-10-07 11:33:25.377725] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.913 [2024-10-07 11:33:25.377783] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.913 [2024-10-07 11:33:25.377832] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.913 [2024-10-07 11:33:25.380166] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.913 [2024-10-07 11:33:25.380444] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.913 [2024-10-07 11:33:25.380480] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.913 [2024-10-07 11:33:25.380497] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.913 [2024-10-07 11:33:25.380552] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.913 [2024-10-07 11:33:25.387291] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.913 [2024-10-07 11:33:25.387400] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.913 [2024-10-07 11:33:25.387430] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.913 [2024-10-07 11:33:25.387446] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.914 [2024-10-07 11:33:25.387470] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.914 [2024-10-07 11:33:25.387492] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.914 [2024-10-07 11:33:25.387506] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.914 [2024-10-07 11:33:25.387519] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.914 [2024-10-07 11:33:25.387542] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.914 [2024-10-07 11:33:25.401453] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.914 [2024-10-07 11:33:25.401557] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.914 [2024-10-07 11:33:25.401587] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.914 [2024-10-07 11:33:25.401604] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.914 [2024-10-07 11:33:25.401628] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.914 [2024-10-07 11:33:25.401666] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.914 [2024-10-07 11:33:25.401684] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.914 [2024-10-07 11:33:25.401697] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.914 [2024-10-07 11:33:25.401720] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.914 [2024-10-07 11:33:25.414868] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.914 [2024-10-07 11:33:25.415761] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.914 [2024-10-07 11:33:25.415805] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.914 [2024-10-07 11:33:25.415825] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.914 [2024-10-07 11:33:25.416579] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.914 [2024-10-07 11:33:25.416909] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.914 [2024-10-07 11:33:25.416946] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.914 [2024-10-07 11:33:25.416963] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.914 [2024-10-07 11:33:25.417255] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.914 [2024-10-07 11:33:25.425247] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.914 [2024-10-07 11:33:25.425457] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.914 [2024-10-07 11:33:25.425497] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.914 [2024-10-07 11:33:25.425516] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.914 [2024-10-07 11:33:25.430239] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.914 [2024-10-07 11:33:25.430559] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.914 [2024-10-07 11:33:25.430598] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.914 [2024-10-07 11:33:25.430626] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.914 [2024-10-07 11:33:25.431594] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.914 [2024-10-07 11:33:25.435563] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.914 [2024-10-07 11:33:25.435694] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.914 [2024-10-07 11:33:25.435740] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.914 [2024-10-07 11:33:25.435756] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.914 [2024-10-07 11:33:25.435780] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.914 [2024-10-07 11:33:25.435968] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.914 [2024-10-07 11:33:25.435995] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.914 [2024-10-07 11:33:25.436009] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.914 [2024-10-07 11:33:25.436133] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.914 [2024-10-07 11:33:25.447405] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.914 [2024-10-07 11:33:25.447519] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.914 [2024-10-07 11:33:25.447550] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.914 [2024-10-07 11:33:25.447566] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.914 [2024-10-07 11:33:25.447590] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.914 [2024-10-07 11:33:25.447612] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.914 [2024-10-07 11:33:25.447627] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.914 [2024-10-07 11:33:25.447640] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.914 [2024-10-07 11:33:25.448221] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.914 [2024-10-07 11:33:25.459496] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.914 [2024-10-07 11:33:25.459916] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.914 [2024-10-07 11:33:25.459961] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.914 [2024-10-07 11:33:25.459981] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.914 [2024-10-07 11:33:25.460034] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.914 [2024-10-07 11:33:25.460062] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.914 [2024-10-07 11:33:25.460077] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.914 [2024-10-07 11:33:25.460090] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.914 [2024-10-07 11:33:25.460114] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.914 [2024-10-07 11:33:25.473013] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.914 [2024-10-07 11:33:25.473134] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.914 [2024-10-07 11:33:25.473164] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.914 [2024-10-07 11:33:25.473180] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.914 [2024-10-07 11:33:25.473562] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.914 [2024-10-07 11:33:25.473731] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.914 [2024-10-07 11:33:25.473757] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.914 [2024-10-07 11:33:25.473772] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.914 [2024-10-07 11:33:25.473833] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.914 [2024-10-07 11:33:25.486227] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.914 [2024-10-07 11:33:25.486394] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.914 [2024-10-07 11:33:25.486425] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.914 [2024-10-07 11:33:25.486442] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.914 [2024-10-07 11:33:25.486467] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.914 [2024-10-07 11:33:25.486490] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.914 [2024-10-07 11:33:25.486504] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.914 [2024-10-07 11:33:25.486518] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.914 [2024-10-07 11:33:25.486542] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.914 [2024-10-07 11:33:25.500454] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.914 [2024-10-07 11:33:25.500560] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.914 [2024-10-07 11:33:25.500590] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.914 [2024-10-07 11:33:25.500629] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.914 [2024-10-07 11:33:25.500672] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.914 [2024-10-07 11:33:25.500699] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.914 [2024-10-07 11:33:25.500713] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.914 [2024-10-07 11:33:25.500726] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.914 [2024-10-07 11:33:25.500750] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.914 [2024-10-07 11:33:25.514549] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.914 [2024-10-07 11:33:25.514667] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.914 [2024-10-07 11:33:25.514698] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.914 [2024-10-07 11:33:25.514715] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.914 [2024-10-07 11:33:25.514739] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.914 [2024-10-07 11:33:25.514761] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.914 [2024-10-07 11:33:25.514775] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.914 [2024-10-07 11:33:25.514789] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.914 [2024-10-07 11:33:25.514812] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.914 [2024-10-07 11:33:25.528466] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.914 [2024-10-07 11:33:25.528720] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.914 [2024-10-07 11:33:25.528753] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.914 [2024-10-07 11:33:25.528770] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.914 [2024-10-07 11:33:25.528915] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.914 [2024-10-07 11:33:25.528972] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.914 [2024-10-07 11:33:25.528993] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.914 [2024-10-07 11:33:25.529007] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.914 [2024-10-07 11:33:25.529032] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.914 [2024-10-07 11:33:25.541494] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.914 [2024-10-07 11:33:25.541708] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.914 [2024-10-07 11:33:25.541745] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.914 [2024-10-07 11:33:25.541763] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.914 [2024-10-07 11:33:25.541788] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.914 [2024-10-07 11:33:25.541811] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.914 [2024-10-07 11:33:25.541842] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.914 [2024-10-07 11:33:25.541856] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.914 [2024-10-07 11:33:25.543127] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.914 [2024-10-07 11:33:25.553724] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.914 [2024-10-07 11:33:25.555652] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.914 [2024-10-07 11:33:25.555707] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.914 [2024-10-07 11:33:25.555728] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.914 [2024-10-07 11:33:25.556258] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.914 [2024-10-07 11:33:25.556347] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.914 [2024-10-07 11:33:25.556368] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.914 [2024-10-07 11:33:25.556382] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.914 [2024-10-07 11:33:25.556407] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.914 [2024-10-07 11:33:25.565917] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.914 [2024-10-07 11:33:25.566159] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.914 [2024-10-07 11:33:25.566191] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.914 [2024-10-07 11:33:25.566208] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.914 [2024-10-07 11:33:25.566318] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.914 [2024-10-07 11:33:25.566438] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.914 [2024-10-07 11:33:25.566475] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.914 [2024-10-07 11:33:25.566493] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.914 [2024-10-07 11:33:25.566597] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.914 [2024-10-07 11:33:25.577933] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.914 [2024-10-07 11:33:25.580224] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.914 [2024-10-07 11:33:25.580284] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.914 [2024-10-07 11:33:25.580304] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.914 [2024-10-07 11:33:25.580407] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.914 [2024-10-07 11:33:25.580437] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.914 [2024-10-07 11:33:25.580452] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.914 [2024-10-07 11:33:25.580465] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.914 [2024-10-07 11:33:25.580489] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.914 [2024-10-07 11:33:25.588086] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.914 [2024-10-07 11:33:25.588221] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.914 [2024-10-07 11:33:25.588252] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.915 [2024-10-07 11:33:25.588268] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.915 [2024-10-07 11:33:25.588292] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.915 [2024-10-07 11:33:25.588468] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.915 [2024-10-07 11:33:25.588493] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.915 [2024-10-07 11:33:25.588507] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.915 [2024-10-07 11:33:25.588565] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.915 [2024-10-07 11:33:25.600334] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.915 [2024-10-07 11:33:25.600681] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.915 [2024-10-07 11:33:25.600724] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.915 [2024-10-07 11:33:25.600744] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.915 [2024-10-07 11:33:25.600951] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.915 [2024-10-07 11:33:25.601029] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.915 [2024-10-07 11:33:25.601053] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.915 [2024-10-07 11:33:25.601067] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.915 [2024-10-07 11:33:25.601241] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.915 [2024-10-07 11:33:25.612984] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.915 [2024-10-07 11:33:25.613385] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.915 [2024-10-07 11:33:25.613429] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.915 [2024-10-07 11:33:25.613449] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.915 [2024-10-07 11:33:25.613701] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.915 [2024-10-07 11:33:25.614357] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.915 [2024-10-07 11:33:25.614392] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.915 [2024-10-07 11:33:25.614425] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.915 [2024-10-07 11:33:25.614682] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.915 [2024-10-07 11:33:25.629240] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.915 [2024-10-07 11:33:25.629438] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.915 [2024-10-07 11:33:25.629471] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.915 [2024-10-07 11:33:25.629488] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.915 [2024-10-07 11:33:25.629544] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.915 [2024-10-07 11:33:25.629568] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.915 [2024-10-07 11:33:25.629582] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.915 [2024-10-07 11:33:25.629595] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.915 [2024-10-07 11:33:25.629617] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.915 [2024-10-07 11:33:25.641948] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.915 [2024-10-07 11:33:25.642676] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.915 [2024-10-07 11:33:25.642747] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.915 [2024-10-07 11:33:25.642768] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.915 [2024-10-07 11:33:25.642910] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.915 [2024-10-07 11:33:25.642941] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.915 [2024-10-07 11:33:25.642957] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.915 [2024-10-07 11:33:25.642971] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.915 [2024-10-07 11:33:25.642994] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.915 [2024-10-07 11:33:25.656450] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.915 [2024-10-07 11:33:25.657315] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.915 [2024-10-07 11:33:25.657358] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.915 [2024-10-07 11:33:25.657378] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.915 [2024-10-07 11:33:25.657491] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.915 [2024-10-07 11:33:25.657520] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.915 [2024-10-07 11:33:25.657535] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.915 [2024-10-07 11:33:25.657548] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.915 [2024-10-07 11:33:25.657571] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.915 [2024-10-07 11:33:25.669475] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.915 [2024-10-07 11:33:25.669675] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.915 [2024-10-07 11:33:25.669708] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.915 [2024-10-07 11:33:25.669726] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.915 [2024-10-07 11:33:25.669751] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.915 [2024-10-07 11:33:25.669905] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.915 [2024-10-07 11:33:25.669930] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.915 [2024-10-07 11:33:25.669960] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.915 [2024-10-07 11:33:25.670212] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.915 [2024-10-07 11:33:25.683327] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.915 [2024-10-07 11:33:25.683433] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.915 [2024-10-07 11:33:25.683464] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.915 [2024-10-07 11:33:25.683480] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.915 [2024-10-07 11:33:25.684083] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.915 [2024-10-07 11:33:25.684199] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.915 [2024-10-07 11:33:25.684222] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.915 [2024-10-07 11:33:25.684237] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.915 [2024-10-07 11:33:25.684261] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.915 [2024-10-07 11:33:25.693952] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.915 [2024-10-07 11:33:25.694177] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.915 [2024-10-07 11:33:25.694209] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.915 [2024-10-07 11:33:25.694226] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.915 [2024-10-07 11:33:25.694325] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.915 [2024-10-07 11:33:25.694851] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.915 [2024-10-07 11:33:25.694886] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.915 [2024-10-07 11:33:25.694919] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.915 [2024-10-07 11:33:25.695150] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.915 [2024-10-07 11:33:25.705193] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.915 [2024-10-07 11:33:25.705398] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.915 [2024-10-07 11:33:25.705429] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.915 [2024-10-07 11:33:25.705445] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.915 [2024-10-07 11:33:25.706258] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.915 [2024-10-07 11:33:25.708740] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.915 [2024-10-07 11:33:25.708778] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.915 [2024-10-07 11:33:25.708795] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.915 [2024-10-07 11:33:25.709144] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.915 [2024-10-07 11:33:25.715413] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.915 [2024-10-07 11:33:25.715517] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.915 [2024-10-07 11:33:25.715563] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.915 [2024-10-07 11:33:25.715582] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.915 [2024-10-07 11:33:25.715606] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.915 [2024-10-07 11:33:25.715640] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.915 [2024-10-07 11:33:25.715670] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.915 [2024-10-07 11:33:25.715684] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.915 [2024-10-07 11:33:25.715708] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.915 [2024-10-07 11:33:25.726724] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.915 [2024-10-07 11:33:25.726924] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.915 [2024-10-07 11:33:25.726970] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.915 [2024-10-07 11:33:25.726990] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.915 [2024-10-07 11:33:25.727015] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.915 [2024-10-07 11:33:25.727038] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.915 [2024-10-07 11:33:25.727053] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.915 [2024-10-07 11:33:25.727066] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.915 [2024-10-07 11:33:25.727090] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.915 [2024-10-07 11:33:25.739887] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.915 [2024-10-07 11:33:25.740645] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.915 [2024-10-07 11:33:25.740702] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.915 [2024-10-07 11:33:25.740722] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.915 [2024-10-07 11:33:25.740972] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.915 [2024-10-07 11:33:25.741183] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.915 [2024-10-07 11:33:25.741218] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.915 [2024-10-07 11:33:25.741235] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.915 [2024-10-07 11:33:25.741295] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.915 [2024-10-07 11:33:25.750425] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.915 [2024-10-07 11:33:25.750617] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.915 [2024-10-07 11:33:25.750660] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.915 [2024-10-07 11:33:25.750681] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.915 [2024-10-07 11:33:25.750815] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.915 [2024-10-07 11:33:25.750954] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.915 [2024-10-07 11:33:25.750987] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.915 [2024-10-07 11:33:25.751005] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.915 [2024-10-07 11:33:25.751110] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.915 [2024-10-07 11:33:25.760807] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.915 [2024-10-07 11:33:25.761111] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.915 [2024-10-07 11:33:25.761154] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.915 [2024-10-07 11:33:25.761174] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.916 [2024-10-07 11:33:25.761230] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.916 [2024-10-07 11:33:25.761259] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.916 [2024-10-07 11:33:25.761274] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.916 [2024-10-07 11:33:25.761287] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.916 [2024-10-07 11:33:25.761311] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.916 [2024-10-07 11:33:25.771386] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.916 [2024-10-07 11:33:25.771601] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.916 [2024-10-07 11:33:25.771633] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.916 [2024-10-07 11:33:25.771664] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.916 [2024-10-07 11:33:25.771853] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.916 [2024-10-07 11:33:25.772010] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.916 [2024-10-07 11:33:25.772043] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.916 [2024-10-07 11:33:25.772060] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.916 [2024-10-07 11:33:25.772163] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.916 [2024-10-07 11:33:25.781620] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.916 [2024-10-07 11:33:25.781735] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.916 [2024-10-07 11:33:25.781765] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.917 [2024-10-07 11:33:25.781782] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.917 [2024-10-07 11:33:25.781806] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.917 [2024-10-07 11:33:25.781829] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.917 [2024-10-07 11:33:25.781843] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.917 [2024-10-07 11:33:25.781856] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.917 [2024-10-07 11:33:25.781894] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.917 [2024-10-07 11:33:25.792917] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.917 [2024-10-07 11:33:25.793022] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.917 [2024-10-07 11:33:25.793053] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.917 [2024-10-07 11:33:25.793069] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.917 [2024-10-07 11:33:25.793093] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.917 [2024-10-07 11:33:25.793115] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.917 [2024-10-07 11:33:25.793129] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.917 [2024-10-07 11:33:25.793142] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.917 [2024-10-07 11:33:25.793165] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.917 [2024-10-07 11:33:25.802997] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.917 [2024-10-07 11:33:25.803117] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.917 [2024-10-07 11:33:25.803147] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.917 [2024-10-07 11:33:25.803163] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.917 [2024-10-07 11:33:25.804704] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.917 [2024-10-07 11:33:25.805280] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.917 [2024-10-07 11:33:25.805315] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.917 [2024-10-07 11:33:25.805348] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.917 [2024-10-07 11:33:25.805533] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.917 [2024-10-07 11:33:25.813075] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.917 [2024-10-07 11:33:25.813208] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.917 [2024-10-07 11:33:25.813238] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.917 [2024-10-07 11:33:25.813254] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.917 [2024-10-07 11:33:25.813277] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.917 [2024-10-07 11:33:25.813299] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.917 [2024-10-07 11:33:25.813313] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.917 [2024-10-07 11:33:25.813327] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.917 [2024-10-07 11:33:25.813350] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.917 [2024-10-07 11:33:25.825824] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.917 [2024-10-07 11:33:25.826178] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.917 [2024-10-07 11:33:25.826223] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.917 [2024-10-07 11:33:25.826257] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.917 [2024-10-07 11:33:25.826330] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.917 [2024-10-07 11:33:25.826361] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.917 [2024-10-07 11:33:25.826377] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.917 [2024-10-07 11:33:25.826390] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.917 [2024-10-07 11:33:25.826429] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.917 [2024-10-07 11:33:25.839506] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.917 [2024-10-07 11:33:25.840641] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.917 [2024-10-07 11:33:25.840709] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.917 [2024-10-07 11:33:25.840747] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.917 [2024-10-07 11:33:25.840892] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.917 [2024-10-07 11:33:25.840923] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.917 [2024-10-07 11:33:25.840938] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.917 [2024-10-07 11:33:25.840952] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.917 [2024-10-07 11:33:25.840975] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.917 [2024-10-07 11:33:25.854667] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.917 [2024-10-07 11:33:25.854802] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.917 [2024-10-07 11:33:25.854832] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.917 [2024-10-07 11:33:25.854848] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.917 [2024-10-07 11:33:25.854871] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.917 [2024-10-07 11:33:25.854892] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.917 [2024-10-07 11:33:25.854906] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.917 [2024-10-07 11:33:25.854920] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.917 [2024-10-07 11:33:25.854942] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.917 [2024-10-07 11:33:25.864926] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.917 [2024-10-07 11:33:25.867693] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.917 [2024-10-07 11:33:25.867799] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.917 [2024-10-07 11:33:25.867819] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.917 [2024-10-07 11:33:25.869790] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.917 [2024-10-07 11:33:25.870279] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.917 [2024-10-07 11:33:25.870332] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.917 [2024-10-07 11:33:25.870350] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.917 [2024-10-07 11:33:25.871157] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.917 [2024-10-07 11:33:25.876119] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.917 [2024-10-07 11:33:25.876326] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.917 [2024-10-07 11:33:25.876356] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.917 [2024-10-07 11:33:25.876372] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.917 [2024-10-07 11:33:25.876506] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.917 [2024-10-07 11:33:25.876659] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.917 [2024-10-07 11:33:25.876690] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.917 [2024-10-07 11:33:25.876712] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.917 [2024-10-07 11:33:25.876812] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.917 [2024-10-07 11:33:25.886211] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.917 [2024-10-07 11:33:25.886326] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.917 [2024-10-07 11:33:25.886355] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.917 [2024-10-07 11:33:25.886371] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.917 [2024-10-07 11:33:25.886394] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.918 [2024-10-07 11:33:25.886447] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.918 [2024-10-07 11:33:25.886461] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.918 [2024-10-07 11:33:25.886475] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.918 [2024-10-07 11:33:25.886498] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.918 [2024-10-07 11:33:25.896901] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.918 [2024-10-07 11:33:25.897020] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.918 [2024-10-07 11:33:25.897050] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.918 [2024-10-07 11:33:25.897065] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.918 [2024-10-07 11:33:25.897088] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.918 [2024-10-07 11:33:25.897109] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.918 [2024-10-07 11:33:25.897123] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.918 [2024-10-07 11:33:25.897135] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.918 [2024-10-07 11:33:25.897157] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.918 8820.78 IOPS, 34.46 MiB/s [2024-10-07T11:33:33.441Z] [2024-10-07 11:33:25.907618] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.918 [2024-10-07 11:33:25.907772] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.918 [2024-10-07 11:33:25.907802] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.918 [2024-10-07 11:33:25.907818] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.918 [2024-10-07 11:33:25.907841] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.918 [2024-10-07 11:33:25.907862] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.918 [2024-10-07 11:33:25.907876] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.918 [2024-10-07 11:33:25.907889] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.918 [2024-10-07 11:33:25.907912] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.918 [2024-10-07 11:33:25.917801] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.918 [2024-10-07 11:33:25.917906] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.918 [2024-10-07 11:33:25.917937] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.918 [2024-10-07 11:33:25.917953] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.918 [2024-10-07 11:33:25.917977] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.918 [2024-10-07 11:33:25.917999] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.918 [2024-10-07 11:33:25.918013] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.918 [2024-10-07 11:33:25.918028] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.918 [2024-10-07 11:33:25.918204] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.918 [2024-10-07 11:33:25.930701] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.918 [2024-10-07 11:33:25.930898] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.918 [2024-10-07 11:33:25.930930] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.918 [2024-10-07 11:33:25.930947] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.918 [2024-10-07 11:33:25.931051] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.918 [2024-10-07 11:33:25.931155] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.918 [2024-10-07 11:33:25.931173] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.918 [2024-10-07 11:33:25.931199] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.918 [2024-10-07 11:33:25.931518] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.918 [2024-10-07 11:33:25.942139] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.918 [2024-10-07 11:33:25.942244] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.918 [2024-10-07 11:33:25.942274] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.918 [2024-10-07 11:33:25.942307] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.918 [2024-10-07 11:33:25.942332] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.918 [2024-10-07 11:33:25.942357] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.918 [2024-10-07 11:33:25.942371] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.918 [2024-10-07 11:33:25.942385] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.918 [2024-10-07 11:33:25.942408] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.918 [2024-10-07 11:33:25.957988] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.918 [2024-10-07 11:33:25.958338] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.918 [2024-10-07 11:33:25.958382] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.918 [2024-10-07 11:33:25.958403] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.918 [2024-10-07 11:33:25.958459] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.918 [2024-10-07 11:33:25.958488] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.918 [2024-10-07 11:33:25.958503] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.918 [2024-10-07 11:33:25.958517] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.918 [2024-10-07 11:33:25.958540] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.918 [2024-10-07 11:33:25.969718] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.918 [2024-10-07 11:33:25.969940] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.918 [2024-10-07 11:33:25.969971] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.918 [2024-10-07 11:33:25.969988] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.918 [2024-10-07 11:33:25.970122] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.918 [2024-10-07 11:33:25.970247] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.918 [2024-10-07 11:33:25.970268] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.918 [2024-10-07 11:33:25.970282] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.918 [2024-10-07 11:33:25.970385] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.918 [2024-10-07 11:33:25.979793] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.918 [2024-10-07 11:33:25.979896] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.918 [2024-10-07 11:33:25.979926] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.918 [2024-10-07 11:33:25.979942] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.918 [2024-10-07 11:33:25.979965] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.918 [2024-10-07 11:33:25.979988] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.918 [2024-10-07 11:33:25.980017] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.918 [2024-10-07 11:33:25.980033] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.918 [2024-10-07 11:33:25.980056] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.918 [2024-10-07 11:33:25.992135] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.918 [2024-10-07 11:33:25.994006] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.918 [2024-10-07 11:33:25.994050] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.918 [2024-10-07 11:33:25.994071] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.918 [2024-10-07 11:33:25.994701] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.918 [2024-10-07 11:33:25.995091] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.918 [2024-10-07 11:33:25.995126] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.918 [2024-10-07 11:33:25.995144] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.918 [2024-10-07 11:33:25.995230] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.918 [2024-10-07 11:33:26.002663] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.918 [2024-10-07 11:33:26.002888] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.918 [2024-10-07 11:33:26.002938] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.918 [2024-10-07 11:33:26.002965] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.918 [2024-10-07 11:33:26.003092] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.918 [2024-10-07 11:33:26.003224] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.918 [2024-10-07 11:33:26.003248] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.918 [2024-10-07 11:33:26.003262] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.918 [2024-10-07 11:33:26.003370] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.918 [2024-10-07 11:33:26.012969] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.918 [2024-10-07 11:33:26.013075] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.918 [2024-10-07 11:33:26.013105] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.919 [2024-10-07 11:33:26.013121] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.919 [2024-10-07 11:33:26.013145] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.919 [2024-10-07 11:33:26.013167] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.919 [2024-10-07 11:33:26.013182] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.919 [2024-10-07 11:33:26.013195] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.919 [2024-10-07 11:33:26.013218] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.919 [2024-10-07 11:33:26.023313] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.919 [2024-10-07 11:33:26.023438] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.919 [2024-10-07 11:33:26.023469] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.919 [2024-10-07 11:33:26.023485] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.919 [2024-10-07 11:33:26.023509] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.919 [2024-10-07 11:33:26.023531] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.919 [2024-10-07 11:33:26.023546] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.919 [2024-10-07 11:33:26.023559] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.919 [2024-10-07 11:33:26.023582] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.919 [2024-10-07 11:33:26.033666] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.919 [2024-10-07 11:33:26.034315] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.919 [2024-10-07 11:33:26.034357] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.919 [2024-10-07 11:33:26.034377] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.919 [2024-10-07 11:33:26.035644] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.919 [2024-10-07 11:33:26.035917] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.919 [2024-10-07 11:33:26.035962] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.919 [2024-10-07 11:33:26.035980] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.919 [2024-10-07 11:33:26.036027] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.919 [2024-10-07 11:33:26.043799] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.919 [2024-10-07 11:33:26.044253] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.919 [2024-10-07 11:33:26.044294] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.919 [2024-10-07 11:33:26.044314] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.919 [2024-10-07 11:33:26.044340] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.919 [2024-10-07 11:33:26.044362] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.919 [2024-10-07 11:33:26.044377] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.919 [2024-10-07 11:33:26.044390] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.919 [2024-10-07 11:33:26.044414] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.919 [2024-10-07 11:33:26.054613] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.919 [2024-10-07 11:33:26.054729] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.919 [2024-10-07 11:33:26.054760] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.919 [2024-10-07 11:33:26.054777] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.919 [2024-10-07 11:33:26.054817] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.919 [2024-10-07 11:33:26.054857] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.919 [2024-10-07 11:33:26.054876] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.919 [2024-10-07 11:33:26.054890] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.919 [2024-10-07 11:33:26.054913] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.919 [2024-10-07 11:33:26.064701] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.919 [2024-10-07 11:33:26.064821] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.919 [2024-10-07 11:33:26.064851] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.919 [2024-10-07 11:33:26.064868] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.919 [2024-10-07 11:33:26.064892] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.919 [2024-10-07 11:33:26.064914] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.919 [2024-10-07 11:33:26.064928] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.919 [2024-10-07 11:33:26.064942] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.919 [2024-10-07 11:33:26.064965] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.919 [2024-10-07 11:33:26.076531] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.919 [2024-10-07 11:33:26.076637] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.919 [2024-10-07 11:33:26.076680] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.919 [2024-10-07 11:33:26.076699] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.919 [2024-10-07 11:33:26.076723] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.919 [2024-10-07 11:33:26.076746] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.919 [2024-10-07 11:33:26.076760] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.919 [2024-10-07 11:33:26.076773] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.919 [2024-10-07 11:33:26.076796] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.919 [2024-10-07 11:33:26.090040] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.919 [2024-10-07 11:33:26.090150] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.919 [2024-10-07 11:33:26.090180] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.919 [2024-10-07 11:33:26.090197] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.919 [2024-10-07 11:33:26.090220] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.919 [2024-10-07 11:33:26.090243] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.919 [2024-10-07 11:33:26.090257] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.919 [2024-10-07 11:33:26.090292] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.919 [2024-10-07 11:33:26.090316] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.919 [2024-10-07 11:33:26.103842] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.919 [2024-10-07 11:33:26.103945] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.919 [2024-10-07 11:33:26.103975] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.919 [2024-10-07 11:33:26.103991] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.919 [2024-10-07 11:33:26.104014] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.919 [2024-10-07 11:33:26.104043] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.919 [2024-10-07 11:33:26.104058] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.919 [2024-10-07 11:33:26.104071] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.919 [2024-10-07 11:33:26.104098] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.919 [2024-10-07 11:33:26.117670] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.919 [2024-10-07 11:33:26.118166] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.919 [2024-10-07 11:33:26.118211] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.919 [2024-10-07 11:33:26.118231] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.919 [2024-10-07 11:33:26.119450] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.919 [2024-10-07 11:33:26.120036] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.919 [2024-10-07 11:33:26.120073] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.919 [2024-10-07 11:33:26.120091] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.919 [2024-10-07 11:33:26.120324] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.919 [2024-10-07 11:33:26.128120] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.919 [2024-10-07 11:33:26.128333] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.919 [2024-10-07 11:33:26.128366] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.919 [2024-10-07 11:33:26.128383] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.919 [2024-10-07 11:33:26.128499] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.919 [2024-10-07 11:33:26.128607] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.919 [2024-10-07 11:33:26.128632] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.919 [2024-10-07 11:33:26.128660] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.919 [2024-10-07 11:33:26.128767] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.919 [2024-10-07 11:33:26.138199] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.919 [2024-10-07 11:33:26.138308] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.920 [2024-10-07 11:33:26.138360] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.920 [2024-10-07 11:33:26.138378] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.920 [2024-10-07 11:33:26.138402] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.920 [2024-10-07 11:33:26.138425] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.920 [2024-10-07 11:33:26.138446] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.920 [2024-10-07 11:33:26.138460] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.920 [2024-10-07 11:33:26.138483] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.920 [2024-10-07 11:33:26.148280] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.920 [2024-10-07 11:33:26.148388] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.920 [2024-10-07 11:33:26.148418] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.920 [2024-10-07 11:33:26.148441] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.920 [2024-10-07 11:33:26.148465] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.920 [2024-10-07 11:33:26.148487] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.920 [2024-10-07 11:33:26.148501] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.920 [2024-10-07 11:33:26.148515] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.920 [2024-10-07 11:33:26.148538] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.920 [2024-10-07 11:33:26.160469] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.920 [2024-10-07 11:33:26.160723] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.920 [2024-10-07 11:33:26.160757] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.920 [2024-10-07 11:33:26.160774] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.920 [2024-10-07 11:33:26.160897] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.920 [2024-10-07 11:33:26.161014] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.920 [2024-10-07 11:33:26.161036] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.920 [2024-10-07 11:33:26.161050] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.920 [2024-10-07 11:33:26.161153] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.920 [2024-10-07 11:33:26.170549] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.920 [2024-10-07 11:33:26.170667] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.920 [2024-10-07 11:33:26.170698] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.920 [2024-10-07 11:33:26.170714] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.920 [2024-10-07 11:33:26.170738] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.920 [2024-10-07 11:33:26.170794] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.920 [2024-10-07 11:33:26.170815] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.920 [2024-10-07 11:33:26.170829] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.920 [2024-10-07 11:33:26.170853] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.920 [2024-10-07 11:33:26.181332] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.920 [2024-10-07 11:33:26.181440] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.920 [2024-10-07 11:33:26.181470] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.920 [2024-10-07 11:33:26.181487] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.920 [2024-10-07 11:33:26.181593] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.920 [2024-10-07 11:33:26.181620] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.920 [2024-10-07 11:33:26.181635] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.920 [2024-10-07 11:33:26.181661] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.920 [2024-10-07 11:33:26.181688] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.920 [2024-10-07 11:33:26.191919] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.920 [2024-10-07 11:33:26.192142] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.920 [2024-10-07 11:33:26.192181] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.920 [2024-10-07 11:33:26.192200] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.920 [2024-10-07 11:33:26.192304] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.920 [2024-10-07 11:33:26.192407] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.920 [2024-10-07 11:33:26.192426] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.920 [2024-10-07 11:33:26.192441] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.920 [2024-10-07 11:33:26.192633] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.920 [2024-10-07 11:33:26.205369] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.920 [2024-10-07 11:33:26.205572] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.920 [2024-10-07 11:33:26.205604] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.920 [2024-10-07 11:33:26.205621] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.920 [2024-10-07 11:33:26.205747] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.920 [2024-10-07 11:33:26.206901] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.920 [2024-10-07 11:33:26.206939] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.920 [2024-10-07 11:33:26.206956] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.920 [2024-10-07 11:33:26.208967] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.920 [2024-10-07 11:33:26.215455] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.920 [2024-10-07 11:33:26.215565] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.920 [2024-10-07 11:33:26.215596] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.920 [2024-10-07 11:33:26.215622] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.920 [2024-10-07 11:33:26.215662] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.920 [2024-10-07 11:33:26.215688] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.920 [2024-10-07 11:33:26.215702] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.920 [2024-10-07 11:33:26.215715] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.920 [2024-10-07 11:33:26.215738] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.920 [2024-10-07 11:33:26.225908] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.920 [2024-10-07 11:33:26.226014] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.920 [2024-10-07 11:33:26.226043] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.920 [2024-10-07 11:33:26.226060] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.920 [2024-10-07 11:33:26.226238] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.920 [2024-10-07 11:33:26.226303] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.920 [2024-10-07 11:33:26.226325] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.920 [2024-10-07 11:33:26.226348] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.920 [2024-10-07 11:33:26.226391] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.920 [2024-10-07 11:33:26.238633] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.920 [2024-10-07 11:33:26.238759] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.920 [2024-10-07 11:33:26.238790] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.920 [2024-10-07 11:33:26.238807] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.920 [2024-10-07 11:33:26.238832] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.920 [2024-10-07 11:33:26.238854] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.920 [2024-10-07 11:33:26.238869] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.920 [2024-10-07 11:33:26.238883] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.920 [2024-10-07 11:33:26.238906] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.920 [2024-10-07 11:33:26.251062] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.920 [2024-10-07 11:33:26.251236] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.920 [2024-10-07 11:33:26.251268] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.920 [2024-10-07 11:33:26.251310] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.920 [2024-10-07 11:33:26.251336] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.920 [2024-10-07 11:33:26.251359] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.920 [2024-10-07 11:33:26.251374] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.920 [2024-10-07 11:33:26.251387] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.920 [2024-10-07 11:33:26.251411] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.921 [2024-10-07 11:33:26.265321] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.921 [2024-10-07 11:33:26.265428] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.921 [2024-10-07 11:33:26.265459] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.921 [2024-10-07 11:33:26.265476] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.921 [2024-10-07 11:33:26.265499] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.921 [2024-10-07 11:33:26.265522] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.921 [2024-10-07 11:33:26.265536] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.921 [2024-10-07 11:33:26.265549] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.921 [2024-10-07 11:33:26.265572] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.921 [2024-10-07 11:33:26.278016] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.921 [2024-10-07 11:33:26.278121] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.921 [2024-10-07 11:33:26.278152] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.921 [2024-10-07 11:33:26.278169] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.921 [2024-10-07 11:33:26.278193] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.921 [2024-10-07 11:33:26.278215] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.921 [2024-10-07 11:33:26.278230] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.921 [2024-10-07 11:33:26.278244] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.921 [2024-10-07 11:33:26.278267] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.921 [2024-10-07 11:33:26.288353] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.921 [2024-10-07 11:33:26.288551] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.921 [2024-10-07 11:33:26.288583] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.921 [2024-10-07 11:33:26.288600] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.921 [2024-10-07 11:33:26.288891] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.921 [2024-10-07 11:33:26.289118] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.921 [2024-10-07 11:33:26.289173] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.921 [2024-10-07 11:33:26.289191] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.921 [2024-10-07 11:33:26.289248] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.921 [2024-10-07 11:33:26.298434] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.921 [2024-10-07 11:33:26.298539] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.921 [2024-10-07 11:33:26.298569] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.921 [2024-10-07 11:33:26.298586] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.921 [2024-10-07 11:33:26.298610] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.921 [2024-10-07 11:33:26.298632] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.921 [2024-10-07 11:33:26.298660] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.921 [2024-10-07 11:33:26.298681] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.921 [2024-10-07 11:33:26.298704] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.921 [2024-10-07 11:33:26.313198] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.921 [2024-10-07 11:33:26.314291] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.921 [2024-10-07 11:33:26.314336] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.921 [2024-10-07 11:33:26.314357] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.921 [2024-10-07 11:33:26.315079] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.921 [2024-10-07 11:33:26.315358] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.921 [2024-10-07 11:33:26.315402] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.921 [2024-10-07 11:33:26.315419] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.921 [2024-10-07 11:33:26.315699] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.921 [2024-10-07 11:33:26.326686] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.921 [2024-10-07 11:33:26.327004] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.921 [2024-10-07 11:33:26.327046] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.921 [2024-10-07 11:33:26.327066] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.921 [2024-10-07 11:33:26.327207] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.921 [2024-10-07 11:33:26.327360] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.921 [2024-10-07 11:33:26.327384] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.921 [2024-10-07 11:33:26.327399] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.921 [2024-10-07 11:33:26.327452] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.921 [2024-10-07 11:33:26.336769] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.921 [2024-10-07 11:33:26.336874] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.921 [2024-10-07 11:33:26.336904] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.921 [2024-10-07 11:33:26.336921] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.921 [2024-10-07 11:33:26.336945] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.921 [2024-10-07 11:33:26.336968] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.921 [2024-10-07 11:33:26.336982] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.921 [2024-10-07 11:33:26.336995] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.921 [2024-10-07 11:33:26.337019] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.921 [2024-10-07 11:33:26.347080] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.921 [2024-10-07 11:33:26.347196] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.921 [2024-10-07 11:33:26.347228] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.921 [2024-10-07 11:33:26.347245] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.921 [2024-10-07 11:33:26.347270] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.921 [2024-10-07 11:33:26.347292] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.921 [2024-10-07 11:33:26.347307] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.921 [2024-10-07 11:33:26.347322] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.921 [2024-10-07 11:33:26.347346] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.921 [2024-10-07 11:33:26.357160] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.921 [2024-10-07 11:33:26.357264] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.921 [2024-10-07 11:33:26.357294] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.921 [2024-10-07 11:33:26.357311] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.921 [2024-10-07 11:33:26.357334] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.921 [2024-10-07 11:33:26.357357] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.921 [2024-10-07 11:33:26.357371] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.921 [2024-10-07 11:33:26.357384] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.921 [2024-10-07 11:33:26.357407] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.921 [2024-10-07 11:33:26.367954] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.921 [2024-10-07 11:33:26.368201] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.921 [2024-10-07 11:33:26.368251] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.922 [2024-10-07 11:33:26.368301] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.922 [2024-10-07 11:33:26.368359] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.922 [2024-10-07 11:33:26.368388] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.922 [2024-10-07 11:33:26.368404] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.922 [2024-10-07 11:33:26.368417] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.922 [2024-10-07 11:33:26.368441] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.922 [2024-10-07 11:33:26.381807] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.922 [2024-10-07 11:33:26.382397] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.922 [2024-10-07 11:33:26.382440] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.922 [2024-10-07 11:33:26.382460] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.922 [2024-10-07 11:33:26.383085] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.922 [2024-10-07 11:33:26.384007] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.922 [2024-10-07 11:33:26.384043] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.922 [2024-10-07 11:33:26.384060] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.922 [2024-10-07 11:33:26.384444] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.922 [2024-10-07 11:33:26.393062] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.922 [2024-10-07 11:33:26.393166] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.922 [2024-10-07 11:33:26.393197] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.922 [2024-10-07 11:33:26.393213] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.922 [2024-10-07 11:33:26.395563] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.922 [2024-10-07 11:33:26.395833] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.922 [2024-10-07 11:33:26.395872] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.922 [2024-10-07 11:33:26.395889] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.922 [2024-10-07 11:33:26.396157] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.922 [2024-10-07 11:33:26.405337] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.922 [2024-10-07 11:33:26.405567] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.922 [2024-10-07 11:33:26.405599] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.922 [2024-10-07 11:33:26.405616] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.922 [2024-10-07 11:33:26.405747] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.922 [2024-10-07 11:33:26.405859] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.922 [2024-10-07 11:33:26.405895] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.922 [2024-10-07 11:33:26.405910] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.922 [2024-10-07 11:33:26.406024] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.922 [2024-10-07 11:33:26.416377] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.922 [2024-10-07 11:33:26.416599] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.922 [2024-10-07 11:33:26.416642] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.922 [2024-10-07 11:33:26.416676] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.922 [2024-10-07 11:33:26.416794] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.922 [2024-10-07 11:33:26.416912] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.922 [2024-10-07 11:33:26.416933] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.922 [2024-10-07 11:33:26.416947] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.922 [2024-10-07 11:33:26.417048] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.922 [2024-10-07 11:33:26.427629] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.922 [2024-10-07 11:33:26.428122] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.922 [2024-10-07 11:33:26.428161] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.922 [2024-10-07 11:33:26.428181] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.922 [2024-10-07 11:33:26.428398] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.922 [2024-10-07 11:33:26.428617] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.922 [2024-10-07 11:33:26.428642] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.922 [2024-10-07 11:33:26.428672] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.922 [2024-10-07 11:33:26.428735] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.922 [2024-10-07 11:33:26.440794] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.922 [2024-10-07 11:33:26.441143] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.922 [2024-10-07 11:33:26.441187] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.922 [2024-10-07 11:33:26.441207] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.922 [2024-10-07 11:33:26.441365] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.922 [2024-10-07 11:33:26.441492] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.922 [2024-10-07 11:33:26.441524] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.922 [2024-10-07 11:33:26.441541] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.922 [2024-10-07 11:33:26.441673] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.922 [2024-10-07 11:33:26.453827] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.922 [2024-10-07 11:33:26.453954] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.922 [2024-10-07 11:33:26.453984] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.922 [2024-10-07 11:33:26.454001] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.922 [2024-10-07 11:33:26.454452] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.922 [2024-10-07 11:33:26.454624] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.922 [2024-10-07 11:33:26.454668] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.922 [2024-10-07 11:33:26.454687] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.922 [2024-10-07 11:33:26.454812] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.922 [2024-10-07 11:33:26.464282] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.922 [2024-10-07 11:33:26.464457] bdev_nvme.c:1730:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0x1a2cb00 was disconnected and freed. reset controller. 00:22:37.922 [2024-10-07 11:33:26.464538] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.922 [2024-10-07 11:33:26.464566] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.922 [2024-10-07 11:33:26.464582] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.922 [2024-10-07 11:33:26.465181] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.922 [2024-10-07 11:33:26.465261] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.922 [2024-10-07 11:33:26.465292] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.922 [2024-10-07 11:33:26.465386] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.922 [2024-10-07 11:33:26.465409] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.922 [2024-10-07 11:33:26.465423] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.922 [2024-10-07 11:33:26.465447] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.922 [2024-10-07 11:33:26.468916] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.922 [2024-10-07 11:33:26.468962] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.922 [2024-10-07 11:33:26.468980] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.922 [2024-10-07 11:33:26.468994] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.922 [2024-10-07 11:33:26.469018] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.922 [2024-10-07 11:33:26.477010] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.922 [2024-10-07 11:33:26.477672] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.922 [2024-10-07 11:33:26.477767] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.922 [2024-10-07 11:33:26.477795] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.922 [2024-10-07 11:33:26.477812] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.922 [2024-10-07 11:33:26.477961] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.922 [2024-10-07 11:33:26.477990] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.922 [2024-10-07 11:33:26.478006] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.922 [2024-10-07 11:33:26.478024] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.922 [2024-10-07 11:33:26.478047] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.922 [2024-10-07 11:33:26.478064] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.923 [2024-10-07 11:33:26.478078] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.923 [2024-10-07 11:33:26.478092] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.923 [2024-10-07 11:33:26.478116] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.923 [2024-10-07 11:33:26.478131] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.923 [2024-10-07 11:33:26.478144] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.923 [2024-10-07 11:33:26.478156] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.923 [2024-10-07 11:33:26.478176] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.923 [2024-10-07 11:33:26.489594] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.923 [2024-10-07 11:33:26.489643] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.923 [2024-10-07 11:33:26.490134] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.923 [2024-10-07 11:33:26.490180] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.923 [2024-10-07 11:33:26.490199] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.923 [2024-10-07 11:33:26.490250] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.923 [2024-10-07 11:33:26.490272] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.923 [2024-10-07 11:33:26.490287] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.923 [2024-10-07 11:33:26.491147] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.923 [2024-10-07 11:33:26.491197] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.923 [2024-10-07 11:33:26.491485] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.923 [2024-10-07 11:33:26.491526] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.923 [2024-10-07 11:33:26.491541] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.923 [2024-10-07 11:33:26.491557] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.923 [2024-10-07 11:33:26.491571] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.923 [2024-10-07 11:33:26.491583] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.923 [2024-10-07 11:33:26.491635] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.923 [2024-10-07 11:33:26.491689] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.923 [2024-10-07 11:33:26.503036] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.923 [2024-10-07 11:33:26.503084] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.923 [2024-10-07 11:33:26.504164] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.923 [2024-10-07 11:33:26.504208] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.923 [2024-10-07 11:33:26.504228] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.923 [2024-10-07 11:33:26.504279] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.923 [2024-10-07 11:33:26.504302] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.923 [2024-10-07 11:33:26.504327] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.923 [2024-10-07 11:33:26.504442] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.923 [2024-10-07 11:33:26.504469] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.923 [2024-10-07 11:33:26.504489] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.923 [2024-10-07 11:33:26.504504] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.923 [2024-10-07 11:33:26.504517] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.923 [2024-10-07 11:33:26.504533] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.923 [2024-10-07 11:33:26.504549] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.923 [2024-10-07 11:33:26.504561] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.923 [2024-10-07 11:33:26.504583] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.923 [2024-10-07 11:33:26.504597] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.923 [2024-10-07 11:33:26.518396] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.923 [2024-10-07 11:33:26.518450] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.923 [2024-10-07 11:33:26.518535] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.923 [2024-10-07 11:33:26.518563] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.923 [2024-10-07 11:33:26.518579] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.923 [2024-10-07 11:33:26.518625] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.923 [2024-10-07 11:33:26.518662] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.923 [2024-10-07 11:33:26.518681] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.923 [2024-10-07 11:33:26.518705] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.923 [2024-10-07 11:33:26.518725] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.923 [2024-10-07 11:33:26.518744] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.923 [2024-10-07 11:33:26.518773] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.923 [2024-10-07 11:33:26.518788] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.923 [2024-10-07 11:33:26.518804] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.923 [2024-10-07 11:33:26.518818] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.923 [2024-10-07 11:33:26.518831] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.923 [2024-10-07 11:33:26.518854] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.923 [2024-10-07 11:33:26.518868] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.923 [2024-10-07 11:33:26.529623] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.923 [2024-10-07 11:33:26.529687] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.923 [2024-10-07 11:33:26.529892] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.923 [2024-10-07 11:33:26.529924] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.923 [2024-10-07 11:33:26.529940] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.923 [2024-10-07 11:33:26.529989] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.923 [2024-10-07 11:33:26.530012] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.923 [2024-10-07 11:33:26.530027] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.923 [2024-10-07 11:33:26.530152] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.923 [2024-10-07 11:33:26.530179] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.923 [2024-10-07 11:33:26.530581] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.923 [2024-10-07 11:33:26.530618] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.923 [2024-10-07 11:33:26.530636] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.923 [2024-10-07 11:33:26.530666] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.923 [2024-10-07 11:33:26.530683] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.923 [2024-10-07 11:33:26.530697] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.923 [2024-10-07 11:33:26.530867] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.923 [2024-10-07 11:33:26.530891] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.923 [2024-10-07 11:33:26.540031] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.923 [2024-10-07 11:33:26.540077] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.923 [2024-10-07 11:33:26.540162] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.923 [2024-10-07 11:33:26.540192] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.923 [2024-10-07 11:33:26.540209] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.923 [2024-10-07 11:33:26.540255] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.923 [2024-10-07 11:33:26.540293] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.923 [2024-10-07 11:33:26.540310] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.923 [2024-10-07 11:33:26.540334] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.923 [2024-10-07 11:33:26.540354] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.923 [2024-10-07 11:33:26.540387] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.923 [2024-10-07 11:33:26.540404] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.923 [2024-10-07 11:33:26.540417] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.923 [2024-10-07 11:33:26.540433] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.923 [2024-10-07 11:33:26.540447] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.923 [2024-10-07 11:33:26.540460] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.924 [2024-10-07 11:33:26.540482] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.924 [2024-10-07 11:33:26.540497] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.924 [2024-10-07 11:33:26.550252] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.924 [2024-10-07 11:33:26.550299] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.924 [2024-10-07 11:33:26.550384] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.924 [2024-10-07 11:33:26.550413] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.924 [2024-10-07 11:33:26.550429] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.924 [2024-10-07 11:33:26.550475] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.924 [2024-10-07 11:33:26.550498] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.924 [2024-10-07 11:33:26.550513] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.924 [2024-10-07 11:33:26.550536] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.924 [2024-10-07 11:33:26.550556] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.924 [2024-10-07 11:33:26.550575] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.924 [2024-10-07 11:33:26.550589] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.924 [2024-10-07 11:33:26.550603] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.924 [2024-10-07 11:33:26.550619] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.924 [2024-10-07 11:33:26.550633] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.924 [2024-10-07 11:33:26.550660] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.924 [2024-10-07 11:33:26.550687] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.924 [2024-10-07 11:33:26.550701] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.924 [2024-10-07 11:33:26.563907] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.924 [2024-10-07 11:33:26.563955] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.924 [2024-10-07 11:33:26.564313] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.924 [2024-10-07 11:33:26.564355] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.924 [2024-10-07 11:33:26.564375] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.924 [2024-10-07 11:33:26.564426] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.924 [2024-10-07 11:33:26.564456] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.924 [2024-10-07 11:33:26.564472] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.924 [2024-10-07 11:33:26.564607] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.924 [2024-10-07 11:33:26.564636] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.924 [2024-10-07 11:33:26.564971] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.924 [2024-10-07 11:33:26.565006] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.924 [2024-10-07 11:33:26.565024] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.924 [2024-10-07 11:33:26.565041] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.924 [2024-10-07 11:33:26.565056] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.924 [2024-10-07 11:33:26.565068] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.924 [2024-10-07 11:33:26.565245] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.924 [2024-10-07 11:33:26.565270] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.924 [2024-10-07 11:33:26.574723] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.924 [2024-10-07 11:33:26.574778] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.924 [2024-10-07 11:33:26.574861] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.924 [2024-10-07 11:33:26.574889] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.924 [2024-10-07 11:33:26.574905] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.924 [2024-10-07 11:33:26.574952] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.924 [2024-10-07 11:33:26.574975] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.924 [2024-10-07 11:33:26.574990] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.924 [2024-10-07 11:33:26.575013] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.924 [2024-10-07 11:33:26.575032] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.924 [2024-10-07 11:33:26.575052] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.924 [2024-10-07 11:33:26.575066] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.924 [2024-10-07 11:33:26.575096] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.924 [2024-10-07 11:33:26.575113] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.924 [2024-10-07 11:33:26.575127] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.924 [2024-10-07 11:33:26.575140] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.924 [2024-10-07 11:33:26.575162] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.924 [2024-10-07 11:33:26.575176] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.924 [2024-10-07 11:33:26.585118] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.924 [2024-10-07 11:33:26.585165] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.924 [2024-10-07 11:33:26.585248] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.924 [2024-10-07 11:33:26.585277] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.924 [2024-10-07 11:33:26.585294] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.924 [2024-10-07 11:33:26.585340] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.924 [2024-10-07 11:33:26.585363] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.924 [2024-10-07 11:33:26.585378] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.924 [2024-10-07 11:33:26.585401] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.924 [2024-10-07 11:33:26.585420] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.924 [2024-10-07 11:33:26.585440] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.924 [2024-10-07 11:33:26.585455] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.924 [2024-10-07 11:33:26.585468] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.924 [2024-10-07 11:33:26.585483] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.924 [2024-10-07 11:33:26.585497] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.924 [2024-10-07 11:33:26.585509] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.924 [2024-10-07 11:33:26.585532] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.924 [2024-10-07 11:33:26.585546] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.924 [2024-10-07 11:33:26.595226] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.924 [2024-10-07 11:33:26.595286] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.924 [2024-10-07 11:33:26.595362] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.924 [2024-10-07 11:33:26.595390] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.924 [2024-10-07 11:33:26.595406] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.924 [2024-10-07 11:33:26.595459] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.924 [2024-10-07 11:33:26.595483] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.924 [2024-10-07 11:33:26.595512] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.924 [2024-10-07 11:33:26.595531] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.924 [2024-10-07 11:33:26.595554] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.924 [2024-10-07 11:33:26.595572] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.924 [2024-10-07 11:33:26.595585] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.924 [2024-10-07 11:33:26.595598] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.924 [2024-10-07 11:33:26.595621] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.924 [2024-10-07 11:33:26.595636] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.924 [2024-10-07 11:33:26.595672] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.924 [2024-10-07 11:33:26.595688] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.924 [2024-10-07 11:33:26.595709] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.924 [2024-10-07 11:33:26.605977] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.924 [2024-10-07 11:33:26.606024] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.924 [2024-10-07 11:33:26.606204] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.925 [2024-10-07 11:33:26.606234] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.925 [2024-10-07 11:33:26.606251] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.925 [2024-10-07 11:33:26.606298] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.925 [2024-10-07 11:33:26.606320] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.925 [2024-10-07 11:33:26.606335] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.925 [2024-10-07 11:33:26.606438] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.925 [2024-10-07 11:33:26.606467] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.925 [2024-10-07 11:33:26.606782] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.925 [2024-10-07 11:33:26.606808] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.925 [2024-10-07 11:33:26.606822] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.925 [2024-10-07 11:33:26.606839] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.925 [2024-10-07 11:33:26.606853] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.925 [2024-10-07 11:33:26.606865] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.925 [2024-10-07 11:33:26.608528] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.925 [2024-10-07 11:33:26.608565] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.925 [2024-10-07 11:33:26.616660] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.925 [2024-10-07 11:33:26.616733] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.925 [2024-10-07 11:33:26.616929] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.925 [2024-10-07 11:33:26.616961] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.925 [2024-10-07 11:33:26.616977] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.925 [2024-10-07 11:33:26.617025] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.925 [2024-10-07 11:33:26.617047] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.925 [2024-10-07 11:33:26.617062] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.925 [2024-10-07 11:33:26.617177] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.925 [2024-10-07 11:33:26.617204] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.925 [2024-10-07 11:33:26.617739] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.925 [2024-10-07 11:33:26.617775] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.925 [2024-10-07 11:33:26.617793] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.925 [2024-10-07 11:33:26.617810] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.925 [2024-10-07 11:33:26.617824] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.925 [2024-10-07 11:33:26.617836] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.925 [2024-10-07 11:33:26.618125] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.925 [2024-10-07 11:33:26.618152] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.925 [2024-10-07 11:33:26.629358] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.925 [2024-10-07 11:33:26.629405] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.925 [2024-10-07 11:33:26.629598] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.925 [2024-10-07 11:33:26.629628] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.925 [2024-10-07 11:33:26.629644] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.925 [2024-10-07 11:33:26.629713] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.925 [2024-10-07 11:33:26.629737] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.925 [2024-10-07 11:33:26.629752] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.925 [2024-10-07 11:33:26.629776] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.925 [2024-10-07 11:33:26.629795] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.925 [2024-10-07 11:33:26.629815] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.925 [2024-10-07 11:33:26.629830] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.925 [2024-10-07 11:33:26.629843] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.925 [2024-10-07 11:33:26.629876] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.925 [2024-10-07 11:33:26.629892] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.925 [2024-10-07 11:33:26.629905] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.925 [2024-10-07 11:33:26.630084] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.925 [2024-10-07 11:33:26.630110] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.925 [2024-10-07 11:33:26.639498] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.925 [2024-10-07 11:33:26.639562] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.925 [2024-10-07 11:33:26.639678] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.925 [2024-10-07 11:33:26.639709] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.925 [2024-10-07 11:33:26.639726] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.925 [2024-10-07 11:33:26.639774] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.925 [2024-10-07 11:33:26.639797] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.925 [2024-10-07 11:33:26.639812] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.925 [2024-10-07 11:33:26.639835] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.925 [2024-10-07 11:33:26.639855] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.925 [2024-10-07 11:33:26.639875] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.925 [2024-10-07 11:33:26.639889] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.925 [2024-10-07 11:33:26.639903] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.925 [2024-10-07 11:33:26.639919] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.925 [2024-10-07 11:33:26.639932] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.925 [2024-10-07 11:33:26.639945] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.925 [2024-10-07 11:33:26.639967] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.925 [2024-10-07 11:33:26.639982] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.925 [2024-10-07 11:33:26.650579] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.925 [2024-10-07 11:33:26.650627] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.925 [2024-10-07 11:33:26.650761] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.925 [2024-10-07 11:33:26.650792] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.925 [2024-10-07 11:33:26.650809] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.925 [2024-10-07 11:33:26.650874] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.925 [2024-10-07 11:33:26.650913] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.925 [2024-10-07 11:33:26.650928] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.925 [2024-10-07 11:33:26.651125] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.925 [2024-10-07 11:33:26.651155] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.925 [2024-10-07 11:33:26.651227] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.925 [2024-10-07 11:33:26.651250] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.925 [2024-10-07 11:33:26.651263] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.925 [2024-10-07 11:33:26.651280] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.925 [2024-10-07 11:33:26.651294] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.926 [2024-10-07 11:33:26.651307] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.926 [2024-10-07 11:33:26.651478] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.926 [2024-10-07 11:33:26.651500] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.926 [2024-10-07 11:33:26.662699] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.926 [2024-10-07 11:33:26.662746] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.926 [2024-10-07 11:33:26.662861] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.926 [2024-10-07 11:33:26.662891] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.926 [2024-10-07 11:33:26.662908] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.926 [2024-10-07 11:33:26.662955] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.926 [2024-10-07 11:33:26.662978] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.926 [2024-10-07 11:33:26.662993] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.926 [2024-10-07 11:33:26.663017] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.926 [2024-10-07 11:33:26.663037] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.926 [2024-10-07 11:33:26.663056] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.926 [2024-10-07 11:33:26.663070] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.926 [2024-10-07 11:33:26.663084] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.926 [2024-10-07 11:33:26.663099] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.926 [2024-10-07 11:33:26.663114] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.926 [2024-10-07 11:33:26.663126] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.926 [2024-10-07 11:33:26.663152] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.926 [2024-10-07 11:33:26.663166] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.926 [2024-10-07 11:33:26.676284] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.926 [2024-10-07 11:33:26.676334] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.926 [2024-10-07 11:33:26.676685] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.926 [2024-10-07 11:33:26.676728] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.926 [2024-10-07 11:33:26.676747] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.926 [2024-10-07 11:33:26.676798] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.926 [2024-10-07 11:33:26.676822] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.926 [2024-10-07 11:33:26.676837] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.926 [2024-10-07 11:33:26.677041] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.926 [2024-10-07 11:33:26.677072] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.926 [2024-10-07 11:33:26.677127] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.926 [2024-10-07 11:33:26.677148] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.926 [2024-10-07 11:33:26.677162] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.926 [2024-10-07 11:33:26.677178] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.926 [2024-10-07 11:33:26.677193] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.926 [2024-10-07 11:33:26.677205] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.926 [2024-10-07 11:33:26.677228] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.926 [2024-10-07 11:33:26.677242] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.926 [2024-10-07 11:33:26.691017] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.926 [2024-10-07 11:33:26.691068] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.926 [2024-10-07 11:33:26.691152] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.926 [2024-10-07 11:33:26.691180] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.926 [2024-10-07 11:33:26.691210] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.926 [2024-10-07 11:33:26.691259] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.926 [2024-10-07 11:33:26.691282] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.926 [2024-10-07 11:33:26.691297] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.926 [2024-10-07 11:33:26.691321] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.926 [2024-10-07 11:33:26.691340] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.926 [2024-10-07 11:33:26.691360] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.926 [2024-10-07 11:33:26.691374] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.926 [2024-10-07 11:33:26.691387] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.926 [2024-10-07 11:33:26.691403] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.926 [2024-10-07 11:33:26.691432] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.926 [2024-10-07 11:33:26.691446] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.926 [2024-10-07 11:33:26.691470] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.926 [2024-10-07 11:33:26.691485] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.926 [2024-10-07 11:33:26.703267] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.926 [2024-10-07 11:33:26.703315] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.926 [2024-10-07 11:33:26.703429] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.926 [2024-10-07 11:33:26.703459] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.926 [2024-10-07 11:33:26.703475] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.926 [2024-10-07 11:33:26.703523] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.926 [2024-10-07 11:33:26.703546] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.926 [2024-10-07 11:33:26.703562] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.926 [2024-10-07 11:33:26.703585] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.926 [2024-10-07 11:33:26.703605] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.926 [2024-10-07 11:33:26.703625] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.926 [2024-10-07 11:33:26.703638] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.926 [2024-10-07 11:33:26.703667] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.926 [2024-10-07 11:33:26.703686] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.926 [2024-10-07 11:33:26.703700] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.926 [2024-10-07 11:33:26.703712] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.926 [2024-10-07 11:33:26.703735] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.926 [2024-10-07 11:33:26.703764] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.926 [2024-10-07 11:33:26.716816] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.926 [2024-10-07 11:33:26.716863] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.926 [2024-10-07 11:33:26.716946] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.926 [2024-10-07 11:33:26.716974] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.926 [2024-10-07 11:33:26.716990] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.926 [2024-10-07 11:33:26.717037] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.926 [2024-10-07 11:33:26.717059] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.926 [2024-10-07 11:33:26.717073] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.926 [2024-10-07 11:33:26.717113] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.926 [2024-10-07 11:33:26.717134] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.926 [2024-10-07 11:33:26.717153] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.926 [2024-10-07 11:33:26.717167] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.926 [2024-10-07 11:33:26.717181] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.926 [2024-10-07 11:33:26.717196] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.926 [2024-10-07 11:33:26.717211] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.926 [2024-10-07 11:33:26.717223] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.926 [2024-10-07 11:33:26.717246] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.926 [2024-10-07 11:33:26.717260] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.926 [2024-10-07 11:33:26.729205] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.926 [2024-10-07 11:33:26.729254] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.926 [2024-10-07 11:33:26.729485] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.926 [2024-10-07 11:33:26.729518] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.927 [2024-10-07 11:33:26.729535] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.927 [2024-10-07 11:33:26.729582] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.927 [2024-10-07 11:33:26.729605] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.927 [2024-10-07 11:33:26.729620] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.927 [2024-10-07 11:33:26.729835] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.927 [2024-10-07 11:33:26.729866] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.927 [2024-10-07 11:33:26.730076] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.927 [2024-10-07 11:33:26.730103] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.927 [2024-10-07 11:33:26.730117] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.927 [2024-10-07 11:33:26.730133] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.927 [2024-10-07 11:33:26.730147] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.927 [2024-10-07 11:33:26.730160] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.927 [2024-10-07 11:33:26.730229] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.927 [2024-10-07 11:33:26.730249] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.927 [2024-10-07 11:33:26.742427] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.927 [2024-10-07 11:33:26.742474] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.927 [2024-10-07 11:33:26.742559] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.927 [2024-10-07 11:33:26.742605] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.927 [2024-10-07 11:33:26.742623] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.927 [2024-10-07 11:33:26.742688] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.927 [2024-10-07 11:33:26.742714] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.927 [2024-10-07 11:33:26.742729] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.927 [2024-10-07 11:33:26.743308] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.927 [2024-10-07 11:33:26.743349] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.927 [2024-10-07 11:33:26.743445] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.927 [2024-10-07 11:33:26.743467] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.927 [2024-10-07 11:33:26.743481] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.927 [2024-10-07 11:33:26.743498] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.927 [2024-10-07 11:33:26.743512] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.927 [2024-10-07 11:33:26.743524] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.927 [2024-10-07 11:33:26.743547] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.927 [2024-10-07 11:33:26.743561] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.927 [2024-10-07 11:33:26.754762] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.927 [2024-10-07 11:33:26.754809] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.927 [2024-10-07 11:33:26.755261] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.927 [2024-10-07 11:33:26.755303] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.927 [2024-10-07 11:33:26.755323] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.927 [2024-10-07 11:33:26.755372] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.927 [2024-10-07 11:33:26.755396] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.927 [2024-10-07 11:33:26.755411] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.927 [2024-10-07 11:33:26.755627] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.927 [2024-10-07 11:33:26.755672] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.927 [2024-10-07 11:33:26.755725] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.927 [2024-10-07 11:33:26.755746] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.927 [2024-10-07 11:33:26.755761] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.927 [2024-10-07 11:33:26.755777] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.927 [2024-10-07 11:33:26.755791] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.927 [2024-10-07 11:33:26.755819] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.927 [2024-10-07 11:33:26.755844] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.927 [2024-10-07 11:33:26.755859] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.927 [2024-10-07 11:33:26.765745] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.927 [2024-10-07 11:33:26.765792] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.927 [2024-10-07 11:33:26.765970] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.927 [2024-10-07 11:33:26.766000] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.927 [2024-10-07 11:33:26.766016] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.927 [2024-10-07 11:33:26.766063] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.927 [2024-10-07 11:33:26.766086] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.927 [2024-10-07 11:33:26.766101] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.927 [2024-10-07 11:33:26.766257] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.927 [2024-10-07 11:33:26.766286] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.927 [2024-10-07 11:33:26.768390] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.927 [2024-10-07 11:33:26.768429] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.927 [2024-10-07 11:33:26.768463] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.927 [2024-10-07 11:33:26.768480] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.927 [2024-10-07 11:33:26.768494] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.927 [2024-10-07 11:33:26.768507] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.927 [2024-10-07 11:33:26.769637] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.927 [2024-10-07 11:33:26.769696] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.927 [2024-10-07 11:33:26.776767] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.927 [2024-10-07 11:33:26.776815] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.927 [2024-10-07 11:33:26.777021] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.927 [2024-10-07 11:33:26.777062] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.927 [2024-10-07 11:33:26.777081] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.927 [2024-10-07 11:33:26.777144] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.927 [2024-10-07 11:33:26.777168] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.927 [2024-10-07 11:33:26.777183] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.927 [2024-10-07 11:33:26.777308] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.927 [2024-10-07 11:33:26.777350] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.927 [2024-10-07 11:33:26.777465] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.927 [2024-10-07 11:33:26.777486] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.927 [2024-10-07 11:33:26.777500] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.927 [2024-10-07 11:33:26.777517] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.927 [2024-10-07 11:33:26.777532] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.927 [2024-10-07 11:33:26.777544] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.927 [2024-10-07 11:33:26.777645] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.927 [2024-10-07 11:33:26.777683] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.927 [2024-10-07 11:33:26.787129] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.927 [2024-10-07 11:33:26.787191] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.927 [2024-10-07 11:33:26.787379] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.927 [2024-10-07 11:33:26.787410] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.927 [2024-10-07 11:33:26.787427] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.927 [2024-10-07 11:33:26.787477] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.927 [2024-10-07 11:33:26.787501] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.927 [2024-10-07 11:33:26.787516] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.927 [2024-10-07 11:33:26.787618] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.927 [2024-10-07 11:33:26.787642] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.927 [2024-10-07 11:33:26.787757] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.928 [2024-10-07 11:33:26.787777] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.928 [2024-10-07 11:33:26.787791] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.928 [2024-10-07 11:33:26.787807] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.928 [2024-10-07 11:33:26.787820] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.928 [2024-10-07 11:33:26.787833] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.928 [2024-10-07 11:33:26.789520] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.928 [2024-10-07 11:33:26.789558] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.928 [2024-10-07 11:33:26.797254] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.928 [2024-10-07 11:33:26.797314] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.928 [2024-10-07 11:33:26.797388] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.928 [2024-10-07 11:33:26.797417] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.928 [2024-10-07 11:33:26.797452] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.928 [2024-10-07 11:33:26.798033] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.928 [2024-10-07 11:33:26.798075] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.928 [2024-10-07 11:33:26.798095] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.928 [2024-10-07 11:33:26.798114] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.928 [2024-10-07 11:33:26.798311] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.928 [2024-10-07 11:33:26.798338] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.928 [2024-10-07 11:33:26.798352] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.928 [2024-10-07 11:33:26.798365] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.928 [2024-10-07 11:33:26.798509] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.928 [2024-10-07 11:33:26.798531] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.928 [2024-10-07 11:33:26.798545] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.928 [2024-10-07 11:33:26.798558] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.928 [2024-10-07 11:33:26.798699] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.928 [2024-10-07 11:33:26.808084] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.928 [2024-10-07 11:33:26.808131] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.928 [2024-10-07 11:33:26.808229] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.928 [2024-10-07 11:33:26.808259] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.928 [2024-10-07 11:33:26.808276] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.928 [2024-10-07 11:33:26.808323] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.928 [2024-10-07 11:33:26.808346] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.928 [2024-10-07 11:33:26.808360] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.928 [2024-10-07 11:33:26.808384] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.928 [2024-10-07 11:33:26.808404] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.928 [2024-10-07 11:33:26.808423] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.928 [2024-10-07 11:33:26.808438] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.928 [2024-10-07 11:33:26.808451] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.928 [2024-10-07 11:33:26.808467] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.928 [2024-10-07 11:33:26.808481] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.928 [2024-10-07 11:33:26.808507] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.928 [2024-10-07 11:33:26.808532] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.928 [2024-10-07 11:33:26.808547] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.928 [2024-10-07 11:33:26.818777] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.928 [2024-10-07 11:33:26.818824] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.928 [2024-10-07 11:33:26.819350] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.928 [2024-10-07 11:33:26.819392] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.928 [2024-10-07 11:33:26.819412] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.928 [2024-10-07 11:33:26.819462] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.928 [2024-10-07 11:33:26.819485] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.928 [2024-10-07 11:33:26.819500] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.928 [2024-10-07 11:33:26.819742] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.928 [2024-10-07 11:33:26.819774] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.928 [2024-10-07 11:33:26.819975] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.928 [2024-10-07 11:33:26.820002] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.928 [2024-10-07 11:33:26.820016] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.928 [2024-10-07 11:33:26.820033] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.928 [2024-10-07 11:33:26.820047] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.928 [2024-10-07 11:33:26.820060] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.928 [2024-10-07 11:33:26.820119] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.928 [2024-10-07 11:33:26.820139] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.928 [2024-10-07 11:33:26.830786] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.928 [2024-10-07 11:33:26.830835] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.928 [2024-10-07 11:33:26.830919] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.928 [2024-10-07 11:33:26.830948] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.928 [2024-10-07 11:33:26.830964] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.928 [2024-10-07 11:33:26.831010] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.928 [2024-10-07 11:33:26.831033] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.928 [2024-10-07 11:33:26.831048] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.928 [2024-10-07 11:33:26.831627] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.928 [2024-10-07 11:33:26.831681] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.928 [2024-10-07 11:33:26.831815] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.928 [2024-10-07 11:33:26.831841] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.928 [2024-10-07 11:33:26.831855] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.928 [2024-10-07 11:33:26.831872] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.928 [2024-10-07 11:33:26.831886] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.928 [2024-10-07 11:33:26.831898] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.928 [2024-10-07 11:33:26.831922] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.928 [2024-10-07 11:33:26.831936] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.928 [2024-10-07 11:33:26.843327] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.928 [2024-10-07 11:33:26.843376] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.928 [2024-10-07 11:33:26.843694] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.928 [2024-10-07 11:33:26.843728] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.928 [2024-10-07 11:33:26.843745] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.928 [2024-10-07 11:33:26.843796] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.928 [2024-10-07 11:33:26.843820] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.928 [2024-10-07 11:33:26.843835] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.928 [2024-10-07 11:33:26.844038] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.928 [2024-10-07 11:33:26.844069] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.928 [2024-10-07 11:33:26.844126] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.928 [2024-10-07 11:33:26.844148] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.928 [2024-10-07 11:33:26.844161] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.928 [2024-10-07 11:33:26.844178] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.928 [2024-10-07 11:33:26.844192] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.928 [2024-10-07 11:33:26.844205] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.928 [2024-10-07 11:33:26.844227] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.928 [2024-10-07 11:33:26.844241] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.929 [2024-10-07 11:33:26.855084] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.929 [2024-10-07 11:33:26.855134] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.929 [2024-10-07 11:33:26.855353] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.929 [2024-10-07 11:33:26.855385] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.929 [2024-10-07 11:33:26.855402] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.929 [2024-10-07 11:33:26.855468] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.929 [2024-10-07 11:33:26.855492] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.929 [2024-10-07 11:33:26.855507] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.929 [2024-10-07 11:33:26.855630] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.929 [2024-10-07 11:33:26.855678] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.929 [2024-10-07 11:33:26.855779] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.929 [2024-10-07 11:33:26.855799] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.929 [2024-10-07 11:33:26.855813] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.929 [2024-10-07 11:33:26.855830] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.929 [2024-10-07 11:33:26.855844] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.929 [2024-10-07 11:33:26.855857] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.929 [2024-10-07 11:33:26.855968] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.929 [2024-10-07 11:33:26.855989] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.929 [2024-10-07 11:33:26.867277] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.929 [2024-10-07 11:33:26.867326] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.929 [2024-10-07 11:33:26.867500] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.929 [2024-10-07 11:33:26.867531] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.929 [2024-10-07 11:33:26.867549] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.929 [2024-10-07 11:33:26.867596] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.929 [2024-10-07 11:33:26.867619] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.929 [2024-10-07 11:33:26.867634] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.929 [2024-10-07 11:33:26.867753] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.929 [2024-10-07 11:33:26.867780] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.929 [2024-10-07 11:33:26.867891] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.929 [2024-10-07 11:33:26.867912] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.929 [2024-10-07 11:33:26.867926] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.929 [2024-10-07 11:33:26.867942] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.929 [2024-10-07 11:33:26.867955] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.929 [2024-10-07 11:33:26.867968] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.929 [2024-10-07 11:33:26.872271] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.929 [2024-10-07 11:33:26.872310] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.929 [2024-10-07 11:33:26.877506] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.929 [2024-10-07 11:33:26.877554] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.929 [2024-10-07 11:33:26.877639] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.929 [2024-10-07 11:33:26.877682] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.929 [2024-10-07 11:33:26.877700] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.929 [2024-10-07 11:33:26.877749] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.929 [2024-10-07 11:33:26.877772] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.929 [2024-10-07 11:33:26.877787] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.929 [2024-10-07 11:33:26.877811] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.929 [2024-10-07 11:33:26.877831] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.929 [2024-10-07 11:33:26.877851] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.929 [2024-10-07 11:33:26.877866] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.929 [2024-10-07 11:33:26.877879] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.929 [2024-10-07 11:33:26.877895] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.929 [2024-10-07 11:33:26.877909] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.929 [2024-10-07 11:33:26.877921] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.929 [2024-10-07 11:33:26.877943] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.929 [2024-10-07 11:33:26.877957] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.929 [2024-10-07 11:33:26.887614] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.929 [2024-10-07 11:33:26.887690] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.929 [2024-10-07 11:33:26.887767] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.929 [2024-10-07 11:33:26.887796] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.929 [2024-10-07 11:33:26.887812] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.929 [2024-10-07 11:33:26.887865] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.929 [2024-10-07 11:33:26.887889] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.929 [2024-10-07 11:33:26.887904] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.929 [2024-10-07 11:33:26.887921] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.929 [2024-10-07 11:33:26.887944] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.929 [2024-10-07 11:33:26.887961] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.929 [2024-10-07 11:33:26.887989] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.929 [2024-10-07 11:33:26.888003] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.929 [2024-10-07 11:33:26.888026] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.929 [2024-10-07 11:33:26.888041] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.929 [2024-10-07 11:33:26.888054] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.929 [2024-10-07 11:33:26.888066] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.929 [2024-10-07 11:33:26.888086] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.929 [2024-10-07 11:33:26.902231] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.929 [2024-10-07 11:33:26.902280] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.929 [2024-10-07 11:33:26.902576] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.929 [2024-10-07 11:33:26.902610] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.929 [2024-10-07 11:33:26.902628] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.929 [2024-10-07 11:33:26.902691] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.929 [2024-10-07 11:33:26.902717] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.929 [2024-10-07 11:33:26.902732] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.929 [2024-10-07 11:33:26.902960] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.929 [2024-10-07 11:33:26.902992] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.929 8863.40 IOPS, 34.62 MiB/s [2024-10-07T11:33:33.452Z] [2024-10-07 11:33:26.904769] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.929 [2024-10-07 11:33:26.904799] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.929 [2024-10-07 11:33:26.904816] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.929 [2024-10-07 11:33:26.904834] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.929 [2024-10-07 11:33:26.904848] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.929 [2024-10-07 11:33:26.904860] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.929 [2024-10-07 11:33:26.904883] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.929 [2024-10-07 11:33:26.904897] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.929 [2024-10-07 11:33:26.916716] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.929 [2024-10-07 11:33:26.916764] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.929 [2024-10-07 11:33:26.917764] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.929 [2024-10-07 11:33:26.917807] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.929 [2024-10-07 11:33:26.917827] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.929 [2024-10-07 11:33:26.917896] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.929 [2024-10-07 11:33:26.917921] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.930 [2024-10-07 11:33:26.917935] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.930 [2024-10-07 11:33:26.918830] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.930 [2024-10-07 11:33:26.918873] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.930 [2024-10-07 11:33:26.919443] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.930 [2024-10-07 11:33:26.919480] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.930 [2024-10-07 11:33:26.919497] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.930 [2024-10-07 11:33:26.919514] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.930 [2024-10-07 11:33:26.919528] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.930 [2024-10-07 11:33:26.919541] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.930 [2024-10-07 11:33:26.919625] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.930 [2024-10-07 11:33:26.919660] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.930 [2024-10-07 11:33:26.928325] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.930 [2024-10-07 11:33:26.928374] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.930 [2024-10-07 11:33:26.928567] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.930 [2024-10-07 11:33:26.928606] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.930 [2024-10-07 11:33:26.928625] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.930 [2024-10-07 11:33:26.928691] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.930 [2024-10-07 11:33:26.928717] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.930 [2024-10-07 11:33:26.928732] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.930 [2024-10-07 11:33:26.928838] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.930 [2024-10-07 11:33:26.928863] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.930 [2024-10-07 11:33:26.929478] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.930 [2024-10-07 11:33:26.929515] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.930 [2024-10-07 11:33:26.929532] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.930 [2024-10-07 11:33:26.929549] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.930 [2024-10-07 11:33:26.929563] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.930 [2024-10-07 11:33:26.929576] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.930 [2024-10-07 11:33:26.931472] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.930 [2024-10-07 11:33:26.931532] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.930 [2024-10-07 11:33:26.941095] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.930 [2024-10-07 11:33:26.941142] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.930 [2024-10-07 11:33:26.941285] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.930 [2024-10-07 11:33:26.941320] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.930 [2024-10-07 11:33:26.941337] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.930 [2024-10-07 11:33:26.941384] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.930 [2024-10-07 11:33:26.941407] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.930 [2024-10-07 11:33:26.941422] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.930 [2024-10-07 11:33:26.941445] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.930 [2024-10-07 11:33:26.941464] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.930 [2024-10-07 11:33:26.941484] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.930 [2024-10-07 11:33:26.941498] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.930 [2024-10-07 11:33:26.941512] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.930 [2024-10-07 11:33:26.941528] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.930 [2024-10-07 11:33:26.941542] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.930 [2024-10-07 11:33:26.941555] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.930 [2024-10-07 11:33:26.941577] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.930 [2024-10-07 11:33:26.941591] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.930 [2024-10-07 11:33:26.951215] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.930 [2024-10-07 11:33:26.951278] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.930 [2024-10-07 11:33:26.951355] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.930 [2024-10-07 11:33:26.951384] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.930 [2024-10-07 11:33:26.951400] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.930 [2024-10-07 11:33:26.951454] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.930 [2024-10-07 11:33:26.951478] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.930 [2024-10-07 11:33:26.951493] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.930 [2024-10-07 11:33:26.951511] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.930 [2024-10-07 11:33:26.951534] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.930 [2024-10-07 11:33:26.951551] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.930 [2024-10-07 11:33:26.951581] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.930 [2024-10-07 11:33:26.951596] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.930 [2024-10-07 11:33:26.951620] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.930 [2024-10-07 11:33:26.951635] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.930 [2024-10-07 11:33:26.951663] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.930 [2024-10-07 11:33:26.951679] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.930 [2024-10-07 11:33:26.951701] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.930 [2024-10-07 11:33:26.961301] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.930 [2024-10-07 11:33:26.961417] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.930 [2024-10-07 11:33:26.961448] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.930 [2024-10-07 11:33:26.961464] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.930 [2024-10-07 11:33:26.961502] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.930 [2024-10-07 11:33:26.961532] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.930 [2024-10-07 11:33:26.961559] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.930 [2024-10-07 11:33:26.961574] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.930 [2024-10-07 11:33:26.961588] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.930 [2024-10-07 11:33:26.961609] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.930 [2024-10-07 11:33:26.961675] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.930 [2024-10-07 11:33:26.961701] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.930 [2024-10-07 11:33:26.961717] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.930 [2024-10-07 11:33:26.961741] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.930 [2024-10-07 11:33:26.961762] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.930 [2024-10-07 11:33:26.961776] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.930 [2024-10-07 11:33:26.961790] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.930 [2024-10-07 11:33:26.961812] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.930 [2024-10-07 11:33:26.971675] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.930 [2024-10-07 11:33:26.971893] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.930 [2024-10-07 11:33:26.971927] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.931 [2024-10-07 11:33:26.971943] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.931 [2024-10-07 11:33:26.972218] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.931 [2024-10-07 11:33:26.972269] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.931 [2024-10-07 11:33:26.972817] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.931 [2024-10-07 11:33:26.972858] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.931 [2024-10-07 11:33:26.972877] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.931 [2024-10-07 11:33:26.972892] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.931 [2024-10-07 11:33:26.972905] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.931 [2024-10-07 11:33:26.972918] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.931 [2024-10-07 11:33:26.976094] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.931 [2024-10-07 11:33:26.976137] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.931 [2024-10-07 11:33:26.976594] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.931 [2024-10-07 11:33:26.976632] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.931 [2024-10-07 11:33:26.976664] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.931 [2024-10-07 11:33:26.976905] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.931 [2024-10-07 11:33:26.981798] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.931 [2024-10-07 11:33:26.981905] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.931 [2024-10-07 11:33:26.981936] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.931 [2024-10-07 11:33:26.981953] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.931 [2024-10-07 11:33:26.981976] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.931 [2024-10-07 11:33:26.981998] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.931 [2024-10-07 11:33:26.982012] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.931 [2024-10-07 11:33:26.982025] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.931 [2024-10-07 11:33:26.982048] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.931 [2024-10-07 11:33:26.982288] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.931 [2024-10-07 11:33:26.982359] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.931 [2024-10-07 11:33:26.982385] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.931 [2024-10-07 11:33:26.982401] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.931 [2024-10-07 11:33:26.982422] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.931 [2024-10-07 11:33:26.982444] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.931 [2024-10-07 11:33:26.982458] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.931 [2024-10-07 11:33:26.982471] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.931 [2024-10-07 11:33:26.982493] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.931 [2024-10-07 11:33:26.991879] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.931 [2024-10-07 11:33:26.991984] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.931 [2024-10-07 11:33:26.992015] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.931 [2024-10-07 11:33:26.992032] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.931 [2024-10-07 11:33:26.994051] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.931 [2024-10-07 11:33:26.994596] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.931 [2024-10-07 11:33:26.994632] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.931 [2024-10-07 11:33:26.994662] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.931 [2024-10-07 11:33:26.995436] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.931 [2024-10-07 11:33:26.995483] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.931 [2024-10-07 11:33:26.995630] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.931 [2024-10-07 11:33:26.995673] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.931 [2024-10-07 11:33:26.995692] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.931 [2024-10-07 11:33:26.995716] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.931 [2024-10-07 11:33:26.995738] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.931 [2024-10-07 11:33:26.995753] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.931 [2024-10-07 11:33:26.995766] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.931 [2024-10-07 11:33:26.995790] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.931 [2024-10-07 11:33:27.004069] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.931 [2024-10-07 11:33:27.004282] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.931 [2024-10-07 11:33:27.004314] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.931 [2024-10-07 11:33:27.004331] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.931 [2024-10-07 11:33:27.004477] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.931 [2024-10-07 11:33:27.004596] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.931 [2024-10-07 11:33:27.004619] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.931 [2024-10-07 11:33:27.004634] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.931 [2024-10-07 11:33:27.004762] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.931 [2024-10-07 11:33:27.010086] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.931 [2024-10-07 11:33:27.010191] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.931 [2024-10-07 11:33:27.010222] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.931 [2024-10-07 11:33:27.010238] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.931 [2024-10-07 11:33:27.010279] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.931 [2024-10-07 11:33:27.010303] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.931 [2024-10-07 11:33:27.010319] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.931 [2024-10-07 11:33:27.010332] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.931 [2024-10-07 11:33:27.010355] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.931 [2024-10-07 11:33:27.016579] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.931 [2024-10-07 11:33:27.016864] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.931 [2024-10-07 11:33:27.016909] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.931 [2024-10-07 11:33:27.016930] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.931 [2024-10-07 11:33:27.017060] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.931 [2024-10-07 11:33:27.017170] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.931 [2024-10-07 11:33:27.017189] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.931 [2024-10-07 11:33:27.017203] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.931 [2024-10-07 11:33:27.017307] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.931 [2024-10-07 11:33:27.021619] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.931 [2024-10-07 11:33:27.021840] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.931 [2024-10-07 11:33:27.021873] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.931 [2024-10-07 11:33:27.021890] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.931 [2024-10-07 11:33:27.022035] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.931 [2024-10-07 11:33:27.022169] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.931 [2024-10-07 11:33:27.022191] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.931 [2024-10-07 11:33:27.022206] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.931 [2024-10-07 11:33:27.022322] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.931 [2024-10-07 11:33:27.027008] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.931 [2024-10-07 11:33:27.027211] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.931 [2024-10-07 11:33:27.027244] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.931 [2024-10-07 11:33:27.027262] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.931 [2024-10-07 11:33:27.027621] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.931 [2024-10-07 11:33:27.029526] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.931 [2024-10-07 11:33:27.029565] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.931 [2024-10-07 11:33:27.029598] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.931 [2024-10-07 11:33:27.030234] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.931 [2024-10-07 11:33:27.032144] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.932 [2024-10-07 11:33:27.032245] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.932 [2024-10-07 11:33:27.032274] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.932 [2024-10-07 11:33:27.032291] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.932 [2024-10-07 11:33:27.032315] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.932 [2024-10-07 11:33:27.032337] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.932 [2024-10-07 11:33:27.032351] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.932 [2024-10-07 11:33:27.032364] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.932 [2024-10-07 11:33:27.032387] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.932 [2024-10-07 11:33:27.037688] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.932 [2024-10-07 11:33:27.037898] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.932 [2024-10-07 11:33:27.037942] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.932 [2024-10-07 11:33:27.037962] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.932 [2024-10-07 11:33:27.038078] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.932 [2024-10-07 11:33:27.038187] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.932 [2024-10-07 11:33:27.038207] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.932 [2024-10-07 11:33:27.038221] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.932 [2024-10-07 11:33:27.038321] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.932 [2024-10-07 11:33:27.042229] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.932 [2024-10-07 11:33:27.042333] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.932 [2024-10-07 11:33:27.042363] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.932 [2024-10-07 11:33:27.042380] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.932 [2024-10-07 11:33:27.042403] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.932 [2024-10-07 11:33:27.042440] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.932 [2024-10-07 11:33:27.042459] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.932 [2024-10-07 11:33:27.042473] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.932 [2024-10-07 11:33:27.043950] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.932 [2024-10-07 11:33:27.047766] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.932 [2024-10-07 11:33:27.047885] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.932 [2024-10-07 11:33:27.047916] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.932 [2024-10-07 11:33:27.047933] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.932 [2024-10-07 11:33:27.047957] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.932 [2024-10-07 11:33:27.049051] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.932 [2024-10-07 11:33:27.049090] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.932 [2024-10-07 11:33:27.049108] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.932 [2024-10-07 11:33:27.049807] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.932 [2024-10-07 11:33:27.052544] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.932 [2024-10-07 11:33:27.052645] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.932 [2024-10-07 11:33:27.052687] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.932 [2024-10-07 11:33:27.052705] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.932 [2024-10-07 11:33:27.052728] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.932 [2024-10-07 11:33:27.052750] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.932 [2024-10-07 11:33:27.052765] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.932 [2024-10-07 11:33:27.052778] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.932 [2024-10-07 11:33:27.052801] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.932 [2024-10-07 11:33:27.057855] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.932 [2024-10-07 11:33:27.057962] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.932 [2024-10-07 11:33:27.057992] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.932 [2024-10-07 11:33:27.058008] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.932 [2024-10-07 11:33:27.058031] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.932 [2024-10-07 11:33:27.058053] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.932 [2024-10-07 11:33:27.058068] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.932 [2024-10-07 11:33:27.058081] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.932 [2024-10-07 11:33:27.058104] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.932 [2024-10-07 11:33:27.064541] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.932 [2024-10-07 11:33:27.064719] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.932 [2024-10-07 11:33:27.064751] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.932 [2024-10-07 11:33:27.064767] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.932 [2024-10-07 11:33:27.064805] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.932 [2024-10-07 11:33:27.064829] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.932 [2024-10-07 11:33:27.064844] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.932 [2024-10-07 11:33:27.064858] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.932 [2024-10-07 11:33:27.064882] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.932 [2024-10-07 11:33:27.070462] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.932 [2024-10-07 11:33:27.070691] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.932 [2024-10-07 11:33:27.070725] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.932 [2024-10-07 11:33:27.070742] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.932 [2024-10-07 11:33:27.071085] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.932 [2024-10-07 11:33:27.071279] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.932 [2024-10-07 11:33:27.071314] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.932 [2024-10-07 11:33:27.071331] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.932 [2024-10-07 11:33:27.071435] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.932 [2024-10-07 11:33:27.074966] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.932 [2024-10-07 11:33:27.075233] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.932 [2024-10-07 11:33:27.075277] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.932 [2024-10-07 11:33:27.075297] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.932 [2024-10-07 11:33:27.075465] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.932 [2024-10-07 11:33:27.075588] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.932 [2024-10-07 11:33:27.075610] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.932 [2024-10-07 11:33:27.075625] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.932 [2024-10-07 11:33:27.075770] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.932 [2024-10-07 11:33:27.080557] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.932 [2024-10-07 11:33:27.080675] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.932 [2024-10-07 11:33:27.080706] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.932 [2024-10-07 11:33:27.080722] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.932 [2024-10-07 11:33:27.080746] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.932 [2024-10-07 11:33:27.080768] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.932 [2024-10-07 11:33:27.080782] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.932 [2024-10-07 11:33:27.080813] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.932 [2024-10-07 11:33:27.080839] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.932 [2024-10-07 11:33:27.086250] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.932 [2024-10-07 11:33:27.086460] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.932 [2024-10-07 11:33:27.086492] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.932 [2024-10-07 11:33:27.086509] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.932 [2024-10-07 11:33:27.086623] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.932 [2024-10-07 11:33:27.086748] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.932 [2024-10-07 11:33:27.086769] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.932 [2024-10-07 11:33:27.086784] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.932 [2024-10-07 11:33:27.086894] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.933 [2024-10-07 11:33:27.090936] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.933 [2024-10-07 11:33:27.091040] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.933 [2024-10-07 11:33:27.091070] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.933 [2024-10-07 11:33:27.091087] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.933 [2024-10-07 11:33:27.091110] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.933 [2024-10-07 11:33:27.091132] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.933 [2024-10-07 11:33:27.091147] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.933 [2024-10-07 11:33:27.091160] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.933 [2024-10-07 11:33:27.091194] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.933 [2024-10-07 11:33:27.096684] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.933 [2024-10-07 11:33:27.096945] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.933 [2024-10-07 11:33:27.096988] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.933 [2024-10-07 11:33:27.097008] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.933 [2024-10-07 11:33:27.097081] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.933 [2024-10-07 11:33:27.097112] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.933 [2024-10-07 11:33:27.097128] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.933 [2024-10-07 11:33:27.097142] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.933 [2024-10-07 11:33:27.097317] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.933 [2024-10-07 11:33:27.101402] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.933 [2024-10-07 11:33:27.101505] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.933 [2024-10-07 11:33:27.101557] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.933 [2024-10-07 11:33:27.101576] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.933 [2024-10-07 11:33:27.101611] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.933 [2024-10-07 11:33:27.101636] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.933 [2024-10-07 11:33:27.101665] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.933 [2024-10-07 11:33:27.101681] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.933 [2024-10-07 11:33:27.101704] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.933 [2024-10-07 11:33:27.107639] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.933 [2024-10-07 11:33:27.110276] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.933 [2024-10-07 11:33:27.110321] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.933 [2024-10-07 11:33:27.110341] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.933 [2024-10-07 11:33:27.110847] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.933 [2024-10-07 11:33:27.111070] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.933 [2024-10-07 11:33:27.111106] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.933 [2024-10-07 11:33:27.111123] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.933 [2024-10-07 11:33:27.111264] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.933 [2024-10-07 11:33:27.111728] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.933 [2024-10-07 11:33:27.112006] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.933 [2024-10-07 11:33:27.112047] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.933 [2024-10-07 11:33:27.112067] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.933 [2024-10-07 11:33:27.112121] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.933 [2024-10-07 11:33:27.112149] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.933 [2024-10-07 11:33:27.112164] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.933 [2024-10-07 11:33:27.112177] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.933 [2024-10-07 11:33:27.112201] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.933 [2024-10-07 11:33:27.119099] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.933 [2024-10-07 11:33:27.119309] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.933 [2024-10-07 11:33:27.119341] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.933 [2024-10-07 11:33:27.119358] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.933 [2024-10-07 11:33:27.119382] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.933 [2024-10-07 11:33:27.119419] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.933 [2024-10-07 11:33:27.119435] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.933 [2024-10-07 11:33:27.119448] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.933 [2024-10-07 11:33:27.119472] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.933 [2024-10-07 11:33:27.121800] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.933 [2024-10-07 11:33:27.121901] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.933 [2024-10-07 11:33:27.121930] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.933 [2024-10-07 11:33:27.121946] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.933 [2024-10-07 11:33:27.121969] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.933 [2024-10-07 11:33:27.121991] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.933 [2024-10-07 11:33:27.122005] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.933 [2024-10-07 11:33:27.122019] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.933 [2024-10-07 11:33:27.122042] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.933 [2024-10-07 11:33:27.130210] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.933 [2024-10-07 11:33:27.130417] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.933 [2024-10-07 11:33:27.130449] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.933 [2024-10-07 11:33:27.130467] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.933 [2024-10-07 11:33:27.130580] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.933 [2024-10-07 11:33:27.130700] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.933 [2024-10-07 11:33:27.130722] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.933 [2024-10-07 11:33:27.130736] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.933 [2024-10-07 11:33:27.130838] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.933 [2024-10-07 11:33:27.134351] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.933 [2024-10-07 11:33:27.134501] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.933 [2024-10-07 11:33:27.134531] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.933 [2024-10-07 11:33:27.134548] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.933 [2024-10-07 11:33:27.134821] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.933 [2024-10-07 11:33:27.134970] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.933 [2024-10-07 11:33:27.135013] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.933 [2024-10-07 11:33:27.135031] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.933 [2024-10-07 11:33:27.135095] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.933 [2024-10-07 11:33:27.140291] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.933 [2024-10-07 11:33:27.140396] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.933 [2024-10-07 11:33:27.140426] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.933 [2024-10-07 11:33:27.140443] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.933 [2024-10-07 11:33:27.140467] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.933 [2024-10-07 11:33:27.140503] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.933 [2024-10-07 11:33:27.140521] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.933 [2024-10-07 11:33:27.140535] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.933 [2024-10-07 11:33:27.140558] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.933 [2024-10-07 11:33:27.144429] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.933 [2024-10-07 11:33:27.144532] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.933 [2024-10-07 11:33:27.144561] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.933 [2024-10-07 11:33:27.144577] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.933 [2024-10-07 11:33:27.147077] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.934 [2024-10-07 11:33:27.147970] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.934 [2024-10-07 11:33:27.148007] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.934 [2024-10-07 11:33:27.148024] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.934 [2024-10-07 11:33:27.148363] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.934 [2024-10-07 11:33:27.150367] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.934 [2024-10-07 11:33:27.150502] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.934 [2024-10-07 11:33:27.150531] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.934 [2024-10-07 11:33:27.150548] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.934 [2024-10-07 11:33:27.150571] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.934 [2024-10-07 11:33:27.150593] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.934 [2024-10-07 11:33:27.150607] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.934 [2024-10-07 11:33:27.150620] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.934 [2024-10-07 11:33:27.150643] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.934 [2024-10-07 11:33:27.154995] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.934 [2024-10-07 11:33:27.155159] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.934 [2024-10-07 11:33:27.155206] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.934 [2024-10-07 11:33:27.155242] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.934 [2024-10-07 11:33:27.155268] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.934 [2024-10-07 11:33:27.155290] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.934 [2024-10-07 11:33:27.155304] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.934 [2024-10-07 11:33:27.155318] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.934 [2024-10-07 11:33:27.155342] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.934 [2024-10-07 11:33:27.163574] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.934 [2024-10-07 11:33:27.163692] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.934 [2024-10-07 11:33:27.163723] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.934 [2024-10-07 11:33:27.163740] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.934 [2024-10-07 11:33:27.163764] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.934 [2024-10-07 11:33:27.163787] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.934 [2024-10-07 11:33:27.163801] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.934 [2024-10-07 11:33:27.163816] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.934 [2024-10-07 11:33:27.163839] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.934 [2024-10-07 11:33:27.165086] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.934 [2024-10-07 11:33:27.165178] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.934 [2024-10-07 11:33:27.165206] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.934 [2024-10-07 11:33:27.165222] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.934 [2024-10-07 11:33:27.165245] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.934 [2024-10-07 11:33:27.165267] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.934 [2024-10-07 11:33:27.165281] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.934 [2024-10-07 11:33:27.165294] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.934 [2024-10-07 11:33:27.165316] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.934 [2024-10-07 11:33:27.178550] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.934 [2024-10-07 11:33:27.178696] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.934 [2024-10-07 11:33:27.178779] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.934 [2024-10-07 11:33:27.178808] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.934 [2024-10-07 11:33:27.178824] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.934 [2024-10-07 11:33:27.178894] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.934 [2024-10-07 11:33:27.178935] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.934 [2024-10-07 11:33:27.178952] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.934 [2024-10-07 11:33:27.178970] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.934 [2024-10-07 11:33:27.178994] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.934 [2024-10-07 11:33:27.179011] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.934 [2024-10-07 11:33:27.179026] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.934 [2024-10-07 11:33:27.179039] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.934 [2024-10-07 11:33:27.179063] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.934 [2024-10-07 11:33:27.179078] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.934 [2024-10-07 11:33:27.179090] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.934 [2024-10-07 11:33:27.179103] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.934 [2024-10-07 11:33:27.179124] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.934 [2024-10-07 11:33:27.193728] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.934 [2024-10-07 11:33:27.193776] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.934 [2024-10-07 11:33:27.194223] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.934 [2024-10-07 11:33:27.194267] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.934 [2024-10-07 11:33:27.194287] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.934 [2024-10-07 11:33:27.194338] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.934 [2024-10-07 11:33:27.194362] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.934 [2024-10-07 11:33:27.194377] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.934 [2024-10-07 11:33:27.194444] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.934 [2024-10-07 11:33:27.194470] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.934 [2024-10-07 11:33:27.194490] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.934 [2024-10-07 11:33:27.194505] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.934 [2024-10-07 11:33:27.194518] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.934 [2024-10-07 11:33:27.194534] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.934 [2024-10-07 11:33:27.194548] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.934 [2024-10-07 11:33:27.194561] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.934 [2024-10-07 11:33:27.194584] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.934 [2024-10-07 11:33:27.194598] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.934 [2024-10-07 11:33:27.204131] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.934 [2024-10-07 11:33:27.204287] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.934 [2024-10-07 11:33:27.204368] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.934 [2024-10-07 11:33:27.204397] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.934 [2024-10-07 11:33:27.204413] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.934 [2024-10-07 11:33:27.204552] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.934 [2024-10-07 11:33:27.204578] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.934 [2024-10-07 11:33:27.204594] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.934 [2024-10-07 11:33:27.204612] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.935 [2024-10-07 11:33:27.204776] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.935 [2024-10-07 11:33:27.204805] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.935 [2024-10-07 11:33:27.204820] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.935 [2024-10-07 11:33:27.204834] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.935 [2024-10-07 11:33:27.204884] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.935 [2024-10-07 11:33:27.204904] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.935 [2024-10-07 11:33:27.204917] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.935 [2024-10-07 11:33:27.204930] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.935 [2024-10-07 11:33:27.204952] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.935 [2024-10-07 11:33:27.215246] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.935 [2024-10-07 11:33:27.215293] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.935 [2024-10-07 11:33:27.215515] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.935 [2024-10-07 11:33:27.215558] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.935 [2024-10-07 11:33:27.215575] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.935 [2024-10-07 11:33:27.215623] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.935 [2024-10-07 11:33:27.215661] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.935 [2024-10-07 11:33:27.215679] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.935 [2024-10-07 11:33:27.215800] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.935 [2024-10-07 11:33:27.215827] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.935 [2024-10-07 11:33:27.215923] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.935 [2024-10-07 11:33:27.215948] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.935 [2024-10-07 11:33:27.215978] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.935 [2024-10-07 11:33:27.215997] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.935 [2024-10-07 11:33:27.216012] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.935 [2024-10-07 11:33:27.216025] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.935 [2024-10-07 11:33:27.216128] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.935 [2024-10-07 11:33:27.216147] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.935 [2024-10-07 11:33:27.225875] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.935 [2024-10-07 11:33:27.225924] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.935 [2024-10-07 11:33:27.226817] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.935 [2024-10-07 11:33:27.226861] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.935 [2024-10-07 11:33:27.226881] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.935 [2024-10-07 11:33:27.226931] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.935 [2024-10-07 11:33:27.226955] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.935 [2024-10-07 11:33:27.226970] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.935 [2024-10-07 11:33:27.228726] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.935 [2024-10-07 11:33:27.228770] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.935 [2024-10-07 11:33:27.229218] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.935 [2024-10-07 11:33:27.229256] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.935 [2024-10-07 11:33:27.229274] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.935 [2024-10-07 11:33:27.229291] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.935 [2024-10-07 11:33:27.229305] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.935 [2024-10-07 11:33:27.229318] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.935 [2024-10-07 11:33:27.229460] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.935 [2024-10-07 11:33:27.229483] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.935 [2024-10-07 11:33:27.235993] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.935 [2024-10-07 11:33:27.236057] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.935 [2024-10-07 11:33:27.236133] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.935 [2024-10-07 11:33:27.236162] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.935 [2024-10-07 11:33:27.236178] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.935 [2024-10-07 11:33:27.236643] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.935 [2024-10-07 11:33:27.236697] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.935 [2024-10-07 11:33:27.236732] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.935 [2024-10-07 11:33:27.236753] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.935 [2024-10-07 11:33:27.236905] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.935 [2024-10-07 11:33:27.236932] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.935 [2024-10-07 11:33:27.236946] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.935 [2024-10-07 11:33:27.236959] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.935 [2024-10-07 11:33:27.237086] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.935 [2024-10-07 11:33:27.237110] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.935 [2024-10-07 11:33:27.237124] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.935 [2024-10-07 11:33:27.237137] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.935 [2024-10-07 11:33:27.237170] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.935 [2024-10-07 11:33:27.246071] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.935 [2024-10-07 11:33:27.246196] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.935 [2024-10-07 11:33:27.246227] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.935 [2024-10-07 11:33:27.246245] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.935 [2024-10-07 11:33:27.246284] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.935 [2024-10-07 11:33:27.246313] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.935 [2024-10-07 11:33:27.246340] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.935 [2024-10-07 11:33:27.246355] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.935 [2024-10-07 11:33:27.246369] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.935 [2024-10-07 11:33:27.246390] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.935 [2024-10-07 11:33:27.246442] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.935 [2024-10-07 11:33:27.246467] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.935 [2024-10-07 11:33:27.246482] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.935 [2024-10-07 11:33:27.246508] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.935 [2024-10-07 11:33:27.246529] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.935 [2024-10-07 11:33:27.246543] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.935 [2024-10-07 11:33:27.246556] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.935 [2024-10-07 11:33:27.246578] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.935 [2024-10-07 11:33:27.258339] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.935 [2024-10-07 11:33:27.258402] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.935 [2024-10-07 11:33:27.258718] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.935 [2024-10-07 11:33:27.258752] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.935 [2024-10-07 11:33:27.258791] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.935 [2024-10-07 11:33:27.258847] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.935 [2024-10-07 11:33:27.258870] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.935 [2024-10-07 11:33:27.258885] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.935 [2024-10-07 11:33:27.259379] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.935 [2024-10-07 11:33:27.259421] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.935 [2024-10-07 11:33:27.259662] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.935 [2024-10-07 11:33:27.259696] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.935 [2024-10-07 11:33:27.259713] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.935 [2024-10-07 11:33:27.259730] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.935 [2024-10-07 11:33:27.259745] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.935 [2024-10-07 11:33:27.259757] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.936 [2024-10-07 11:33:27.259813] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.936 [2024-10-07 11:33:27.259833] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.936 [2024-10-07 11:33:27.271046] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.936 [2024-10-07 11:33:27.271096] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.936 [2024-10-07 11:33:27.271292] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.936 [2024-10-07 11:33:27.271324] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.936 [2024-10-07 11:33:27.271341] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.936 [2024-10-07 11:33:27.271389] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.936 [2024-10-07 11:33:27.271412] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.936 [2024-10-07 11:33:27.271427] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.936 [2024-10-07 11:33:27.271560] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.936 [2024-10-07 11:33:27.271588] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.936 [2024-10-07 11:33:27.271713] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.936 [2024-10-07 11:33:27.271736] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.936 [2024-10-07 11:33:27.271750] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.936 [2024-10-07 11:33:27.271781] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.936 [2024-10-07 11:33:27.271797] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.936 [2024-10-07 11:33:27.271810] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.936 [2024-10-07 11:33:27.271925] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.936 [2024-10-07 11:33:27.271946] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.936 [2024-10-07 11:33:27.281175] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.936 [2024-10-07 11:33:27.281221] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.936 [2024-10-07 11:33:27.281306] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.936 [2024-10-07 11:33:27.281335] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.936 [2024-10-07 11:33:27.281351] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.936 [2024-10-07 11:33:27.281397] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.936 [2024-10-07 11:33:27.281419] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.936 [2024-10-07 11:33:27.281434] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.936 [2024-10-07 11:33:27.281457] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.936 [2024-10-07 11:33:27.281476] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.936 [2024-10-07 11:33:27.281496] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.936 [2024-10-07 11:33:27.281510] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.936 [2024-10-07 11:33:27.281523] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.936 [2024-10-07 11:33:27.281539] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.936 [2024-10-07 11:33:27.281553] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.936 [2024-10-07 11:33:27.281565] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.936 [2024-10-07 11:33:27.281588] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.936 [2024-10-07 11:33:27.281602] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.936 [2024-10-07 11:33:27.291284] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.936 [2024-10-07 11:33:27.291348] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.936 [2024-10-07 11:33:27.291434] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.936 [2024-10-07 11:33:27.291463] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.936 [2024-10-07 11:33:27.291479] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.936 [2024-10-07 11:33:27.291533] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.936 [2024-10-07 11:33:27.291557] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.936 [2024-10-07 11:33:27.291572] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.936 [2024-10-07 11:33:27.291606] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.936 [2024-10-07 11:33:27.291664] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.936 [2024-10-07 11:33:27.291687] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.936 [2024-10-07 11:33:27.291701] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.936 [2024-10-07 11:33:27.291714] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.936 [2024-10-07 11:33:27.291738] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.936 [2024-10-07 11:33:27.291754] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.936 [2024-10-07 11:33:27.291766] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.936 [2024-10-07 11:33:27.291779] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.936 [2024-10-07 11:33:27.291799] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.936 [2024-10-07 11:33:27.303747] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.936 [2024-10-07 11:33:27.303795] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.936 [2024-10-07 11:33:27.303881] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.936 [2024-10-07 11:33:27.303909] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.936 [2024-10-07 11:33:27.303925] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.936 [2024-10-07 11:33:27.303973] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.936 [2024-10-07 11:33:27.303996] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.936 [2024-10-07 11:33:27.304011] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.936 [2024-10-07 11:33:27.304507] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.936 [2024-10-07 11:33:27.304549] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.936 [2024-10-07 11:33:27.304812] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.936 [2024-10-07 11:33:27.304848] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.936 [2024-10-07 11:33:27.304870] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.936 [2024-10-07 11:33:27.304898] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.936 [2024-10-07 11:33:27.304914] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.936 [2024-10-07 11:33:27.304927] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.936 [2024-10-07 11:33:27.305407] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.936 [2024-10-07 11:33:27.305442] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.936 [2024-10-07 11:33:27.318075] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.936 [2024-10-07 11:33:27.318129] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.936 [2024-10-07 11:33:27.318236] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.936 [2024-10-07 11:33:27.318266] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.936 [2024-10-07 11:33:27.318283] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.936 [2024-10-07 11:33:27.318330] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.936 [2024-10-07 11:33:27.318353] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.936 [2024-10-07 11:33:27.318368] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.936 [2024-10-07 11:33:27.318391] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.936 [2024-10-07 11:33:27.318411] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.936 [2024-10-07 11:33:27.318431] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.936 [2024-10-07 11:33:27.318445] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.936 [2024-10-07 11:33:27.318459] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.936 [2024-10-07 11:33:27.318475] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.936 [2024-10-07 11:33:27.318489] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.936 [2024-10-07 11:33:27.318502] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.936 [2024-10-07 11:33:27.318524] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.936 [2024-10-07 11:33:27.318540] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.936 [2024-10-07 11:33:27.330325] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.936 [2024-10-07 11:33:27.330374] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.936 [2024-10-07 11:33:27.330499] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.936 [2024-10-07 11:33:27.330529] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.936 [2024-10-07 11:33:27.330546] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.936 [2024-10-07 11:33:27.330593] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.937 [2024-10-07 11:33:27.330616] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.937 [2024-10-07 11:33:27.330632] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.937 [2024-10-07 11:33:27.330696] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.937 [2024-10-07 11:33:27.330723] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.937 [2024-10-07 11:33:27.330743] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.937 [2024-10-07 11:33:27.330757] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.937 [2024-10-07 11:33:27.330771] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.937 [2024-10-07 11:33:27.330788] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.937 [2024-10-07 11:33:27.330816] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.937 [2024-10-07 11:33:27.330830] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.937 [2024-10-07 11:33:27.330853] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.937 [2024-10-07 11:33:27.330868] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.937 [2024-10-07 11:33:27.342374] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.937 [2024-10-07 11:33:27.342423] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.937 [2024-10-07 11:33:27.342622] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.937 [2024-10-07 11:33:27.342681] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.937 [2024-10-07 11:33:27.342701] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.937 [2024-10-07 11:33:27.342752] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.937 [2024-10-07 11:33:27.342776] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.937 [2024-10-07 11:33:27.342791] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.937 [2024-10-07 11:33:27.342946] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.937 [2024-10-07 11:33:27.342976] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.937 [2024-10-07 11:33:27.343101] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.937 [2024-10-07 11:33:27.343124] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.937 [2024-10-07 11:33:27.343138] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.937 [2024-10-07 11:33:27.343155] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.937 [2024-10-07 11:33:27.343169] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.937 [2024-10-07 11:33:27.343195] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.937 [2024-10-07 11:33:27.343312] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.937 [2024-10-07 11:33:27.343333] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.937 [2024-10-07 11:33:27.352724] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.937 [2024-10-07 11:33:27.352773] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.937 [2024-10-07 11:33:27.352942] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.937 [2024-10-07 11:33:27.352973] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.937 [2024-10-07 11:33:27.352989] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.937 [2024-10-07 11:33:27.353038] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.937 [2024-10-07 11:33:27.353062] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.937 [2024-10-07 11:33:27.353077] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.937 [2024-10-07 11:33:27.353241] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.937 [2024-10-07 11:33:27.353286] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.937 [2024-10-07 11:33:27.353338] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.937 [2024-10-07 11:33:27.353360] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.937 [2024-10-07 11:33:27.353374] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.937 [2024-10-07 11:33:27.353390] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.937 [2024-10-07 11:33:27.353405] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.937 [2024-10-07 11:33:27.353418] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.937 [2024-10-07 11:33:27.353440] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.937 [2024-10-07 11:33:27.353455] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.937 [2024-10-07 11:33:27.362944] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.937 [2024-10-07 11:33:27.362993] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.937 [2024-10-07 11:33:27.363080] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.937 [2024-10-07 11:33:27.363110] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.937 [2024-10-07 11:33:27.363126] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.937 [2024-10-07 11:33:27.363174] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.937 [2024-10-07 11:33:27.363209] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.937 [2024-10-07 11:33:27.363237] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.937 [2024-10-07 11:33:27.365860] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.937 [2024-10-07 11:33:27.365903] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.937 [2024-10-07 11:33:27.367039] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.937 [2024-10-07 11:33:27.367078] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.937 [2024-10-07 11:33:27.367096] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.937 [2024-10-07 11:33:27.367113] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.937 [2024-10-07 11:33:27.367127] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.937 [2024-10-07 11:33:27.367139] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.937 [2024-10-07 11:33:27.367391] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.937 [2024-10-07 11:33:27.367417] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.937 [2024-10-07 11:33:27.373054] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.937 [2024-10-07 11:33:27.373114] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.937 [2024-10-07 11:33:27.373190] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.937 [2024-10-07 11:33:27.373238] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.937 [2024-10-07 11:33:27.373256] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.937 [2024-10-07 11:33:27.373312] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.937 [2024-10-07 11:33:27.373337] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.937 [2024-10-07 11:33:27.373352] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.937 [2024-10-07 11:33:27.373370] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.937 [2024-10-07 11:33:27.373394] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.937 [2024-10-07 11:33:27.373411] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.937 [2024-10-07 11:33:27.373424] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.937 [2024-10-07 11:33:27.373438] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.937 [2024-10-07 11:33:27.375891] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.937 [2024-10-07 11:33:27.375932] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.937 [2024-10-07 11:33:27.375950] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.937 [2024-10-07 11:33:27.375964] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.937 [2024-10-07 11:33:27.376533] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.937 [2024-10-07 11:33:27.383133] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.937 [2024-10-07 11:33:27.383249] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.937 [2024-10-07 11:33:27.383280] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.937 [2024-10-07 11:33:27.383297] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.937 [2024-10-07 11:33:27.383551] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.937 [2024-10-07 11:33:27.383639] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.937 [2024-10-07 11:33:27.383694] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.937 [2024-10-07 11:33:27.383711] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.937 [2024-10-07 11:33:27.383725] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.937 [2024-10-07 11:33:27.383748] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.937 [2024-10-07 11:33:27.383805] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.937 [2024-10-07 11:33:27.383830] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.937 [2024-10-07 11:33:27.383846] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.938 [2024-10-07 11:33:27.383870] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.938 [2024-10-07 11:33:27.383892] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.938 [2024-10-07 11:33:27.383922] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.938 [2024-10-07 11:33:27.383936] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.938 [2024-10-07 11:33:27.383959] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.938 [2024-10-07 11:33:27.396115] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.938 [2024-10-07 11:33:27.396165] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.938 [2024-10-07 11:33:27.396383] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.938 [2024-10-07 11:33:27.396416] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.938 [2024-10-07 11:33:27.396433] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.938 [2024-10-07 11:33:27.396484] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.938 [2024-10-07 11:33:27.396507] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.938 [2024-10-07 11:33:27.396522] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.938 [2024-10-07 11:33:27.396625] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.938 [2024-10-07 11:33:27.396665] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.938 [2024-10-07 11:33:27.396768] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.938 [2024-10-07 11:33:27.396788] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.938 [2024-10-07 11:33:27.396802] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.938 [2024-10-07 11:33:27.396818] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.938 [2024-10-07 11:33:27.396832] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.938 [2024-10-07 11:33:27.396846] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.938 [2024-10-07 11:33:27.396960] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.938 [2024-10-07 11:33:27.396982] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.938 [2024-10-07 11:33:27.406228] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.938 [2024-10-07 11:33:27.406292] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.938 [2024-10-07 11:33:27.406369] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.938 [2024-10-07 11:33:27.406398] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.938 [2024-10-07 11:33:27.406415] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.938 [2024-10-07 11:33:27.406468] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.938 [2024-10-07 11:33:27.406492] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.938 [2024-10-07 11:33:27.406507] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.938 [2024-10-07 11:33:27.406524] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.938 [2024-10-07 11:33:27.406547] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.938 [2024-10-07 11:33:27.406579] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.938 [2024-10-07 11:33:27.406594] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.938 [2024-10-07 11:33:27.406607] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.938 [2024-10-07 11:33:27.407079] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.938 [2024-10-07 11:33:27.407107] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.938 [2024-10-07 11:33:27.407121] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.938 [2024-10-07 11:33:27.407134] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.938 [2024-10-07 11:33:27.407301] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.938 [2024-10-07 11:33:27.416577] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.938 [2024-10-07 11:33:27.416625] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.938 [2024-10-07 11:33:27.416725] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.938 [2024-10-07 11:33:27.416755] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.938 [2024-10-07 11:33:27.416771] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.938 [2024-10-07 11:33:27.416818] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.938 [2024-10-07 11:33:27.416841] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.938 [2024-10-07 11:33:27.416855] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.938 [2024-10-07 11:33:27.416878] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.938 [2024-10-07 11:33:27.416898] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.938 [2024-10-07 11:33:27.416917] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.938 [2024-10-07 11:33:27.416933] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.938 [2024-10-07 11:33:27.416946] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.938 [2024-10-07 11:33:27.416962] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.938 [2024-10-07 11:33:27.416976] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.938 [2024-10-07 11:33:27.416988] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.938 [2024-10-07 11:33:27.417011] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.938 [2024-10-07 11:33:27.417025] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.938 [2024-10-07 11:33:27.427049] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.938 [2024-10-07 11:33:27.427098] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.938 [2024-10-07 11:33:27.427339] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.938 [2024-10-07 11:33:27.427372] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.938 [2024-10-07 11:33:27.427406] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.938 [2024-10-07 11:33:27.427457] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.938 [2024-10-07 11:33:27.427481] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.938 [2024-10-07 11:33:27.427496] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.938 [2024-10-07 11:33:27.427619] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.938 [2024-10-07 11:33:27.427665] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.938 [2024-10-07 11:33:27.427771] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.938 [2024-10-07 11:33:27.427791] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.938 [2024-10-07 11:33:27.427805] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.938 [2024-10-07 11:33:27.427822] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.938 [2024-10-07 11:33:27.427836] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.938 [2024-10-07 11:33:27.427849] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.938 [2024-10-07 11:33:27.428210] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.938 [2024-10-07 11:33:27.428236] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.938 [2024-10-07 11:33:27.437159] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.938 [2024-10-07 11:33:27.437222] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.938 [2024-10-07 11:33:27.437298] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.938 [2024-10-07 11:33:27.437329] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.938 [2024-10-07 11:33:27.437345] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.938 [2024-10-07 11:33:27.437398] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.939 [2024-10-07 11:33:27.437422] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.939 [2024-10-07 11:33:27.437437] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.939 [2024-10-07 11:33:27.437454] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.939 [2024-10-07 11:33:27.437477] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.939 [2024-10-07 11:33:27.437494] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.939 [2024-10-07 11:33:27.437508] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.939 [2024-10-07 11:33:27.437521] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.939 [2024-10-07 11:33:27.437544] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.939 [2024-10-07 11:33:27.437558] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.939 [2024-10-07 11:33:27.437571] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.939 [2024-10-07 11:33:27.437598] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.939 [2024-10-07 11:33:27.437621] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.939 [2024-10-07 11:33:27.449669] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.939 [2024-10-07 11:33:27.449713] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.939 [2024-10-07 11:33:27.450121] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.939 [2024-10-07 11:33:27.450164] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.939 [2024-10-07 11:33:27.450184] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.939 [2024-10-07 11:33:27.450234] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.939 [2024-10-07 11:33:27.450258] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.939 [2024-10-07 11:33:27.450277] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.939 [2024-10-07 11:33:27.450349] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.939 [2024-10-07 11:33:27.450375] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.939 [2024-10-07 11:33:27.450412] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.939 [2024-10-07 11:33:27.450431] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.939 [2024-10-07 11:33:27.450444] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.939 [2024-10-07 11:33:27.450460] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.939 [2024-10-07 11:33:27.450474] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.939 [2024-10-07 11:33:27.450487] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.939 [2024-10-07 11:33:27.450509] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.939 [2024-10-07 11:33:27.450524] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.939 [2024-10-07 11:33:27.462024] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.939 [2024-10-07 11:33:27.462073] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.939 [2024-10-07 11:33:27.462187] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.939 [2024-10-07 11:33:27.462218] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.939 [2024-10-07 11:33:27.462234] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.939 [2024-10-07 11:33:27.462281] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.939 [2024-10-07 11:33:27.462304] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.939 [2024-10-07 11:33:27.462318] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.939 [2024-10-07 11:33:27.462800] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.939 [2024-10-07 11:33:27.462841] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.939 [2024-10-07 11:33:27.463077] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.939 [2024-10-07 11:33:27.463115] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.939 [2024-10-07 11:33:27.463132] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.939 [2024-10-07 11:33:27.463150] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.939 [2024-10-07 11:33:27.463163] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.939 [2024-10-07 11:33:27.463176] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.939 [2024-10-07 11:33:27.463246] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.939 [2024-10-07 11:33:27.463267] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.939 [2024-10-07 11:33:27.472476] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.939 [2024-10-07 11:33:27.472523] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.939 [2024-10-07 11:33:27.472608] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.939 [2024-10-07 11:33:27.472637] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.939 [2024-10-07 11:33:27.472668] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.939 [2024-10-07 11:33:27.472719] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.939 [2024-10-07 11:33:27.472742] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.939 [2024-10-07 11:33:27.472758] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.939 [2024-10-07 11:33:27.472781] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.939 [2024-10-07 11:33:27.472801] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.939 [2024-10-07 11:33:27.472821] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.939 [2024-10-07 11:33:27.472835] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.939 [2024-10-07 11:33:27.472848] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.939 [2024-10-07 11:33:27.472864] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.939 [2024-10-07 11:33:27.472878] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.939 [2024-10-07 11:33:27.472890] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.939 [2024-10-07 11:33:27.472913] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.939 [2024-10-07 11:33:27.472927] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.939 [2024-10-07 11:33:27.482945] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.939 [2024-10-07 11:33:27.482994] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.939 [2024-10-07 11:33:27.483113] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.939 [2024-10-07 11:33:27.483143] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.939 [2024-10-07 11:33:27.483160] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.939 [2024-10-07 11:33:27.483241] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.939 [2024-10-07 11:33:27.483267] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.939 [2024-10-07 11:33:27.483282] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.939 [2024-10-07 11:33:27.483307] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.939 [2024-10-07 11:33:27.483333] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.939 [2024-10-07 11:33:27.483352] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.939 [2024-10-07 11:33:27.483367] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.939 [2024-10-07 11:33:27.483380] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.939 [2024-10-07 11:33:27.483396] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.939 [2024-10-07 11:33:27.483410] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.939 [2024-10-07 11:33:27.483423] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.939 [2024-10-07 11:33:27.483445] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.939 [2024-10-07 11:33:27.483460] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.939 [2024-10-07 11:33:27.495870] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.939 [2024-10-07 11:33:27.495918] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.939 [2024-10-07 11:33:27.496199] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.939 [2024-10-07 11:33:27.496241] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.939 [2024-10-07 11:33:27.496262] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.939 [2024-10-07 11:33:27.496312] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.939 [2024-10-07 11:33:27.496335] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.939 [2024-10-07 11:33:27.496351] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.939 [2024-10-07 11:33:27.496419] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.939 [2024-10-07 11:33:27.496458] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.939 [2024-10-07 11:33:27.496484] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.939 [2024-10-07 11:33:27.496498] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.940 [2024-10-07 11:33:27.496512] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.940 [2024-10-07 11:33:27.496529] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.940 [2024-10-07 11:33:27.496543] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.940 [2024-10-07 11:33:27.496556] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.940 [2024-10-07 11:33:27.496578] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.940 [2024-10-07 11:33:27.496606] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.940 [2024-10-07 11:33:27.510107] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.940 [2024-10-07 11:33:27.510156] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.940 [2024-10-07 11:33:27.510514] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.940 [2024-10-07 11:33:27.510557] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.940 [2024-10-07 11:33:27.510576] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.940 [2024-10-07 11:33:27.510626] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.940 [2024-10-07 11:33:27.510664] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.940 [2024-10-07 11:33:27.510682] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.940 [2024-10-07 11:33:27.510806] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.940 [2024-10-07 11:33:27.510835] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.940 [2024-10-07 11:33:27.510856] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.940 [2024-10-07 11:33:27.510872] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.940 [2024-10-07 11:33:27.510885] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.940 [2024-10-07 11:33:27.510902] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.940 [2024-10-07 11:33:27.510916] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.940 [2024-10-07 11:33:27.510928] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.940 [2024-10-07 11:33:27.510951] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.940 [2024-10-07 11:33:27.510965] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.940 [2024-10-07 11:33:27.523502] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.940 [2024-10-07 11:33:27.523557] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.940 [2024-10-07 11:33:27.523740] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.940 [2024-10-07 11:33:27.523772] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.940 [2024-10-07 11:33:27.523789] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.940 [2024-10-07 11:33:27.523839] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.940 [2024-10-07 11:33:27.523868] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.940 [2024-10-07 11:33:27.523883] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.940 [2024-10-07 11:33:27.524048] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.940 [2024-10-07 11:33:27.524078] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.940 [2024-10-07 11:33:27.524129] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.940 [2024-10-07 11:33:27.524167] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.940 [2024-10-07 11:33:27.524183] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.940 [2024-10-07 11:33:27.524199] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.940 [2024-10-07 11:33:27.524214] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.940 [2024-10-07 11:33:27.524227] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.940 [2024-10-07 11:33:27.524250] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.940 [2024-10-07 11:33:27.524264] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.940 [2024-10-07 11:33:27.536874] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.940 [2024-10-07 11:33:27.536924] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.940 [2024-10-07 11:33:27.537030] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.940 [2024-10-07 11:33:27.537061] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.940 [2024-10-07 11:33:27.537078] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.940 [2024-10-07 11:33:27.537126] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.940 [2024-10-07 11:33:27.537149] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.940 [2024-10-07 11:33:27.537164] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.940 [2024-10-07 11:33:27.537484] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.940 [2024-10-07 11:33:27.537515] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.940 [2024-10-07 11:33:27.537663] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.940 [2024-10-07 11:33:27.537687] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.940 [2024-10-07 11:33:27.537701] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.940 [2024-10-07 11:33:27.537718] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.940 [2024-10-07 11:33:27.537732] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.940 [2024-10-07 11:33:27.537745] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.940 [2024-10-07 11:33:27.537854] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.940 [2024-10-07 11:33:27.537878] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.940 [2024-10-07 11:33:27.547126] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.940 [2024-10-07 11:33:27.547174] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.940 [2024-10-07 11:33:27.547271] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.940 [2024-10-07 11:33:27.547300] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.940 [2024-10-07 11:33:27.547316] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.940 [2024-10-07 11:33:27.547363] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.940 [2024-10-07 11:33:27.547402] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.940 [2024-10-07 11:33:27.547419] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.940 [2024-10-07 11:33:27.547443] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.940 [2024-10-07 11:33:27.547462] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.940 [2024-10-07 11:33:27.547481] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.940 [2024-10-07 11:33:27.547495] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.940 [2024-10-07 11:33:27.547509] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.940 [2024-10-07 11:33:27.547525] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.940 [2024-10-07 11:33:27.547539] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.940 [2024-10-07 11:33:27.547551] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.940 [2024-10-07 11:33:27.547573] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.940 [2024-10-07 11:33:27.547588] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.940 [2024-10-07 11:33:27.557963] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.940 [2024-10-07 11:33:27.558010] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.940 [2024-10-07 11:33:27.558095] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.940 [2024-10-07 11:33:27.558124] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.940 [2024-10-07 11:33:27.558141] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.940 [2024-10-07 11:33:27.558187] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.940 [2024-10-07 11:33:27.558210] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.940 [2024-10-07 11:33:27.558225] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.940 [2024-10-07 11:33:27.558262] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.940 [2024-10-07 11:33:27.558286] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.940 [2024-10-07 11:33:27.558305] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.940 [2024-10-07 11:33:27.558320] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.940 [2024-10-07 11:33:27.558333] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.940 [2024-10-07 11:33:27.558349] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.940 [2024-10-07 11:33:27.558362] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.940 [2024-10-07 11:33:27.558375] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.940 [2024-10-07 11:33:27.558397] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.940 [2024-10-07 11:33:27.558411] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.940 [2024-10-07 11:33:27.568077] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.941 [2024-10-07 11:33:27.568298] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.941 [2024-10-07 11:33:27.568391] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.941 [2024-10-07 11:33:27.568420] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.941 [2024-10-07 11:33:27.568437] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.941 [2024-10-07 11:33:27.568523] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.941 [2024-10-07 11:33:27.568551] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.941 [2024-10-07 11:33:27.568566] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.941 [2024-10-07 11:33:27.568585] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.941 [2024-10-07 11:33:27.568624] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.941 [2024-10-07 11:33:27.568660] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.941 [2024-10-07 11:33:27.568676] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.941 [2024-10-07 11:33:27.568690] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.941 [2024-10-07 11:33:27.568714] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.941 [2024-10-07 11:33:27.568729] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.941 [2024-10-07 11:33:27.568742] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.941 [2024-10-07 11:33:27.568755] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.941 [2024-10-07 11:33:27.568775] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.941 [2024-10-07 11:33:27.578857] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.941 [2024-10-07 11:33:27.578905] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.941 [2024-10-07 11:33:27.578990] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.941 [2024-10-07 11:33:27.579019] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.941 [2024-10-07 11:33:27.579035] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.941 [2024-10-07 11:33:27.579087] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.941 [2024-10-07 11:33:27.579110] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.941 [2024-10-07 11:33:27.579125] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.941 [2024-10-07 11:33:27.579148] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.941 [2024-10-07 11:33:27.579167] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.941 [2024-10-07 11:33:27.579200] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.941 [2024-10-07 11:33:27.579217] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.941 [2024-10-07 11:33:27.579247] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.941 [2024-10-07 11:33:27.579265] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.941 [2024-10-07 11:33:27.579279] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.941 [2024-10-07 11:33:27.579292] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.941 [2024-10-07 11:33:27.579470] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.941 [2024-10-07 11:33:27.579496] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.941 [2024-10-07 11:33:27.592895] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.941 [2024-10-07 11:33:27.592944] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.941 [2024-10-07 11:33:27.593030] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.941 [2024-10-07 11:33:27.593060] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.941 [2024-10-07 11:33:27.593076] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.941 [2024-10-07 11:33:27.593124] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.941 [2024-10-07 11:33:27.593146] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.941 [2024-10-07 11:33:27.593161] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.941 [2024-10-07 11:33:27.593184] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.941 [2024-10-07 11:33:27.593204] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.941 [2024-10-07 11:33:27.593224] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.941 [2024-10-07 11:33:27.593238] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.941 [2024-10-07 11:33:27.593252] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.941 [2024-10-07 11:33:27.593268] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.941 [2024-10-07 11:33:27.593282] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.941 [2024-10-07 11:33:27.593295] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.941 [2024-10-07 11:33:27.593317] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.941 [2024-10-07 11:33:27.593331] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.941 [2024-10-07 11:33:27.606719] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.941 [2024-10-07 11:33:27.606768] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.941 [2024-10-07 11:33:27.607134] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.941 [2024-10-07 11:33:27.607178] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.941 [2024-10-07 11:33:27.607208] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.941 [2024-10-07 11:33:27.607260] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.941 [2024-10-07 11:33:27.607284] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.941 [2024-10-07 11:33:27.607314] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.941 [2024-10-07 11:33:27.607522] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.941 [2024-10-07 11:33:27.607553] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.941 [2024-10-07 11:33:27.607609] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.941 [2024-10-07 11:33:27.607630] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.941 [2024-10-07 11:33:27.607644] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.941 [2024-10-07 11:33:27.607678] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.941 [2024-10-07 11:33:27.607693] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.941 [2024-10-07 11:33:27.607706] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.941 [2024-10-07 11:33:27.607730] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.941 [2024-10-07 11:33:27.607745] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.941 [2024-10-07 11:33:27.617569] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.941 [2024-10-07 11:33:27.617618] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.941 [2024-10-07 11:33:27.617801] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.941 [2024-10-07 11:33:27.617833] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.941 [2024-10-07 11:33:27.617850] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.941 [2024-10-07 11:33:27.617896] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.941 [2024-10-07 11:33:27.617920] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.941 [2024-10-07 11:33:27.617934] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.941 [2024-10-07 11:33:27.618037] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.941 [2024-10-07 11:33:27.618065] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.941 [2024-10-07 11:33:27.618394] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.941 [2024-10-07 11:33:27.618431] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.941 [2024-10-07 11:33:27.618448] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.941 [2024-10-07 11:33:27.618465] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.941 [2024-10-07 11:33:27.618480] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.941 [2024-10-07 11:33:27.618492] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.941 [2024-10-07 11:33:27.618561] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.941 [2024-10-07 11:33:27.618581] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.941 [2024-10-07 11:33:27.630962] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.941 [2024-10-07 11:33:27.631032] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.941 [2024-10-07 11:33:27.631118] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.941 [2024-10-07 11:33:27.631147] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.941 [2024-10-07 11:33:27.631163] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.941 [2024-10-07 11:33:27.631224] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.941 [2024-10-07 11:33:27.631249] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.942 [2024-10-07 11:33:27.631264] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.942 [2024-10-07 11:33:27.631288] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.942 [2024-10-07 11:33:27.631308] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.942 [2024-10-07 11:33:27.631327] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.942 [2024-10-07 11:33:27.631342] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.942 [2024-10-07 11:33:27.631355] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.942 [2024-10-07 11:33:27.631371] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.942 [2024-10-07 11:33:27.631385] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.942 [2024-10-07 11:33:27.631397] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.942 [2024-10-07 11:33:27.631420] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.942 [2024-10-07 11:33:27.631434] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.942 [2024-10-07 11:33:27.641268] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.942 [2024-10-07 11:33:27.641318] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.942 [2024-10-07 11:33:27.641482] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.942 [2024-10-07 11:33:27.641513] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.942 [2024-10-07 11:33:27.641530] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.942 [2024-10-07 11:33:27.641578] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.942 [2024-10-07 11:33:27.641608] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.942 [2024-10-07 11:33:27.641623] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.942 [2024-10-07 11:33:27.642351] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.942 [2024-10-07 11:33:27.642393] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.942 [2024-10-07 11:33:27.645290] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.942 [2024-10-07 11:33:27.645330] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.942 [2024-10-07 11:33:27.645348] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.942 [2024-10-07 11:33:27.645380] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.942 [2024-10-07 11:33:27.645396] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.942 [2024-10-07 11:33:27.645409] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.942 [2024-10-07 11:33:27.645866] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.942 [2024-10-07 11:33:27.645896] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.942 [2024-10-07 11:33:27.651515] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.942 [2024-10-07 11:33:27.651562] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.942 [2024-10-07 11:33:27.651663] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.942 [2024-10-07 11:33:27.651694] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.942 [2024-10-07 11:33:27.651710] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.942 [2024-10-07 11:33:27.651760] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.942 [2024-10-07 11:33:27.651784] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.942 [2024-10-07 11:33:27.651799] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.942 [2024-10-07 11:33:27.651822] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.942 [2024-10-07 11:33:27.651842] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.942 [2024-10-07 11:33:27.651862] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.942 [2024-10-07 11:33:27.651876] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.942 [2024-10-07 11:33:27.651889] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.942 [2024-10-07 11:33:27.651905] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.942 [2024-10-07 11:33:27.651919] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.942 [2024-10-07 11:33:27.651932] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.942 [2024-10-07 11:33:27.651954] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.942 [2024-10-07 11:33:27.651968] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.942 [2024-10-07 11:33:27.661788] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.942 [2024-10-07 11:33:27.661836] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.942 [2024-10-07 11:33:27.661920] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.942 [2024-10-07 11:33:27.661949] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.942 [2024-10-07 11:33:27.661966] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.942 [2024-10-07 11:33:27.662013] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.942 [2024-10-07 11:33:27.662036] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.942 [2024-10-07 11:33:27.662051] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.942 [2024-10-07 11:33:27.662094] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.942 [2024-10-07 11:33:27.662114] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.942 [2024-10-07 11:33:27.662134] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.942 [2024-10-07 11:33:27.662150] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.942 [2024-10-07 11:33:27.662164] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.942 [2024-10-07 11:33:27.662180] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.942 [2024-10-07 11:33:27.662194] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.942 [2024-10-07 11:33:27.662206] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.942 [2024-10-07 11:33:27.662228] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.942 [2024-10-07 11:33:27.662242] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.942 [2024-10-07 11:33:27.672821] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.942 [2024-10-07 11:33:27.672869] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.942 [2024-10-07 11:33:27.672954] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.942 [2024-10-07 11:33:27.672983] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.942 [2024-10-07 11:33:27.672999] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.942 [2024-10-07 11:33:27.673048] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.942 [2024-10-07 11:33:27.673071] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.942 [2024-10-07 11:33:27.673086] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.942 [2024-10-07 11:33:27.675264] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.942 [2024-10-07 11:33:27.675311] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.942 [2024-10-07 11:33:27.675446] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.942 [2024-10-07 11:33:27.675472] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.942 [2024-10-07 11:33:27.675486] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.942 [2024-10-07 11:33:27.675503] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.942 [2024-10-07 11:33:27.675517] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.942 [2024-10-07 11:33:27.675530] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.942 [2024-10-07 11:33:27.675708] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.942 [2024-10-07 11:33:27.675735] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.942 [2024-10-07 11:33:27.682949] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.942 [2024-10-07 11:33:27.682995] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.942 [2024-10-07 11:33:27.683097] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.942 [2024-10-07 11:33:27.683126] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.943 [2024-10-07 11:33:27.683143] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.943 [2024-10-07 11:33:27.683203] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.943 [2024-10-07 11:33:27.683228] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.943 [2024-10-07 11:33:27.683243] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.943 [2024-10-07 11:33:27.683421] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.943 [2024-10-07 11:33:27.683450] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.943 [2024-10-07 11:33:27.683508] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.943 [2024-10-07 11:33:27.683530] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.943 [2024-10-07 11:33:27.683544] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.943 [2024-10-07 11:33:27.683560] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.943 [2024-10-07 11:33:27.683575] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.943 [2024-10-07 11:33:27.683587] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.943 [2024-10-07 11:33:27.683609] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.943 [2024-10-07 11:33:27.683623] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.943 [2024-10-07 11:33:27.696324] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.943 [2024-10-07 11:33:27.696372] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.943 [2024-10-07 11:33:27.696458] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.943 [2024-10-07 11:33:27.696487] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.943 [2024-10-07 11:33:27.696504] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.943 [2024-10-07 11:33:27.696551] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.943 [2024-10-07 11:33:27.696574] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.943 [2024-10-07 11:33:27.696589] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.943 [2024-10-07 11:33:27.696612] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.943 [2024-10-07 11:33:27.696631] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.943 [2024-10-07 11:33:27.696664] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.943 [2024-10-07 11:33:27.696682] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.943 [2024-10-07 11:33:27.696696] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.943 [2024-10-07 11:33:27.696712] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.943 [2024-10-07 11:33:27.696739] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.943 [2024-10-07 11:33:27.696753] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.943 [2024-10-07 11:33:27.696777] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.943 [2024-10-07 11:33:27.696792] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.943 [2024-10-07 11:33:27.710479] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.943 [2024-10-07 11:33:27.710529] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.943 [2024-10-07 11:33:27.711842] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.943 [2024-10-07 11:33:27.711888] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.943 [2024-10-07 11:33:27.711909] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.943 [2024-10-07 11:33:27.711959] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.943 [2024-10-07 11:33:27.711982] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.943 [2024-10-07 11:33:27.711997] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.943 [2024-10-07 11:33:27.712585] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.943 [2024-10-07 11:33:27.712628] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.943 [2024-10-07 11:33:27.712876] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.943 [2024-10-07 11:33:27.712912] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.943 [2024-10-07 11:33:27.712929] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.943 [2024-10-07 11:33:27.712947] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.943 [2024-10-07 11:33:27.712962] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.943 [2024-10-07 11:33:27.712974] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.943 [2024-10-07 11:33:27.713176] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.943 [2024-10-07 11:33:27.713200] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.943 [2024-10-07 11:33:27.720875] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.943 [2024-10-07 11:33:27.720928] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.943 [2024-10-07 11:33:27.721093] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.943 [2024-10-07 11:33:27.721123] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.943 [2024-10-07 11:33:27.721139] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.943 [2024-10-07 11:33:27.721186] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.943 [2024-10-07 11:33:27.721208] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.943 [2024-10-07 11:33:27.721223] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.943 [2024-10-07 11:33:27.721351] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.943 [2024-10-07 11:33:27.721378] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.943 [2024-10-07 11:33:27.722070] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.943 [2024-10-07 11:33:27.722109] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.943 [2024-10-07 11:33:27.722126] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.943 [2024-10-07 11:33:27.722143] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.943 [2024-10-07 11:33:27.722158] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.943 [2024-10-07 11:33:27.722171] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.943 [2024-10-07 11:33:27.725620] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.943 [2024-10-07 11:33:27.725671] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.943 [2024-10-07 11:33:27.731110] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.943 [2024-10-07 11:33:27.731156] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.943 [2024-10-07 11:33:27.731272] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.943 [2024-10-07 11:33:27.731313] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.943 [2024-10-07 11:33:27.731333] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.943 [2024-10-07 11:33:27.731385] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.943 [2024-10-07 11:33:27.731409] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.943 [2024-10-07 11:33:27.731425] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.943 [2024-10-07 11:33:27.731449] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.943 [2024-10-07 11:33:27.731469] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.943 [2024-10-07 11:33:27.731489] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.943 [2024-10-07 11:33:27.731504] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.943 [2024-10-07 11:33:27.731517] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.943 [2024-10-07 11:33:27.731533] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.943 [2024-10-07 11:33:27.731552] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.943 [2024-10-07 11:33:27.731565] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.943 [2024-10-07 11:33:27.731587] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.943 [2024-10-07 11:33:27.731601] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.943 [2024-10-07 11:33:27.743715] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.943 [2024-10-07 11:33:27.743763] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.943 [2024-10-07 11:33:27.744064] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.943 [2024-10-07 11:33:27.744121] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.943 [2024-10-07 11:33:27.744142] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.943 [2024-10-07 11:33:27.744194] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.943 [2024-10-07 11:33:27.744218] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.944 [2024-10-07 11:33:27.744233] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.944 [2024-10-07 11:33:27.744438] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.944 [2024-10-07 11:33:27.744469] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.944 [2024-10-07 11:33:27.744539] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.944 [2024-10-07 11:33:27.744563] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.944 [2024-10-07 11:33:27.744578] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.944 [2024-10-07 11:33:27.744595] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.944 [2024-10-07 11:33:27.744609] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.944 [2024-10-07 11:33:27.744621] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.944 [2024-10-07 11:33:27.744644] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.944 [2024-10-07 11:33:27.744676] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.944 [2024-10-07 11:33:27.755491] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.944 [2024-10-07 11:33:27.755540] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.944 [2024-10-07 11:33:27.755781] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.944 [2024-10-07 11:33:27.755814] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.944 [2024-10-07 11:33:27.755832] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.944 [2024-10-07 11:33:27.755880] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.944 [2024-10-07 11:33:27.755903] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.944 [2024-10-07 11:33:27.755918] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.944 [2024-10-07 11:33:27.756047] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.944 [2024-10-07 11:33:27.756076] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.944 [2024-10-07 11:33:27.756183] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.944 [2024-10-07 11:33:27.756204] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.944 [2024-10-07 11:33:27.756218] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.944 [2024-10-07 11:33:27.756235] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.944 [2024-10-07 11:33:27.756250] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.944 [2024-10-07 11:33:27.756278] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.944 [2024-10-07 11:33:27.756394] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.944 [2024-10-07 11:33:27.756415] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.944 [2024-10-07 11:33:27.766507] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.944 [2024-10-07 11:33:27.766562] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.944 [2024-10-07 11:33:27.766659] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.944 [2024-10-07 11:33:27.766689] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.944 [2024-10-07 11:33:27.766705] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.944 [2024-10-07 11:33:27.766755] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.944 [2024-10-07 11:33:27.766778] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.944 [2024-10-07 11:33:27.766794] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.944 [2024-10-07 11:33:27.769310] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.944 [2024-10-07 11:33:27.769355] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.944 [2024-10-07 11:33:27.769645] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.944 [2024-10-07 11:33:27.769696] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.944 [2024-10-07 11:33:27.769713] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.944 [2024-10-07 11:33:27.769731] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.944 [2024-10-07 11:33:27.769745] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.944 [2024-10-07 11:33:27.769758] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.944 [2024-10-07 11:33:27.769905] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.944 [2024-10-07 11:33:27.769928] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.944 [2024-10-07 11:33:27.777595] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.944 [2024-10-07 11:33:27.777642] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.944 [2024-10-07 11:33:27.777803] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.944 [2024-10-07 11:33:27.777834] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.944 [2024-10-07 11:33:27.777850] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.944 [2024-10-07 11:33:27.777897] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.944 [2024-10-07 11:33:27.777920] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.944 [2024-10-07 11:33:27.777935] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.944 [2024-10-07 11:33:27.777958] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.944 [2024-10-07 11:33:27.778006] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.944 [2024-10-07 11:33:27.778027] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.944 [2024-10-07 11:33:27.778042] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.944 [2024-10-07 11:33:27.778055] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.944 [2024-10-07 11:33:27.778072] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.944 [2024-10-07 11:33:27.778086] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.944 [2024-10-07 11:33:27.778099] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.944 [2024-10-07 11:33:27.778121] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.944 [2024-10-07 11:33:27.778135] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.944 [2024-10-07 11:33:27.787718] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.944 [2024-10-07 11:33:27.787781] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.944 [2024-10-07 11:33:27.787856] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.944 [2024-10-07 11:33:27.787884] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.944 [2024-10-07 11:33:27.787900] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.944 [2024-10-07 11:33:27.788094] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.944 [2024-10-07 11:33:27.788126] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.944 [2024-10-07 11:33:27.788153] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.944 [2024-10-07 11:33:27.788175] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.944 [2024-10-07 11:33:27.788299] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.944 [2024-10-07 11:33:27.788325] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.944 [2024-10-07 11:33:27.788339] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.944 [2024-10-07 11:33:27.788352] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.944 [2024-10-07 11:33:27.788498] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.944 [2024-10-07 11:33:27.788522] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.944 [2024-10-07 11:33:27.788536] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.944 [2024-10-07 11:33:27.788550] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.944 [2024-10-07 11:33:27.788600] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.944 [2024-10-07 11:33:27.798027] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.944 [2024-10-07 11:33:27.798172] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.944 [2024-10-07 11:33:27.798251] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.944 [2024-10-07 11:33:27.798280] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.944 [2024-10-07 11:33:27.798312] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.944 [2024-10-07 11:33:27.798591] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.944 [2024-10-07 11:33:27.798633] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.944 [2024-10-07 11:33:27.798664] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.944 [2024-10-07 11:33:27.798685] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.944 [2024-10-07 11:33:27.798743] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.944 [2024-10-07 11:33:27.798767] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.944 [2024-10-07 11:33:27.798782] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.944 [2024-10-07 11:33:27.798795] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.944 [2024-10-07 11:33:27.798819] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.944 [2024-10-07 11:33:27.798834] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.945 [2024-10-07 11:33:27.798847] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.945 [2024-10-07 11:33:27.798859] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.945 [2024-10-07 11:33:27.798879] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.945 [2024-10-07 11:33:27.808108] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.945 [2024-10-07 11:33:27.808214] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.945 [2024-10-07 11:33:27.808244] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.945 [2024-10-07 11:33:27.808260] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.945 [2024-10-07 11:33:27.808284] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.945 [2024-10-07 11:33:27.808319] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.945 [2024-10-07 11:33:27.808338] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.945 [2024-10-07 11:33:27.808351] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.945 [2024-10-07 11:33:27.808375] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.945 [2024-10-07 11:33:27.808393] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.945 [2024-10-07 11:33:27.808456] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.945 [2024-10-07 11:33:27.808482] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.945 [2024-10-07 11:33:27.808497] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.945 [2024-10-07 11:33:27.808524] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.945 [2024-10-07 11:33:27.808585] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.945 [2024-10-07 11:33:27.808605] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.945 [2024-10-07 11:33:27.808633] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.945 [2024-10-07 11:33:27.808671] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.945 [2024-10-07 11:33:27.820444] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.945 [2024-10-07 11:33:27.820493] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.945 [2024-10-07 11:33:27.820579] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.945 [2024-10-07 11:33:27.820607] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.945 [2024-10-07 11:33:27.820624] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.945 [2024-10-07 11:33:27.820685] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.945 [2024-10-07 11:33:27.820710] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.945 [2024-10-07 11:33:27.820725] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.945 [2024-10-07 11:33:27.820748] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.945 [2024-10-07 11:33:27.820768] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.945 [2024-10-07 11:33:27.820803] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.945 [2024-10-07 11:33:27.820821] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.945 [2024-10-07 11:33:27.820834] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.945 [2024-10-07 11:33:27.820850] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.945 [2024-10-07 11:33:27.820865] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.945 [2024-10-07 11:33:27.820877] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.945 [2024-10-07 11:33:27.820900] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.945 [2024-10-07 11:33:27.820914] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.945 [2024-10-07 11:33:27.834108] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.945 [2024-10-07 11:33:27.834157] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.945 [2024-10-07 11:33:27.834483] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.945 [2024-10-07 11:33:27.834526] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.945 [2024-10-07 11:33:27.834546] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.945 [2024-10-07 11:33:27.834596] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.945 [2024-10-07 11:33:27.834620] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.945 [2024-10-07 11:33:27.834635] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.945 [2024-10-07 11:33:27.834704] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.945 [2024-10-07 11:33:27.834731] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.945 [2024-10-07 11:33:27.834771] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.945 [2024-10-07 11:33:27.834787] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.945 [2024-10-07 11:33:27.834800] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.945 [2024-10-07 11:33:27.834817] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.945 [2024-10-07 11:33:27.834832] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.945 [2024-10-07 11:33:27.834844] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.945 [2024-10-07 11:33:27.834867] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.945 [2024-10-07 11:33:27.834881] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.945 [2024-10-07 11:33:27.848134] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.945 [2024-10-07 11:33:27.848182] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.945 [2024-10-07 11:33:27.848268] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.945 [2024-10-07 11:33:27.848297] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.945 [2024-10-07 11:33:27.848314] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.945 [2024-10-07 11:33:27.848359] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.945 [2024-10-07 11:33:27.848382] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.945 [2024-10-07 11:33:27.848397] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.945 [2024-10-07 11:33:27.848419] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.945 [2024-10-07 11:33:27.848439] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.945 [2024-10-07 11:33:27.848459] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.945 [2024-10-07 11:33:27.848473] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.945 [2024-10-07 11:33:27.848487] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.945 [2024-10-07 11:33:27.848502] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.945 [2024-10-07 11:33:27.848516] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.945 [2024-10-07 11:33:27.848529] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.945 [2024-10-07 11:33:27.848553] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.945 [2024-10-07 11:33:27.848568] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.945 [2024-10-07 11:33:27.862203] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.945 [2024-10-07 11:33:27.862250] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.945 [2024-10-07 11:33:27.862334] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.945 [2024-10-07 11:33:27.862362] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.945 [2024-10-07 11:33:27.862379] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.945 [2024-10-07 11:33:27.862442] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.945 [2024-10-07 11:33:27.862466] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.945 [2024-10-07 11:33:27.862481] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.945 [2024-10-07 11:33:27.862505] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.945 [2024-10-07 11:33:27.862524] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.945 [2024-10-07 11:33:27.862544] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.945 [2024-10-07 11:33:27.862558] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.945 [2024-10-07 11:33:27.862571] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.945 [2024-10-07 11:33:27.862587] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.945 [2024-10-07 11:33:27.862602] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.945 [2024-10-07 11:33:27.862614] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.945 [2024-10-07 11:33:27.862636] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.945 [2024-10-07 11:33:27.862664] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.945 [2024-10-07 11:33:27.876500] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.945 [2024-10-07 11:33:27.876547] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.945 [2024-10-07 11:33:27.876632] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.945 [2024-10-07 11:33:27.876675] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.946 [2024-10-07 11:33:27.876694] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.946 [2024-10-07 11:33:27.876742] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.946 [2024-10-07 11:33:27.876765] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.946 [2024-10-07 11:33:27.876780] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.946 [2024-10-07 11:33:27.876803] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.946 [2024-10-07 11:33:27.876823] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.946 [2024-10-07 11:33:27.876842] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.946 [2024-10-07 11:33:27.876856] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.946 [2024-10-07 11:33:27.876870] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.946 [2024-10-07 11:33:27.876886] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.946 [2024-10-07 11:33:27.876900] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.946 [2024-10-07 11:33:27.876912] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.946 [2024-10-07 11:33:27.876952] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.946 [2024-10-07 11:33:27.876968] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.946 [2024-10-07 11:33:27.889150] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.946 [2024-10-07 11:33:27.889201] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.946 [2024-10-07 11:33:27.889292] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.946 [2024-10-07 11:33:27.889321] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.946 [2024-10-07 11:33:27.889336] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.946 [2024-10-07 11:33:27.889384] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.946 [2024-10-07 11:33:27.889407] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.946 [2024-10-07 11:33:27.889422] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.946 [2024-10-07 11:33:27.889444] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.946 [2024-10-07 11:33:27.889464] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.946 [2024-10-07 11:33:27.889484] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.946 [2024-10-07 11:33:27.889498] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.946 [2024-10-07 11:33:27.889511] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.946 [2024-10-07 11:33:27.889527] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.946 [2024-10-07 11:33:27.889541] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.946 [2024-10-07 11:33:27.889553] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.946 [2024-10-07 11:33:27.889576] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.946 [2024-10-07 11:33:27.889590] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.946 [2024-10-07 11:33:27.899262] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.946 [2024-10-07 11:33:27.899328] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.946 [2024-10-07 11:33:27.899404] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.946 [2024-10-07 11:33:27.899432] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.946 [2024-10-07 11:33:27.899448] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.946 [2024-10-07 11:33:27.899503] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.946 [2024-10-07 11:33:27.899527] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.946 [2024-10-07 11:33:27.899542] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.946 [2024-10-07 11:33:27.899560] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.946 [2024-10-07 11:33:27.899583] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.946 [2024-10-07 11:33:27.899600] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.946 [2024-10-07 11:33:27.899628] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.946 [2024-10-07 11:33:27.899643] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.946 [2024-10-07 11:33:27.899682] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.946 [2024-10-07 11:33:27.899698] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.946 [2024-10-07 11:33:27.899711] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.946 [2024-10-07 11:33:27.899728] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.946 [2024-10-07 11:33:27.899751] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.946 8897.27 IOPS, 34.75 MiB/s [2024-10-07T11:33:33.469Z] [2024-10-07 11:33:27.909616] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.946 [2024-10-07 11:33:27.909675] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.946 [2024-10-07 11:33:27.909861] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.946 [2024-10-07 11:33:27.909892] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.946 [2024-10-07 11:33:27.909909] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.946 [2024-10-07 11:33:27.909958] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.946 [2024-10-07 11:33:27.909982] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.946 [2024-10-07 11:33:27.909997] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.946 [2024-10-07 11:33:27.910112] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.946 [2024-10-07 11:33:27.910138] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.946 [2024-10-07 11:33:27.910237] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.946 [2024-10-07 11:33:27.910256] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.946 [2024-10-07 11:33:27.910270] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.946 [2024-10-07 11:33:27.910287] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.946 [2024-10-07 11:33:27.910301] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.946 [2024-10-07 11:33:27.910314] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.946 [2024-10-07 11:33:27.911106] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.946 [2024-10-07 11:33:27.911140] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.946 [2024-10-07 11:33:27.920368] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.946 [2024-10-07 11:33:27.920416] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.946 [2024-10-07 11:33:27.920589] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.946 [2024-10-07 11:33:27.920619] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.946 [2024-10-07 11:33:27.920636] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.946 [2024-10-07 11:33:27.920729] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.946 [2024-10-07 11:33:27.920754] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.946 [2024-10-07 11:33:27.920770] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.946 [2024-10-07 11:33:27.920876] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.946 [2024-10-07 11:33:27.920901] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.946 [2024-10-07 11:33:27.920996] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.946 [2024-10-07 11:33:27.921015] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.946 [2024-10-07 11:33:27.921029] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.946 [2024-10-07 11:33:27.921046] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.946 [2024-10-07 11:33:27.921061] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.946 [2024-10-07 11:33:27.921073] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.946 [2024-10-07 11:33:27.921175] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.946 [2024-10-07 11:33:27.921193] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.946 [2024-10-07 11:33:27.931976] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.946 [2024-10-07 11:33:27.932025] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.946 [2024-10-07 11:33:27.932330] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.946 [2024-10-07 11:33:27.932382] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.946 [2024-10-07 11:33:27.932402] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.946 [2024-10-07 11:33:27.932452] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.946 [2024-10-07 11:33:27.932475] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.946 [2024-10-07 11:33:27.932490] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.946 [2024-10-07 11:33:27.932709] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.946 [2024-10-07 11:33:27.932741] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.946 [2024-10-07 11:33:27.932797] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.947 [2024-10-07 11:33:27.932819] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.947 [2024-10-07 11:33:27.932833] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.947 [2024-10-07 11:33:27.932850] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.947 [2024-10-07 11:33:27.932864] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.947 [2024-10-07 11:33:27.932876] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.947 [2024-10-07 11:33:27.932899] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.947 [2024-10-07 11:33:27.932928] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.947 [2024-10-07 11:33:27.944496] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.947 [2024-10-07 11:33:27.944544] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.947 [2024-10-07 11:33:27.944631] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.947 [2024-10-07 11:33:27.944677] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.947 [2024-10-07 11:33:27.944695] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.947 [2024-10-07 11:33:27.944744] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.947 [2024-10-07 11:33:27.944768] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.947 [2024-10-07 11:33:27.944783] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.947 [2024-10-07 11:33:27.944806] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.947 [2024-10-07 11:33:27.944826] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.947 [2024-10-07 11:33:27.944846] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.947 [2024-10-07 11:33:27.944860] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.947 [2024-10-07 11:33:27.944873] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.947 [2024-10-07 11:33:27.944890] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.947 [2024-10-07 11:33:27.944904] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.947 [2024-10-07 11:33:27.944916] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.947 [2024-10-07 11:33:27.944939] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.947 [2024-10-07 11:33:27.944954] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.947 [2024-10-07 11:33:27.956722] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.947 [2024-10-07 11:33:27.956772] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.947 [2024-10-07 11:33:27.956902] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.947 [2024-10-07 11:33:27.956932] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.947 [2024-10-07 11:33:27.956950] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.947 [2024-10-07 11:33:27.956997] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.947 [2024-10-07 11:33:27.957021] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.947 [2024-10-07 11:33:27.957037] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.947 [2024-10-07 11:33:27.957060] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.947 [2024-10-07 11:33:27.957080] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.947 [2024-10-07 11:33:27.957116] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.947 [2024-10-07 11:33:27.957155] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.947 [2024-10-07 11:33:27.957169] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.947 [2024-10-07 11:33:27.957186] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.947 [2024-10-07 11:33:27.957200] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.947 [2024-10-07 11:33:27.957213] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.947 [2024-10-07 11:33:27.957236] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.947 [2024-10-07 11:33:27.957251] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.947 [2024-10-07 11:33:27.970499] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.947 [2024-10-07 11:33:27.970548] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.947 [2024-10-07 11:33:27.970858] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.947 [2024-10-07 11:33:27.970900] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.947 [2024-10-07 11:33:27.970921] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.947 [2024-10-07 11:33:27.970971] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.947 [2024-10-07 11:33:27.970994] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.947 [2024-10-07 11:33:27.971010] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.947 [2024-10-07 11:33:27.971223] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.947 [2024-10-07 11:33:27.971254] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.947 [2024-10-07 11:33:27.971311] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.947 [2024-10-07 11:33:27.971332] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.947 [2024-10-07 11:33:27.971346] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.947 [2024-10-07 11:33:27.971363] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.947 [2024-10-07 11:33:27.971377] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.947 [2024-10-07 11:33:27.971390] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.947 [2024-10-07 11:33:27.971413] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.947 [2024-10-07 11:33:27.971428] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.947 [2024-10-07 11:33:27.982746] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.947 [2024-10-07 11:33:27.982793] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.947 [2024-10-07 11:33:27.982969] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.947 [2024-10-07 11:33:27.983000] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.947 [2024-10-07 11:33:27.983016] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.947 [2024-10-07 11:33:27.983064] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.947 [2024-10-07 11:33:27.983103] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.947 [2024-10-07 11:33:27.983121] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.947 [2024-10-07 11:33:27.983461] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.947 [2024-10-07 11:33:27.983503] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.947 [2024-10-07 11:33:27.984715] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.947 [2024-10-07 11:33:27.984751] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.947 [2024-10-07 11:33:27.984768] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.947 [2024-10-07 11:33:27.984785] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.947 [2024-10-07 11:33:27.984799] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.947 [2024-10-07 11:33:27.984811] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.947 [2024-10-07 11:33:27.986604] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.947 [2024-10-07 11:33:27.986641] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.947 [2024-10-07 11:33:27.993056] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.947 [2024-10-07 11:33:27.993113] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.947 [2024-10-07 11:33:27.993305] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.947 [2024-10-07 11:33:27.993336] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.947 [2024-10-07 11:33:27.993353] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.947 [2024-10-07 11:33:27.993401] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.948 [2024-10-07 11:33:27.993424] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.948 [2024-10-07 11:33:27.993439] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.948 [2024-10-07 11:33:27.993557] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.948 [2024-10-07 11:33:27.993584] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.948 [2024-10-07 11:33:27.994296] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.948 [2024-10-07 11:33:27.994332] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.948 [2024-10-07 11:33:27.994350] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.948 [2024-10-07 11:33:27.994367] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.948 [2024-10-07 11:33:27.994381] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.948 [2024-10-07 11:33:27.994393] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.948 [2024-10-07 11:33:27.994565] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.948 [2024-10-07 11:33:27.994590] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.948 [2024-10-07 11:33:28.003174] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.948 [2024-10-07 11:33:28.003244] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.948 [2024-10-07 11:33:28.003319] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.948 [2024-10-07 11:33:28.003347] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.948 [2024-10-07 11:33:28.003365] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.948 [2024-10-07 11:33:28.003418] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.948 [2024-10-07 11:33:28.003442] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.948 [2024-10-07 11:33:28.003458] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.948 [2024-10-07 11:33:28.003475] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.948 [2024-10-07 11:33:28.003498] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.948 [2024-10-07 11:33:28.003515] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.948 [2024-10-07 11:33:28.003529] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.948 [2024-10-07 11:33:28.003542] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.948 [2024-10-07 11:33:28.003565] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.948 [2024-10-07 11:33:28.003580] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.948 [2024-10-07 11:33:28.003592] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.948 [2024-10-07 11:33:28.003605] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.948 [2024-10-07 11:33:28.003625] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.948 [2024-10-07 11:33:28.013593] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.948 [2024-10-07 11:33:28.013641] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.948 [2024-10-07 11:33:28.014775] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.948 [2024-10-07 11:33:28.014817] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.948 [2024-10-07 11:33:28.014836] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.948 [2024-10-07 11:33:28.014886] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.948 [2024-10-07 11:33:28.014908] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.948 [2024-10-07 11:33:28.014924] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.948 [2024-10-07 11:33:28.015204] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.948 [2024-10-07 11:33:28.015238] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.948 [2024-10-07 11:33:28.015371] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.948 [2024-10-07 11:33:28.015396] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.948 [2024-10-07 11:33:28.015424] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.948 [2024-10-07 11:33:28.015443] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.948 [2024-10-07 11:33:28.015458] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.948 [2024-10-07 11:33:28.015470] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.948 [2024-10-07 11:33:28.015573] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.948 [2024-10-07 11:33:28.015592] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.948 [2024-10-07 11:33:28.024432] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.948 [2024-10-07 11:33:28.024481] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.948 [2024-10-07 11:33:28.024631] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.948 [2024-10-07 11:33:28.024678] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.948 [2024-10-07 11:33:28.024697] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.948 [2024-10-07 11:33:28.024747] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.948 [2024-10-07 11:33:28.024771] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.948 [2024-10-07 11:33:28.024786] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.948 [2024-10-07 11:33:28.024831] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.948 [2024-10-07 11:33:28.024860] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.948 [2024-10-07 11:33:28.024880] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.948 [2024-10-07 11:33:28.024895] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.948 [2024-10-07 11:33:28.024909] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.948 [2024-10-07 11:33:28.024925] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.948 [2024-10-07 11:33:28.024939] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.948 [2024-10-07 11:33:28.024952] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.948 [2024-10-07 11:33:28.024974] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.948 [2024-10-07 11:33:28.024988] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.948 [2024-10-07 11:33:28.035964] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.948 [2024-10-07 11:33:28.036013] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.948 [2024-10-07 11:33:28.036098] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.948 [2024-10-07 11:33:28.036127] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.948 [2024-10-07 11:33:28.036143] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.948 [2024-10-07 11:33:28.036190] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.948 [2024-10-07 11:33:28.036214] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.948 [2024-10-07 11:33:28.036245] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.948 [2024-10-07 11:33:28.036269] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.948 [2024-10-07 11:33:28.036289] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.948 [2024-10-07 11:33:28.036309] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.948 [2024-10-07 11:33:28.036323] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.948 [2024-10-07 11:33:28.036337] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.948 [2024-10-07 11:33:28.036353] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.948 [2024-10-07 11:33:28.036367] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.948 [2024-10-07 11:33:28.036380] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.948 [2024-10-07 11:33:28.036572] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.948 [2024-10-07 11:33:28.036598] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.948 [2024-10-07 11:33:28.046393] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.948 [2024-10-07 11:33:28.046441] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.948 [2024-10-07 11:33:28.046611] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.948 [2024-10-07 11:33:28.046641] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.948 [2024-10-07 11:33:28.046674] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.948 [2024-10-07 11:33:28.046725] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.948 [2024-10-07 11:33:28.046749] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.948 [2024-10-07 11:33:28.046764] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.948 [2024-10-07 11:33:28.046867] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.948 [2024-10-07 11:33:28.046891] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.948 [2024-10-07 11:33:28.047652] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.948 [2024-10-07 11:33:28.047717] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.948 [2024-10-07 11:33:28.047734] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.949 [2024-10-07 11:33:28.047752] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.949 [2024-10-07 11:33:28.047767] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.949 [2024-10-07 11:33:28.047779] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.949 [2024-10-07 11:33:28.049746] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.949 [2024-10-07 11:33:28.049782] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.949 [2024-10-07 11:33:28.057603] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.949 [2024-10-07 11:33:28.057688] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.949 [2024-10-07 11:33:28.057857] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.949 [2024-10-07 11:33:28.057887] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.949 [2024-10-07 11:33:28.057904] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.949 [2024-10-07 11:33:28.057951] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.949 [2024-10-07 11:33:28.057974] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.949 [2024-10-07 11:33:28.057989] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.949 [2024-10-07 11:33:28.058144] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.949 [2024-10-07 11:33:28.058175] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.949 [2024-10-07 11:33:28.058242] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.949 [2024-10-07 11:33:28.058265] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.949 [2024-10-07 11:33:28.058279] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.949 [2024-10-07 11:33:28.058296] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.949 [2024-10-07 11:33:28.058310] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.949 [2024-10-07 11:33:28.058323] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.949 [2024-10-07 11:33:28.058346] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.949 [2024-10-07 11:33:28.058361] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.949 [2024-10-07 11:33:28.067754] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.949 [2024-10-07 11:33:28.067816] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.949 [2024-10-07 11:33:28.067891] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.949 [2024-10-07 11:33:28.067919] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.949 [2024-10-07 11:33:28.067935] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.949 [2024-10-07 11:33:28.067991] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.949 [2024-10-07 11:33:28.068015] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.949 [2024-10-07 11:33:28.068030] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.949 [2024-10-07 11:33:28.068047] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.949 [2024-10-07 11:33:28.068071] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.949 [2024-10-07 11:33:28.068089] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.949 [2024-10-07 11:33:28.068102] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.949 [2024-10-07 11:33:28.068115] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.949 [2024-10-07 11:33:28.068153] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.949 [2024-10-07 11:33:28.068169] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.949 [2024-10-07 11:33:28.068183] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.949 [2024-10-07 11:33:28.068196] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.949 [2024-10-07 11:33:28.068215] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.949 [2024-10-07 11:33:28.077833] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.949 [2024-10-07 11:33:28.077951] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.949 [2024-10-07 11:33:28.077981] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.949 [2024-10-07 11:33:28.077997] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.949 [2024-10-07 11:33:28.078212] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.949 [2024-10-07 11:33:28.078371] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.949 [2024-10-07 11:33:28.078419] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.949 [2024-10-07 11:33:28.078438] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.949 [2024-10-07 11:33:28.078452] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.949 [2024-10-07 11:33:28.078560] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.949 [2024-10-07 11:33:28.078621] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.949 [2024-10-07 11:33:28.078660] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.949 [2024-10-07 11:33:28.078680] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.949 [2024-10-07 11:33:28.078792] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.949 [2024-10-07 11:33:28.078896] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.949 [2024-10-07 11:33:28.078915] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.949 [2024-10-07 11:33:28.078929] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.949 [2024-10-07 11:33:28.079092] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.949 [2024-10-07 11:33:28.088179] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.949 [2024-10-07 11:33:28.088297] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.949 [2024-10-07 11:33:28.088327] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.949 [2024-10-07 11:33:28.088343] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.949 [2024-10-07 11:33:28.088366] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.949 [2024-10-07 11:33:28.088388] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.949 [2024-10-07 11:33:28.088402] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.949 [2024-10-07 11:33:28.088432] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.949 [2024-10-07 11:33:28.088458] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.949 [2024-10-07 11:33:28.088494] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.949 [2024-10-07 11:33:28.088566] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.949 [2024-10-07 11:33:28.088593] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.949 [2024-10-07 11:33:28.088609] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.949 [2024-10-07 11:33:28.088631] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.949 [2024-10-07 11:33:28.088653] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.949 [2024-10-07 11:33:28.088684] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.949 [2024-10-07 11:33:28.088699] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.949 [2024-10-07 11:33:28.088722] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.949 [2024-10-07 11:33:28.099607] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.949 [2024-10-07 11:33:28.099667] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.949 [2024-10-07 11:33:28.101973] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.949 [2024-10-07 11:33:28.102017] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.949 [2024-10-07 11:33:28.102038] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.949 [2024-10-07 11:33:28.102087] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.949 [2024-10-07 11:33:28.102111] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.949 [2024-10-07 11:33:28.102126] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.949 [2024-10-07 11:33:28.102391] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.949 [2024-10-07 11:33:28.102423] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.949 [2024-10-07 11:33:28.102600] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.949 [2024-10-07 11:33:28.102633] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.949 [2024-10-07 11:33:28.102664] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.949 [2024-10-07 11:33:28.102685] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.949 [2024-10-07 11:33:28.102699] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.949 [2024-10-07 11:33:28.102711] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.949 [2024-10-07 11:33:28.102850] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.949 [2024-10-07 11:33:28.102873] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.949 [2024-10-07 11:33:28.111091] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.949 [2024-10-07 11:33:28.111138] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.949 [2024-10-07 11:33:28.111250] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.949 [2024-10-07 11:33:28.111281] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.949 [2024-10-07 11:33:28.111297] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.949 [2024-10-07 11:33:28.111344] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.949 [2024-10-07 11:33:28.111367] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.949 [2024-10-07 11:33:28.111382] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.949 [2024-10-07 11:33:28.111405] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.950 [2024-10-07 11:33:28.111424] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.950 [2024-10-07 11:33:28.111444] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.950 [2024-10-07 11:33:28.111459] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.950 [2024-10-07 11:33:28.111472] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.950 [2024-10-07 11:33:28.111488] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.950 [2024-10-07 11:33:28.111502] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.950 [2024-10-07 11:33:28.111515] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.950 [2024-10-07 11:33:28.111538] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.950 [2024-10-07 11:33:28.111552] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.950 [2024-10-07 11:33:28.122027] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.950 [2024-10-07 11:33:28.122075] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.950 [2024-10-07 11:33:28.123361] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.950 [2024-10-07 11:33:28.123404] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.950 [2024-10-07 11:33:28.123423] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.950 [2024-10-07 11:33:28.123475] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.950 [2024-10-07 11:33:28.123499] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.950 [2024-10-07 11:33:28.123514] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.950 [2024-10-07 11:33:28.124012] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.950 [2024-10-07 11:33:28.124054] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.950 [2024-10-07 11:33:28.125222] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.950 [2024-10-07 11:33:28.125258] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.950 [2024-10-07 11:33:28.125276] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.950 [2024-10-07 11:33:28.125293] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.950 [2024-10-07 11:33:28.125320] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.950 [2024-10-07 11:33:28.125350] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.950 [2024-10-07 11:33:28.125616] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.950 [2024-10-07 11:33:28.125679] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.950 [2024-10-07 11:33:28.132137] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.950 [2024-10-07 11:33:28.132228] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.950 [2024-10-07 11:33:28.132317] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.950 [2024-10-07 11:33:28.132344] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.950 [2024-10-07 11:33:28.132360] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.950 [2024-10-07 11:33:28.132413] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.950 [2024-10-07 11:33:28.132436] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.950 [2024-10-07 11:33:28.132451] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.950 [2024-10-07 11:33:28.132468] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.950 [2024-10-07 11:33:28.132491] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.950 [2024-10-07 11:33:28.132507] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.950 [2024-10-07 11:33:28.132520] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.950 [2024-10-07 11:33:28.132549] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.950 [2024-10-07 11:33:28.132572] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.950 [2024-10-07 11:33:28.132587] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.950 [2024-10-07 11:33:28.132600] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.950 [2024-10-07 11:33:28.132612] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.950 [2024-10-07 11:33:28.132648] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.950 [2024-10-07 11:33:28.143165] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.950 [2024-10-07 11:33:28.143396] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.950 [2024-10-07 11:33:28.143489] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.950 [2024-10-07 11:33:28.143520] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.950 [2024-10-07 11:33:28.143536] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.950 [2024-10-07 11:33:28.143625] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.950 [2024-10-07 11:33:28.143665] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.950 [2024-10-07 11:33:28.143684] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.950 [2024-10-07 11:33:28.143719] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.950 [2024-10-07 11:33:28.144531] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.950 [2024-10-07 11:33:28.144569] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.950 [2024-10-07 11:33:28.144602] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.950 [2024-10-07 11:33:28.144615] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.950 [2024-10-07 11:33:28.146047] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.950 [2024-10-07 11:33:28.146083] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.950 [2024-10-07 11:33:28.146116] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.950 [2024-10-07 11:33:28.146130] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.950 [2024-10-07 11:33:28.146288] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.950 [2024-10-07 11:33:28.153495] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.950 [2024-10-07 11:33:28.153570] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.950 [2024-10-07 11:33:28.153644] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.950 [2024-10-07 11:33:28.153686] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.950 [2024-10-07 11:33:28.153705] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.950 [2024-10-07 11:33:28.153761] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.950 [2024-10-07 11:33:28.153786] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.950 [2024-10-07 11:33:28.153802] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.950 [2024-10-07 11:33:28.153821] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.950 [2024-10-07 11:33:28.153845] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.950 [2024-10-07 11:33:28.153862] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.950 [2024-10-07 11:33:28.153875] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.950 [2024-10-07 11:33:28.153889] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.950 [2024-10-07 11:33:28.153912] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.950 [2024-10-07 11:33:28.153927] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.950 [2024-10-07 11:33:28.153939] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.950 [2024-10-07 11:33:28.153952] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.950 [2024-10-07 11:33:28.153972] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.950 [2024-10-07 11:33:28.163571] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.950 [2024-10-07 11:33:28.163685] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.950 [2024-10-07 11:33:28.163716] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.950 [2024-10-07 11:33:28.163754] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.950 [2024-10-07 11:33:28.163792] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.950 [2024-10-07 11:33:28.163822] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.950 [2024-10-07 11:33:28.163848] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.950 [2024-10-07 11:33:28.163864] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.950 [2024-10-07 11:33:28.163878] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.950 [2024-10-07 11:33:28.163898] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.950 [2024-10-07 11:33:28.163951] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.950 [2024-10-07 11:33:28.163977] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.950 [2024-10-07 11:33:28.163993] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.950 [2024-10-07 11:33:28.164016] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.950 [2024-10-07 11:33:28.164038] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.950 [2024-10-07 11:33:28.164051] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.950 [2024-10-07 11:33:28.164064] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.950 [2024-10-07 11:33:28.165800] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.950 [2024-10-07 11:33:28.173647] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.950 [2024-10-07 11:33:28.173777] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.950 [2024-10-07 11:33:28.173808] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.950 [2024-10-07 11:33:28.173825] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.950 [2024-10-07 11:33:28.173848] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.950 [2024-10-07 11:33:28.173870] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.951 [2024-10-07 11:33:28.173884] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.951 [2024-10-07 11:33:28.173897] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.951 [2024-10-07 11:33:28.173930] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.951 [2024-10-07 11:33:28.173954] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.951 [2024-10-07 11:33:28.174021] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.951 [2024-10-07 11:33:28.174048] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.951 [2024-10-07 11:33:28.174063] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.951 [2024-10-07 11:33:28.174086] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.951 [2024-10-07 11:33:28.174107] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.951 [2024-10-07 11:33:28.174136] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.951 [2024-10-07 11:33:28.174150] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.951 [2024-10-07 11:33:28.174173] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.951 [2024-10-07 11:33:28.185968] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.951 [2024-10-07 11:33:28.186030] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.951 [2024-10-07 11:33:28.186339] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.951 [2024-10-07 11:33:28.186380] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.951 [2024-10-07 11:33:28.186399] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.951 [2024-10-07 11:33:28.186465] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.951 [2024-10-07 11:33:28.186489] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.951 [2024-10-07 11:33:28.186504] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.951 [2024-10-07 11:33:28.187021] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.951 [2024-10-07 11:33:28.187063] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.951 [2024-10-07 11:33:28.187312] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.951 [2024-10-07 11:33:28.187348] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.951 [2024-10-07 11:33:28.187365] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.951 [2024-10-07 11:33:28.187382] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.951 [2024-10-07 11:33:28.187396] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.951 [2024-10-07 11:33:28.187409] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.951 [2024-10-07 11:33:28.187611] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.951 [2024-10-07 11:33:28.187636] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.951 [2024-10-07 11:33:28.198598] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.951 [2024-10-07 11:33:28.198657] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.951 [2024-10-07 11:33:28.198744] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.951 [2024-10-07 11:33:28.198773] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.951 [2024-10-07 11:33:28.198789] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.951 [2024-10-07 11:33:28.198836] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.951 [2024-10-07 11:33:28.198859] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.951 [2024-10-07 11:33:28.198874] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.951 [2024-10-07 11:33:28.199453] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.951 [2024-10-07 11:33:28.199510] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.951 [2024-10-07 11:33:28.199606] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.951 [2024-10-07 11:33:28.199628] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.951 [2024-10-07 11:33:28.199643] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.951 [2024-10-07 11:33:28.199676] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.951 [2024-10-07 11:33:28.199691] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.951 [2024-10-07 11:33:28.199703] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.951 [2024-10-07 11:33:28.199727] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.951 [2024-10-07 11:33:28.199741] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.951 [2024-10-07 11:33:28.209318] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.951 [2024-10-07 11:33:28.209363] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.951 [2024-10-07 11:33:28.210180] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.951 [2024-10-07 11:33:28.210221] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.951 [2024-10-07 11:33:28.210240] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.951 [2024-10-07 11:33:28.210289] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.951 [2024-10-07 11:33:28.210312] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.951 [2024-10-07 11:33:28.210326] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.951 [2024-10-07 11:33:28.211515] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.951 [2024-10-07 11:33:28.211557] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.951 [2024-10-07 11:33:28.211991] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.951 [2024-10-07 11:33:28.212027] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.951 [2024-10-07 11:33:28.212044] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.951 [2024-10-07 11:33:28.212061] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.951 [2024-10-07 11:33:28.212075] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.951 [2024-10-07 11:33:28.212088] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.951 [2024-10-07 11:33:28.212295] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.951 [2024-10-07 11:33:28.212319] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.951 [2024-10-07 11:33:28.219438] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.951 [2024-10-07 11:33:28.222281] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.951 [2024-10-07 11:33:28.222378] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.951 [2024-10-07 11:33:28.222407] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.951 [2024-10-07 11:33:28.222438] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.951 [2024-10-07 11:33:28.223498] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.951 [2024-10-07 11:33:28.223541] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.951 [2024-10-07 11:33:28.223561] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.951 [2024-10-07 11:33:28.223579] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.951 [2024-10-07 11:33:28.223805] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.951 [2024-10-07 11:33:28.223833] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.951 [2024-10-07 11:33:28.223848] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.951 [2024-10-07 11:33:28.223861] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.951 [2024-10-07 11:33:28.223965] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.951 [2024-10-07 11:33:28.223985] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.951 [2024-10-07 11:33:28.223998] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.951 [2024-10-07 11:33:28.224011] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.951 [2024-10-07 11:33:28.224574] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.951 [2024-10-07 11:33:28.229514] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.951 [2024-10-07 11:33:28.229615] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.951 [2024-10-07 11:33:28.229645] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.951 [2024-10-07 11:33:28.229679] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.951 [2024-10-07 11:33:28.232111] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.951 [2024-10-07 11:33:28.233021] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.951 [2024-10-07 11:33:28.233059] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.951 [2024-10-07 11:33:28.233077] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.952 [2024-10-07 11:33:28.233329] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.952 [2024-10-07 11:33:28.233478] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.952 [2024-10-07 11:33:28.233667] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.952 [2024-10-07 11:33:28.233706] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.952 [2024-10-07 11:33:28.233725] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.952 [2024-10-07 11:33:28.233841] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.952 [2024-10-07 11:33:28.233945] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.952 [2024-10-07 11:33:28.233965] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.952 [2024-10-07 11:33:28.233999] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.952 [2024-10-07 11:33:28.234298] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.952 [2024-10-07 11:33:28.239590] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.952 [2024-10-07 11:33:28.239707] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.952 [2024-10-07 11:33:28.239738] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.952 [2024-10-07 11:33:28.239755] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.952 [2024-10-07 11:33:28.239778] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.952 [2024-10-07 11:33:28.239800] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.952 [2024-10-07 11:33:28.239814] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.952 [2024-10-07 11:33:28.239828] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.952 [2024-10-07 11:33:28.239851] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.952 [2024-10-07 11:33:28.244585] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.952 [2024-10-07 11:33:28.244812] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.952 [2024-10-07 11:33:28.244844] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.952 [2024-10-07 11:33:28.244861] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.952 [2024-10-07 11:33:28.244991] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.952 [2024-10-07 11:33:28.245110] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.952 [2024-10-07 11:33:28.245132] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.952 [2024-10-07 11:33:28.245146] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.952 [2024-10-07 11:33:28.245249] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.952 [2024-10-07 11:33:28.252895] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.952 [2024-10-07 11:33:28.253232] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.952 [2024-10-07 11:33:28.253275] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.952 [2024-10-07 11:33:28.253295] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.952 [2024-10-07 11:33:28.253350] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.952 [2024-10-07 11:33:28.253379] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.952 [2024-10-07 11:33:28.253394] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.952 [2024-10-07 11:33:28.253407] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.952 [2024-10-07 11:33:28.253431] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.952 [2024-10-07 11:33:28.254676] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.952 [2024-10-07 11:33:28.254792] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.952 [2024-10-07 11:33:28.254822] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.952 [2024-10-07 11:33:28.254838] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.952 [2024-10-07 11:33:28.254861] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.952 [2024-10-07 11:33:28.254883] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.952 [2024-10-07 11:33:28.254898] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.952 [2024-10-07 11:33:28.254911] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.952 [2024-10-07 11:33:28.254933] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.952 [2024-10-07 11:33:28.266337] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.952 [2024-10-07 11:33:28.266386] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.952 [2024-10-07 11:33:28.267814] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.952 [2024-10-07 11:33:28.267858] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.952 [2024-10-07 11:33:28.267878] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.952 [2024-10-07 11:33:28.267928] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.952 [2024-10-07 11:33:28.267951] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.952 [2024-10-07 11:33:28.267966] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.952 [2024-10-07 11:33:28.268635] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.952 [2024-10-07 11:33:28.268689] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.952 [2024-10-07 11:33:28.268784] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.952 [2024-10-07 11:33:28.268806] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.952 [2024-10-07 11:33:28.268821] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.952 [2024-10-07 11:33:28.268841] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.952 [2024-10-07 11:33:28.268871] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.952 [2024-10-07 11:33:28.268898] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.952 [2024-10-07 11:33:28.268946] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.952 [2024-10-07 11:33:28.268966] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.952 [2024-10-07 11:33:28.276703] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.952 [2024-10-07 11:33:28.276749] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.952 [2024-10-07 11:33:28.276924] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.952 [2024-10-07 11:33:28.276954] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.952 [2024-10-07 11:33:28.276971] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.952 [2024-10-07 11:33:28.277036] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.952 [2024-10-07 11:33:28.277060] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.952 [2024-10-07 11:33:28.277075] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.952 [2024-10-07 11:33:28.277504] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.952 [2024-10-07 11:33:28.277545] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.952 [2024-10-07 11:33:28.280634] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.952 [2024-10-07 11:33:28.280698] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.952 [2024-10-07 11:33:28.280718] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.952 [2024-10-07 11:33:28.280736] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.952 [2024-10-07 11:33:28.280750] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.952 [2024-10-07 11:33:28.280763] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.952 [2024-10-07 11:33:28.281208] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.952 [2024-10-07 11:33:28.281236] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.952 [2024-10-07 11:33:28.287893] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.952 [2024-10-07 11:33:28.287940] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.952 [2024-10-07 11:33:28.288024] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.952 [2024-10-07 11:33:28.288053] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.952 [2024-10-07 11:33:28.288070] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.952 [2024-10-07 11:33:28.288116] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.952 [2024-10-07 11:33:28.288138] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.952 [2024-10-07 11:33:28.288153] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.952 [2024-10-07 11:33:28.288176] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.952 [2024-10-07 11:33:28.288195] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.952 [2024-10-07 11:33:28.288215] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.952 [2024-10-07 11:33:28.288230] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.952 [2024-10-07 11:33:28.288243] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.952 [2024-10-07 11:33:28.288258] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.952 [2024-10-07 11:33:28.288272] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.952 [2024-10-07 11:33:28.288285] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.952 [2024-10-07 11:33:28.288311] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.952 [2024-10-07 11:33:28.288357] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.952 [2024-10-07 11:33:28.298003] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.952 [2024-10-07 11:33:28.298067] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.952 [2024-10-07 11:33:28.298144] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.952 [2024-10-07 11:33:28.298173] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.952 [2024-10-07 11:33:28.298189] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.952 [2024-10-07 11:33:28.298258] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.952 [2024-10-07 11:33:28.298284] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.952 [2024-10-07 11:33:28.298300] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.952 [2024-10-07 11:33:28.298318] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.952 [2024-10-07 11:33:28.298341] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.952 [2024-10-07 11:33:28.298358] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.952 [2024-10-07 11:33:28.298372] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.952 [2024-10-07 11:33:28.298385] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.953 [2024-10-07 11:33:28.298407] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.953 [2024-10-07 11:33:28.298422] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.953 [2024-10-07 11:33:28.298435] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.953 [2024-10-07 11:33:28.298448] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.953 [2024-10-07 11:33:28.298468] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.953 [2024-10-07 11:33:28.311320] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.953 [2024-10-07 11:33:28.311370] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.953 [2024-10-07 11:33:28.311955] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.953 [2024-10-07 11:33:28.311998] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.953 [2024-10-07 11:33:28.312018] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.953 [2024-10-07 11:33:28.312068] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.953 [2024-10-07 11:33:28.312092] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.953 [2024-10-07 11:33:28.312107] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.953 [2024-10-07 11:33:28.312189] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.953 [2024-10-07 11:33:28.312216] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.953 [2024-10-07 11:33:28.312250] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.953 [2024-10-07 11:33:28.312284] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.953 [2024-10-07 11:33:28.312298] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.953 [2024-10-07 11:33:28.312316] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.953 [2024-10-07 11:33:28.312330] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.953 [2024-10-07 11:33:28.312343] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.953 [2024-10-07 11:33:28.312366] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.953 [2024-10-07 11:33:28.312381] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.953 [2024-10-07 11:33:28.323973] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.953 [2024-10-07 11:33:28.324022] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.953 [2024-10-07 11:33:28.324253] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.953 [2024-10-07 11:33:28.324292] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.953 [2024-10-07 11:33:28.324308] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.953 [2024-10-07 11:33:28.324356] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.953 [2024-10-07 11:33:28.324379] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.953 [2024-10-07 11:33:28.324394] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.953 [2024-10-07 11:33:28.324497] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.953 [2024-10-07 11:33:28.324522] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.953 [2024-10-07 11:33:28.324606] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.953 [2024-10-07 11:33:28.324631] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.953 [2024-10-07 11:33:28.324645] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.953 [2024-10-07 11:33:28.324679] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.953 [2024-10-07 11:33:28.324693] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.953 [2024-10-07 11:33:28.324707] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.953 [2024-10-07 11:33:28.324754] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.953 [2024-10-07 11:33:28.324774] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.953 [2024-10-07 11:33:28.334562] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.953 [2024-10-07 11:33:28.334731] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.953 [2024-10-07 11:33:28.334817] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.953 [2024-10-07 11:33:28.334845] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.953 [2024-10-07 11:33:28.334862] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.953 [2024-10-07 11:33:28.334959] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.953 [2024-10-07 11:33:28.334987] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.953 [2024-10-07 11:33:28.335004] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.953 [2024-10-07 11:33:28.335021] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.953 [2024-10-07 11:33:28.335045] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.953 [2024-10-07 11:33:28.335063] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.953 [2024-10-07 11:33:28.335076] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.953 [2024-10-07 11:33:28.335089] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.953 [2024-10-07 11:33:28.335113] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.953 [2024-10-07 11:33:28.335128] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.953 [2024-10-07 11:33:28.335141] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.953 [2024-10-07 11:33:28.335153] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.953 [2024-10-07 11:33:28.335174] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.953 [2024-10-07 11:33:28.345133] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.953 [2024-10-07 11:33:28.345185] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.953 [2024-10-07 11:33:28.345386] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.953 [2024-10-07 11:33:28.345418] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.953 [2024-10-07 11:33:28.345435] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.953 [2024-10-07 11:33:28.345484] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.953 [2024-10-07 11:33:28.345507] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.953 [2024-10-07 11:33:28.345524] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.953 [2024-10-07 11:33:28.345681] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.953 [2024-10-07 11:33:28.345726] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.953 [2024-10-07 11:33:28.345888] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.953 [2024-10-07 11:33:28.345912] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.953 [2024-10-07 11:33:28.345927] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.953 [2024-10-07 11:33:28.345944] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.953 [2024-10-07 11:33:28.345958] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.953 [2024-10-07 11:33:28.345971] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.953 [2024-10-07 11:33:28.346099] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.953 [2024-10-07 11:33:28.346121] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.953 [2024-10-07 11:33:28.355246] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.953 [2024-10-07 11:33:28.355309] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.953 [2024-10-07 11:33:28.355384] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.953 [2024-10-07 11:33:28.355413] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.953 [2024-10-07 11:33:28.355429] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.953 [2024-10-07 11:33:28.355482] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.953 [2024-10-07 11:33:28.355506] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.953 [2024-10-07 11:33:28.355521] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.953 [2024-10-07 11:33:28.355539] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.953 [2024-10-07 11:33:28.355562] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.953 [2024-10-07 11:33:28.355579] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.953 [2024-10-07 11:33:28.355593] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.953 [2024-10-07 11:33:28.355606] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.953 [2024-10-07 11:33:28.355629] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.953 [2024-10-07 11:33:28.355643] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.953 [2024-10-07 11:33:28.355671] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.953 [2024-10-07 11:33:28.355685] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.953 [2024-10-07 11:33:28.355706] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.953 [2024-10-07 11:33:28.368146] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.953 [2024-10-07 11:33:28.368194] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.953 [2024-10-07 11:33:28.368280] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.953 [2024-10-07 11:33:28.368309] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.953 [2024-10-07 11:33:28.368326] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.953 [2024-10-07 11:33:28.368372] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.953 [2024-10-07 11:33:28.368395] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.953 [2024-10-07 11:33:28.368410] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.953 [2024-10-07 11:33:28.368433] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.953 [2024-10-07 11:33:28.368453] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.953 [2024-10-07 11:33:28.368473] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.953 [2024-10-07 11:33:28.368487] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.954 [2024-10-07 11:33:28.368517] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.954 [2024-10-07 11:33:28.368535] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.954 [2024-10-07 11:33:28.368549] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.954 [2024-10-07 11:33:28.368562] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.954 [2024-10-07 11:33:28.368585] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.954 [2024-10-07 11:33:28.368599] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.954 [2024-10-07 11:33:28.378451] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.954 [2024-10-07 11:33:28.378498] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.954 [2024-10-07 11:33:28.378686] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.954 [2024-10-07 11:33:28.378717] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.954 [2024-10-07 11:33:28.378735] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.954 [2024-10-07 11:33:28.378783] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.954 [2024-10-07 11:33:28.378806] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.954 [2024-10-07 11:33:28.378821] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.954 [2024-10-07 11:33:28.379456] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.954 [2024-10-07 11:33:28.379498] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.954 [2024-10-07 11:33:28.382427] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.954 [2024-10-07 11:33:28.382467] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.954 [2024-10-07 11:33:28.382485] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.954 [2024-10-07 11:33:28.382502] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.954 [2024-10-07 11:33:28.382516] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.954 [2024-10-07 11:33:28.382529] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.954 [2024-10-07 11:33:28.383133] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.954 [2024-10-07 11:33:28.383169] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.954 [2024-10-07 11:33:28.388557] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.954 [2024-10-07 11:33:28.388619] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.954 [2024-10-07 11:33:28.388706] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.954 [2024-10-07 11:33:28.388742] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.954 [2024-10-07 11:33:28.388758] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.954 [2024-10-07 11:33:28.388812] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.954 [2024-10-07 11:33:28.388836] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.954 [2024-10-07 11:33:28.388866] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.954 [2024-10-07 11:33:28.388897] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.954 [2024-10-07 11:33:28.388937] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.954 [2024-10-07 11:33:28.388968] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.954 [2024-10-07 11:33:28.388993] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.954 [2024-10-07 11:33:28.389017] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.954 [2024-10-07 11:33:28.391527] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.954 [2024-10-07 11:33:28.391568] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.954 [2024-10-07 11:33:28.391586] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.954 [2024-10-07 11:33:28.391600] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.954 [2024-10-07 11:33:28.392228] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.954 [2024-10-07 11:33:28.398633] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.954 [2024-10-07 11:33:28.398767] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.954 [2024-10-07 11:33:28.398797] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.954 [2024-10-07 11:33:28.398813] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.954 [2024-10-07 11:33:28.398850] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.954 [2024-10-07 11:33:28.398880] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.954 [2024-10-07 11:33:28.398906] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.954 [2024-10-07 11:33:28.398922] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.954 [2024-10-07 11:33:28.398935] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.954 [2024-10-07 11:33:28.398956] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.954 [2024-10-07 11:33:28.399008] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.954 [2024-10-07 11:33:28.399033] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.954 [2024-10-07 11:33:28.399049] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.954 [2024-10-07 11:33:28.399071] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.954 [2024-10-07 11:33:28.399092] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.954 [2024-10-07 11:33:28.399106] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.954 [2024-10-07 11:33:28.399119] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.954 [2024-10-07 11:33:28.399141] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.954 [2024-10-07 11:33:28.408722] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.954 [2024-10-07 11:33:28.408845] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.954 [2024-10-07 11:33:28.408877] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.954 [2024-10-07 11:33:28.408893] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.954 [2024-10-07 11:33:28.408917] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.954 [2024-10-07 11:33:28.408953] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.954 [2024-10-07 11:33:28.408971] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.954 [2024-10-07 11:33:28.408985] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.954 [2024-10-07 11:33:28.409009] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.954 [2024-10-07 11:33:28.409027] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.954 [2024-10-07 11:33:28.409090] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.954 [2024-10-07 11:33:28.409117] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.954 [2024-10-07 11:33:28.409133] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.954 [2024-10-07 11:33:28.409155] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.954 [2024-10-07 11:33:28.409177] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.954 [2024-10-07 11:33:28.409191] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.954 [2024-10-07 11:33:28.409204] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.954 [2024-10-07 11:33:28.409226] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.954 [2024-10-07 11:33:28.418816] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.954 [2024-10-07 11:33:28.418924] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.954 [2024-10-07 11:33:28.418954] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.954 [2024-10-07 11:33:28.418972] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.954 [2024-10-07 11:33:28.418995] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.954 [2024-10-07 11:33:28.419021] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.954 [2024-10-07 11:33:28.419035] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.954 [2024-10-07 11:33:28.419048] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.954 [2024-10-07 11:33:28.419071] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.954 [2024-10-07 11:33:28.419105] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.954 [2024-10-07 11:33:28.419174] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.954 [2024-10-07 11:33:28.419222] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.954 [2024-10-07 11:33:28.419242] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.954 [2024-10-07 11:33:28.419279] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.954 [2024-10-07 11:33:28.419302] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.954 [2024-10-07 11:33:28.419315] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.954 [2024-10-07 11:33:28.419328] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.954 [2024-10-07 11:33:28.419350] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.954 [2024-10-07 11:33:28.429432] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.954 [2024-10-07 11:33:28.429542] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.954 [2024-10-07 11:33:28.429624] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.954 [2024-10-07 11:33:28.429668] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.954 [2024-10-07 11:33:28.429688] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.954 [2024-10-07 11:33:28.429745] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.954 [2024-10-07 11:33:28.429770] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.954 [2024-10-07 11:33:28.429786] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.954 [2024-10-07 11:33:28.429804] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.954 [2024-10-07 11:33:28.429827] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.954 [2024-10-07 11:33:28.429844] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.954 [2024-10-07 11:33:28.429857] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.954 [2024-10-07 11:33:28.429871] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.954 [2024-10-07 11:33:28.429910] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.955 [2024-10-07 11:33:28.429928] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.955 [2024-10-07 11:33:28.429941] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.955 [2024-10-07 11:33:28.429955] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.955 [2024-10-07 11:33:28.429975] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.955 [2024-10-07 11:33:28.441381] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.955 [2024-10-07 11:33:28.441431] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.955 [2024-10-07 11:33:28.441581] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.955 [2024-10-07 11:33:28.441612] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.955 [2024-10-07 11:33:28.441629] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.955 [2024-10-07 11:33:28.441700] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.955 [2024-10-07 11:33:28.441726] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.955 [2024-10-07 11:33:28.441758] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.955 [2024-10-07 11:33:28.442002] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.955 [2024-10-07 11:33:28.442033] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.955 [2024-10-07 11:33:28.442161] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.955 [2024-10-07 11:33:28.442184] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.955 [2024-10-07 11:33:28.442198] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.955 [2024-10-07 11:33:28.442216] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.955 [2024-10-07 11:33:28.442231] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.955 [2024-10-07 11:33:28.442244] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.955 [2024-10-07 11:33:28.442303] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.955 [2024-10-07 11:33:28.442325] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.955 [2024-10-07 11:33:28.454881] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.955 [2024-10-07 11:33:28.454931] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.955 [2024-10-07 11:33:28.455018] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.955 [2024-10-07 11:33:28.455047] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.955 [2024-10-07 11:33:28.455063] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.955 [2024-10-07 11:33:28.455109] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.955 [2024-10-07 11:33:28.455132] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.955 [2024-10-07 11:33:28.455148] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.955 [2024-10-07 11:33:28.455171] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.955 [2024-10-07 11:33:28.455214] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.955 [2024-10-07 11:33:28.455237] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.955 [2024-10-07 11:33:28.455252] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.955 [2024-10-07 11:33:28.455265] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.955 [2024-10-07 11:33:28.455281] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.955 [2024-10-07 11:33:28.455295] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.955 [2024-10-07 11:33:28.455308] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.955 [2024-10-07 11:33:28.455330] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.955 [2024-10-07 11:33:28.455344] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.955 [2024-10-07 11:33:28.469777] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.955 [2024-10-07 11:33:28.469857] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.955 [2024-10-07 11:33:28.470087] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.955 [2024-10-07 11:33:28.470119] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.955 [2024-10-07 11:33:28.470136] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.955 [2024-10-07 11:33:28.470184] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.955 [2024-10-07 11:33:28.470207] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.955 [2024-10-07 11:33:28.470223] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.955 [2024-10-07 11:33:28.470247] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.955 [2024-10-07 11:33:28.470268] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.955 [2024-10-07 11:33:28.470287] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.955 [2024-10-07 11:33:28.470302] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.955 [2024-10-07 11:33:28.470316] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.955 [2024-10-07 11:33:28.470333] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.955 [2024-10-07 11:33:28.470347] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.955 [2024-10-07 11:33:28.470360] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.955 [2024-10-07 11:33:28.471108] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.955 [2024-10-07 11:33:28.471146] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.955 [2024-10-07 11:33:28.482628] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.955 [2024-10-07 11:33:28.482693] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.955 [2024-10-07 11:33:28.482785] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.955 [2024-10-07 11:33:28.482815] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.955 [2024-10-07 11:33:28.482831] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.955 [2024-10-07 11:33:28.482878] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.955 [2024-10-07 11:33:28.482901] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.955 [2024-10-07 11:33:28.482917] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.955 [2024-10-07 11:33:28.482940] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.955 [2024-10-07 11:33:28.482960] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.955 [2024-10-07 11:33:28.482980] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.955 [2024-10-07 11:33:28.482994] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.955 [2024-10-07 11:33:28.483007] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.955 [2024-10-07 11:33:28.483039] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.955 [2024-10-07 11:33:28.483055] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.955 [2024-10-07 11:33:28.483068] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.955 [2024-10-07 11:33:28.483091] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.955 [2024-10-07 11:33:28.483106] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.955 [2024-10-07 11:33:28.494031] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.955 [2024-10-07 11:33:28.494081] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.955 [2024-10-07 11:33:28.495919] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.955 [2024-10-07 11:33:28.495964] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.955 [2024-10-07 11:33:28.495984] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.955 [2024-10-07 11:33:28.496034] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.955 [2024-10-07 11:33:28.496058] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.955 [2024-10-07 11:33:28.496073] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.955 [2024-10-07 11:33:28.496718] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.955 [2024-10-07 11:33:28.496760] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.955 [2024-10-07 11:33:28.497039] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.955 [2024-10-07 11:33:28.497075] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.955 [2024-10-07 11:33:28.497092] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.955 [2024-10-07 11:33:28.497110] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.955 [2024-10-07 11:33:28.497124] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.955 [2024-10-07 11:33:28.497137] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.955 [2024-10-07 11:33:28.497297] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.955 [2024-10-07 11:33:28.497322] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.955 [2024-10-07 11:33:28.506484] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.955 [2024-10-07 11:33:28.506540] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.955 [2024-10-07 11:33:28.506801] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.955 [2024-10-07 11:33:28.506838] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.955 [2024-10-07 11:33:28.506856] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.955 [2024-10-07 11:33:28.506909] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.956 [2024-10-07 11:33:28.506933] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.956 [2024-10-07 11:33:28.506948] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.956 [2024-10-07 11:33:28.507070] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.956 [2024-10-07 11:33:28.507095] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.956 [2024-10-07 11:33:28.507206] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.956 [2024-10-07 11:33:28.507227] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.956 [2024-10-07 11:33:28.507241] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.956 [2024-10-07 11:33:28.507257] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.956 [2024-10-07 11:33:28.507272] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.956 [2024-10-07 11:33:28.507285] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.956 [2024-10-07 11:33:28.507385] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.956 [2024-10-07 11:33:28.507404] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.956 [2024-10-07 11:33:28.517328] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.956 [2024-10-07 11:33:28.517378] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.956 [2024-10-07 11:33:28.517562] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.956 [2024-10-07 11:33:28.517594] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.956 [2024-10-07 11:33:28.517612] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.956 [2024-10-07 11:33:28.517676] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.956 [2024-10-07 11:33:28.517701] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.956 [2024-10-07 11:33:28.517717] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.956 [2024-10-07 11:33:28.517832] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.956 [2024-10-07 11:33:28.517858] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.956 [2024-10-07 11:33:28.517975] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.956 [2024-10-07 11:33:28.517997] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.956 [2024-10-07 11:33:28.518011] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.956 [2024-10-07 11:33:28.518027] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.956 [2024-10-07 11:33:28.518041] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.956 [2024-10-07 11:33:28.518055] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.956 [2024-10-07 11:33:28.518441] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.956 [2024-10-07 11:33:28.518465] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.956 [2024-10-07 11:33:28.527699] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.956 [2024-10-07 11:33:28.527746] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.956 [2024-10-07 11:33:28.527851] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.956 [2024-10-07 11:33:28.527881] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.956 [2024-10-07 11:33:28.527897] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.956 [2024-10-07 11:33:28.527945] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.956 [2024-10-07 11:33:28.527968] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.956 [2024-10-07 11:33:28.527983] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.956 [2024-10-07 11:33:28.528006] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.956 [2024-10-07 11:33:28.528026] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.956 [2024-10-07 11:33:28.528045] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.956 [2024-10-07 11:33:28.528059] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.956 [2024-10-07 11:33:28.528073] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.956 [2024-10-07 11:33:28.528089] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.956 [2024-10-07 11:33:28.528104] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.956 [2024-10-07 11:33:28.528117] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.956 [2024-10-07 11:33:28.529697] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.956 [2024-10-07 11:33:28.529737] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.956 [2024-10-07 11:33:28.537829] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.956 [2024-10-07 11:33:28.537890] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.956 [2024-10-07 11:33:28.537965] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.956 [2024-10-07 11:33:28.537993] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.956 [2024-10-07 11:33:28.538010] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.956 [2024-10-07 11:33:28.538064] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.956 [2024-10-07 11:33:28.538088] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.956 [2024-10-07 11:33:28.538103] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.956 [2024-10-07 11:33:28.538121] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.956 [2024-10-07 11:33:28.538594] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.956 [2024-10-07 11:33:28.538624] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.956 [2024-10-07 11:33:28.538638] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.956 [2024-10-07 11:33:28.538668] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.956 [2024-10-07 11:33:28.538876] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.956 [2024-10-07 11:33:28.538913] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.956 [2024-10-07 11:33:28.538929] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.956 [2024-10-07 11:33:28.538942] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.956 [2024-10-07 11:33:28.539084] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.956 [2024-10-07 11:33:28.547908] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.956 [2024-10-07 11:33:28.548019] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.956 [2024-10-07 11:33:28.548050] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.956 [2024-10-07 11:33:28.548066] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.956 [2024-10-07 11:33:28.548101] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.956 [2024-10-07 11:33:28.548145] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.956 [2024-10-07 11:33:28.548176] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.956 [2024-10-07 11:33:28.548193] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.956 [2024-10-07 11:33:28.548206] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.956 [2024-10-07 11:33:28.548228] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.956 [2024-10-07 11:33:28.548280] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.956 [2024-10-07 11:33:28.548304] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.956 [2024-10-07 11:33:28.548320] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.956 [2024-10-07 11:33:28.548342] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.956 [2024-10-07 11:33:28.548364] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.956 [2024-10-07 11:33:28.548378] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.956 [2024-10-07 11:33:28.548391] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.956 [2024-10-07 11:33:28.548412] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.956 [2024-10-07 11:33:28.560933] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.956 [2024-10-07 11:33:28.560983] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.956 [2024-10-07 11:33:28.561180] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.956 [2024-10-07 11:33:28.561211] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.956 [2024-10-07 11:33:28.561228] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.956 [2024-10-07 11:33:28.561277] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.956 [2024-10-07 11:33:28.561300] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.956 [2024-10-07 11:33:28.561315] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.956 [2024-10-07 11:33:28.561887] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.956 [2024-10-07 11:33:28.561944] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.956 [2024-10-07 11:33:28.563096] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.956 [2024-10-07 11:33:28.563130] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.956 [2024-10-07 11:33:28.563146] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.956 [2024-10-07 11:33:28.563163] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.956 [2024-10-07 11:33:28.563177] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.956 [2024-10-07 11:33:28.563207] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.956 [2024-10-07 11:33:28.563764] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.956 [2024-10-07 11:33:28.563795] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.956 [2024-10-07 11:33:28.574429] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.956 [2024-10-07 11:33:28.574479] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.956 [2024-10-07 11:33:28.574901] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.956 [2024-10-07 11:33:28.574945] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.956 [2024-10-07 11:33:28.574966] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.956 [2024-10-07 11:33:28.575017] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.956 [2024-10-07 11:33:28.575040] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.956 [2024-10-07 11:33:28.575055] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.956 [2024-10-07 11:33:28.575219] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.956 [2024-10-07 11:33:28.575249] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.957 [2024-10-07 11:33:28.575346] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.957 [2024-10-07 11:33:28.575365] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.957 [2024-10-07 11:33:28.575380] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.957 [2024-10-07 11:33:28.575396] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.957 [2024-10-07 11:33:28.575411] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.957 [2024-10-07 11:33:28.575424] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.957 [2024-10-07 11:33:28.575476] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.957 [2024-10-07 11:33:28.575494] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.957 [2024-10-07 11:33:28.588596] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.957 [2024-10-07 11:33:28.588659] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.957 [2024-10-07 11:33:28.589409] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.957 [2024-10-07 11:33:28.589471] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.957 [2024-10-07 11:33:28.589494] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.957 [2024-10-07 11:33:28.589547] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.957 [2024-10-07 11:33:28.589570] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.957 [2024-10-07 11:33:28.589585] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.957 [2024-10-07 11:33:28.589694] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.957 [2024-10-07 11:33:28.589722] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.957 [2024-10-07 11:33:28.589743] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.957 [2024-10-07 11:33:28.589758] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.957 [2024-10-07 11:33:28.589771] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.957 [2024-10-07 11:33:28.589788] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.957 [2024-10-07 11:33:28.589802] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.957 [2024-10-07 11:33:28.589814] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.957 [2024-10-07 11:33:28.589837] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.957 [2024-10-07 11:33:28.589851] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.957 [2024-10-07 11:33:28.599067] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.957 [2024-10-07 11:33:28.599117] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.957 [2024-10-07 11:33:28.599306] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.957 [2024-10-07 11:33:28.599338] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.957 [2024-10-07 11:33:28.599355] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.957 [2024-10-07 11:33:28.599404] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.957 [2024-10-07 11:33:28.599427] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.957 [2024-10-07 11:33:28.599442] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.957 [2024-10-07 11:33:28.599545] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.957 [2024-10-07 11:33:28.599570] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.957 [2024-10-07 11:33:28.600422] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.957 [2024-10-07 11:33:28.600458] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.957 [2024-10-07 11:33:28.600476] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.957 [2024-10-07 11:33:28.600493] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.957 [2024-10-07 11:33:28.600508] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.957 [2024-10-07 11:33:28.600537] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.957 [2024-10-07 11:33:28.602406] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.957 [2024-10-07 11:33:28.602444] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.957 [2024-10-07 11:33:28.609180] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.957 [2024-10-07 11:33:28.609241] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.957 [2024-10-07 11:33:28.609316] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.957 [2024-10-07 11:33:28.609345] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.957 [2024-10-07 11:33:28.609361] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.957 [2024-10-07 11:33:28.609416] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.957 [2024-10-07 11:33:28.609439] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.957 [2024-10-07 11:33:28.609455] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.957 [2024-10-07 11:33:28.609472] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.957 [2024-10-07 11:33:28.609496] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.957 [2024-10-07 11:33:28.609512] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.957 [2024-10-07 11:33:28.609526] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.957 [2024-10-07 11:33:28.609539] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.957 [2024-10-07 11:33:28.609562] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.957 [2024-10-07 11:33:28.609576] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.957 [2024-10-07 11:33:28.609589] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.957 [2024-10-07 11:33:28.609602] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.957 [2024-10-07 11:33:28.609622] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.957 [2024-10-07 11:33:28.619256] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.957 [2024-10-07 11:33:28.619365] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.957 [2024-10-07 11:33:28.619396] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.957 [2024-10-07 11:33:28.619412] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.957 [2024-10-07 11:33:28.619450] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.957 [2024-10-07 11:33:28.619479] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.957 [2024-10-07 11:33:28.619505] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.957 [2024-10-07 11:33:28.619521] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.957 [2024-10-07 11:33:28.619534] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.957 [2024-10-07 11:33:28.619555] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.957 [2024-10-07 11:33:28.619623] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.957 [2024-10-07 11:33:28.619663] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.957 [2024-10-07 11:33:28.619682] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.957 [2024-10-07 11:33:28.619705] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.957 [2024-10-07 11:33:28.619727] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.958 [2024-10-07 11:33:28.619741] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.958 [2024-10-07 11:33:28.619754] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.958 [2024-10-07 11:33:28.619777] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.958 [2024-10-07 11:33:28.629337] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.958 [2024-10-07 11:33:28.631237] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.958 [2024-10-07 11:33:28.631283] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.958 [2024-10-07 11:33:28.631304] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.958 [2024-10-07 11:33:28.631677] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.958 [2024-10-07 11:33:28.631765] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.958 [2024-10-07 11:33:28.631801] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.958 [2024-10-07 11:33:28.631817] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.958 [2024-10-07 11:33:28.631831] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.958 [2024-10-07 11:33:28.631854] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.958 [2024-10-07 11:33:28.631911] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.958 [2024-10-07 11:33:28.631937] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.958 [2024-10-07 11:33:28.631953] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.958 [2024-10-07 11:33:28.632661] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.958 [2024-10-07 11:33:28.632880] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.958 [2024-10-07 11:33:28.632907] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.958 [2024-10-07 11:33:28.632922] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.958 [2024-10-07 11:33:28.633055] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.958 [2024-10-07 11:33:28.640426] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.958 [2024-10-07 11:33:28.640545] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.958 [2024-10-07 11:33:28.640576] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.958 [2024-10-07 11:33:28.640593] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.958 [2024-10-07 11:33:28.640639] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.958 [2024-10-07 11:33:28.640681] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.958 [2024-10-07 11:33:28.640696] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.958 [2024-10-07 11:33:28.640710] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.958 [2024-10-07 11:33:28.641377] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.958 [2024-10-07 11:33:28.644138] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.958 [2024-10-07 11:33:28.644299] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.958 [2024-10-07 11:33:28.644330] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.958 [2024-10-07 11:33:28.644346] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.958 [2024-10-07 11:33:28.644370] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.958 [2024-10-07 11:33:28.644392] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.958 [2024-10-07 11:33:28.644407] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.958 [2024-10-07 11:33:28.644420] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.958 [2024-10-07 11:33:28.644443] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.958 [2024-10-07 11:33:28.650694] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.958 [2024-10-07 11:33:28.650799] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.958 [2024-10-07 11:33:28.650828] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.958 [2024-10-07 11:33:28.650845] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.958 [2024-10-07 11:33:28.650868] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.958 [2024-10-07 11:33:28.650890] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.958 [2024-10-07 11:33:28.650904] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.958 [2024-10-07 11:33:28.650917] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.958 [2024-10-07 11:33:28.650941] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.958 [2024-10-07 11:33:28.654215] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.958 [2024-10-07 11:33:28.654315] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.958 [2024-10-07 11:33:28.654345] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.958 [2024-10-07 11:33:28.654361] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.958 [2024-10-07 11:33:28.654384] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.958 [2024-10-07 11:33:28.654406] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.958 [2024-10-07 11:33:28.654421] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.958 [2024-10-07 11:33:28.654449] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.958 [2024-10-07 11:33:28.654474] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.958 [2024-10-07 11:33:28.661364] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.958 [2024-10-07 11:33:28.661574] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.958 [2024-10-07 11:33:28.661606] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.958 [2024-10-07 11:33:28.661624] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.958 [2024-10-07 11:33:28.661781] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.958 [2024-10-07 11:33:28.661914] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.958 [2024-10-07 11:33:28.661947] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.958 [2024-10-07 11:33:28.661964] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.958 [2024-10-07 11:33:28.662460] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.958 [2024-10-07 11:33:28.665393] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.958 [2024-10-07 11:33:28.665610] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.958 [2024-10-07 11:33:28.665642] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.958 [2024-10-07 11:33:28.665676] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.958 [2024-10-07 11:33:28.665804] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.958 [2024-10-07 11:33:28.665921] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.958 [2024-10-07 11:33:28.665948] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.958 [2024-10-07 11:33:28.665964] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.958 [2024-10-07 11:33:28.666074] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.958 [2024-10-07 11:33:28.671478] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.958 [2024-10-07 11:33:28.671581] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.958 [2024-10-07 11:33:28.671612] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.958 [2024-10-07 11:33:28.671628] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.958 [2024-10-07 11:33:28.671667] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.958 [2024-10-07 11:33:28.671693] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.958 [2024-10-07 11:33:28.671707] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.958 [2024-10-07 11:33:28.671721] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.958 [2024-10-07 11:33:28.671743] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.958 [2024-10-07 11:33:28.676509] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.958 [2024-10-07 11:33:28.676613] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.958 [2024-10-07 11:33:28.676675] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.958 [2024-10-07 11:33:28.676696] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.958 [2024-10-07 11:33:28.676721] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.958 [2024-10-07 11:33:28.676744] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.958 [2024-10-07 11:33:28.676758] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.959 [2024-10-07 11:33:28.676771] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.959 [2024-10-07 11:33:28.676794] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.959 [2024-10-07 11:33:28.685552] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.959 [2024-10-07 11:33:28.685670] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.959 [2024-10-07 11:33:28.685701] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.959 [2024-10-07 11:33:28.685718] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.959 [2024-10-07 11:33:28.685741] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.959 [2024-10-07 11:33:28.685764] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.959 [2024-10-07 11:33:28.685778] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.959 [2024-10-07 11:33:28.685792] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.959 [2024-10-07 11:33:28.685816] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.959 [2024-10-07 11:33:28.687758] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.959 [2024-10-07 11:33:28.687863] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.959 [2024-10-07 11:33:28.687893] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.959 [2024-10-07 11:33:28.687910] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.959 [2024-10-07 11:33:28.687933] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.959 [2024-10-07 11:33:28.687955] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.959 [2024-10-07 11:33:28.687969] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.959 [2024-10-07 11:33:28.687983] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.959 [2024-10-07 11:33:28.688005] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.959 [2024-10-07 11:33:28.697432] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.959 [2024-10-07 11:33:28.697540] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.959 [2024-10-07 11:33:28.697571] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.959 [2024-10-07 11:33:28.697588] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.959 [2024-10-07 11:33:28.697611] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.959 [2024-10-07 11:33:28.697663] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.959 [2024-10-07 11:33:28.697682] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.959 [2024-10-07 11:33:28.697695] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.959 [2024-10-07 11:33:28.697719] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.959 [2024-10-07 11:33:28.698182] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.959 [2024-10-07 11:33:28.698285] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.959 [2024-10-07 11:33:28.698314] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.959 [2024-10-07 11:33:28.698330] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.959 [2024-10-07 11:33:28.698354] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.959 [2024-10-07 11:33:28.698376] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.959 [2024-10-07 11:33:28.698390] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.959 [2024-10-07 11:33:28.698403] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.959 [2024-10-07 11:33:28.698425] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.959 [2024-10-07 11:33:28.708463] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.959 [2024-10-07 11:33:28.708607] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.959 [2024-10-07 11:33:28.708700] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.959 [2024-10-07 11:33:28.708729] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.959 [2024-10-07 11:33:28.708746] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.959 [2024-10-07 11:33:28.708895] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.959 [2024-10-07 11:33:28.708923] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.959 [2024-10-07 11:33:28.708940] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.959 [2024-10-07 11:33:28.708958] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.959 [2024-10-07 11:33:28.709535] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.959 [2024-10-07 11:33:28.709574] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.959 [2024-10-07 11:33:28.709592] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.959 [2024-10-07 11:33:28.709606] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.959 [2024-10-07 11:33:28.711532] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.959 [2024-10-07 11:33:28.711570] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.959 [2024-10-07 11:33:28.711587] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.959 [2024-10-07 11:33:28.711602] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.959 [2024-10-07 11:33:28.712248] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.959 [2024-10-07 11:33:28.719739] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.959 [2024-10-07 11:33:28.719787] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.959 [2024-10-07 11:33:28.719981] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.959 [2024-10-07 11:33:28.720012] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.959 [2024-10-07 11:33:28.720028] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.959 [2024-10-07 11:33:28.720078] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.959 [2024-10-07 11:33:28.720102] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.959 [2024-10-07 11:33:28.720116] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.959 [2024-10-07 11:33:28.720229] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.959 [2024-10-07 11:33:28.720255] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.959 [2024-10-07 11:33:28.720361] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.959 [2024-10-07 11:33:28.720382] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.959 [2024-10-07 11:33:28.720396] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.959 [2024-10-07 11:33:28.720413] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.959 [2024-10-07 11:33:28.720427] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.959 [2024-10-07 11:33:28.720440] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.959 [2024-10-07 11:33:28.720539] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.959 [2024-10-07 11:33:28.720557] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.960 [2024-10-07 11:33:28.729960] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.960 [2024-10-07 11:33:28.730008] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.960 [2024-10-07 11:33:28.730092] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.960 [2024-10-07 11:33:28.730121] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.960 [2024-10-07 11:33:28.730137] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.960 [2024-10-07 11:33:28.730183] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.960 [2024-10-07 11:33:28.730206] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.960 [2024-10-07 11:33:28.730221] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.960 [2024-10-07 11:33:28.730243] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.960 [2024-10-07 11:33:28.730263] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.960 [2024-10-07 11:33:28.730282] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.960 [2024-10-07 11:33:28.730313] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.960 [2024-10-07 11:33:28.730328] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.960 [2024-10-07 11:33:28.730344] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.960 [2024-10-07 11:33:28.730358] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.960 [2024-10-07 11:33:28.730370] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.960 [2024-10-07 11:33:28.730393] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.960 [2024-10-07 11:33:28.730407] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.960 [2024-10-07 11:33:28.742735] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.960 [2024-10-07 11:33:28.742779] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.960 [2024-10-07 11:33:28.742958] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.960 [2024-10-07 11:33:28.742989] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.960 [2024-10-07 11:33:28.743006] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.960 [2024-10-07 11:33:28.743053] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.960 [2024-10-07 11:33:28.743077] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.960 [2024-10-07 11:33:28.743092] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.960 [2024-10-07 11:33:28.743335] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.960 [2024-10-07 11:33:28.743456] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.960 [2024-10-07 11:33:28.745298] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.960 [2024-10-07 11:33:28.745420] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.960 [2024-10-07 11:33:28.745500] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.960 [2024-10-07 11:33:28.745571] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.960 [2024-10-07 11:33:28.745637] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.960 [2024-10-07 11:33:28.745726] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.960 [2024-10-07 11:33:28.746453] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.960 [2024-10-07 11:33:28.746563] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.960 [2024-10-07 11:33:28.754186] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.960 [2024-10-07 11:33:28.754304] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.960 [2024-10-07 11:33:28.754566] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.960 [2024-10-07 11:33:28.754678] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.960 [2024-10-07 11:33:28.754764] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.960 [2024-10-07 11:33:28.754837] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.960 [2024-10-07 11:33:28.754878] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.960 [2024-10-07 11:33:28.754896] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.960 [2024-10-07 11:33:28.755021] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.960 [2024-10-07 11:33:28.755049] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.960 [2024-10-07 11:33:28.755216] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.960 [2024-10-07 11:33:28.755238] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.960 [2024-10-07 11:33:28.755252] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.960 [2024-10-07 11:33:28.755269] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.960 [2024-10-07 11:33:28.755284] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.960 [2024-10-07 11:33:28.755297] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.960 [2024-10-07 11:33:28.755400] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.960 [2024-10-07 11:33:28.755418] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.960 [2024-10-07 11:33:28.765770] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.960 [2024-10-07 11:33:28.765884] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.960 [2024-10-07 11:33:28.766054] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.960 [2024-10-07 11:33:28.766148] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.960 [2024-10-07 11:33:28.766219] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.960 [2024-10-07 11:33:28.766343] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.960 [2024-10-07 11:33:28.766425] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.960 [2024-10-07 11:33:28.766492] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.960 [2024-10-07 11:33:28.766568] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.960 [2024-10-07 11:33:28.766661] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.960 [2024-10-07 11:33:28.766765] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.960 [2024-10-07 11:33:28.766838] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.960 [2024-10-07 11:33:28.766903] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.960 [2024-10-07 11:33:28.766971] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.960 [2024-10-07 11:33:28.767035] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.960 [2024-10-07 11:33:28.767096] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.960 [2024-10-07 11:33:28.767201] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.960 [2024-10-07 11:33:28.767281] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.960 [2024-10-07 11:33:28.780582] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.960 [2024-10-07 11:33:28.780720] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.960 [2024-10-07 11:33:28.780876] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.960 [2024-10-07 11:33:28.780967] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.960 [2024-10-07 11:33:28.781037] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.960 [2024-10-07 11:33:28.781144] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.960 [2024-10-07 11:33:28.781244] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.960 [2024-10-07 11:33:28.781314] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.960 [2024-10-07 11:33:28.781390] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.960 [2024-10-07 11:33:28.781464] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.960 [2024-10-07 11:33:28.781542] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.960 [2024-10-07 11:33:28.781619] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.960 [2024-10-07 11:33:28.781701] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.960 [2024-10-07 11:33:28.781772] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.960 [2024-10-07 11:33:28.781858] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.960 [2024-10-07 11:33:28.781935] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.960 [2024-10-07 11:33:28.782014] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.961 [2024-10-07 11:33:28.782081] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.961 [2024-10-07 11:33:28.793486] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.961 [2024-10-07 11:33:28.793599] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.961 [2024-10-07 11:33:28.793777] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.961 [2024-10-07 11:33:28.793870] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.961 [2024-10-07 11:33:28.793941] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.961 [2024-10-07 11:33:28.794049] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.961 [2024-10-07 11:33:28.794129] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.961 [2024-10-07 11:33:28.794214] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.961 [2024-10-07 11:33:28.794295] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.961 [2024-10-07 11:33:28.794370] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.961 [2024-10-07 11:33:28.794462] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.961 [2024-10-07 11:33:28.794536] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.961 [2024-10-07 11:33:28.794629] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.961 [2024-10-07 11:33:28.794723] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.961 [2024-10-07 11:33:28.794792] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.961 [2024-10-07 11:33:28.794855] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.961 [2024-10-07 11:33:28.797309] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.961 [2024-10-07 11:33:28.797409] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.961 [2024-10-07 11:33:28.805351] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.961 [2024-10-07 11:33:28.805463] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.961 [2024-10-07 11:33:28.806296] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.961 [2024-10-07 11:33:28.806419] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.961 [2024-10-07 11:33:28.806495] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.961 [2024-10-07 11:33:28.806604] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.961 [2024-10-07 11:33:28.806713] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.961 [2024-10-07 11:33:28.806785] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.961 [2024-10-07 11:33:28.807026] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.961 [2024-10-07 11:33:28.807115] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.961 [2024-10-07 11:33:28.807942] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.961 [2024-10-07 11:33:28.808038] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.961 [2024-10-07 11:33:28.808105] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.961 [2024-10-07 11:33:28.808173] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.961 [2024-10-07 11:33:28.808237] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.961 [2024-10-07 11:33:28.808314] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.961 [2024-10-07 11:33:28.810220] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.961 [2024-10-07 11:33:28.810316] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.961 [2024-10-07 11:33:28.815760] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.961 [2024-10-07 11:33:28.815870] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.961 [2024-10-07 11:33:28.816024] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.961 [2024-10-07 11:33:28.816115] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.961 [2024-10-07 11:33:28.816186] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.961 [2024-10-07 11:33:28.816296] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.961 [2024-10-07 11:33:28.816377] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.961 [2024-10-07 11:33:28.816465] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.961 [2024-10-07 11:33:28.818998] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.961 [2024-10-07 11:33:28.819110] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.961 [2024-10-07 11:33:28.820027] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.961 [2024-10-07 11:33:28.820141] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.961 [2024-10-07 11:33:28.820212] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.961 [2024-10-07 11:33:28.820286] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.961 [2024-10-07 11:33:28.820350] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.961 [2024-10-07 11:33:28.820411] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.961 [2024-10-07 11:33:28.820701] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.961 [2024-10-07 11:33:28.820791] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.961 [2024-10-07 11:33:28.825991] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.961 [2024-10-07 11:33:28.826121] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.961 [2024-10-07 11:33:28.826262] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.961 [2024-10-07 11:33:28.826363] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.961 [2024-10-07 11:33:28.826476] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.961 [2024-10-07 11:33:28.829193] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.961 [2024-10-07 11:33:28.829315] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.961 [2024-10-07 11:33:28.829391] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.961 [2024-10-07 11:33:28.829462] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.961 [2024-10-07 11:33:28.830511] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.961 [2024-10-07 11:33:28.830615] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.961 [2024-10-07 11:33:28.830731] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.961 [2024-10-07 11:33:28.830804] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.961 [2024-10-07 11:33:28.831055] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.961 [2024-10-07 11:33:28.831137] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.961 [2024-10-07 11:33:28.831218] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.961 [2024-10-07 11:33:28.831285] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.961 [2024-10-07 11:33:28.831452] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.961 [2024-10-07 11:33:28.836148] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.961 [2024-10-07 11:33:28.836337] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.961 [2024-10-07 11:33:28.836449] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.961 [2024-10-07 11:33:28.836523] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.961 [2024-10-07 11:33:28.839402] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.961 [2024-10-07 11:33:28.840164] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.961 [2024-10-07 11:33:28.840278] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.961 [2024-10-07 11:33:28.840350] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.961 [2024-10-07 11:33:28.840433] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.961 [2024-10-07 11:33:28.840763] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.961 [2024-10-07 11:33:28.840904] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.961 [2024-10-07 11:33:28.840989] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.961 [2024-10-07 11:33:28.841056] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.961 [2024-10-07 11:33:28.841239] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.961 [2024-10-07 11:33:28.841409] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.961 [2024-10-07 11:33:28.841499] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.961 [2024-10-07 11:33:28.841567] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.961 [2024-10-07 11:33:28.842266] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.962 [2024-10-07 11:33:28.846426] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.962 [2024-10-07 11:33:28.846596] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.962 [2024-10-07 11:33:28.846717] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.962 [2024-10-07 11:33:28.846793] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.962 [2024-10-07 11:33:28.849482] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.962 [2024-10-07 11:33:28.850360] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.962 [2024-10-07 11:33:28.850458] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.962 [2024-10-07 11:33:28.850552] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.962 [2024-10-07 11:33:28.851322] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.962 [2024-10-07 11:33:28.853134] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.962 [2024-10-07 11:33:28.853904] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.962 [2024-10-07 11:33:28.854024] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.962 [2024-10-07 11:33:28.854098] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.962 [2024-10-07 11:33:28.854301] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.962 [2024-10-07 11:33:28.854399] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.962 [2024-10-07 11:33:28.854467] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.962 [2024-10-07 11:33:28.854529] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.962 [2024-10-07 11:33:28.854614] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.962 [2024-10-07 11:33:28.856563] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.962 [2024-10-07 11:33:28.856776] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.962 [2024-10-07 11:33:28.856874] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.962 [2024-10-07 11:33:28.856978] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.962 [2024-10-07 11:33:28.857058] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.962 [2024-10-07 11:33:28.857134] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.962 [2024-10-07 11:33:28.857211] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.962 [2024-10-07 11:33:28.857285] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.962 [2024-10-07 11:33:28.857361] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.962 [2024-10-07 11:33:28.865187] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.962 [2024-10-07 11:33:28.865445] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.962 [2024-10-07 11:33:28.865542] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.962 [2024-10-07 11:33:28.865614] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.962 [2024-10-07 11:33:28.865803] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.962 [2024-10-07 11:33:28.866186] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.962 [2024-10-07 11:33:28.866271] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.962 [2024-10-07 11:33:28.866369] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.962 [2024-10-07 11:33:28.868357] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.962 [2024-10-07 11:33:28.868536] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.962 [2024-10-07 11:33:28.868706] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.962 [2024-10-07 11:33:28.868820] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.962 [2024-10-07 11:33:28.868892] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.962 [2024-10-07 11:33:28.868969] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.962 [2024-10-07 11:33:28.869046] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.962 [2024-10-07 11:33:28.869111] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.962 [2024-10-07 11:33:28.869154] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.962 [2024-10-07 11:33:28.870025] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.962 [2024-10-07 11:33:28.875332] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.962 [2024-10-07 11:33:28.875518] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.962 [2024-10-07 11:33:28.875612] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.962 [2024-10-07 11:33:28.875715] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.962 [2024-10-07 11:33:28.875802] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.962 [2024-10-07 11:33:28.875899] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.962 [2024-10-07 11:33:28.875989] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.962 [2024-10-07 11:33:28.876055] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.962 [2024-10-07 11:33:28.878564] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.962 [2024-10-07 11:33:28.879692] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.962 [2024-10-07 11:33:28.879953] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.962 [2024-10-07 11:33:28.880049] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.962 [2024-10-07 11:33:28.880121] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.962 [2024-10-07 11:33:28.880998] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.962 [2024-10-07 11:33:28.882868] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.962 [2024-10-07 11:33:28.882964] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.962 [2024-10-07 11:33:28.883032] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.962 [2024-10-07 11:33:28.883357] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.962 [2024-10-07 11:33:28.885488] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.962 [2024-10-07 11:33:28.885669] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.962 [2024-10-07 11:33:28.885784] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.962 [2024-10-07 11:33:28.885858] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.962 [2024-10-07 11:33:28.885936] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.962 [2024-10-07 11:33:28.886014] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.962 [2024-10-07 11:33:28.886080] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.962 [2024-10-07 11:33:28.886142] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.962 [2024-10-07 11:33:28.886217] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.962 [2024-10-07 11:33:28.890961] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.962 [2024-10-07 11:33:28.891238] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.962 [2024-10-07 11:33:28.891354] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.962 [2024-10-07 11:33:28.891427] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.962 [2024-10-07 11:33:28.891587] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.962 [2024-10-07 11:33:28.892289] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.962 [2024-10-07 11:33:28.892400] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.962 [2024-10-07 11:33:28.892470] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.962 [2024-10-07 11:33:28.894611] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.962 [2024-10-07 11:33:28.895989] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.962 [2024-10-07 11:33:28.896185] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.962 [2024-10-07 11:33:28.896280] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.962 [2024-10-07 11:33:28.896352] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.962 [2024-10-07 11:33:28.896429] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.962 [2024-10-07 11:33:28.899020] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.962 [2024-10-07 11:33:28.899135] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.962 [2024-10-07 11:33:28.899222] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.962 [2024-10-07 11:33:28.900080] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.962 [2024-10-07 11:33:28.901109] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.962 [2024-10-07 11:33:28.902783] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.963 [2024-10-07 11:33:28.902918] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.963 [2024-10-07 11:33:28.902996] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.963 [2024-10-07 11:33:28.903717] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.963 8925.75 IOPS, 34.87 MiB/s [2024-10-07T11:33:33.486Z] [2024-10-07 11:33:28.905823] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.963 [2024-10-07 11:33:28.905914] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.963 [2024-10-07 11:33:28.905984] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.963 [2024-10-07 11:33:28.906235] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.963 [2024-10-07 11:33:28.906549] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.963 [2024-10-07 11:33:28.906802] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.963 [2024-10-07 11:33:28.906896] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.963 [2024-10-07 11:33:28.906966] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.963 [2024-10-07 11:33:28.907127] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.963 [2024-10-07 11:33:28.907424] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.963 [2024-10-07 11:33:28.907526] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.963 [2024-10-07 11:33:28.907595] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.963 [2024-10-07 11:33:28.907735] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.963 [2024-10-07 11:33:28.915724] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.963 [2024-10-07 11:33:28.915924] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.963 [2024-10-07 11:33:28.916035] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.963 [2024-10-07 11:33:28.916121] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.963 [2024-10-07 11:33:28.916222] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.963 [2024-10-07 11:33:28.916305] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.963 [2024-10-07 11:33:28.916371] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.963 [2024-10-07 11:33:28.916448] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.963 [2024-10-07 11:33:28.916540] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.963 [2024-10-07 11:33:28.916687] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.963 [2024-10-07 11:33:28.916860] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.963 [2024-10-07 11:33:28.916960] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.963 [2024-10-07 11:33:28.917046] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.963 [2024-10-07 11:33:28.917120] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.963 [2024-10-07 11:33:28.917197] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.963 [2024-10-07 11:33:28.917263] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.963 [2024-10-07 11:33:28.917325] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.963 [2024-10-07 11:33:28.917414] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.963 [2024-10-07 11:33:28.929814] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.963 [2024-10-07 11:33:28.929926] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.963 [2024-10-07 11:33:28.930072] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.963 [2024-10-07 11:33:28.930163] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.963 [2024-10-07 11:33:28.930252] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.963 [2024-10-07 11:33:28.930365] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.963 [2024-10-07 11:33:28.930460] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.963 [2024-10-07 11:33:28.930528] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.963 [2024-10-07 11:33:28.930622] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.963 [2024-10-07 11:33:28.930747] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.963 [2024-10-07 11:33:28.930828] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.963 [2024-10-07 11:33:28.930894] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.963 [2024-10-07 11:33:28.930958] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.963 [2024-10-07 11:33:28.931037] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.963 [2024-10-07 11:33:28.931113] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.963 [2024-10-07 11:33:28.931178] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.963 [2024-10-07 11:33:28.931280] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.963 [2024-10-07 11:33:28.931349] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.963 [2024-10-07 11:33:28.942735] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.963 [2024-10-07 11:33:28.942848] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.963 [2024-10-07 11:33:28.944828] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.963 [2024-10-07 11:33:28.944938] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.963 [2024-10-07 11:33:28.945013] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.963 [2024-10-07 11:33:28.945123] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.963 [2024-10-07 11:33:28.945205] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.963 [2024-10-07 11:33:28.945275] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.963 [2024-10-07 11:33:28.945504] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.963 [2024-10-07 11:33:28.945599] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.963 [2024-10-07 11:33:28.945812] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.963 [2024-10-07 11:33:28.945894] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.963 [2024-10-07 11:33:28.945959] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.963 [2024-10-07 11:33:28.946026] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.963 [2024-10-07 11:33:28.946091] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.963 [2024-10-07 11:33:28.946170] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.963 [2024-10-07 11:33:28.946439] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.963 [2024-10-07 11:33:28.946522] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.963 [2024-10-07 11:33:28.956424] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.963 [2024-10-07 11:33:28.956532] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.963 [2024-10-07 11:33:28.956737] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.963 [2024-10-07 11:33:28.956770] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.963 [2024-10-07 11:33:28.956788] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.963 [2024-10-07 11:33:28.956838] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.963 [2024-10-07 11:33:28.956862] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.963 [2024-10-07 11:33:28.956877] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.963 [2024-10-07 11:33:28.956903] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.963 [2024-10-07 11:33:28.956924] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.963 [2024-10-07 11:33:28.956945] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.963 [2024-10-07 11:33:28.956960] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.963 [2024-10-07 11:33:28.956973] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.963 [2024-10-07 11:33:28.956990] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.963 [2024-10-07 11:33:28.957004] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.963 [2024-10-07 11:33:28.957017] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.963 [2024-10-07 11:33:28.957040] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.963 [2024-10-07 11:33:28.957053] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.963 [2024-10-07 11:33:28.967030] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.963 [2024-10-07 11:33:28.967143] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.963 [2024-10-07 11:33:28.967413] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.963 [2024-10-07 11:33:28.967508] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.964 [2024-10-07 11:33:28.967599] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.964 [2024-10-07 11:33:28.967745] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.964 [2024-10-07 11:33:28.967846] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.964 [2024-10-07 11:33:28.967924] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.964 [2024-10-07 11:33:28.968353] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.964 [2024-10-07 11:33:28.968445] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.964 [2024-10-07 11:33:28.971640] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.964 [2024-10-07 11:33:28.971832] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.964 [2024-10-07 11:33:28.971907] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.964 [2024-10-07 11:33:28.971977] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.964 [2024-10-07 11:33:28.972058] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.964 [2024-10-07 11:33:28.972121] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.964 [2024-10-07 11:33:28.972699] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.964 [2024-10-07 11:33:28.972824] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.964 [2024-10-07 11:33:28.980284] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.964 [2024-10-07 11:33:28.980417] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.964 [2024-10-07 11:33:28.980997] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.964 [2024-10-07 11:33:28.981114] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.964 [2024-10-07 11:33:28.981185] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.964 [2024-10-07 11:33:28.981293] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.964 [2024-10-07 11:33:28.981373] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.964 [2024-10-07 11:33:28.981438] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.964 [2024-10-07 11:33:28.981681] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.964 [2024-10-07 11:33:28.981790] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.964 [2024-10-07 11:33:28.981993] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.964 [2024-10-07 11:33:28.982093] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.964 [2024-10-07 11:33:28.982161] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.964 [2024-10-07 11:33:28.982229] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.964 [2024-10-07 11:33:28.982293] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.964 [2024-10-07 11:33:28.982367] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.964 [2024-10-07 11:33:28.982547] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.964 [2024-10-07 11:33:28.982626] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.964 [2024-10-07 11:33:28.990539] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.964 [2024-10-07 11:33:28.990680] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.964 [2024-10-07 11:33:28.990828] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.964 [2024-10-07 11:33:28.990917] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.964 [2024-10-07 11:33:28.990989] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.964 [2024-10-07 11:33:28.993181] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.964 [2024-10-07 11:33:28.993307] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.964 [2024-10-07 11:33:28.993384] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.964 [2024-10-07 11:33:28.993455] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.964 [2024-10-07 11:33:28.994376] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.964 [2024-10-07 11:33:28.994498] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.964 [2024-10-07 11:33:28.994571] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.964 [2024-10-07 11:33:28.994637] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.964 [2024-10-07 11:33:28.994881] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.964 [2024-10-07 11:33:28.994964] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.964 [2024-10-07 11:33:28.995051] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.964 [2024-10-07 11:33:28.995161] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.964 [2024-10-07 11:33:28.995352] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.964 [2024-10-07 11:33:29.001103] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.964 [2024-10-07 11:33:29.001217] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.964 [2024-10-07 11:33:29.002036] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.964 [2024-10-07 11:33:29.002159] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.964 [2024-10-07 11:33:29.002254] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.964 [2024-10-07 11:33:29.002380] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.964 [2024-10-07 11:33:29.002465] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.964 [2024-10-07 11:33:29.002533] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.964 [2024-10-07 11:33:29.004253] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.964 [2024-10-07 11:33:29.004361] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.964 [2024-10-07 11:33:29.004719] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.964 [2024-10-07 11:33:29.004817] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.964 [2024-10-07 11:33:29.004906] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.964 [2024-10-07 11:33:29.004990] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.964 [2024-10-07 11:33:29.005068] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.964 [2024-10-07 11:33:29.005133] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.964 [2024-10-07 11:33:29.005798] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.964 [2024-10-07 11:33:29.005832] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.964 [2024-10-07 11:33:29.012298] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.964 [2024-10-07 11:33:29.012348] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.964 [2024-10-07 11:33:29.014832] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.964 [2024-10-07 11:33:29.014878] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.964 [2024-10-07 11:33:29.014915] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.964 [2024-10-07 11:33:29.014970] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.964 [2024-10-07 11:33:29.014994] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.964 [2024-10-07 11:33:29.015009] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.964 [2024-10-07 11:33:29.015382] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.965 [2024-10-07 11:33:29.015426] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.965 [2024-10-07 11:33:29.015583] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.965 [2024-10-07 11:33:29.015618] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.965 [2024-10-07 11:33:29.015635] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.965 [2024-10-07 11:33:29.015668] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.965 [2024-10-07 11:33:29.015687] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.965 [2024-10-07 11:33:29.015701] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.965 [2024-10-07 11:33:29.015816] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.965 [2024-10-07 11:33:29.015838] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.965 [2024-10-07 11:33:29.023448] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.965 [2024-10-07 11:33:29.023499] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.965 [2024-10-07 11:33:29.023620] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.965 [2024-10-07 11:33:29.023668] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.965 [2024-10-07 11:33:29.023688] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.965 [2024-10-07 11:33:29.023738] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.965 [2024-10-07 11:33:29.023762] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.965 [2024-10-07 11:33:29.023787] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.965 [2024-10-07 11:33:29.023811] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.965 [2024-10-07 11:33:29.023831] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.965 [2024-10-07 11:33:29.023851] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.965 [2024-10-07 11:33:29.023866] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.965 [2024-10-07 11:33:29.023880] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.965 [2024-10-07 11:33:29.023897] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.965 [2024-10-07 11:33:29.023912] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.965 [2024-10-07 11:33:29.023940] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.965 [2024-10-07 11:33:29.023965] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.965 [2024-10-07 11:33:29.023980] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.965 [2024-10-07 11:33:29.033563] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.965 [2024-10-07 11:33:29.033628] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.965 [2024-10-07 11:33:29.033717] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.965 [2024-10-07 11:33:29.033747] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.965 [2024-10-07 11:33:29.033763] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.965 [2024-10-07 11:33:29.033817] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.965 [2024-10-07 11:33:29.033842] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.965 [2024-10-07 11:33:29.033857] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.965 [2024-10-07 11:33:29.033875] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.965 [2024-10-07 11:33:29.033898] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.965 [2024-10-07 11:33:29.033915] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.965 [2024-10-07 11:33:29.033928] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.965 [2024-10-07 11:33:29.033942] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.965 [2024-10-07 11:33:29.033965] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.965 [2024-10-07 11:33:29.033980] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.965 [2024-10-07 11:33:29.033993] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.965 [2024-10-07 11:33:29.034006] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.965 [2024-10-07 11:33:29.034167] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.965 [2024-10-07 11:33:29.046666] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.965 [2024-10-07 11:33:29.046715] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.965 [2024-10-07 11:33:29.047034] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.965 [2024-10-07 11:33:29.047078] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.965 [2024-10-07 11:33:29.047098] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.965 [2024-10-07 11:33:29.047153] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.965 [2024-10-07 11:33:29.047176] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.965 [2024-10-07 11:33:29.047204] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.965 [2024-10-07 11:33:29.047424] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.965 [2024-10-07 11:33:29.047455] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.965 [2024-10-07 11:33:29.047532] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.965 [2024-10-07 11:33:29.047555] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.965 [2024-10-07 11:33:29.047569] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.965 [2024-10-07 11:33:29.047586] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.965 [2024-10-07 11:33:29.047601] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.965 [2024-10-07 11:33:29.047614] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.965 [2024-10-07 11:33:29.047637] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.965 [2024-10-07 11:33:29.047669] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.965 [2024-10-07 11:33:29.059208] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.965 [2024-10-07 11:33:29.059257] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.965 [2024-10-07 11:33:29.059436] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.965 [2024-10-07 11:33:29.059467] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.965 [2024-10-07 11:33:29.059483] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.965 [2024-10-07 11:33:29.059530] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.965 [2024-10-07 11:33:29.059553] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.965 [2024-10-07 11:33:29.059568] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.965 [2024-10-07 11:33:29.059785] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.965 [2024-10-07 11:33:29.059817] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.965 [2024-10-07 11:33:29.060941] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.965 [2024-10-07 11:33:29.060979] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.965 [2024-10-07 11:33:29.060996] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.965 [2024-10-07 11:33:29.061014] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.965 [2024-10-07 11:33:29.061028] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.965 [2024-10-07 11:33:29.061042] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.965 [2024-10-07 11:33:29.062531] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.965 [2024-10-07 11:33:29.062568] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.965 [2024-10-07 11:33:29.070682] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.965 [2024-10-07 11:33:29.070729] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.965 [2024-10-07 11:33:29.073387] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.965 [2024-10-07 11:33:29.073434] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.965 [2024-10-07 11:33:29.073469] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.965 [2024-10-07 11:33:29.073522] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.965 [2024-10-07 11:33:29.073547] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.966 [2024-10-07 11:33:29.073562] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.966 [2024-10-07 11:33:29.074823] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.966 [2024-10-07 11:33:29.074879] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.966 [2024-10-07 11:33:29.075442] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.966 [2024-10-07 11:33:29.075479] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.966 [2024-10-07 11:33:29.075496] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.966 [2024-10-07 11:33:29.075514] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.966 [2024-10-07 11:33:29.075529] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.966 [2024-10-07 11:33:29.075542] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.966 [2024-10-07 11:33:29.075623] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.966 [2024-10-07 11:33:29.075644] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.966 [2024-10-07 11:33:29.081769] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.966 [2024-10-07 11:33:29.081816] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.966 [2024-10-07 11:33:29.081900] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.966 [2024-10-07 11:33:29.081929] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.966 [2024-10-07 11:33:29.081945] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.966 [2024-10-07 11:33:29.081993] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.966 [2024-10-07 11:33:29.082016] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.966 [2024-10-07 11:33:29.082031] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.966 [2024-10-07 11:33:29.082054] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.966 [2024-10-07 11:33:29.082073] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.966 [2024-10-07 11:33:29.082108] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.966 [2024-10-07 11:33:29.082127] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.966 [2024-10-07 11:33:29.082140] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.966 [2024-10-07 11:33:29.082157] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.966 [2024-10-07 11:33:29.082171] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.966 [2024-10-07 11:33:29.082183] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.966 [2024-10-07 11:33:29.082220] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.966 [2024-10-07 11:33:29.082242] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.966 [2024-10-07 11:33:29.091876] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.966 [2024-10-07 11:33:29.091940] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.966 [2024-10-07 11:33:29.092017] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.966 [2024-10-07 11:33:29.092046] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.966 [2024-10-07 11:33:29.092063] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.966 [2024-10-07 11:33:29.092117] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.966 [2024-10-07 11:33:29.092140] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.966 [2024-10-07 11:33:29.092156] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.966 [2024-10-07 11:33:29.092173] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.966 [2024-10-07 11:33:29.092196] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.966 [2024-10-07 11:33:29.092213] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.966 [2024-10-07 11:33:29.092227] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.966 [2024-10-07 11:33:29.092240] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.966 [2024-10-07 11:33:29.092263] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.966 [2024-10-07 11:33:29.092277] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.966 [2024-10-07 11:33:29.092290] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.966 [2024-10-07 11:33:29.092304] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.966 [2024-10-07 11:33:29.092324] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.966 [2024-10-07 11:33:29.102716] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.966 [2024-10-07 11:33:29.102771] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.966 [2024-10-07 11:33:29.102893] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.966 [2024-10-07 11:33:29.102924] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.966 [2024-10-07 11:33:29.102941] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.966 [2024-10-07 11:33:29.102989] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.966 [2024-10-07 11:33:29.103013] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.966 [2024-10-07 11:33:29.103029] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.966 [2024-10-07 11:33:29.103635] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.966 [2024-10-07 11:33:29.103704] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.966 [2024-10-07 11:33:29.103948] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.966 [2024-10-07 11:33:29.104016] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.966 [2024-10-07 11:33:29.104035] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.966 [2024-10-07 11:33:29.104053] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.966 [2024-10-07 11:33:29.104067] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.966 [2024-10-07 11:33:29.104080] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.966 [2024-10-07 11:33:29.104286] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.966 [2024-10-07 11:33:29.104312] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.966 [2024-10-07 11:33:29.114183] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.966 [2024-10-07 11:33:29.114234] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.966 [2024-10-07 11:33:29.114439] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.966 [2024-10-07 11:33:29.114471] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.966 [2024-10-07 11:33:29.114488] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.966 [2024-10-07 11:33:29.114543] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.966 [2024-10-07 11:33:29.114566] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.966 [2024-10-07 11:33:29.114582] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.966 [2024-10-07 11:33:29.114703] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.966 [2024-10-07 11:33:29.114730] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.966 [2024-10-07 11:33:29.117137] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.966 [2024-10-07 11:33:29.117177] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.966 [2024-10-07 11:33:29.117195] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.966 [2024-10-07 11:33:29.117213] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.966 [2024-10-07 11:33:29.117227] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.966 [2024-10-07 11:33:29.117240] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.966 [2024-10-07 11:33:29.118511] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.966 [2024-10-07 11:33:29.118546] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.966 [2024-10-07 11:33:29.124303] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.966 [2024-10-07 11:33:29.124375] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.966 [2024-10-07 11:33:29.124452] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.966 [2024-10-07 11:33:29.124482] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.966 [2024-10-07 11:33:29.124498] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.966 [2024-10-07 11:33:29.124574] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.966 [2024-10-07 11:33:29.124600] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.967 [2024-10-07 11:33:29.124615] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.967 [2024-10-07 11:33:29.124633] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.967 [2024-10-07 11:33:29.124672] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.967 [2024-10-07 11:33:29.124692] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.967 [2024-10-07 11:33:29.124706] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.967 [2024-10-07 11:33:29.124719] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.967 [2024-10-07 11:33:29.124742] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.967 [2024-10-07 11:33:29.124757] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.967 [2024-10-07 11:33:29.124771] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.967 [2024-10-07 11:33:29.124784] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.967 [2024-10-07 11:33:29.124803] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.967 [2024-10-07 11:33:29.134392] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.967 [2024-10-07 11:33:29.134504] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.967 [2024-10-07 11:33:29.134535] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.967 [2024-10-07 11:33:29.134552] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.967 [2024-10-07 11:33:29.134595] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.967 [2024-10-07 11:33:29.134624] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.967 [2024-10-07 11:33:29.134668] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.967 [2024-10-07 11:33:29.134687] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.967 [2024-10-07 11:33:29.134701] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.967 [2024-10-07 11:33:29.135002] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.967 [2024-10-07 11:33:29.135074] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.967 [2024-10-07 11:33:29.135100] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.967 [2024-10-07 11:33:29.135116] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.967 [2024-10-07 11:33:29.135279] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.967 [2024-10-07 11:33:29.135390] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.967 [2024-10-07 11:33:29.135409] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.967 [2024-10-07 11:33:29.135423] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.967 [2024-10-07 11:33:29.135541] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.967 [2024-10-07 11:33:29.144476] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.967 [2024-10-07 11:33:29.144584] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.967 [2024-10-07 11:33:29.144614] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.967 [2024-10-07 11:33:29.144631] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.967 [2024-10-07 11:33:29.144670] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.967 [2024-10-07 11:33:29.144695] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.967 [2024-10-07 11:33:29.144709] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.967 [2024-10-07 11:33:29.144722] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.967 [2024-10-07 11:33:29.144756] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.967 [2024-10-07 11:33:29.144780] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.967 [2024-10-07 11:33:29.144848] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.967 [2024-10-07 11:33:29.144874] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.967 [2024-10-07 11:33:29.144889] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.967 [2024-10-07 11:33:29.144912] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.967 [2024-10-07 11:33:29.144934] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.967 [2024-10-07 11:33:29.144948] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.967 [2024-10-07 11:33:29.144961] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.967 [2024-10-07 11:33:29.144983] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.967 [2024-10-07 11:33:29.157499] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.967 [2024-10-07 11:33:29.157548] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.967 [2024-10-07 11:33:29.157825] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.967 [2024-10-07 11:33:29.157865] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.967 [2024-10-07 11:33:29.157884] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.967 [2024-10-07 11:33:29.157932] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.967 [2024-10-07 11:33:29.157956] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.967 [2024-10-07 11:33:29.157970] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.967 [2024-10-07 11:33:29.158106] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.967 [2024-10-07 11:33:29.158135] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.967 [2024-10-07 11:33:29.158286] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.967 [2024-10-07 11:33:29.158345] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.967 [2024-10-07 11:33:29.158363] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.967 [2024-10-07 11:33:29.158381] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.967 [2024-10-07 11:33:29.158395] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.967 [2024-10-07 11:33:29.158413] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.967 [2024-10-07 11:33:29.158470] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.967 [2024-10-07 11:33:29.158491] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.967 [2024-10-07 11:33:29.173874] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.967 [2024-10-07 11:33:29.173923] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.967 [2024-10-07 11:33:29.174010] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.967 [2024-10-07 11:33:29.174039] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.967 [2024-10-07 11:33:29.174056] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.967 [2024-10-07 11:33:29.174102] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.967 [2024-10-07 11:33:29.174125] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.967 [2024-10-07 11:33:29.174140] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.967 [2024-10-07 11:33:29.174163] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.967 [2024-10-07 11:33:29.174183] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.967 [2024-10-07 11:33:29.174203] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.967 [2024-10-07 11:33:29.174217] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.967 [2024-10-07 11:33:29.174231] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.967 [2024-10-07 11:33:29.174247] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.967 [2024-10-07 11:33:29.174261] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.967 [2024-10-07 11:33:29.174274] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.967 [2024-10-07 11:33:29.174296] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.967 [2024-10-07 11:33:29.174310] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.967 [2024-10-07 11:33:29.184900] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.967 [2024-10-07 11:33:29.184948] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.967 [2024-10-07 11:33:29.185124] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.967 [2024-10-07 11:33:29.185155] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.967 [2024-10-07 11:33:29.185173] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.967 [2024-10-07 11:33:29.185220] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.967 [2024-10-07 11:33:29.185260] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.967 [2024-10-07 11:33:29.185278] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.967 [2024-10-07 11:33:29.185381] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.967 [2024-10-07 11:33:29.185406] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.968 [2024-10-07 11:33:29.185516] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.968 [2024-10-07 11:33:29.185537] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.968 [2024-10-07 11:33:29.185550] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.968 [2024-10-07 11:33:29.185567] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.968 [2024-10-07 11:33:29.185582] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.968 [2024-10-07 11:33:29.185594] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.968 [2024-10-07 11:33:29.188109] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.968 [2024-10-07 11:33:29.188148] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.968 [2024-10-07 11:33:29.196022] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.968 [2024-10-07 11:33:29.196069] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.968 [2024-10-07 11:33:29.196155] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.968 [2024-10-07 11:33:29.196184] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.968 [2024-10-07 11:33:29.196201] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.968 [2024-10-07 11:33:29.196247] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.968 [2024-10-07 11:33:29.196270] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.968 [2024-10-07 11:33:29.196285] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.968 [2024-10-07 11:33:29.196308] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.968 [2024-10-07 11:33:29.196327] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.968 [2024-10-07 11:33:29.196347] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.968 [2024-10-07 11:33:29.196361] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.968 [2024-10-07 11:33:29.196375] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.968 [2024-10-07 11:33:29.196391] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.968 [2024-10-07 11:33:29.196405] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.968 [2024-10-07 11:33:29.196418] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.968 [2024-10-07 11:33:29.196440] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.968 [2024-10-07 11:33:29.196454] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.968 [2024-10-07 11:33:29.206407] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.968 [2024-10-07 11:33:29.206456] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.968 [2024-10-07 11:33:29.206542] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.968 [2024-10-07 11:33:29.206571] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.968 [2024-10-07 11:33:29.206587] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.968 [2024-10-07 11:33:29.206634] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.968 [2024-10-07 11:33:29.206672] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.968 [2024-10-07 11:33:29.206689] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.968 [2024-10-07 11:33:29.206713] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.968 [2024-10-07 11:33:29.206733] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.968 [2024-10-07 11:33:29.206752] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.968 [2024-10-07 11:33:29.206767] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.968 [2024-10-07 11:33:29.206780] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.968 [2024-10-07 11:33:29.206796] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.968 [2024-10-07 11:33:29.206810] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.968 [2024-10-07 11:33:29.206822] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.968 [2024-10-07 11:33:29.206845] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.968 [2024-10-07 11:33:29.206859] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.968 [2024-10-07 11:33:29.216520] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.968 [2024-10-07 11:33:29.216584] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.968 [2024-10-07 11:33:29.216676] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.968 [2024-10-07 11:33:29.216706] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.968 [2024-10-07 11:33:29.216723] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.968 [2024-10-07 11:33:29.216779] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.968 [2024-10-07 11:33:29.216803] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.968 [2024-10-07 11:33:29.216818] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.968 [2024-10-07 11:33:29.216836] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.968 [2024-10-07 11:33:29.216859] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.968 [2024-10-07 11:33:29.216878] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.968 [2024-10-07 11:33:29.216892] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.968 [2024-10-07 11:33:29.216920] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.968 [2024-10-07 11:33:29.216945] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.968 [2024-10-07 11:33:29.216960] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.968 [2024-10-07 11:33:29.216974] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.968 [2024-10-07 11:33:29.216987] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.968 [2024-10-07 11:33:29.217006] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.968 [2024-10-07 11:33:29.227941] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.968 [2024-10-07 11:33:29.227990] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.968 [2024-10-07 11:33:29.228972] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.968 [2024-10-07 11:33:29.229016] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.968 [2024-10-07 11:33:29.229036] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.968 [2024-10-07 11:33:29.229086] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.968 [2024-10-07 11:33:29.229109] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.968 [2024-10-07 11:33:29.229124] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.968 [2024-10-07 11:33:29.229246] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.968 [2024-10-07 11:33:29.229272] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.968 [2024-10-07 11:33:29.229293] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.968 [2024-10-07 11:33:29.229307] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.968 [2024-10-07 11:33:29.229321] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.968 [2024-10-07 11:33:29.229338] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.968 [2024-10-07 11:33:29.229352] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.968 [2024-10-07 11:33:29.229364] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.968 [2024-10-07 11:33:29.229387] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.968 [2024-10-07 11:33:29.229401] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.969 [2024-10-07 11:33:29.239281] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.969 [2024-10-07 11:33:29.239334] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.969 [2024-10-07 11:33:29.239530] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.969 [2024-10-07 11:33:29.239563] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.969 [2024-10-07 11:33:29.239580] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.969 [2024-10-07 11:33:29.239628] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.969 [2024-10-07 11:33:29.239664] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.969 [2024-10-07 11:33:29.239696] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.969 [2024-10-07 11:33:29.239841] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.969 [2024-10-07 11:33:29.239872] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.969 [2024-10-07 11:33:29.240616] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.969 [2024-10-07 11:33:29.240664] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.969 [2024-10-07 11:33:29.240684] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.969 [2024-10-07 11:33:29.240701] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.969 [2024-10-07 11:33:29.240716] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.969 [2024-10-07 11:33:29.240729] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.969 [2024-10-07 11:33:29.243363] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.969 [2024-10-07 11:33:29.243400] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.969 [2024-10-07 11:33:29.249398] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.969 [2024-10-07 11:33:29.249461] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.969 [2024-10-07 11:33:29.249541] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.969 [2024-10-07 11:33:29.249570] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.969 [2024-10-07 11:33:29.249586] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.969 [2024-10-07 11:33:29.249642] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.969 [2024-10-07 11:33:29.249700] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.969 [2024-10-07 11:33:29.249717] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.969 [2024-10-07 11:33:29.249736] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.969 [2024-10-07 11:33:29.249760] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.969 [2024-10-07 11:33:29.249778] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.969 [2024-10-07 11:33:29.249792] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.969 [2024-10-07 11:33:29.249805] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.969 [2024-10-07 11:33:29.249828] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.969 [2024-10-07 11:33:29.249842] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.969 [2024-10-07 11:33:29.249856] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.969 [2024-10-07 11:33:29.249868] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.969 [2024-10-07 11:33:29.249887] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.969 [2024-10-07 11:33:29.262362] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.969 [2024-10-07 11:33:29.262427] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.969 [2024-10-07 11:33:29.262516] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.969 [2024-10-07 11:33:29.262546] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.969 [2024-10-07 11:33:29.262562] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.969 [2024-10-07 11:33:29.262608] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.969 [2024-10-07 11:33:29.262631] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.969 [2024-10-07 11:33:29.262646] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.969 [2024-10-07 11:33:29.262686] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.969 [2024-10-07 11:33:29.262706] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.969 [2024-10-07 11:33:29.262725] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.969 [2024-10-07 11:33:29.262740] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.969 [2024-10-07 11:33:29.262754] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.969 [2024-10-07 11:33:29.262770] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.969 [2024-10-07 11:33:29.262784] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.969 [2024-10-07 11:33:29.262797] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.969 [2024-10-07 11:33:29.262819] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.969 [2024-10-07 11:33:29.262833] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.969 [2024-10-07 11:33:29.272755] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.969 [2024-10-07 11:33:29.272808] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.969 [2024-10-07 11:33:29.272983] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.969 [2024-10-07 11:33:29.273014] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.969 [2024-10-07 11:33:29.273031] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.969 [2024-10-07 11:33:29.273079] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.969 [2024-10-07 11:33:29.273102] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.969 [2024-10-07 11:33:29.273117] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.969 [2024-10-07 11:33:29.273222] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.969 [2024-10-07 11:33:29.273246] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.969 [2024-10-07 11:33:29.276580] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.969 [2024-10-07 11:33:29.276621] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.969 [2024-10-07 11:33:29.276638] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.969 [2024-10-07 11:33:29.276683] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.969 [2024-10-07 11:33:29.276700] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.969 [2024-10-07 11:33:29.276713] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.969 [2024-10-07 11:33:29.277404] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.969 [2024-10-07 11:33:29.277442] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.969 [2024-10-07 11:33:29.284252] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.969 [2024-10-07 11:33:29.284301] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.969 [2024-10-07 11:33:29.284476] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.969 [2024-10-07 11:33:29.284508] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.969 [2024-10-07 11:33:29.284525] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.969 [2024-10-07 11:33:29.284573] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.969 [2024-10-07 11:33:29.284596] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.969 [2024-10-07 11:33:29.284612] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.969 [2024-10-07 11:33:29.284729] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.969 [2024-10-07 11:33:29.284756] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.969 [2024-10-07 11:33:29.285261] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.969 [2024-10-07 11:33:29.285299] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.969 [2024-10-07 11:33:29.285317] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.969 [2024-10-07 11:33:29.285336] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.969 [2024-10-07 11:33:29.285350] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.969 [2024-10-07 11:33:29.285363] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.969 [2024-10-07 11:33:29.285445] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.969 [2024-10-07 11:33:29.285466] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.969 [2024-10-07 11:33:29.295839] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.969 [2024-10-07 11:33:29.295888] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.969 [2024-10-07 11:33:29.296003] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.969 [2024-10-07 11:33:29.296034] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.969 [2024-10-07 11:33:29.296051] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.969 [2024-10-07 11:33:29.296098] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.969 [2024-10-07 11:33:29.296122] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.970 [2024-10-07 11:33:29.296137] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.970 [2024-10-07 11:33:29.296331] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.970 [2024-10-07 11:33:29.296362] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.970 [2024-10-07 11:33:29.296416] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.970 [2024-10-07 11:33:29.296437] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.970 [2024-10-07 11:33:29.296451] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.970 [2024-10-07 11:33:29.296468] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.970 [2024-10-07 11:33:29.296482] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.970 [2024-10-07 11:33:29.296494] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.970 [2024-10-07 11:33:29.296681] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.970 [2024-10-07 11:33:29.296706] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.970 [2024-10-07 11:33:29.309713] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.970 [2024-10-07 11:33:29.309759] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.970 [2024-10-07 11:33:29.310222] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.970 [2024-10-07 11:33:29.310265] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.970 [2024-10-07 11:33:29.310285] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.970 [2024-10-07 11:33:29.310354] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.970 [2024-10-07 11:33:29.310377] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.970 [2024-10-07 11:33:29.310393] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.970 [2024-10-07 11:33:29.310609] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.970 [2024-10-07 11:33:29.310640] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.970 [2024-10-07 11:33:29.310859] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.970 [2024-10-07 11:33:29.310891] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.970 [2024-10-07 11:33:29.310906] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.970 [2024-10-07 11:33:29.310925] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.970 [2024-10-07 11:33:29.310939] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.970 [2024-10-07 11:33:29.310952] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.970 [2024-10-07 11:33:29.311004] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.970 [2024-10-07 11:33:29.311024] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.970 [2024-10-07 11:33:29.322877] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.970 [2024-10-07 11:33:29.322946] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.970 [2024-10-07 11:33:29.323791] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.970 [2024-10-07 11:33:29.323835] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.970 [2024-10-07 11:33:29.323855] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.970 [2024-10-07 11:33:29.323905] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.970 [2024-10-07 11:33:29.323929] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.970 [2024-10-07 11:33:29.323944] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.970 [2024-10-07 11:33:29.324318] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.970 [2024-10-07 11:33:29.324349] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.970 [2024-10-07 11:33:29.324560] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.970 [2024-10-07 11:33:29.324596] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.970 [2024-10-07 11:33:29.324613] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.970 [2024-10-07 11:33:29.324631] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.970 [2024-10-07 11:33:29.324645] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.970 [2024-10-07 11:33:29.324674] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.970 [2024-10-07 11:33:29.324879] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.970 [2024-10-07 11:33:29.324903] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.970 [2024-10-07 11:33:29.336742] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.970 [2024-10-07 11:33:29.336789] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.970 [2024-10-07 11:33:29.337596] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.970 [2024-10-07 11:33:29.337639] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.970 [2024-10-07 11:33:29.337672] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.970 [2024-10-07 11:33:29.337724] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.970 [2024-10-07 11:33:29.337749] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.970 [2024-10-07 11:33:29.337764] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.970 [2024-10-07 11:33:29.338138] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.970 [2024-10-07 11:33:29.338180] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.970 [2024-10-07 11:33:29.338394] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.970 [2024-10-07 11:33:29.338430] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.970 [2024-10-07 11:33:29.338448] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.970 [2024-10-07 11:33:29.338466] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.970 [2024-10-07 11:33:29.338494] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.970 [2024-10-07 11:33:29.338508] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.970 [2024-10-07 11:33:29.338742] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.970 [2024-10-07 11:33:29.338792] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.970 [2024-10-07 11:33:29.350926] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.970 [2024-10-07 11:33:29.350976] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.970 [2024-10-07 11:33:29.351804] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.970 [2024-10-07 11:33:29.351849] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.970 [2024-10-07 11:33:29.351869] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.970 [2024-10-07 11:33:29.351919] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.970 [2024-10-07 11:33:29.351942] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.970 [2024-10-07 11:33:29.351957] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.970 [2024-10-07 11:33:29.352358] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.970 [2024-10-07 11:33:29.352409] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.970 [2024-10-07 11:33:29.352660] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.970 [2024-10-07 11:33:29.352696] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.970 [2024-10-07 11:33:29.352713] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.970 [2024-10-07 11:33:29.352730] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.970 [2024-10-07 11:33:29.352745] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.970 [2024-10-07 11:33:29.352758] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.970 [2024-10-07 11:33:29.352819] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.970 [2024-10-07 11:33:29.352839] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.970 [2024-10-07 11:33:29.361038] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.970 [2024-10-07 11:33:29.361100] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.970 [2024-10-07 11:33:29.361176] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.970 [2024-10-07 11:33:29.361204] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.970 [2024-10-07 11:33:29.361220] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.970 [2024-10-07 11:33:29.364133] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.970 [2024-10-07 11:33:29.364180] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.970 [2024-10-07 11:33:29.364200] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.970 [2024-10-07 11:33:29.364219] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.970 [2024-10-07 11:33:29.366393] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.970 [2024-10-07 11:33:29.366438] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.970 [2024-10-07 11:33:29.366456] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.970 [2024-10-07 11:33:29.366470] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.970 [2024-10-07 11:33:29.366938] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.971 [2024-10-07 11:33:29.366976] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.971 [2024-10-07 11:33:29.366993] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.971 [2024-10-07 11:33:29.367007] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.971 [2024-10-07 11:33:29.367242] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.971 [2024-10-07 11:33:29.371756] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.971 [2024-10-07 11:33:29.371803] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.971 [2024-10-07 11:33:29.371888] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.971 [2024-10-07 11:33:29.371918] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.971 [2024-10-07 11:33:29.371934] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.971 [2024-10-07 11:33:29.371981] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.971 [2024-10-07 11:33:29.372004] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.971 [2024-10-07 11:33:29.372020] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.971 [2024-10-07 11:33:29.372043] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.971 [2024-10-07 11:33:29.372062] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.971 [2024-10-07 11:33:29.372082] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.971 [2024-10-07 11:33:29.372097] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.971 [2024-10-07 11:33:29.372110] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.971 [2024-10-07 11:33:29.372126] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.971 [2024-10-07 11:33:29.372139] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.971 [2024-10-07 11:33:29.372152] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.971 [2024-10-07 11:33:29.372174] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.971 [2024-10-07 11:33:29.372188] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.971 [2024-10-07 11:33:29.382142] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.971 [2024-10-07 11:33:29.382192] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.971 [2024-10-07 11:33:29.382279] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.971 [2024-10-07 11:33:29.382322] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.971 [2024-10-07 11:33:29.382340] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.971 [2024-10-07 11:33:29.382389] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.971 [2024-10-07 11:33:29.382413] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.971 [2024-10-07 11:33:29.382428] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.971 [2024-10-07 11:33:29.382910] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.971 [2024-10-07 11:33:29.382941] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.971 [2024-10-07 11:33:29.383163] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.971 [2024-10-07 11:33:29.383212] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.971 [2024-10-07 11:33:29.383230] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.971 [2024-10-07 11:33:29.383247] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.971 [2024-10-07 11:33:29.383262] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.971 [2024-10-07 11:33:29.383275] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.971 [2024-10-07 11:33:29.383477] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.971 [2024-10-07 11:33:29.383501] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.971 [2024-10-07 11:33:29.396567] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.971 [2024-10-07 11:33:29.396616] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.971 [2024-10-07 11:33:29.397090] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.971 [2024-10-07 11:33:29.397134] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.971 [2024-10-07 11:33:29.397154] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.971 [2024-10-07 11:33:29.397204] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.971 [2024-10-07 11:33:29.397227] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.971 [2024-10-07 11:33:29.397242] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.971 [2024-10-07 11:33:29.397456] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.971 [2024-10-07 11:33:29.397487] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.971 [2024-10-07 11:33:29.397697] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.971 [2024-10-07 11:33:29.397732] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.971 [2024-10-07 11:33:29.397749] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.971 [2024-10-07 11:33:29.397766] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.971 [2024-10-07 11:33:29.397780] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.971 [2024-10-07 11:33:29.397812] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.971 [2024-10-07 11:33:29.398015] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.971 [2024-10-07 11:33:29.398040] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.971 [2024-10-07 11:33:29.409750] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.971 [2024-10-07 11:33:29.409799] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.971 [2024-10-07 11:33:29.410567] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.971 [2024-10-07 11:33:29.410611] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.971 [2024-10-07 11:33:29.410631] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.971 [2024-10-07 11:33:29.410698] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.971 [2024-10-07 11:33:29.410724] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.971 [2024-10-07 11:33:29.410740] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.971 [2024-10-07 11:33:29.411124] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.971 [2024-10-07 11:33:29.411160] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.971 [2024-10-07 11:33:29.411380] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.971 [2024-10-07 11:33:29.411407] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.971 [2024-10-07 11:33:29.411421] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.971 [2024-10-07 11:33:29.411439] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.971 [2024-10-07 11:33:29.411454] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.971 [2024-10-07 11:33:29.411466] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.971 [2024-10-07 11:33:29.411706] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.971 [2024-10-07 11:33:29.411731] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.971 [2024-10-07 11:33:29.423690] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.971 [2024-10-07 11:33:29.423736] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.971 [2024-10-07 11:33:29.424545] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.971 [2024-10-07 11:33:29.424587] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.971 [2024-10-07 11:33:29.424607] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.971 [2024-10-07 11:33:29.424671] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.971 [2024-10-07 11:33:29.424697] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.971 [2024-10-07 11:33:29.424712] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.971 [2024-10-07 11:33:29.425087] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.971 [2024-10-07 11:33:29.425142] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.971 [2024-10-07 11:33:29.425359] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.971 [2024-10-07 11:33:29.425396] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.971 [2024-10-07 11:33:29.425415] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.971 [2024-10-07 11:33:29.425432] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.971 [2024-10-07 11:33:29.425447] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.971 [2024-10-07 11:33:29.425459] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.971 [2024-10-07 11:33:29.425676] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.971 [2024-10-07 11:33:29.425701] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.971 [2024-10-07 11:33:29.437534] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.971 [2024-10-07 11:33:29.437584] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.971 [2024-10-07 11:33:29.438408] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.972 [2024-10-07 11:33:29.438452] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.972 [2024-10-07 11:33:29.438472] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.972 [2024-10-07 11:33:29.438521] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.972 [2024-10-07 11:33:29.438545] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.972 [2024-10-07 11:33:29.438560] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.972 [2024-10-07 11:33:29.438952] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.972 [2024-10-07 11:33:29.438984] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.972 [2024-10-07 11:33:29.439214] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.972 [2024-10-07 11:33:29.439251] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.972 [2024-10-07 11:33:29.439267] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.972 [2024-10-07 11:33:29.439285] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.972 [2024-10-07 11:33:29.439299] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.972 [2024-10-07 11:33:29.439312] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.972 [2024-10-07 11:33:29.439513] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.972 [2024-10-07 11:33:29.439538] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.972 [2024-10-07 11:33:29.451579] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.972 [2024-10-07 11:33:29.451638] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.972 [2024-10-07 11:33:29.452425] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.972 [2024-10-07 11:33:29.452469] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.972 [2024-10-07 11:33:29.452504] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.972 [2024-10-07 11:33:29.452558] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.972 [2024-10-07 11:33:29.452582] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.972 [2024-10-07 11:33:29.452597] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.972 [2024-10-07 11:33:29.452986] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.972 [2024-10-07 11:33:29.453028] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.972 [2024-10-07 11:33:29.453255] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.972 [2024-10-07 11:33:29.453291] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.972 [2024-10-07 11:33:29.453309] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.972 [2024-10-07 11:33:29.453326] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.972 [2024-10-07 11:33:29.453341] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.972 [2024-10-07 11:33:29.453353] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.972 [2024-10-07 11:33:29.453554] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.972 [2024-10-07 11:33:29.453579] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.972 [2024-10-07 11:33:29.465627] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.972 [2024-10-07 11:33:29.465689] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.972 [2024-10-07 11:33:29.466472] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.972 [2024-10-07 11:33:29.466515] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.972 [2024-10-07 11:33:29.466535] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.972 [2024-10-07 11:33:29.466585] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.972 [2024-10-07 11:33:29.466609] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.972 [2024-10-07 11:33:29.466624] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.972 [2024-10-07 11:33:29.467013] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.972 [2024-10-07 11:33:29.467045] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.972 [2024-10-07 11:33:29.467270] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.972 [2024-10-07 11:33:29.467307] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.972 [2024-10-07 11:33:29.467324] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.972 [2024-10-07 11:33:29.467354] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.972 [2024-10-07 11:33:29.467368] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.972 [2024-10-07 11:33:29.467381] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.972 [2024-10-07 11:33:29.467604] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.972 [2024-10-07 11:33:29.467630] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.972 [2024-10-07 11:33:29.479444] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.972 [2024-10-07 11:33:29.479494] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.972 [2024-10-07 11:33:29.480322] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.972 [2024-10-07 11:33:29.480367] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.972 [2024-10-07 11:33:29.480387] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.972 [2024-10-07 11:33:29.480438] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.972 [2024-10-07 11:33:29.480461] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.972 [2024-10-07 11:33:29.480476] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.972 [2024-10-07 11:33:29.480867] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.972 [2024-10-07 11:33:29.480899] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.972 [2024-10-07 11:33:29.481110] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.972 [2024-10-07 11:33:29.481146] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.972 [2024-10-07 11:33:29.481164] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.972 [2024-10-07 11:33:29.481181] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.972 [2024-10-07 11:33:29.481196] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.972 [2024-10-07 11:33:29.481208] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.972 [2024-10-07 11:33:29.481407] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.972 [2024-10-07 11:33:29.481432] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.972 [2024-10-07 11:33:29.493447] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.972 [2024-10-07 11:33:29.493506] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.972 [2024-10-07 11:33:29.494307] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.972 [2024-10-07 11:33:29.494352] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.972 [2024-10-07 11:33:29.494372] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.972 [2024-10-07 11:33:29.494423] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.972 [2024-10-07 11:33:29.494446] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.972 [2024-10-07 11:33:29.494461] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.972 [2024-10-07 11:33:29.494862] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.972 [2024-10-07 11:33:29.494894] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.972 [2024-10-07 11:33:29.495144] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.972 [2024-10-07 11:33:29.495192] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.972 [2024-10-07 11:33:29.495211] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.972 [2024-10-07 11:33:29.495228] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.972 [2024-10-07 11:33:29.495242] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.972 [2024-10-07 11:33:29.495256] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.972 [2024-10-07 11:33:29.495475] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.972 [2024-10-07 11:33:29.495500] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.972 [2024-10-07 11:33:29.507983] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.973 [2024-10-07 11:33:29.508033] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.973 [2024-10-07 11:33:29.508186] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.973 [2024-10-07 11:33:29.508217] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.973 [2024-10-07 11:33:29.508234] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.973 [2024-10-07 11:33:29.508282] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.973 [2024-10-07 11:33:29.508305] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.973 [2024-10-07 11:33:29.508320] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.973 [2024-10-07 11:33:29.508345] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.973 [2024-10-07 11:33:29.508365] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.973 [2024-10-07 11:33:29.508385] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.973 [2024-10-07 11:33:29.508399] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.973 [2024-10-07 11:33:29.508413] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.973 [2024-10-07 11:33:29.508429] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.973 [2024-10-07 11:33:29.508443] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.973 [2024-10-07 11:33:29.508456] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.973 [2024-10-07 11:33:29.508478] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.973 [2024-10-07 11:33:29.508493] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.973 [2024-10-07 11:33:29.518139] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.973 [2024-10-07 11:33:29.518186] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.973 [2024-10-07 11:33:29.518272] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.973 [2024-10-07 11:33:29.518301] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.973 [2024-10-07 11:33:29.518317] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.973 [2024-10-07 11:33:29.518388] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.973 [2024-10-07 11:33:29.518412] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.973 [2024-10-07 11:33:29.518427] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.973 [2024-10-07 11:33:29.518798] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.973 [2024-10-07 11:33:29.518828] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.973 [2024-10-07 11:33:29.518850] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.973 [2024-10-07 11:33:29.518865] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.973 [2024-10-07 11:33:29.518878] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.973 [2024-10-07 11:33:29.518895] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.973 [2024-10-07 11:33:29.518908] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.973 [2024-10-07 11:33:29.518921] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.973 [2024-10-07 11:33:29.518944] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.973 [2024-10-07 11:33:29.518957] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.973 [2024-10-07 11:33:29.528680] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.973 [2024-10-07 11:33:29.528728] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.973 [2024-10-07 11:33:29.528860] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.973 [2024-10-07 11:33:29.528891] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.973 [2024-10-07 11:33:29.528907] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.973 [2024-10-07 11:33:29.528955] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.973 [2024-10-07 11:33:29.528978] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.973 [2024-10-07 11:33:29.528993] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.973 [2024-10-07 11:33:29.529017] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.973 [2024-10-07 11:33:29.529037] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.973 [2024-10-07 11:33:29.529057] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.973 [2024-10-07 11:33:29.529071] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.973 [2024-10-07 11:33:29.529085] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.973 [2024-10-07 11:33:29.529101] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.973 [2024-10-07 11:33:29.529115] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.973 [2024-10-07 11:33:29.529127] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.973 [2024-10-07 11:33:29.529150] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.973 [2024-10-07 11:33:29.529178] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.973 [2024-10-07 11:33:29.538789] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.973 [2024-10-07 11:33:29.538851] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.973 [2024-10-07 11:33:29.538926] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.973 [2024-10-07 11:33:29.538955] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.973 [2024-10-07 11:33:29.538971] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.973 [2024-10-07 11:33:29.539241] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.973 [2024-10-07 11:33:29.539272] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.973 [2024-10-07 11:33:29.539289] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.973 [2024-10-07 11:33:29.539307] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.973 [2024-10-07 11:33:29.539365] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.973 [2024-10-07 11:33:29.539389] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.973 [2024-10-07 11:33:29.539403] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.973 [2024-10-07 11:33:29.539423] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.973 [2024-10-07 11:33:29.539598] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.973 [2024-10-07 11:33:29.539621] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.973 [2024-10-07 11:33:29.539635] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.973 [2024-10-07 11:33:29.539662] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.973 [2024-10-07 11:33:29.539723] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.973 [2024-10-07 11:33:29.551880] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.973 [2024-10-07 11:33:29.551931] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.973 [2024-10-07 11:33:29.552407] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.973 [2024-10-07 11:33:29.552452] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.973 [2024-10-07 11:33:29.552472] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.973 [2024-10-07 11:33:29.552524] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.973 [2024-10-07 11:33:29.552548] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.973 [2024-10-07 11:33:29.552563] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.973 [2024-10-07 11:33:29.552798] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.973 [2024-10-07 11:33:29.552830] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.973 [2024-10-07 11:33:29.553028] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.973 [2024-10-07 11:33:29.553080] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.973 [2024-10-07 11:33:29.553098] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.973 [2024-10-07 11:33:29.553116] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.973 [2024-10-07 11:33:29.553130] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.973 [2024-10-07 11:33:29.553143] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.973 [2024-10-07 11:33:29.553214] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.973 [2024-10-07 11:33:29.553236] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.973 [2024-10-07 11:33:29.565877] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.973 [2024-10-07 11:33:29.565926] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.973 [2024-10-07 11:33:29.566367] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.973 [2024-10-07 11:33:29.566412] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.973 [2024-10-07 11:33:29.566433] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.974 [2024-10-07 11:33:29.566485] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.974 [2024-10-07 11:33:29.566522] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.974 [2024-10-07 11:33:29.566549] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.974 [2024-10-07 11:33:29.566819] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.974 [2024-10-07 11:33:29.566852] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.974 [2024-10-07 11:33:29.567061] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.974 [2024-10-07 11:33:29.567097] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.974 [2024-10-07 11:33:29.567115] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.974 [2024-10-07 11:33:29.567132] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.974 [2024-10-07 11:33:29.567146] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.974 [2024-10-07 11:33:29.567159] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.974 [2024-10-07 11:33:29.567230] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.974 [2024-10-07 11:33:29.567252] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.974 [2024-10-07 11:33:29.579050] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.974 [2024-10-07 11:33:29.579099] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.974 [2024-10-07 11:33:29.579892] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.974 [2024-10-07 11:33:29.579935] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.974 [2024-10-07 11:33:29.579955] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.974 [2024-10-07 11:33:29.580022] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.974 [2024-10-07 11:33:29.580047] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.974 [2024-10-07 11:33:29.580063] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.974 [2024-10-07 11:33:29.580440] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.974 [2024-10-07 11:33:29.580487] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.974 [2024-10-07 11:33:29.580721] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.974 [2024-10-07 11:33:29.580758] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.974 [2024-10-07 11:33:29.580775] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.974 [2024-10-07 11:33:29.580793] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.974 [2024-10-07 11:33:29.580807] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.974 [2024-10-07 11:33:29.580820] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.974 [2024-10-07 11:33:29.581035] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.974 [2024-10-07 11:33:29.581060] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.974 [2024-10-07 11:33:29.592776] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.974 [2024-10-07 11:33:29.592824] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.974 [2024-10-07 11:33:29.593675] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.974 [2024-10-07 11:33:29.593720] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.974 [2024-10-07 11:33:29.593739] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.974 [2024-10-07 11:33:29.593790] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.974 [2024-10-07 11:33:29.593814] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.974 [2024-10-07 11:33:29.593829] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.974 [2024-10-07 11:33:29.594210] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.974 [2024-10-07 11:33:29.594243] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.974 [2024-10-07 11:33:29.594453] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.974 [2024-10-07 11:33:29.594489] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.974 [2024-10-07 11:33:29.594506] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.974 [2024-10-07 11:33:29.594524] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.974 [2024-10-07 11:33:29.594538] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.974 [2024-10-07 11:33:29.594551] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.974 [2024-10-07 11:33:29.594766] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.974 [2024-10-07 11:33:29.594792] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.974 [2024-10-07 11:33:29.606701] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.974 [2024-10-07 11:33:29.606750] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.974 [2024-10-07 11:33:29.607549] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.974 [2024-10-07 11:33:29.607593] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.974 [2024-10-07 11:33:29.607613] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.974 [2024-10-07 11:33:29.607678] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.974 [2024-10-07 11:33:29.607704] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.974 [2024-10-07 11:33:29.607720] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.974 [2024-10-07 11:33:29.608104] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.974 [2024-10-07 11:33:29.608161] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.974 [2024-10-07 11:33:29.608396] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.974 [2024-10-07 11:33:29.608434] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.974 [2024-10-07 11:33:29.608452] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.974 [2024-10-07 11:33:29.608469] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.974 [2024-10-07 11:33:29.608483] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.974 [2024-10-07 11:33:29.608496] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.974 [2024-10-07 11:33:29.608722] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.974 [2024-10-07 11:33:29.608747] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.974 [2024-10-07 11:33:29.620709] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.974 [2024-10-07 11:33:29.620780] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.974 [2024-10-07 11:33:29.621614] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.974 [2024-10-07 11:33:29.621668] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.974 [2024-10-07 11:33:29.621690] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.974 [2024-10-07 11:33:29.621742] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.974 [2024-10-07 11:33:29.621766] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.974 [2024-10-07 11:33:29.621781] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.974 [2024-10-07 11:33:29.622157] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.974 [2024-10-07 11:33:29.622190] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.974 [2024-10-07 11:33:29.622415] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.974 [2024-10-07 11:33:29.622452] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.974 [2024-10-07 11:33:29.622485] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.974 [2024-10-07 11:33:29.622505] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.974 [2024-10-07 11:33:29.622520] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.974 [2024-10-07 11:33:29.622532] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.974 [2024-10-07 11:33:29.622752] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.974 [2024-10-07 11:33:29.622779] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.974 [2024-10-07 11:33:29.634636] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.974 [2024-10-07 11:33:29.634701] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.974 [2024-10-07 11:33:29.635526] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.974 [2024-10-07 11:33:29.635570] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.974 [2024-10-07 11:33:29.635590] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.974 [2024-10-07 11:33:29.635641] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.974 [2024-10-07 11:33:29.635678] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.974 [2024-10-07 11:33:29.635694] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.974 [2024-10-07 11:33:29.636077] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.974 [2024-10-07 11:33:29.636109] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.975 [2024-10-07 11:33:29.636319] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.975 [2024-10-07 11:33:29.636356] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.975 [2024-10-07 11:33:29.636374] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.975 [2024-10-07 11:33:29.636391] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.975 [2024-10-07 11:33:29.636405] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.975 [2024-10-07 11:33:29.636418] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.975 [2024-10-07 11:33:29.636620] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.975 [2024-10-07 11:33:29.636645] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.975 [2024-10-07 11:33:29.648496] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.975 [2024-10-07 11:33:29.648546] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.975 [2024-10-07 11:33:29.649341] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.975 [2024-10-07 11:33:29.649385] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.975 [2024-10-07 11:33:29.649406] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.975 [2024-10-07 11:33:29.649457] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.975 [2024-10-07 11:33:29.649481] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.975 [2024-10-07 11:33:29.649513] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.975 [2024-10-07 11:33:29.649906] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.975 [2024-10-07 11:33:29.649940] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.975 [2024-10-07 11:33:29.650151] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.975 [2024-10-07 11:33:29.650189] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.975 [2024-10-07 11:33:29.650207] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.975 [2024-10-07 11:33:29.650225] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.975 [2024-10-07 11:33:29.650240] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.975 [2024-10-07 11:33:29.650252] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.975 [2024-10-07 11:33:29.650453] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.975 [2024-10-07 11:33:29.650478] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.975 [2024-10-07 11:33:29.662313] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.975 [2024-10-07 11:33:29.662362] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.975 [2024-10-07 11:33:29.663153] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.975 [2024-10-07 11:33:29.663204] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.975 [2024-10-07 11:33:29.663225] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.975 [2024-10-07 11:33:29.663276] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.975 [2024-10-07 11:33:29.663300] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.975 [2024-10-07 11:33:29.663316] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.975 [2024-10-07 11:33:29.663707] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.975 [2024-10-07 11:33:29.663748] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.975 [2024-10-07 11:33:29.663964] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.975 [2024-10-07 11:33:29.664000] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.975 [2024-10-07 11:33:29.664018] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.975 [2024-10-07 11:33:29.664036] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.975 [2024-10-07 11:33:29.664050] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.975 [2024-10-07 11:33:29.664062] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.975 [2024-10-07 11:33:29.664276] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.975 [2024-10-07 11:33:29.664303] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.975 [2024-10-07 11:33:29.676150] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.975 [2024-10-07 11:33:29.676213] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.975 [2024-10-07 11:33:29.677012] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.975 [2024-10-07 11:33:29.677055] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.975 [2024-10-07 11:33:29.677075] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.975 [2024-10-07 11:33:29.677125] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.975 [2024-10-07 11:33:29.677149] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.975 [2024-10-07 11:33:29.677164] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.975 [2024-10-07 11:33:29.677538] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.975 [2024-10-07 11:33:29.677570] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.975 [2024-10-07 11:33:29.677793] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.975 [2024-10-07 11:33:29.677830] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.975 [2024-10-07 11:33:29.677847] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.975 [2024-10-07 11:33:29.677864] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.975 [2024-10-07 11:33:29.677878] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.975 [2024-10-07 11:33:29.677892] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.975 [2024-10-07 11:33:29.678094] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.975 [2024-10-07 11:33:29.678119] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.975 [2024-10-07 11:33:29.690046] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.975 [2024-10-07 11:33:29.690095] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.975 [2024-10-07 11:33:29.690895] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.975 [2024-10-07 11:33:29.690939] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.975 [2024-10-07 11:33:29.690958] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.975 [2024-10-07 11:33:29.691009] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.975 [2024-10-07 11:33:29.691033] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.975 [2024-10-07 11:33:29.691049] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.975 [2024-10-07 11:33:29.691435] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.975 [2024-10-07 11:33:29.691467] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.975 [2024-10-07 11:33:29.691691] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.975 [2024-10-07 11:33:29.691727] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.975 [2024-10-07 11:33:29.691745] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.975 [2024-10-07 11:33:29.691777] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.975 [2024-10-07 11:33:29.691793] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.975 [2024-10-07 11:33:29.691806] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.975 [2024-10-07 11:33:29.692010] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.975 [2024-10-07 11:33:29.692036] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.975 [2024-10-07 11:33:29.703798] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.975 [2024-10-07 11:33:29.703846] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.975 [2024-10-07 11:33:29.704670] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.975 [2024-10-07 11:33:29.704712] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.975 [2024-10-07 11:33:29.704732] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.975 [2024-10-07 11:33:29.704783] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.975 [2024-10-07 11:33:29.704807] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.975 [2024-10-07 11:33:29.704822] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.975 [2024-10-07 11:33:29.705196] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.975 [2024-10-07 11:33:29.705240] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.975 [2024-10-07 11:33:29.705457] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.975 [2024-10-07 11:33:29.705492] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.975 [2024-10-07 11:33:29.705510] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.975 [2024-10-07 11:33:29.705527] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.975 [2024-10-07 11:33:29.705541] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.975 [2024-10-07 11:33:29.705555] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.975 [2024-10-07 11:33:29.705770] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.975 [2024-10-07 11:33:29.705796] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.976 [2024-10-07 11:33:29.717687] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.976 [2024-10-07 11:33:29.717739] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.976 [2024-10-07 11:33:29.718170] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.976 [2024-10-07 11:33:29.718214] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.976 [2024-10-07 11:33:29.718234] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.976 [2024-10-07 11:33:29.718285] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.976 [2024-10-07 11:33:29.718310] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.976 [2024-10-07 11:33:29.718340] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.976 [2024-10-07 11:33:29.719071] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.976 [2024-10-07 11:33:29.719114] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.976 [2024-10-07 11:33:29.719369] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.976 [2024-10-07 11:33:29.719396] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.976 [2024-10-07 11:33:29.719411] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.976 [2024-10-07 11:33:29.719428] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.976 [2024-10-07 11:33:29.719442] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.976 [2024-10-07 11:33:29.719455] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.976 [2024-10-07 11:33:29.719671] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.976 [2024-10-07 11:33:29.719697] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.976 [2024-10-07 11:33:29.731425] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.976 [2024-10-07 11:33:29.731473] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.976 [2024-10-07 11:33:29.732257] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.976 [2024-10-07 11:33:29.732302] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.976 [2024-10-07 11:33:29.732321] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.976 [2024-10-07 11:33:29.732371] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.976 [2024-10-07 11:33:29.732395] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.976 [2024-10-07 11:33:29.732410] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.976 [2024-10-07 11:33:29.732800] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.976 [2024-10-07 11:33:29.732851] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.976 [2024-10-07 11:33:29.733065] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.976 [2024-10-07 11:33:29.733100] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.976 [2024-10-07 11:33:29.733118] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.976 [2024-10-07 11:33:29.733135] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.976 [2024-10-07 11:33:29.733149] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.976 [2024-10-07 11:33:29.733161] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.976 [2024-10-07 11:33:29.733361] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.976 [2024-10-07 11:33:29.733386] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.976 [2024-10-07 11:33:29.745192] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.976 [2024-10-07 11:33:29.745241] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.976 [2024-10-07 11:33:29.746068] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.976 [2024-10-07 11:33:29.746113] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.976 [2024-10-07 11:33:29.746134] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.976 [2024-10-07 11:33:29.746185] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.976 [2024-10-07 11:33:29.746209] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.976 [2024-10-07 11:33:29.746224] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.976 [2024-10-07 11:33:29.746600] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.976 [2024-10-07 11:33:29.746632] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.976 [2024-10-07 11:33:29.746860] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.976 [2024-10-07 11:33:29.746897] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.976 [2024-10-07 11:33:29.746914] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.976 [2024-10-07 11:33:29.746932] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.976 [2024-10-07 11:33:29.746946] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.976 [2024-10-07 11:33:29.746959] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.976 [2024-10-07 11:33:29.747159] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.976 [2024-10-07 11:33:29.747196] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.976 [2024-10-07 11:33:29.759055] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.976 [2024-10-07 11:33:29.759105] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.976 [2024-10-07 11:33:29.759917] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.976 [2024-10-07 11:33:29.759961] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.976 [2024-10-07 11:33:29.759980] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.976 [2024-10-07 11:33:29.760029] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.976 [2024-10-07 11:33:29.760052] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.976 [2024-10-07 11:33:29.760067] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.976 [2024-10-07 11:33:29.760440] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.976 [2024-10-07 11:33:29.760471] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.976 [2024-10-07 11:33:29.760696] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.976 [2024-10-07 11:33:29.760733] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.976 [2024-10-07 11:33:29.760751] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.976 [2024-10-07 11:33:29.760768] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.976 [2024-10-07 11:33:29.760797] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.976 [2024-10-07 11:33:29.760811] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.976 [2024-10-07 11:33:29.761021] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.976 [2024-10-07 11:33:29.761046] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.976 [2024-10-07 11:33:29.772934] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.976 [2024-10-07 11:33:29.772986] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.976 [2024-10-07 11:33:29.773924] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.976 [2024-10-07 11:33:29.773968] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.976 [2024-10-07 11:33:29.773988] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.976 [2024-10-07 11:33:29.774039] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.976 [2024-10-07 11:33:29.774062] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.976 [2024-10-07 11:33:29.774077] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.976 [2024-10-07 11:33:29.774465] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.976 [2024-10-07 11:33:29.774498] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.976 [2024-10-07 11:33:29.774725] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.976 [2024-10-07 11:33:29.774758] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.976 [2024-10-07 11:33:29.774774] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.976 [2024-10-07 11:33:29.774791] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.976 [2024-10-07 11:33:29.774805] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.976 [2024-10-07 11:33:29.774817] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.976 [2024-10-07 11:33:29.775018] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.976 [2024-10-07 11:33:29.775043] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.976 [2024-10-07 11:33:29.786665] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.976 [2024-10-07 11:33:29.786715] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.976 [2024-10-07 11:33:29.787592] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.976 [2024-10-07 11:33:29.787636] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.976 [2024-10-07 11:33:29.787670] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.976 [2024-10-07 11:33:29.787724] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.976 [2024-10-07 11:33:29.787748] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.977 [2024-10-07 11:33:29.787764] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.977 [2024-10-07 11:33:29.788169] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.977 [2024-10-07 11:33:29.788211] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.977 [2024-10-07 11:33:29.788427] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.977 [2024-10-07 11:33:29.788462] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.977 [2024-10-07 11:33:29.788481] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.977 [2024-10-07 11:33:29.788499] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.977 [2024-10-07 11:33:29.788513] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.977 [2024-10-07 11:33:29.788525] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.977 [2024-10-07 11:33:29.788742] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.977 [2024-10-07 11:33:29.788767] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.977 [2024-10-07 11:33:29.800617] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.977 [2024-10-07 11:33:29.800676] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.977 [2024-10-07 11:33:29.801509] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.977 [2024-10-07 11:33:29.801552] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.977 [2024-10-07 11:33:29.801573] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.977 [2024-10-07 11:33:29.801623] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.977 [2024-10-07 11:33:29.801660] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.977 [2024-10-07 11:33:29.801678] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.977 [2024-10-07 11:33:29.802072] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.977 [2024-10-07 11:33:29.802113] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.977 [2024-10-07 11:33:29.802346] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.977 [2024-10-07 11:33:29.802383] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.977 [2024-10-07 11:33:29.802400] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.977 [2024-10-07 11:33:29.802417] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.977 [2024-10-07 11:33:29.802431] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.977 [2024-10-07 11:33:29.802443] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.977 [2024-10-07 11:33:29.802645] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.977 [2024-10-07 11:33:29.802684] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.977 [2024-10-07 11:33:29.814131] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.977 [2024-10-07 11:33:29.814180] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.977 [2024-10-07 11:33:29.814565] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.977 [2024-10-07 11:33:29.814609] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.977 [2024-10-07 11:33:29.814629] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.977 [2024-10-07 11:33:29.814693] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.977 [2024-10-07 11:33:29.814719] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.977 [2024-10-07 11:33:29.814734] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.977 [2024-10-07 11:33:29.814960] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.977 [2024-10-07 11:33:29.814991] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.977 [2024-10-07 11:33:29.815604] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.977 [2024-10-07 11:33:29.815642] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.977 [2024-10-07 11:33:29.815674] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.977 [2024-10-07 11:33:29.815692] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.977 [2024-10-07 11:33:29.815706] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.977 [2024-10-07 11:33:29.815719] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.977 [2024-10-07 11:33:29.815959] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.977 [2024-10-07 11:33:29.815985] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.977 [2024-10-07 11:33:29.825944] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.977 [2024-10-07 11:33:29.825993] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.977 [2024-10-07 11:33:29.826165] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.977 [2024-10-07 11:33:29.826205] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.977 [2024-10-07 11:33:29.826225] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.977 [2024-10-07 11:33:29.826274] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.977 [2024-10-07 11:33:29.826297] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.977 [2024-10-07 11:33:29.826312] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.977 [2024-10-07 11:33:29.826445] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.977 [2024-10-07 11:33:29.826476] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.977 [2024-10-07 11:33:29.828909] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.977 [2024-10-07 11:33:29.828950] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.977 [2024-10-07 11:33:29.828968] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.977 [2024-10-07 11:33:29.828985] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.977 [2024-10-07 11:33:29.829014] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.977 [2024-10-07 11:33:29.829028] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.977 [2024-10-07 11:33:29.830300] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.977 [2024-10-07 11:33:29.830337] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.977 [2024-10-07 11:33:29.836057] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.977 [2024-10-07 11:33:29.836121] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.977 [2024-10-07 11:33:29.836198] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.977 [2024-10-07 11:33:29.836227] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.977 [2024-10-07 11:33:29.836243] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.977 [2024-10-07 11:33:29.836298] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.977 [2024-10-07 11:33:29.836322] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.977 [2024-10-07 11:33:29.836338] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.977 [2024-10-07 11:33:29.836355] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.977 [2024-10-07 11:33:29.836378] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.977 [2024-10-07 11:33:29.836396] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.977 [2024-10-07 11:33:29.836409] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.977 [2024-10-07 11:33:29.836422] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.977 [2024-10-07 11:33:29.836454] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.977 [2024-10-07 11:33:29.836469] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.977 [2024-10-07 11:33:29.836482] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.978 [2024-10-07 11:33:29.836494] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.978 [2024-10-07 11:33:29.836514] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.978 [2024-10-07 11:33:29.846140] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.978 [2024-10-07 11:33:29.846249] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.978 [2024-10-07 11:33:29.846280] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.978 [2024-10-07 11:33:29.846297] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.978 [2024-10-07 11:33:29.846334] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.978 [2024-10-07 11:33:29.846365] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.978 [2024-10-07 11:33:29.846392] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.978 [2024-10-07 11:33:29.846408] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.978 [2024-10-07 11:33:29.846421] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.978 [2024-10-07 11:33:29.846729] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.978 [2024-10-07 11:33:29.846800] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.978 [2024-10-07 11:33:29.846826] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.978 [2024-10-07 11:33:29.846842] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.978 [2024-10-07 11:33:29.847000] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.978 [2024-10-07 11:33:29.847107] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.978 [2024-10-07 11:33:29.847131] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.978 [2024-10-07 11:33:29.847152] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.978 [2024-10-07 11:33:29.847298] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.978 [2024-10-07 11:33:29.858194] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.978 [2024-10-07 11:33:29.858244] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.978 [2024-10-07 11:33:29.858332] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.978 [2024-10-07 11:33:29.858361] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.978 [2024-10-07 11:33:29.858378] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.978 [2024-10-07 11:33:29.858426] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.978 [2024-10-07 11:33:29.858448] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.978 [2024-10-07 11:33:29.858463] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.978 [2024-10-07 11:33:29.858486] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.978 [2024-10-07 11:33:29.858506] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.978 [2024-10-07 11:33:29.858525] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.978 [2024-10-07 11:33:29.858540] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.978 [2024-10-07 11:33:29.858553] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.978 [2024-10-07 11:33:29.858570] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.978 [2024-10-07 11:33:29.858584] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.978 [2024-10-07 11:33:29.858596] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.978 [2024-10-07 11:33:29.858619] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.978 [2024-10-07 11:33:29.858633] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.978 [2024-10-07 11:33:29.868734] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.978 [2024-10-07 11:33:29.868784] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.978 [2024-10-07 11:33:29.868870] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.978 [2024-10-07 11:33:29.868898] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.978 [2024-10-07 11:33:29.868932] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.978 [2024-10-07 11:33:29.868983] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.978 [2024-10-07 11:33:29.869007] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.978 [2024-10-07 11:33:29.869022] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.978 [2024-10-07 11:33:29.869046] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.978 [2024-10-07 11:33:29.869065] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.978 [2024-10-07 11:33:29.869085] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.978 [2024-10-07 11:33:29.869099] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.978 [2024-10-07 11:33:29.869113] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.978 [2024-10-07 11:33:29.869129] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.978 [2024-10-07 11:33:29.869143] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.978 [2024-10-07 11:33:29.869155] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.978 [2024-10-07 11:33:29.869178] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.978 [2024-10-07 11:33:29.869192] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.978 [2024-10-07 11:33:29.880537] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.978 [2024-10-07 11:33:29.880588] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.978 [2024-10-07 11:33:29.880869] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.978 [2024-10-07 11:33:29.880912] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.978 [2024-10-07 11:33:29.880932] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.978 [2024-10-07 11:33:29.880982] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.978 [2024-10-07 11:33:29.881005] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.978 [2024-10-07 11:33:29.881021] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.978 [2024-10-07 11:33:29.881130] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.978 [2024-10-07 11:33:29.881159] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.978 [2024-10-07 11:33:29.881181] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.978 [2024-10-07 11:33:29.881196] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.978 [2024-10-07 11:33:29.881209] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.978 [2024-10-07 11:33:29.881226] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.978 [2024-10-07 11:33:29.881240] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.978 [2024-10-07 11:33:29.881276] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.978 [2024-10-07 11:33:29.881302] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.978 [2024-10-07 11:33:29.881316] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.978 [2024-10-07 11:33:29.890843] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.978 [2024-10-07 11:33:29.890910] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.978 [2024-10-07 11:33:29.890987] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.978 [2024-10-07 11:33:29.891016] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.978 [2024-10-07 11:33:29.891033] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.978 [2024-10-07 11:33:29.891087] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.978 [2024-10-07 11:33:29.891112] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.978 [2024-10-07 11:33:29.891127] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.978 [2024-10-07 11:33:29.891145] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.978 [2024-10-07 11:33:29.891334] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.978 [2024-10-07 11:33:29.891363] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.978 [2024-10-07 11:33:29.891378] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.978 [2024-10-07 11:33:29.891391] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.978 [2024-10-07 11:33:29.891449] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.978 [2024-10-07 11:33:29.891470] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.978 [2024-10-07 11:33:29.891483] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.978 [2024-10-07 11:33:29.891496] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.978 [2024-10-07 11:33:29.891685] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.978 [2024-10-07 11:33:29.903832] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.978 [2024-10-07 11:33:29.903881] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.978 8939.62 IOPS, 34.92 MiB/s [2024-10-07T11:33:33.501Z] [2024-10-07 11:33:29.907307] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.978 [2024-10-07 11:33:29.907350] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.978 [2024-10-07 11:33:29.907370] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.979 [2024-10-07 11:33:29.907422] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.979 [2024-10-07 11:33:29.907445] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.979 [2024-10-07 11:33:29.907460] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.979 [2024-10-07 11:33:29.908190] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.979 [2024-10-07 11:33:29.908249] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.979 [2024-10-07 11:33:29.908474] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.979 [2024-10-07 11:33:29.908510] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.979 [2024-10-07 11:33:29.908533] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.979 [2024-10-07 11:33:29.908551] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.979 [2024-10-07 11:33:29.908565] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.979 [2024-10-07 11:33:29.908578] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.979 [2024-10-07 11:33:29.908719] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.979 [2024-10-07 11:33:29.908743] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.979 [2024-10-07 11:33:29.918937] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.979 [2024-10-07 11:33:29.918987] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.979 [2024-10-07 11:33:29.919168] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.979 [2024-10-07 11:33:29.919219] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.979 [2024-10-07 11:33:29.919239] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.979 [2024-10-07 11:33:29.919289] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.979 [2024-10-07 11:33:29.919313] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.979 [2024-10-07 11:33:29.919328] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.979 [2024-10-07 11:33:29.919352] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.979 [2024-10-07 11:33:29.919372] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.979 [2024-10-07 11:33:29.919392] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.979 [2024-10-07 11:33:29.919406] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.979 [2024-10-07 11:33:29.919426] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.979 [2024-10-07 11:33:29.919443] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.979 [2024-10-07 11:33:29.919457] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.979 [2024-10-07 11:33:29.919469] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.979 [2024-10-07 11:33:29.919492] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.979 [2024-10-07 11:33:29.919506] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.979 [2024-10-07 11:33:29.929957] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.979 [2024-10-07 11:33:29.930017] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.979 [2024-10-07 11:33:29.930823] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.979 [2024-10-07 11:33:29.930872] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.979 [2024-10-07 11:33:29.930909] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.979 [2024-10-07 11:33:29.930973] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.979 [2024-10-07 11:33:29.930998] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.979 [2024-10-07 11:33:29.931013] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.979 [2024-10-07 11:33:29.933073] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.979 [2024-10-07 11:33:29.933117] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.979 [2024-10-07 11:33:29.933634] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.979 [2024-10-07 11:33:29.933683] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.979 [2024-10-07 11:33:29.933701] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.979 [2024-10-07 11:33:29.933718] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.979 [2024-10-07 11:33:29.933732] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.979 [2024-10-07 11:33:29.933746] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.979 [2024-10-07 11:33:29.933830] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.979 [2024-10-07 11:33:29.933851] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.979 [2024-10-07 11:33:29.942360] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.979 [2024-10-07 11:33:29.942410] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.979 [2024-10-07 11:33:29.942525] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.979 [2024-10-07 11:33:29.942555] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.979 [2024-10-07 11:33:29.942572] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.979 [2024-10-07 11:33:29.942619] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.979 [2024-10-07 11:33:29.942642] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.979 [2024-10-07 11:33:29.942672] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.979 [2024-10-07 11:33:29.942698] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.979 [2024-10-07 11:33:29.942718] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.979 [2024-10-07 11:33:29.942738] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.979 [2024-10-07 11:33:29.942752] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.979 [2024-10-07 11:33:29.942766] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.979 [2024-10-07 11:33:29.942782] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.979 [2024-10-07 11:33:29.942796] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.979 [2024-10-07 11:33:29.942808] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.979 [2024-10-07 11:33:29.942846] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.979 [2024-10-07 11:33:29.942861] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.979 [2024-10-07 11:33:29.952781] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.979 [2024-10-07 11:33:29.952829] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.979 [2024-10-07 11:33:29.954045] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.979 [2024-10-07 11:33:29.954088] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.979 [2024-10-07 11:33:29.954113] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.979 [2024-10-07 11:33:29.954191] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.979 [2024-10-07 11:33:29.954217] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.979 [2024-10-07 11:33:29.954232] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.979 [2024-10-07 11:33:29.956066] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.979 [2024-10-07 11:33:29.956112] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.979 [2024-10-07 11:33:29.956801] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.979 [2024-10-07 11:33:29.956841] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.979 [2024-10-07 11:33:29.956859] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.979 [2024-10-07 11:33:29.956876] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.979 [2024-10-07 11:33:29.956890] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.979 [2024-10-07 11:33:29.956902] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.979 [2024-10-07 11:33:29.957150] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.979 [2024-10-07 11:33:29.957176] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.979 [2024-10-07 11:33:29.964413] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.979 [2024-10-07 11:33:29.964474] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.979 [2024-10-07 11:33:29.964730] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.979 [2024-10-07 11:33:29.964774] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.979 [2024-10-07 11:33:29.964794] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.979 [2024-10-07 11:33:29.964853] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.979 [2024-10-07 11:33:29.964877] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.979 [2024-10-07 11:33:29.964902] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.979 [2024-10-07 11:33:29.965078] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.980 [2024-10-07 11:33:29.965116] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.980 [2024-10-07 11:33:29.965269] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.980 [2024-10-07 11:33:29.965294] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.980 [2024-10-07 11:33:29.965309] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.980 [2024-10-07 11:33:29.965326] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.980 [2024-10-07 11:33:29.965341] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.980 [2024-10-07 11:33:29.965354] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.980 [2024-10-07 11:33:29.965492] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.980 [2024-10-07 11:33:29.965529] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.980 [2024-10-07 11:33:29.974577] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.980 [2024-10-07 11:33:29.974684] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.980 [2024-10-07 11:33:29.974795] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.980 [2024-10-07 11:33:29.974826] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.980 [2024-10-07 11:33:29.974844] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.980 [2024-10-07 11:33:29.974919] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.980 [2024-10-07 11:33:29.974957] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.980 [2024-10-07 11:33:29.974973] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.980 [2024-10-07 11:33:29.974998] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.980 [2024-10-07 11:33:29.975044] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.980 [2024-10-07 11:33:29.975062] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.980 [2024-10-07 11:33:29.975076] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.980 [2024-10-07 11:33:29.975091] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.980 [2024-10-07 11:33:29.975125] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.980 [2024-10-07 11:33:29.975140] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.980 [2024-10-07 11:33:29.975153] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.980 [2024-10-07 11:33:29.975167] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.980 [2024-10-07 11:33:29.975201] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.980 [2024-10-07 11:33:29.985058] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.980 [2024-10-07 11:33:29.985142] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.980 [2024-10-07 11:33:29.985256] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.980 [2024-10-07 11:33:29.985288] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.980 [2024-10-07 11:33:29.985305] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.980 [2024-10-07 11:33:29.985386] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.980 [2024-10-07 11:33:29.985411] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.980 [2024-10-07 11:33:29.985426] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.980 [2024-10-07 11:33:29.985451] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.980 [2024-10-07 11:33:29.985471] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.980 [2024-10-07 11:33:29.985497] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.980 [2024-10-07 11:33:29.985512] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.980 [2024-10-07 11:33:29.985527] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.980 [2024-10-07 11:33:29.985544] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.980 [2024-10-07 11:33:29.985557] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.980 [2024-10-07 11:33:29.985570] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.980 [2024-10-07 11:33:29.985603] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.980 [2024-10-07 11:33:29.985618] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.980 [2024-10-07 11:33:29.995258] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.980 [2024-10-07 11:33:29.995353] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.980 [2024-10-07 11:33:29.995464] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.980 [2024-10-07 11:33:29.995496] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.980 [2024-10-07 11:33:29.995513] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.980 [2024-10-07 11:33:29.995584] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.980 [2024-10-07 11:33:29.995616] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.980 [2024-10-07 11:33:29.995631] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.980 [2024-10-07 11:33:29.995663] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.980 [2024-10-07 11:33:29.995692] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.980 [2024-10-07 11:33:29.995711] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.980 [2024-10-07 11:33:29.995726] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.980 [2024-10-07 11:33:29.995740] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.980 [2024-10-07 11:33:29.995765] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.980 [2024-10-07 11:33:29.995780] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.980 [2024-10-07 11:33:29.995793] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.980 [2024-10-07 11:33:29.995806] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.980 [2024-10-07 11:33:29.995857] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.980 [2024-10-07 11:33:30.009539] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.980 [2024-10-07 11:33:30.009644] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.980 [2024-10-07 11:33:30.010672] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.980 [2024-10-07 11:33:30.010720] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.980 [2024-10-07 11:33:30.010742] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.980 [2024-10-07 11:33:30.010797] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.980 [2024-10-07 11:33:30.010821] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.980 [2024-10-07 11:33:30.010837] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.980 [2024-10-07 11:33:30.011246] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.980 [2024-10-07 11:33:30.011279] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.980 [2024-10-07 11:33:30.011492] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.980 [2024-10-07 11:33:30.011528] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.980 [2024-10-07 11:33:30.011548] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.980 [2024-10-07 11:33:30.011567] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.980 [2024-10-07 11:33:30.011582] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.980 [2024-10-07 11:33:30.011596] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.980 [2024-10-07 11:33:30.011818] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.980 [2024-10-07 11:33:30.011844] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.980 [2024-10-07 11:33:30.020027] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.980 [2024-10-07 11:33:30.020081] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.980 [2024-10-07 11:33:30.020271] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.980 [2024-10-07 11:33:30.020312] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.980 [2024-10-07 11:33:30.020332] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.980 [2024-10-07 11:33:30.020382] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.980 [2024-10-07 11:33:30.020406] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.980 [2024-10-07 11:33:30.020422] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.980 [2024-10-07 11:33:30.020535] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.980 [2024-10-07 11:33:30.020561] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.980 [2024-10-07 11:33:30.020686] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.980 [2024-10-07 11:33:30.020753] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.980 [2024-10-07 11:33:30.020769] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.980 [2024-10-07 11:33:30.020786] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.980 [2024-10-07 11:33:30.020800] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.980 [2024-10-07 11:33:30.020813] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.981 [2024-10-07 11:33:30.021353] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.981 [2024-10-07 11:33:30.021392] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.981 [2024-10-07 11:33:30.030283] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.981 [2024-10-07 11:33:30.030370] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.981 [2024-10-07 11:33:30.030490] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.981 [2024-10-07 11:33:30.030523] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.981 [2024-10-07 11:33:30.030541] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.981 [2024-10-07 11:33:30.030590] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.981 [2024-10-07 11:33:30.030613] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.981 [2024-10-07 11:33:30.030629] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.981 [2024-10-07 11:33:30.030671] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.981 [2024-10-07 11:33:30.030694] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.981 [2024-10-07 11:33:30.030715] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.981 [2024-10-07 11:33:30.030730] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.981 [2024-10-07 11:33:30.030746] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.981 [2024-10-07 11:33:30.030763] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.981 [2024-10-07 11:33:30.030777] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.981 [2024-10-07 11:33:30.030790] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.981 [2024-10-07 11:33:30.030823] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.981 [2024-10-07 11:33:30.030838] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.981 [2024-10-07 11:33:30.040905] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.981 [2024-10-07 11:33:30.040987] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.981 [2024-10-07 11:33:30.041193] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.981 [2024-10-07 11:33:30.041236] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.981 [2024-10-07 11:33:30.041257] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.981 [2024-10-07 11:33:30.041309] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.981 [2024-10-07 11:33:30.041366] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.981 [2024-10-07 11:33:30.041384] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.981 [2024-10-07 11:33:30.041847] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.981 [2024-10-07 11:33:30.041888] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.981 [2024-10-07 11:33:30.042059] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.981 [2024-10-07 11:33:30.042085] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.981 [2024-10-07 11:33:30.042101] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.981 [2024-10-07 11:33:30.042120] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.981 [2024-10-07 11:33:30.042135] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.981 [2024-10-07 11:33:30.042148] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.981 [2024-10-07 11:33:30.042293] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.981 [2024-10-07 11:33:30.042317] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.981 [2024-10-07 11:33:30.051461] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.981 [2024-10-07 11:33:30.051552] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.981 [2024-10-07 11:33:30.051798] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.981 [2024-10-07 11:33:30.051843] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.981 [2024-10-07 11:33:30.051867] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.981 [2024-10-07 11:33:30.051917] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.981 [2024-10-07 11:33:30.051940] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.981 [2024-10-07 11:33:30.051956] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.981 [2024-10-07 11:33:30.052095] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.981 [2024-10-07 11:33:30.052134] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.981 [2024-10-07 11:33:30.052551] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.981 [2024-10-07 11:33:30.052587] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.981 [2024-10-07 11:33:30.052607] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.981 [2024-10-07 11:33:30.052626] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.981 [2024-10-07 11:33:30.052640] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.981 [2024-10-07 11:33:30.052668] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.981 [2024-10-07 11:33:30.052823] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.981 [2024-10-07 11:33:30.052848] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.981 [2024-10-07 11:33:30.062481] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.981 [2024-10-07 11:33:30.062576] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.981 [2024-10-07 11:33:30.062717] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.981 [2024-10-07 11:33:30.062752] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.981 [2024-10-07 11:33:30.062775] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.981 [2024-10-07 11:33:30.062842] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.981 [2024-10-07 11:33:30.062866] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.981 [2024-10-07 11:33:30.062881] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.981 [2024-10-07 11:33:30.062907] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.981 [2024-10-07 11:33:30.062929] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.981 [2024-10-07 11:33:30.062949] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.981 [2024-10-07 11:33:30.062964] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.981 [2024-10-07 11:33:30.062979] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.981 [2024-10-07 11:33:30.062996] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.981 [2024-10-07 11:33:30.063010] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.981 [2024-10-07 11:33:30.063024] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.981 [2024-10-07 11:33:30.063047] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.981 [2024-10-07 11:33:30.063062] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.981 [2024-10-07 11:33:30.074956] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.981 [2024-10-07 11:33:30.075045] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.981 [2024-10-07 11:33:30.075231] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.981 [2024-10-07 11:33:30.075269] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.981 [2024-10-07 11:33:30.075303] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.981 [2024-10-07 11:33:30.075371] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.981 [2024-10-07 11:33:30.075396] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.981 [2024-10-07 11:33:30.075412] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.981 [2024-10-07 11:33:30.075439] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.981 [2024-10-07 11:33:30.075461] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.981 [2024-10-07 11:33:30.075481] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.982 [2024-10-07 11:33:30.075497] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.982 [2024-10-07 11:33:30.075554] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.982 [2024-10-07 11:33:30.075578] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.982 [2024-10-07 11:33:30.075593] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.982 [2024-10-07 11:33:30.075606] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.982 [2024-10-07 11:33:30.075639] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.982 [2024-10-07 11:33:30.075673] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.982 [2024-10-07 11:33:30.085754] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.982 [2024-10-07 11:33:30.085838] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.982 [2024-10-07 11:33:30.085974] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.982 [2024-10-07 11:33:30.086007] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.982 [2024-10-07 11:33:30.086025] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.982 [2024-10-07 11:33:30.086074] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.982 [2024-10-07 11:33:30.086097] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.982 [2024-10-07 11:33:30.086112] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.982 [2024-10-07 11:33:30.086139] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.982 [2024-10-07 11:33:30.086160] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.982 [2024-10-07 11:33:30.086181] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.982 [2024-10-07 11:33:30.086198] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.982 [2024-10-07 11:33:30.086213] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.982 [2024-10-07 11:33:30.086230] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.982 [2024-10-07 11:33:30.086245] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.982 [2024-10-07 11:33:30.086267] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.982 [2024-10-07 11:33:30.086291] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.982 [2024-10-07 11:33:30.086307] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.982 [2024-10-07 11:33:30.098987] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.982 [2024-10-07 11:33:30.099075] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.982 [2024-10-07 11:33:30.099420] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.982 [2024-10-07 11:33:30.099461] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.982 [2024-10-07 11:33:30.099480] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.982 [2024-10-07 11:33:30.099531] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.982 [2024-10-07 11:33:30.099559] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.982 [2024-10-07 11:33:30.099606] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.982 [2024-10-07 11:33:30.099738] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.982 [2024-10-07 11:33:30.099766] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.982 [2024-10-07 11:33:30.099866] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.982 [2024-10-07 11:33:30.099908] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.982 [2024-10-07 11:33:30.099925] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.982 [2024-10-07 11:33:30.099943] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.982 [2024-10-07 11:33:30.099958] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.982 [2024-10-07 11:33:30.099971] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.982 [2024-10-07 11:33:30.100074] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.982 [2024-10-07 11:33:30.100095] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.982 [2024-10-07 11:33:30.109781] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.982 [2024-10-07 11:33:30.109858] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.982 [2024-10-07 11:33:30.110053] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.982 [2024-10-07 11:33:30.110087] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.982 [2024-10-07 11:33:30.110105] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.982 [2024-10-07 11:33:30.110155] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.982 [2024-10-07 11:33:30.110178] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.982 [2024-10-07 11:33:30.110194] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.982 [2024-10-07 11:33:30.110355] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.982 [2024-10-07 11:33:30.110386] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.982 [2024-10-07 11:33:30.110436] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.982 [2024-10-07 11:33:30.110463] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.982 [2024-10-07 11:33:30.110480] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.982 [2024-10-07 11:33:30.110497] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.982 [2024-10-07 11:33:30.110511] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.982 [2024-10-07 11:33:30.110525] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.982 [2024-10-07 11:33:30.110552] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.982 [2024-10-07 11:33:30.110567] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.982 [2024-10-07 11:33:30.121019] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.982 [2024-10-07 11:33:30.121110] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.982 [2024-10-07 11:33:30.121357] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.982 [2024-10-07 11:33:30.121390] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.982 [2024-10-07 11:33:30.121409] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.982 [2024-10-07 11:33:30.121458] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.982 [2024-10-07 11:33:30.121480] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.982 [2024-10-07 11:33:30.121496] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.982 [2024-10-07 11:33:30.121640] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.982 [2024-10-07 11:33:30.121685] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.982 [2024-10-07 11:33:30.121842] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.982 [2024-10-07 11:33:30.121866] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.982 [2024-10-07 11:33:30.121881] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.982 [2024-10-07 11:33:30.121899] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.982 [2024-10-07 11:33:30.121913] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.982 [2024-10-07 11:33:30.121927] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.982 [2024-10-07 11:33:30.122060] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.982 [2024-10-07 11:33:30.122083] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.982 [2024-10-07 11:33:30.131208] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.982 [2024-10-07 11:33:30.131296] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.982 [2024-10-07 11:33:30.131388] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.982 [2024-10-07 11:33:30.131420] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.982 [2024-10-07 11:33:30.131438] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.982 [2024-10-07 11:33:30.131494] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.982 [2024-10-07 11:33:30.131526] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.982 [2024-10-07 11:33:30.131547] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.982 [2024-10-07 11:33:30.131565] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.982 [2024-10-07 11:33:30.131589] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.982 [2024-10-07 11:33:30.131608] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.982 [2024-10-07 11:33:30.131622] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.982 [2024-10-07 11:33:30.131637] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.982 [2024-10-07 11:33:30.131742] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.982 [2024-10-07 11:33:30.131761] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.982 [2024-10-07 11:33:30.131774] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.982 [2024-10-07 11:33:30.131787] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.982 [2024-10-07 11:33:30.131809] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.982 [2024-10-07 11:33:30.145553] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.983 [2024-10-07 11:33:30.145623] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.983 [2024-10-07 11:33:30.145778] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.983 [2024-10-07 11:33:30.145810] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.983 [2024-10-07 11:33:30.145828] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.983 [2024-10-07 11:33:30.145885] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.983 [2024-10-07 11:33:30.145908] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.983 [2024-10-07 11:33:30.145924] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.983 [2024-10-07 11:33:30.145949] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.983 [2024-10-07 11:33:30.145969] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.983 [2024-10-07 11:33:30.145990] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.983 [2024-10-07 11:33:30.146004] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.983 [2024-10-07 11:33:30.146019] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.983 [2024-10-07 11:33:30.146035] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.983 [2024-10-07 11:33:30.146050] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.983 [2024-10-07 11:33:30.146062] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.983 [2024-10-07 11:33:30.146085] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.983 [2024-10-07 11:33:30.146100] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.983 [2024-10-07 11:33:30.159508] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.983 [2024-10-07 11:33:30.159558] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.983 [2024-10-07 11:33:30.159660] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.983 [2024-10-07 11:33:30.159691] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.983 [2024-10-07 11:33:30.159708] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.983 [2024-10-07 11:33:30.159756] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.983 [2024-10-07 11:33:30.159781] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.983 [2024-10-07 11:33:30.159824] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.983 [2024-10-07 11:33:30.159851] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.983 [2024-10-07 11:33:30.159872] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.983 [2024-10-07 11:33:30.159892] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.983 [2024-10-07 11:33:30.159907] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.983 [2024-10-07 11:33:30.159920] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.983 [2024-10-07 11:33:30.159936] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.983 [2024-10-07 11:33:30.159951] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.983 [2024-10-07 11:33:30.159964] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.983 [2024-10-07 11:33:30.159987] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.983 [2024-10-07 11:33:30.160001] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.983 [2024-10-07 11:33:30.174019] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.983 [2024-10-07 11:33:30.174109] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.983 [2024-10-07 11:33:30.174229] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.983 [2024-10-07 11:33:30.174261] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.983 [2024-10-07 11:33:30.174280] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.983 [2024-10-07 11:33:30.174329] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.983 [2024-10-07 11:33:30.174352] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.983 [2024-10-07 11:33:30.174367] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.983 [2024-10-07 11:33:30.174392] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.983 [2024-10-07 11:33:30.174413] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.983 [2024-10-07 11:33:30.174433] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.983 [2024-10-07 11:33:30.174449] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.983 [2024-10-07 11:33:30.174464] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.983 [2024-10-07 11:33:30.174481] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.983 [2024-10-07 11:33:30.174496] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.983 [2024-10-07 11:33:30.174510] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.983 [2024-10-07 11:33:30.174532] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.983 [2024-10-07 11:33:30.174548] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.983 [2024-10-07 11:33:30.188208] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.983 [2024-10-07 11:33:30.188282] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.983 [2024-10-07 11:33:30.188811] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.983 [2024-10-07 11:33:30.188861] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.983 [2024-10-07 11:33:30.188894] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.983 [2024-10-07 11:33:30.188945] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.983 [2024-10-07 11:33:30.188968] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.983 [2024-10-07 11:33:30.188983] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.983 [2024-10-07 11:33:30.190219] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.983 [2024-10-07 11:33:30.190265] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.983 [2024-10-07 11:33:30.190835] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.983 [2024-10-07 11:33:30.190881] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.983 [2024-10-07 11:33:30.190901] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.983 [2024-10-07 11:33:30.190919] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.983 [2024-10-07 11:33:30.190933] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.983 [2024-10-07 11:33:30.190955] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.983 [2024-10-07 11:33:30.191205] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.983 [2024-10-07 11:33:30.191232] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.983 [2024-10-07 11:33:30.199014] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.983 [2024-10-07 11:33:30.199063] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.983 [2024-10-07 11:33:30.199290] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.983 [2024-10-07 11:33:30.199322] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.983 [2024-10-07 11:33:30.199339] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.983 [2024-10-07 11:33:30.199387] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.983 [2024-10-07 11:33:30.199410] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.983 [2024-10-07 11:33:30.199425] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.983 [2024-10-07 11:33:30.199559] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.983 [2024-10-07 11:33:30.199588] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.983 [2024-10-07 11:33:30.199753] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.983 [2024-10-07 11:33:30.199776] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.983 [2024-10-07 11:33:30.199791] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.983 [2024-10-07 11:33:30.199808] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.983 [2024-10-07 11:33:30.199837] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.983 [2024-10-07 11:33:30.199851] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.983 [2024-10-07 11:33:30.199962] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.983 [2024-10-07 11:33:30.199981] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.983 [2024-10-07 11:33:30.209145] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.983 [2024-10-07 11:33:30.209259] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.983 [2024-10-07 11:33:30.209371] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.983 [2024-10-07 11:33:30.209402] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.983 [2024-10-07 11:33:30.209419] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.983 [2024-10-07 11:33:30.209474] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.983 [2024-10-07 11:33:30.209498] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.984 [2024-10-07 11:33:30.209514] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.984 [2024-10-07 11:33:30.209532] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.984 [2024-10-07 11:33:30.209556] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.984 [2024-10-07 11:33:30.209574] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.984 [2024-10-07 11:33:30.209588] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.984 [2024-10-07 11:33:30.209603] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.984 [2024-10-07 11:33:30.209627] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.984 [2024-10-07 11:33:30.209645] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.984 [2024-10-07 11:33:30.209658] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.984 [2024-10-07 11:33:30.209687] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.984 [2024-10-07 11:33:30.209710] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.984 [2024-10-07 11:33:30.219880] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.984 [2024-10-07 11:33:30.219959] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.984 [2024-10-07 11:33:30.220079] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.984 [2024-10-07 11:33:30.220122] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.984 [2024-10-07 11:33:30.220140] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.984 [2024-10-07 11:33:30.220188] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.984 [2024-10-07 11:33:30.220211] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.984 [2024-10-07 11:33:30.220226] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.984 [2024-10-07 11:33:30.220279] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.984 [2024-10-07 11:33:30.220300] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.984 [2024-10-07 11:33:30.220320] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.984 [2024-10-07 11:33:30.220336] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.984 [2024-10-07 11:33:30.220359] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.984 [2024-10-07 11:33:30.220376] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.984 [2024-10-07 11:33:30.220391] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.984 [2024-10-07 11:33:30.220404] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.984 [2024-10-07 11:33:30.220427] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.984 [2024-10-07 11:33:30.220441] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.984 [2024-10-07 11:33:30.230301] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.984 [2024-10-07 11:33:30.230352] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.984 [2024-10-07 11:33:30.230530] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.984 [2024-10-07 11:33:30.230561] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.984 [2024-10-07 11:33:30.230578] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.984 [2024-10-07 11:33:30.230626] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.984 [2024-10-07 11:33:30.230665] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.984 [2024-10-07 11:33:30.230684] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.984 [2024-10-07 11:33:30.231141] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.984 [2024-10-07 11:33:30.231194] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.984 [2024-10-07 11:33:30.232950] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.984 [2024-10-07 11:33:30.232991] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.984 [2024-10-07 11:33:30.233009] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.984 [2024-10-07 11:33:30.233027] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.984 [2024-10-07 11:33:30.233041] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.984 [2024-10-07 11:33:30.233054] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.984 [2024-10-07 11:33:30.233673] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.984 [2024-10-07 11:33:30.233709] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.984 [2024-10-07 11:33:30.242462] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.984 [2024-10-07 11:33:30.242510] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.984 [2024-10-07 11:33:30.242626] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.984 [2024-10-07 11:33:30.242689] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.984 [2024-10-07 11:33:30.242709] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.984 [2024-10-07 11:33:30.242763] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.984 [2024-10-07 11:33:30.242787] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.984 [2024-10-07 11:33:30.242802] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.984 [2024-10-07 11:33:30.245014] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.984 [2024-10-07 11:33:30.245060] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.984 [2024-10-07 11:33:30.245173] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.984 [2024-10-07 11:33:30.245202] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.984 [2024-10-07 11:33:30.245216] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.984 [2024-10-07 11:33:30.245234] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.984 [2024-10-07 11:33:30.245248] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.984 [2024-10-07 11:33:30.245261] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.984 [2024-10-07 11:33:30.245499] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.984 [2024-10-07 11:33:30.245525] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.984 [2024-10-07 11:33:30.252575] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.984 [2024-10-07 11:33:30.252638] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.984 [2024-10-07 11:33:30.252735] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.984 [2024-10-07 11:33:30.252764] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.984 [2024-10-07 11:33:30.252781] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.984 [2024-10-07 11:33:30.252836] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.984 [2024-10-07 11:33:30.252861] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.984 [2024-10-07 11:33:30.252877] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.984 [2024-10-07 11:33:30.252894] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.984 [2024-10-07 11:33:30.252917] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.984 [2024-10-07 11:33:30.252935] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.984 [2024-10-07 11:33:30.252948] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.984 [2024-10-07 11:33:30.252961] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.984 [2024-10-07 11:33:30.252984] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.984 [2024-10-07 11:33:30.252999] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.984 [2024-10-07 11:33:30.253028] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.984 [2024-10-07 11:33:30.253042] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.984 [2024-10-07 11:33:30.253064] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.984 [2024-10-07 11:33:30.264857] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.984 [2024-10-07 11:33:30.264906] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.984 [2024-10-07 11:33:30.264993] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.984 [2024-10-07 11:33:30.265023] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.984 [2024-10-07 11:33:30.265039] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.984 [2024-10-07 11:33:30.265086] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.984 [2024-10-07 11:33:30.265109] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.984 [2024-10-07 11:33:30.265125] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.984 [2024-10-07 11:33:30.265148] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.984 [2024-10-07 11:33:30.265167] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.984 [2024-10-07 11:33:30.265187] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.984 [2024-10-07 11:33:30.265202] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.984 [2024-10-07 11:33:30.265215] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.984 [2024-10-07 11:33:30.265230] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.984 [2024-10-07 11:33:30.265245] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.985 [2024-10-07 11:33:30.265257] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.985 [2024-10-07 11:33:30.265280] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.985 [2024-10-07 11:33:30.265294] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.985 [2024-10-07 11:33:30.278439] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.985 [2024-10-07 11:33:30.278503] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.985 [2024-10-07 11:33:30.278591] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.985 [2024-10-07 11:33:30.278621] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.985 [2024-10-07 11:33:30.278637] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.985 [2024-10-07 11:33:30.278705] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.985 [2024-10-07 11:33:30.278730] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.985 [2024-10-07 11:33:30.278746] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.985 [2024-10-07 11:33:30.278770] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.985 [2024-10-07 11:33:30.278807] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.985 [2024-10-07 11:33:30.278829] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.985 [2024-10-07 11:33:30.278843] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.985 [2024-10-07 11:33:30.278857] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.985 [2024-10-07 11:33:30.278873] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.985 [2024-10-07 11:33:30.278888] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.985 [2024-10-07 11:33:30.278900] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.985 [2024-10-07 11:33:30.278922] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.985 [2024-10-07 11:33:30.278937] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.985 [2024-10-07 11:33:30.289308] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.985 [2024-10-07 11:33:30.289357] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.985 [2024-10-07 11:33:30.289859] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.985 [2024-10-07 11:33:30.289903] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.985 [2024-10-07 11:33:30.289923] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.985 [2024-10-07 11:33:30.289974] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.985 [2024-10-07 11:33:30.289997] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.985 [2024-10-07 11:33:30.290012] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.985 [2024-10-07 11:33:30.292515] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.985 [2024-10-07 11:33:30.292560] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.985 [2024-10-07 11:33:30.293393] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.985 [2024-10-07 11:33:30.293431] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.985 [2024-10-07 11:33:30.293449] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.985 [2024-10-07 11:33:30.293466] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.985 [2024-10-07 11:33:30.293480] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.985 [2024-10-07 11:33:30.293493] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.985 [2024-10-07 11:33:30.293684] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.985 [2024-10-07 11:33:30.293708] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.985 [2024-10-07 11:33:30.301030] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.985 [2024-10-07 11:33:30.301082] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.985 [2024-10-07 11:33:30.303447] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.985 [2024-10-07 11:33:30.303493] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.985 [2024-10-07 11:33:30.303533] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.985 [2024-10-07 11:33:30.303586] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.985 [2024-10-07 11:33:30.303610] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.985 [2024-10-07 11:33:30.303626] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.985 [2024-10-07 11:33:30.303910] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.985 [2024-10-07 11:33:30.303943] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.985 [2024-10-07 11:33:30.304136] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.985 [2024-10-07 11:33:30.304163] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.985 [2024-10-07 11:33:30.304178] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.985 [2024-10-07 11:33:30.304196] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.985 [2024-10-07 11:33:30.304211] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.985 [2024-10-07 11:33:30.304224] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.985 [2024-10-07 11:33:30.304345] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.985 [2024-10-07 11:33:30.304368] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.985 [2024-10-07 11:33:30.312725] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.985 [2024-10-07 11:33:30.312773] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.985 [2024-10-07 11:33:30.312861] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.985 [2024-10-07 11:33:30.312890] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.985 [2024-10-07 11:33:30.312907] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.985 [2024-10-07 11:33:30.312954] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.985 [2024-10-07 11:33:30.312976] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.985 [2024-10-07 11:33:30.312991] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.985 [2024-10-07 11:33:30.313014] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.985 [2024-10-07 11:33:30.313034] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.985 [2024-10-07 11:33:30.313054] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.985 [2024-10-07 11:33:30.313068] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.985 [2024-10-07 11:33:30.313082] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.985 [2024-10-07 11:33:30.313098] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.985 [2024-10-07 11:33:30.313112] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.985 [2024-10-07 11:33:30.313141] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.985 [2024-10-07 11:33:30.313166] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.985 [2024-10-07 11:33:30.313181] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.985 [2024-10-07 11:33:30.323119] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.985 [2024-10-07 11:33:30.323194] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.985 [2024-10-07 11:33:30.323334] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.985 [2024-10-07 11:33:30.323375] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.985 [2024-10-07 11:33:30.323396] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.985 [2024-10-07 11:33:30.323447] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.985 [2024-10-07 11:33:30.323471] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.985 [2024-10-07 11:33:30.323486] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.985 [2024-10-07 11:33:30.323511] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.985 [2024-10-07 11:33:30.323534] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.985 [2024-10-07 11:33:30.323554] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.986 [2024-10-07 11:33:30.323569] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.986 [2024-10-07 11:33:30.323582] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.986 [2024-10-07 11:33:30.323598] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.986 [2024-10-07 11:33:30.323612] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.986 [2024-10-07 11:33:30.323625] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.986 [2024-10-07 11:33:30.323662] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.986 [2024-10-07 11:33:30.323680] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.986 [2024-10-07 11:33:30.337461] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.986 [2024-10-07 11:33:30.337518] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.986 [2024-10-07 11:33:30.337712] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.986 [2024-10-07 11:33:30.337744] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.986 [2024-10-07 11:33:30.337761] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.986 [2024-10-07 11:33:30.337810] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.986 [2024-10-07 11:33:30.337833] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.986 [2024-10-07 11:33:30.337848] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.986 [2024-10-07 11:33:30.337873] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.986 [2024-10-07 11:33:30.337894] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.986 [2024-10-07 11:33:30.337941] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.986 [2024-10-07 11:33:30.337958] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.986 [2024-10-07 11:33:30.337972] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.986 [2024-10-07 11:33:30.337989] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.986 [2024-10-07 11:33:30.338003] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.986 [2024-10-07 11:33:30.338016] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.986 [2024-10-07 11:33:30.338039] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.986 [2024-10-07 11:33:30.338054] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.986 [2024-10-07 11:33:30.351583] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.986 [2024-10-07 11:33:30.351637] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.986 [2024-10-07 11:33:30.351744] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.986 [2024-10-07 11:33:30.351773] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.986 [2024-10-07 11:33:30.351789] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.986 [2024-10-07 11:33:30.351837] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.986 [2024-10-07 11:33:30.351860] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.986 [2024-10-07 11:33:30.351875] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.986 [2024-10-07 11:33:30.351897] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.986 [2024-10-07 11:33:30.351918] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.986 [2024-10-07 11:33:30.351937] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.986 [2024-10-07 11:33:30.351952] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.986 [2024-10-07 11:33:30.351966] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.986 [2024-10-07 11:33:30.351982] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.986 [2024-10-07 11:33:30.351996] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.986 [2024-10-07 11:33:30.352008] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.986 [2024-10-07 11:33:30.352031] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.986 [2024-10-07 11:33:30.352045] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.986 [2024-10-07 11:33:30.363245] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.986 [2024-10-07 11:33:30.363296] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.986 [2024-10-07 11:33:30.363497] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.986 [2024-10-07 11:33:30.363529] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.986 [2024-10-07 11:33:30.363565] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.986 [2024-10-07 11:33:30.363619] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.986 [2024-10-07 11:33:30.363643] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.986 [2024-10-07 11:33:30.363675] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.986 [2024-10-07 11:33:30.363827] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.986 [2024-10-07 11:33:30.363855] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.986 [2024-10-07 11:33:30.363981] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.986 [2024-10-07 11:33:30.364004] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.986 [2024-10-07 11:33:30.364019] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.986 [2024-10-07 11:33:30.364036] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.986 [2024-10-07 11:33:30.364050] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.986 [2024-10-07 11:33:30.364063] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.986 [2024-10-07 11:33:30.364194] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.986 [2024-10-07 11:33:30.364217] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.986 [2024-10-07 11:33:30.374024] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.986 [2024-10-07 11:33:30.374077] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.986 [2024-10-07 11:33:30.374189] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.986 [2024-10-07 11:33:30.374229] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.986 [2024-10-07 11:33:30.374248] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.986 [2024-10-07 11:33:30.374296] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.986 [2024-10-07 11:33:30.374320] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.986 [2024-10-07 11:33:30.374335] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.986 [2024-10-07 11:33:30.374359] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.986 [2024-10-07 11:33:30.374379] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.986 [2024-10-07 11:33:30.374399] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.986 [2024-10-07 11:33:30.374414] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.986 [2024-10-07 11:33:30.374427] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.986 [2024-10-07 11:33:30.374443] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.986 [2024-10-07 11:33:30.374457] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.986 [2024-10-07 11:33:30.374470] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.986 [2024-10-07 11:33:30.374517] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.986 [2024-10-07 11:33:30.374534] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.986 [2024-10-07 11:33:30.386644] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.986 [2024-10-07 11:33:30.386712] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.986 [2024-10-07 11:33:30.386920] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.986 [2024-10-07 11:33:30.386953] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.986 [2024-10-07 11:33:30.386971] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.986 [2024-10-07 11:33:30.387022] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.986 [2024-10-07 11:33:30.387045] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.986 [2024-10-07 11:33:30.387060] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.986 [2024-10-07 11:33:30.387085] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.986 [2024-10-07 11:33:30.387105] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.986 [2024-10-07 11:33:30.387124] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.986 [2024-10-07 11:33:30.387139] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.986 [2024-10-07 11:33:30.387152] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.986 [2024-10-07 11:33:30.387169] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.986 [2024-10-07 11:33:30.387196] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.986 [2024-10-07 11:33:30.387211] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.986 [2024-10-07 11:33:30.387235] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.986 [2024-10-07 11:33:30.387250] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.987 [2024-10-07 11:33:30.398100] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.987 [2024-10-07 11:33:30.398151] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.987 [2024-10-07 11:33:30.398240] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.987 [2024-10-07 11:33:30.398270] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.987 [2024-10-07 11:33:30.398286] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.987 [2024-10-07 11:33:30.398333] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.987 [2024-10-07 11:33:30.398356] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.987 [2024-10-07 11:33:30.398371] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.987 [2024-10-07 11:33:30.398644] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.987 [2024-10-07 11:33:30.398691] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.987 [2024-10-07 11:33:30.398883] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.987 [2024-10-07 11:33:30.398930] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.987 [2024-10-07 11:33:30.398946] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.987 [2024-10-07 11:33:30.398963] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.987 [2024-10-07 11:33:30.398978] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.987 [2024-10-07 11:33:30.398991] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.987 [2024-10-07 11:33:30.399126] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.987 [2024-10-07 11:33:30.399148] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.987 [2024-10-07 11:33:30.408216] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.987 [2024-10-07 11:33:30.408281] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.987 [2024-10-07 11:33:30.408358] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.987 [2024-10-07 11:33:30.408388] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.987 [2024-10-07 11:33:30.408404] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.987 [2024-10-07 11:33:30.408459] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.987 [2024-10-07 11:33:30.408483] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.987 [2024-10-07 11:33:30.408498] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.987 [2024-10-07 11:33:30.408516] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.987 [2024-10-07 11:33:30.408540] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.987 [2024-10-07 11:33:30.408558] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.987 [2024-10-07 11:33:30.408571] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.987 [2024-10-07 11:33:30.408584] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.987 [2024-10-07 11:33:30.408607] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.987 [2024-10-07 11:33:30.408622] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.987 [2024-10-07 11:33:30.408635] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.987 [2024-10-07 11:33:30.408662] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.987 [2024-10-07 11:33:30.408687] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.987 [2024-10-07 11:33:30.419597] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.987 [2024-10-07 11:33:30.419662] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.987 [2024-10-07 11:33:30.419904] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.987 [2024-10-07 11:33:30.419948] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.987 [2024-10-07 11:33:30.419968] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.987 [2024-10-07 11:33:30.420036] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.987 [2024-10-07 11:33:30.420061] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.987 [2024-10-07 11:33:30.420076] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.987 [2024-10-07 11:33:30.420205] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.987 [2024-10-07 11:33:30.420234] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.987 [2024-10-07 11:33:30.420584] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.987 [2024-10-07 11:33:30.420619] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.987 [2024-10-07 11:33:30.420637] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.987 [2024-10-07 11:33:30.420669] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.987 [2024-10-07 11:33:30.420686] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.987 [2024-10-07 11:33:30.420699] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.987 [2024-10-07 11:33:30.422562] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.987 [2024-10-07 11:33:30.422599] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.987 [2024-10-07 11:33:30.429729] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.987 [2024-10-07 11:33:30.431896] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.987 [2024-10-07 11:33:30.431992] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.987 [2024-10-07 11:33:30.432022] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.987 [2024-10-07 11:33:30.432038] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.987 [2024-10-07 11:33:30.432788] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.987 [2024-10-07 11:33:30.432830] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.987 [2024-10-07 11:33:30.432849] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.987 [2024-10-07 11:33:30.432868] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.987 [2024-10-07 11:33:30.432966] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.987 [2024-10-07 11:33:30.432991] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.987 [2024-10-07 11:33:30.433004] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.987 [2024-10-07 11:33:30.433018] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.987 [2024-10-07 11:33:30.433043] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.987 [2024-10-07 11:33:30.433058] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.987 [2024-10-07 11:33:30.433070] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.987 [2024-10-07 11:33:30.433083] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.987 [2024-10-07 11:33:30.433118] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.987 [2024-10-07 11:33:30.439813] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.987 [2024-10-07 11:33:30.439946] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.987 [2024-10-07 11:33:30.439986] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.987 [2024-10-07 11:33:30.440003] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.987 [2024-10-07 11:33:30.440026] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.987 [2024-10-07 11:33:30.440049] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.987 [2024-10-07 11:33:30.440063] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.987 [2024-10-07 11:33:30.440077] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.987 [2024-10-07 11:33:30.440101] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.987 [2024-10-07 11:33:30.445274] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.987 [2024-10-07 11:33:30.445593] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.987 [2024-10-07 11:33:30.445636] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.987 [2024-10-07 11:33:30.445670] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.987 [2024-10-07 11:33:30.447856] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.987 [2024-10-07 11:33:30.447978] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.987 [2024-10-07 11:33:30.448003] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.987 [2024-10-07 11:33:30.448017] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.987 [2024-10-07 11:33:30.448042] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.987 [2024-10-07 11:33:30.453894] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.987 [2024-10-07 11:33:30.454236] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.987 [2024-10-07 11:33:30.454280] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.987 [2024-10-07 11:33:30.454300] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.987 [2024-10-07 11:33:30.454955] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.987 [2024-10-07 11:33:30.455374] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.987 [2024-10-07 11:33:30.455410] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.987 [2024-10-07 11:33:30.455428] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.988 [2024-10-07 11:33:30.455695] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.988 [2024-10-07 11:33:30.455778] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.988 [2024-10-07 11:33:30.455870] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.988 [2024-10-07 11:33:30.455904] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.988 [2024-10-07 11:33:30.455941] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.988 [2024-10-07 11:33:30.456131] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.988 [2024-10-07 11:33:30.456209] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.988 [2024-10-07 11:33:30.456233] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.988 [2024-10-07 11:33:30.456247] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.988 [2024-10-07 11:33:30.456271] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.988 [2024-10-07 11:33:30.464277] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.988 [2024-10-07 11:33:30.464483] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.988 [2024-10-07 11:33:30.464515] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.988 [2024-10-07 11:33:30.464532] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.988 [2024-10-07 11:33:30.464638] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.988 [2024-10-07 11:33:30.464761] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.988 [2024-10-07 11:33:30.464781] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.988 [2024-10-07 11:33:30.464795] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.988 [2024-10-07 11:33:30.465894] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.988 [2024-10-07 11:33:30.469577] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.988 [2024-10-07 11:33:30.469928] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.988 [2024-10-07 11:33:30.469972] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.988 [2024-10-07 11:33:30.469993] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.988 [2024-10-07 11:33:30.470229] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.988 [2024-10-07 11:33:30.470319] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.988 [2024-10-07 11:33:30.470343] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.988 [2024-10-07 11:33:30.470359] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.988 [2024-10-07 11:33:30.470383] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.988 [2024-10-07 11:33:30.474366] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.988 [2024-10-07 11:33:30.474467] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.988 [2024-10-07 11:33:30.474496] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.988 [2024-10-07 11:33:30.474513] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.988 [2024-10-07 11:33:30.474985] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.988 [2024-10-07 11:33:30.475197] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.988 [2024-10-07 11:33:30.475258] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.988 [2024-10-07 11:33:30.475284] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.988 [2024-10-07 11:33:30.475446] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.988 [2024-10-07 11:33:30.480129] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.988 [2024-10-07 11:33:30.480335] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.988 [2024-10-07 11:33:30.480368] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.988 [2024-10-07 11:33:30.480386] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.988 [2024-10-07 11:33:30.480502] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.988 [2024-10-07 11:33:30.480728] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.988 [2024-10-07 11:33:30.480763] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.988 [2024-10-07 11:33:30.480780] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.988 [2024-10-07 11:33:30.481278] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.988 [2024-10-07 11:33:30.487309] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.988 [2024-10-07 11:33:30.487531] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.988 [2024-10-07 11:33:30.487564] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.988 [2024-10-07 11:33:30.487582] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.988 [2024-10-07 11:33:30.487829] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.988 [2024-10-07 11:33:30.487984] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.988 [2024-10-07 11:33:30.488018] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.988 [2024-10-07 11:33:30.488035] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.988 [2024-10-07 11:33:30.488141] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.988 [2024-10-07 11:33:30.493855] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.988 [2024-10-07 11:33:30.494074] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.988 [2024-10-07 11:33:30.494106] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.988 [2024-10-07 11:33:30.494123] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.988 [2024-10-07 11:33:30.494237] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.988 [2024-10-07 11:33:30.494344] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.988 [2024-10-07 11:33:30.494363] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.988 [2024-10-07 11:33:30.494377] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.988 [2024-10-07 11:33:30.494493] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.988 [2024-10-07 11:33:30.498561] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.988 [2024-10-07 11:33:30.498680] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.988 [2024-10-07 11:33:30.498712] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.988 [2024-10-07 11:33:30.498729] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.988 [2024-10-07 11:33:30.498753] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.988 [2024-10-07 11:33:30.498776] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.988 [2024-10-07 11:33:30.498790] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.988 [2024-10-07 11:33:30.498804] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.988 [2024-10-07 11:33:30.498828] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.988 [2024-10-07 11:33:30.504107] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.988 [2024-10-07 11:33:30.504230] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.988 [2024-10-07 11:33:30.504261] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.988 [2024-10-07 11:33:30.504278] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.988 [2024-10-07 11:33:30.504307] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.988 [2024-10-07 11:33:30.504329] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.988 [2024-10-07 11:33:30.504344] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.988 [2024-10-07 11:33:30.504358] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.988 [2024-10-07 11:33:30.504381] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.988 [2024-10-07 11:33:30.513222] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.988 [2024-10-07 11:33:30.513534] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.988 [2024-10-07 11:33:30.513578] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.988 [2024-10-07 11:33:30.513603] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.988 [2024-10-07 11:33:30.514095] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.988 [2024-10-07 11:33:30.514342] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.988 [2024-10-07 11:33:30.514377] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.988 [2024-10-07 11:33:30.514395] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.988 [2024-10-07 11:33:30.514464] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.988 [2024-10-07 11:33:30.514494] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.988 [2024-10-07 11:33:30.514567] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.988 [2024-10-07 11:33:30.514595] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.988 [2024-10-07 11:33:30.514611] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.988 [2024-10-07 11:33:30.514819] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.988 [2024-10-07 11:33:30.514976] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.989 [2024-10-07 11:33:30.515008] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.989 [2024-10-07 11:33:30.515024] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.989 [2024-10-07 11:33:30.515080] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.989 [2024-10-07 11:33:30.527086] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.989 [2024-10-07 11:33:30.527135] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.989 [2024-10-07 11:33:30.527232] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.989 [2024-10-07 11:33:30.527262] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.989 [2024-10-07 11:33:30.527279] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.989 [2024-10-07 11:33:30.527326] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.989 [2024-10-07 11:33:30.527349] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.989 [2024-10-07 11:33:30.527364] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.989 [2024-10-07 11:33:30.527387] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.989 [2024-10-07 11:33:30.527407] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.989 [2024-10-07 11:33:30.527426] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.989 [2024-10-07 11:33:30.527441] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.989 [2024-10-07 11:33:30.527465] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.989 [2024-10-07 11:33:30.527481] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.989 [2024-10-07 11:33:30.527495] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.989 [2024-10-07 11:33:30.527508] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.989 [2024-10-07 11:33:30.527530] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.989 [2024-10-07 11:33:30.527544] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.989 [2024-10-07 11:33:30.542043] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.989 [2024-10-07 11:33:30.542093] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.989 [2024-10-07 11:33:30.542181] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.989 [2024-10-07 11:33:30.542210] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.989 [2024-10-07 11:33:30.542226] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.989 [2024-10-07 11:33:30.542274] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.989 [2024-10-07 11:33:30.542297] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.989 [2024-10-07 11:33:30.542331] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.989 [2024-10-07 11:33:30.542357] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.989 [2024-10-07 11:33:30.542377] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.989 [2024-10-07 11:33:30.542397] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.989 [2024-10-07 11:33:30.542411] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.989 [2024-10-07 11:33:30.542425] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.989 [2024-10-07 11:33:30.542441] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.989 [2024-10-07 11:33:30.542455] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.989 [2024-10-07 11:33:30.542468] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.989 [2024-10-07 11:33:30.543125] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.989 [2024-10-07 11:33:30.543152] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.989 [2024-10-07 11:33:30.553032] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.989 [2024-10-07 11:33:30.553080] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.989 [2024-10-07 11:33:30.553266] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.989 [2024-10-07 11:33:30.553297] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.989 [2024-10-07 11:33:30.553314] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.989 [2024-10-07 11:33:30.553362] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.989 [2024-10-07 11:33:30.553385] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.989 [2024-10-07 11:33:30.553400] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.989 [2024-10-07 11:33:30.554864] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.989 [2024-10-07 11:33:30.554906] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.989 [2024-10-07 11:33:30.557145] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.989 [2024-10-07 11:33:30.557185] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.989 [2024-10-07 11:33:30.557204] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.989 [2024-10-07 11:33:30.557221] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.989 [2024-10-07 11:33:30.557235] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.989 [2024-10-07 11:33:30.557248] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.989 [2024-10-07 11:33:30.558462] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.989 [2024-10-07 11:33:30.558502] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.989 [2024-10-07 11:33:30.563706] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.989 [2024-10-07 11:33:30.563775] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.989 [2024-10-07 11:33:30.563971] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.989 [2024-10-07 11:33:30.564003] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.989 [2024-10-07 11:33:30.564021] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.989 [2024-10-07 11:33:30.564068] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.989 [2024-10-07 11:33:30.564091] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.989 [2024-10-07 11:33:30.564106] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.989 [2024-10-07 11:33:30.564224] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.989 [2024-10-07 11:33:30.564251] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.989 [2024-10-07 11:33:30.564350] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.989 [2024-10-07 11:33:30.564369] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.989 [2024-10-07 11:33:30.564383] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.989 [2024-10-07 11:33:30.564399] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.989 [2024-10-07 11:33:30.564414] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.989 [2024-10-07 11:33:30.564426] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.989 [2024-10-07 11:33:30.564538] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.989 [2024-10-07 11:33:30.564559] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.989 [2024-10-07 11:33:30.573837] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.989 [2024-10-07 11:33:30.573902] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.989 [2024-10-07 11:33:30.573978] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.989 [2024-10-07 11:33:30.574007] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.989 [2024-10-07 11:33:30.574023] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.989 [2024-10-07 11:33:30.574076] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.989 [2024-10-07 11:33:30.574101] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.989 [2024-10-07 11:33:30.574116] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.989 [2024-10-07 11:33:30.574134] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.989 [2024-10-07 11:33:30.574157] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.989 [2024-10-07 11:33:30.574174] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.989 [2024-10-07 11:33:30.574187] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.989 [2024-10-07 11:33:30.574201] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.989 [2024-10-07 11:33:30.574239] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.989 [2024-10-07 11:33:30.574256] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.989 [2024-10-07 11:33:30.574269] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.989 [2024-10-07 11:33:30.574282] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.989 [2024-10-07 11:33:30.574302] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.989 [2024-10-07 11:33:30.586686] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.989 [2024-10-07 11:33:30.586756] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.989 [2024-10-07 11:33:30.587233] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.989 [2024-10-07 11:33:30.587280] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.989 [2024-10-07 11:33:30.587300] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.990 [2024-10-07 11:33:30.587350] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.990 [2024-10-07 11:33:30.587374] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.990 [2024-10-07 11:33:30.587389] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.990 [2024-10-07 11:33:30.587675] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.990 [2024-10-07 11:33:30.587707] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.990 [2024-10-07 11:33:30.587783] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.990 [2024-10-07 11:33:30.587807] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.990 [2024-10-07 11:33:30.587831] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.990 [2024-10-07 11:33:30.587848] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.990 [2024-10-07 11:33:30.587862] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.990 [2024-10-07 11:33:30.587875] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.990 [2024-10-07 11:33:30.587898] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.990 [2024-10-07 11:33:30.587913] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.990 [2024-10-07 11:33:30.601313] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.990 [2024-10-07 11:33:30.601365] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.990 [2024-10-07 11:33:30.601671] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.990 [2024-10-07 11:33:30.601704] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.990 [2024-10-07 11:33:30.601722] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.990 [2024-10-07 11:33:30.601772] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.990 [2024-10-07 11:33:30.601795] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.990 [2024-10-07 11:33:30.601811] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.990 [2024-10-07 11:33:30.602037] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.990 [2024-10-07 11:33:30.602069] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.990 [2024-10-07 11:33:30.602266] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.990 [2024-10-07 11:33:30.602302] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.990 [2024-10-07 11:33:30.602320] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.990 [2024-10-07 11:33:30.602338] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.990 [2024-10-07 11:33:30.602353] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.990 [2024-10-07 11:33:30.602365] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.990 [2024-10-07 11:33:30.602430] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.990 [2024-10-07 11:33:30.602450] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.990 [2024-10-07 11:33:30.615956] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.990 [2024-10-07 11:33:30.616006] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.990 [2024-10-07 11:33:30.616337] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.990 [2024-10-07 11:33:30.616381] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.990 [2024-10-07 11:33:30.616409] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.990 [2024-10-07 11:33:30.616468] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.990 [2024-10-07 11:33:30.616492] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.990 [2024-10-07 11:33:30.616507] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.990 [2024-10-07 11:33:30.616731] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.990 [2024-10-07 11:33:30.616763] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.990 [2024-10-07 11:33:30.616812] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.990 [2024-10-07 11:33:30.616833] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.990 [2024-10-07 11:33:30.616847] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.990 [2024-10-07 11:33:30.616863] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.990 [2024-10-07 11:33:30.616877] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.990 [2024-10-07 11:33:30.616890] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.990 [2024-10-07 11:33:30.616913] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.990 [2024-10-07 11:33:30.616927] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.990 [2024-10-07 11:33:30.630236] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.990 [2024-10-07 11:33:30.630285] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.990 [2024-10-07 11:33:30.630582] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.990 [2024-10-07 11:33:30.630616] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.990 [2024-10-07 11:33:30.630634] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.990 [2024-10-07 11:33:30.630698] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.990 [2024-10-07 11:33:30.630724] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.990 [2024-10-07 11:33:30.630739] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.990 [2024-10-07 11:33:30.630943] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.990 [2024-10-07 11:33:30.630974] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.990 [2024-10-07 11:33:30.631030] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.990 [2024-10-07 11:33:30.631052] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.990 [2024-10-07 11:33:30.631066] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.990 [2024-10-07 11:33:30.631083] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.990 [2024-10-07 11:33:30.631097] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.990 [2024-10-07 11:33:30.631109] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.990 [2024-10-07 11:33:30.631132] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.990 [2024-10-07 11:33:30.631146] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.990 [2024-10-07 11:33:30.644582] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.990 [2024-10-07 11:33:30.644637] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.990 [2024-10-07 11:33:30.644738] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.990 [2024-10-07 11:33:30.644767] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.990 [2024-10-07 11:33:30.644784] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.990 [2024-10-07 11:33:30.644830] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.990 [2024-10-07 11:33:30.644853] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.990 [2024-10-07 11:33:30.644869] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.990 [2024-10-07 11:33:30.644891] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.990 [2024-10-07 11:33:30.644911] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.990 [2024-10-07 11:33:30.644931] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.990 [2024-10-07 11:33:30.644945] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.990 [2024-10-07 11:33:30.644959] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.990 [2024-10-07 11:33:30.644975] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.990 [2024-10-07 11:33:30.645009] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.991 [2024-10-07 11:33:30.645023] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.991 [2024-10-07 11:33:30.645047] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.991 [2024-10-07 11:33:30.645062] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.991 [2024-10-07 11:33:30.655715] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.991 [2024-10-07 11:33:30.655764] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.991 [2024-10-07 11:33:30.658353] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.991 [2024-10-07 11:33:30.658399] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.991 [2024-10-07 11:33:30.658420] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.991 [2024-10-07 11:33:30.658470] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.991 [2024-10-07 11:33:30.658494] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.991 [2024-10-07 11:33:30.658510] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.991 [2024-10-07 11:33:30.659250] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.991 [2024-10-07 11:33:30.659294] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.991 [2024-10-07 11:33:30.659460] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.991 [2024-10-07 11:33:30.659485] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.991 [2024-10-07 11:33:30.659499] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.991 [2024-10-07 11:33:30.659517] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.991 [2024-10-07 11:33:30.659532] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.991 [2024-10-07 11:33:30.659545] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.991 [2024-10-07 11:33:30.659788] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.991 [2024-10-07 11:33:30.659813] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.991 [2024-10-07 11:33:30.666364] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.991 [2024-10-07 11:33:30.666413] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.991 [2024-10-07 11:33:30.666500] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.991 [2024-10-07 11:33:30.666530] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.991 [2024-10-07 11:33:30.666546] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.991 [2024-10-07 11:33:30.666594] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.991 [2024-10-07 11:33:30.666616] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.991 [2024-10-07 11:33:30.666631] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.991 [2024-10-07 11:33:30.666671] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.991 [2024-10-07 11:33:30.666713] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.991 [2024-10-07 11:33:30.666734] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.991 [2024-10-07 11:33:30.666749] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.991 [2024-10-07 11:33:30.666763] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.991 [2024-10-07 11:33:30.666779] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.991 [2024-10-07 11:33:30.666793] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.991 [2024-10-07 11:33:30.666806] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.991 [2024-10-07 11:33:30.666828] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.991 [2024-10-07 11:33:30.666843] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.991 [2024-10-07 11:33:30.678034] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.991 [2024-10-07 11:33:30.678086] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.991 [2024-10-07 11:33:30.678352] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.991 [2024-10-07 11:33:30.678385] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.991 [2024-10-07 11:33:30.678402] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.991 [2024-10-07 11:33:30.678451] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.991 [2024-10-07 11:33:30.678474] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.991 [2024-10-07 11:33:30.678497] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.991 [2024-10-07 11:33:30.678711] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.991 [2024-10-07 11:33:30.678743] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.991 [2024-10-07 11:33:30.678806] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.991 [2024-10-07 11:33:30.678828] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.991 [2024-10-07 11:33:30.678843] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.991 [2024-10-07 11:33:30.678859] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.991 [2024-10-07 11:33:30.678874] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.991 [2024-10-07 11:33:30.678886] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.991 [2024-10-07 11:33:30.678909] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.991 [2024-10-07 11:33:30.678924] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.991 [2024-10-07 11:33:30.690563] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.991 [2024-10-07 11:33:30.690614] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.991 [2024-10-07 11:33:30.690842] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.991 [2024-10-07 11:33:30.690895] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.991 [2024-10-07 11:33:30.690927] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.991 [2024-10-07 11:33:30.690998] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.991 [2024-10-07 11:33:30.691024] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.991 [2024-10-07 11:33:30.691040] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.991 [2024-10-07 11:33:30.691167] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.991 [2024-10-07 11:33:30.691209] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.991 [2024-10-07 11:33:30.691327] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.991 [2024-10-07 11:33:30.691349] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.991 [2024-10-07 11:33:30.691366] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.991 [2024-10-07 11:33:30.691384] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.991 [2024-10-07 11:33:30.691398] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.991 [2024-10-07 11:33:30.691411] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.991 [2024-10-07 11:33:30.691512] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.991 [2024-10-07 11:33:30.691530] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.991 [2024-10-07 11:33:30.702357] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.991 [2024-10-07 11:33:30.702409] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.991 [2024-10-07 11:33:30.702528] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.991 [2024-10-07 11:33:30.702559] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.991 [2024-10-07 11:33:30.702576] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.991 [2024-10-07 11:33:30.702624] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.991 [2024-10-07 11:33:30.702661] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.991 [2024-10-07 11:33:30.702680] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.991 [2024-10-07 11:33:30.702705] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.991 [2024-10-07 11:33:30.702726] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.991 [2024-10-07 11:33:30.702745] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.991 [2024-10-07 11:33:30.702760] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.991 [2024-10-07 11:33:30.702773] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.991 [2024-10-07 11:33:30.702790] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.991 [2024-10-07 11:33:30.702804] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.991 [2024-10-07 11:33:30.702832] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.991 [2024-10-07 11:33:30.702858] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.991 [2024-10-07 11:33:30.702872] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.991 [2024-10-07 11:33:30.713413] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.991 [2024-10-07 11:33:30.713463] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.991 [2024-10-07 11:33:30.713584] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.991 [2024-10-07 11:33:30.713615] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.992 [2024-10-07 11:33:30.713632] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.992 [2024-10-07 11:33:30.713698] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.992 [2024-10-07 11:33:30.713723] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.992 [2024-10-07 11:33:30.713738] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.992 [2024-10-07 11:33:30.713763] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.992 [2024-10-07 11:33:30.713783] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.992 [2024-10-07 11:33:30.713803] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.992 [2024-10-07 11:33:30.713818] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.992 [2024-10-07 11:33:30.713833] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.992 [2024-10-07 11:33:30.713850] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.992 [2024-10-07 11:33:30.713864] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.992 [2024-10-07 11:33:30.713877] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.992 [2024-10-07 11:33:30.713899] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.992 [2024-10-07 11:33:30.713913] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.992 [2024-10-07 11:33:30.725266] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.992 [2024-10-07 11:33:30.725317] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.992 [2024-10-07 11:33:30.725493] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.992 [2024-10-07 11:33:30.725524] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.992 [2024-10-07 11:33:30.725541] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.992 [2024-10-07 11:33:30.725589] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.992 [2024-10-07 11:33:30.725612] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.992 [2024-10-07 11:33:30.725627] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.992 [2024-10-07 11:33:30.725826] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.992 [2024-10-07 11:33:30.725871] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.992 [2024-10-07 11:33:30.727015] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.992 [2024-10-07 11:33:30.727053] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.992 [2024-10-07 11:33:30.727071] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.992 [2024-10-07 11:33:30.727089] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.992 [2024-10-07 11:33:30.727103] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.992 [2024-10-07 11:33:30.727117] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.992 [2024-10-07 11:33:30.728632] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.992 [2024-10-07 11:33:30.728679] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.992 [2024-10-07 11:33:30.735964] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.992 [2024-10-07 11:33:30.736011] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.992 [2024-10-07 11:33:30.736808] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.992 [2024-10-07 11:33:30.736851] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.992 [2024-10-07 11:33:30.736878] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.992 [2024-10-07 11:33:30.736928] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.992 [2024-10-07 11:33:30.736954] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.992 [2024-10-07 11:33:30.736969] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.992 [2024-10-07 11:33:30.737177] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.992 [2024-10-07 11:33:30.737209] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.992 [2024-10-07 11:33:30.737316] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.992 [2024-10-07 11:33:30.737335] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.992 [2024-10-07 11:33:30.737349] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.992 [2024-10-07 11:33:30.737367] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.992 [2024-10-07 11:33:30.737381] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.992 [2024-10-07 11:33:30.737393] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.992 [2024-10-07 11:33:30.740200] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.992 [2024-10-07 11:33:30.740243] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.992 [2024-10-07 11:33:30.746075] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.992 [2024-10-07 11:33:30.746550] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.992 [2024-10-07 11:33:30.746667] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.992 [2024-10-07 11:33:30.746699] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.992 [2024-10-07 11:33:30.746767] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.992 [2024-10-07 11:33:30.746958] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.992 [2024-10-07 11:33:30.746989] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.992 [2024-10-07 11:33:30.747006] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.992 [2024-10-07 11:33:30.747024] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.992 [2024-10-07 11:33:30.747218] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.992 [2024-10-07 11:33:30.747248] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.992 [2024-10-07 11:33:30.747264] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.992 [2024-10-07 11:33:30.747277] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.992 [2024-10-07 11:33:30.747335] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.992 [2024-10-07 11:33:30.747356] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.992 [2024-10-07 11:33:30.747369] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.992 [2024-10-07 11:33:30.747383] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.992 [2024-10-07 11:33:30.747404] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.992 [2024-10-07 11:33:30.758582] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.992 [2024-10-07 11:33:30.758634] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.992 [2024-10-07 11:33:30.758923] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.992 [2024-10-07 11:33:30.758968] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.992 [2024-10-07 11:33:30.758988] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.992 [2024-10-07 11:33:30.759040] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.992 [2024-10-07 11:33:30.759063] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.992 [2024-10-07 11:33:30.759079] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.992 [2024-10-07 11:33:30.759242] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.992 [2024-10-07 11:33:30.759274] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.992 [2024-10-07 11:33:30.759339] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.992 [2024-10-07 11:33:30.759363] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.992 [2024-10-07 11:33:30.759377] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.992 [2024-10-07 11:33:30.759394] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.992 [2024-10-07 11:33:30.759409] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.992 [2024-10-07 11:33:30.759422] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.992 [2024-10-07 11:33:30.759460] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.992 [2024-10-07 11:33:30.759477] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.992 [2024-10-07 11:33:30.769746] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.992 [2024-10-07 11:33:30.769795] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.992 [2024-10-07 11:33:30.772105] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.992 [2024-10-07 11:33:30.772150] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.992 [2024-10-07 11:33:30.772171] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.992 [2024-10-07 11:33:30.772220] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.992 [2024-10-07 11:33:30.772244] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.992 [2024-10-07 11:33:30.772259] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.992 [2024-10-07 11:33:30.772679] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.992 [2024-10-07 11:33:30.772712] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.993 [2024-10-07 11:33:30.772794] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.993 [2024-10-07 11:33:30.772818] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.993 [2024-10-07 11:33:30.772832] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.993 [2024-10-07 11:33:30.772849] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.993 [2024-10-07 11:33:30.772863] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.993 [2024-10-07 11:33:30.772876] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.993 [2024-10-07 11:33:30.773127] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.993 [2024-10-07 11:33:30.773157] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.993 [2024-10-07 11:33:30.782331] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.993 [2024-10-07 11:33:30.782380] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.993 [2024-10-07 11:33:30.782541] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.993 [2024-10-07 11:33:30.782573] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.993 [2024-10-07 11:33:30.782589] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.993 [2024-10-07 11:33:30.782637] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.993 [2024-10-07 11:33:30.782675] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.993 [2024-10-07 11:33:30.782692] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.993 [2024-10-07 11:33:30.782716] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.993 [2024-10-07 11:33:30.782735] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.993 [2024-10-07 11:33:30.782770] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.993 [2024-10-07 11:33:30.782791] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.993 [2024-10-07 11:33:30.782804] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.993 [2024-10-07 11:33:30.782820] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.993 [2024-10-07 11:33:30.782834] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.993 [2024-10-07 11:33:30.782847] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.993 [2024-10-07 11:33:30.782870] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.993 [2024-10-07 11:33:30.782884] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.993 [2024-10-07 11:33:30.793324] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.993 [2024-10-07 11:33:30.793374] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.993 [2024-10-07 11:33:30.793559] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.993 [2024-10-07 11:33:30.793590] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.993 [2024-10-07 11:33:30.793607] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.993 [2024-10-07 11:33:30.793671] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.993 [2024-10-07 11:33:30.793697] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.993 [2024-10-07 11:33:30.793712] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.993 [2024-10-07 11:33:30.793826] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.993 [2024-10-07 11:33:30.793853] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.993 [2024-10-07 11:33:30.793967] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.993 [2024-10-07 11:33:30.793989] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.993 [2024-10-07 11:33:30.794003] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.993 [2024-10-07 11:33:30.794020] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.993 [2024-10-07 11:33:30.794034] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.993 [2024-10-07 11:33:30.794046] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.993 [2024-10-07 11:33:30.794164] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.993 [2024-10-07 11:33:30.794185] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.993 [2024-10-07 11:33:30.803592] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.993 [2024-10-07 11:33:30.803640] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.993 [2024-10-07 11:33:30.803759] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.993 [2024-10-07 11:33:30.803789] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.993 [2024-10-07 11:33:30.803805] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.993 [2024-10-07 11:33:30.803870] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.993 [2024-10-07 11:33:30.803894] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.993 [2024-10-07 11:33:30.803909] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.993 [2024-10-07 11:33:30.803933] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.993 [2024-10-07 11:33:30.803953] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.993 [2024-10-07 11:33:30.803973] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.993 [2024-10-07 11:33:30.803987] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.993 [2024-10-07 11:33:30.804001] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.993 [2024-10-07 11:33:30.804017] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.993 [2024-10-07 11:33:30.804031] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.993 [2024-10-07 11:33:30.804048] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.993 [2024-10-07 11:33:30.804071] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.993 [2024-10-07 11:33:30.804085] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.993 [2024-10-07 11:33:30.813706] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.993 [2024-10-07 11:33:30.813853] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.993 [2024-10-07 11:33:30.813885] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.993 [2024-10-07 11:33:30.813901] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.993 [2024-10-07 11:33:30.813927] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.993 [2024-10-07 11:33:30.813956] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.993 [2024-10-07 11:33:30.814018] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.993 [2024-10-07 11:33:30.814044] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.993 [2024-10-07 11:33:30.814059] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.993 [2024-10-07 11:33:30.814074] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.993 [2024-10-07 11:33:30.814086] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.993 [2024-10-07 11:33:30.814100] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.993 [2024-10-07 11:33:30.814124] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.993 [2024-10-07 11:33:30.814142] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.993 [2024-10-07 11:33:30.814178] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.993 [2024-10-07 11:33:30.814197] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.993 [2024-10-07 11:33:30.814210] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.993 [2024-10-07 11:33:30.814248] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.993 [2024-10-07 11:33:30.826157] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.993 [2024-10-07 11:33:30.826207] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.993 [2024-10-07 11:33:30.826293] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.993 [2024-10-07 11:33:30.826322] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.993 [2024-10-07 11:33:30.826339] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.993 [2024-10-07 11:33:30.826394] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.993 [2024-10-07 11:33:30.826416] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.993 [2024-10-07 11:33:30.826432] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.993 [2024-10-07 11:33:30.826454] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.993 [2024-10-07 11:33:30.826475] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.993 [2024-10-07 11:33:30.826494] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.993 [2024-10-07 11:33:30.826509] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.993 [2024-10-07 11:33:30.826522] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.993 [2024-10-07 11:33:30.826538] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.993 [2024-10-07 11:33:30.826558] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.993 [2024-10-07 11:33:30.826571] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.993 [2024-10-07 11:33:30.826593] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.993 [2024-10-07 11:33:30.826607] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.993 [2024-10-07 11:33:30.838149] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.993 [2024-10-07 11:33:30.838200] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.993 [2024-10-07 11:33:30.838919] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.993 [2024-10-07 11:33:30.838963] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.993 [2024-10-07 11:33:30.838983] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.994 [2024-10-07 11:33:30.839033] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.994 [2024-10-07 11:33:30.839057] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.994 [2024-10-07 11:33:30.839072] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.994 [2024-10-07 11:33:30.841318] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.994 [2024-10-07 11:33:30.841363] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.994 [2024-10-07 11:33:30.841690] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.994 [2024-10-07 11:33:30.841745] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.994 [2024-10-07 11:33:30.841764] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.994 [2024-10-07 11:33:30.841782] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.994 [2024-10-07 11:33:30.841797] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.994 [2024-10-07 11:33:30.841809] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.994 [2024-10-07 11:33:30.841944] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.994 [2024-10-07 11:33:30.841967] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.994 [2024-10-07 11:33:30.848430] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.994 [2024-10-07 11:33:30.848479] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.994 [2024-10-07 11:33:30.848733] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.994 [2024-10-07 11:33:30.848766] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.994 [2024-10-07 11:33:30.848783] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.994 [2024-10-07 11:33:30.848832] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.994 [2024-10-07 11:33:30.848856] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.994 [2024-10-07 11:33:30.848871] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.994 [2024-10-07 11:33:30.848925] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.994 [2024-10-07 11:33:30.848952] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.994 [2024-10-07 11:33:30.849124] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.994 [2024-10-07 11:33:30.849148] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.994 [2024-10-07 11:33:30.849163] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.994 [2024-10-07 11:33:30.849179] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.994 [2024-10-07 11:33:30.849194] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.994 [2024-10-07 11:33:30.849207] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.994 [2024-10-07 11:33:30.849270] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.994 [2024-10-07 11:33:30.849291] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.994 [2024-10-07 11:33:30.861674] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.994 [2024-10-07 11:33:30.861725] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.994 [2024-10-07 11:33:30.862077] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.994 [2024-10-07 11:33:30.862121] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.994 [2024-10-07 11:33:30.862141] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.994 [2024-10-07 11:33:30.862193] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.994 [2024-10-07 11:33:30.862234] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.994 [2024-10-07 11:33:30.862251] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.994 [2024-10-07 11:33:30.862483] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.994 [2024-10-07 11:33:30.862515] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.994 [2024-10-07 11:33:30.863153] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.994 [2024-10-07 11:33:30.863199] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.994 [2024-10-07 11:33:30.863218] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.994 [2024-10-07 11:33:30.863236] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.994 [2024-10-07 11:33:30.863251] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.994 [2024-10-07 11:33:30.863264] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.994 [2024-10-07 11:33:30.863510] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.994 [2024-10-07 11:33:30.863535] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.994 [2024-10-07 11:33:30.874254] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.994 [2024-10-07 11:33:30.874304] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.994 [2024-10-07 11:33:30.874389] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.994 [2024-10-07 11:33:30.874419] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.994 [2024-10-07 11:33:30.874435] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.994 [2024-10-07 11:33:30.874482] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.994 [2024-10-07 11:33:30.874505] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.994 [2024-10-07 11:33:30.874520] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.994 [2024-10-07 11:33:30.874543] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.994 [2024-10-07 11:33:30.874562] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.994 [2024-10-07 11:33:30.875176] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.994 [2024-10-07 11:33:30.875225] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.994 [2024-10-07 11:33:30.875243] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.994 [2024-10-07 11:33:30.875260] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.994 [2024-10-07 11:33:30.875275] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.994 [2024-10-07 11:33:30.875287] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.994 [2024-10-07 11:33:30.875386] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.994 [2024-10-07 11:33:30.875408] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.994 [2024-10-07 11:33:30.884367] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.994 [2024-10-07 11:33:30.884432] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.994 [2024-10-07 11:33:30.884511] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.994 [2024-10-07 11:33:30.884540] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.994 [2024-10-07 11:33:30.884557] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.994 [2024-10-07 11:33:30.884611] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.994 [2024-10-07 11:33:30.884636] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.994 [2024-10-07 11:33:30.884664] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.994 [2024-10-07 11:33:30.884685] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.994 [2024-10-07 11:33:30.884708] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.994 [2024-10-07 11:33:30.884726] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.994 [2024-10-07 11:33:30.884739] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.994 [2024-10-07 11:33:30.884753] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.994 [2024-10-07 11:33:30.884775] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.994 [2024-10-07 11:33:30.884797] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.994 [2024-10-07 11:33:30.884810] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.994 [2024-10-07 11:33:30.884823] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.994 [2024-10-07 11:33:30.884843] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.994 [2024-10-07 11:33:30.896904] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.994 [2024-10-07 11:33:30.896951] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.994 [2024-10-07 11:33:30.897190] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.994 [2024-10-07 11:33:30.897221] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.994 [2024-10-07 11:33:30.897239] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.994 [2024-10-07 11:33:30.897290] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.994 [2024-10-07 11:33:30.897313] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.995 [2024-10-07 11:33:30.897328] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.995 [2024-10-07 11:33:30.897353] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.995 [2024-10-07 11:33:30.897374] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.995 [2024-10-07 11:33:30.897394] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.995 [2024-10-07 11:33:30.897408] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.995 [2024-10-07 11:33:30.897438] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.995 [2024-10-07 11:33:30.897455] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.995 [2024-10-07 11:33:30.897470] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.995 [2024-10-07 11:33:30.897483] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.995 [2024-10-07 11:33:30.897505] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.995 [2024-10-07 11:33:30.897520] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.995 8936.43 IOPS, 34.91 MiB/s [2024-10-07T11:33:33.518Z] [2024-10-07 11:33:30.907222] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.995 [2024-10-07 11:33:30.907270] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.995 [2024-10-07 11:33:30.909272] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.995 [2024-10-07 11:33:30.909318] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.995 [2024-10-07 11:33:30.909339] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.995 [2024-10-07 11:33:30.909389] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.995 [2024-10-07 11:33:30.909413] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.995 [2024-10-07 11:33:30.909428] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.995 [2024-10-07 11:33:30.912682] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.995 [2024-10-07 11:33:30.912727] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.995 [2024-10-07 11:33:30.913596] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.995 [2024-10-07 11:33:30.913634] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.995 [2024-10-07 11:33:30.913664] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.995 [2024-10-07 11:33:30.913685] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.995 [2024-10-07 11:33:30.913698] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.995 [2024-10-07 11:33:30.913711] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.995 [2024-10-07 11:33:30.913826] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.995 [2024-10-07 11:33:30.913848] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.995 [2024-10-07 11:33:30.918785] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.995 [2024-10-07 11:33:30.918835] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.995 [2024-10-07 11:33:30.919026] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.995 [2024-10-07 11:33:30.919058] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.995 [2024-10-07 11:33:30.919075] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.995 [2024-10-07 11:33:30.919122] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.995 [2024-10-07 11:33:30.919169] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.995 [2024-10-07 11:33:30.919203] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.995 [2024-10-07 11:33:30.919331] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.995 [2024-10-07 11:33:30.919359] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.995 [2024-10-07 11:33:30.919476] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.995 [2024-10-07 11:33:30.919498] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.995 [2024-10-07 11:33:30.919512] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.995 [2024-10-07 11:33:30.919529] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.995 [2024-10-07 11:33:30.919543] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.995 [2024-10-07 11:33:30.919556] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.995 [2024-10-07 11:33:30.919671] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.995 [2024-10-07 11:33:30.919692] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.995 [2024-10-07 11:33:30.928897] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.995 [2024-10-07 11:33:30.928961] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.995 [2024-10-07 11:33:30.929038] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.995 [2024-10-07 11:33:30.929067] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.995 [2024-10-07 11:33:30.929083] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.995 [2024-10-07 11:33:30.929147] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.995 [2024-10-07 11:33:30.929172] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.995 [2024-10-07 11:33:30.929187] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.995 [2024-10-07 11:33:30.929204] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.995 [2024-10-07 11:33:30.929228] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.995 [2024-10-07 11:33:30.929245] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.995 [2024-10-07 11:33:30.929259] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.995 [2024-10-07 11:33:30.929272] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.995 [2024-10-07 11:33:30.929296] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.995 [2024-10-07 11:33:30.929310] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.995 [2024-10-07 11:33:30.929323] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.995 [2024-10-07 11:33:30.929336] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.995 [2024-10-07 11:33:30.929355] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.995 [2024-10-07 11:33:30.940638] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.995 [2024-10-07 11:33:30.940716] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.995 [2024-10-07 11:33:30.941085] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.995 [2024-10-07 11:33:30.941130] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.995 [2024-10-07 11:33:30.941151] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.995 [2024-10-07 11:33:30.941201] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.995 [2024-10-07 11:33:30.941224] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.995 [2024-10-07 11:33:30.941239] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.995 [2024-10-07 11:33:30.941452] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.995 [2024-10-07 11:33:30.941483] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.995 [2024-10-07 11:33:30.941534] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.995 [2024-10-07 11:33:30.941555] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.995 [2024-10-07 11:33:30.941569] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.995 [2024-10-07 11:33:30.941586] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.995 [2024-10-07 11:33:30.941600] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.995 [2024-10-07 11:33:30.941613] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.995 [2024-10-07 11:33:30.941636] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.995 [2024-10-07 11:33:30.941666] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.995 [2024-10-07 11:33:30.951155] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.995 [2024-10-07 11:33:30.951215] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.995 [2024-10-07 11:33:30.951393] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.995 [2024-10-07 11:33:30.951424] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.995 [2024-10-07 11:33:30.951441] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.995 [2024-10-07 11:33:30.951490] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.995 [2024-10-07 11:33:30.951513] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.995 [2024-10-07 11:33:30.951528] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.995 [2024-10-07 11:33:30.952476] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.995 [2024-10-07 11:33:30.952521] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.995 [2024-10-07 11:33:30.954420] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.995 [2024-10-07 11:33:30.954459] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.995 [2024-10-07 11:33:30.954492] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.995 [2024-10-07 11:33:30.954512] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.995 [2024-10-07 11:33:30.954527] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.995 [2024-10-07 11:33:30.954540] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.995 [2024-10-07 11:33:30.955287] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.995 [2024-10-07 11:33:30.955324] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.995 [2024-10-07 11:33:30.961588] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.995 [2024-10-07 11:33:30.961638] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.995 [2024-10-07 11:33:30.961817] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.995 [2024-10-07 11:33:30.961848] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.996 [2024-10-07 11:33:30.961865] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.996 [2024-10-07 11:33:30.961912] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.996 [2024-10-07 11:33:30.961935] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.996 [2024-10-07 11:33:30.961950] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.996 [2024-10-07 11:33:30.962054] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.996 [2024-10-07 11:33:30.962080] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.996 [2024-10-07 11:33:30.963721] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.996 [2024-10-07 11:33:30.963761] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.996 [2024-10-07 11:33:30.963779] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.996 [2024-10-07 11:33:30.963796] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.996 [2024-10-07 11:33:30.963811] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.996 [2024-10-07 11:33:30.963824] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.996 [2024-10-07 11:33:30.964102] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.996 [2024-10-07 11:33:30.964129] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.996 [2024-10-07 11:33:30.971717] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.996 [2024-10-07 11:33:30.971783] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.996 [2024-10-07 11:33:30.971860] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.996 [2024-10-07 11:33:30.971888] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.996 [2024-10-07 11:33:30.971905] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.996 [2024-10-07 11:33:30.971959] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.996 [2024-10-07 11:33:30.971984] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.996 [2024-10-07 11:33:30.972018] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.996 [2024-10-07 11:33:30.972037] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.996 [2024-10-07 11:33:30.972061] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.996 [2024-10-07 11:33:30.972078] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.996 [2024-10-07 11:33:30.972092] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.996 [2024-10-07 11:33:30.972105] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.996 [2024-10-07 11:33:30.972128] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.996 [2024-10-07 11:33:30.972143] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.996 [2024-10-07 11:33:30.972156] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.996 [2024-10-07 11:33:30.972169] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.996 [2024-10-07 11:33:30.972189] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.996 [2024-10-07 11:33:30.982512] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.996 [2024-10-07 11:33:30.982565] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.996 [2024-10-07 11:33:30.982666] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.996 [2024-10-07 11:33:30.982696] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.996 [2024-10-07 11:33:30.982712] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.996 [2024-10-07 11:33:30.982761] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.996 [2024-10-07 11:33:30.982784] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.996 [2024-10-07 11:33:30.982800] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.996 [2024-10-07 11:33:30.982824] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.996 [2024-10-07 11:33:30.982844] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.996 [2024-10-07 11:33:30.982864] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.996 [2024-10-07 11:33:30.982878] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.996 [2024-10-07 11:33:30.982892] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.996 [2024-10-07 11:33:30.982908] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.996 [2024-10-07 11:33:30.982921] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.996 [2024-10-07 11:33:30.982934] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.996 [2024-10-07 11:33:30.982957] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.996 [2024-10-07 11:33:30.982971] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.996 [2024-10-07 11:33:30.992759] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.996 [2024-10-07 11:33:30.992827] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.996 [2024-10-07 11:33:30.992916] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.996 [2024-10-07 11:33:30.992946] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.996 [2024-10-07 11:33:30.992963] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.996 [2024-10-07 11:33:30.993010] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.996 [2024-10-07 11:33:30.993032] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.996 [2024-10-07 11:33:30.993047] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.996 [2024-10-07 11:33:30.995920] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.996 [2024-10-07 11:33:30.995968] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.996 [2024-10-07 11:33:30.997225] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.996 [2024-10-07 11:33:30.997263] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.996 [2024-10-07 11:33:30.997282] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.996 [2024-10-07 11:33:30.997300] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.996 [2024-10-07 11:33:30.997315] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.996 [2024-10-07 11:33:30.997327] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.996 [2024-10-07 11:33:30.998539] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.996 [2024-10-07 11:33:30.998575] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.996 [2024-10-07 11:33:31.002889] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.996 [2024-10-07 11:33:31.002949] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.996 [2024-10-07 11:33:31.003025] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.996 [2024-10-07 11:33:31.003055] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.996 [2024-10-07 11:33:31.003072] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.996 [2024-10-07 11:33:31.003127] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.996 [2024-10-07 11:33:31.003152] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.996 [2024-10-07 11:33:31.003167] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.996 [2024-10-07 11:33:31.003196] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.996 [2024-10-07 11:33:31.003224] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.996 [2024-10-07 11:33:31.003241] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.996 [2024-10-07 11:33:31.003255] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.996 [2024-10-07 11:33:31.003268] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.996 [2024-10-07 11:33:31.003307] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.996 [2024-10-07 11:33:31.003324] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.996 [2024-10-07 11:33:31.003336] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.996 [2024-10-07 11:33:31.003349] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.996 [2024-10-07 11:33:31.003376] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.996 [2024-10-07 11:33:31.014491] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.996 [2024-10-07 11:33:31.014543] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.996 [2024-10-07 11:33:31.014847] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.996 [2024-10-07 11:33:31.014880] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.996 [2024-10-07 11:33:31.014898] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.996 [2024-10-07 11:33:31.014952] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.996 [2024-10-07 11:33:31.014976] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.996 [2024-10-07 11:33:31.014991] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.996 [2024-10-07 11:33:31.015208] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.996 [2024-10-07 11:33:31.015240] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.996 [2024-10-07 11:33:31.015298] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.996 [2024-10-07 11:33:31.015320] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.996 [2024-10-07 11:33:31.015335] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.996 [2024-10-07 11:33:31.015351] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.996 [2024-10-07 11:33:31.015365] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.996 [2024-10-07 11:33:31.015378] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.996 [2024-10-07 11:33:31.015560] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.996 [2024-10-07 11:33:31.015583] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.996 [2024-10-07 11:33:31.028421] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.996 [2024-10-07 11:33:31.028472] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.996 [2024-10-07 11:33:31.028702] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.996 [2024-10-07 11:33:31.028746] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.996 [2024-10-07 11:33:31.028767] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.996 [2024-10-07 11:33:31.028818] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.997 [2024-10-07 11:33:31.028841] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.997 [2024-10-07 11:33:31.028857] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.997 [2024-10-07 11:33:31.030493] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.997 [2024-10-07 11:33:31.030538] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.997 [2024-10-07 11:33:31.031162] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.997 [2024-10-07 11:33:31.031210] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.997 [2024-10-07 11:33:31.031228] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.997 [2024-10-07 11:33:31.031246] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.997 [2024-10-07 11:33:31.031260] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.997 [2024-10-07 11:33:31.031273] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.997 [2024-10-07 11:33:31.031517] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.997 [2024-10-07 11:33:31.031552] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.997 [2024-10-07 11:33:31.044831] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.997 [2024-10-07 11:33:31.044882] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.997 [2024-10-07 11:33:31.045052] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.997 [2024-10-07 11:33:31.045082] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.997 [2024-10-07 11:33:31.045099] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.997 [2024-10-07 11:33:31.045147] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.997 [2024-10-07 11:33:31.045170] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.997 [2024-10-07 11:33:31.045185] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.997 [2024-10-07 11:33:31.045209] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.997 [2024-10-07 11:33:31.045229] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.997 [2024-10-07 11:33:31.045254] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.997 [2024-10-07 11:33:31.045284] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.997 [2024-10-07 11:33:31.045309] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.997 [2024-10-07 11:33:31.045330] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.997 [2024-10-07 11:33:31.045344] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.997 [2024-10-07 11:33:31.045357] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.997 [2024-10-07 11:33:31.045380] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.997 [2024-10-07 11:33:31.045394] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.997 [2024-10-07 11:33:31.059884] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.997 [2024-10-07 11:33:31.059935] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.997 [2024-10-07 11:33:31.060049] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.997 [2024-10-07 11:33:31.060080] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.997 [2024-10-07 11:33:31.060097] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.997 [2024-10-07 11:33:31.060144] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.997 [2024-10-07 11:33:31.060167] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.997 [2024-10-07 11:33:31.060183] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.997 [2024-10-07 11:33:31.060206] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.997 [2024-10-07 11:33:31.060226] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.997 [2024-10-07 11:33:31.060246] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.997 [2024-10-07 11:33:31.060266] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.997 [2024-10-07 11:33:31.060280] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.997 [2024-10-07 11:33:31.060296] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.997 [2024-10-07 11:33:31.060310] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.997 [2024-10-07 11:33:31.060323] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.997 [2024-10-07 11:33:31.060345] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.997 [2024-10-07 11:33:31.060360] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.997 [2024-10-07 11:33:31.071001] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.997 [2024-10-07 11:33:31.071051] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.997 [2024-10-07 11:33:31.071243] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.997 [2024-10-07 11:33:31.071276] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.997 [2024-10-07 11:33:31.071293] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.997 [2024-10-07 11:33:31.071352] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.997 [2024-10-07 11:33:31.071375] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.997 [2024-10-07 11:33:31.071391] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.997 [2024-10-07 11:33:31.071525] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.997 [2024-10-07 11:33:31.071549] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.997 [2024-10-07 11:33:31.071664] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.997 [2024-10-07 11:33:31.071685] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.997 [2024-10-07 11:33:31.071699] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.997 [2024-10-07 11:33:31.071716] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.997 [2024-10-07 11:33:31.071748] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.997 [2024-10-07 11:33:31.071762] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.997 [2024-10-07 11:33:31.074262] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.997 [2024-10-07 11:33:31.074301] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.997 [2024-10-07 11:33:31.081115] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.997 [2024-10-07 11:33:31.081760] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.997 [2024-10-07 11:33:31.081859] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.997 [2024-10-07 11:33:31.081889] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.997 [2024-10-07 11:33:31.081906] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.997 [2024-10-07 11:33:31.082145] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.997 [2024-10-07 11:33:31.082185] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.997 [2024-10-07 11:33:31.082205] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.997 [2024-10-07 11:33:31.082224] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.997 [2024-10-07 11:33:31.082353] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.997 [2024-10-07 11:33:31.082378] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.997 [2024-10-07 11:33:31.082393] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.997 [2024-10-07 11:33:31.082406] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.997 [2024-10-07 11:33:31.082526] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.997 [2024-10-07 11:33:31.082547] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.997 [2024-10-07 11:33:31.082561] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.997 [2024-10-07 11:33:31.082574] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.997 [2024-10-07 11:33:31.082701] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.997 [2024-10-07 11:33:31.091209] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.997 [2024-10-07 11:33:31.091316] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.997 [2024-10-07 11:33:31.091347] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.997 [2024-10-07 11:33:31.091364] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.997 [2024-10-07 11:33:31.091388] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.997 [2024-10-07 11:33:31.091410] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.997 [2024-10-07 11:33:31.091425] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.997 [2024-10-07 11:33:31.091439] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.997 [2024-10-07 11:33:31.091462] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.997 [2024-10-07 11:33:31.091834] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.997 [2024-10-07 11:33:31.091914] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.997 [2024-10-07 11:33:31.091941] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.997 [2024-10-07 11:33:31.091957] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.997 [2024-10-07 11:33:31.091980] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.997 [2024-10-07 11:33:31.092001] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.997 [2024-10-07 11:33:31.092016] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.997 [2024-10-07 11:33:31.092036] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.997 [2024-10-07 11:33:31.092077] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.997 [2024-10-07 11:33:31.103287] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.997 [2024-10-07 11:33:31.103806] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.997 [2024-10-07 11:33:31.103903] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.997 [2024-10-07 11:33:31.103933] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.997 [2024-10-07 11:33:31.103949] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.997 [2024-10-07 11:33:31.104223] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.997 [2024-10-07 11:33:31.104264] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.997 [2024-10-07 11:33:31.104284] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.997 [2024-10-07 11:33:31.104303] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.997 [2024-10-07 11:33:31.104523] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.998 [2024-10-07 11:33:31.104577] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.998 [2024-10-07 11:33:31.104596] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.998 [2024-10-07 11:33:31.104611] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.998 [2024-10-07 11:33:31.104687] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.998 [2024-10-07 11:33:31.104710] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.998 [2024-10-07 11:33:31.104724] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.998 [2024-10-07 11:33:31.104737] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.998 [2024-10-07 11:33:31.104759] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.998 [2024-10-07 11:33:31.116470] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.998 [2024-10-07 11:33:31.116823] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.998 [2024-10-07 11:33:31.116921] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.998 [2024-10-07 11:33:31.116967] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.998 [2024-10-07 11:33:31.116986] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.998 [2024-10-07 11:33:31.117209] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.998 [2024-10-07 11:33:31.117261] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.998 [2024-10-07 11:33:31.117283] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.998 [2024-10-07 11:33:31.117302] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.998 [2024-10-07 11:33:31.117421] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.998 [2024-10-07 11:33:31.117446] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.998 [2024-10-07 11:33:31.117460] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.998 [2024-10-07 11:33:31.117474] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.998 [2024-10-07 11:33:31.117587] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.998 [2024-10-07 11:33:31.117609] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.998 [2024-10-07 11:33:31.117622] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.998 [2024-10-07 11:33:31.117636] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.998 [2024-10-07 11:33:31.117752] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.998 [2024-10-07 11:33:31.126814] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.998 [2024-10-07 11:33:31.127145] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.998 [2024-10-07 11:33:31.127195] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.998 [2024-10-07 11:33:31.127217] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.998 [2024-10-07 11:33:31.127257] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.998 [2024-10-07 11:33:31.127287] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.998 [2024-10-07 11:33:31.127313] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.998 [2024-10-07 11:33:31.127328] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.998 [2024-10-07 11:33:31.127342] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.998 [2024-10-07 11:33:31.127363] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.998 [2024-10-07 11:33:31.127417] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.998 [2024-10-07 11:33:31.127442] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.998 [2024-10-07 11:33:31.127458] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.998 [2024-10-07 11:33:31.127481] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.998 [2024-10-07 11:33:31.127502] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.998 [2024-10-07 11:33:31.127532] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.998 [2024-10-07 11:33:31.127546] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.998 [2024-10-07 11:33:31.127569] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.998 [2024-10-07 11:33:31.136894] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.998 [2024-10-07 11:33:31.137001] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.998 [2024-10-07 11:33:31.137031] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.998 [2024-10-07 11:33:31.137048] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.998 [2024-10-07 11:33:31.137071] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.998 [2024-10-07 11:33:31.137093] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.998 [2024-10-07 11:33:31.137108] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.998 [2024-10-07 11:33:31.137121] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.998 [2024-10-07 11:33:31.137144] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.998 [2024-10-07 11:33:31.137333] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.998 [2024-10-07 11:33:31.137402] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.998 [2024-10-07 11:33:31.137428] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.998 [2024-10-07 11:33:31.137444] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.998 [2024-10-07 11:33:31.137467] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.998 [2024-10-07 11:33:31.137493] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.998 [2024-10-07 11:33:31.137507] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.998 [2024-10-07 11:33:31.137520] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.998 [2024-10-07 11:33:31.137542] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.998 [2024-10-07 11:33:31.149234] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.998 [2024-10-07 11:33:31.149282] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.998 [2024-10-07 11:33:31.149370] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.998 [2024-10-07 11:33:31.149398] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.998 [2024-10-07 11:33:31.149415] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.998 [2024-10-07 11:33:31.149461] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.998 [2024-10-07 11:33:31.149484] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.998 [2024-10-07 11:33:31.149499] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.998 [2024-10-07 11:33:31.149521] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.998 [2024-10-07 11:33:31.149541] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.998 [2024-10-07 11:33:31.149576] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.998 [2024-10-07 11:33:31.149591] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.998 [2024-10-07 11:33:31.149605] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.998 [2024-10-07 11:33:31.149621] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.998 [2024-10-07 11:33:31.149635] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.998 [2024-10-07 11:33:31.149661] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.998 [2024-10-07 11:33:31.149689] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.998 [2024-10-07 11:33:31.149703] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.999 [2024-10-07 11:33:31.161173] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.999 [2024-10-07 11:33:31.161224] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.999 [2024-10-07 11:33:31.161408] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.999 [2024-10-07 11:33:31.161439] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.999 [2024-10-07 11:33:31.161456] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.999 [2024-10-07 11:33:31.161503] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.999 [2024-10-07 11:33:31.161526] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.999 [2024-10-07 11:33:31.161541] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.999 [2024-10-07 11:33:31.161704] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.999 [2024-10-07 11:33:31.161736] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.999 [2024-10-07 11:33:31.161851] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.999 [2024-10-07 11:33:31.161873] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.999 [2024-10-07 11:33:31.161888] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.999 [2024-10-07 11:33:31.161906] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.999 [2024-10-07 11:33:31.161920] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.999 [2024-10-07 11:33:31.161932] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.999 [2024-10-07 11:33:31.162033] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.999 [2024-10-07 11:33:31.162052] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.999 [2024-10-07 11:33:31.171697] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.999 [2024-10-07 11:33:31.171746] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.999 [2024-10-07 11:33:31.171924] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.999 [2024-10-07 11:33:31.171965] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.999 [2024-10-07 11:33:31.172000] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.999 [2024-10-07 11:33:31.172054] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.999 [2024-10-07 11:33:31.172078] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.999 [2024-10-07 11:33:31.172093] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.999 [2024-10-07 11:33:31.172197] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.999 [2024-10-07 11:33:31.172221] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.999 [2024-10-07 11:33:31.172321] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.999 [2024-10-07 11:33:31.172341] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.999 [2024-10-07 11:33:31.172355] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.999 [2024-10-07 11:33:31.172372] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.999 [2024-10-07 11:33:31.172386] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.999 [2024-10-07 11:33:31.172398] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.999 [2024-10-07 11:33:31.175560] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.999 [2024-10-07 11:33:31.175600] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.999 [2024-10-07 11:33:31.181809] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.999 [2024-10-07 11:33:31.181873] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.999 [2024-10-07 11:33:31.181949] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.999 [2024-10-07 11:33:31.181979] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.999 [2024-10-07 11:33:31.181995] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.999 [2024-10-07 11:33:31.182050] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.999 [2024-10-07 11:33:31.182075] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.999 [2024-10-07 11:33:31.182090] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.999 [2024-10-07 11:33:31.182108] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.999 [2024-10-07 11:33:31.182131] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.999 [2024-10-07 11:33:31.182148] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.999 [2024-10-07 11:33:31.182161] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.999 [2024-10-07 11:33:31.182175] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.999 [2024-10-07 11:33:31.182198] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.999 [2024-10-07 11:33:31.182212] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.999 [2024-10-07 11:33:31.182225] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.999 [2024-10-07 11:33:31.182253] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.999 [2024-10-07 11:33:31.182276] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.999 [2024-10-07 11:33:31.194496] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.999 [2024-10-07 11:33:31.194547] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.999 [2024-10-07 11:33:31.194866] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.999 [2024-10-07 11:33:31.194910] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.999 [2024-10-07 11:33:31.194931] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:37.999 [2024-10-07 11:33:31.194982] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.999 [2024-10-07 11:33:31.195006] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.999 [2024-10-07 11:33:31.195021] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.999 [2024-10-07 11:33:31.195298] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:37.999 [2024-10-07 11:33:31.195340] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:37.999 [2024-10-07 11:33:31.195400] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.999 [2024-10-07 11:33:31.195422] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.999 [2024-10-07 11:33:31.195436] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.999 [2024-10-07 11:33:31.195453] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:37.999 [2024-10-07 11:33:31.195467] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:37.999 [2024-10-07 11:33:31.195480] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:37.999 [2024-10-07 11:33:31.195504] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.999 [2024-10-07 11:33:31.195518] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:37.999 [2024-10-07 11:33:31.208638] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.999 [2024-10-07 11:33:31.208714] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:37.999 [2024-10-07 11:33:31.209287] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.999 [2024-10-07 11:33:31.209331] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:37.999 [2024-10-07 11:33:31.209352] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:37.999 [2024-10-07 11:33:31.209403] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:37.999 [2024-10-07 11:33:31.209427] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:37.999 [2024-10-07 11:33:31.209442] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:38.000 [2024-10-07 11:33:31.209690] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:38.000 [2024-10-07 11:33:31.209739] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:38.000 [2024-10-07 11:33:31.210245] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:38.000 [2024-10-07 11:33:31.210283] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:38.000 [2024-10-07 11:33:31.210301] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:38.000 [2024-10-07 11:33:31.210318] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:38.000 [2024-10-07 11:33:31.210333] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:38.000 [2024-10-07 11:33:31.210346] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:38.000 [2024-10-07 11:33:31.210568] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:38.000 [2024-10-07 11:33:31.210603] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:38.000 [2024-10-07 11:33:31.222245] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:38.000 [2024-10-07 11:33:31.222297] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:38.000 [2024-10-07 11:33:31.222385] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:38.000 [2024-10-07 11:33:31.222415] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:38.000 [2024-10-07 11:33:31.222431] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:38.000 [2024-10-07 11:33:31.222479] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:38.000 [2024-10-07 11:33:31.222517] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:38.000 [2024-10-07 11:33:31.222534] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:38.000 [2024-10-07 11:33:31.222558] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:38.000 [2024-10-07 11:33:31.222577] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:38.000 [2024-10-07 11:33:31.222601] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:38.000 [2024-10-07 11:33:31.222615] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:38.000 [2024-10-07 11:33:31.222629] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:38.000 [2024-10-07 11:33:31.222645] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:38.000 [2024-10-07 11:33:31.222675] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:38.000 [2024-10-07 11:33:31.222688] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:38.000 [2024-10-07 11:33:31.222712] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:38.000 [2024-10-07 11:33:31.222727] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:38.000 [2024-10-07 11:33:31.234417] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:38.000 [2024-10-07 11:33:31.234465] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:38.000 [2024-10-07 11:33:31.235729] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:38.000 [2024-10-07 11:33:31.235806] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:38.000 [2024-10-07 11:33:31.235826] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:38.000 [2024-10-07 11:33:31.235897] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:38.000 [2024-10-07 11:33:31.235922] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:38.000 [2024-10-07 11:33:31.235943] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:38.000 [2024-10-07 11:33:31.236241] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:38.000 [2024-10-07 11:33:31.236284] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:38.000 [2024-10-07 11:33:31.236340] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:38.000 [2024-10-07 11:33:31.236360] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:38.000 [2024-10-07 11:33:31.236374] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:38.000 [2024-10-07 11:33:31.236392] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:38.000 [2024-10-07 11:33:31.236406] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:38.000 [2024-10-07 11:33:31.236419] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:38.000 [2024-10-07 11:33:31.236442] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:38.000 [2024-10-07 11:33:31.236457] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:38.000 [2024-10-07 11:33:31.248238] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:38.000 [2024-10-07 11:33:31.248290] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:38.000 [2024-10-07 11:33:31.248901] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:38.000 [2024-10-07 11:33:31.248961] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:38.000 [2024-10-07 11:33:31.248981] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:38.000 [2024-10-07 11:33:31.249031] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:38.000 [2024-10-07 11:33:31.249054] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:38.000 [2024-10-07 11:33:31.249070] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:38.000 [2024-10-07 11:33:31.249151] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:38.000 [2024-10-07 11:33:31.249177] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:38.000 [2024-10-07 11:33:31.249198] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:38.000 [2024-10-07 11:33:31.249213] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:38.000 [2024-10-07 11:33:31.249226] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:38.000 [2024-10-07 11:33:31.249243] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:38.000 [2024-10-07 11:33:31.249257] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:38.000 [2024-10-07 11:33:31.249270] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:38.000 [2024-10-07 11:33:31.249293] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:38.000 [2024-10-07 11:33:31.249322] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:38.000 [2024-10-07 11:33:31.261650] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:38.000 [2024-10-07 11:33:31.261725] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:38.000 [2024-10-07 11:33:31.262026] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:38.000 [2024-10-07 11:33:31.262087] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:38.000 [2024-10-07 11:33:31.262107] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:38.000 [2024-10-07 11:33:31.262157] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:38.000 [2024-10-07 11:33:31.262181] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:38.000 [2024-10-07 11:33:31.262196] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:38.000 [2024-10-07 11:33:31.262508] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:38.000 [2024-10-07 11:33:31.262549] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:38.000 [2024-10-07 11:33:31.263265] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:38.000 [2024-10-07 11:33:31.263302] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:38.000 [2024-10-07 11:33:31.263320] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:38.000 [2024-10-07 11:33:31.263338] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:38.000 [2024-10-07 11:33:31.263352] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:38.000 [2024-10-07 11:33:31.263364] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:38.000 [2024-10-07 11:33:31.263801] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:38.000 [2024-10-07 11:33:31.263838] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:38.000 [2024-10-07 11:33:31.273726] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:38.000 [2024-10-07 11:33:31.273775] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:38.000 [2024-10-07 11:33:31.273962] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:38.000 [2024-10-07 11:33:31.273995] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:38.000 [2024-10-07 11:33:31.274012] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:38.000 [2024-10-07 11:33:31.274059] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:38.000 [2024-10-07 11:33:31.274083] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:38.000 [2024-10-07 11:33:31.274098] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:38.000 [2024-10-07 11:33:31.274203] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:38.000 [2024-10-07 11:33:31.274227] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:38.000 [2024-10-07 11:33:31.274989] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:38.000 [2024-10-07 11:33:31.275040] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:38.000 [2024-10-07 11:33:31.275059] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:38.000 [2024-10-07 11:33:31.275076] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:38.000 [2024-10-07 11:33:31.275090] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:38.000 [2024-10-07 11:33:31.275103] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:38.001 [2024-10-07 11:33:31.277838] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:38.001 [2024-10-07 11:33:31.277878] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:38.001 [2024-10-07 11:33:31.283835] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:38.001 [2024-10-07 11:33:31.283896] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:38.001 [2024-10-07 11:33:31.283976] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:38.001 [2024-10-07 11:33:31.284005] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:38.001 [2024-10-07 11:33:31.284021] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:38.001 [2024-10-07 11:33:31.284075] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:38.001 [2024-10-07 11:33:31.284099] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:38.001 [2024-10-07 11:33:31.284114] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:38.001 [2024-10-07 11:33:31.284132] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:38.001 [2024-10-07 11:33:31.284165] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:38.001 [2024-10-07 11:33:31.284183] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:38.001 [2024-10-07 11:33:31.284196] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:38.001 [2024-10-07 11:33:31.284210] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:38.001 [2024-10-07 11:33:31.284232] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:38.001 [2024-10-07 11:33:31.284247] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:38.001 [2024-10-07 11:33:31.284260] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:38.001 [2024-10-07 11:33:31.284273] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:38.001 [2024-10-07 11:33:31.284292] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:38.001 [2024-10-07 11:33:31.294701] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:38.001 [2024-10-07 11:33:31.294750] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:38.001 [2024-10-07 11:33:31.295873] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:38.001 [2024-10-07 11:33:31.295918] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:38.001 [2024-10-07 11:33:31.295938] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:38.001 [2024-10-07 11:33:31.295988] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:38.001 [2024-10-07 11:33:31.296038] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:38.001 [2024-10-07 11:33:31.296055] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:38.001 [2024-10-07 11:33:31.296480] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:38.001 [2024-10-07 11:33:31.296527] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:38.001 [2024-10-07 11:33:31.296760] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:38.001 [2024-10-07 11:33:31.296788] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:38.001 [2024-10-07 11:33:31.296803] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:38.001 [2024-10-07 11:33:31.296821] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:38.001 [2024-10-07 11:33:31.296835] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:38.001 [2024-10-07 11:33:31.296847] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:38.001 [2024-10-07 11:33:31.297069] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:38.001 [2024-10-07 11:33:31.297095] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:38.001 [2024-10-07 11:33:31.305692] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:38.001 [2024-10-07 11:33:31.305740] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:38.001 [2024-10-07 11:33:31.305946] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:38.001 [2024-10-07 11:33:31.305978] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:38.001 [2024-10-07 11:33:31.305994] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:38.001 [2024-10-07 11:33:31.306048] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:38.001 [2024-10-07 11:33:31.306072] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:38.001 [2024-10-07 11:33:31.306087] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:38.001 [2024-10-07 11:33:31.306214] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:38.001 [2024-10-07 11:33:31.306243] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:38.001 [2024-10-07 11:33:31.306353] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:38.001 [2024-10-07 11:33:31.306374] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:38.001 [2024-10-07 11:33:31.306388] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:38.001 [2024-10-07 11:33:31.306405] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:38.001 [2024-10-07 11:33:31.306419] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:38.001 [2024-10-07 11:33:31.306431] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:38.001 [2024-10-07 11:33:31.306534] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:38.001 [2024-10-07 11:33:31.306559] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:38.001 [2024-10-07 11:33:31.316705] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:38.001 [2024-10-07 11:33:31.316804] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:38.001 [2024-10-07 11:33:31.316885] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:38.001 [2024-10-07 11:33:31.316914] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:38.001 [2024-10-07 11:33:31.316930] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:38.001 [2024-10-07 11:33:31.316985] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:38.001 [2024-10-07 11:33:31.317010] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:38.001 [2024-10-07 11:33:31.317025] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:38.001 [2024-10-07 11:33:31.317043] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:38.001 [2024-10-07 11:33:31.317066] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:38.001 [2024-10-07 11:33:31.317083] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:38.001 [2024-10-07 11:33:31.317097] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:38.001 [2024-10-07 11:33:31.317110] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:38.001 [2024-10-07 11:33:31.317134] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:38.001 [2024-10-07 11:33:31.317157] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:38.001 [2024-10-07 11:33:31.317170] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:38.001 [2024-10-07 11:33:31.317183] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:38.001 [2024-10-07 11:33:31.317202] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:38.001 [2024-10-07 11:33:31.328666] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:38.001 [2024-10-07 11:33:31.328727] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:38.001 [2024-10-07 11:33:31.329052] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:38.001 [2024-10-07 11:33:31.329096] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:38.001 [2024-10-07 11:33:31.329117] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:38.001 [2024-10-07 11:33:31.329168] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:38.001 [2024-10-07 11:33:31.329191] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:38.001 [2024-10-07 11:33:31.329206] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:38.001 [2024-10-07 11:33:31.329366] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:38.001 [2024-10-07 11:33:31.329395] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:38.001 [2024-10-07 11:33:31.329435] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:38.001 [2024-10-07 11:33:31.329454] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:38.001 [2024-10-07 11:33:31.329484] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:38.001 [2024-10-07 11:33:31.329509] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:38.001 [2024-10-07 11:33:31.329524] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:38.001 [2024-10-07 11:33:31.329537] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:38.001 [2024-10-07 11:33:31.329560] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:38.001 [2024-10-07 11:33:31.329574] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:38.001 [2024-10-07 11:33:31.340605] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:38.001 [2024-10-07 11:33:31.340666] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:38.001 [2024-10-07 11:33:31.340869] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:38.001 [2024-10-07 11:33:31.340901] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:38.002 [2024-10-07 11:33:31.340918] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:38.002 [2024-10-07 11:33:31.340966] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:38.002 [2024-10-07 11:33:31.340990] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:38.002 [2024-10-07 11:33:31.341005] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:38.002 [2024-10-07 11:33:31.341149] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:38.002 [2024-10-07 11:33:31.341177] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:38.002 [2024-10-07 11:33:31.341285] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:38.002 [2024-10-07 11:33:31.341306] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:38.002 [2024-10-07 11:33:31.341319] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:38.002 [2024-10-07 11:33:31.341351] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:38.002 [2024-10-07 11:33:31.341365] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:38.002 [2024-10-07 11:33:31.341378] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:38.002 [2024-10-07 11:33:31.341617] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:38.002 [2024-10-07 11:33:31.341641] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:38.002 [2024-10-07 11:33:31.350747] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:38.002 [2024-10-07 11:33:31.350809] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:38.002 [2024-10-07 11:33:31.350904] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:38.002 [2024-10-07 11:33:31.350933] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:38.002 [2024-10-07 11:33:31.350949] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:38.002 [2024-10-07 11:33:31.351002] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:38.002 [2024-10-07 11:33:31.351025] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:38.002 [2024-10-07 11:33:31.351056] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:38.002 [2024-10-07 11:33:31.351075] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:38.002 [2024-10-07 11:33:31.351098] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:38.002 [2024-10-07 11:33:31.351115] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:38.002 [2024-10-07 11:33:31.351128] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:38.002 [2024-10-07 11:33:31.351141] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:38.002 [2024-10-07 11:33:31.351164] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:38.002 [2024-10-07 11:33:31.351190] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:38.002 [2024-10-07 11:33:31.351221] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:38.002 [2024-10-07 11:33:31.351235] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:38.002 [2024-10-07 11:33:31.351256] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:38.002 [2024-10-07 11:33:31.363839] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:38.002 [2024-10-07 11:33:31.363887] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:38.002 [2024-10-07 11:33:31.364014] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:38.002 [2024-10-07 11:33:31.364045] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:38.002 [2024-10-07 11:33:31.364061] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:38.002 [2024-10-07 11:33:31.364109] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:38.002 [2024-10-07 11:33:31.364132] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:38.002 [2024-10-07 11:33:31.364147] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:38.002 [2024-10-07 11:33:31.364171] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:38.002 [2024-10-07 11:33:31.364191] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:38.002 [2024-10-07 11:33:31.364211] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:38.002 [2024-10-07 11:33:31.364226] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:38.002 [2024-10-07 11:33:31.364239] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:38.002 [2024-10-07 11:33:31.364255] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:38.002 [2024-10-07 11:33:31.364269] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:38.002 [2024-10-07 11:33:31.364282] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:38.002 [2024-10-07 11:33:31.364481] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:38.002 [2024-10-07 11:33:31.364507] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:38.002 [2024-10-07 11:33:31.376083] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:38.002 [2024-10-07 11:33:31.376175] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:38.002 [2024-10-07 11:33:31.377628] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:38.002 [2024-10-07 11:33:31.377697] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:38.002 [2024-10-07 11:33:31.377718] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:38.002 [2024-10-07 11:33:31.377768] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:38.002 [2024-10-07 11:33:31.377792] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:38.002 [2024-10-07 11:33:31.377806] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:38.002 [2024-10-07 11:33:31.378415] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:38.002 [2024-10-07 11:33:31.378458] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:38.002 [2024-10-07 11:33:31.378742] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:38.002 [2024-10-07 11:33:31.378778] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:38.002 [2024-10-07 11:33:31.378795] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:38.002 [2024-10-07 11:33:31.378812] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:38.002 [2024-10-07 11:33:31.378826] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:38.002 [2024-10-07 11:33:31.378838] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:38.002 [2024-10-07 11:33:31.378892] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:38.002 [2024-10-07 11:33:31.378912] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:38.002 [2024-10-07 11:33:31.387089] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:38.002 [2024-10-07 11:33:31.387135] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:38.002 [2024-10-07 11:33:31.387378] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:38.002 [2024-10-07 11:33:31.387410] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:38.002 [2024-10-07 11:33:31.387426] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:38.002 [2024-10-07 11:33:31.387474] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:38.002 [2024-10-07 11:33:31.387497] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:38.002 [2024-10-07 11:33:31.387512] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:38.002 [2024-10-07 11:33:31.387639] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:38.002 [2024-10-07 11:33:31.387681] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:38.002 [2024-10-07 11:33:31.387797] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:38.002 [2024-10-07 11:33:31.387818] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:38.002 [2024-10-07 11:33:31.387832] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:38.002 [2024-10-07 11:33:31.387863] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:38.002 [2024-10-07 11:33:31.387881] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:38.003 [2024-10-07 11:33:31.387894] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:38.003 [2024-10-07 11:33:31.387996] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:38.003 [2024-10-07 11:33:31.388015] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:38.003 [2024-10-07 11:33:31.397743] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:38.003 [2024-10-07 11:33:31.397807] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:38.003 [2024-10-07 11:33:31.397919] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:38.003 [2024-10-07 11:33:31.397950] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:38.003 [2024-10-07 11:33:31.397967] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:38.003 [2024-10-07 11:33:31.398014] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:38.003 [2024-10-07 11:33:31.398038] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:38.003 [2024-10-07 11:33:31.398053] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:38.003 [2024-10-07 11:33:31.398077] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:38.003 [2024-10-07 11:33:31.398097] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:38.003 [2024-10-07 11:33:31.398116] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:38.003 [2024-10-07 11:33:31.398130] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:38.003 [2024-10-07 11:33:31.398144] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:38.003 [2024-10-07 11:33:31.398159] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:38.003 [2024-10-07 11:33:31.398174] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:38.003 [2024-10-07 11:33:31.398186] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:38.003 [2024-10-07 11:33:31.398209] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:38.003 [2024-10-07 11:33:31.398223] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:38.003 [2024-10-07 11:33:31.408353] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:38.003 [2024-10-07 11:33:31.408401] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:38.003 [2024-10-07 11:33:31.408566] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:38.003 [2024-10-07 11:33:31.408605] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:38.003 [2024-10-07 11:33:31.408622] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:38.003 [2024-10-07 11:33:31.408686] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:38.003 [2024-10-07 11:33:31.408712] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:38.003 [2024-10-07 11:33:31.408727] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:38.003 [2024-10-07 11:33:31.410235] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:38.003 [2024-10-07 11:33:31.410280] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:38.003 [2024-10-07 11:33:31.410350] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:38.003 [2024-10-07 11:33:31.410375] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:38.003 [2024-10-07 11:33:31.410389] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:38.003 [2024-10-07 11:33:31.410406] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:38.003 [2024-10-07 11:33:31.410421] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:38.003 [2024-10-07 11:33:31.410434] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:38.003 [2024-10-07 11:33:31.410457] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:38.003 [2024-10-07 11:33:31.410471] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:38.003 [2024-10-07 11:33:31.418462] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:38.003 [2024-10-07 11:33:31.418525] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:38.003 [2024-10-07 11:33:31.418603] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:38.003 [2024-10-07 11:33:31.418632] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:38.003 [2024-10-07 11:33:31.418661] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:38.003 [2024-10-07 11:33:31.418730] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:38.003 [2024-10-07 11:33:31.418755] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:38.003 [2024-10-07 11:33:31.418786] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:38.003 [2024-10-07 11:33:31.418804] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:38.003 [2024-10-07 11:33:31.418828] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:38.003 [2024-10-07 11:33:31.418845] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:38.003 [2024-10-07 11:33:31.418859] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:38.003 [2024-10-07 11:33:31.418872] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:38.003 [2024-10-07 11:33:31.418896] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:38.003 [2024-10-07 11:33:31.418910] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:38.003 [2024-10-07 11:33:31.418923] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:38.003 [2024-10-07 11:33:31.418936] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:38.003 [2024-10-07 11:33:31.418959] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:38.003 [2024-10-07 11:33:31.431502] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:38.003 [2024-10-07 11:33:31.431551] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:38.003 [2024-10-07 11:33:31.431669] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:38.003 [2024-10-07 11:33:31.431701] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:38.003 [2024-10-07 11:33:31.431718] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:38.003 [2024-10-07 11:33:31.431768] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:38.003 [2024-10-07 11:33:31.431791] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:38.003 [2024-10-07 11:33:31.431806] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:38.003 [2024-10-07 11:33:31.432374] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:38.003 [2024-10-07 11:33:31.432417] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:38.003 [2024-10-07 11:33:31.432532] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:38.003 [2024-10-07 11:33:31.432557] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:38.003 [2024-10-07 11:33:31.432580] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:38.003 [2024-10-07 11:33:31.432597] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:38.003 [2024-10-07 11:33:31.432611] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:38.003 [2024-10-07 11:33:31.432624] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:38.003 [2024-10-07 11:33:31.432660] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:38.003 [2024-10-07 11:33:31.432678] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:38.003 [2024-10-07 11:33:31.442051] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:38.003 [2024-10-07 11:33:31.442099] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:38.003 [2024-10-07 11:33:31.442264] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:38.003 [2024-10-07 11:33:31.442294] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:38.003 [2024-10-07 11:33:31.442311] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:38.003 [2024-10-07 11:33:31.442358] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:38.003 [2024-10-07 11:33:31.442381] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:38.003 [2024-10-07 11:33:31.442406] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:38.003 [2024-10-07 11:33:31.442519] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:38.003 [2024-10-07 11:33:31.442543] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:38.003 [2024-10-07 11:33:31.442641] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:38.003 [2024-10-07 11:33:31.442677] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:38.003 [2024-10-07 11:33:31.442692] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:38.003 [2024-10-07 11:33:31.442708] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:38.003 [2024-10-07 11:33:31.442738] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:38.003 [2024-10-07 11:33:31.442752] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:38.003 [2024-10-07 11:33:31.443073] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:38.003 [2024-10-07 11:33:31.443099] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:38.003 [2024-10-07 11:33:31.453086] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:38.003 [2024-10-07 11:33:31.453135] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:38.003 [2024-10-07 11:33:31.453342] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:38.004 [2024-10-07 11:33:31.453384] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:38.004 [2024-10-07 11:33:31.453401] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:38.004 [2024-10-07 11:33:31.453461] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:38.004 [2024-10-07 11:33:31.453484] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:38.004 [2024-10-07 11:33:31.453499] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:38.004 [2024-10-07 11:33:31.453614] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:38.004 [2024-10-07 11:33:31.453640] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:38.004 [2024-10-07 11:33:31.453767] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:38.004 [2024-10-07 11:33:31.453788] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:38.004 [2024-10-07 11:33:31.453802] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:38.004 [2024-10-07 11:33:31.453819] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:38.004 [2024-10-07 11:33:31.453833] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:38.004 [2024-10-07 11:33:31.453846] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:38.004 [2024-10-07 11:33:31.453950] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:38.004 [2024-10-07 11:33:31.453969] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:38.004 [2024-10-07 11:33:31.464492] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:38.004 [2024-10-07 11:33:31.464541] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:38.004 [2024-10-07 11:33:31.464831] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:38.004 [2024-10-07 11:33:31.464877] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:38.004 [2024-10-07 11:33:31.464897] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:38.004 [2024-10-07 11:33:31.464948] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:38.004 [2024-10-07 11:33:31.464971] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:38.004 [2024-10-07 11:33:31.464987] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:38.004 [2024-10-07 11:33:31.465061] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:38.004 [2024-10-07 11:33:31.465088] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:38.004 [2024-10-07 11:33:31.465260] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:38.004 [2024-10-07 11:33:31.465285] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:38.004 [2024-10-07 11:33:31.465300] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:38.004 [2024-10-07 11:33:31.465317] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:38.004 [2024-10-07 11:33:31.465333] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:38.004 [2024-10-07 11:33:31.465345] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:38.004 [2024-10-07 11:33:31.465401] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:38.004 [2024-10-07 11:33:31.465422] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:38.004 [2024-10-07 11:33:31.474618] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:38.004 [2024-10-07 11:33:31.474708] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:38.004 [2024-10-07 11:33:31.474795] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:38.004 [2024-10-07 11:33:31.474825] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:38.004 [2024-10-07 11:33:31.474842] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:38.004 [2024-10-07 11:33:31.474896] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:38.004 [2024-10-07 11:33:31.474920] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:38.004 [2024-10-07 11:33:31.474936] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:38.004 [2024-10-07 11:33:31.474953] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:38.004 [2024-10-07 11:33:31.474976] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:38.004 [2024-10-07 11:33:31.474993] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:38.004 [2024-10-07 11:33:31.475013] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:38.004 [2024-10-07 11:33:31.475027] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:38.004 [2024-10-07 11:33:31.475050] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:38.004 [2024-10-07 11:33:31.475064] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:38.004 [2024-10-07 11:33:31.475077] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:38.004 [2024-10-07 11:33:31.475090] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:38.004 [2024-10-07 11:33:31.475111] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:38.004 [2024-10-07 11:33:31.484897] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:38.004 [2024-10-07 11:33:31.484945] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:38.004 [2024-10-07 11:33:31.485040] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:38.004 [2024-10-07 11:33:31.485086] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:38.004 [2024-10-07 11:33:31.485104] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:38.004 [2024-10-07 11:33:31.485165] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:38.004 [2024-10-07 11:33:31.485189] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:38.004 [2024-10-07 11:33:31.485204] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:38.004 [2024-10-07 11:33:31.485382] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:38.004 [2024-10-07 11:33:31.485413] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:38.004 [2024-10-07 11:33:31.485469] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:38.004 [2024-10-07 11:33:31.485490] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:38.004 [2024-10-07 11:33:31.485504] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:38.004 [2024-10-07 11:33:31.485526] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:38.004 [2024-10-07 11:33:31.485541] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:38.004 [2024-10-07 11:33:31.485553] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:38.004 [2024-10-07 11:33:31.485576] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:38.004 [2024-10-07 11:33:31.485591] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:38.004 [2024-10-07 11:33:31.495448] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:38.004 [2024-10-07 11:33:31.495497] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:38.004 [2024-10-07 11:33:31.495694] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:38.004 [2024-10-07 11:33:31.495726] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:38.004 [2024-10-07 11:33:31.495743] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:38.004 [2024-10-07 11:33:31.495792] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:38.004 [2024-10-07 11:33:31.495815] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:38.004 [2024-10-07 11:33:31.495830] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:38.004 [2024-10-07 11:33:31.495936] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:38.004 [2024-10-07 11:33:31.495961] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:38.004 [2024-10-07 11:33:31.496083] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:38.004 [2024-10-07 11:33:31.496105] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:38.004 [2024-10-07 11:33:31.496119] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:38.004 [2024-10-07 11:33:31.496136] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:38.004 [2024-10-07 11:33:31.496151] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:38.004 [2024-10-07 11:33:31.496178] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:38.004 [2024-10-07 11:33:31.496899] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:38.004 [2024-10-07 11:33:31.496935] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:38.004 [2024-10-07 11:33:31.505743] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:38.004 [2024-10-07 11:33:31.506091] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:38.004 [2024-10-07 11:33:31.506189] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:38.004 [2024-10-07 11:33:31.506218] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:38.004 [2024-10-07 11:33:31.506235] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:38.004 [2024-10-07 11:33:31.506320] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:38.004 [2024-10-07 11:33:31.506347] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:38.004 [2024-10-07 11:33:31.506363] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:38.004 [2024-10-07 11:33:31.506381] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:38.004 [2024-10-07 11:33:31.506406] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:38.005 [2024-10-07 11:33:31.506423] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:38.005 [2024-10-07 11:33:31.506437] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:38.005 [2024-10-07 11:33:31.506451] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:38.005 [2024-10-07 11:33:31.506474] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:38.005 [2024-10-07 11:33:31.506489] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:38.005 [2024-10-07 11:33:31.506501] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:38.005 [2024-10-07 11:33:31.506514] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:38.005 [2024-10-07 11:33:31.506535] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:38.005 [2024-10-07 11:33:31.515923] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:38.005 [2024-10-07 11:33:31.516029] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:38.005 [2024-10-07 11:33:31.516059] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:38.005 [2024-10-07 11:33:31.516076] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:38.005 [2024-10-07 11:33:31.516100] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:38.005 [2024-10-07 11:33:31.516122] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:38.005 [2024-10-07 11:33:31.516136] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:38.005 [2024-10-07 11:33:31.516149] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:38.005 [2024-10-07 11:33:31.516172] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:38.005 [2024-10-07 11:33:31.516232] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:38.005 [2024-10-07 11:33:31.516306] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:38.005 [2024-10-07 11:33:31.516333] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:38.005 [2024-10-07 11:33:31.516349] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:38.005 [2024-10-07 11:33:31.516372] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:38.005 [2024-10-07 11:33:31.516394] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:38.005 [2024-10-07 11:33:31.516408] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:38.005 [2024-10-07 11:33:31.516421] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:38.005 [2024-10-07 11:33:31.516459] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:38.005 [2024-10-07 11:33:31.526359] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:38.005 [2024-10-07 11:33:31.526594] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:38.005 [2024-10-07 11:33:31.526629] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:38.005 [2024-10-07 11:33:31.526663] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:38.005 [2024-10-07 11:33:31.526775] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:38.005 [2024-10-07 11:33:31.526810] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:38.005 [2024-10-07 11:33:31.527229] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:38.005 [2024-10-07 11:33:31.527270] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:38.005 [2024-10-07 11:33:31.527289] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:38.005 [2024-10-07 11:33:31.527304] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:38.005 [2024-10-07 11:33:31.527317] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:38.005 [2024-10-07 11:33:31.527330] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:38.005 [2024-10-07 11:33:31.527398] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:38.005 [2024-10-07 11:33:31.527422] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:38.005 [2024-10-07 11:33:31.527447] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:38.005 [2024-10-07 11:33:31.527462] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:38.005 [2024-10-07 11:33:31.527475] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:38.005 [2024-10-07 11:33:31.527497] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:38.005 [2024-10-07 11:33:31.536761] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:38.005 [2024-10-07 11:33:31.537008] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:38.005 [2024-10-07 11:33:31.537052] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:38.005 [2024-10-07 11:33:31.537073] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:38.005 [2024-10-07 11:33:31.537423] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:38.005 [2024-10-07 11:33:31.539025] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:38.005 [2024-10-07 11:33:31.539078] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:38.005 [2024-10-07 11:33:31.539097] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:38.005 [2024-10-07 11:33:31.539111] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:38.005 [2024-10-07 11:33:31.539737] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:38.005 [2024-10-07 11:33:31.539820] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:38.005 [2024-10-07 11:33:31.539848] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:38.005 [2024-10-07 11:33:31.539864] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:38.005 [2024-10-07 11:33:31.540133] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:38.005 [2024-10-07 11:33:31.540209] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:38.005 [2024-10-07 11:33:31.540231] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:38.005 [2024-10-07 11:33:31.540245] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:38.005 [2024-10-07 11:33:31.540270] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:38.005 [2024-10-07 11:33:31.547777] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:38.005 [2024-10-07 11:33:31.548017] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:38.005 [2024-10-07 11:33:31.548051] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:38.005 [2024-10-07 11:33:31.548069] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:38.005 [2024-10-07 11:33:31.548185] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:38.005 [2024-10-07 11:33:31.548300] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:38.005 [2024-10-07 11:33:31.548320] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:38.005 [2024-10-07 11:33:31.548334] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:38.005 [2024-10-07 11:33:31.548442] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:38.005 [2024-10-07 11:33:31.552021] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:38.005 [2024-10-07 11:33:31.552203] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:38.005 [2024-10-07 11:33:31.552234] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:38.005 [2024-10-07 11:33:31.552251] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:38.005 [2024-10-07 11:33:31.552378] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:38.005 [2024-10-07 11:33:31.552497] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:38.005 [2024-10-07 11:33:31.552520] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:38.005 [2024-10-07 11:33:31.552549] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:38.005 [2024-10-07 11:33:31.552670] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:38.005 [2024-10-07 11:33:31.558215] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:38.005 [2024-10-07 11:33:31.558374] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:38.005 [2024-10-07 11:33:31.558405] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:38.005 [2024-10-07 11:33:31.558422] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:38.005 [2024-10-07 11:33:31.558446] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:38.005 [2024-10-07 11:33:31.558468] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:38.005 [2024-10-07 11:33:31.558482] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:38.005 [2024-10-07 11:33:31.558496] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:38.005 [2024-10-07 11:33:31.558519] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:38.005 [2024-10-07 11:33:31.563309] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:38.005 [2024-10-07 11:33:31.563434] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:38.005 [2024-10-07 11:33:31.563465] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:38.005 [2024-10-07 11:33:31.563482] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:38.005 [2024-10-07 11:33:31.563506] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:38.005 [2024-10-07 11:33:31.563539] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:38.005 [2024-10-07 11:33:31.563553] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:38.005 [2024-10-07 11:33:31.563566] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:38.005 [2024-10-07 11:33:31.563590] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:38.006 [2024-10-07 11:33:31.568298] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:38.006 [2024-10-07 11:33:31.568403] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:38.006 [2024-10-07 11:33:31.568433] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:38.006 [2024-10-07 11:33:31.568450] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:38.006 [2024-10-07 11:33:31.568474] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:38.006 [2024-10-07 11:33:31.568497] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:38.006 [2024-10-07 11:33:31.568512] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:38.006 [2024-10-07 11:33:31.568532] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:38.006 [2024-10-07 11:33:31.568564] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:38.006 [2024-10-07 11:33:31.573981] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:38.006 [2024-10-07 11:33:31.574137] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:38.006 [2024-10-07 11:33:31.574168] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:38.006 [2024-10-07 11:33:31.574185] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:38.006 [2024-10-07 11:33:31.574209] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:38.006 [2024-10-07 11:33:31.574231] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:38.006 [2024-10-07 11:33:31.574246] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:38.006 [2024-10-07 11:33:31.574259] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:38.006 [2024-10-07 11:33:31.574282] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:38.006 [2024-10-07 11:33:31.578717] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:38.006 [2024-10-07 11:33:31.578857] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:38.006 [2024-10-07 11:33:31.578889] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:38.006 [2024-10-07 11:33:31.578906] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:38.006 [2024-10-07 11:33:31.578929] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:38.006 [2024-10-07 11:33:31.578952] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:38.006 [2024-10-07 11:33:31.578966] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:38.006 [2024-10-07 11:33:31.578979] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:38.006 [2024-10-07 11:33:31.579002] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:38.006 [2024-10-07 11:33:31.584456] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:38.006 [2024-10-07 11:33:31.584660] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:38.006 [2024-10-07 11:33:31.584692] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:38.006 [2024-10-07 11:33:31.584709] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:38.006 [2024-10-07 11:33:31.585620] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:38.006 [2024-10-07 11:33:31.586009] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:38.006 [2024-10-07 11:33:31.586047] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:38.006 [2024-10-07 11:33:31.586065] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:38.006 [2024-10-07 11:33:31.588393] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:38.006 [2024-10-07 11:33:31.588987] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:38.006 [2024-10-07 11:33:31.589227] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:38.006 [2024-10-07 11:33:31.589275] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:38.006 [2024-10-07 11:33:31.589296] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:38.006 [2024-10-07 11:33:31.589365] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:38.006 [2024-10-07 11:33:31.589396] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:38.006 [2024-10-07 11:33:31.589411] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:38.006 [2024-10-07 11:33:31.589424] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:38.006 [2024-10-07 11:33:31.589448] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:38.006 [2024-10-07 11:33:31.597700] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:38.006 [2024-10-07 11:33:31.597967] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:38.006 [2024-10-07 11:33:31.598012] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:38.006 [2024-10-07 11:33:31.598032] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:38.006 [2024-10-07 11:33:31.598212] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:38.006 [2024-10-07 11:33:31.598332] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:38.006 [2024-10-07 11:33:31.598363] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:38.006 [2024-10-07 11:33:31.598380] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:38.006 [2024-10-07 11:33:31.598484] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:38.006 [2024-10-07 11:33:31.601212] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:38.006 [2024-10-07 11:33:31.601446] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:38.006 [2024-10-07 11:33:31.601482] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:38.006 [2024-10-07 11:33:31.601501] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:38.006 [2024-10-07 11:33:31.601594] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:38.006 [2024-10-07 11:33:31.601621] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:38.006 [2024-10-07 11:33:31.601635] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:38.006 [2024-10-07 11:33:31.601662] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:38.006 [2024-10-07 11:33:31.601689] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:38.006 [2024-10-07 11:33:31.609855] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:38.006 [2024-10-07 11:33:31.610316] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:38.006 [2024-10-07 11:33:31.610359] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:38.006 [2024-10-07 11:33:31.610379] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:38.006 [2024-10-07 11:33:31.610472] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:38.006 [2024-10-07 11:33:31.610781] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:38.006 [2024-10-07 11:33:31.610816] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:38.006 [2024-10-07 11:33:31.610849] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:38.006 [2024-10-07 11:33:31.611037] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:38.006 [2024-10-07 11:33:31.611363] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:38.006 [2024-10-07 11:33:31.612579] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:38.006 [2024-10-07 11:33:31.612635] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:38.006 [2024-10-07 11:33:31.612655] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:38.006 [2024-10-07 11:33:31.614880] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:38.006 [2024-10-07 11:33:31.615353] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:38.006 [2024-10-07 11:33:31.615391] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:38.006 [2024-10-07 11:33:31.615408] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:38.006 [2024-10-07 11:33:31.615582] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:38.006 [2024-10-07 11:33:31.619948] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:38.006 [2024-10-07 11:33:31.620065] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:38.006 [2024-10-07 11:33:31.620094] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:38.006 [2024-10-07 11:33:31.620111] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:38.006 [2024-10-07 11:33:31.620134] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:38.006 [2024-10-07 11:33:31.620156] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:38.006 [2024-10-07 11:33:31.620171] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:38.006 [2024-10-07 11:33:31.620184] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:38.006 [2024-10-07 11:33:31.620207] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:38.006 [2024-10-07 11:33:31.621670] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:38.006 [2024-10-07 11:33:31.621902] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:38.006 [2024-10-07 11:33:31.621932] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:38.006 [2024-10-07 11:33:31.621948] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:38.006 [2024-10-07 11:33:31.622128] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:38.006 [2024-10-07 11:33:31.622284] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:38.007 [2024-10-07 11:33:31.622333] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:38.007 [2024-10-07 11:33:31.622350] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:38.007 [2024-10-07 11:33:31.622453] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:38.007 [2024-10-07 11:33:31.630037] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:38.007 [2024-10-07 11:33:31.630155] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:38.007 [2024-10-07 11:33:31.630201] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:38.007 [2024-10-07 11:33:31.630218] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:38.007 [2024-10-07 11:33:31.630241] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:38.007 [2024-10-07 11:33:31.630263] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:38.007 [2024-10-07 11:33:31.630277] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:38.007 [2024-10-07 11:33:31.630290] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:38.007 [2024-10-07 11:33:31.630313] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:38.007 [2024-10-07 11:33:31.631794] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:38.007 [2024-10-07 11:33:31.631894] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:38.007 [2024-10-07 11:33:31.631923] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:38.007 [2024-10-07 11:33:31.631940] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:38.007 [2024-10-07 11:33:31.631963] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:38.007 [2024-10-07 11:33:31.631984] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:38.007 [2024-10-07 11:33:31.631998] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:38.007 [2024-10-07 11:33:31.632012] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:38.007 [2024-10-07 11:33:31.632037] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:38.007 [2024-10-07 11:33:31.641961] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:38.007 [2024-10-07 11:33:31.642196] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:38.007 [2024-10-07 11:33:31.642231] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:38.007 [2024-10-07 11:33:31.642248] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:38.007 [2024-10-07 11:33:31.642364] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:38.007 [2024-10-07 11:33:31.642401] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:38.007 [2024-10-07 11:33:31.642543] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:38.007 [2024-10-07 11:33:31.642572] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:38.007 [2024-10-07 11:33:31.642588] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:38.007 [2024-10-07 11:33:31.642602] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:38.007 [2024-10-07 11:33:31.642615] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:38.007 [2024-10-07 11:33:31.642628] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:38.007 [2024-10-07 11:33:31.643001] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:38.007 [2024-10-07 11:33:31.643042] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:38.007 [2024-10-07 11:33:31.645242] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:38.007 [2024-10-07 11:33:31.645281] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:38.007 [2024-10-07 11:33:31.645315] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:38.007 [2024-10-07 11:33:31.646100] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:38.007 [2024-10-07 11:33:31.653182] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:38.007 [2024-10-07 11:33:31.653393] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:38.007 [2024-10-07 11:33:31.653474] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:38.007 [2024-10-07 11:33:31.653503] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:38.007 [2024-10-07 11:33:31.653520] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:38.007 [2024-10-07 11:33:31.653713] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:38.007 [2024-10-07 11:33:31.653741] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:38.007 [2024-10-07 11:33:31.653758] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:38.007 [2024-10-07 11:33:31.653775] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:38.007 [2024-10-07 11:33:31.653887] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:38.007 [2024-10-07 11:33:31.653910] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:38.007 [2024-10-07 11:33:31.653924] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:38.007 [2024-10-07 11:33:31.653937] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:38.007 [2024-10-07 11:33:31.654063] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:38.007 [2024-10-07 11:33:31.654083] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:38.007 [2024-10-07 11:33:31.654096] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:38.007 [2024-10-07 11:33:31.654110] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:38.007 [2024-10-07 11:33:31.654207] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:38.007 [2024-10-07 11:33:31.664132] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:38.007 [2024-10-07 11:33:31.664194] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:38.007 [2024-10-07 11:33:31.664294] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:38.007 [2024-10-07 11:33:31.664323] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:38.007 [2024-10-07 11:33:31.664340] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:38.007 [2024-10-07 11:33:31.664386] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:38.007 [2024-10-07 11:33:31.664409] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:38.007 [2024-10-07 11:33:31.664423] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:38.007 [2024-10-07 11:33:31.664463] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:38.007 [2024-10-07 11:33:31.664485] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:38.007 [2024-10-07 11:33:31.664504] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:38.007 [2024-10-07 11:33:31.664519] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:38.007 [2024-10-07 11:33:31.664532] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:38.007 [2024-10-07 11:33:31.664548] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:38.007 [2024-10-07 11:33:31.664563] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:38.007 [2024-10-07 11:33:31.664575] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:38.007 [2024-10-07 11:33:31.664598] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:38.007 [2024-10-07 11:33:31.664612] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:38.007 [2024-10-07 11:33:31.675525] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:38.007 [2024-10-07 11:33:31.675574] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:38.007 [2024-10-07 11:33:31.675716] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:38.007 [2024-10-07 11:33:31.675747] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:38.007 [2024-10-07 11:33:31.675765] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:38.007 [2024-10-07 11:33:31.675811] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:38.007 [2024-10-07 11:33:31.675834] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:38.007 [2024-10-07 11:33:31.675850] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:38.007 [2024-10-07 11:33:31.675873] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:38.007 [2024-10-07 11:33:31.675893] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:38.007 [2024-10-07 11:33:31.675913] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:38.008 [2024-10-07 11:33:31.675927] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:38.008 [2024-10-07 11:33:31.675941] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:38.008 [2024-10-07 11:33:31.675956] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:38.008 [2024-10-07 11:33:31.675971] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:38.008 [2024-10-07 11:33:31.675984] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:38.008 [2024-10-07 11:33:31.676006] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:38.008 [2024-10-07 11:33:31.676021] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:38.008 [2024-10-07 11:33:31.687197] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:38.008 [2024-10-07 11:33:31.687246] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:38.008 [2024-10-07 11:33:31.687524] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:38.008 [2024-10-07 11:33:31.687573] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:38.008 [2024-10-07 11:33:31.687592] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:38.008 [2024-10-07 11:33:31.687642] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:38.008 [2024-10-07 11:33:31.687681] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:38.008 [2024-10-07 11:33:31.687697] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:38.008 [2024-10-07 11:33:31.687831] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:38.008 [2024-10-07 11:33:31.687860] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:38.008 [2024-10-07 11:33:31.689735] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:38.008 [2024-10-07 11:33:31.689774] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:38.008 [2024-10-07 11:33:31.689792] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:38.008 [2024-10-07 11:33:31.689809] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:38.008 [2024-10-07 11:33:31.689824] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:38.008 [2024-10-07 11:33:31.689837] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:38.008 [2024-10-07 11:33:31.690581] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:38.008 [2024-10-07 11:33:31.690616] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:38.008 [2024-10-07 11:33:31.697939] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:38.008 [2024-10-07 11:33:31.697982] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:38.008 [2024-10-07 11:33:31.698079] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:38.008 [2024-10-07 11:33:31.698107] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:38.008 [2024-10-07 11:33:31.698122] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:38.008 [2024-10-07 11:33:31.698166] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:38.008 [2024-10-07 11:33:31.698188] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:38.008 [2024-10-07 11:33:31.698203] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:38.008 [2024-10-07 11:33:31.698224] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:38.008 [2024-10-07 11:33:31.698242] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:38.008 [2024-10-07 11:33:31.698261] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:38.008 [2024-10-07 11:33:31.698275] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:38.008 [2024-10-07 11:33:31.698287] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:38.008 [2024-10-07 11:33:31.698302] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:38.008 [2024-10-07 11:33:31.698315] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:38.008 [2024-10-07 11:33:31.698349] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:38.008 [2024-10-07 11:33:31.701249] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:38.008 [2024-10-07 11:33:31.701289] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:38.008 [2024-10-07 11:33:31.708055] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:38.008 [2024-10-07 11:33:31.708128] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:38.008 [2024-10-07 11:33:31.708212] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:38.008 [2024-10-07 11:33:31.708240] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:38.008 [2024-10-07 11:33:31.708256] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:38.008 [2024-10-07 11:33:31.708307] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:38.008 [2024-10-07 11:33:31.708330] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:38.008 [2024-10-07 11:33:31.708344] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:38.008 [2024-10-07 11:33:31.708361] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:38.008 [2024-10-07 11:33:31.708383] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:38.008 [2024-10-07 11:33:31.708399] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:38.008 [2024-10-07 11:33:31.708412] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:38.008 [2024-10-07 11:33:31.708425] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:38.008 [2024-10-07 11:33:31.708447] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:38.008 [2024-10-07 11:33:31.708460] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:38.008 [2024-10-07 11:33:31.708472] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:38.008 [2024-10-07 11:33:31.708485] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:38.008 [2024-10-07 11:33:31.708504] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:38.008 [2024-10-07 11:33:31.718253] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:38.008 [2024-10-07 11:33:31.718300] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:38.008 [2024-10-07 11:33:31.718399] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:38.008 [2024-10-07 11:33:31.718428] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:38.008 [2024-10-07 11:33:31.718445] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:38.008 [2024-10-07 11:33:31.718491] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:38.008 [2024-10-07 11:33:31.718513] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:38.008 [2024-10-07 11:33:31.718528] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:38.008 [2024-10-07 11:33:31.718551] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:38.008 [2024-10-07 11:33:31.718587] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:38.008 [2024-10-07 11:33:31.718609] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:38.008 [2024-10-07 11:33:31.718624] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:38.008 [2024-10-07 11:33:31.718637] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:38.008 [2024-10-07 11:33:31.718653] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:38.008 [2024-10-07 11:33:31.718699] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:38.008 [2024-10-07 11:33:31.718713] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:38.008 [2024-10-07 11:33:31.718736] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:38.008 [2024-10-07 11:33:31.718750] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:38.008 [2024-10-07 11:33:31.731785] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:38.008 [2024-10-07 11:33:31.731864] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:38.008 [2024-10-07 11:33:31.732041] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:38.008 [2024-10-07 11:33:31.732072] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:38.008 [2024-10-07 11:33:31.732088] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:38.008 [2024-10-07 11:33:31.732151] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:38.008 [2024-10-07 11:33:31.732174] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:38.008 [2024-10-07 11:33:31.732188] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:38.008 [2024-10-07 11:33:31.732211] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:38.008 [2024-10-07 11:33:31.732231] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:38.008 [2024-10-07 11:33:31.732251] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:38.008 [2024-10-07 11:33:31.732266] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:38.008 [2024-10-07 11:33:31.732279] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:38.008 [2024-10-07 11:33:31.732295] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:38.008 [2024-10-07 11:33:31.732310] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:38.008 [2024-10-07 11:33:31.732322] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:38.008 [2024-10-07 11:33:31.732345] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:38.008 [2024-10-07 11:33:31.732360] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:38.009 [2024-10-07 11:33:31.743727] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:38.009 [2024-10-07 11:33:31.743773] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:38.009 [2024-10-07 11:33:31.743988] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:38.009 [2024-10-07 11:33:31.744020] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:38.009 [2024-10-07 11:33:31.744053] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:38.009 [2024-10-07 11:33:31.744106] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:38.009 [2024-10-07 11:33:31.744130] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:38.009 [2024-10-07 11:33:31.744145] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:38.009 [2024-10-07 11:33:31.744273] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:38.009 [2024-10-07 11:33:31.744318] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:38.009 [2024-10-07 11:33:31.744439] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:38.009 [2024-10-07 11:33:31.744462] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:38.009 [2024-10-07 11:33:31.744476] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:38.009 [2024-10-07 11:33:31.744493] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:38.009 [2024-10-07 11:33:31.744508] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:38.009 [2024-10-07 11:33:31.744520] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:38.009 [2024-10-07 11:33:31.744633] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:38.009 [2024-10-07 11:33:31.744676] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:38.009 [2024-10-07 11:33:31.754078] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:38.009 [2024-10-07 11:33:31.754126] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:38.009 [2024-10-07 11:33:31.754227] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:38.009 [2024-10-07 11:33:31.754256] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:38.009 [2024-10-07 11:33:31.754272] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:38.009 [2024-10-07 11:33:31.754319] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:38.009 [2024-10-07 11:33:31.754342] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:38.009 [2024-10-07 11:33:31.754356] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:38.009 [2024-10-07 11:33:31.754380] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:38.009 [2024-10-07 11:33:31.754400] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:38.009 [2024-10-07 11:33:31.754419] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:38.009 [2024-10-07 11:33:31.754433] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:38.009 [2024-10-07 11:33:31.754447] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:38.009 [2024-10-07 11:33:31.754463] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:38.009 [2024-10-07 11:33:31.754477] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:38.009 [2024-10-07 11:33:31.754489] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:38.009 [2024-10-07 11:33:31.754772] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:38.009 [2024-10-07 11:33:31.754800] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:38.009 [2024-10-07 11:33:31.764206] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:38.009 [2024-10-07 11:33:31.764269] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:38.009 [2024-10-07 11:33:31.764344] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:38.009 [2024-10-07 11:33:31.764373] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:38.009 [2024-10-07 11:33:31.764390] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:38.009 [2024-10-07 11:33:31.764444] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:38.009 [2024-10-07 11:33:31.764468] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:38.009 [2024-10-07 11:33:31.764483] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:38.009 [2024-10-07 11:33:31.764501] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:38.009 [2024-10-07 11:33:31.764524] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:38.009 [2024-10-07 11:33:31.764541] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:38.009 [2024-10-07 11:33:31.764554] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:38.009 [2024-10-07 11:33:31.764567] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:38.009 [2024-10-07 11:33:31.764590] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:38.009 [2024-10-07 11:33:31.764605] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:38.009 [2024-10-07 11:33:31.764618] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:38.009 [2024-10-07 11:33:31.764630] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:38.009 [2024-10-07 11:33:31.764665] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:38.009 [2024-10-07 11:33:31.776563] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:38.009 [2024-10-07 11:33:31.776612] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:38.009 [2024-10-07 11:33:31.776921] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:38.009 [2024-10-07 11:33:31.776965] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:38.009 [2024-10-07 11:33:31.776986] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:38.009 [2024-10-07 11:33:31.777037] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:38.009 [2024-10-07 11:33:31.777060] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:38.009 [2024-10-07 11:33:31.777075] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:38.009 [2024-10-07 11:33:31.777129] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:38.009 [2024-10-07 11:33:31.777155] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:38.009 [2024-10-07 11:33:31.777199] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:38.009 [2024-10-07 11:33:31.777215] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:38.009 [2024-10-07 11:33:31.777228] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:38.009 [2024-10-07 11:33:31.777245] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:38.009 [2024-10-07 11:33:31.777260] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:38.009 [2024-10-07 11:33:31.777273] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:38.009 [2024-10-07 11:33:31.777523] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:38.009 [2024-10-07 11:33:31.777547] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:38.009 [2024-10-07 11:33:31.791153] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:38.009 [2024-10-07 11:33:31.791213] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:38.009 [2024-10-07 11:33:31.791304] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:38.009 [2024-10-07 11:33:31.791333] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:38.009 [2024-10-07 11:33:31.791349] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:38.009 [2024-10-07 11:33:31.791396] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:38.009 [2024-10-07 11:33:31.791420] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:38.009 [2024-10-07 11:33:31.791435] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:38.009 [2024-10-07 11:33:31.791458] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:38.009 [2024-10-07 11:33:31.791478] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:38.009 [2024-10-07 11:33:31.791498] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:38.009 [2024-10-07 11:33:31.791513] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:38.009 [2024-10-07 11:33:31.791526] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:38.009 [2024-10-07 11:33:31.791542] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:38.009 [2024-10-07 11:33:31.791556] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:38.009 [2024-10-07 11:33:31.791568] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:38.009 [2024-10-07 11:33:31.791591] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:38.009 [2024-10-07 11:33:31.791605] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:38.009 [2024-10-07 11:33:31.805324] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:38.009 [2024-10-07 11:33:31.805375] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:38.009 [2024-10-07 11:33:31.806580] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:38.009 [2024-10-07 11:33:31.806625] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:38.009 [2024-10-07 11:33:31.806660] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:38.009 [2024-10-07 11:33:31.806735] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:38.009 [2024-10-07 11:33:31.806760] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:38.010 [2024-10-07 11:33:31.806776] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:38.010 [2024-10-07 11:33:31.807389] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:38.010 [2024-10-07 11:33:31.807433] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:38.010 [2024-10-07 11:33:31.807684] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:38.010 [2024-10-07 11:33:31.807720] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:38.010 [2024-10-07 11:33:31.807737] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:38.010 [2024-10-07 11:33:31.807756] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:38.010 [2024-10-07 11:33:31.807770] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:38.010 [2024-10-07 11:33:31.807783] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:38.010 [2024-10-07 11:33:31.807837] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:38.010 [2024-10-07 11:33:31.807857] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:38.010 [2024-10-07 11:33:31.815670] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:38.010 [2024-10-07 11:33:31.815732] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:38.010 [2024-10-07 11:33:31.815891] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:38.010 [2024-10-07 11:33:31.815921] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:38.010 [2024-10-07 11:33:31.815937] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:38.010 [2024-10-07 11:33:31.815983] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:38.010 [2024-10-07 11:33:31.816006] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:38.010 [2024-10-07 11:33:31.816021] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:38.010 [2024-10-07 11:33:31.816129] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:38.010 [2024-10-07 11:33:31.816155] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:38.010 [2024-10-07 11:33:31.816871] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:38.010 [2024-10-07 11:33:31.816899] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:38.010 [2024-10-07 11:33:31.816914] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:38.010 [2024-10-07 11:33:31.816930] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:38.010 [2024-10-07 11:33:31.816946] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:38.010 [2024-10-07 11:33:31.816958] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:38.010 [2024-10-07 11:33:31.820238] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:38.010 [2024-10-07 11:33:31.820295] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:38.010 [2024-10-07 11:33:31.825972] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:38.010 [2024-10-07 11:33:31.826025] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:38.010 [2024-10-07 11:33:31.826110] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:38.010 [2024-10-07 11:33:31.826139] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:38.010 [2024-10-07 11:33:31.826156] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:38.010 [2024-10-07 11:33:31.826203] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:38.010 [2024-10-07 11:33:31.826226] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:38.010 [2024-10-07 11:33:31.826241] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:38.010 [2024-10-07 11:33:31.826264] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:38.010 [2024-10-07 11:33:31.826284] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:38.010 [2024-10-07 11:33:31.826533] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:38.010 [2024-10-07 11:33:31.826559] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:38.010 [2024-10-07 11:33:31.826574] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:38.010 [2024-10-07 11:33:31.826590] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:38.010 [2024-10-07 11:33:31.826604] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:38.010 [2024-10-07 11:33:31.826618] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:38.010 [2024-10-07 11:33:31.826689] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:38.010 [2024-10-07 11:33:31.826712] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:38.010 [2024-10-07 11:33:31.836088] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:38.010 [2024-10-07 11:33:31.836169] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:38.010 [2024-10-07 11:33:31.836249] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:38.010 [2024-10-07 11:33:31.836278] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:38.010 [2024-10-07 11:33:31.836294] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:38.010 [2024-10-07 11:33:31.836349] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:38.010 [2024-10-07 11:33:31.836374] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:38.010 [2024-10-07 11:33:31.836389] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:38.010 [2024-10-07 11:33:31.836406] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:38.010 [2024-10-07 11:33:31.836429] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:38.010 [2024-10-07 11:33:31.836447] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:38.010 [2024-10-07 11:33:31.836476] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:38.010 [2024-10-07 11:33:31.836490] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:38.010 [2024-10-07 11:33:31.836514] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:38.010 [2024-10-07 11:33:31.836529] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:38.010 [2024-10-07 11:33:31.836542] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:38.010 [2024-10-07 11:33:31.836555] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:38.010 [2024-10-07 11:33:31.836575] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:38.010 [2024-10-07 11:33:31.849659] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:38.010 [2024-10-07 11:33:31.849708] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:38.010 [2024-10-07 11:33:31.850021] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:38.010 [2024-10-07 11:33:31.850064] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:38.010 [2024-10-07 11:33:31.850085] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:38.010 [2024-10-07 11:33:31.850136] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:38.010 [2024-10-07 11:33:31.850160] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:38.010 [2024-10-07 11:33:31.850175] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:38.010 [2024-10-07 11:33:31.850943] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:38.010 [2024-10-07 11:33:31.850985] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:38.010 [2024-10-07 11:33:31.851418] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:38.010 [2024-10-07 11:33:31.851467] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:38.010 [2024-10-07 11:33:31.851489] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:38.010 [2024-10-07 11:33:31.851507] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:38.010 [2024-10-07 11:33:31.851521] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:38.010 [2024-10-07 11:33:31.851534] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:38.010 [2024-10-07 11:33:31.851772] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:38.010 [2024-10-07 11:33:31.851798] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:38.010 [2024-10-07 11:33:31.860327] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:38.010 [2024-10-07 11:33:31.860376] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:38.010 [2024-10-07 11:33:31.860494] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:38.010 [2024-10-07 11:33:31.860525] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:38.010 [2024-10-07 11:33:31.860541] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:38.010 [2024-10-07 11:33:31.860608] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:38.010 [2024-10-07 11:33:31.860633] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:38.010 [2024-10-07 11:33:31.860662] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:38.010 [2024-10-07 11:33:31.862864] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:38.010 [2024-10-07 11:33:31.862920] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:38.010 [2024-10-07 11:33:31.863610] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:38.010 [2024-10-07 11:33:31.863658] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:38.010 [2024-10-07 11:33:31.863678] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:38.010 [2024-10-07 11:33:31.863696] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:38.010 [2024-10-07 11:33:31.863709] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:38.011 [2024-10-07 11:33:31.863723] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:38.011 [2024-10-07 11:33:31.863819] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:38.011 [2024-10-07 11:33:31.863840] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:38.011 [2024-10-07 11:33:31.870438] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:38.011 [2024-10-07 11:33:31.870508] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:38.011 [2024-10-07 11:33:31.870586] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:38.011 [2024-10-07 11:33:31.870614] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:38.011 [2024-10-07 11:33:31.870630] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:38.011 [2024-10-07 11:33:31.870701] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:38.011 [2024-10-07 11:33:31.870728] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:38.011 [2024-10-07 11:33:31.870744] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:38.011 [2024-10-07 11:33:31.870762] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:38.011 [2024-10-07 11:33:31.870785] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:38.011 [2024-10-07 11:33:31.870802] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:38.011 [2024-10-07 11:33:31.870816] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:38.011 [2024-10-07 11:33:31.870830] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:38.011 [2024-10-07 11:33:31.870852] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:38.011 [2024-10-07 11:33:31.870867] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:38.011 [2024-10-07 11:33:31.870880] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:38.011 [2024-10-07 11:33:31.870893] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:38.011 [2024-10-07 11:33:31.870913] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:38.011 [2024-10-07 11:33:31.883537] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:38.011 [2024-10-07 11:33:31.883586] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:38.011 [2024-10-07 11:33:31.884001] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:38.011 [2024-10-07 11:33:31.884045] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:38.011 [2024-10-07 11:33:31.884065] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:38.011 [2024-10-07 11:33:31.884118] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:38.011 [2024-10-07 11:33:31.884142] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:38.011 [2024-10-07 11:33:31.884157] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:38.011 [2024-10-07 11:33:31.884292] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:38.011 [2024-10-07 11:33:31.884320] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:38.011 [2024-10-07 11:33:31.884410] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:38.011 [2024-10-07 11:33:31.884430] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:38.011 [2024-10-07 11:33:31.884444] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:38.011 [2024-10-07 11:33:31.884461] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:38.011 [2024-10-07 11:33:31.884475] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:38.011 [2024-10-07 11:33:31.884488] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:38.011 [2024-10-07 11:33:31.884522] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:38.011 [2024-10-07 11:33:31.884537] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:38.011 [2024-10-07 11:33:31.898671] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:38.011 [2024-10-07 11:33:31.898735] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:38.011 [2024-10-07 11:33:31.898870] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:38.011 [2024-10-07 11:33:31.898902] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:38.011 [2024-10-07 11:33:31.898919] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:38.011 [2024-10-07 11:33:31.898966] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:38.011 [2024-10-07 11:33:31.898989] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:38.011 [2024-10-07 11:33:31.899004] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:38.011 [2024-10-07 11:33:31.899028] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:38.011 [2024-10-07 11:33:31.899047] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:38.011 [2024-10-07 11:33:31.899067] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:38.011 [2024-10-07 11:33:31.899082] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:38.011 [2024-10-07 11:33:31.899112] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:38.011 [2024-10-07 11:33:31.899130] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:38.011 [2024-10-07 11:33:31.899144] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:38.011 [2024-10-07 11:33:31.899157] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:38.011 [2024-10-07 11:33:31.899191] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:38.011 [2024-10-07 11:33:31.899209] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:38.011 8943.53 IOPS, 34.94 MiB/s 00:22:38.011 Latency(us) 00:22:38.011 [2024-10-07T11:33:33.534Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:22:38.011 Job: NVMe0n1 (Core Mask 0x1, workload: verify, depth: 128, IO size: 4096) 00:22:38.011 Verification LBA range: start 0x0 length 0x4000 00:22:38.011 NVMe0n1 : 15.01 8941.87 34.93 0.00 0.00 14282.61 860.16 23712.12 00:22:38.011 [2024-10-07T11:33:33.534Z] =================================================================================================================== 00:22:38.011 [2024-10-07T11:33:33.534Z] Total : 8941.87 34.93 0.00 0.00 14282.61 860.16 23712.12 00:22:38.011 [2024-10-07 11:33:31.910904] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:38.011 [2024-10-07 11:33:31.910953] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:38.011 [2024-10-07 11:33:31.911697] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:38.011 [2024-10-07 11:33:31.911739] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:38.011 [2024-10-07 11:33:31.911760] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:38.011 [2024-10-07 11:33:31.911810] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:38.011 [2024-10-07 11:33:31.911834] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:38.011 [2024-10-07 11:33:31.911849] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:38.011 [2024-10-07 11:33:31.911869] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:38.011 [2024-10-07 11:33:31.911888] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:38.011 [2024-10-07 11:33:31.911905] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:38.011 [2024-10-07 11:33:31.911919] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:38.011 [2024-10-07 11:33:31.911933] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:38.011 [2024-10-07 11:33:31.911949] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:38.011 [2024-10-07 11:33:31.911962] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:38.011 [2024-10-07 11:33:31.911975] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:38.011 [2024-10-07 11:33:31.911991] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:38.011 [2024-10-07 11:33:31.912004] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:38.011 [2024-10-07 11:33:31.920998] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:38.011 [2024-10-07 11:33:31.921068] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:38.011 [2024-10-07 11:33:31.921138] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:38.011 [2024-10-07 11:33:31.921166] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:38.012 [2024-10-07 11:33:31.921182] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:38.012 [2024-10-07 11:33:31.921231] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:38.012 [2024-10-07 11:33:31.921254] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:38.012 [2024-10-07 11:33:31.921269] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:38.012 [2024-10-07 11:33:31.921287] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:38.012 [2024-10-07 11:33:31.921307] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:38.012 [2024-10-07 11:33:31.921323] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:38.012 [2024-10-07 11:33:31.921337] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:38.012 [2024-10-07 11:33:31.921350] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:38.012 [2024-10-07 11:33:31.921367] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:38.012 [2024-10-07 11:33:31.921381] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:38.012 [2024-10-07 11:33:31.921394] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:38.012 [2024-10-07 11:33:31.921406] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:38.012 [2024-10-07 11:33:31.921420] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:38.012 [2024-10-07 11:33:31.931077] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:38.012 [2024-10-07 11:33:31.931166] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:38.012 [2024-10-07 11:33:31.931205] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:38.012 [2024-10-07 11:33:31.931223] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:38.012 [2024-10-07 11:33:31.931255] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:38.012 [2024-10-07 11:33:31.931278] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:38.012 [2024-10-07 11:33:31.931302] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:38.012 [2024-10-07 11:33:31.931317] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:38.012 [2024-10-07 11:33:31.931330] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:38.012 [2024-10-07 11:33:31.931345] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:38.012 [2024-10-07 11:33:31.931394] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:38.012 [2024-10-07 11:33:31.931419] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:38.012 [2024-10-07 11:33:31.931434] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:38.012 [2024-10-07 11:33:31.931468] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:38.012 [2024-10-07 11:33:31.931487] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:38.012 [2024-10-07 11:33:31.931507] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:38.012 [2024-10-07 11:33:31.931520] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:38.012 [2024-10-07 11:33:31.931536] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:38.012 [2024-10-07 11:33:31.941135] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:38.012 [2024-10-07 11:33:31.941236] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:38.012 [2024-10-07 11:33:31.941263] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:38.012 [2024-10-07 11:33:31.941279] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:38.012 [2024-10-07 11:33:31.941298] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:38.012 [2024-10-07 11:33:31.941321] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:38.012 [2024-10-07 11:33:31.941335] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:38.012 [2024-10-07 11:33:31.941348] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:38.012 [2024-10-07 11:33:31.941372] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:38.012 [2024-10-07 11:33:31.941392] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:38.012 [2024-10-07 11:33:31.941451] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:38.012 [2024-10-07 11:33:31.941477] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:38.012 [2024-10-07 11:33:31.941492] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:38.012 [2024-10-07 11:33:31.941511] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:38.012 [2024-10-07 11:33:31.941529] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:38.012 [2024-10-07 11:33:31.941542] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:38.012 [2024-10-07 11:33:31.941555] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:38.012 [2024-10-07 11:33:31.941572] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:38.012 [2024-10-07 11:33:31.951194] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:38.012 [2024-10-07 11:33:31.951294] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:38.012 [2024-10-07 11:33:31.951321] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b55930 with addr=10.0.0.3, port=4422 00:22:38.012 [2024-10-07 11:33:31.951337] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b55930 is same with the state(6) to be set 00:22:38.012 [2024-10-07 11:33:31.951356] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b55930 (9): Bad file descriptor 00:22:38.012 [2024-10-07 11:33:31.951377] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:38.012 [2024-10-07 11:33:31.951392] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:38.012 [2024-10-07 11:33:31.951419] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:38.012 [2024-10-07 11:33:31.951438] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:38.012 [2024-10-07 11:33:31.951463] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:38.012 [2024-10-07 11:33:31.951527] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:38.012 [2024-10-07 11:33:31.951553] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19aae40 with addr=10.0.0.3, port=4421 00:22:38.012 [2024-10-07 11:33:31.951568] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x19aae40 is same with the state(6) to be set 00:22:38.012 [2024-10-07 11:33:31.951587] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19aae40 (9): Bad file descriptor 00:22:38.012 [2024-10-07 11:33:31.951605] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:38.012 [2024-10-07 11:33:31.951619] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:38.012 [2024-10-07 11:33:31.951634] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:38.012 [2024-10-07 11:33:31.951669] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:38.012 Received shutdown signal, test time was about 15.000000 seconds 00:22:38.012 00:22:38.012 Latency(us) 00:22:38.012 [2024-10-07T11:33:33.535Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:22:38.012 [2024-10-07T11:33:33.535Z] =================================================================================================================== 00:22:38.012 [2024-10-07T11:33:33.535Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:22:38.012 11:33:32 nvmf_tcp.nvmf_host.nvmf_failover -- host/failover.sh@1 -- # rm -f /home/vagrant/spdk_repo/spdk/test/nvmf/host/try.txt 00:22:38.012 Process with pid 89088 is not found 00:22:38.012 11:33:32 nvmf_tcp.nvmf_host.nvmf_failover -- host/failover.sh@1 -- # killprocess 89088 00:22:38.012 11:33:32 nvmf_tcp.nvmf_host.nvmf_failover -- common/autotest_common.sh@950 -- # '[' -z 89088 ']' 00:22:38.012 11:33:32 nvmf_tcp.nvmf_host.nvmf_failover -- common/autotest_common.sh@954 -- # kill -0 89088 00:22:38.012 /home/vagrant/spdk_repo/spdk/test/common/autotest_common.sh: line 954: kill: (89088) - No such process 00:22:38.012 11:33:32 nvmf_tcp.nvmf_host.nvmf_failover -- common/autotest_common.sh@977 -- # echo 'Process with pid 89088 is not found' 00:22:38.012 11:33:32 nvmf_tcp.nvmf_host.nvmf_failover -- host/failover.sh@1 -- # nvmftestfini 00:22:38.012 11:33:32 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@514 -- # nvmfcleanup 00:22:38.012 11:33:32 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@121 -- # sync 00:22:38.012 11:33:32 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@123 -- # '[' tcp == tcp ']' 00:22:38.012 11:33:32 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@124 -- # set +e 00:22:38.012 11:33:32 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@125 -- # for i in {1..20} 00:22:38.012 11:33:32 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@126 -- # modprobe -v -r nvme-tcp 00:22:38.012 rmmod nvme_tcp 00:22:38.012 rmmod nvme_fabrics 00:22:38.012 rmmod nvme_keyring 00:22:38.012 11:33:32 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@127 -- # modprobe -v -r nvme-fabrics 00:22:38.012 11:33:32 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@128 -- # set -e 00:22:38.012 11:33:32 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@129 -- # return 0 00:22:38.012 11:33:32 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@515 -- # '[' -n 88975 ']' 00:22:38.012 11:33:32 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@516 -- # killprocess 88975 00:22:38.012 11:33:32 nvmf_tcp.nvmf_host.nvmf_failover -- common/autotest_common.sh@950 -- # '[' -z 88975 ']' 00:22:38.012 11:33:32 nvmf_tcp.nvmf_host.nvmf_failover -- common/autotest_common.sh@954 -- # kill -0 88975 00:22:38.012 11:33:32 nvmf_tcp.nvmf_host.nvmf_failover -- common/autotest_common.sh@955 -- # uname 00:22:38.012 11:33:32 nvmf_tcp.nvmf_host.nvmf_failover -- common/autotest_common.sh@955 -- # '[' Linux = Linux ']' 00:22:38.012 11:33:32 nvmf_tcp.nvmf_host.nvmf_failover -- common/autotest_common.sh@956 -- # ps --no-headers -o comm= 88975 00:22:38.012 killing process with pid 88975 00:22:38.012 11:33:32 nvmf_tcp.nvmf_host.nvmf_failover -- common/autotest_common.sh@956 -- # process_name=reactor_1 00:22:38.012 11:33:32 nvmf_tcp.nvmf_host.nvmf_failover -- common/autotest_common.sh@960 -- # '[' reactor_1 = sudo ']' 00:22:38.012 11:33:32 nvmf_tcp.nvmf_host.nvmf_failover -- common/autotest_common.sh@968 -- # echo 'killing process with pid 88975' 00:22:38.012 11:33:32 nvmf_tcp.nvmf_host.nvmf_failover -- common/autotest_common.sh@969 -- # kill 88975 00:22:38.012 11:33:32 nvmf_tcp.nvmf_host.nvmf_failover -- common/autotest_common.sh@974 -- # wait 88975 00:22:38.012 11:33:32 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@518 -- # '[' '' == iso ']' 00:22:38.013 11:33:32 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@521 -- # [[ tcp == \t\c\p ]] 00:22:38.013 11:33:32 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@522 -- # nvmf_tcp_fini 00:22:38.013 11:33:32 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@297 -- # iptr 00:22:38.013 11:33:32 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@789 -- # iptables-save 00:22:38.013 11:33:32 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@789 -- # grep -v SPDK_NVMF 00:22:38.013 11:33:32 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@789 -- # iptables-restore 00:22:38.013 11:33:32 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@298 -- # [[ nvmf_tgt_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s\_\s\p\d\k ]] 00:22:38.013 11:33:32 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@299 -- # nvmf_veth_fini 00:22:38.013 11:33:32 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@233 -- # ip link set nvmf_init_br nomaster 00:22:38.013 11:33:32 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@234 -- # ip link set nvmf_init_br2 nomaster 00:22:38.013 11:33:32 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@235 -- # ip link set nvmf_tgt_br nomaster 00:22:38.013 11:33:32 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@236 -- # ip link set nvmf_tgt_br2 nomaster 00:22:38.013 11:33:32 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@237 -- # ip link set nvmf_init_br down 00:22:38.013 11:33:32 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@238 -- # ip link set nvmf_init_br2 down 00:22:38.013 11:33:32 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@239 -- # ip link set nvmf_tgt_br down 00:22:38.013 11:33:32 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@240 -- # ip link set nvmf_tgt_br2 down 00:22:38.013 11:33:32 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@241 -- # ip link delete nvmf_br type bridge 00:22:38.013 11:33:32 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@242 -- # ip link delete nvmf_init_if 00:22:38.013 11:33:32 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@243 -- # ip link delete nvmf_init_if2 00:22:38.013 11:33:33 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@244 -- # ip netns exec nvmf_tgt_ns_spdk ip link delete nvmf_tgt_if 00:22:38.013 11:33:33 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@245 -- # ip netns exec nvmf_tgt_ns_spdk ip link delete nvmf_tgt_if2 00:22:38.013 11:33:33 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@246 -- # remove_spdk_ns 00:22:38.013 11:33:33 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@654 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:22:38.013 11:33:33 nvmf_tcp.nvmf_host.nvmf_failover -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 15> /dev/null' 00:22:38.013 11:33:33 nvmf_tcp.nvmf_host.nvmf_failover -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:22:38.013 11:33:33 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@300 -- # return 0 00:22:38.013 11:33:33 nvmf_tcp.nvmf_host.nvmf_failover -- host/failover.sh@1 -- # exit 1 00:22:38.013 11:33:33 nvmf_tcp.nvmf_host.nvmf_failover -- common/autotest_common.sh@1125 -- # trap - ERR 00:22:38.013 11:33:33 nvmf_tcp.nvmf_host.nvmf_failover -- common/autotest_common.sh@1125 -- # print_backtrace 00:22:38.013 11:33:33 nvmf_tcp.nvmf_host.nvmf_failover -- common/autotest_common.sh@1153 -- # [[ ehxBET =~ e ]] 00:22:38.013 11:33:33 nvmf_tcp.nvmf_host.nvmf_failover -- common/autotest_common.sh@1155 -- # args=('--transport=tcp' '/home/vagrant/spdk_repo/spdk/test/nvmf/host/failover.sh' 'nvmf_failover' '--transport=tcp') 00:22:38.013 11:33:33 nvmf_tcp.nvmf_host.nvmf_failover -- common/autotest_common.sh@1155 -- # local args 00:22:38.013 11:33:33 nvmf_tcp.nvmf_host.nvmf_failover -- common/autotest_common.sh@1157 -- # xtrace_disable 00:22:38.013 11:33:33 nvmf_tcp.nvmf_host.nvmf_failover -- common/autotest_common.sh@10 -- # set +x 00:22:38.013 ========== Backtrace start: ========== 00:22:38.013 00:22:38.013 in /home/vagrant/spdk_repo/spdk/test/common/autotest_common.sh:1125 -> run_test(["nvmf_failover"],["/home/vagrant/spdk_repo/spdk/test/nvmf/host/failover.sh"],["--transport=tcp"]) 00:22:38.013 ... 00:22:38.013 1120 timing_enter $test_name 00:22:38.013 1121 echo "************************************" 00:22:38.013 1122 echo "START TEST $test_name" 00:22:38.013 1123 echo "************************************" 00:22:38.013 1124 xtrace_restore 00:22:38.013 1125 time "$@" 00:22:38.013 1126 xtrace_disable 00:22:38.013 1127 echo "************************************" 00:22:38.013 1128 echo "END TEST $test_name" 00:22:38.013 1129 echo "************************************" 00:22:38.013 1130 timing_exit $test_name 00:22:38.013 ... 00:22:38.013 in /home/vagrant/spdk_repo/spdk/test/nvmf/nvmf_host.sh:25 -> main(["--transport=tcp"]) 00:22:38.013 ... 00:22:38.013 20 fi 00:22:38.013 21 00:22:38.013 22 run_test "nvmf_identify" $rootdir/test/nvmf/host/identify.sh "${TEST_ARGS[@]}" 00:22:38.013 23 run_test "nvmf_perf" $rootdir/test/nvmf/host/perf.sh "${TEST_ARGS[@]}" 00:22:38.013 24 run_test "nvmf_fio_host" $rootdir/test/nvmf/host/fio.sh "${TEST_ARGS[@]}" 00:22:38.013 => 25 run_test "nvmf_failover" $rootdir/test/nvmf/host/failover.sh "${TEST_ARGS[@]}" 00:22:38.013 26 run_test "nvmf_host_discovery" $rootdir/test/nvmf/host/discovery.sh "${TEST_ARGS[@]}" 00:22:38.013 27 run_test "nvmf_host_multipath_status" $rootdir/test/nvmf/host/multipath_status.sh "${TEST_ARGS[@]}" 00:22:38.013 28 run_test "nvmf_discovery_remove_ifc" $rootdir/test/nvmf/host/discovery_remove_ifc.sh "${TEST_ARGS[@]}" 00:22:38.013 29 run_test "nvmf_identify_kernel_target" "$rootdir/test/nvmf/host/identify_kernel_nvmf.sh" "${TEST_ARGS[@]}" 00:22:38.013 30 run_test "nvmf_auth_host" "$rootdir/test/nvmf/host/auth.sh" "${TEST_ARGS[@]}" 00:22:38.013 ... 00:22:38.013 00:22:38.013 ========== Backtrace end ========== 00:22:38.013 11:33:33 nvmf_tcp.nvmf_host.nvmf_failover -- common/autotest_common.sh@1194 -- # return 0 00:22:38.013 00:22:38.013 real 0m21.936s 00:22:38.013 user 1m20.304s 00:22:38.013 sys 0m4.123s 00:22:38.013 11:33:33 nvmf_tcp.nvmf_host.nvmf_failover -- common/autotest_common.sh@1 -- # exit 1 00:22:38.013 11:33:33 nvmf_tcp.nvmf_host -- common/autotest_common.sh@1125 -- # trap - ERR 00:22:38.013 11:33:33 nvmf_tcp.nvmf_host -- common/autotest_common.sh@1125 -- # print_backtrace 00:22:38.013 11:33:33 nvmf_tcp.nvmf_host -- common/autotest_common.sh@1153 -- # [[ ehxBET =~ e ]] 00:22:38.013 11:33:33 nvmf_tcp.nvmf_host -- common/autotest_common.sh@1155 -- # args=('--transport=tcp' '/home/vagrant/spdk_repo/spdk/test/nvmf/nvmf_host.sh' 'nvmf_host' '--transport=tcp') 00:22:38.013 11:33:33 nvmf_tcp.nvmf_host -- common/autotest_common.sh@1155 -- # local args 00:22:38.013 11:33:33 nvmf_tcp.nvmf_host -- common/autotest_common.sh@1157 -- # xtrace_disable 00:22:38.013 11:33:33 nvmf_tcp.nvmf_host -- common/autotest_common.sh@10 -- # set +x 00:22:38.013 ========== Backtrace start: ========== 00:22:38.013 00:22:38.013 in /home/vagrant/spdk_repo/spdk/test/common/autotest_common.sh:1125 -> run_test(["nvmf_host"],["/home/vagrant/spdk_repo/spdk/test/nvmf/nvmf_host.sh"],["--transport=tcp"]) 00:22:38.013 ... 00:22:38.013 1120 timing_enter $test_name 00:22:38.013 1121 echo "************************************" 00:22:38.013 1122 echo "START TEST $test_name" 00:22:38.013 1123 echo "************************************" 00:22:38.013 1124 xtrace_restore 00:22:38.013 1125 time "$@" 00:22:38.013 1126 xtrace_disable 00:22:38.013 1127 echo "************************************" 00:22:38.013 1128 echo "END TEST $test_name" 00:22:38.013 1129 echo "************************************" 00:22:38.013 1130 timing_exit $test_name 00:22:38.013 ... 00:22:38.272 in /home/vagrant/spdk_repo/spdk/test/nvmf/nvmf.sh:16 -> main(["--transport=tcp"]) 00:22:38.272 ... 00:22:38.272 11 exit 0 00:22:38.272 12 fi 00:22:38.272 13 00:22:38.272 14 run_test "nvmf_target_core" $rootdir/test/nvmf/nvmf_target_core.sh --transport=$SPDK_TEST_NVMF_TRANSPORT 00:22:38.272 15 run_test "nvmf_target_extra" $rootdir/test/nvmf/nvmf_target_extra.sh --transport=$SPDK_TEST_NVMF_TRANSPORT 00:22:38.272 => 16 run_test "nvmf_host" $rootdir/test/nvmf/nvmf_host.sh --transport=$SPDK_TEST_NVMF_TRANSPORT 00:22:38.272 17 00:22:38.272 18 # Interrupt mode for now is supported only on the target, with the TCP transport and posix or ssl socket implementations. 00:22:38.272 19 if [[ "$SPDK_TEST_NVMF_TRANSPORT" = "tcp" && $SPDK_TEST_URING -eq 0 ]]; then 00:22:38.272 20 run_test "nvmf_target_core_interrupt_mode" $rootdir/test/nvmf/nvmf_target_core.sh --transport=$SPDK_TEST_NVMF_TRANSPORT --interrupt-mode 00:22:38.272 21 run_test "nvmf_interrupt" $rootdir/test/nvmf/target/interrupt.sh --transport=$SPDK_TEST_NVMF_TRANSPORT --interrupt-mode 00:22:38.272 ... 00:22:38.272 00:22:38.272 ========== Backtrace end ========== 00:22:38.272 11:33:33 nvmf_tcp.nvmf_host -- common/autotest_common.sh@1194 -- # return 0 00:22:38.272 00:22:38.272 real 1m5.305s 00:22:38.272 user 3m38.573s 00:22:38.272 sys 0m14.900s 00:22:38.272 11:33:33 nvmf_tcp -- common/autotest_common.sh@1125 -- # trap - ERR 00:22:38.272 11:33:33 nvmf_tcp -- common/autotest_common.sh@1125 -- # print_backtrace 00:22:38.272 11:33:33 nvmf_tcp -- common/autotest_common.sh@1153 -- # [[ ehxBET =~ e ]] 00:22:38.272 11:33:33 nvmf_tcp -- common/autotest_common.sh@1155 -- # args=('--transport=tcp' '/home/vagrant/spdk_repo/spdk/test/nvmf/nvmf.sh' 'nvmf_tcp' '/home/vagrant/spdk_repo/autorun-spdk.conf') 00:22:38.272 11:33:33 nvmf_tcp -- common/autotest_common.sh@1155 -- # local args 00:22:38.272 11:33:33 nvmf_tcp -- common/autotest_common.sh@1157 -- # xtrace_disable 00:22:38.272 11:33:33 nvmf_tcp -- common/autotest_common.sh@10 -- # set +x 00:22:38.272 ========== Backtrace start: ========== 00:22:38.272 00:22:38.272 in /home/vagrant/spdk_repo/spdk/test/common/autotest_common.sh:1125 -> run_test(["nvmf_tcp"],["/home/vagrant/spdk_repo/spdk/test/nvmf/nvmf.sh"],["--transport=tcp"]) 00:22:38.272 ... 00:22:38.272 1120 timing_enter $test_name 00:22:38.272 1121 echo "************************************" 00:22:38.272 1122 echo "START TEST $test_name" 00:22:38.272 1123 echo "************************************" 00:22:38.272 1124 xtrace_restore 00:22:38.272 1125 time "$@" 00:22:38.272 1126 xtrace_disable 00:22:38.272 1127 echo "************************************" 00:22:38.272 1128 echo "END TEST $test_name" 00:22:38.272 1129 echo "************************************" 00:22:38.272 1130 timing_exit $test_name 00:22:38.272 ... 00:22:38.272 in /home/vagrant/spdk_repo/spdk/autotest.sh:280 -> main(["/home/vagrant/spdk_repo/autorun-spdk.conf"]) 00:22:38.272 ... 00:22:38.272 275 # list of all tests can properly differentiate them. Please do not merge them into one line. 00:22:38.272 276 if [ "$SPDK_TEST_NVMF_TRANSPORT" = "rdma" ]; then 00:22:38.272 277 run_test "nvmf_rdma" $rootdir/test/nvmf/nvmf.sh --transport=$SPDK_TEST_NVMF_TRANSPORT 00:22:38.272 278 run_test "spdkcli_nvmf_rdma" $rootdir/test/spdkcli/nvmf.sh --transport=$SPDK_TEST_NVMF_TRANSPORT 00:22:38.272 279 elif [ "$SPDK_TEST_NVMF_TRANSPORT" = "tcp" ]; then 00:22:38.272 => 280 run_test "nvmf_tcp" $rootdir/test/nvmf/nvmf.sh --transport=$SPDK_TEST_NVMF_TRANSPORT 00:22:38.272 281 if [[ $SPDK_TEST_URING -eq 0 ]]; then 00:22:38.272 282 run_test "spdkcli_nvmf_tcp" $rootdir/test/spdkcli/nvmf.sh --transport=$SPDK_TEST_NVMF_TRANSPORT 00:22:38.272 283 run_test "nvmf_identify_passthru" $rootdir/test/nvmf/target/identify_passthru.sh --transport=$SPDK_TEST_NVMF_TRANSPORT 00:22:38.272 284 fi 00:22:38.272 285 run_test "nvmf_dif" $rootdir/test/nvmf/target/dif.sh 00:22:38.272 ... 00:22:38.272 00:22:38.272 ========== Backtrace end ========== 00:22:38.272 11:33:33 nvmf_tcp -- common/autotest_common.sh@1194 -- # return 0 00:22:38.272 00:22:38.272 real 12m32.435s 00:22:38.272 user 33m59.614s 00:22:38.272 sys 2m48.106s 00:22:38.272 11:33:33 nvmf_tcp -- common/autotest_common.sh@1 -- # autotest_cleanup 00:22:38.272 11:33:33 nvmf_tcp -- common/autotest_common.sh@1392 -- # local autotest_es=1 00:22:38.272 11:33:33 nvmf_tcp -- common/autotest_common.sh@1393 -- # xtrace_disable 00:22:38.272 11:33:33 nvmf_tcp -- common/autotest_common.sh@10 -- # set +x 00:22:50.466 INFO: APP EXITING 00:22:50.466 INFO: killing all VMs 00:22:50.466 INFO: killing vhost app 00:22:50.466 INFO: EXIT DONE 00:22:50.466 0000:00:03.0 (1af4 1001): Active devices: mount@vda:vda2,mount@vda:vda3,mount@vda:vda5, so not binding PCI dev 00:22:50.466 Waiting for block devices as requested 00:22:50.466 0000:00:11.0 (1b36 0010): uio_pci_generic -> nvme 00:22:50.466 0000:00:10.0 (1b36 0010): uio_pci_generic -> nvme 00:22:50.724 0000:00:03.0 (1af4 1001): Active devices: mount@vda:vda2,mount@vda:vda3,mount@vda:vda5, so not binding PCI dev 00:22:50.724 Cleaning 00:22:50.724 Removing: /var/run/dpdk/spdk0/config 00:22:50.724 Removing: /var/run/dpdk/spdk0/fbarray_memseg-2048k-0-0 00:22:50.724 Removing: /var/run/dpdk/spdk0/fbarray_memseg-2048k-0-1 00:22:50.724 Removing: /var/run/dpdk/spdk0/fbarray_memseg-2048k-0-2 00:22:50.724 Removing: /var/run/dpdk/spdk0/fbarray_memseg-2048k-0-3 00:22:50.724 Removing: /var/run/dpdk/spdk0/fbarray_memzone 00:22:50.724 Removing: /var/run/dpdk/spdk0/hugepage_info 00:22:50.724 Removing: /var/run/dpdk/spdk1/config 00:22:50.724 Removing: /var/run/dpdk/spdk1/fbarray_memseg-2048k-0-0 00:22:50.724 Removing: /var/run/dpdk/spdk1/fbarray_memseg-2048k-0-1 00:22:50.724 Removing: /var/run/dpdk/spdk1/fbarray_memseg-2048k-0-2 00:22:50.724 Removing: /var/run/dpdk/spdk1/fbarray_memseg-2048k-0-3 00:22:50.724 Removing: /var/run/dpdk/spdk1/fbarray_memzone 00:22:50.724 Removing: /var/run/dpdk/spdk1/hugepage_info 00:22:50.724 Removing: /var/run/dpdk/spdk2/config 00:22:50.724 Removing: /var/run/dpdk/spdk2/fbarray_memseg-2048k-0-0 00:22:50.724 Removing: /var/run/dpdk/spdk2/fbarray_memseg-2048k-0-1 00:22:50.724 Removing: /var/run/dpdk/spdk2/fbarray_memseg-2048k-0-2 00:22:50.724 Removing: /var/run/dpdk/spdk2/fbarray_memseg-2048k-0-3 00:22:50.724 Removing: /var/run/dpdk/spdk2/fbarray_memzone 00:22:50.724 Removing: /var/run/dpdk/spdk2/hugepage_info 00:22:50.724 Removing: /var/run/dpdk/spdk3/config 00:22:50.724 Removing: /var/run/dpdk/spdk3/fbarray_memseg-2048k-0-0 00:22:50.724 Removing: /var/run/dpdk/spdk3/fbarray_memseg-2048k-0-1 00:22:50.724 Removing: /var/run/dpdk/spdk3/fbarray_memseg-2048k-0-2 00:22:50.724 Removing: /var/run/dpdk/spdk3/fbarray_memseg-2048k-0-3 00:22:50.724 Removing: /var/run/dpdk/spdk3/fbarray_memzone 00:22:50.724 Removing: /var/run/dpdk/spdk3/hugepage_info 00:22:50.724 Removing: /var/run/dpdk/spdk4/config 00:22:50.724 Removing: /var/run/dpdk/spdk4/fbarray_memseg-2048k-0-0 00:22:50.724 Removing: /var/run/dpdk/spdk4/fbarray_memseg-2048k-0-1 00:22:50.724 Removing: /var/run/dpdk/spdk4/fbarray_memseg-2048k-0-2 00:22:50.724 Removing: /var/run/dpdk/spdk4/fbarray_memseg-2048k-0-3 00:22:50.724 Removing: /var/run/dpdk/spdk4/fbarray_memzone 00:22:50.724 Removing: /var/run/dpdk/spdk4/hugepage_info 00:22:50.724 Removing: /dev/shm/nvmf_trace.0 00:22:50.724 Removing: /dev/shm/spdk_tgt_trace.pid58619 00:22:50.724 Removing: /var/run/dpdk/spdk0 00:22:50.724 Removing: /var/run/dpdk/spdk1 00:22:50.724 Removing: /var/run/dpdk/spdk2 00:22:50.724 Removing: /var/run/dpdk/spdk3 00:22:50.724 Removing: /var/run/dpdk/spdk4 00:22:50.724 Removing: /var/run/dpdk/spdk_pid58466 00:22:50.724 Removing: /var/run/dpdk/spdk_pid58619 00:22:50.724 Removing: /var/run/dpdk/spdk_pid58880 00:22:50.724 Removing: /var/run/dpdk/spdk_pid58973 00:22:50.724 Removing: /var/run/dpdk/spdk_pid59012 00:22:50.724 Removing: /var/run/dpdk/spdk_pid59122 00:22:50.724 Removing: /var/run/dpdk/spdk_pid59152 00:22:50.724 Removing: /var/run/dpdk/spdk_pid59291 00:22:50.724 Removing: /var/run/dpdk/spdk_pid59576 00:22:50.724 Removing: /var/run/dpdk/spdk_pid59760 00:22:50.983 Removing: /var/run/dpdk/spdk_pid59845 00:22:50.983 Removing: /var/run/dpdk/spdk_pid59945 00:22:50.983 Removing: /var/run/dpdk/spdk_pid60048 00:22:50.983 Removing: /var/run/dpdk/spdk_pid60092 00:22:50.983 Removing: /var/run/dpdk/spdk_pid60122 00:22:50.983 Removing: /var/run/dpdk/spdk_pid60196 00:22:50.983 Removing: /var/run/dpdk/spdk_pid60320 00:22:50.983 Removing: /var/run/dpdk/spdk_pid60974 00:22:50.983 Removing: /var/run/dpdk/spdk_pid61033 00:22:50.983 Removing: /var/run/dpdk/spdk_pid61102 00:22:50.983 Removing: /var/run/dpdk/spdk_pid61136 00:22:50.983 Removing: /var/run/dpdk/spdk_pid61215 00:22:50.983 Removing: /var/run/dpdk/spdk_pid61243 00:22:50.983 Removing: /var/run/dpdk/spdk_pid61327 00:22:50.983 Removing: /var/run/dpdk/spdk_pid61355 00:22:50.983 Removing: /var/run/dpdk/spdk_pid61407 00:22:50.983 Removing: /var/run/dpdk/spdk_pid61437 00:22:50.983 Removing: /var/run/dpdk/spdk_pid61483 00:22:50.983 Removing: /var/run/dpdk/spdk_pid61513 00:22:50.983 Removing: /var/run/dpdk/spdk_pid61675 00:22:50.983 Removing: /var/run/dpdk/spdk_pid61718 00:22:50.983 Removing: /var/run/dpdk/spdk_pid61795 00:22:50.983 Removing: /var/run/dpdk/spdk_pid62292 00:22:50.983 Removing: /var/run/dpdk/spdk_pid62705 00:22:50.983 Removing: /var/run/dpdk/spdk_pid65201 00:22:50.983 Removing: /var/run/dpdk/spdk_pid65251 00:22:50.983 Removing: /var/run/dpdk/spdk_pid65609 00:22:50.983 Removing: /var/run/dpdk/spdk_pid65659 00:22:50.983 Removing: /var/run/dpdk/spdk_pid66098 00:22:50.983 Removing: /var/run/dpdk/spdk_pid66686 00:22:50.983 Removing: /var/run/dpdk/spdk_pid67147 00:22:50.983 Removing: /var/run/dpdk/spdk_pid68250 00:22:50.983 Removing: /var/run/dpdk/spdk_pid69394 00:22:50.983 Removing: /var/run/dpdk/spdk_pid69512 00:22:50.983 Removing: /var/run/dpdk/spdk_pid69580 00:22:50.983 Removing: /var/run/dpdk/spdk_pid71230 00:22:50.983 Removing: /var/run/dpdk/spdk_pid71583 00:22:50.983 Removing: /var/run/dpdk/spdk_pid75516 00:22:50.983 Removing: /var/run/dpdk/spdk_pid75945 00:22:50.983 Removing: /var/run/dpdk/spdk_pid76597 00:22:50.983 Removing: /var/run/dpdk/spdk_pid77062 00:22:50.983 Removing: /var/run/dpdk/spdk_pid82988 00:22:50.983 Removing: /var/run/dpdk/spdk_pid83498 00:22:50.983 Removing: /var/run/dpdk/spdk_pid83607 00:22:50.983 Removing: /var/run/dpdk/spdk_pid83766 00:22:50.983 Removing: /var/run/dpdk/spdk_pid83825 00:22:50.983 Removing: /var/run/dpdk/spdk_pid83883 00:22:50.983 Removing: /var/run/dpdk/spdk_pid83942 00:22:50.983 Removing: /var/run/dpdk/spdk_pid84135 00:22:50.983 Removing: /var/run/dpdk/spdk_pid84303 00:22:50.983 Removing: /var/run/dpdk/spdk_pid84612 00:22:50.983 Removing: /var/run/dpdk/spdk_pid84747 00:22:50.983 Removing: /var/run/dpdk/spdk_pid85012 00:22:50.983 Removing: /var/run/dpdk/spdk_pid85125 00:22:50.983 Removing: /var/run/dpdk/spdk_pid85260 00:22:50.983 Removing: /var/run/dpdk/spdk_pid85672 00:22:50.983 Removing: /var/run/dpdk/spdk_pid86132 00:22:50.983 Removing: /var/run/dpdk/spdk_pid86133 00:22:50.983 Removing: /var/run/dpdk/spdk_pid86134 00:22:50.983 Removing: /var/run/dpdk/spdk_pid86429 00:22:50.983 Removing: /var/run/dpdk/spdk_pid86773 00:22:50.983 Removing: /var/run/dpdk/spdk_pid87142 00:22:50.983 Removing: /var/run/dpdk/spdk_pid87754 00:22:50.983 Removing: /var/run/dpdk/spdk_pid87766 00:22:50.983 Removing: /var/run/dpdk/spdk_pid88165 00:22:50.983 Removing: /var/run/dpdk/spdk_pid88183 00:22:50.983 Removing: /var/run/dpdk/spdk_pid88197 00:22:50.983 Removing: /var/run/dpdk/spdk_pid88230 00:22:50.983 Removing: /var/run/dpdk/spdk_pid88236 00:22:50.983 Removing: /var/run/dpdk/spdk_pid88647 00:22:50.983 Removing: /var/run/dpdk/spdk_pid88690 00:22:50.983 Removing: /var/run/dpdk/spdk_pid89088 00:22:50.983 Clean 00:22:57.544 11:33:52 nvmf_tcp -- common/autotest_common.sh@1451 -- # return 1 00:22:57.544 11:33:52 nvmf_tcp -- common/autotest_common.sh@1 -- # : 00:22:57.544 11:33:52 nvmf_tcp -- common/autotest_common.sh@1 -- # exit 1 00:22:58.490 [Pipeline] } 00:22:58.506 [Pipeline] // timeout 00:22:58.513 [Pipeline] } 00:22:58.529 [Pipeline] // stage 00:22:58.537 [Pipeline] } 00:22:58.540 ERROR: script returned exit code 1 00:22:58.540 Setting overall build result to FAILURE 00:22:58.554 [Pipeline] // catchError 00:22:58.563 [Pipeline] stage 00:22:58.565 [Pipeline] { (Stop VM) 00:22:58.578 [Pipeline] sh 00:22:58.859 + vagrant halt 00:23:03.056 ==> default: Halting domain... 00:23:08.328 [Pipeline] sh 00:23:08.604 + vagrant destroy -f 00:23:11.885 ==> default: Removing domain... 00:23:12.154 [Pipeline] sh 00:23:12.432 + mv output /var/jenkins/workspace/nvmf-tcp-vg-autotest_4/output 00:23:12.440 [Pipeline] } 00:23:12.454 [Pipeline] // stage 00:23:12.460 [Pipeline] } 00:23:12.475 [Pipeline] // dir 00:23:12.480 [Pipeline] } 00:23:12.492 [Pipeline] // wrap 00:23:12.498 [Pipeline] } 00:23:12.507 [Pipeline] // catchError 00:23:12.514 [Pipeline] stage 00:23:12.515 [Pipeline] { (Epilogue) 00:23:12.525 [Pipeline] sh 00:23:12.798 + jbp/jenkins/jjb-config/jobs/scripts/compress_artifacts.sh 00:23:14.711 [Pipeline] catchError 00:23:14.712 [Pipeline] { 00:23:14.724 [Pipeline] sh 00:23:15.003 + jbp/jenkins/jjb-config/jobs/scripts/check_artifacts_size.sh 00:23:15.262 Artifacts sizes are good 00:23:15.270 [Pipeline] } 00:23:15.284 [Pipeline] // catchError 00:23:15.293 [Pipeline] archiveArtifacts 00:23:15.299 Archiving artifacts 00:23:15.555 [Pipeline] cleanWs 00:23:15.566 [WS-CLEANUP] Deleting project workspace... 00:23:15.566 [WS-CLEANUP] Deferred wipeout is used... 00:23:15.572 [WS-CLEANUP] done 00:23:15.574 [Pipeline] } 00:23:15.588 [Pipeline] // stage 00:23:15.593 [Pipeline] } 00:23:15.607 [Pipeline] // node 00:23:15.612 [Pipeline] End of Pipeline 00:23:15.656 Finished: FAILURE